-- Logs begin at Sat 2022-03-12 20:01:16 UTC, end at Sat 2022-03-12 22:10:20 UTC. -- Mar 12 20:37:19.596561 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Mar 12 20:37:19.604002 ncdv-master-1 devstack@n-api.service[120632]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Mar 12 20:37:19 2022] *** Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: nodename: ncdv-master-1 Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: machine: x86_64 Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: clock source: unix Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: pcre jit disabled Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: detected number of CPU cores: 4 Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: current working directory: / Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: detected binary path: /usr/bin/uwsgi-core Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: your processes number limit is 47680 Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: your memory page size is 4096 bytes Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: detected max file descriptor number: 2048 Mar 12 20:37:19.607313 ncdv-master-1 devstack@n-api.service[120632]: lock engine: pthread robust mutexes Mar 12 20:37:19.609974 ncdv-master-1 devstack@n-api.service[120632]: thunder lock: enabled Mar 12 20:37:19.609974 ncdv-master-1 devstack@n-api.service[120632]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 12 20:37:19.609974 ncdv-master-1 devstack@n-api.service[120632]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 12 20:37:19.656687 ncdv-master-1 devstack@n-api.service[120632]: Python main interpreter initialized at 0x5649535d39c0 Mar 12 20:37:19.656687 ncdv-master-1 devstack@n-api.service[120632]: python threads support enabled Mar 12 20:37:19.656687 ncdv-master-1 devstack@n-api.service[120632]: your server socket listen backlog is limited to 100 connections Mar 12 20:37:19.656687 ncdv-master-1 devstack@n-api.service[120632]: your mercy for graceful operations on workers is 90 seconds Mar 12 20:37:19.657050 ncdv-master-1 devstack@n-api.service[120632]: mapped 403077 bytes (393 KB) for 2 cores Mar 12 20:37:19.657126 ncdv-master-1 devstack@n-api.service[120632]: *** Operational MODE: preforking *** Mar 12 20:37:19.657346 ncdv-master-1 devstack@n-api.service[120632]: *** uWSGI is running in multiple interpreter mode *** Mar 12 20:37:19.657346 ncdv-master-1 devstack@n-api.service[120632]: spawned uWSGI master process (pid: 120632) Mar 12 20:37:19.657550 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Mar 12 20:37:19.663305 ncdv-master-1 devstack@n-api.service[120632]: spawned uWSGI worker 1 (pid: 120633, cores: 1) Mar 12 20:37:19.663305 ncdv-master-1 devstack@n-api.service[120632]: spawned uWSGI worker 2 (pid: 120634, cores: 1) Mar 12 20:37:19.663305 ncdv-master-1 devstack@n-api.service[120632]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 12 20:37:20.894846 ncdv-master-1 devstack@n-api.service[120633]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 12 20:37:20.900193 ncdv-master-1 devstack@n-api.service[120634]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 12 20:37:21.744523 ncdv-master-1 devstack@n-api.service[120634]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 12 20:37:21.744523 ncdv-master-1 devstack@n-api.service[120634]: from cryptography.utils import int_from_bytes Mar 12 20:37:21.744797 ncdv-master-1 devstack@n-api.service[120633]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 12 20:37:21.744797 ncdv-master-1 devstack@n-api.service[120633]: from cryptography.utils import int_from_bytes Mar 12 20:37:21.744918 ncdv-master-1 devstack@n-api.service[120634]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 12 20:37:21.744918 ncdv-master-1 devstack@n-api.service[120634]: from cryptography.utils import int_from_bytes Mar 12 20:37:21.745028 ncdv-master-1 devstack@n-api.service[120633]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 12 20:37:21.745028 ncdv-master-1 devstack@n-api.service[120633]: from cryptography.utils import int_from_bytes Mar 12 20:37:24.263460 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 12 20:37:24.263994 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 12 20:37:24.264221 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 12 20:37:24.264587 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 12 20:37:24.264845 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 12 20:37:24.265004 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 12 20:37:24.265361 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.265450 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 12 20:37:24.265535 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.265908 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 12 20:37:24.266018 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.266155 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 12 20:37:24.266251 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.266415 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 12 20:37:24.266521 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.266798 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.266912 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.267119 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.267213 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.267434 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.267532 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.267755 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.267850 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.268014 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.268107 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.268332 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.268419 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.268657 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.268744 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.268984 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.269070 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.269294 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.269380 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.269551 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.269646 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.269888 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.269979 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.270214 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.270307 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.270534 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.270620 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.270840 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.270926 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.271146 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.271336 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.271462 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.272466 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.272609 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.272609 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.272845 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.272845 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.273077 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.273077 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.273318 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.273464 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.273595 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.273726 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.273867 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.273994 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.274130 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.274257 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.274379 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.274498 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.274628 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.274758 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.274896 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.275010 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.275119 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.275243 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.275398 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.275533 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.275717 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.275852 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.276024 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.276234 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.276433 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.276571 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.277328 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.277454 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.277592 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.277718 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.277878 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.278004 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.278298 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.278440 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.278600 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.278730 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.278903 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.279041 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.279219 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.279355 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.279540 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.279669 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.279842 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.279982 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.280151 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.280280 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.280462 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.280590 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.280777 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.280904 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.281081 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.281214 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.281383 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.281517 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.281650 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.281793 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.281949 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.282090 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.282274 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.282403 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.282598 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.282734 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.282898 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.283027 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.283154 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.283285 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.283418 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.283548 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.283698 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.283826 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.284020 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.284159 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.284330 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.284457 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.284582 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.284704 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.284836 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.284961 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.285120 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.285249 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.285438 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.285567 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.285743 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.285891 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.286073 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.286202 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.286377 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.286503 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.286681 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.286809 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.286983 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.287117 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.287285 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.287420 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.287585 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.287712 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.287885 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.288011 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.288206 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.288360 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.288557 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.288684 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.288814 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.288937 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.289108 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.289249 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.289423 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.289550 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.289751 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.289910 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.290090 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.290231 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.290393 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.290520 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.290707 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.290839 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.291013 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.291153 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.291318 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.291445 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.291631 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.291757 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.291950 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.292080 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.292272 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.292937 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.293107 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.293242 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.293415 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.293545 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.293722 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.293892 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.294072 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.294200 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.294376 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.294505 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.294627 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.294751 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.294909 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.295043 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.295211 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.295347 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.295529 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.295702 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.295828 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.295960 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.296123 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.296262 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.296426 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.296561 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.296724 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.296865 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.297027 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.297160 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.297327 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.297454 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.297629 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.297792 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.297961 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.298088 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.298265 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.298397 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.298601 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.298747 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.298880 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.299004 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.299136 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.299259 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.299440 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.299581 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.299760 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.299898 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.300078 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.300205 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.300384 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.300519 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.300685 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.300811 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.300988 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.301130 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.301291 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.301496 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.301631 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.301754 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.301946 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.302069 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.302214 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.302356 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.302520 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.302653 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.302823 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.302949 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.303125 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.303255 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.303429 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.303565 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.303732 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.303859 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.304037 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.304173 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.304348 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.304479 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.304632 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.304766 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.304933 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.305060 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.305237 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.305363 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.305527 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.305645 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.305856 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.305994 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.306161 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.306294 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.306460 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.306598 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.306762 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.306888 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.307066 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.307199 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.307366 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.307506 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.307668 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.307795 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.307994 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.308120 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.308313 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.308449 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.308711 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.308849 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.308973 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.309096 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.309226 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.309359 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.309523 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.309652 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.309866 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:37:24.309997 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.310202 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.310325 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.310535 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.310662 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.310874 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.311000 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.311186 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.311314 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.311511 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.311647 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.311826 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.311954 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.312139 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.312275 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.312448 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.312574 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.312760 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.312903 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.313077 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.313203 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.313388 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.313513 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.313683 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.313865 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.314016 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.314154 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.314325 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.314461 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.314639 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.314772 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.314954 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.315083 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.315274 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.315407 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.315588 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.315718 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.315897 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.316024 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.316206 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.316340 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.316521 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.316658 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.316848 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.316977 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.317172 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.317300 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.317480 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.317617 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.317810 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.317941 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.318130 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.318259 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.318442 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.318583 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.318819 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.318958 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.319081 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.319203 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.319387 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.319516 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.319696 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.319831 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.320006 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.320131 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.320317 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.320440 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.320628 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.320762 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.320939 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.321066 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.321249 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.321379 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.321557 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.321691 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.321892 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.322019 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.322201 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.322338 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.322512 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.322640 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.322821 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.322957 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.323130 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.323263 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.323444 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.323572 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.323780 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.323986 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.324132 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.324250 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.324371 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.324494 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.324668 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.324804 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.324979 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.325106 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.325284 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.325411 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.325583 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.325718 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.325912 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.326056 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.326215 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.326343 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.326523 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.326661 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.326824 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.326952 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.327142 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.327276 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.327467 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.327593 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.327774 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.327900 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.328080 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.328212 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.328386 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.328511 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.328688 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.328816 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.329025 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.329152 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.329284 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.329408 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.329579 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.329709 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.329912 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.330113 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.330250 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.330375 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.330518 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.330645 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.330823 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.330964 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.331139 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.331267 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.331444 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.331572 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.331755 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.331891 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.332056 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.332182 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.332360 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.332495 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.332672 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.332813 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.332981 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.333109 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.333290 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.333418 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.333599 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.333736 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.333929 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.334085 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.334240 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.334368 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.334552 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.334682 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.334863 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.334993 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.335177 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.335311 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.335485 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.335863 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.336049 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.336178 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.336356 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.336491 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.336669 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.336798 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.336975 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.337107 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.337273 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.337398 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.337577 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.337704 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.337905 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.338034 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.338210 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.338350 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.338509 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.338635 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.338812 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.338946 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.339642 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.339786 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.339912 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.340035 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.340208 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.340337 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.340509 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.340639 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.340811 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.340940 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.341133 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.341261 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.341443 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.341580 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.341744 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.341904 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.342070 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.342209 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.342372 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.342501 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.342712 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.342841 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.343015 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.343144 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.343354 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.343484 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.343682 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.343809 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.343997 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.344125 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.344312 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.344442 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.344621 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.344747 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.344934 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.345061 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.345242 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.345369 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.345548 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.345682 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.345880 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.346013 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.346189 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.346318 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.346504 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.346633 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.346812 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.346948 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.347121 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.347254 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.347424 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.347552 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.347753 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.347891 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.348065 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.348194 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.348381 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.348516 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.348683 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.348820 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.348995 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.349138 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.349326 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.349452 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.349585 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.349711 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.349927 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.350055 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.350239 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.350379 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.350552 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.350683 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.350872 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.351000 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.351177 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.351304 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.351483 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.351613 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.351791 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.351917 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.352096 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.352222 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.352411 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.352540 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.352718 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.352848 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.353020 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.353154 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.353362 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.353495 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.353619 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.353757 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.353950 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.354090 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.354267 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.354411 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.354569 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.354697 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.355447 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.355579 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.355774 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.355903 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.356101 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.356234 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.356407 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.356544 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.356714 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.356840 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.357021 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.357150 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.357325 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.357461 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.357638 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.357789 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.357973 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.358094 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.358277 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.358406 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.358580 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.358707 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.358888 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.359015 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.359195 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.359344 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.359536 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.359662 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.359786 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.359909 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.360083 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.360214 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.360393 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.360521 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.360698 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.360826 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.361000 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.361129 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.361299 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.361426 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.361605 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.361745 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.361923 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.362045 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.362250 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.362378 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.362562 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.362703 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.362868 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.362995 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.363175 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.363303 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.363482 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.363617 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.363826 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.363953 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.364138 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.364264 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.364443 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.364579 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.364761 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.364889 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.365065 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.365191 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.365379 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.365513 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.365693 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.365838 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.366030 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.366156 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.366341 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.366478 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.366659 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.366784 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.366965 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.367099 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.367274 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.367402 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.367584 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.367709 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.367889 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.368021 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.368198 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.368325 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.368508 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.368634 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.368818 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.368945 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.369126 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.369254 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.369432 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.369579 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.369802 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.369945 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.370072 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.370194 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.370394 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.370530 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.370710 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.370852 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.371015 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.371276 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.371404 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.371607 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.371733 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.371915 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.372042 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.372228 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.372354 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.372546 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.372790 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.372925 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.373120 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.373247 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.373433 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.373559 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.373751 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.373915 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.374092 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.374230 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.374409 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.374537 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.374740 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.374877 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.375045 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.375172 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.375359 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.375488 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.375667 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.375808 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.375974 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.376111 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.376279 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.376412 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.376583 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.376710 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.376885 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.377013 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.377187 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.377313 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.377494 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.377622 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.377879 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.378009 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.378146 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.378304 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.378420 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.378545 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.378714 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.378847 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.378972 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.379102 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.379273 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.379408 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.379587 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.379716 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.379916 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.380045 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.380169 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.380301 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.380474 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.380602 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.380796 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.380925 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.381106 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.381243 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.381409 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.381537 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.381711 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.381872 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.382039 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.382178 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.382377 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.382513 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.382663 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.382790 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.383001 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.383131 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.383307 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.383432 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.383613 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.383740 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.383919 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.384048 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.384232 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.384360 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.384542 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.384692 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.384826 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.384950 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.385130 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.385259 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.385430 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.385558 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.385736 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.385911 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.386117 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.386253 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.386425 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.386562 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.386734 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.386863 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.387039 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.387172 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.387346 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.387482 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.387655 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.387781 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.387956 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.388081 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.388256 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.388394 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.388554 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.388703 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.388859 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.388985 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.389162 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.389299 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.389460 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.389594 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.389759 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.389932 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.390136 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.390272 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.390404 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.390529 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.390676 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.390810 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.390948 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.391072 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.391240 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.391376 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.391551 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.391679 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.391849 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.391984 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.392148 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.392277 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.392447 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.392604 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.392741 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.392873 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.393044 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.393172 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.393341 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.393476 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.393644 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.393796 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.393970 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.394110 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.394280 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.394417 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.394582 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.394712 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.394887 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.395015 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.395186 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.395323 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.395485 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.395613 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.395788 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.395922 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.396092 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.396229 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.396396 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.396524 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.396696 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.396823 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.396995 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.397123 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.397294 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.397420 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.397594 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.397720 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.397918 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.398054 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.398220 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.398347 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.398517 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.398643 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.398816 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.398946 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.399114 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.399242 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.399403 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.399526 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.399697 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.399827 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.400017 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.400157 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.400387 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.400531 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.400656 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.400779 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.400901 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.401025 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.401183 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.401320 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.401521 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.402168 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.402357 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.402524 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.402716 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.402858 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.403021 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.403150 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.403334 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.403461 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.403647 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.403787 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.403955 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.404082 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.404260 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.404386 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.404563 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.404698 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.404860 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.404994 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.405173 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.405308 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.405479 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.405639 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.405817 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.405945 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.406112 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.406251 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.406451 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.406578 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.406708 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.406832 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.407014 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.407142 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.407321 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.407451 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.407642 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.407769 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.407958 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.408092 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.408270 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.408408 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.408573 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.408699 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.408881 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.409019 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.409188 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.409316 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.409493 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.409621 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.409817 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.409966 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.410129 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.410264 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.410467 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.410595 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.410726 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.410860 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.411024 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.411153 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.411327 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.411453 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.411631 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.411771 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.411932 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.412060 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.412239 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.412375 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.412546 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.412675 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.412844 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.412978 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.413152 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.413278 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.413459 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.413597 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.413759 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.413946 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.414071 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.414216 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.414380 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.414530 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.414687 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.414822 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.414991 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.415128 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.415415 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.415549 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.415728 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.415857 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.416035 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.416171 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.416337 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.416463 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.416642 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.416769 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.416949 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.417092 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.417300 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.417434 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.417617 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.417746 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.417947 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.418092 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.418356 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.418489 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.418662 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.418789 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.418970 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.419109 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.419276 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.419404 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.419577 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.419704 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.419877 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.420007 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.420183 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.420311 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.420515 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.420649 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.420783 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.420907 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.421079 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.421215 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.421378 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.421505 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.421695 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.421850 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.422109 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.422248 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.422386 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.422511 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.422738 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.422868 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.423047 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.423177 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.423350 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.423488 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.423752 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.423880 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.424060 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.424188 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.424367 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.424509 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.424675 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.424809 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.425009 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.425150 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.425304 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.425433 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.425606 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.425744 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.425939 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.426068 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.426246 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.426373 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.426565 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.426705 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.426888 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.427017 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.427195 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.427323 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.427506 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.427644 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.427807 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.427943 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.428132 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.428271 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.428443 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.428571 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.428754 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.428876 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.429074 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.429203 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.429442 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.429570 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.429746 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.429922 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.430077 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.430205 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.430382 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.430513 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.430691 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.430819 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.430996 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.431124 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.431298 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.431426 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.431604 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.431731 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.431906 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.432043 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.432248 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.432384 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.432517 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.432642 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.432794 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.433448 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.433633 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.433760 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.433967 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.434096 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.434275 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.434417 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.434578 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.434706 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.434877 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.435038 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.435198 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.435337 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.435499 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.435629 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.435820 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.435947 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.436130 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.436259 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.436432 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.436559 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.436735 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.436864 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.437038 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.437169 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.437356 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.437483 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.437665 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.437846 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.437986 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.438113 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.438278 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.438412 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.438582 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.438711 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.438920 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.439057 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.439222 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.439351 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.439538 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.439676 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.439867 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.440003 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.440192 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.440319 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.440498 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.440638 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.440816 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.440944 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.441124 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.441252 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.441437 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.441575 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.441745 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.441893 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.442077 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.442206 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.442420 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.442564 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.442691 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.442815 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.442974 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.443111 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.443276 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.443406 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.443577 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.443707 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.443879 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.444008 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.444185 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.444322 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.444487 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.444617 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.444787 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.444917 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.445090 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.445219 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.445395 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.445521 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.445700 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.445855 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.446052 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.446184 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.446362 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.446489 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.446665 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.446803 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.446971 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.447100 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.447274 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.447402 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.447614 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.447755 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.447916 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.448045 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.448241 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.448369 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.448604 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.448744 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.448928 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.449056 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.449254 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.449384 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.449563 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.449705 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.449900 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.450028 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.450216 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.450344 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.450530 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.450660 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.450840 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.450966 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.451150 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.451276 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.451463 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.451593 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.451775 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.451910 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.452088 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.452293 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.452432 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.452634 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.452763 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.452930 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.453060 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.453245 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.453383 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.453561 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.453817 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.453951 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.454146 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.454289 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.454462 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.454592 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.454776 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.454904 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.455088 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.455226 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.455398 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.455526 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.455706 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.455841 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.456015 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.456153 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.456322 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.456452 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.456630 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.456768 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.456941 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.457071 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.457266 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.457394 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.457576 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.457705 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.457914 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.458045 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.458245 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.458379 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.458562 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.458702 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.458870 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.459004 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.459178 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.459307 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.459487 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.459625 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.459798 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.459932 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.460112 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.460240 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.460424 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.460804 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.460987 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.461117 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.461299 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.461426 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.461608 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.461736 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.461940 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.462069 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.462247 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.462376 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.462556 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.462763 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.462892 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.463016 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.463160 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.463289 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.463469 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.463600 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.463779 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.463909 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.464089 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.464739 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.464960 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.465088 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.465328 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.465480 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.465652 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.465855 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.465986 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.466141 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.466300 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.466469 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.466601 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.466797 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.467113 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.467240 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.467423 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.467551 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.467749 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.467883 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.468057 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.468187 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.468365 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.468493 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.468675 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.468805 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.468989 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.469125 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.469292 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.469464 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.469762 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.469915 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.470057 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.470186 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.470312 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.470437 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.470571 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.470706 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.470840 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.470966 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.471100 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.471348 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.471481 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.471694 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.471823 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.472009 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.472137 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.472313 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.472443 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.472649 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.472868 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.473021 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.473183 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.473322 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.473499 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.473629 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.473848 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.473982 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.474174 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.474316 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.474487 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.474615 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.474792 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.474933 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.475095 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.475224 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.475398 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.475528 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.475699 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.475827 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.476008 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.476148 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.476311 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.476441 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.476608 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.476737 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.476939 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.477073 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.477206 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.477331 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.477500 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.477631 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.477819 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.477949 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.478127 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.478260 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.478419 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.478559 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.478719 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.478847 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.479029 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.479157 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.479328 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.479464 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.479629 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.479792 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.479988 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.480127 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.480290 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.480436 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.480591 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.480721 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.480892 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.481020 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.481193 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.481332 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.481496 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.481623 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.481811 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.481943 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.482121 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.482253 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.482422 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.482552 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.482728 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.482858 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.483069 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.483207 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.483333 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.483464 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.483649 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.483777 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.483985 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.484112 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.484244 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.484369 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.484546 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.484676 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.484858 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.484988 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.485164 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.485293 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.485485 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.485718 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.485879 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.486081 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.486211 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.486408 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.486538 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.486746 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.486903 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.487080 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.487271 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.487406 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.487601 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.487739 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.487919 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.488049 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.488250 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.488379 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.488578 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.488721 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.488883 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.489011 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.489191 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.489332 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.489493 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.489622 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.489824 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.489955 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.490138 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.490266 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.490447 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.490578 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.490755 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.490882 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.491062 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.491190 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.491368 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.491495 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.491673 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.491812 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.491981 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.492115 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.492286 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.492423 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.492594 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.492732 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.492900 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.493055 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.493246 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.493375 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.493498 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.493634 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.493813 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.493957 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.494150 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.494278 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.494462 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.494591 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.494770 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.494900 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.495078 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.495210 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.495900 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.496036 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.496212 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.496343 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.496519 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.496662 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.496825 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.496947 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.497129 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.497269 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.497441 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.497572 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.497798 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.497954 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.498088 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.498213 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.498390 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.498521 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.498799 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.498970 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.499109 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.499233 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.499416 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.499545 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.499733 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.499872 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.500039 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.500169 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.500359 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.500500 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.500679 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.500809 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.500989 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.501118 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.501308 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.501438 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.501616 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.501748 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.501944 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.502072 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.502251 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.502380 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.502561 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.502691 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.502878 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.503007 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.503187 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.503402 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.503531 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.503656 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.503781 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.503904 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.504078 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.504218 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.504380 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.504507 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.504686 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.504815 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.504987 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.505123 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.505288 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.505416 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.505601 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.505734 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.505908 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.506045 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.506206 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.506342 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.506505 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.506633 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.506806 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.506943 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.507111 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.507240 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.507409 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.507537 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.507711 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.507841 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.508011 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.508139 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.508311 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.508439 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.508611 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.508746 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.508909 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.509045 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.509208 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.509336 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.509506 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.509628 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.509828 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.509960 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.510131 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.510277 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.510416 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.510549 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.510719 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.510849 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.511108 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.511252 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.511445 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.511575 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.511761 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.511892 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.512082 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.512221 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.512392 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.512521 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.512711 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.512847 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.513017 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.513220 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.513372 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.513604 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.513797 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.513924 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.514063 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.514190 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.514316 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.514440 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.514564 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.514687 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.514824 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.514950 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.515149 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.515279 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.515451 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.515579 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.515768 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.515903 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.516094 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.516223 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.516413 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.516550 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.516733 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.516872 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.517049 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.517170 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.517360 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.517507 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.517689 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.517834 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.518029 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.518157 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.518342 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.518484 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.518654 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.518788 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.518962 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.519097 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.519272 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.519413 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.519588 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.519716 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.519897 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.520025 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.520209 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.520345 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.520517 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.520646 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.520824 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.520954 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.521136 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.521267 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.521448 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.521576 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.521817 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.521950 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.522141 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.522271 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.522466 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.522594 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.522781 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.522918 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.523094 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.523230 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.523399 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.523528 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.523732 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 12 20:37:24.523876 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.524054 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.524364 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.524673 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.524975 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:37:24.525217 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 12 20:37:24.548588 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_db.sqlalchemy.engines [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:37:24.549608 ncdv-master-1 devstack@n-api.service[120634]: DEBUG oslo_db.sqlalchemy.engines [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:37:24.612899 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.context [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) {{(pid=120634) load_cells /opt/stack/nova/nova/context.py:464}} Mar 12 20:37:24.613573 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.context [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) {{(pid=120633) load_cells /opt/stack/nova/nova/context.py:464}} Mar 12 20:37:24.617127 ncdv-master-1 devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:37:24.617693 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:37:24.618738 ncdv-master-1 devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:37:24.619297 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:37:24.619521 ncdv-master-1 devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:37:24.620078 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:37:24.621500 ncdv-master-1 devstack@n-api.service[120634]: DEBUG oslo_concurrency.lockutils [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:37:24.622042 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:37:24.631724 ncdv-master-1 devstack@n-api.service[120634]: DEBUG oslo_db.sqlalchemy.engines [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:37:24.634260 ncdv-master-1 devstack@n-api.service[120634]: DEBUG oslo_db.sqlalchemy.engines [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:37:24.638118 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_db.sqlalchemy.engines [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:37:24.640569 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_db.sqlalchemy.engines [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:37:24.796281 ncdv-master-1 devstack@n-api.service[120634]: DEBUG oslo_db.sqlalchemy.engines [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:37:24.799181 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_db.sqlalchemy.engines [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:37:25.248415 ncdv-master-1 devstack@n-api.service[120633]: WARNING keystonemiddleware.auth_token [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 12 20:37:25.249341 ncdv-master-1 devstack@n-api.service[120634]: WARNING keystonemiddleware.auth_token [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 12 20:37:25.255026 ncdv-master-1 devstack@n-api.service[120633]: WARNING keystonemiddleware.auth_token [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 12 20:37:25.255911 ncdv-master-1 devstack@n-api.service[120634]: WARNING keystonemiddleware.auth_token [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 12 20:37:25.477870 ncdv-master-1 devstack@n-api.service[120633]: WARNING keystonemiddleware.auth_token [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 12 20:37:25.478417 ncdv-master-1 devstack@n-api.service[120634]: WARNING keystonemiddleware.auth_token [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 12 20:37:25.483677 ncdv-master-1 devstack@n-api.service[120633]: WARNING keystonemiddleware.auth_token [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 12 20:37:25.484107 ncdv-master-1 devstack@n-api.service[120634]: WARNING keystonemiddleware.auth_token [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 12 20:37:25.488809 ncdv-master-1 devstack@n-api.service[120633]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5649535d39c0 pid: 120633 (default app) Mar 12 20:37:25.489154 ncdv-master-1 devstack@n-api.service[120634]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5649535d39c0 pid: 120634 (default app) Mar 12 20:37:25.490897 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:37:25.492095 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-c6680b74-62bc-4374-872e-a0620178a7cd None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001759 Mar 12 20:37:25.492533 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Sat Mar 12 20:37:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:38:48.849323 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:38:48.850625 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002071 Mar 12 20:38:48.851186 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:38:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:38:49.278235 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-7a11becb-d1e7-41b9-808a-adddcea47bc8 admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:38:49.307110 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-7a11becb-d1e7-41b9-808a-adddcea47bc8 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.449642 Mar 12 20:38:49.307759 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 2/3] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Mar 12 20:38:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:38:51.731254 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:38:51.732248 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-968b735f-0fa6-4559-8e51-004f2aa8815a None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Mar 12 20:38:51.732653 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 2/4] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:38:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:38:51.793618 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3bf65e09-2dd4-48a7-aba6-b715614e85e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "swap": 0, "ram": 256, "name": "cirros256"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:38:51.812139 ncdv-master-1 devstack@n-api.service[120633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:38:51.812139 ncdv-master-1 devstack@n-api.service[120633]: warnings.warn(msg) Mar 12 20:38:51.839406 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3bf65e09-2dd4-48a7-aba6-b715614e85e5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.100746 Mar 12 20:38:51.839958 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 3/5] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Mar 12 20:38:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 20:38:52.056102 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-96353116-f0cc-4b03-a7dd-3ed9800b7e58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:38:52.058521 ncdv-master-1 devstack@n-api.service[120634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:38:52.058521 ncdv-master-1 devstack@n-api.service[120634]: warnings.warn(msg) Mar 12 20:38:52.108745 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-96353116-f0cc-4b03-a7dd-3ed9800b7e58 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.260888 Mar 12 20:38:52.110391 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 3/6] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Mar 12 20:38:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:38:54.507072 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3bf65e09-2dd4-48a7-aba6-b715614e85e5 admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:38:54.508159 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3bf65e09-2dd4-48a7-aba6-b715614e85e5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Mar 12 20:38:54.509211 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 4/7] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:38:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:38:54.613571 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d483cfbd-1fde-4482-a2b4-149099469568 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:38:54.631478 ncdv-master-1 devstack@n-api.service[120634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:38:54.631478 ncdv-master-1 devstack@n-api.service[120634]: warnings.warn(msg) Mar 12 20:38:54.651092 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d483cfbd-1fde-4482-a2b4-149099469568 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136177 Mar 12 20:38:54.653423 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 4/8] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Mar 12 20:38:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:38:54.665875 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bc1844ff-da1d-4ea0-bc4c-fe46fdc8b935 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:38:54.668405 ncdv-master-1 devstack@n-api.service[120633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:38:54.668405 ncdv-master-1 devstack@n-api.service[120633]: warnings.warn(msg) Mar 12 20:38:54.703639 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bc1844ff-da1d-4ea0-bc4c-fe46fdc8b935 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043499 Mar 12 20:38:54.704373 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 5/9] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Mar 12 20:38:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:38:57.247551 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d483cfbd-1fde-4482-a2b4-149099469568 admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:38:57.248563 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d483cfbd-1fde-4482-a2b4-149099469568 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Mar 12 20:38:57.248972 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:38:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:38:57.313425 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0ac8bf6a-cf3a-4a5a-8334-f6246cd65e68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "disk": 10, "vcpus": 1, "name": "ds1G", "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:38:57.334790 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0ac8bf6a-cf3a-4a5a-8334-f6246cd65e68 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079081 Mar 12 20:38:57.348688 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-c537d164-85a0-45e2-bb84-7c4160207518 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:38:57.354253 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 6/11] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Mar 12 20:38:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:38:57.376184 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-c537d164-85a0-45e2-bb84-7c4160207518 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031492 Mar 12 20:38:57.377002 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 6/12] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Mar 12 20:38:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:39:00.115403 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-0ac8bf6a-cf3a-4a5a-8334-f6246cd65e68 admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:00.116415 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-0ac8bf6a-cf3a-4a5a-8334-f6246cd65e68 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Mar 12 20:39:00.117105 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 7/13] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:39:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:00.179586 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fe7f0d24-fef9-4f28-b6cc-d8b2bcfd00f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "vcpus": 2}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:00.203908 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fe7f0d24-fef9-4f28-b6cc-d8b2bcfd00f3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080689 Mar 12 20:39:00.205113 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 7/14] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Mar 12 20:39:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:39:00.217058 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-6cdfc006-52dd-4e67-8afb-a3f9ce42160f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:00.244938 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-6cdfc006-52dd-4e67-8afb-a3f9ce42160f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031447 Mar 12 20:39:00.253962 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 8/15] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Mar 12 20:39:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:39:02.934900 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-fe7f0d24-fef9-4f28-b6cc-d8b2bcfd00f3 admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:02.941369 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-fe7f0d24-fef9-4f28-b6cc-d8b2bcfd00f3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006866 Mar 12 20:39:02.941831 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 8/16] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:39:02 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:03.028309 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3741c760-968b-4ded-a423-253cc0a07d21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:03.048133 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3741c760-968b-4ded-a423-253cc0a07d21 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099233 Mar 12 20:39:03.048774 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 9/17] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Mar 12 20:39:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:39:03.060775 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1c89b971-48b2-4064-810e-6b62f6ce60f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:03.084952 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1c89b971-48b2-4064-810e-6b62f6ce60f6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027725 Mar 12 20:39:03.086035 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 9/18] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Mar 12 20:39:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:39:05.868339 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3741c760-968b-4ded-a423-253cc0a07d21 admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:05.869350 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3741c760-968b-4ded-a423-253cc0a07d21 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Mar 12 20:39:05.869746 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 10/19] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:39:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:05.932077 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-56bd7764-0d90-45bd-84eb-f9d72936fae7 admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:05.954860 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-56bd7764-0d90-45bd-84eb-f9d72936fae7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079229 Mar 12 20:39:05.955403 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 10/20] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Mar 12 20:39:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:39:08.447715 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-3741c760-968b-4ded-a423-253cc0a07d21 admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:08.448737 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-3741c760-968b-4ded-a423-253cc0a07d21 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Mar 12 20:39:08.449547 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 11/21] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:39:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:08.512116 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6fa1ed88-4ffe-47bf-b67d-6cf290caf0ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "vcpus": 1, "id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:08.532706 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6fa1ed88-4ffe-47bf-b67d-6cf290caf0ee admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076811 Mar 12 20:39:08.533802 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 11/22] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Mar 12 20:39:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:39:08.545166 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-71d197b1-4cc6-4c6b-9945-abae84524d77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:08.571713 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-71d197b1-4cc6-4c6b-9945-abae84524d77 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029440 Mar 12 20:39:08.572665 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 12/23] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Mar 12 20:39:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:39:11.050784 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6fa1ed88-4ffe-47bf-b67d-6cf290caf0ee admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:11.051974 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6fa1ed88-4ffe-47bf-b67d-6cf290caf0ee admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Mar 12 20:39:11.052385 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 12/24] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:39:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:11.115626 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e956fcd8-9637-4c27-a835-bcc81aedb84a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "ram": 2048, "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:11.132544 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e956fcd8-9637-4c27-a835-bcc81aedb84a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073873 Mar 12 20:39:11.134610 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 13/25] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Mar 12 20:39:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:39:11.147835 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-aff1551e-d0d2-4443-b3a3-27b3f24de290 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:11.175717 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-aff1551e-d0d2-4443-b3a3-27b3f24de290 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033596 Mar 12 20:39:11.176357 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 13/26] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Mar 12 20:39:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:39:14.766078 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e956fcd8-9637-4c27-a835-bcc81aedb84a admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:14.767215 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e956fcd8-9637-4c27-a835-bcc81aedb84a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Mar 12 20:39:14.767614 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 14/27] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:39:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:14.837908 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-42689063-b8e6-4158-bd9b-f495eb9e2fc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:14.855750 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-42689063-b8e6-4158-bd9b-f495eb9e2fc3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.080288 Mar 12 20:39:14.856588 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 14/28] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Mar 12 20:39:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 20:39:14.868112 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-bbc18295-1c56-49c6-9f1c-5571af790dc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:14.891566 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-bbc18295-1c56-49c6-9f1c-5571af790dc7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027078 Mar 12 20:39:14.892138 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 15/29] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Mar 12 20:39:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:39:17.417171 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-42689063-b8e6-4158-bd9b-f495eb9e2fc3 admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:17.418206 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-42689063-b8e6-4158-bd9b-f495eb9e2fc3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Mar 12 20:39:17.418601 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 15/30] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:39:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:17.475772 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-99c4a2a8-a646-450f-b378-6b11eb030bb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:17.494766 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-99c4a2a8-a646-450f-b378-6b11eb030bb9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070368 Mar 12 20:39:17.495319 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 16/31] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Mar 12 20:39:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 20:39:17.507317 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-e66e84a6-9173-40b5-8c86-924003876d23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:17.529043 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-e66e84a6-9173-40b5-8c86-924003876d23 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025598 Mar 12 20:39:17.529618 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 16/32] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Mar 12 20:39:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:39:19.986268 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-99c4a2a8-a646-450f-b378-6b11eb030bb9 admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:19.987926 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-99c4a2a8-a646-450f-b378-6b11eb030bb9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002225 Mar 12 20:39:19.997849 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 17/33] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:39:19 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:20.060212 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-14dd25a3-2558-435e-8dd6-f674708528eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5"}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:20.079143 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-14dd25a3-2558-435e-8dd6-f674708528eb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.084044 Mar 12 20:39:20.079693 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 17/34] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Mar 12 20:39:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:39:20.092431 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-b1affa17-a175-47c5-bd6c-b16eae380f29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:20.133098 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-b1affa17-a175-47c5-bd6c-b16eae380f29 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044799 Mar 12 20:39:20.137629 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 18/35] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Mar 12 20:39:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:39:45.585508 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-14dd25a3-2558-435e-8dd6-f674708528eb admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:45.587145 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-14dd25a3-2558-435e-8dd6-f674708528eb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Mar 12 20:39:45.587542 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 18/36] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:39:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:45.651883 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-917d9400-caad-4c3f-8d9a-ae3221dac134 admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:45.669312 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-917d9400-caad-4c3f-8d9a-ae3221dac134 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075261 Mar 12 20:39:45.669875 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 19/37] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Mar 12 20:39:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:39:47.283328 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-14dd25a3-2558-435e-8dd6-f674708528eb admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:47.284361 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-14dd25a3-2558-435e-8dd6-f674708528eb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Mar 12 20:39:47.284756 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 19/38] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Mar 12 20:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:47.535728 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4bbfc76b-e097-403d-a1dd-923cb92ea4fd admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:47.541171 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-4bbfc76b-e097-403d-a1dd-923cb92ea4fd admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 12 20:39:47.541727 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-4bbfc76b-e097-403d-a1dd-923cb92ea4fd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:39:47.542536 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-4bbfc76b-e097-403d-a1dd-923cb92ea4fd admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058252 Mar 12 20:39:47.543038 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 20/39] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:39:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:39:47.552023 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-38a80a6a-c5e8-47b4-ad3d-b7cd57da421a admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:47.573051 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-38a80a6a-c5e8-47b4-ad3d-b7cd57da421a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024507 Mar 12 20:39:47.573582 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 20/40] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Mar 12 20:39:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:39:47.583062 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-651efb95-6a46-4200-918c-e1009d601cc2 admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:47.603650 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-651efb95-6a46-4200-918c-e1009d601cc2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024164 Mar 12 20:39:47.604167 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 21/41] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Mar 12 20:39:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:39:47.613087 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2e957853-88c0-471d-9d92-1d05c0569982 admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:47.618928 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-2e957853-88c0-471d-9d92-1d05c0569982 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 12 20:39:47.619484 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-2e957853-88c0-471d-9d92-1d05c0569982 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:39:47.620256 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-2e957853-88c0-471d-9d92-1d05c0569982 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010694 Mar 12 20:39:47.620741 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 21/42] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:39:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Mar 12 20:39:48.942929 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-651efb95-6a46-4200-918c-e1009d601cc2 admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:48.943936 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-651efb95-6a46-4200-918c-e1009d601cc2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Mar 12 20:39:48.944339 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 22/43] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Mar 12 20:39:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:49.143389 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-69f61ba0-bf37-4346-ad85-ca57b2766e7f admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:49.149105 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-69f61ba0-bf37-4346-ad85-ca57b2766e7f admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 12 20:39:49.149652 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-69f61ba0-bf37-4346-ad85-ca57b2766e7f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:39:49.150470 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-69f61ba0-bf37-4346-ad85-ca57b2766e7f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058135 Mar 12 20:39:49.150962 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 22/44] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:39:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:39:49.160053 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-69005ab3-aea5-4e73-b903-bf466b16d37c admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:49.174083 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-69005ab3-aea5-4e73-b903-bf466b16d37c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017580 Mar 12 20:39:49.174609 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 23/45] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Mar 12 20:39:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:39:49.183942 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-51bfdfb2-1584-466e-99d0-ebf6a0d763fe admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:49.197213 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-51bfdfb2-1584-466e-99d0-ebf6a0d763fe admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016837 Mar 12 20:39:49.197713 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 23/46] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Mar 12 20:39:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:39:49.206474 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-00a48482-c89b-405e-94a6-f3754eb264ce admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:49.212296 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-00a48482-c89b-405e-94a6-f3754eb264ce admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 12 20:39:49.212851 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-00a48482-c89b-405e-94a6-f3754eb264ce admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:39:49.213620 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-00a48482-c89b-405e-94a6-f3754eb264ce admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010649 Mar 12 20:39:49.214133 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 24/47] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:39:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:39:50.538548 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-51bfdfb2-1584-466e-99d0-ebf6a0d763fe admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:50.539563 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-51bfdfb2-1584-466e-99d0-ebf6a0d763fe admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Mar 12 20:39:50.539948 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 24/48] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Mar 12 20:39:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:50.735282 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fc196bc0-f049-4158-b4f0-9802b3c06868 admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:50.740398 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.wsgi [None req-fc196bc0-f049-4158-b4f0-9802b3c06868 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 12 20:39:50.740955 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-fc196bc0-f049-4158-b4f0-9802b3c06868 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:39:50.741728 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-fc196bc0-f049-4158-b4f0-9802b3c06868 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057602 Mar 12 20:39:50.742888 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 25/49] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:39:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:39:50.751972 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-4d9e0e2a-96c2-4987-b8eb-c9096aad743b admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:50.764850 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-4d9e0e2a-96c2-4987-b8eb-c9096aad743b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016469 Mar 12 20:39:50.765352 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 25/50] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Mar 12 20:39:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:39:50.774829 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:50.788640 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017781 Mar 12 20:39:50.789674 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 26/51] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Mar 12 20:39:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:39:50.799045 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f4c839c6-dd94-475d-b3fb-a23a74b03028 admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:50.804223 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.wsgi [None req-f4c839c6-dd94-475d-b3fb-a23a74b03028 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 12 20:39:50.805322 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-f4c839c6-dd94-475d-b3fb-a23a74b03028 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:39:50.806122 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-f4c839c6-dd94-475d-b3fb-a23a74b03028 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010662 Mar 12 20:39:50.806597 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 26/52] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:39:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:39:52.146626 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:52.147644 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Mar 12 20:39:52.148029 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 27/53] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Mar 12 20:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:52.345354 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-7ce889d6-1ccc-42cb-9199-bffacac947d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:52.363286 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-7ce889d6-1ccc-42cb-9199-bffacac947d1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068511 Mar 12 20:39:52.363747 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 27/54] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Mar 12 20:39:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:39:53.709828 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:53.710835 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Mar 12 20:39:53.711224 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 28/55] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Mar 12 20:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:53.907884 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-6496bf86-4946-4d56-a8d0-fdcd0a603055 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:53.924812 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-6496bf86-4946-4d56-a8d0-fdcd0a603055 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.066755 Mar 12 20:39:53.925282 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 28/56] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Mar 12 20:39:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:39:55.260801 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:55.261836 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Mar 12 20:39:55.262231 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 29/57] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Mar 12 20:39:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:55.461671 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-23bc370e-8695-46f2-a118-2eb6e929d708 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:55.477993 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-23bc370e-8695-46f2-a118-2eb6e929d708 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.066847 Mar 12 20:39:55.478660 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 29/58] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Mar 12 20:39:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 20:39:56.812800 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:56.813809 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Mar 12 20:39:56.814204 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 30/59] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Mar 12 20:39:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:57.011687 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-1dd35c16-83b4-4824-b170-6089efc18c17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:39:57.029861 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-1dd35c16-83b4-4824-b170-6089efc18c17 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071214 Mar 12 20:39:57.030352 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 30/60] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Mar 12 20:39:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 20:39:58.404877 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:58.405918 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Mar 12 20:39:58.406313 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 31/61] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Mar 12 20:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:39:58.617749 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-030ebd16-bbae-432c-b73a-f14725de776e admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:39:58.636818 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-030ebd16-bbae-432c-b73a-f14725de776e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071290 Mar 12 20:39:58.637345 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 31/62] 10.222.0.30 () {60 vars in 1202 bytes} [Sat Mar 12 20:39:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:40:50.853379 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:40:50.854415 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-8740741c-7c63-42f3-9760-35fc7012bbae admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Mar 12 20:40:50.854817 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 32/63] 10.222.0.30 () {54 vars in 930 bytes} [Sat Mar 12 20:40:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:40:50.911759 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-79afc943-8628-497e-bc5b-6012bd60918d admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:40:50.931241 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-79afc943-8628-497e-bc5b-6012bd60918d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070339 Mar 12 20:40:50.931765 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 32/64] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Mar 12 20:40:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:40:50.954024 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-65cc1c62-3ffa-4c95-a3c1-7b573026791b admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:40:50.961866 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-65cc1c62-3ffa-4c95-a3c1-7b573026791b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011964 Mar 12 20:40:50.962377 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 33/65] 10.222.0.30 () {60 vars in 1282 bytes} [Sat Mar 12 20:40:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:40:50.973037 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-d9ea5569-6727-42bc-be0c-2fc912476ef1 admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:40:50.980893 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-d9ea5569-6727-42bc-be0c-2fc912476ef1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011247 Mar 12 20:40:50.981395 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 33/66] 10.222.0.30 () {60 vars in 1285 bytes} [Sat Mar 12 20:40:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:40:50.992754 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-989f2166-cf7a-4d73-9a98-bf50aa32ce46 admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:40:51.000040 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-989f2166-cf7a-4d73-9a98-bf50aa32ce46 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011271 Mar 12 20:40:51.000531 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 34/67] 10.222.0.30 () {60 vars in 1285 bytes} [Sat Mar 12 20:40:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:40:51.011242 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3c750127-d7bb-4d64-9db9-adb2c109933d admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:40:51.018623 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3c750127-d7bb-4d64-9db9-adb2c109933d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010949 Mar 12 20:40:51.019337 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 34/68] 10.222.0.30 () {60 vars in 1282 bytes} [Sat Mar 12 20:40:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:42:21.382626 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-81087b30-4b44-4dcf-8646-4d2469e1dd2e tempest-verify_tempest_config-2055597298 tempest-verify_tempest_config-2055597298-project] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:42:21.384567 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-81087b30-4b44-4dcf-8646-4d2469e1dd2e tempest-verify_tempest_config-2055597298 tempest-verify_tempest_config-2055597298-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104881 Mar 12 20:42:21.385092 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 35/69] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Mar 12 20:42:21 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:46:20.668263 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3c750127-d7bb-4d64-9db9-adb2c109933d admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:46:20.669330 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3c750127-d7bb-4d64-9db9-adb2c109933d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Mar 12 20:46:20.669721 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 35/70] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Mar 12 20:46:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:46:20.927024 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-5302c090-0d3d-4f77-8482-bbed182e32ce admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:46:20.928217 ncdv-master-1 devstack@n-api.service[120633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:46:20.928217 ncdv-master-1 devstack@n-api.service[120633]: warnings.warn(msg) Mar 12 20:46:20.929440 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5302c090-0d3d-4f77-8482-bbed182e32ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:46:20.929907 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5302c090-0d3d-4f77-8482-bbed182e32ce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:46:20.930688 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5302c090-0d3d-4f77-8482-bbed182e32ce admin admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:46:20.931145 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-5302c090-0d3d-4f77-8482-bbed182e32ce admin admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:46:20.970998 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-5302c090-0d3d-4f77-8482-bbed182e32ce admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.158705 Mar 12 20:46:20.971558 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 36/71] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:46:20 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:46:22.297684 ncdv-master-1 devstack@n-api.service[120634]: DEBUG nova.api.openstack.wsgi [None req-3c750127-d7bb-4d64-9db9-adb2c109933d admin admin] Calling method '>' {{(pid=120634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:46:22.298704 ncdv-master-1 devstack@n-api.service[120634]: INFO nova.api.openstack.requestlog [None req-3c750127-d7bb-4d64-9db9-adb2c109933d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Mar 12 20:46:22.299093 ncdv-master-1 devstack@n-api.service[120634]: [pid: 120634|app: 0|req: 36/72] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Mar 12 20:46:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:46:22.492937 ncdv-master-1 devstack@n-api.service[120633]: DEBUG nova.api.openstack.wsgi [None req-e30cd898-7dd5-4570-86df-6d3234ef6943 admin admin] Calling method '>' {{(pid=120633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:46:22.494134 ncdv-master-1 devstack@n-api.service[120633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:46:22.494134 ncdv-master-1 devstack@n-api.service[120633]: warnings.warn(msg) Mar 12 20:46:22.495352 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e30cd898-7dd5-4570-86df-6d3234ef6943 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:46:22.495795 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e30cd898-7dd5-4570-86df-6d3234ef6943 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:46:22.496602 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e30cd898-7dd5-4570-86df-6d3234ef6943 admin admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:46:22.497032 ncdv-master-1 devstack@n-api.service[120633]: DEBUG oslo_concurrency.lockutils [None req-e30cd898-7dd5-4570-86df-6d3234ef6943 admin admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:46:22.519390 ncdv-master-1 devstack@n-api.service[120633]: INFO nova.api.openstack.requestlog [None req-e30cd898-7dd5-4570-86df-6d3234ef6943 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.076807 Mar 12 20:46:22.520496 ncdv-master-1 devstack@n-api.service[120633]: [pid: 120633|app: 0|req: 37/73] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:46:22 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:47:10.574440 ncdv-master-1 devstack@n-api.service[120632]: Sat Mar 12 20:47:10 2022 - graceful shutdown triggered... Mar 12 20:47:10.574567 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Mar 12 20:47:10.575667 ncdv-master-1 devstack@n-api.service[120634]: Gracefully killing worker 2 (pid: 120634)... Mar 12 20:47:10.576071 ncdv-master-1 devstack@n-api.service[120633]: Gracefully killing worker 1 (pid: 120633)... Mar 12 20:47:11.576107 ncdv-master-1 devstack@n-api.service[120632]: worker 1 buried after 1 seconds Mar 12 20:47:11.576107 ncdv-master-1 devstack@n-api.service[120632]: worker 2 buried after 1 seconds Mar 12 20:47:11.576107 ncdv-master-1 devstack@n-api.service[120632]: goodbye to uWSGI. Mar 12 20:47:11.577709 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Mar 12 20:47:11.578334 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Mar 12 20:47:11.581113 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Mar 12 20:47:11.625336 ncdv-master-1 devstack@n-api.service[136292]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 12 20:47:11.627491 ncdv-master-1 devstack@n-api.service[136292]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Mar 12 20:47:11 2022] *** Mar 12 20:47:11.627491 ncdv-master-1 devstack@n-api.service[136292]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 12 20:47:11.627491 ncdv-master-1 devstack@n-api.service[136292]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 12 20:47:11.627491 ncdv-master-1 devstack@n-api.service[136292]: nodename: ncdv-master-1 Mar 12 20:47:11.627491 ncdv-master-1 devstack@n-api.service[136292]: machine: x86_64 Mar 12 20:47:11.627491 ncdv-master-1 devstack@n-api.service[136292]: clock source: unix Mar 12 20:47:11.627491 ncdv-master-1 devstack@n-api.service[136292]: pcre jit disabled Mar 12 20:47:11.627491 ncdv-master-1 devstack@n-api.service[136292]: detected number of CPU cores: 4 Mar 12 20:47:11.627491 ncdv-master-1 devstack@n-api.service[136292]: current working directory: / Mar 12 20:47:11.627491 ncdv-master-1 devstack@n-api.service[136292]: detected binary path: /usr/bin/uwsgi-core Mar 12 20:47:11.628251 ncdv-master-1 devstack@n-api.service[136292]: your processes number limit is 47680 Mar 12 20:47:11.628251 ncdv-master-1 devstack@n-api.service[136292]: your memory page size is 4096 bytes Mar 12 20:47:11.628251 ncdv-master-1 devstack@n-api.service[136292]: detected max file descriptor number: 2048 Mar 12 20:47:11.628251 ncdv-master-1 devstack@n-api.service[136292]: lock engine: pthread robust mutexes Mar 12 20:47:11.628251 ncdv-master-1 devstack@n-api.service[136292]: thunder lock: enabled Mar 12 20:47:11.628251 ncdv-master-1 devstack@n-api.service[136292]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 12 20:47:11.628251 ncdv-master-1 devstack@n-api.service[136292]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 12 20:47:11.678520 ncdv-master-1 devstack@n-api.service[136292]: Python main interpreter initialized at 0x557b75cce9c0 Mar 12 20:47:11.678520 ncdv-master-1 devstack@n-api.service[136292]: python threads support enabled Mar 12 20:47:11.678520 ncdv-master-1 devstack@n-api.service[136292]: your server socket listen backlog is limited to 100 connections Mar 12 20:47:11.678520 ncdv-master-1 devstack@n-api.service[136292]: your mercy for graceful operations on workers is 90 seconds Mar 12 20:47:11.678999 ncdv-master-1 devstack@n-api.service[136292]: mapped 403077 bytes (393 KB) for 2 cores Mar 12 20:47:11.678999 ncdv-master-1 devstack@n-api.service[136292]: *** Operational MODE: preforking *** Mar 12 20:47:11.679203 ncdv-master-1 devstack@n-api.service[136292]: *** uWSGI is running in multiple interpreter mode *** Mar 12 20:47:11.679203 ncdv-master-1 devstack@n-api.service[136292]: spawned uWSGI master process (pid: 136292) Mar 12 20:47:11.679410 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Mar 12 20:47:11.680945 ncdv-master-1 devstack@n-api.service[136292]: spawned uWSGI worker 1 (pid: 136302, cores: 1) Mar 12 20:47:11.680945 ncdv-master-1 devstack@n-api.service[136292]: spawned uWSGI worker 2 (pid: 136303, cores: 1) Mar 12 20:47:11.680945 ncdv-master-1 devstack@n-api.service[136292]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 12 20:47:12.947432 ncdv-master-1 devstack@n-api.service[136302]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 12 20:47:12.994673 ncdv-master-1 devstack@n-api.service[136303]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 12 20:47:13.911426 ncdv-master-1 devstack@n-api.service[136302]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 12 20:47:13.911426 ncdv-master-1 devstack@n-api.service[136302]: from cryptography.utils import int_from_bytes Mar 12 20:47:13.911782 ncdv-master-1 devstack@n-api.service[136302]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 12 20:47:13.911782 ncdv-master-1 devstack@n-api.service[136302]: from cryptography.utils import int_from_bytes Mar 12 20:47:13.918216 ncdv-master-1 devstack@n-api.service[136303]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 12 20:47:13.918216 ncdv-master-1 devstack@n-api.service[136303]: from cryptography.utils import int_from_bytes Mar 12 20:47:13.918531 ncdv-master-1 devstack@n-api.service[136303]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 12 20:47:13.918531 ncdv-master-1 devstack@n-api.service[136303]: from cryptography.utils import int_from_bytes Mar 12 20:47:16.313655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 12 20:47:16.314247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 12 20:47:16.314457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 12 20:47:16.314833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 12 20:47:16.315099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 12 20:47:16.315493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.315828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.316157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.316484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.316825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.317149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.317875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.318215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.318654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.319056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.319390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.320161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.320161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.320433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.320830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.321150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.321467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.321818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.322141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.322653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.324741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.324741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.324741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.325395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.325478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.325749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.326092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.326413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.326747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.327067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.327475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.327795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.328263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.328564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.329008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.329400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.329693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.330109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.330458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.330775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.331109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.331443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.331770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.332100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.332415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.333008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.333331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.333660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.334005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.334320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.334577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.334897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.335226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.335554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.335886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.336142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.336399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.336727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.337056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.337374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.337688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.338029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.338343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.338658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.338975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.339350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.339664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.339993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.340317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.340648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.340964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.341293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.341699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.341983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.342300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.342647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.342982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.343303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.343633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.343965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.344283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.344596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.344914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.345249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.345595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.345939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.346200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.346510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.346823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.347150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.347466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.347780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.348095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.348405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.348719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.349031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.349345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.349660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.350002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.350313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.350627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.350939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.351251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.351581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.351909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.352225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.352539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.352859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.353174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.353501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.353840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.354157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.354485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.354823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.355139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.355468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.355783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.356100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.356428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.356739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.357052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.357378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.357693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.358156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.358488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.358871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.359189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.359503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.359864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.360193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.360576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.360906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.361237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.361553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.361966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.362282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.362611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.362960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.363301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.363652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.363977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.364316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.364659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.364985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.365309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.365693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.366056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.366487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.366838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.367160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.367565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.367942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.368301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.368699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.369066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.369417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.369738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.370085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.370949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.371590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.372060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.372513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.372977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.373321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.373760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.374134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.374457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.374778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.375097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.375429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.375873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.376295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.376703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.377029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.377913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.378395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.378909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.379369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.379772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.380177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.380517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.380913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.381406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.381736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.382101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.382417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.382738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.383057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.383377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.383700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.384019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.384353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.384694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.385014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.385374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.385684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.386069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.386926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.387248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.387567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.387672 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 12 20:47:16.388076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.388173 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 12 20:47:16.388258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.388406 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 12 20:47:16.388498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.388780 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 12 20:47:16.388925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.389049 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 12 20:47:16.389150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.389438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.389536 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.389792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.389888 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.390108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.390214 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.390431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.390564 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.390755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.390876 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.391076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.391185 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.391397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.391496 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.391718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.391834 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.392037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.392136 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.392309 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.392413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.392633 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.392725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.392967 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.393067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.393301 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.393392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.393619 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.393712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.393988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.394092 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.394331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.394441 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.394650 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.394763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.394980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.395087 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.395292 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.395389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.395610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.395812 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.395941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.396139 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.396249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.396452 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.396552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.396772 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.397006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.397119 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.397263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.397431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.397530 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.397749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.397931 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.398105 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.398219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.398421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.398513 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.398752 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.398844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.399070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.399170 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.399386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.399484 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.399702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.399793 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.400016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.400108 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.400368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.400459 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.400685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.400807 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.401032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.401135 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.401379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.401470 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.401731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.401861 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.402088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.402180 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.402408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.402516 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.402733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.402838 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.403053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.403150 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.403376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.403477 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.403699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.403808 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.404010 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.404165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.404327 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.404564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.404665 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.404910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.405056 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.405230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.405356 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.405573 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.405818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.405949 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.406076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.406204 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.406393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.406507 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.406623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.406801 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.406929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.407129 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.407246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.407384 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.407540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.407667 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.407884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.408009 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.408213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.408339 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.408547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.408680 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.409820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.410113 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.410200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.410276 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.410368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.410463 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.410538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.410620 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.410692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.410770 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.410908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.410990 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.411590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.411691 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.411779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.411904 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.412158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.412254 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.412350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.412443 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.412443 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.412715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.412834 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.412926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.412926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.413076 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.413076 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.413224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.413405 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.413567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.413756 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.413940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.414109 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.414258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.414949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.415162 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.415295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.415431 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.415953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.416098 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.416227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.416369 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.416562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.416702 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.416845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.416974 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.417123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.417319 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.417449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.417578 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.417726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.418051 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.418051 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.418299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.418436 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.418436 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.418677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.418813 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.419088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.419220 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.419348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.419475 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.419609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.419746 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.419884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.420154 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.420283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.420410 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.420544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.420686 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.420789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.420874 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.420964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.421056 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.421139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.421230 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.421320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.421415 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.421505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.421588 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.421679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.421786 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.421916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.422075 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.422250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.422408 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.422569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.422741 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.422884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.423064 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.423195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.423383 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.423498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.423699 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.423845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.424012 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.424163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.424342 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.424477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.424662 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.424803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.424978 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.425197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.425301 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.425448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.425617 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.425827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.426063 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.426158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.426275 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.426412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.426631 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.426740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.426896 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.427051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.427226 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.427374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.427542 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.427692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.427856 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.428012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.428182 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.428333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.428498 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.428654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.428813 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.428987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.429126 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.429304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.429441 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.429624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.429757 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.430031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.430133 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.430346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.430447 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.430662 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.430753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.430975 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.431066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.431305 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.431554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.431654 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.431893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.431990 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.432218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.432317 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.432543 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.432634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.433403 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 12 20:47:16.433758 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.433953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.434125 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.434258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.434480 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.434599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.434844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.435268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.435617 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.435973 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.436323 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.436657 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.436986 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.437315 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.437626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.437725 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.438003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.438102 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.438344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.438443 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.438682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.438781 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.439023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.439133 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.439343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.439467 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.439671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.439781 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.440003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.440122 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.440332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.440435 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.440662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.440773 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.440975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.441105 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.441306 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.441648 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.441755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.442012 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.442121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.442336 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.442443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.442688 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.442796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.443029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.443142 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.443354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.443461 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.443690 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.443788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.444017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.444130 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.444392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.444496 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.444651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.444746 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.444964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.445077 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.445306 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.445414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.445665 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.445802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.446004 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.446179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.446328 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.446573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.446734 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.446932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.447100 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.447254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.447408 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.447554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.447717 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.447873 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.448028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.448174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.448316 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.448490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.448642 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.448786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.448950 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.449104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.449249 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.449416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.449567 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.451223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.451430 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.451589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.451758 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.451912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.452058 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.452214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.452367 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.452563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.452563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.452855 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.453007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.453166 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.453324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.453324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.453848 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.456039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.456039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.456739 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.456894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.457041 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.457200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.457200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.457487 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.457645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.457812 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.457977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.457977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.458273 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.458429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.458429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.458724 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.458878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.459022 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.459166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.459166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.459466 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.459612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.459612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.459904 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.460058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.460212 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.460365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.460365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.460659 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.460984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.460984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.461286 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.461440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.461585 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.461730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.461730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.462159 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.462314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.462314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.462600 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.462754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.462899 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.463054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.463200 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.463360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.463536 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.463972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.464156 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.464338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.464501 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.464662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.464818 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.464963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.465108 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.465263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.465409 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.465604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.465755 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.465928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.466310 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.466473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.466632 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.466786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.466933 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.467078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.467237 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.467391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.467391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.467666 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.467810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.467810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.468100 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.468254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.468409 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.468562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.468562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.468881 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.469043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.469188 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.469333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.469333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.469608 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.469823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.469991 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.470138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.470290 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.470446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.470600 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.470833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.471198 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.471362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.471595 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.471846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.472093 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.473251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.473439 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.473600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.473755 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.474246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.474421 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.474590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.474740 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.474885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.475029 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.475191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.475353 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.475499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.475657 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.475802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.475947 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.476091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.476362 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.476767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.477031 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.477283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.477529 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.477818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.477818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.478548 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.478816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.478816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.479220 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.479368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.479368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.479762 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.479937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.480093 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.480238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.480394 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.480556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.480709 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.480901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.481341 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.481527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.481693 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.481693 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.482011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.482168 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.482312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.482456 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.482617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.482771 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.482915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.483067 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.483220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.483364 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.483525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.483671 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.483815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.483968 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.484386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.484567 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.484727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.484873 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.485026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.485179 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.485323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.485478 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.485623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.485908 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.486063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.486216 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.486449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.486625 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.486889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.487045 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.487197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.487342 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.487494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.487649 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.487803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.488057 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.488208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.488354 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.488508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.488668 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.488834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.488834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.489120 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.489265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.489265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.489562 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.489715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.489715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.489715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.490711 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.490880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.491036 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.491223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.491223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.491671 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.491824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.491985 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.492132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.492132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.492421 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.492565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.492709 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.492868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.493022 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.493169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.493332 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.493478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.493638 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.493833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.493986 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.494145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.494555 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.494718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.494718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.495010 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.495155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.495155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.495965 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.496125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.496286 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.496459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.496685 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.496835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.496979 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.497230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.497399 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.497553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.497706 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.497887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.498035 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.498237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.498406 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.498552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.498552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.498844 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.498988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.499148 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.499301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.499456 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.499601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.499745 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.499889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.500045 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.500207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.500362 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.500507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.500652 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.501721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.501721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.502064 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.502398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.502398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.502848 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.503015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.503161 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.503313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.503482 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.503637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.503791 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.503947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.504092 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.504236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.504407 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.504841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.504997 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.505169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.505316 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.505462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.505615 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.505810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.505976 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.506136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.506290 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.506445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.506589 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.506820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.507054 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.507220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.507461 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.507620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.507766 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.507766 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.508064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.508064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.508348 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.508491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.508644 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.508796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.508951 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.509104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.509256 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.509400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.509544 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.509688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.509881 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.509881 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.510170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.510315 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.510458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.510458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.510752 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.510897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.511089 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.511902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.512056 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.512213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.512358 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.512358 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.512646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.512798 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.512951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.513117 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.513262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.513407 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.513551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.513695 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.513886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.513886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.514191 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.514345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.514510 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.514909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.515093 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.515254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.515254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.515546 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.515690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.515834 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.515988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.516134 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.516279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.516424 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.516579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.516724 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.516968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.517129 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.517276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.517451 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.517692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.517877 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.518025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.518178 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.518324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.518523 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.518673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.518830 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.518982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.519127 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.519270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.519433 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.519587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.519740 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.519884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.520028 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.520172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.520325 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.520472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.520472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.520772 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.520923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.521087 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.521239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.521390 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.521540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.521700 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.522116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.522286 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.522439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.522589 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.522738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.522895 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.523056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.523221 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.523372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.523524 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.523683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.523836 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.523986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.524146 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.524297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.524455 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.524607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.524785 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.524785 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.525347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.525508 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.525662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.525833 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.526003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.526165 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.526317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.526476 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.526651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.527411 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.527589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.527863 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.528036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.528188 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.528340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.528491 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.528642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.528811 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.528972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.529259 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.529420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.529582 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.529754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.529951 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.530103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.530286 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.530439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.530590 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.530755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.530909 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.531067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.531219 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.531370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.531522 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.531687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.531687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.532012 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.532333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.532517 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.532684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.532837 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.532989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.533140 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.533301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.533453 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.533618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.533790 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.533949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.534114 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.534356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.534520 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.534672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.534823 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.535246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.535551 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.535722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.535884 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.536083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.536240 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.536392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.536543 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.536704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.536876 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.537056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.537254 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.537410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.537578 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.537739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.538577 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.538758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.538921 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.539086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.539270 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.539497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.539684 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.539838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.539998 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.539998 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.540298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.540450 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.540601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.540752 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.540912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.541064 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.541064 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.541364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.541524 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.541728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.541970 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.543009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.543188 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.543350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.543504 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.543654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.543812 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.543978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.544130 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.544290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.544290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.544650 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.544840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.545011 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.545482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.545645 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.545894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.546057 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.546223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.546384 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.546544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.546697 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.546848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.547007 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.547181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.547335 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.547335 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.547624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.547785 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.547937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.548102 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.548262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.548414 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.548586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.548868 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.549030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.549192 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.549363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.549534 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.549534 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.550113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.550269 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.550269 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.550676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.550818 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.550949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.551086 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.551230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.551362 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.551362 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.551629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.551767 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.551900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.552040 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.552040 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.552040 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.552408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.552549 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.552738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.552883 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.553205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.553205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.553466 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.553596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.553726 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.554497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.554644 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.554644 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.554912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.555053 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.555193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.555606 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.555757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.555895 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.556036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.556177 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.556318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.556448 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.556578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.556716 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.556716 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.556971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.557122 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.557122 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.557377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.557508 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.557508 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.557508 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.557971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.558606 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.558606 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.558870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.559097 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.559247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.559385 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.559385 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.559663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.559910 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.560074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.560236 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.560390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.560558 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.560704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.560848 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.560848 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.561148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.561350 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.561498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.561643 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.561643 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.562012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.562168 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.562314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.562460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.562628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.562785 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.562940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.563103 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.563411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.563572 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.563763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.563919 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.563919 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.564219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.564373 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.564527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.564673 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.564830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.564985 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.565131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.565283 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.565437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.565867 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.565867 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.566177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.566331 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.566477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.566623 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.566775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.566943 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.567090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.567235 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.567379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.567532 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.567686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.567842 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.567996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.568154 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.568310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.568464 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.568610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.568610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.568984 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.569159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.569405 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.569557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.569720 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.569920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.570152 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.570313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.570467 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.570621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.570778 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.570931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.571087 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.571232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.571232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.571516 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.571715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.571870 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.572016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.572161 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.572306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.572306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.572607 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.572760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.572907 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.573064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.573217 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.573591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.573591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.573949 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.574097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.574242 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.574398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.574559 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.574713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.574858 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.575267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.575421 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.575577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.576009 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.576169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.576316 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.576471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.576620 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.576851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.577001 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.577163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.577311 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.577457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.577603 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.577788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.577961 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.578129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.578415 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.578582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.578732 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.578888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.579035 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.579181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.579327 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.579598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.579774 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.579943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.580091 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.580960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.581123 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.581300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.581586 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.581763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.581933 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.582090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.582246 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.582400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.582400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.582688 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.582858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.583013 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.583158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.583312 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.583467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.583788 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.583949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.584095 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.584250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.584407 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.584563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.584717 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.584863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.585020 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.585175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.585175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.585463 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.585609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.585762 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.586270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.586432 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.586589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.586736 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.586881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.587033 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.587178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.587343 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.587502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.587655 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.587801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.587961 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.588108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.588268 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.588423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.588599 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.588831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.588991 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.589182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.589366 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.589522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.589672 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.589863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.590114 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.590275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.590437 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.590586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.590733 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.590965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.591118 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.591283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.591437 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.591594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.591750 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.591896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.592050 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.592205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.592352 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.592505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.592651 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.592804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.592804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.593098 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.593245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.593390 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.593552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.593718 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.594020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.594181 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.594328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.594481 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.594636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.594782 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.594943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.595090 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.595236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.595381 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.595546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.595693 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.595849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.596155 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.596427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.596581 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.596726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.596880 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.597041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.597187 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.597332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.597486 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.597632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.597864 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.598038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.598186 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.598332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.598485 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.598639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.598795 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.598940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.599095 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.599239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.599384 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.599529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.599684 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.599840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.599993 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.600160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.600408 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.600568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.600568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.600857 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.601096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.601259 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.601405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.601559 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.601714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.601896 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.602055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.602202 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.602355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.602511 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.602675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.602917 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.602917 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.603227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.603227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.603527 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.603680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.603680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.604116 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.604271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.604417 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.604417 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.604417 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.604417 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.605521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.605668 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.605843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.605997 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.606298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.606573 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.606573 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.606888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.606888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 12 20:47:16.607184 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.607184 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.607184 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.607184 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.607184 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.607184 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.607184 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.607184 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.608294 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.608294 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.608294 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.608294 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.608294 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.608294 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.608294 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.609355 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.609355 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.609355 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.609355 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.609355 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.609355 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.609355 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.609355 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.610666 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.610666 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.610666 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.610666 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.611339 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.611339 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.611628 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.612025 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.612353 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.612700 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.613040 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.613379 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.613711 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.614171 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.614414 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.614737 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.615059 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.615383 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.615705 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.616026 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.616406 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.616695 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.616994 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.617327 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.617928 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.618476 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.618839 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.619171 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.620925 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.620925 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.620925 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.620925 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.620925 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.622195 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.622195 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.622195 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.622195 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.623071 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.623071 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.623071 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.623716 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.623716 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.624345 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.624345 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.624790 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.625049 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.625298 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.625517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:47:16.625754 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.626008 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.626242 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.626630 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.626955 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.627149 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.627536 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.628056 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.628282 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.628597 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.628928 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.629253 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.629601 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.630002 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.630333 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.630579 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.630899 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.631233 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.631560 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.631885 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.632240 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.632574 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.632980 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.633211 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.633846 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.634162 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.634505 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.634833 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.635178 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.635501 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.635824 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.636724 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.637027 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.637342 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.637669 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.638230 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.638556 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.638881 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.639205 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.639525 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.639849 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.640171 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.640492 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.640820 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.641130 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.641457 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.641844 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.642165 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.642495 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.642823 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.643324 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.643657 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.643981 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.644374 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.644696 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.644945 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.645289 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.645616 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.645960 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.646405 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.646837 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.647056 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.647389 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.647711 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.648150 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.648492 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.648816 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.649149 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.649473 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.649843 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.650199 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.650541 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.651599 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.651599 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.651599 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.652833 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.652833 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.653130 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.653411 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.653736 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.654078 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.654401 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.654769 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.655033 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.655350 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.655668 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.655988 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.656306 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.656625 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.656980 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.657257 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.657575 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.657915 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.658325 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.658548 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.658864 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.659179 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.659495 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.659828 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.660150 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.660497 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.660823 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.661160 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.661485 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.661852 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.662175 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.662509 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.662843 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.663175 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.663733 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.664086 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.664549 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.664758 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.665098 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.665348 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.665670 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.666018 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.666360 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.666698 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.667022 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.667387 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.667720 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.668056 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.668382 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.668706 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.669049 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.669373 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.669693 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.670049 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.670374 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.670696 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.671025 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.671351 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.671689 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.672026 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.672363 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.672702 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.673062 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.673388 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.673879 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.674221 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.674551 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.674875 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.675192 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 12 20:47:16.675448 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 12 20:47:16.691543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.context [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) {{(pid=136302) load_cells /opt/stack/nova/nova/context.py:464}} Mar 12 20:47:16.696286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:47:16.697922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:47:16.699364 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_db.sqlalchemy.engines [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:47:16.699578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:47:16.702183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:47:16.713547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:47:16.715729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:47:16.764399 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.context [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) {{(pid=136303) load_cells /opt/stack/nova/nova/context.py:464}} Mar 12 20:47:16.768875 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:47:16.770624 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:47:16.771465 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:47:16.773459 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:47:16.786855 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_db.sqlalchemy.engines [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:47:16.789327 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_db.sqlalchemy.engines [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:47:16.883022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:47:16.952852 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_db.sqlalchemy.engines [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 12 20:47:17.346373 ncdv-master-1 devstack@n-api.service[136302]: WARNING keystonemiddleware.auth_token [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 12 20:47:17.352954 ncdv-master-1 devstack@n-api.service[136302]: WARNING keystonemiddleware.auth_token [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 12 20:47:17.405151 ncdv-master-1 devstack@n-api.service[136303]: WARNING keystonemiddleware.auth_token [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 12 20:47:17.411841 ncdv-master-1 devstack@n-api.service[136303]: WARNING keystonemiddleware.auth_token [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 12 20:47:17.587510 ncdv-master-1 devstack@n-api.service[136302]: WARNING keystonemiddleware.auth_token [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 12 20:47:17.592763 ncdv-master-1 devstack@n-api.service[136302]: WARNING keystonemiddleware.auth_token [None req-fa4118d4-2812-401c-8605-2667e78c39fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 12 20:47:17.598218 ncdv-master-1 devstack@n-api.service[136302]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b75cce9c0 pid: 136302 (default app) Mar 12 20:47:17.643861 ncdv-master-1 devstack@n-api.service[136303]: WARNING keystonemiddleware.auth_token [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 12 20:47:17.649151 ncdv-master-1 devstack@n-api.service[136303]: WARNING keystonemiddleware.auth_token [None req-237369f7-15ae-4775-9c32-4c9a2693f7af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 12 20:47:17.655141 ncdv-master-1 devstack@n-api.service[136303]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b75cce9c0 pid: 136303 (default app) Mar 12 20:48:03.869739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c0b4213-18e0-4071-b724-f504f6c43658 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Calling method '.version_select at 0x7f6e45cea790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:03.872765 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:03.872765 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:03.879357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c0b4213-18e0-4071-b724-f504f6c43658 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) {{(pid=136302) load_cells /opt/stack/nova/nova/compute/api.py:306}} Mar 12 20:48:03.880172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c0b4213-18e0-4071-b724-f504f6c43658 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:03.880950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c0b4213-18e0-4071-b724-f504f6c43658 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:03.920069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c0b4213-18e0-4071-b724-f504f6c43658 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:03.920882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c0b4213-18e0-4071-b724-f504f6c43658 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:03.938530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c0b4213-18e0-4071-b724-f504f6c43658 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:03.939164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c0b4213-18e0-4071-b724-f504f6c43658 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:03.947740 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c0b4213-18e0-4071-b724-f504f6c43658 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.379212 Mar 12 20:48:03.955019 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1/1] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:04.022002 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b556e66b-5d4e-4fc6-9588-282d44c863e1 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '.version_select at 0x7f6e45cec790>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:04.023620 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:04.023620 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:04.030038 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b556e66b-5d4e-4fc6-9588-282d44c863e1 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) {{(pid=136303) load_cells /opt/stack/nova/nova/compute/api.py:306}} Mar 12 20:48:04.031117 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b556e66b-5d4e-4fc6-9588-282d44c863e1 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:04.031560 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b556e66b-5d4e-4fc6-9588-282d44c863e1 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:04.088668 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b556e66b-5d4e-4fc6-9588-282d44c863e1 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:04.090933 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b556e66b-5d4e-4fc6-9588-282d44c863e1 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:04.147914 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b556e66b-5d4e-4fc6-9588-282d44c863e1 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:04.150944 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b556e66b-5d4e-4fc6-9588-282d44c863e1 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:04.168094 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b556e66b-5d4e-4fc6-9588-282d44c863e1 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.280954 Mar 12 20:48:04.168708 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 1/2] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Mar 12 20:48:02 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:04.379378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-110475c7-e7e3-4704-930f-debdb7b3aaca tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Calling method '.version_select at 0x7f6e45cc3c10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:04.382595 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:04.382595 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:04.384857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-110475c7-e7e3-4704-930f-debdb7b3aaca tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:04.386957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-110475c7-e7e3-4704-930f-debdb7b3aaca tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:04.428143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-110475c7-e7e3-4704-930f-debdb7b3aaca tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:04.429250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-110475c7-e7e3-4704-930f-debdb7b3aaca tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:04.453926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-110475c7-e7e3-4704-930f-debdb7b3aaca tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:04.454384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-110475c7-e7e3-4704-930f-debdb7b3aaca tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:04.470335 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-110475c7-e7e3-4704-930f-debdb7b3aaca tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.513703 Mar 12 20:48:04.470803 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2/3] 10.222.0.30 () {60 vars in 1207 bytes} [Sat Mar 12 20:48:03 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:04.613525 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-cc25b962-7e8d-427d-bb34-ef5bd658cd77 tempest-FlavorsV255TestJSON-2065524255 tempest-FlavorsV255TestJSON-2065524255-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-119595603", "id": 1510727232, "os-flavor-access:is_public": "True"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:04.668639 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:04.668639 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:04.717388 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-cc25b962-7e8d-427d-bb34-ef5bd658cd77 tempest-FlavorsV255TestJSON-2065524255 tempest-FlavorsV255TestJSON-2065524255-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.541662 Mar 12 20:48:04.728545 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 2/4] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:48:04 2022] POST /compute/v2.1/flavors => generated 448 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:04.783366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-db7da4d8-f1de-43d0-800e-b67bdde4c6f0 tempest-AZAdminNegativeTestJSON-633739330 tempest-AZAdminNegativeTestJSON-633739330-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:04.784194 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:04.784194 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:04.785452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-db7da4d8-f1de-43d0-800e-b67bdde4c6f0 tempest-AZAdminNegativeTestJSON-633739330 tempest-AZAdminNegativeTestJSON-633739330-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'a4a2e693a07a497ca0bd2c165e146b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0fe351741748758347d69d1ee166e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:04.786132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-db7da4d8-f1de-43d0-800e-b67bdde4c6f0 tempest-AZAdminNegativeTestJSON-633739330 tempest-AZAdminNegativeTestJSON-633739330-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:04.787211 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-db7da4d8-f1de-43d0-800e-b67bdde4c6f0 tempest-AZAdminNegativeTestJSON-633739330 tempest-AZAdminNegativeTestJSON-633739330-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.315091 Mar 12 20:48:04.795211 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3/5] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Mar 12 20:48:04 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 323 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:04.809471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2af6ba49-9369-4c1b-b95c-05be65b61e5f tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Calling method '.version_select at 0x7f6e46520d30>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:04.810776 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:04.810776 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:04.816739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2af6ba49-9369-4c1b-b95c-05be65b61e5f tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:04.817619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2af6ba49-9369-4c1b-b95c-05be65b61e5f tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:04.847412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2af6ba49-9369-4c1b-b95c-05be65b61e5f tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:04.850680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2af6ba49-9369-4c1b-b95c-05be65b61e5f tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:04.879732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2af6ba49-9369-4c1b-b95c-05be65b61e5f tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:04.880263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2af6ba49-9369-4c1b-b95c-05be65b61e5f tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:04.895743 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2af6ba49-9369-4c1b-b95c-05be65b61e5f tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.099134 Mar 12 20:48:04.898495 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4/6] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Mar 12 20:48:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:04.911525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e653f0bb-0bbf-4dae-9252-9de64c1266f2 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1966139314", "name": "tempest-test_aggregate-1064843404"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:04.989708 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:04.989708 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:04.991521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.aggregate [None req-e653f0bb-0bbf-4dae-9252-9de64c1266f2 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Generated uuid 9d04600d-305b-4809-a28a-ca77415256ce for aggregate {{(pid=136302) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:05.033454 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-51bfda8d-3037-4c2e-ba5b-90be3fcb77e1 tempest-FlavorMetadataValidation-675788420 tempest-FlavorMetadataValidation-675788420-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-452642256", "id": 1187906634, "os-flavor-access:is_public": "True"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:05.080803 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-51bfda8d-3037-4c2e-ba5b-90be3fcb77e1 tempest-FlavorMetadataValidation-675788420 tempest-FlavorMetadataValidation-675788420-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.350901 Mar 12 20:48:05.085837 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 3/7] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:48:04 2022] POST /compute/v2.1/flavors => generated 470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:05.136214 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e653f0bb-0bbf-4dae-9252-9de64c1266f2 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.236223 Mar 12 20:48:05.139316 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5/8] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Mar 12 20:48:04 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:05.155671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-426fd501-1e38-4ce2-9049-fe1d7c6a18d2 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Calling method '.version_select at 0x7f6e4533f9d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:05.156688 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:05.156688 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:05.160305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-426fd501-1e38-4ce2-9049-fe1d7c6a18d2 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:05.161694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-426fd501-1e38-4ce2-9049-fe1d7c6a18d2 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:05.186499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-426fd501-1e38-4ce2-9049-fe1d7c6a18d2 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:05.188838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-426fd501-1e38-4ce2-9049-fe1d7c6a18d2 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:05.208873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-426fd501-1e38-4ce2-9049-fe1d7c6a18d2 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:05.210262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-426fd501-1e38-4ce2-9049-fe1d7c6a18d2 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:05.221754 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-426fd501-1e38-4ce2-9049-fe1d7c6a18d2 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.081570 Mar 12 20:48:05.230448 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 6/9] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:05.239275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8ba6dfc-50a5-4753-899d-6b43edb29e30 tempest-FlavorMetadataValidation-675788420 tempest-FlavorMetadataValidation-675788420-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:05.241939 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:05.241939 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:05.485708 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1f92ac63-b210-4d91-a07c-0b9d19d1764f tempest-FlavorsV255TestJSON-1224313579 tempest-FlavorsV255TestJSON-1224313579-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:05.523823 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1f92ac63-b210-4d91-a07c-0b9d19d1764f tempest-FlavorsV255TestJSON-1224313579 tempest-FlavorsV255TestJSON-1224313579-project] 10.222.0.30 "GET /compute/v2.1/flavors/1510727232" status: 200 len: 448 microversion: 2.55 time: 0.436427 Mar 12 20:48:05.526404 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 4/10] 10.222.0.30 () {60 vars in 1198 bytes} [Sat Mar 12 20:48:05 2022] GET /compute/v2.1/flavors/1510727232 => generated 448 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:05.540680 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b5f989d3-f726-4063-afa6-55c4d1863d31 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:05.541675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8ba6dfc-50a5-4753-899d-6b43edb29e30 tempest-FlavorMetadataValidation-675788420 tempest-FlavorMetadataValidation-675788420-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1187906634/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.313639 Mar 12 20:48:05.543625 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:05.543625 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:05.544496 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 7/11] 10.222.0.30 () {62 vars in 1264 bytes} [Sat Mar 12 20:48:05 2022] POST /compute/v2.1/flavors/1187906634/os-extra_specs => generated 62 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:05.558158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b107372-6e49-40b4-be5c-e5c71ec88297 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Calling method '.version_select at 0x7f6e44ae2af0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:05.559084 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:05.559084 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:05.560353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b107372-6e49-40b4-be5c-e5c71ec88297 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:05.560809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b107372-6e49-40b4-be5c-e5c71ec88297 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:05.581568 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b5f989d3-f726-4063-afa6-55c4d1863d31 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.053919 Mar 12 20:48:05.584701 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 5/12] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 20:48:05 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:05.592791 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9a53e306-3af5-42ae-a730-ea7e53308da2 tempest-FlavorsV255TestJSON-2065524255 tempest-FlavorsV255TestJSON-2065524255-project-admin] Action: 'update', calling method: .version_select at 0x7f6e460af4c0>, body: {"flavor": {"description": "new"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:05.597474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b107372-6e49-40b4-be5c-e5c71ec88297 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:05.597970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b107372-6e49-40b4-be5c-e5c71ec88297 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:05.613376 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b107372-6e49-40b4-be5c-e5c71ec88297 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.067381 Mar 12 20:48:05.614272 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 8/13] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:05.621689 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:05.621689 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:05.629997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c4996994-3f41-48bc-a7e8-9fb9a2c2459a tempest-FlavorMetadataValidation-675788420 tempest-FlavorMetadataValidation-675788420-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:05.630725 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:05.630725 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:05.667125 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c4996994-3f41-48bc-a7e8-9fb9a2c2459a tempest-FlavorMetadataValidation-675788420 tempest-FlavorMetadataValidation-675788420-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1187906634" status: 202 len: 0 microversion: 2.86 time: 0.039856 Mar 12 20:48:05.669653 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 9/14] 10.222.0.30 () {60 vars in 1201 bytes} [Sat Mar 12 20:48:05 2022] DELETE /compute/v2.1/flavors/1187906634 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:48:05.678596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f0e98c5e-3043-46fd-af76-670fef92d8e3 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:05.682014 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:05.682014 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:05.698695 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9a53e306-3af5-42ae-a730-ea7e53308da2 tempest-FlavorsV255TestJSON-2065524255 tempest-FlavorsV255TestJSON-2065524255-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1510727232" status: 200 len: 449 microversion: 2.55 time: 0.112864 Mar 12 20:48:05.699880 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 6/15] 10.222.0.30 () {62 vars in 1218 bytes} [Sat Mar 12 20:48:05 2022] PUT /compute/v2.1/flavors/1510727232 => generated 449 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:05.708501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0e98c5e-3043-46fd-af76-670fef92d8e3 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:05.709402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0e98c5e-3043-46fd-af76-670fef92d8e3 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:05.711073 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0d2b79bb-b51b-4faf-929c-2fa94bb8c3e9 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Calling method '.version_select at 0x7f6e45b7b4c0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:05.711982 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:05.711982 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:05.713204 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0d2b79bb-b51b-4faf-929c-2fa94bb8c3e9 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:05.713651 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0d2b79bb-b51b-4faf-929c-2fa94bb8c3e9 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:05.769942 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0d2b79bb-b51b-4faf-929c-2fa94bb8c3e9 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.068878 Mar 12 20:48:05.770467 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 7/16] 10.222.0.30 () {58 vars in 1178 bytes} [Sat Mar 12 20:48:05 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:05.782212 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ef842b26-cba7-4d09-83ee-4e4a726cfaf8 tempest-FlavorMetadataValidation-675788420 tempest-FlavorMetadataValidation-675788420-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:05.836007 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ef842b26-cba7-4d09-83ee-4e4a726cfaf8 tempest-FlavorMetadataValidation-675788420 tempest-FlavorMetadataValidation-675788420-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6234 microversion: 2.86 time: 0.064303 Mar 12 20:48:05.836590 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 8/17] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Mar 12 20:48:05 2022] GET /compute/v2.1/flavors/detail => generated 6234 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:05.853759 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-71bce8d7-1605-490e-9073-781d31127554 tempest-FlavorsV255TestJSON-1224313579 tempest-FlavorsV255TestJSON-1224313579-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:05.942933 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-71bce8d7-1605-490e-9073-781d31127554 tempest-FlavorsV255TestJSON-1224313579 tempest-FlavorsV255TestJSON-1224313579-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.105222 Mar 12 20:48:05.945538 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 9/18] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Mar 12 20:48:05 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:05.957812 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9f01ad30-f3fe-473e-a134-4d919548c8be tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Calling method '.version_select at 0x7f6e45b2e4c0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:05.958679 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:05.958679 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:05.960566 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f01ad30-f3fe-473e-a134-4d919548c8be tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:05.961251 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f01ad30-f3fe-473e-a134-4d919548c8be tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:05.993244 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f01ad30-f3fe-473e-a134-4d919548c8be tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:05.994012 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f01ad30-f3fe-473e-a134-4d919548c8be tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:06.030473 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f01ad30-f3fe-473e-a134-4d919548c8be tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:06.032938 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f01ad30-f3fe-473e-a134-4d919548c8be tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:06.048920 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9f01ad30-f3fe-473e-a134-4d919548c8be tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.102178 Mar 12 20:48:06.050700 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 10/19] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:06.467675 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-045c0da5-263d-457c-b4c3-ef788ad3a990 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1006152719", "id": 1270033073, "os-flavor-access:is_public": "False"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:06.469699 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:06.469699 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:06.498166 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-045c0da5-263d-457c-b4c3-ef788ad3a990 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.445506 Mar 12 20:48:06.499797 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:06 2022] POST /compute/v2.1/flavors => generated 431 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:06.517298 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4ba1a87b-2575-4ae7-96ed-04f86df34b82 tempest-FlavorsV255TestJSON-1224313579 tempest-FlavorsV255TestJSON-1224313579-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:06.556118 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f0e98c5e-3043-46fd-af76-670fef92d8e3 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 0.882961 Mar 12 20:48:06.573321 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 10/21] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:48:05 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:06.576177 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4ba1a87b-2575-4ae7-96ed-04f86df34b82 tempest-FlavorsV255TestJSON-1224313579 tempest-FlavorsV255TestJSON-1224313579-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.075113 Mar 12 20:48:06.576984 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 12/22] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Mar 12 20:48:06 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:06.589604 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9c281218-eea0-471a-ab62-5aa8398127ca tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7ed24fd1eb0342a5983cbc96ca015517"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:06.593864 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:06.593864 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:06.595995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56b9c65d-4cc0-4aa0-8dd5-36369acea148 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Calling method '.version_select at 0x7f6e441d6ee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:06.596964 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:06.596964 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:06.601386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56b9c65d-4cc0-4aa0-8dd5-36369acea148 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:06.602040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56b9c65d-4cc0-4aa0-8dd5-36369acea148 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:06.618985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56b9c65d-4cc0-4aa0-8dd5-36369acea148 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:06.619436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56b9c65d-4cc0-4aa0-8dd5-36369acea148 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:06.629840 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56b9c65d-4cc0-4aa0-8dd5-36369acea148 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.054810 Mar 12 20:48:06.630464 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 11/23] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:06 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:06.644965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b60e9d1-c293-4e11-aeb9-6fd27a9e1e02 tempest-FlavorsV255TestJSON-2065524255 tempest-FlavorsV255TestJSON-2065524255-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:06.645749 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:06.645749 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:06.678892 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b60e9d1-c293-4e11-aeb9-6fd27a9e1e02 tempest-FlavorsV255TestJSON-2065524255 tempest-FlavorsV255TestJSON-2065524255-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1510727232" status: 202 len: 0 microversion: 2.55 time: 0.036874 Mar 12 20:48:06.683282 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 12/24] 10.222.0.30 () {60 vars in 1201 bytes} [Sat Mar 12 20:48:06 2022] DELETE /compute/v2.1/flavors/1510727232 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:48:06.687253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7a5ad0c-3f7b-4c58-8a68-01ffc57e61ba tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Calling method '.version_select at 0x7f6e441db430>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:06.688158 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:06.688158 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:06.690521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7a5ad0c-3f7b-4c58-8a68-01ffc57e61ba tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:06.691088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7a5ad0c-3f7b-4c58-8a68-01ffc57e61ba tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:06.710774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7a5ad0c-3f7b-4c58-8a68-01ffc57e61ba tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:06.711450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7a5ad0c-3f7b-4c58-8a68-01ffc57e61ba tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:06.719100 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7a5ad0c-3f7b-4c58-8a68-01ffc57e61ba tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.037004 Mar 12 20:48:06.720089 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:06 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:06.738381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6d6b8c2f-8391-4ecc-ace7-4e8b6ee7250f tempest-FlavorsV255TestJSON-2065524255 tempest-FlavorsV255TestJSON-2065524255-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:06.776462 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6d6b8c2f-8391-4ecc-ace7-4e8b6ee7250f tempest-FlavorsV255TestJSON-2065524255 tempest-FlavorsV255TestJSON-2065524255-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.048239 Mar 12 20:48:06.785907 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 14/26] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Mar 12 20:48:06 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:06.785907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-92140e25-52ab-42fe-9f70-fb3dba39aa01 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Calling method '.version_select at 0x7f6e441db700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:06.785907 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:06.785907 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:06.785907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92140e25-52ab-42fe-9f70-fb3dba39aa01 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:06.785907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92140e25-52ab-42fe-9f70-fb3dba39aa01 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:06.804137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92140e25-52ab-42fe-9f70-fb3dba39aa01 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:06.804826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92140e25-52ab-42fe-9f70-fb3dba39aa01 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:06.822762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92140e25-52ab-42fe-9f70-fb3dba39aa01 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:06.823513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92140e25-52ab-42fe-9f70-fb3dba39aa01 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:06.837342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92140e25-52ab-42fe-9f70-fb3dba39aa01 tempest-HypervisorAdminTestJSON-658665396 tempest-HypervisorAdminTestJSON-658665396-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 20:48:06.840525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30ca0922-f39a-4524-b7ff-cb5795ae1309 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:06.841157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30ca0922-f39a-4524-b7ff-cb5795ae1309 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:06.842482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30ca0922-f39a-4524-b7ff-cb5795ae1309 None None] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:06.843100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30ca0922-f39a-4524-b7ff-cb5795ae1309 None None] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:06.871355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.rpcapi [None req-30ca0922-f39a-4524-b7ff-cb5795ae1309 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 12 20:48:06.872625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30ca0922-f39a-4524-b7ff-cb5795ae1309 None None] Releasing lock "compute-rpcapi-router" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 20:48:06.963334 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30ca0922-f39a-4524-b7ff-cb5795ae1309 None None] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.183578 Mar 12 20:48:06.965173 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 15/27] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Mar 12 20:48:06 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:07.648327 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9c281218-eea0-471a-ab62-5aa8398127ca tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1270033073/action" status: 200 len: 97 microversion: 2.1 time: 1.069841 Mar 12 20:48:07.648965 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 13/28] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Mar 12 20:48:06 2022] POST /compute/v2.1/flavors/1270033073/action => generated 97 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:07.816183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-10842464", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "availability_zone": "tempest-test_az-1966139314"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:07.855845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:07.856507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:07.857450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:07.858302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:08.098205 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fb8a45ae-5f73-4014-833a-046f6a85711d tempest-FlavorsAccessTestJSON-1552936802 tempest-FlavorsAccessTestJSON-1552936802-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:08.124675 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fb8a45ae-5f73-4014-833a-046f6a85711d tempest-FlavorsAccessTestJSON-1552936802 tempest-FlavorsAccessTestJSON-1552936802-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.466639 Mar 12 20:48:08.137242 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 14/29] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:07 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:08.142921 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2dabbf18-0aa0-489b-bc07-082420e347b7 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7ed24fd1eb0342a5983cbc96ca015517"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:08.144401 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:08.144401 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:08.761902 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2dabbf18-0aa0-489b-bc07-082420e347b7 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1270033073/action" status: 200 len: 21 microversion: 2.1 time: 0.621932 Mar 12 20:48:08.769345 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 15/30] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Mar 12 20:48:08 2022] POST /compute/v2.1/flavors/1270033073/action => generated 21 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:08.782421 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5e541ac4-9494-4171-b1c2-3b01b9b5c74c tempest-FlavorsAccessTestJSON-1552936802 tempest-FlavorsAccessTestJSON-1552936802-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:08.831352 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5e541ac4-9494-4171-b1c2-3b01b9b5c74c tempest-FlavorsAccessTestJSON-1552936802 tempest-FlavorsAccessTestJSON-1552936802-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054985 Mar 12 20:48:08.844773 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 16/31] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:08.849527 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7826295c-cd4a-46db-9000-d24bc83aa9ae tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:08.853838 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:08.853838 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:08.910156 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7826295c-cd4a-46db-9000-d24bc83aa9ae tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1270033073" status: 202 len: 0 microversion: 2.1 time: 0.063641 Mar 12 20:48:08.915507 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 17/32] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Mar 12 20:48:08 2022] DELETE /compute/v2.1/flavors/1270033073 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:48:08.929352 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-64b08f31-6e1b-45bb-91a1-02c78c0ca884 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:08.987944 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-64b08f31-6e1b-45bb-91a1-02c78c0ca884 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070810 Mar 12 20:48:08.989926 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 18/33] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:09.010031 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e4c4d7ea-3912-4861-89f1-6b0bb652af24 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2092959833", "id": 635315982, "os-flavor-access:is_public": "False"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:09.047282 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e4c4d7ea-3912-4861-89f1-6b0bb652af24 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.043715 Mar 12 20:48:09.050488 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 19/34] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:09 2022] POST /compute/v2.1/flavors => generated 428 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:09.060503 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-766bf381-13f2-4465-bb93-f1391af01887 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:09.062802 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:09.062802 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:09.082206 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-766bf381-13f2-4465-bb93-f1391af01887 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/635315982/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.024939 Mar 12 20:48:09.084177 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 20/35] 10.222.0.30 () {58 vars in 1205 bytes} [Sat Mar 12 20:48:09 2022] GET /compute/v2.1/flavors/635315982/os-flavor-access => generated 21 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 12 20:48:09.111749 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-6b0522fa-f527-43e5-b54b-eef8c68c7fd5 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:09.169695 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-6b0522fa-f527-43e5-b54b-eef8c68c7fd5 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/635315982" status: 202 len: 0 microversion: 2.1 time: 0.079610 Mar 12 20:48:09.173761 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 21/36] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:48:09 2022] DELETE /compute/v2.1/flavors/635315982 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:48:09.178518 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-51c2dfbd-ada4-4185-9218-bb9bdd7b2986 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:09.199326 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-51c2dfbd-ada4-4185-9218-bb9bdd7b2986 tempest-FlavorsAccessTestJSON-1630626159 tempest-FlavorsAccessTestJSON-1630626159-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024267 Mar 12 20:48:09.211198 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 22/37] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:09.321272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:48:09.750145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:48:09.751102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:48:09.752069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:48:09.753013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:48:09.754462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:48:09.772627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:09.773351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:09.774618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:09.775412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:09.822984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Getting quotas for project 40f760324b47441b87a22d536df238c6. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:48:09.831189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Getting quotas for user 24ff8e5e41c3418992c25e162e502c44 and project 40f760324b47441b87a22d536df238c6. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:48:09.863448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:48:09.869391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:48:09.965576 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-083ccf57-516f-462a-97d2-9280db32abe1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.996573 Mar 12 20:48:09.973083 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 16/38] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:48:09.980678 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-823beb05-7531-46bc-8faa-d9b86ccb43db tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:09.981529 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-823beb05-7531-46bc-8faa-d9b86ccb43db tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:11.521063 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-823beb05-7531-46bc-8faa-d9b86ccb43db tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:11.563685 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-823beb05-7531-46bc-8faa-d9b86ccb43db tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1241 microversion: 2.1 time: 1.590207 Mar 12 20:48:11.567830 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 23/39] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:09 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1241 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:12.589244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f65abf4a-aa1b-4471-aad6-b8724fa4669e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:12.590045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f65abf4a-aa1b-4471-aad6-b8724fa4669e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:12.667662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f65abf4a-aa1b-4471-aad6-b8724fa4669e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:12.674473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f65abf4a-aa1b-4471-aad6-b8724fa4669e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:12.681651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f65abf4a-aa1b-4471-aad6-b8724fa4669e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:12.682380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f65abf4a-aa1b-4471-aad6-b8724fa4669e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:13.293490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f65abf4a-aa1b-4471-aad6-b8724fa4669e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:13.323002 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f65abf4a-aa1b-4471-aad6-b8724fa4669e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1289 microversion: 2.1 time: 0.738391 Mar 12 20:48:13.328390 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 17/40] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:12 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1289 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:14.344343 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-69877bff-1e59-44be-9d4a-f6c5aa6b4de1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:14.345524 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-69877bff-1e59-44be-9d4a-f6c5aa6b4de1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:14.359915 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-69877bff-1e59-44be-9d4a-f6c5aa6b4de1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:14.360391 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-69877bff-1e59-44be-9d4a-f6c5aa6b4de1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:14.361232 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-69877bff-1e59-44be-9d4a-f6c5aa6b4de1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:14.363783 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-69877bff-1e59-44be-9d4a-f6c5aa6b4de1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:14.905584 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-69877bff-1e59-44be-9d4a-f6c5aa6b4de1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:14.921436 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-69877bff-1e59-44be-9d4a-f6c5aa6b4de1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1295 microversion: 2.1 time: 0.582117 Mar 12 20:48:14.931805 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 24/41] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:14 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1295 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:15.950032 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fa788224-70ff-4266-9395-f572719ced37 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:15.950736 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-fa788224-70ff-4266-9395-f572719ced37 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:15.964151 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa788224-70ff-4266-9395-f572719ced37 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:15.965002 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa788224-70ff-4266-9395-f572719ced37 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:15.966173 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa788224-70ff-4266-9395-f572719ced37 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:15.966783 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa788224-70ff-4266-9395-f572719ced37 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:16.448864 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fa788224-70ff-4266-9395-f572719ced37 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:16.457403 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fa788224-70ff-4266-9395-f572719ced37 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1337 microversion: 2.1 time: 0.513038 Mar 12 20:48:16.463809 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 25/42] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:15 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1337 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:48:16.682312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1e8fd116-3226-4ba7-bb20-8a03576f7557 tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] Calling method '.version_select at 0x7f6e44182e50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:16.684796 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:16.684796 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:16.689671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e8fd116-3226-4ba7-bb20-8a03576f7557 tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:16.691817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e8fd116-3226-4ba7-bb20-8a03576f7557 tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:16.758274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e8fd116-3226-4ba7-bb20-8a03576f7557 tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:16.759154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e8fd116-3226-4ba7-bb20-8a03576f7557 tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:16.786165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e8fd116-3226-4ba7-bb20-8a03576f7557 tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:16.786938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e8fd116-3226-4ba7-bb20-8a03576f7557 tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:16.807838 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1e8fd116-3226-4ba7-bb20-8a03576f7557 tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.909073 Mar 12 20:48:16.808713 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 18/43] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Mar 12 20:48:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:16.823011 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-6c4c3562-347e-4d0b-9bcb-1b5c5a6387be tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] Calling method '.version_select at 0x7f6e459a48b0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:16.825525 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:16.825525 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:16.830094 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6c4c3562-347e-4d0b-9bcb-1b5c5a6387be tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:16.834411 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6c4c3562-347e-4d0b-9bcb-1b5c5a6387be tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:16.896794 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6c4c3562-347e-4d0b-9bcb-1b5c5a6387be tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:16.897893 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6c4c3562-347e-4d0b-9bcb-1b5c5a6387be tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:16.913833 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-6c4c3562-347e-4d0b-9bcb-1b5c5a6387be tempest-HypervisorAdminV228Test-1999101201 tempest-HypervisorAdminV228Test-1999101201-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.097509 Mar 12 20:48:16.919650 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 26/44] 10.222.0.30 () {60 vars in 1192 bytes} [Sat Mar 12 20:48:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:17.477348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ecdaa6bb-4eb3-4e77-887f-b005503a014a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:17.479125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ecdaa6bb-4eb3-4e77-887f-b005503a014a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:17.492650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecdaa6bb-4eb3-4e77-887f-b005503a014a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:17.497381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecdaa6bb-4eb3-4e77-887f-b005503a014a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:17.500427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecdaa6bb-4eb3-4e77-887f-b005503a014a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:17.501089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecdaa6bb-4eb3-4e77-887f-b005503a014a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:18.629091 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b4af5554-f01e-4059-bf59-22971c9de1bc tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Calling method '.version_select at 0x7f6e45aba4c0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:18.630202 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:18.630202 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:18.631821 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4af5554-f01e-4059-bf59-22971c9de1bc tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:18.632493 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4af5554-f01e-4059-bf59-22971c9de1bc tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:18.696145 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4af5554-f01e-4059-bf59-22971c9de1bc tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:18.698746 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4af5554-f01e-4059-bf59-22971c9de1bc tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:18.744143 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4af5554-f01e-4059-bf59-22971c9de1bc tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:18.745524 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4af5554-f01e-4059-bf59-22971c9de1bc tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:18.771857 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b4af5554-f01e-4059-bf59-22971c9de1bc tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.693283 Mar 12 20:48:18.778635 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 27/45] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:48:18.925407 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-49526e13-7c47-4bd6-b7ca-630fbaf41afa tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Calling method '.version_select at 0x7f6e459a4b80>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:18.926582 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:18.926582 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:18.928207 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-49526e13-7c47-4bd6-b7ca-630fbaf41afa tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:18.929040 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-49526e13-7c47-4bd6-b7ca-630fbaf41afa tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:18.992890 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-49526e13-7c47-4bd6-b7ca-630fbaf41afa tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:18.999357 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-49526e13-7c47-4bd6-b7ca-630fbaf41afa tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.072706 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-49526e13-7c47-4bd6-b7ca-630fbaf41afa tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.078381 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-49526e13-7c47-4bd6-b7ca-630fbaf41afa tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.106753 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-49526e13-7c47-4bd6-b7ca-630fbaf41afa tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.310896 Mar 12 20:48:19.107990 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 28/46] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:19.541682 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fb3fe27f-17e3-4e35-953a-6a21e4b68a0b tempest-HypervisorAdminNegativeUnderV252Test-517602104 tempest-HypervisorAdminNegativeUnderV252Test-517602104-project] Calling method '.version_select at 0x7f6e459a4ca0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:19.542715 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:19.542715 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:19.543949 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fb3fe27f-17e3-4e35-953a-6a21e4b68a0b tempest-HypervisorAdminNegativeUnderV252Test-517602104 tempest-HypervisorAdminNegativeUnderV252Test-517602104-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '98f5025017a648f69bff6b79e3183883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fc2e35603f457e847516b84b4ef807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:19.544658 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fb3fe27f-17e3-4e35-953a-6a21e4b68a0b tempest-HypervisorAdminNegativeUnderV252Test-517602104 tempest-HypervisorAdminNegativeUnderV252Test-517602104-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:19.545575 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fb3fe27f-17e3-4e35-953a-6a21e4b68a0b tempest-HypervisorAdminNegativeUnderV252Test-517602104 tempest-HypervisorAdminNegativeUnderV252Test-517602104-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.433940 Mar 12 20:48:19.546190 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 29/47] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Mar 12 20:48:19 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 435 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:19.566803 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-838f9758-1fa9-4dd0-962d-2b937bce62cb tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Calling method '.version_select at 0x7f6e459b00d0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:19.567890 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:19.567890 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:19.569399 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-838f9758-1fa9-4dd0-962d-2b937bce62cb tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.570098 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-838f9758-1fa9-4dd0-962d-2b937bce62cb tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.619286 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-838f9758-1fa9-4dd0-962d-2b937bce62cb tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.620090 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-838f9758-1fa9-4dd0-962d-2b937bce62cb tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.707673 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-838f9758-1fa9-4dd0-962d-2b937bce62cb tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.712045 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-838f9758-1fa9-4dd0-962d-2b937bce62cb tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.736899 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-838f9758-1fa9-4dd0-962d-2b937bce62cb tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.189435 Mar 12 20:48:19.741167 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 30/48] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Mar 12 20:48:19 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 196 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:19.752768 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-44f2b676-178f-4b51-a086-4b609a0c0173 tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Calling method '.version_select at 0x7f6e459b0dc0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:19.754991 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:19.754991 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:19.765718 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-44f2b676-178f-4b51-a086-4b609a0c0173 tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.766460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-44f2b676-178f-4b51-a086-4b609a0c0173 tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.770123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ecdaa6bb-4eb3-4e77-887f-b005503a014a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:19.783799 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-44f2b676-178f-4b51-a086-4b609a0c0173 tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Mar 12 20:48:19.784876 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-44f2b676-178f-4b51-a086-4b609a0c0173 tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:19.789102 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-44f2b676-178f-4b51-a086-4b609a0c0173 tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.043893 Mar 12 20:48:19.793524 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 31/49] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Mar 12 20:48:19 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:19.799512 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ecdaa6bb-4eb3-4e77-887f-b005503a014a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1337 microversion: 2.1 time: 2.325064 Mar 12 20:48:19.800620 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 19/50] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:17 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1337 bytes in 2330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:19.814323 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-62ab6896-80db-4f95-8f71-a194f3f4f674 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Calling method '.version_select at 0x7f6e459ba9d0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:19.817525 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:19.817525 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:19.819089 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-62ab6896-80db-4f95-8f71-a194f3f4f674 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.819841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7593e185-200d-425a-b6cd-219da1d4e80c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Calling method '.version_select at 0x7f6e440baf70>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:19.820741 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-62ab6896-80db-4f95-8f71-a194f3f4f674 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.825479 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:19.825479 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:19.827298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7593e185-200d-425a-b6cd-219da1d4e80c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.827945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7593e185-200d-425a-b6cd-219da1d4e80c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.858767 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-62ab6896-80db-4f95-8f71-a194f3f4f674 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.870246 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-62ab6896-80db-4f95-8f71-a194f3f4f674 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.870580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7593e185-200d-425a-b6cd-219da1d4e80c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.871224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7593e185-200d-425a-b6cd-219da1d4e80c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.884700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7593e185-200d-425a-b6cd-219da1d4e80c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.885446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7593e185-200d-425a-b6cd-219da1d4e80c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.892741 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7593e185-200d-425a-b6cd-219da1d4e80c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.090984 Mar 12 20:48:19.903039 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-62ab6896-80db-4f95-8f71-a194f3f4f674 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.908889 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-62ab6896-80db-4f95-8f71-a194f3f4f674 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.912644 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 20/51] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:19.935833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1a35e3c1-01eb-4132-b2e5-041593eeaf52 tempest-HypervisorAdminNegativeUnderV252Test-517602104 tempest-HypervisorAdminNegativeUnderV252Test-517602104-project] Calling method '.version_select at 0x7f6e44084f70>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:19.937601 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-62ab6896-80db-4f95-8f71-a194f3f4f674 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.143025 Mar 12 20:48:19.939099 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:19.939099 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:19.946054 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 32/52] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:19.949252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1a35e3c1-01eb-4132-b2e5-041593eeaf52 tempest-HypervisorAdminNegativeUnderV252Test-517602104 tempest-HypervisorAdminNegativeUnderV252Test-517602104-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '98f5025017a648f69bff6b79e3183883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fc2e35603f457e847516b84b4ef807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:19.950052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1a35e3c1-01eb-4132-b2e5-041593eeaf52 tempest-HypervisorAdminNegativeUnderV252Test-517602104 tempest-HypervisorAdminNegativeUnderV252Test-517602104-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:19.951098 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1a35e3c1-01eb-4132-b2e5-041593eeaf52 tempest-HypervisorAdminNegativeUnderV252Test-517602104 tempest-HypervisorAdminNegativeUnderV252Test-517602104-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.025123 Mar 12 20:48:19.953821 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 21/53] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Mar 12 20:48:19 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:48:19.962231 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f7028cfb-ed5c-497c-8539-5e4b167bbd75 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Calling method '.version_select at 0x7f6e459b0310>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:19.969292 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:19.969292 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:19.971060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-197b4c1c-3d93-46bd-ace5-4d698089b47c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Calling method '.version_select at 0x7f6e44051550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:19.980489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197b4c1c-3d93-46bd-ace5-4d698089b47c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.981306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197b4c1c-3d93-46bd-ace5-4d698089b47c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:19.981454 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f7028cfb-ed5c-497c-8539-5e4b167bbd75 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:19.982404 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f7028cfb-ed5c-497c-8539-5e4b167bbd75 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:20.019661 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f7028cfb-ed5c-497c-8539-5e4b167bbd75 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:20.020649 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f7028cfb-ed5c-497c-8539-5e4b167bbd75 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:20.027554 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-197b4c1c-3d93-46bd-ace5-4d698089b47c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] HTTP exception thrown: No hypervisor matching 'b9cdcafe-17be-4769-8c5f-847a5f90868d' could be found. Mar 12 20:48:20.028166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-197b4c1c-3d93-46bd-ace5-4d698089b47c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] Returning 404 to user: No hypervisor matching 'b9cdcafe-17be-4769-8c5f-847a5f90868d' could be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:20.029020 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-197b4c1c-3d93-46bd-ace5-4d698089b47c tempest-HypervisorAdminNegativeUnderV252Test-1743329200 tempest-HypervisorAdminNegativeUnderV252Test-1743329200-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/b9cdcafe-17be-4769-8c5f-847a5f90868d/servers" status: 404 len: 123 microversion: 2.1 time: 0.068827 Mar 12 20:48:20.029595 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 22/54] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Mar 12 20:48:19 2022] GET /compute/v2.1/os-hypervisors/b9cdcafe-17be-4769-8c5f-847a5f90868d/servers => generated 123 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:20.032256 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f7028cfb-ed5c-497c-8539-5e4b167bbd75 tempest-HypervisorAdminUnderV252Test-1744233420 tempest-HypervisorAdminUnderV252Test-1744233420-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.081881 Mar 12 20:48:20.033419 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 33/55] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Mar 12 20:48:19 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:20.819589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-48898037-cd91-4d38-97e8-d4be5b002ceb tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:20.822955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-48898037-cd91-4d38-97e8-d4be5b002ceb tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:20.841007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48898037-cd91-4d38-97e8-d4be5b002ceb tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:20.842788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48898037-cd91-4d38-97e8-d4be5b002ceb tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:20.854158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48898037-cd91-4d38-97e8-d4be5b002ceb tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:20.856143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48898037-cd91-4d38-97e8-d4be5b002ceb tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:21.968500 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-dcba3f94-32a0-4cb2-8cca-89f13660e345 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-476744316", "ram": 512, "vcpus": 1, "disk": 10, "id": 1959519693, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:21.970250 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:21.970250 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:21.991664 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-dcba3f94-32a0-4cb2-8cca-89f13660e345 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.562312 Mar 12 20:48:22.000471 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 34/56] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:21 2022] POST /compute/v2.1/flavors => generated 415 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:22.009740 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7462b75c-0156-42d9-803f-68a82c9ce9c2 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:22.012965 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:22.012965 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:22.048960 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7462b75c-0156-42d9-803f-68a82c9ce9c2 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1959519693/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046958 Mar 12 20:48:22.056583 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 35/57] 10.222.0.30 () {60 vars in 1223 bytes} [Sat Mar 12 20:48:22 2022] POST /compute/v2.1/flavors/1959519693/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:22.285364 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-94013f9d-54e5-411b-b992-dbed38ff259d tempest-FlavorsExtraSpecsTestJSON-1397366249 tempest-FlavorsExtraSpecsTestJSON-1397366249-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:22.322729 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-94013f9d-54e5-411b-b992-dbed38ff259d tempest-FlavorsExtraSpecsTestJSON-1397366249 tempest-FlavorsExtraSpecsTestJSON-1397366249-project] 10.222.0.30 "GET /compute/v2.1/flavors/1959519693/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.264139 Mar 12 20:48:22.327143 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 36/58] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Mar 12 20:48:22 2022] GET /compute/v2.1/flavors/1959519693/os-extra_specs => generated 66 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:22.340412 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-aa5444a7-d0da-4e7b-a43f-34a3861552c4 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:22.406538 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-aa5444a7-d0da-4e7b-a43f-34a3861552c4 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1959519693/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.072988 Mar 12 20:48:22.413512 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 37/59] 10.222.0.30 () {60 vars in 1223 bytes} [Sat Mar 12 20:48:22 2022] POST /compute/v2.1/flavors/1959519693/os-extra_specs => generated 66 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:22.421132 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-218e8fae-3621-4aca-8a09-26a43512e767 tempest-FlavorsExtraSpecsTestJSON-1397366249 tempest-FlavorsExtraSpecsTestJSON-1397366249-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:22.441731 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-218e8fae-3621-4aca-8a09-26a43512e767 tempest-FlavorsExtraSpecsTestJSON-1397366249 tempest-FlavorsExtraSpecsTestJSON-1397366249-project] 10.222.0.30 "GET /compute/v2.1/flavors/1959519693/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.025823 Mar 12 20:48:22.446882 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 38/60] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 20:48:22 2022] GET /compute/v2.1/flavors/1959519693/os-extra_specs/hw:numa_nodes => generated 22 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 12 20:48:22.461364 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ba260ed1-866b-4cc8-a9d7-98c32c63e0b0 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:22.545295 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ba260ed1-866b-4cc8-a9d7-98c32c63e0b0 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1959519693/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.089392 Mar 12 20:48:22.546553 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 39/61] 10.222.0.30 () {60 vars in 1223 bytes} [Sat Mar 12 20:48:22 2022] POST /compute/v2.1/flavors/1959519693/os-extra_specs => generated 66 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 12 20:48:22.554622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-48898037-cd91-4d38-97e8-d4be5b002ceb tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:22.569748 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-48898037-cd91-4d38-97e8-d4be5b002ceb tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1337 microversion: 2.1 time: 1.756776 Mar 12 20:48:22.570398 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-53d8512b-1d24-476f-b13b-b360ffa6c3ed tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:22.574188 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 23/62] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:20 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1337 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:22.594874 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-53d8512b-1d24-476f-b13b-b360ffa6c3ed tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1959519693/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036873 Mar 12 20:48:22.603795 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 40/63] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Mar 12 20:48:22 2022] GET /compute/v2.1/flavors/1959519693/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:22.608588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cde9def9-3c37-43ee-8e5a-896f78c9ab21 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:22.611161 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:22.611161 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:22.669100 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cde9def9-3c37-43ee-8e5a-896f78c9ab21 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1959519693/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.062400 Mar 12 20:48:22.670021 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 24/64] 10.222.0.30 () {60 vars in 1264 bytes} [Sat Mar 12 20:48:22 2022] PUT /compute/v2.1/flavors/1959519693/os-extra_specs/hw:numa_nodes => generated 22 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:22.693200 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2ffedc67-3167-4053-92e8-961767f91c54 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:22.717245 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2ffedc67-3167-4053-92e8-961767f91c54 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1959519693/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037607 Mar 12 20:48:22.717936 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 41/65] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Mar 12 20:48:22 2022] GET /compute/v2.1/flavors/1959519693/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:22.727361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1a216307-78ea-47ef-a23e-a4020a320b04 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:22.728115 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:22.728115 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:22.785718 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1a216307-78ea-47ef-a23e-a4020a320b04 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1959519693/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.061124 Mar 12 20:48:22.789201 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 25/66] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 20:48:22 2022] DELETE /compute/v2.1/flavors/1959519693/os-extra_specs/hw:numa_nodes => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:22.795467 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-46e1b75a-0fe0-48cd-8bbe-5694bcb37804 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:22.796516 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:22.796516 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:22.840582 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-46e1b75a-0fe0-48cd-8bbe-5694bcb37804 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1959519693/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.048764 Mar 12 20:48:22.842721 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 42/67] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 20:48:22 2022] DELETE /compute/v2.1/flavors/1959519693/os-extra_specs/hw:cpu_policy => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:22.849846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-11385024-7435-4b67-940c-de2b41fda20d tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:22.875563 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-11385024-7435-4b67-940c-de2b41fda20d tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1959519693/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029730 Mar 12 20:48:22.878501 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 26/68] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Mar 12 20:48:22 2022] GET /compute/v2.1/flavors/1959519693/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:22.887121 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4a235b36-d95a-451d-9d77-d7dbf1d42ef8 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:22.895018 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:22.895018 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:22.936026 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4a235b36-d95a-451d-9d77-d7dbf1d42ef8 tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1959519693" status: 202 len: 0 microversion: 2.1 time: 0.053672 Mar 12 20:48:22.938244 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 43/69] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Mar 12 20:48:22 2022] DELETE /compute/v2.1/flavors/1959519693 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 20:48:22.945491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ad78c40-d9aa-46b3-8672-880ad2311c7f tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:22.986117 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ad78c40-d9aa-46b3-8672-880ad2311c7f tempest-FlavorsExtraSpecsTestJSON-335314295 tempest-FlavorsExtraSpecsTestJSON-335314295-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043913 Mar 12 20:48:22.989292 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 27/70] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:48:23.605541 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-10a54891-b07f-4cba-8284-544d0395afb1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:23.608076 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-10a54891-b07f-4cba-8284-544d0395afb1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:23.615896 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10a54891-b07f-4cba-8284-544d0395afb1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:23.619737 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10a54891-b07f-4cba-8284-544d0395afb1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:23.623251 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10a54891-b07f-4cba-8284-544d0395afb1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:23.623922 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10a54891-b07f-4cba-8284-544d0395afb1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:24.336975 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-10a54891-b07f-4cba-8284-544d0395afb1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:24.376492 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-10a54891-b07f-4cba-8284-544d0395afb1 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1337 microversion: 2.1 time: 0.763679 Mar 12 20:48:24.380026 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 44/71] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:23 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1337 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:24.814845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-65cf5511-a40e-459b-b01a-13b7db2cbb93 req-f71b7208-51ac-4892-a286-c70b79fe43b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd46d9b-8f4b-45b5-acd7-d0fad29477de", "tag": "3a62bf65-339f-4aeb-b067-e21644cb2004"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:24.841838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-65cf5511-a40e-459b-b01a-13b7db2cbb93 req-f71b7208-51ac-4892-a286-c70b79fe43b4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:24.842656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-65cf5511-a40e-459b-b01a-13b7db2cbb93 req-f71b7208-51ac-4892-a286-c70b79fe43b4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:24.879980 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-65cf5511-a40e-459b-b01a-13b7db2cbb93 req-f71b7208-51ac-4892-a286-c70b79fe43b4 service nova] Creating event network-changed:3a62bf65-339f-4aeb-b067-e21644cb2004 for instance 6cd46d9b-8f4b-45b5-acd7-d0fad29477de on nch2-master-1 Mar 12 20:48:24.888599 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-65cf5511-a40e-459b-b01a-13b7db2cbb93 req-f71b7208-51ac-4892-a286-c70b79fe43b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.560562 Mar 12 20:48:24.890525 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 28/72] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:25.401212 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-de68a644-db0c-450a-adbc-c1e158afc587 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:25.402624 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-de68a644-db0c-450a-adbc-c1e158afc587 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:25.414387 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de68a644-db0c-450a-adbc-c1e158afc587 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:25.417283 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de68a644-db0c-450a-adbc-c1e158afc587 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:25.419662 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de68a644-db0c-450a-adbc-c1e158afc587 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:25.421174 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de68a644-db0c-450a-adbc-c1e158afc587 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:25.695274 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-de68a644-db0c-450a-adbc-c1e158afc587 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:25.703247 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-de68a644-db0c-450a-adbc-c1e158afc587 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1337 microversion: 2.1 time: 0.307639 Mar 12 20:48:25.704209 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 45/73] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:25 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1337 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:26.157417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ac01c0d4-f744-475b-8ef3-eda4bb0938e8 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:26.174596 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ac01c0d4-f744-475b-8ef3-eda4bb0938e8 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.698428 Mar 12 20:48:26.176642 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 29/74] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:48:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:48:26.720467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-10db4290-6124-48c8-800e-92b08560e238 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:26.721838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-10db4290-6124-48c8-800e-92b08560e238 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:26.735171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10db4290-6124-48c8-800e-92b08560e238 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:26.736808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10db4290-6124-48c8-800e-92b08560e238 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:26.738442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10db4290-6124-48c8-800e-92b08560e238 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:26.740248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10db4290-6124-48c8-800e-92b08560e238 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:26.925488 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5efe3a28-ff54-4081-9beb-82f68624b3ed tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-342831126", "id": 377171495, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:26.927272 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:26.927272 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:26.962110 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5efe3a28-ff54-4081-9beb-82f68624b3ed tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.775613 Mar 12 20:48:26.966242 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 46/75] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:26 2022] POST /compute/v2.1/flavors => generated 421 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:26.976936 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a8810272-2ea8-456c-b8e7-833e56387d38 tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:27.001469 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a8810272-2ea8-456c-b8e7-833e56387d38 tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028509 Mar 12 20:48:27.003018 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 47/76] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Mar 12 20:48:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:27.015223 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-64c4f3fe-c9d4-4911-b58a-2f00348f1e47 tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1713924065", "id": 817529204, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:27.046862 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-64c4f3fe-c9d4-4911-b58a-2f00348f1e47 tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.038114 Mar 12 20:48:27.052317 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 48/77] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:27 2022] POST /compute/v2.1/flavors => generated 422 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:27.070515 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-662b5200-0166-4845-8e3c-096cff9d083e tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:27.086367 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-662b5200-0166-4845-8e3c-096cff9d083e tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.027846 Mar 12 20:48:27.088991 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 49/78] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Mar 12 20:48:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 12 20:48:27.103747 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8162a77c-6063-421f-9dbb-df2f93647fac tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Action: 'create', calling method: .version_select at 0x7f6e4591c820>, body: {"keypair": {"name": "tempest-keypair-1383205792"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:27.151818 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-8162a77c-6063-421f-9dbb-df2f93647fac tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Getting quotas for project 2f8c425aaac144c2aa98af4365bf84a6. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:48:27.162724 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-8162a77c-6063-421f-9dbb-df2f93647fac tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Getting quotas for user df10426ae3e14b428a1a7dc944867ce2 and project 2f8c425aaac144c2aa98af4365bf84a6. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:48:27.273728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-10db4290-6124-48c8-800e-92b08560e238 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:27.281687 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-10db4290-6124-48c8-800e-92b08560e238 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1337 microversion: 2.1 time: 0.564922 Mar 12 20:48:27.282138 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 30/79] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:26 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1337 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:27.465727 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-8162a77c-6063-421f-9dbb-df2f93647fac tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Getting quotas for project 2f8c425aaac144c2aa98af4365bf84a6. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:48:27.479997 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-8162a77c-6063-421f-9dbb-df2f93647fac tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Getting quotas for user df10426ae3e14b428a1a7dc944867ce2 and project 2f8c425aaac144c2aa98af4365bf84a6. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:48:27.506487 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8162a77c-6063-421f-9dbb-df2f93647fac tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.410378 Mar 12 20:48:27.514480 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 50/80] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:48:27 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:48:28.298992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1bd37a6a-9ced-4b06-94e6-db0e7fac897a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:28.299975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1bd37a6a-9ced-4b06-94e6-db0e7fac897a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:28.309637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bd37a6a-9ced-4b06-94e6-db0e7fac897a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:28.312793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bd37a6a-9ced-4b06-94e6-db0e7fac897a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:28.315225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bd37a6a-9ced-4b06-94e6-db0e7fac897a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:28.316135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bd37a6a-9ced-4b06-94e6-db0e7fac897a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:28.567295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1bd37a6a-9ced-4b06-94e6-db0e7fac897a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:28.593278 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1bd37a6a-9ced-4b06-94e6-db0e7fac897a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1337 microversion: 2.1 time: 0.298487 Mar 12 20:48:28.594782 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 31/81] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:28 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1337 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:29.612941 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0ca0f13d-1ad5-489a-ac0f-0fce1c86309c tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:29.613558 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-0ca0f13d-1ad5-489a-ac0f-0fce1c86309c tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:29.621652 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0ca0f13d-1ad5-489a-ac0f-0fce1c86309c tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:29.622745 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0ca0f13d-1ad5-489a-ac0f-0fce1c86309c tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:29.625887 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0ca0f13d-1ad5-489a-ac0f-0fce1c86309c tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:29.626689 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0ca0f13d-1ad5-489a-ac0f-0fce1c86309c tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:29.928515 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-0ca0f13d-1ad5-489a-ac0f-0fce1c86309c tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:29.941549 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0ca0f13d-1ad5-489a-ac0f-0fce1c86309c tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1337 microversion: 2.1 time: 0.330730 Mar 12 20:48:29.942512 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 51/82] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:29 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1337 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:30.104618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1579373636", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "817529204", "adminPass": "***", "networks": [{"uuid": "6d81997f-04c7-4abe-983f-03c84afabe15"}], "security_groups": [{"name": "tempest-securitygroup--1402957834"}], "key_name": "tempest-keypair-1383205792", "user_data": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:30.305738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] validate_networks() for [('6d81997f-04c7-4abe-983f-03c84afabe15', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:48:31.167358 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a3628f65-eddd-4459-9ecf-5e0977a6b4ee tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Calling method '.version_select at 0x7f6e458e0310>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:31.168195 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:31.168195 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:31.169288 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a3628f65-eddd-4459-9ecf-5e0977a6b4ee tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '6fd83f3ff91a450fb38650875dbd0728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b140e4fe5bb40dc829660cb507878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:31.170109 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a3628f65-eddd-4459-9ecf-5e0977a6b4ee tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:31.170826 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a3628f65-eddd-4459-9ecf-5e0977a6b4ee tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.410959 Mar 12 20:48:31.175659 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 52/83] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Mar 12 20:48:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 412 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:31.179062 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d9cac4ac-5131-4f32-9a49-411d119003d9 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:31.179734 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d9cac4ac-5131-4f32-9a49-411d119003d9 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:31.186411 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d9cac4ac-5131-4f32-9a49-411d119003d9 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:31.186877 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d9cac4ac-5131-4f32-9a49-411d119003d9 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:31.187659 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d9cac4ac-5131-4f32-9a49-411d119003d9 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:31.188102 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d9cac4ac-5131-4f32-9a49-411d119003d9 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:31.334632 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d9cac4ac-5131-4f32-9a49-411d119003d9 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:31.342699 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d9cac4ac-5131-4f32-9a49-411d119003d9 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1337 microversion: 2.1 time: 0.170403 Mar 12 20:48:31.343491 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 53/84] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:31 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1337 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:31.353755 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-74f4137d-dbc3-4eab-877b-a82cd5e9361b tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Calling method '.version_select at 0x7f6e458e0b80>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:31.354771 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:31.354771 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:31.356205 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-74f4137d-dbc3-4eab-877b-a82cd5e9361b tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '6fd83f3ff91a450fb38650875dbd0728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b140e4fe5bb40dc829660cb507878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:31.356994 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-74f4137d-dbc3-4eab-877b-a82cd5e9361b tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:31.358024 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-74f4137d-dbc3-4eab-877b-a82cd5e9361b tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.013507 Mar 12 20:48:31.360014 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 54/85] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:31 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:31.367164 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d4700d16-42e8-4748-9778-404541901403 tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Calling method '.version_select at 0x7f6e459071f0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:31.368281 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:31.368281 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:31.369844 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d4700d16-42e8-4748-9778-404541901403 tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '6fd83f3ff91a450fb38650875dbd0728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b140e4fe5bb40dc829660cb507878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:31.370808 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d4700d16-42e8-4748-9778-404541901403 tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:31.371601 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d4700d16-42e8-4748-9778-404541901403 tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.007997 Mar 12 20:48:31.372107 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 55/86] 10.222.0.30 () {58 vars in 1178 bytes} [Sat Mar 12 20:48:31 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:48:31.739368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:48:31.739871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:48:31.740349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:48:31.740935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:48:31.741483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:48:31.764187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:31.764682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:31.767256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:31.767712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:31.810770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Getting quotas for project 2f8c425aaac144c2aa98af4365bf84a6. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:48:31.818480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Getting quotas for user df10426ae3e14b428a1a7dc944867ce2 and project 2f8c425aaac144c2aa98af4365bf84a6. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:48:31.848079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:48:31.855698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:48:31.926192 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2cdd4349-b87d-4709-9044-0bde2fdd427e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.826599 Mar 12 20:48:31.927610 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 32/87] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:48:31.942061 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-363fd1b7-be07-4408-a632-b1d771cd1435 tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Calling method '.version_select at 0x7f6e45907ee0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:31.949334 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-363fd1b7-be07-4408-a632-b1d771cd1435 tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:31.950929 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-363fd1b7-be07-4408-a632-b1d771cd1435 tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:31.987836 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-363fd1b7-be07-4408-a632-b1d771cd1435 tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:31.988222 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-363fd1b7-be07-4408-a632-b1d771cd1435 tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:32.015641 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-363fd1b7-be07-4408-a632-b1d771cd1435 tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:32.019721 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-363fd1b7-be07-4408-a632-b1d771cd1435 tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:32.038735 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-363fd1b7-be07-4408-a632-b1d771cd1435 tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.659392 Mar 12 20:48:32.046124 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 56/88] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:48:32.054573 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fb36f911-24d4-4db0-b2e3-66a213d0f839 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:32.055798 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-fb36f911-24d4-4db0-b2e3-66a213d0f839 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:32.083537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-107417911", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:32.195524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:48:32.295970 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fb36f911-24d4-4db0-b2e3-66a213d0f839 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:32.303167 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fb36f911-24d4-4db0-b2e3-66a213d0f839 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1263 microversion: 2.1 time: 0.259348 Mar 12 20:48:32.303732 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 57/89] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:32 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1263 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:32.310339 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d7e05172-a1b7-449d-87f1-76e169da0f97 tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Calling method '.version_select at 0x7f6e458e0e50>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:32.311137 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:32.311137 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:32.312199 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d7e05172-a1b7-449d-87f1-76e169da0f97 tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '6fd83f3ff91a450fb38650875dbd0728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b140e4fe5bb40dc829660cb507878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:32.313029 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d7e05172-a1b7-449d-87f1-76e169da0f97 tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:32.317283 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d7e05172-a1b7-449d-87f1-76e169da0f97 tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.012179 Mar 12 20:48:32.318362 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 58/90] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Mar 12 20:48:32 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:32.619494 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d2f9f2de-ab50-4f15-93e7-271281c70181 tempest-FlavorsV261TestJSON-860423578 tempest-FlavorsV261TestJSON-860423578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1122995711", "id": 1899196365, "os-flavor-access:is_public": "True"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:32.621531 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:32.621531 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:32.633941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:48:32.635028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:48:32.635520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:48:32.635938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:48:32.636350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:48:32.654959 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d2f9f2de-ab50-4f15-93e7-271281c70181 tempest-FlavorsV261TestJSON-860423578 tempest-FlavorsV261TestJSON-860423578-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.335155 Mar 12 20:48:32.663438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:32.664243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:32.665788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:32.666504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:32.669320 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 59/91] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:48:32 2022] POST /compute/v2.1/flavors => generated 468 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:32.703221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Getting quotas for project d8057df76c4c4652a22bb659969dbb31. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:48:32.709168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Getting quotas for user b404502bb19242c385bc7d6ca5bff2de and project d8057df76c4c4652a22bb659969dbb31. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:48:32.729490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:48:32.735630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:48:32.810364 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e41ba124-374b-48d1-808e-0dd71376e321 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.881197 Mar 12 20:48:32.817250 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 33/92] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:48:32.823789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c872ac0b-092a-430b-9741-6f9740544584 tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Calling method '.version_select at 0x7f6e44020f70>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:32.825876 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:32.825876 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:32.827255 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c872ac0b-092a-430b-9741-6f9740544584 tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] HTTP exception thrown: Hypervisor with ID '804929e0-5621-4290-b066-6cfbaf3904c5' could not be found. Mar 12 20:48:32.828000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c872ac0b-092a-430b-9741-6f9740544584 tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Returning 404 to user: Hypervisor with ID '804929e0-5621-4290-b066-6cfbaf3904c5' could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:32.828970 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c872ac0b-092a-430b-9741-6f9740544584 tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/804929e0-5621-4290-b066-6cfbaf3904c5/uptime" status: 404 len: 123 microversion: 2.1 time: 0.010247 Mar 12 20:48:32.834747 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 34/93] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Mar 12 20:48:32 2022] GET /compute/v2.1/os-hypervisors/804929e0-5621-4290-b066-6cfbaf3904c5/uptime => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:32.841118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7603ecba-f24b-4dd0-af62-8d05afe1de22 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:32.842105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7603ecba-f24b-4dd0-af62-8d05afe1de22 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:32.850478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7603ecba-f24b-4dd0-af62-8d05afe1de22 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:32.851418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7603ecba-f24b-4dd0-af62-8d05afe1de22 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:32.852493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7603ecba-f24b-4dd0-af62-8d05afe1de22 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:32.854137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7603ecba-f24b-4dd0-af62-8d05afe1de22 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:32.937128 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-37cd47d0-9869-4b2d-a1e9-43e4dfed0cdb req-6a316c27-e2d0-4dd7-9a51-1db60fb40aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd46d9b-8f4b-45b5-acd7-d0fad29477de", "name": "network-vif-plugged", "status": "completed", "tag": "3a62bf65-339f-4aeb-b067-e21644cb2004"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:32.949586 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-37cd47d0-9869-4b2d-a1e9-43e4dfed0cdb req-6a316c27-e2d0-4dd7-9a51-1db60fb40aa4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:32.954582 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-37cd47d0-9869-4b2d-a1e9-43e4dfed0cdb req-6a316c27-e2d0-4dd7-9a51-1db60fb40aa4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:32.987266 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-37cd47d0-9869-4b2d-a1e9-43e4dfed0cdb req-6a316c27-e2d0-4dd7-9a51-1db60fb40aa4 service nova] Creating event network-vif-plugged:3a62bf65-339f-4aeb-b067-e21644cb2004 for instance 6cd46d9b-8f4b-45b5-acd7-d0fad29477de on nch2-master-1 Mar 12 20:48:32.988043 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-37cd47d0-9869-4b2d-a1e9-43e4dfed0cdb req-6a316c27-e2d0-4dd7-9a51-1db60fb40aa4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=136303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 20:48:32.989200 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21831f4c-3491-458d-b818-1ce787369bf3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:32.989635 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21831f4c-3491-458d-b818-1ce787369bf3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:32.991177 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21831f4c-3491-458d-b818-1ce787369bf3 None None] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:32.991618 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21831f4c-3491-458d-b818-1ce787369bf3 None None] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:33.000432 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.compute.rpcapi [None req-21831f4c-3491-458d-b818-1ce787369bf3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 12 20:48:33.002519 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21831f4c-3491-458d-b818-1ce787369bf3 None None] Releasing lock "compute-rpcapi-router" {{(pid=136303) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 20:48:33.021534 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-21831f4c-3491-458d-b818-1ce787369bf3 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350862 Mar 12 20:48:33.022197 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 60/94] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:33.187245 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c50923da-fb1a-407e-bb64-9b5cae16c7ec tempest-FlavorsV261TestJSON-2018695344 tempest-FlavorsV261TestJSON-2018695344-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:33.205246 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c50923da-fb1a-407e-bb64-9b5cae16c7ec tempest-FlavorsV261TestJSON-2018695344 tempest-FlavorsV261TestJSON-2018695344-project] 10.222.0.30 "GET /compute/v2.1/flavors/1899196365" status: 200 len: 468 microversion: 2.61 time: 0.181623 Mar 12 20:48:33.206083 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 61/95] 10.222.0.30 () {60 vars in 1198 bytes} [Sat Mar 12 20:48:33 2022] GET /compute/v2.1/flavors/1899196365 => generated 468 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:33.212175 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8c0a8411-9cb8-4b5a-8286-bd3a5de267f8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:33.213700 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8c0a8411-9cb8-4b5a-8286-bd3a5de267f8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:33.292188 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8c0a8411-9cb8-4b5a-8286-bd3a5de267f8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:33.302740 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8c0a8411-9cb8-4b5a-8286-bd3a5de267f8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1212 microversion: 2.1 time: 0.094986 Mar 12 20:48:33.306092 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 62/96] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:33 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1212 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:33.338906 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-98efb6c5-4e90-435f-80f1-839e3a3072ba tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Calling method '.version_select at 0x7f6e459078b0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:33.342171 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:33.342171 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:33.344817 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-98efb6c5-4e90-435f-80f1-839e3a3072ba tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:33.345198 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-98efb6c5-4e90-435f-80f1-839e3a3072ba tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:33.370106 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-98efb6c5-4e90-435f-80f1-839e3a3072ba tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:33.371485 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-98efb6c5-4e90-435f-80f1-839e3a3072ba tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:33.387846 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-98efb6c5-4e90-435f-80f1-839e3a3072ba tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:33.388533 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-98efb6c5-4e90-435f-80f1-839e3a3072ba tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:33.391731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7603ecba-f24b-4dd0-af62-8d05afe1de22 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:33.397041 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-98efb6c5-4e90-435f-80f1-839e3a3072ba tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.088830 Mar 12 20:48:33.403066 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 63/97] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:33.408436 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1eea7670-f855-4e7d-95ea-b7f9334c5439 tempest-FlavorsV261TestJSON-860423578 tempest-FlavorsV261TestJSON-860423578-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:33.410789 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7603ecba-f24b-4dd0-af62-8d05afe1de22 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1337 microversion: 2.1 time: 0.574433 Mar 12 20:48:33.410954 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:33.410954 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:33.412148 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 35/98] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:32 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1337 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:33.419233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85f9c2f3-1083-45d5-9467-3ffdf55e8cb1 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:33.420864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85f9c2f3-1083-45d5-9467-3ffdf55e8cb1 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:33.442042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85f9c2f3-1083-45d5-9467-3ffdf55e8cb1 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:33.444713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85f9c2f3-1083-45d5-9467-3ffdf55e8cb1 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:33.452997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85f9c2f3-1083-45d5-9467-3ffdf55e8cb1 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:33.454878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85f9c2f3-1083-45d5-9467-3ffdf55e8cb1 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:33.464861 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1eea7670-f855-4e7d-95ea-b7f9334c5439 tempest-FlavorsV261TestJSON-860423578 tempest-FlavorsV261TestJSON-860423578-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1899196365" status: 200 len: 469 microversion: 2.61 time: 0.060594 Mar 12 20:48:33.471682 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 64/99] 10.222.0.30 () {62 vars in 1218 bytes} [Sat Mar 12 20:48:33 2022] PUT /compute/v2.1/flavors/1899196365 => generated 469 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:33.489905 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e45a3ce0-fecc-4d2f-a577-ce49cd64cec0 tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Calling method '.version_select at 0x7f6e4509d430>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:33.494518 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:33.494518 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:33.498559 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e45a3ce0-fecc-4d2f-a577-ce49cd64cec0 tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '6fd83f3ff91a450fb38650875dbd0728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b140e4fe5bb40dc829660cb507878fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:33.499478 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e45a3ce0-fecc-4d2f-a577-ce49cd64cec0 tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:33.504484 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e45a3ce0-fecc-4d2f-a577-ce49cd64cec0 tempest-HypervisorAdminNegativeTestJSON-1411250495 tempest-HypervisorAdminNegativeTestJSON-1411250495-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.026325 Mar 12 20:48:33.505578 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 65/100] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:33.518906 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-99e6d7c4-f9b7-43a8-865d-0bc8fbd95b59 tempest-FlavorsV261TestJSON-2018695344 tempest-FlavorsV261TestJSON-2018695344-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:33.580302 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-99e6d7c4-f9b7-43a8-865d-0bc8fbd95b59 tempest-FlavorsV261TestJSON-2018695344 tempest-FlavorsV261TestJSON-2018695344-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 7153 microversion: 2.61 time: 0.073244 Mar 12 20:48:33.581531 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 66/101] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Mar 12 20:48:33 2022] GET /compute/v2.1/flavors/detail => generated 7153 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:33.591520 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9a964c5d-87ed-4ab5-8a0f-edd2b0a604de tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Calling method '.version_select at 0x7f6e45907430>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:33.594093 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-9a964c5d-87ed-4ab5-8a0f-edd2b0a604de tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] HTTP exception thrown: Hypervisor with ID 'c7962e42-07f8-4114-b86b-28c0f9fb30aa' could not be found. Mar 12 20:48:33.594805 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9a964c5d-87ed-4ab5-8a0f-edd2b0a604de tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] Returning 404 to user: Hypervisor with ID 'c7962e42-07f8-4114-b86b-28c0f9fb30aa' could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:33.595692 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9a964c5d-87ed-4ab5-8a0f-edd2b0a604de tempest-HypervisorAdminNegativeTestJSON-319406417 tempest-HypervisorAdminNegativeTestJSON-319406417-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/c7962e42-07f8-4114-b86b-28c0f9fb30aa" status: 404 len: 123 microversion: 2.1 time: 0.012920 Mar 12 20:48:33.596313 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 67/102] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Mar 12 20:48:33 2022] GET /compute/v2.1/os-hypervisors/c7962e42-07f8-4114-b86b-28c0f9fb30aa => generated 123 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:33.602700 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-761e1376-1d82-4230-a071-15b3a40381a3 tempest-FlavorsV261TestJSON-2018695344 tempest-FlavorsV261TestJSON-2018695344-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:33.630040 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-761e1376-1d82-4230-a071-15b3a40381a3 tempest-FlavorsV261TestJSON-2018695344 tempest-FlavorsV261TestJSON-2018695344-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.61 time: 0.031672 Mar 12 20:48:33.632233 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 68/103] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Mar 12 20:48:33 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:33.648145 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-11ded0cb-7aca-4707-b104-54f75dbc03b7 tempest-FlavorsV261TestJSON-860423578 tempest-FlavorsV261TestJSON-860423578-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:33.649012 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:33.649012 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:33.673605 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-11ded0cb-7aca-4707-b104-54f75dbc03b7 tempest-FlavorsV261TestJSON-860423578 tempest-FlavorsV261TestJSON-860423578-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1899196365" status: 202 len: 0 microversion: 2.61 time: 0.030910 Mar 12 20:48:33.678846 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 69/104] 10.222.0.30 () {60 vars in 1201 bytes} [Sat Mar 12 20:48:33 2022] DELETE /compute/v2.1/flavors/1899196365 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 12 20:48:33.685583 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-32a21afd-b65d-48ef-9b78-346a0e2a7e86 tempest-FlavorsV261TestJSON-860423578 tempest-FlavorsV261TestJSON-860423578-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:33.712614 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-32a21afd-b65d-48ef-9b78-346a0e2a7e86 tempest-FlavorsV261TestJSON-860423578 tempest-FlavorsV261TestJSON-860423578-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.032347 Mar 12 20:48:33.726941 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 70/105] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Mar 12 20:48:33 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:33.756314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-85f9c2f3-1083-45d5-9467-3ffdf55e8cb1 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:33.779509 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85f9c2f3-1083-45d5-9467-3ffdf55e8cb1 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1259 microversion: 2.1 time: 0.363841 Mar 12 20:48:33.791564 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 36/106] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:33 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1259 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:34.321657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c72d531-e41c-4d8b-904f-15ccc79324bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:34.322320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2c72d531-e41c-4d8b-904f-15ccc79324bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:34.328404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c72d531-e41c-4d8b-904f-15ccc79324bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:34.328863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c72d531-e41c-4d8b-904f-15ccc79324bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:34.329638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c72d531-e41c-4d8b-904f-15ccc79324bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:34.330266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c72d531-e41c-4d8b-904f-15ccc79324bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:34.429482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c72d531-e41c-4d8b-904f-15ccc79324bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:34.443863 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c72d531-e41c-4d8b-904f-15ccc79324bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1264 microversion: 2.1 time: 0.127450 Mar 12 20:48:34.444514 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 37/107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:34 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1264 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:34.650360 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1237116198", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "1c06f7bd-57f3-494e-b107-2b7e9aae71ae"}]}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:34.749888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2009561515", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "4b8a32df-ad87-496b-8291-8d1bc2a20fb0"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:34.752916 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.neutron [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] validate_networks() for [('1c06f7bd-57f3-494e-b107-2b7e9aae71ae', None, None, None, None, None)] {{(pid=136303) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:48:34.858788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] validate_networks() for [('4b8a32df-ad87-496b-8291-8d1bc2a20fb0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:48:35.321819 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:48:35.322245 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:48:35.322724 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:48:35.323999 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:48:35.324428 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:48:35.334978 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:35.335666 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:35.349559 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:35.350187 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:35.376668 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Getting quotas for project 7417ea19a899461e99596d0df881a336. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:48:35.384641 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Getting quotas for user 9c3556ea8eba477e92c2f6f765a30c1f and project 7417ea19a899461e99596d0df881a336. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:48:35.400288 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Going to run 1 instances... {{(pid=136303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:48:35.403430 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:48:35.475576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:48:35.476617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:48:35.477902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:48:35.478546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:48:35.479230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:48:35.494510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:35.495122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:35.499163 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d512fbaf-245c-47ee-a860-5772949c897e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.221423 Mar 12 20:48:35.505432 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 71/108] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:48:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 20:48:35.511021 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-555e0a2c-912c-4e1b-b044-3e6aafbb3eef tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:35.511644 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-555e0a2c-912c-4e1b-b044-3e6aafbb3eef tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:35.520160 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-555e0a2c-912c-4e1b-b044-3e6aafbb3eef tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:35.520810 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-555e0a2c-912c-4e1b-b044-3e6aafbb3eef tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:35.521643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:35.522088 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-555e0a2c-912c-4e1b-b044-3e6aafbb3eef tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:35.522207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:35.526400 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-555e0a2c-912c-4e1b-b044-3e6aafbb3eef tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:35.546056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Getting quotas for project c248ec2e2f0c457291cd412812c08e5a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:48:35.568316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Getting quotas for user a7854cfb82544a70aee1a7d421bfce55 and project c248ec2e2f0c457291cd412812c08e5a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:48:35.582935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:48:35.585356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:48:35.651531 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bfcebc45-f1af-4f12-b38f-7677e17ce200 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.205601 Mar 12 20:48:35.652665 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 38/109] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:48:35.679424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4947a93-6505-4f32-8f89-5a489edac9ab tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:35.689280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b4947a93-6505-4f32-8f89-5a489edac9ab tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:35.699034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4947a93-6505-4f32-8f89-5a489edac9ab tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:35.699510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4947a93-6505-4f32-8f89-5a489edac9ab tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:35.700275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4947a93-6505-4f32-8f89-5a489edac9ab tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:35.700855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4947a93-6505-4f32-8f89-5a489edac9ab tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:35.861018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b4947a93-6505-4f32-8f89-5a489edac9ab tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:35.878005 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b4947a93-6505-4f32-8f89-5a489edac9ab tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1321 microversion: 2.1 time: 0.222679 Mar 12 20:48:35.890370 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 39/110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:35 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:35.896498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a461b347-11d0-4bb5-a8fe-3ddb26537d99 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:35.899414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a461b347-11d0-4bb5-a8fe-3ddb26537d99 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:35.908139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a461b347-11d0-4bb5-a8fe-3ddb26537d99 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:35.909106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a461b347-11d0-4bb5-a8fe-3ddb26537d99 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:35.910293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a461b347-11d0-4bb5-a8fe-3ddb26537d99 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:35.910903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a461b347-11d0-4bb5-a8fe-3ddb26537d99 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:35.968843 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-555e0a2c-912c-4e1b-b044-3e6aafbb3eef tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:35.981604 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-555e0a2c-912c-4e1b-b044-3e6aafbb3eef tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1337 microversion: 2.1 time: 0.474632 Mar 12 20:48:35.982271 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 72/111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:35 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1337 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:35.994754 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a9abcfb2-830d-42c0-b683-88a06de7783a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:35.996375 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a9abcfb2-830d-42c0-b683-88a06de7783a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:36.006374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a461b347-11d0-4bb5-a8fe-3ddb26537d99 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:36.017514 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a461b347-11d0-4bb5-a8fe-3ddb26537d99 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1264 microversion: 2.1 time: 0.125800 Mar 12 20:48:36.021755 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 40/112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:35 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1264 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:36.027649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69aaa187-b9e8-4f75-b0ad-c1b165b77ca0 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:36.035398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-69aaa187-b9e8-4f75-b0ad-c1b165b77ca0 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:36.078219 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a9abcfb2-830d-42c0-b683-88a06de7783a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:36.087674 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a9abcfb2-830d-42c0-b683-88a06de7783a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:36.092858 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a9abcfb2-830d-42c0-b683-88a06de7783a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:36.094092 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a9abcfb2-830d-42c0-b683-88a06de7783a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1262 microversion: 2.25 time: 0.109787 Mar 12 20:48:36.105355 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 73/113] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:35 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1262 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:36.156893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-69aaa187-b9e8-4f75-b0ad-c1b165b77ca0 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:36.172675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-69aaa187-b9e8-4f75-b0ad-c1b165b77ca0 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1211 microversion: 2.1 time: 0.149440 Mar 12 20:48:36.173762 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 41/114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:36 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1211 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:36.896079 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3027ba3f-698b-4751-9059-4e6104bb5729 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:36.896950 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3027ba3f-698b-4751-9059-4e6104bb5729 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:36.905326 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3027ba3f-698b-4751-9059-4e6104bb5729 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:36.906363 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3027ba3f-698b-4751-9059-4e6104bb5729 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:36.907559 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3027ba3f-698b-4751-9059-4e6104bb5729 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:36.908478 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3027ba3f-698b-4751-9059-4e6104bb5729 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:36.999247 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3027ba3f-698b-4751-9059-4e6104bb5729 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:36.999806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2cba9243-9211-4b28-a02f-e7e8529fce8b tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:37.000212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2cba9243-9211-4b28-a02f-e7e8529fce8b tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:37.010899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cba9243-9211-4b28-a02f-e7e8529fce8b tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:37.011182 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3027ba3f-698b-4751-9059-4e6104bb5729 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1321 microversion: 2.1 time: 0.119351 Mar 12 20:48:37.011356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cba9243-9211-4b28-a02f-e7e8529fce8b tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:37.012790 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 74/115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:36 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1321 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:48:37.029211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cba9243-9211-4b28-a02f-e7e8529fce8b tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:37.029893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cba9243-9211-4b28-a02f-e7e8529fce8b tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:37.038966 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e44bff75-e802-4f72-bda7-d26ba1eb258b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:37.039842 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e44bff75-e802-4f72-bda7-d26ba1eb258b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:37.052126 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e44bff75-e802-4f72-bda7-d26ba1eb258b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:37.054224 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e44bff75-e802-4f72-bda7-d26ba1eb258b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:37.059181 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e44bff75-e802-4f72-bda7-d26ba1eb258b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:37.060340 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e44bff75-e802-4f72-bda7-d26ba1eb258b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:37.211121 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e44bff75-e802-4f72-bda7-d26ba1eb258b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:37.221531 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e44bff75-e802-4f72-bda7-d26ba1eb258b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1264 microversion: 2.1 time: 0.188451 Mar 12 20:48:37.238038 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 75/116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:37 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:48:37.253895 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4a2feacc-49b2-49fd-a3b9-f0f95d2bae41 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:37.256229 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4a2feacc-49b2-49fd-a3b9-f0f95d2bae41 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:37.266658 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4a2feacc-49b2-49fd-a3b9-f0f95d2bae41 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:37.270328 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4a2feacc-49b2-49fd-a3b9-f0f95d2bae41 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:37.274501 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4a2feacc-49b2-49fd-a3b9-f0f95d2bae41 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:37.275202 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4a2feacc-49b2-49fd-a3b9-f0f95d2bae41 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:37.332436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2cba9243-9211-4b28-a02f-e7e8529fce8b tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:37.340372 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2cba9243-9211-4b28-a02f-e7e8529fce8b tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1486 microversion: 2.1 time: 0.345647 Mar 12 20:48:37.357045 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 42/117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:36 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1486 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:37.364333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8dcc57a6-ad37-4977-96f9-33756d719520 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:37.365400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8dcc57a6-ad37-4977-96f9-33756d719520 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:37.373147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dcc57a6-ad37-4977-96f9-33756d719520 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:37.374018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dcc57a6-ad37-4977-96f9-33756d719520 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:37.375017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dcc57a6-ad37-4977-96f9-33756d719520 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:37.375772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dcc57a6-ad37-4977-96f9-33756d719520 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:37.473761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8dcc57a6-ad37-4977-96f9-33756d719520 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:37.485318 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8dcc57a6-ad37-4977-96f9-33756d719520 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1293 microversion: 2.1 time: 0.126550 Mar 12 20:48:37.486136 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 43/118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:37 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1293 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:37.490936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6161dd2f-6b46-45f8-87c6-3257f5a1be29 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:37.491772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6161dd2f-6b46-45f8-87c6-3257f5a1be29 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:37.504639 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4a2feacc-49b2-49fd-a3b9-f0f95d2bae41 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:37.510634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6161dd2f-6b46-45f8-87c6-3257f5a1be29 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:37.511376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6161dd2f-6b46-45f8-87c6-3257f5a1be29 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:37.512562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6161dd2f-6b46-45f8-87c6-3257f5a1be29 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:37.513714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6161dd2f-6b46-45f8-87c6-3257f5a1be29 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:37.524163 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4a2feacc-49b2-49fd-a3b9-f0f95d2bae41 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:37.525827 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4a2feacc-49b2-49fd-a3b9-f0f95d2bae41 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:37.528365 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4a2feacc-49b2-49fd-a3b9-f0f95d2bae41 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1354 microversion: 2.25 time: 0.287807 Mar 12 20:48:37.528958 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 76/119] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:37 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1354 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:38.000415 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6161dd2f-6b46-45f8-87c6-3257f5a1be29 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1637 microversion: 2.1 time: 0.513026 Mar 12 20:48:38.001007 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 44/120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:37 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1637 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:38.016163 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-244bde55-02de-4c8c-8008-248d501091ce tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:38.017219 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-244bde55-02de-4c8c-8008-248d501091ce tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:38.034932 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-244bde55-02de-4c8c-8008-248d501091ce tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:38.035648 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-244bde55-02de-4c8c-8008-248d501091ce tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:38.038157 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-244bde55-02de-4c8c-8008-248d501091ce tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:38.040159 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-244bde55-02de-4c8c-8008-248d501091ce tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:38.044000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b2b2460-0789-41aa-8896-971aeb846ebf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:38.045705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b2b2460-0789-41aa-8896-971aeb846ebf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:38.060715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b2b2460-0789-41aa-8896-971aeb846ebf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:38.064239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b2b2460-0789-41aa-8896-971aeb846ebf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:38.066473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b2b2460-0789-41aa-8896-971aeb846ebf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:38.066934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b2b2460-0789-41aa-8896-971aeb846ebf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:38.102045 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-244bde55-02de-4c8c-8008-248d501091ce tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:48:38.284655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8b2b2460-0789-41aa-8896-971aeb846ebf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:38.298625 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b2b2460-0789-41aa-8896-971aeb846ebf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1321 microversion: 2.1 time: 0.265590 Mar 12 20:48:38.303771 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 45/121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:38 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:38.317853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-261b081e-be17-4829-8c32-3dfb8856e4bd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:38.321555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-261b081e-be17-4829-8c32-3dfb8856e4bd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:38.333099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-261b081e-be17-4829-8c32-3dfb8856e4bd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:38.335907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-261b081e-be17-4829-8c32-3dfb8856e4bd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:38.338766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-261b081e-be17-4829-8c32-3dfb8856e4bd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:38.340185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-261b081e-be17-4829-8c32-3dfb8856e4bd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:38.366926 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-244bde55-02de-4c8c-8008-248d501091ce tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 204 len: 0 microversion: 2.1 time: 0.351602 Mar 12 20:48:38.371545 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 77/122] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:48:38 2022] DELETE /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:48:38.377458 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d52125c5-5551-4771-8ad4-4dbe229528e5 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:38.378205 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d52125c5-5551-4771-8ad4-4dbe229528e5 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:38.394266 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d52125c5-5551-4771-8ad4-4dbe229528e5 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:38.400198 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d52125c5-5551-4771-8ad4-4dbe229528e5 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:38.401041 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d52125c5-5551-4771-8ad4-4dbe229528e5 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:38.401502 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d52125c5-5551-4771-8ad4-4dbe229528e5 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:38.579601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-261b081e-be17-4829-8c32-3dfb8856e4bd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:38.593625 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-261b081e-be17-4829-8c32-3dfb8856e4bd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1264 microversion: 2.1 time: 0.287355 Mar 12 20:48:38.605834 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 46/123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:38 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1264 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:38.613952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-68a661c1-2ce2-4329-8846-7fdeb90171da tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:38.614959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-68a661c1-2ce2-4329-8846-7fdeb90171da tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:38.622914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68a661c1-2ce2-4329-8846-7fdeb90171da tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:38.624012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68a661c1-2ce2-4329-8846-7fdeb90171da tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:38.625223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68a661c1-2ce2-4329-8846-7fdeb90171da tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:38.627635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68a661c1-2ce2-4329-8846-7fdeb90171da tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:38.710171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-68a661c1-2ce2-4329-8846-7fdeb90171da tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:38.720614 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-68a661c1-2ce2-4329-8846-7fdeb90171da tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1291 microversion: 2.1 time: 0.112024 Mar 12 20:48:38.722572 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 47/124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:38 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1291 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:38.733754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f05ca0d3-380a-43ca-b4b1-1dc3ae51eb2b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:38.736665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f05ca0d3-380a-43ca-b4b1-1dc3ae51eb2b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:38.748413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f05ca0d3-380a-43ca-b4b1-1dc3ae51eb2b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:38.748875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f05ca0d3-380a-43ca-b4b1-1dc3ae51eb2b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:38.749680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f05ca0d3-380a-43ca-b4b1-1dc3ae51eb2b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:38.754087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f05ca0d3-380a-43ca-b4b1-1dc3ae51eb2b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.102772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f05ca0d3-380a-43ca-b4b1-1dc3ae51eb2b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:39.112489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f05ca0d3-380a-43ca-b4b1-1dc3ae51eb2b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:39.118045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f05ca0d3-380a-43ca-b4b1-1dc3ae51eb2b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:39.119199 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f05ca0d3-380a-43ca-b4b1-1dc3ae51eb2b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1384 microversion: 2.25 time: 0.395500 Mar 12 20:48:39.135209 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 48/125] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:38 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1384 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:39.152944 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d52125c5-5551-4771-8ad4-4dbe229528e5 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:39.160387 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d52125c5-5551-4771-8ad4-4dbe229528e5 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1492 microversion: 2.1 time: 0.787523 Mar 12 20:48:39.161003 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 78/126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:38 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1492 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:39.342534 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-107009722", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:39.346729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7025c66-13ca-4382-95ab-1cd73798de9d tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Calling method '.version_select at 0x7f6e377f9790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:39.354980 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:39.354980 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:39.357398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7025c66-13ca-4382-95ab-1cd73798de9d tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.358036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7025c66-13ca-4382-95ab-1cd73798de9d tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.359077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7025c66-13ca-4382-95ab-1cd73798de9d tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.359857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7025c66-13ca-4382-95ab-1cd73798de9d tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.394298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f7025c66-13ca-4382-95ab-1cd73798de9d tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.215601 Mar 12 20:48:39.395416 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 49/127] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Mar 12 20:48:39 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:39.401224 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.neutron [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] validate_networks() for None {{(pid=136303) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:48:39.401985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-53e1f8d1-6caf-4a3a-b2ae-b33e1136b2be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:39.402796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-53e1f8d1-6caf-4a3a-b2ae-b33e1136b2be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:39.409561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53e1f8d1-6caf-4a3a-b2ae-b33e1136b2be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.410295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53e1f8d1-6caf-4a3a-b2ae-b33e1136b2be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.411451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53e1f8d1-6caf-4a3a-b2ae-b33e1136b2be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.412093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53e1f8d1-6caf-4a3a-b2ae-b33e1136b2be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.498377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-53e1f8d1-6caf-4a3a-b2ae-b33e1136b2be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:39.507581 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-53e1f8d1-6caf-4a3a-b2ae-b33e1136b2be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1321 microversion: 2.1 time: 0.110848 Mar 12 20:48:39.525787 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 50/128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:39 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1321 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:39.532559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-45895e29-7387-4f7a-876f-4260c015fe69 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Calling method '.version_select at 0x7f6e377cbaf0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:39.537448 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:39.537448 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:39.539846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45895e29-7387-4f7a-876f-4260c015fe69 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.541023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45895e29-7387-4f7a-876f-4260c015fe69 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.542134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45895e29-7387-4f7a-876f-4260c015fe69 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.542756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45895e29-7387-4f7a-876f-4260c015fe69 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.568999 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-45895e29-7387-4f7a-876f-4260c015fe69 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.041756 Mar 12 20:48:39.569930 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 51/129] 10.222.0.30 () {58 vars in 1138 bytes} [Sat Mar 12 20:48:39 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:39.575582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e07ccd8d-f286-4aad-9bbc-34960247ac35 req-10fca53c-18dd-4df0-a9e1-9a965e991f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb8e841-3f4c-4bb0-b6cd-6feab78be43c", "tag": "31853141-b24e-4296-ac44-006fdaa259f8"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:39.587122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e07ccd8d-f286-4aad-9bbc-34960247ac35 req-10fca53c-18dd-4df0-a9e1-9a965e991f0f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.587711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e07ccd8d-f286-4aad-9bbc-34960247ac35 req-10fca53c-18dd-4df0-a9e1-9a965e991f0f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.607989 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e07ccd8d-f286-4aad-9bbc-34960247ac35 req-10fca53c-18dd-4df0-a9e1-9a965e991f0f service nova] Creating event network-changed:31853141-b24e-4296-ac44-006fdaa259f8 for instance 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c on nch2-master-1 Mar 12 20:48:39.614661 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e07ccd8d-f286-4aad-9bbc-34960247ac35 req-10fca53c-18dd-4df0-a9e1-9a965e991f0f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042644 Mar 12 20:48:39.615734 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 52/130] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:39.622534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3f870cf7-170f-4b7c-bba3-032595fefc2f tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Calling method '.version_select at 0x7f6e3778cee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:39.623818 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:39.623818 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:39.625002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f870cf7-170f-4b7c-bba3-032595fefc2f tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.625507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f870cf7-170f-4b7c-bba3-032595fefc2f tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.626348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f870cf7-170f-4b7c-bba3-032595fefc2f tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.626789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f870cf7-170f-4b7c-bba3-032595fefc2f tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.652681 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3f870cf7-170f-4b7c-bba3-032595fefc2f tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.035678 Mar 12 20:48:39.653852 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 53/131] 10.222.0.30 () {58 vars in 1144 bytes} [Sat Mar 12 20:48:39 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:39.658629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27cda074-8e43-4ca6-8ef8-76229ad6daac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:39.659525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27cda074-8e43-4ca6-8ef8-76229ad6daac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:39.665953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27cda074-8e43-4ca6-8ef8-76229ad6daac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.666966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27cda074-8e43-4ca6-8ef8-76229ad6daac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.667196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27cda074-8e43-4ca6-8ef8-76229ad6daac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.667640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27cda074-8e43-4ca6-8ef8-76229ad6daac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.744640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27cda074-8e43-4ca6-8ef8-76229ad6daac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:39.752362 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27cda074-8e43-4ca6-8ef8-76229ad6daac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1264 microversion: 2.1 time: 0.097272 Mar 12 20:48:39.753329 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 54/132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:39 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1264 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:39.758292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f407843d-10d4-4fc0-87ef-b85b800a7f16 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:39.759254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f407843d-10d4-4fc0-87ef-b85b800a7f16 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:39.764809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f407843d-10d4-4fc0-87ef-b85b800a7f16 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.765407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f407843d-10d4-4fc0-87ef-b85b800a7f16 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.766219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f407843d-10d4-4fc0-87ef-b85b800a7f16 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.766661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f407843d-10d4-4fc0-87ef-b85b800a7f16 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.934254 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:48:39.934683 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:48:39.935165 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:48:39.935581 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:48:39.935999 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:48:39.947253 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.947892 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.948974 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:39.949407 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:39.968805 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Getting quotas for project 3758c472ec7d47d6a85c9eb1cae6e39b. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:48:39.973111 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Getting quotas for user 073b94a21f4049fe9ca8fd5f908f498e and project 3758c472ec7d47d6a85c9eb1cae6e39b. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:48:39.985143 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Going to run 1 instances... {{(pid=136303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:48:39.987487 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:48:40.019464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f407843d-10d4-4fc0-87ef-b85b800a7f16 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:40.029303 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f407843d-10d4-4fc0-87ef-b85b800a7f16 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1333 microversion: 2.1 time: 0.275159 Mar 12 20:48:40.030181 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 55/133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:39 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1333 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:40.046638 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9e5261d1-004f-4176-8b1e-fb72f154db2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848744 Mar 12 20:48:40.047527 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 79/134] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 20:48:40.064330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-60293009-922f-4164-bdfa-f81ad30ed5f0 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:40.064946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-60293009-922f-4164-bdfa-f81ad30ed5f0 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:40.137154 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-82fb5a1a-2b6d-407e-a24c-21c207a0d35e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:40.138166 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-82fb5a1a-2b6d-407e-a24c-21c207a0d35e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:40.145721 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-82fb5a1a-2b6d-407e-a24c-21c207a0d35e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:40.147332 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-82fb5a1a-2b6d-407e-a24c-21c207a0d35e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:40.148263 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-82fb5a1a-2b6d-407e-a24c-21c207a0d35e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:40.149375 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-82fb5a1a-2b6d-407e-a24c-21c207a0d35e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:40.160141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-60293009-922f-4164-bdfa-f81ad30ed5f0 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:40.169751 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-60293009-922f-4164-bdfa-f81ad30ed5f0 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1218 microversion: 2.1 time: 0.115354 Mar 12 20:48:40.170371 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 56/135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:40 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:40.183247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-250fd972-5fb7-42c5-8cff-3414d2b1708f tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:40.183869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-250fd972-5fb7-42c5-8cff-3414d2b1708f tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:40.198560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-250fd972-5fb7-42c5-8cff-3414d2b1708f tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:40.199271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-250fd972-5fb7-42c5-8cff-3414d2b1708f tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:40.200146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-250fd972-5fb7-42c5-8cff-3414d2b1708f tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:40.200592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-250fd972-5fb7-42c5-8cff-3414d2b1708f tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:40.464850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-250fd972-5fb7-42c5-8cff-3414d2b1708f tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:40.472240 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-250fd972-5fb7-42c5-8cff-3414d2b1708f tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1492 microversion: 2.1 time: 0.298575 Mar 12 20:48:40.472943 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 57/136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:40 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1492 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:48:40.524750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a5299732-818c-48a2-9329-46f315269717 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:40.525372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a5299732-818c-48a2-9329-46f315269717 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:40.537871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5299732-818c-48a2-9329-46f315269717 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:40.538613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5299732-818c-48a2-9329-46f315269717 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:40.542957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5299732-818c-48a2-9329-46f315269717 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:40.544446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5299732-818c-48a2-9329-46f315269717 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:40.629007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a5299732-818c-48a2-9329-46f315269717 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:40.637101 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a5299732-818c-48a2-9329-46f315269717 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1321 microversion: 2.1 time: 0.116260 Mar 12 20:48:40.637962 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 58/137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:40 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1321 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:40.770188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fbd82572-8301-4435-994f-9f9e93200bc8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:40.770808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fbd82572-8301-4435-994f-9f9e93200bc8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:40.777462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbd82572-8301-4435-994f-9f9e93200bc8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:40.777910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbd82572-8301-4435-994f-9f9e93200bc8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:40.778856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbd82572-8301-4435-994f-9f9e93200bc8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:40.779300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbd82572-8301-4435-994f-9f9e93200bc8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:40.790807 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-82fb5a1a-2b6d-407e-a24c-21c207a0d35e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:40.799603 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-82fb5a1a-2b6d-407e-a24c-21c207a0d35e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:40.801298 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-82fb5a1a-2b6d-407e-a24c-21c207a0d35e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:40.802853 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-82fb5a1a-2b6d-407e-a24c-21c207a0d35e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1384 microversion: 2.25 time: 0.670222 Mar 12 20:48:40.803640 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 80/138] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:40 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1384 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:48:40.845624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fbd82572-8301-4435-994f-9f9e93200bc8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:40.859954 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fbd82572-8301-4435-994f-9f9e93200bc8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1264 microversion: 2.1 time: 0.088598 Mar 12 20:48:40.861811 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 59/139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:40 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1264 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:41.046426 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c13fd759-f553-4a3b-93e0-8473d9bf44f1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:41.046968 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c13fd759-f553-4a3b-93e0-8473d9bf44f1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:41.052874 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c13fd759-f553-4a3b-93e0-8473d9bf44f1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.053337 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c13fd759-f553-4a3b-93e0-8473d9bf44f1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.054146 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c13fd759-f553-4a3b-93e0-8473d9bf44f1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.054598 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c13fd759-f553-4a3b-93e0-8473d9bf44f1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.189265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c8e9420-6b3a-4408-912c-f68f883dbc60 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:41.190500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2c8e9420-6b3a-4408-912c-f68f883dbc60 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:41.199047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c8e9420-6b3a-4408-912c-f68f883dbc60 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.199521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c8e9420-6b3a-4408-912c-f68f883dbc60 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.200304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c8e9420-6b3a-4408-912c-f68f883dbc60 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.200945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c8e9420-6b3a-4408-912c-f68f883dbc60 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.263354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c8e9420-6b3a-4408-912c-f68f883dbc60 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:41.270312 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c8e9420-6b3a-4408-912c-f68f883dbc60 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1222 microversion: 2.1 time: 0.087213 Mar 12 20:48:41.270889 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 60/140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:41 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:48:41.429196 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c13fd759-f553-4a3b-93e0-8473d9bf44f1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:41.437709 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c13fd759-f553-4a3b-93e0-8473d9bf44f1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1333 microversion: 2.1 time: 0.395202 Mar 12 20:48:41.438370 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 81/141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:41 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1333 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:41.490037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d046ecb3-912f-4232-a548-06b946e5cc6a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:41.490815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d046ecb3-912f-4232-a548-06b946e5cc6a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:41.505829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d046ecb3-912f-4232-a548-06b946e5cc6a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.506555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d046ecb3-912f-4232-a548-06b946e5cc6a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.507567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d046ecb3-912f-4232-a548-06b946e5cc6a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.508689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d046ecb3-912f-4232-a548-06b946e5cc6a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.581393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d046ecb3-912f-4232-a548-06b946e5cc6a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ff8e5e41c3418992c25e162e502c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f760324b47441b87a22d536df238c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:41.591970 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d046ecb3-912f-4232-a548-06b946e5cc6a tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 200 len: 1322 microversion: 2.1 time: 0.106036 Mar 12 20:48:41.592877 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 61/142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:41 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 1322 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:41.594868 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-02dba87b-e07c-4a6c-bb42-5b3046796927 req-5437fdae-9856-41fd-86d9-f607c2e6e63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd46d9b-8f4b-45b5-acd7-d0fad29477de", "name": "network-vif-deleted", "tag": "3a62bf65-339f-4aeb-b067-e21644cb2004"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:41.605873 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-02dba87b-e07c-4a6c-bb42-5b3046796927 req-5437fdae-9856-41fd-86d9-f607c2e6e63f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.606328 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-02dba87b-e07c-4a6c-bb42-5b3046796927 req-5437fdae-9856-41fd-86d9-f607c2e6e63f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.619846 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-02dba87b-e07c-4a6c-bb42-5b3046796927 req-5437fdae-9856-41fd-86d9-f607c2e6e63f service nova] Creating event network-vif-deleted:3a62bf65-339f-4aeb-b067-e21644cb2004 for instance 6cd46d9b-8f4b-45b5-acd7-d0fad29477de on nch2-master-1 Mar 12 20:48:41.625372 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-02dba87b-e07c-4a6c-bb42-5b3046796927 req-5437fdae-9856-41fd-86d9-f607c2e6e63f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104863 Mar 12 20:48:41.626379 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 82/143] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:48:41.654217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dcb0738f-11cd-40bf-bca7-0249706d14a8 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:41.655068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dcb0738f-11cd-40bf-bca7-0249706d14a8 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:41.661140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcb0738f-11cd-40bf-bca7-0249706d14a8 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.661684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcb0738f-11cd-40bf-bca7-0249706d14a8 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.662629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcb0738f-11cd-40bf-bca7-0249706d14a8 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.663137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcb0738f-11cd-40bf-bca7-0249706d14a8 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.723194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dcb0738f-11cd-40bf-bca7-0249706d14a8 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:41.730694 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dcb0738f-11cd-40bf-bca7-0249706d14a8 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1321 microversion: 2.1 time: 0.080544 Mar 12 20:48:41.731265 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 62/144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:41 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1321 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:41.821737 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-60f5f41f-35f3-4561-b4c7-f75b7d4741d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:41.822485 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-60f5f41f-35f3-4561-b4c7-f75b7d4741d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:41.828919 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-60f5f41f-35f3-4561-b4c7-f75b7d4741d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.829383 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-60f5f41f-35f3-4561-b4c7-f75b7d4741d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.830195 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-60f5f41f-35f3-4561-b4c7-f75b7d4741d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.830642 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-60f5f41f-35f3-4561-b4c7-f75b7d4741d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.876637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ee4fc4d-ccb5-4e82-93f0-bd94c89c734d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:41.877265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5ee4fc4d-ccb5-4e82-93f0-bd94c89c734d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:41.884816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ee4fc4d-ccb5-4e82-93f0-bd94c89c734d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.885232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ee4fc4d-ccb5-4e82-93f0-bd94c89c734d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.886662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ee4fc4d-ccb5-4e82-93f0-bd94c89c734d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:41.887104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ee4fc4d-ccb5-4e82-93f0-bd94c89c734d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:41.964720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5ee4fc4d-ccb5-4e82-93f0-bd94c89c734d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:41.973633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ee4fc4d-ccb5-4e82-93f0-bd94c89c734d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1264 microversion: 2.1 time: 0.101049 Mar 12 20:48:41.974328 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 63/145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:41 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1264 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:48:42.110121 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-60f5f41f-35f3-4561-b4c7-f75b7d4741d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:42.119647 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-60f5f41f-35f3-4561-b4c7-f75b7d4741d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:42.121479 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-60f5f41f-35f3-4561-b4c7-f75b7d4741d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:42.122702 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-60f5f41f-35f3-4561-b4c7-f75b7d4741d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1384 microversion: 2.25 time: 0.305263 Mar 12 20:48:42.123345 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 83/146] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:41 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1384 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:42.288298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b00f404-7721-48f5-be68-5047b0bb3128 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:42.289613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b00f404-7721-48f5-be68-5047b0bb3128 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:42.296045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b00f404-7721-48f5-be68-5047b0bb3128 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:42.296699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b00f404-7721-48f5-be68-5047b0bb3128 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:42.297646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b00f404-7721-48f5-be68-5047b0bb3128 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:42.298116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b00f404-7721-48f5-be68-5047b0bb3128 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:42.379996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b00f404-7721-48f5-be68-5047b0bb3128 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:42.388644 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b00f404-7721-48f5-be68-5047b0bb3128 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1270 microversion: 2.1 time: 0.104209 Mar 12 20:48:42.389275 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 64/147] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:42 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:42.455949 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-514b91bf-9ad8-4c7d-ad20-058b2eeb3806 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:42.456728 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-514b91bf-9ad8-4c7d-ad20-058b2eeb3806 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:42.463310 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-514b91bf-9ad8-4c7d-ad20-058b2eeb3806 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:42.463844 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-514b91bf-9ad8-4c7d-ad20-058b2eeb3806 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:42.464719 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-514b91bf-9ad8-4c7d-ad20-058b2eeb3806 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:42.465244 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-514b91bf-9ad8-4c7d-ad20-058b2eeb3806 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:42.608709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7594924a-76d7-44f6-ad72-3aa28487a606 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:42.609284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7594924a-76d7-44f6-ad72-3aa28487a606 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:42.627874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7594924a-76d7-44f6-ad72-3aa28487a606 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:42.628245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7594924a-76d7-44f6-ad72-3aa28487a606 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:42.629056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7594924a-76d7-44f6-ad72-3aa28487a606 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:42.629502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7594924a-76d7-44f6-ad72-3aa28487a606 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:42.652155 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-7594924a-76d7-44f6-ad72-3aa28487a606 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] HTTP exception thrown: Instance 6cd46d9b-8f4b-45b5-acd7-d0fad29477de could not be found. Mar 12 20:48:42.655993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7594924a-76d7-44f6-ad72-3aa28487a606 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Returning 404 to user: Instance 6cd46d9b-8f4b-45b5-acd7-d0fad29477de could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:42.657214 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7594924a-76d7-44f6-ad72-3aa28487a606 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 404 len: 111 microversion: 2.1 time: 0.052464 Mar 12 20:48:42.658528 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 65/148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:42 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:48:42.669894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d87b311a-5480-4860-9e14-e3424bc5eb4e tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:42.671443 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:42.671443 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:42.686728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d87b311a-5480-4860-9e14-e3424bc5eb4e tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:42.687940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d87b311a-5480-4860-9e14-e3424bc5eb4e tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:42.819649 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-514b91bf-9ad8-4c7d-ad20-058b2eeb3806 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:42.852373 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-514b91bf-9ad8-4c7d-ad20-058b2eeb3806 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1333 microversion: 2.1 time: 0.394729 Mar 12 20:48:42.865555 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d87b311a-5480-4860-9e14-e3424bc5eb4e tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.196685 Mar 12 20:48:42.865555 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 66/149] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:48:42 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:42.869756 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 84/150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:42 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1333 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:42.873470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c223488-da40-4e4d-ac9f-5013b3d36f1c tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:42.874782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c223488-da40-4e4d-ac9f-5013b3d36f1c tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:42.879140 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3b962f41-3b59-4631-be6f-06c6da03dcb4 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:42.881068 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:42.881068 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:42.889331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c223488-da40-4e4d-ac9f-5013b3d36f1c tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:42.889331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c223488-da40-4e4d-ac9f-5013b3d36f1c tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:42.891653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c223488-da40-4e4d-ac9f-5013b3d36f1c tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:42.892253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c223488-da40-4e4d-ac9f-5013b3d36f1c tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:42.943001 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3b962f41-3b59-4631-be6f-06c6da03dcb4 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.071694 Mar 12 20:48:42.946168 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 85/151] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:42 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:42.968072 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2306408e-9ad1-48e2-97f8-efe6c935f5be tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-471248279"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:42.970291 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:42.970291 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:42.971455 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-2306408e-9ad1-48e2-97f8-efe6c935f5be tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Generated uuid 61b1d334-e451-496f-801a-771184700150 for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:43.026271 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2306408e-9ad1-48e2-97f8-efe6c935f5be tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.065236 Mar 12 20:48:43.027072 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 86/152] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:42 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:43.034422 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-50502639-c940-416b-bdb9-d7afd90f3d88 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:43.035373 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-50502639-c940-416b-bdb9-d7afd90f3d88 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:43.044135 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-50502639-c940-416b-bdb9-d7afd90f3d88 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:43.045286 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-50502639-c940-416b-bdb9-d7afd90f3d88 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:43.046553 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-50502639-c940-416b-bdb9-d7afd90f3d88 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:43.047189 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-50502639-c940-416b-bdb9-d7afd90f3d88 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:43.134928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c223488-da40-4e4d-ac9f-5013b3d36f1c tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:43.143125 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c223488-da40-4e4d-ac9f-5013b3d36f1c tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1389 microversion: 2.1 time: 0.280306 Mar 12 20:48:43.143873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 67/153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:42 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1389 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:43.149597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-522f5c5e-5186-42ec-95e7-4f0c8646c588 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:43.151309 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:43.151309 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:43.161499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-522f5c5e-5186-42ec-95e7-4f0c8646c588 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:43.162169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-522f5c5e-5186-42ec-95e7-4f0c8646c588 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:43.286185 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-522f5c5e-5186-42ec-95e7-4f0c8646c588 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.140338 Mar 12 20:48:43.293043 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 68/154] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:48:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:43.297612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-343086f5-ac2d-44e4-9b28-a12012649c47 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:43.298375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-343086f5-ac2d-44e4-9b28-a12012649c47 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:43.305378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-343086f5-ac2d-44e4-9b28-a12012649c47 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:43.305990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-343086f5-ac2d-44e4-9b28-a12012649c47 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:43.306791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-343086f5-ac2d-44e4-9b28-a12012649c47 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:43.307236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-343086f5-ac2d-44e4-9b28-a12012649c47 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:43.348006 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-50502639-c940-416b-bdb9-d7afd90f3d88 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:43.357319 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-50502639-c940-416b-bdb9-d7afd90f3d88 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1270 microversion: 2.1 time: 0.328645 Mar 12 20:48:43.358181 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 87/155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:43 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1270 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:43.363077 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-63d49742-e1c3-4472-a607-6e667e41ba89 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:43.363852 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:43.363852 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:43.372516 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-63d49742-e1c3-4472-a607-6e667e41ba89 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.011873 Mar 12 20:48:43.372516 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 88/156] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Mar 12 20:48:43 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:43.382598 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-72577cf7-9de4-438e-abbb-24cd1786f921 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:43.384410 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:43.384410 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:43.393035 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-72577cf7-9de4-438e-abbb-24cd1786f921 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:43.393460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-72577cf7-9de4-438e-abbb-24cd1786f921 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:43.570171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-343086f5-ac2d-44e4-9b28-a12012649c47 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:43.583620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-343086f5-ac2d-44e4-9b28-a12012649c47 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:43.589906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-343086f5-ac2d-44e4-9b28-a12012649c47 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:43.592925 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-343086f5-ac2d-44e4-9b28-a12012649c47 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1362 microversion: 2.25 time: 0.303721 Mar 12 20:48:43.605451 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 69/157] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:43 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1362 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:43.612283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-099a514d-7c6f-4ea1-b539-b2737e7fc1df tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:43.613573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-099a514d-7c6f-4ea1-b539-b2737e7fc1df tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:43.636613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-099a514d-7c6f-4ea1-b539-b2737e7fc1df tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:43.637243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-099a514d-7c6f-4ea1-b539-b2737e7fc1df tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:43.638600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-099a514d-7c6f-4ea1-b539-b2737e7fc1df tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:43.639211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-099a514d-7c6f-4ea1-b539-b2737e7fc1df tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:43.750530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-099a514d-7c6f-4ea1-b539-b2737e7fc1df tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:43.802088 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-099a514d-7c6f-4ea1-b539-b2737e7fc1df tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1276 microversion: 2.1 time: 0.194219 Mar 12 20:48:43.806402 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 70/158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:43 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:43.837139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-79a781bf-64f7-427e-8263-fab1a2bcb687 req-dfa66559-ee55-4878-a00f-957d997bc29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609a3dcb-697d-4955-8b1f-23f2ba14cda4", "tag": "d4cfae29-d4f0-4e0c-a36c-dbcc83815e9b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:43.847003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-79a781bf-64f7-427e-8263-fab1a2bcb687 req-dfa66559-ee55-4878-a00f-957d997bc29e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:43.847652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-79a781bf-64f7-427e-8263-fab1a2bcb687 req-dfa66559-ee55-4878-a00f-957d997bc29e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:43.871357 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-79a781bf-64f7-427e-8263-fab1a2bcb687 req-dfa66559-ee55-4878-a00f-957d997bc29e service nova] Creating event network-changed:d4cfae29-d4f0-4e0c-a36c-dbcc83815e9b for instance 609a3dcb-697d-4955-8b1f-23f2ba14cda4 on nch2-master-1 Mar 12 20:48:43.879517 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-79a781bf-64f7-427e-8263-fab1a2bcb687 req-dfa66559-ee55-4878-a00f-957d997bc29e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058100 Mar 12 20:48:43.880112 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 71/159] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:43.896966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-325be476-95de-4dda-b315-6048e8b32eab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:43.897691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-325be476-95de-4dda-b315-6048e8b32eab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:43.912766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-325be476-95de-4dda-b315-6048e8b32eab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:43.913315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-325be476-95de-4dda-b315-6048e8b32eab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:43.914852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-325be476-95de-4dda-b315-6048e8b32eab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:43.921177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-325be476-95de-4dda-b315-6048e8b32eab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:43.921583 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-72577cf7-9de4-438e-abbb-24cd1786f921 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.542573 Mar 12 20:48:43.929356 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 89/160] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:48:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:48:43.940359 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-41dd8771-011a-4c10-88ae-68a3bc74e7ea tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:43.941289 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:43.941289 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:43.995833 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-41dd8771-011a-4c10-88ae-68a3bc74e7ea tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.064842 Mar 12 20:48:43.997362 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 90/161] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:43 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:44.012833 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5e59768a-1f29-4911-bfab-a0ac391d5585 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1104704453"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:44.014912 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:44.014912 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:44.016189 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-5e59768a-1f29-4911-bfab-a0ac391d5585 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Generated uuid 69f364f8-c727-47a1-afde-512ba6b771a7 for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:44.052706 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5e59768a-1f29-4911-bfab-a0ac391d5585 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047722 Mar 12 20:48:44.054184 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 91/162] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:44.064346 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e7162513-6000-449f-9d3e-d61928368c70 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:44.066572 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:44.066572 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:44.084918 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e7162513-6000-449f-9d3e-d61928368c70 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:44.086733 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e7162513-6000-449f-9d3e-d61928368c70 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:44.237136 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e7162513-6000-449f-9d3e-d61928368c70 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.177110 Mar 12 20:48:44.238205 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 92/163] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:48:44 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:44.245676 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1f41145b-4ecd-451f-b19c-f10dfddf1bbc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:44.246685 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-1f41145b-4ecd-451f-b19c-f10dfddf1bbc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:44.257158 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1f41145b-4ecd-451f-b19c-f10dfddf1bbc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:44.258180 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1f41145b-4ecd-451f-b19c-f10dfddf1bbc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:44.259467 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1f41145b-4ecd-451f-b19c-f10dfddf1bbc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:44.260949 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1f41145b-4ecd-451f-b19c-f10dfddf1bbc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:44.348165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-325be476-95de-4dda-b315-6048e8b32eab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:44.367058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-325be476-95de-4dda-b315-6048e8b32eab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1311 microversion: 2.1 time: 0.485368 Mar 12 20:48:44.367735 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 72/164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:43 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1311 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:44.379776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9acc9ab8-b7eb-42a5-bf5f-c0bf1bc7fd5c tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:44.389239 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:44.389239 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:44.410737 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9acc9ab8-b7eb-42a5-bf5f-c0bf1bc7fd5c tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.038173 Mar 12 20:48:44.412236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 73/165] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 20:48:44 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:44.422891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a70f516a-d50d-48ee-94e3-95fb97b28986 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:44.423685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a70f516a-d50d-48ee-94e3-95fb97b28986 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:44.431712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a70f516a-d50d-48ee-94e3-95fb97b28986 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:44.432181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a70f516a-d50d-48ee-94e3-95fb97b28986 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:44.432973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a70f516a-d50d-48ee-94e3-95fb97b28986 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:44.433416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a70f516a-d50d-48ee-94e3-95fb97b28986 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:44.703389 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-1f41145b-4ecd-451f-b19c-f10dfddf1bbc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:44.711220 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1f41145b-4ecd-451f-b19c-f10dfddf1bbc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1389 microversion: 2.1 time: 0.471636 Mar 12 20:48:44.712126 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 93/166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:44 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1389 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:44.724715 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5e57b0d8-af47-47a9-9411-bbd3fdce6315 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:44.726470 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:44.726470 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:44.735441 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5e57b0d8-af47-47a9-9411-bbd3fdce6315 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:44.736132 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5e57b0d8-af47-47a9-9411-bbd3fdce6315 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:44.760116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a70f516a-d50d-48ee-94e3-95fb97b28986 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:44.774863 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a70f516a-d50d-48ee-94e3-95fb97b28986 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.360516 Mar 12 20:48:44.776047 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 74/167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:44 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:44.781683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5b567f89-c13c-4810-b46d-0f6a6064622a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:44.782598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5b567f89-c13c-4810-b46d-0f6a6064622a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:44.792717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b567f89-c13c-4810-b46d-0f6a6064622a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:44.793361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b567f89-c13c-4810-b46d-0f6a6064622a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:44.794550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b567f89-c13c-4810-b46d-0f6a6064622a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:44.795509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b567f89-c13c-4810-b46d-0f6a6064622a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:44.902807 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5e57b0d8-af47-47a9-9411-bbd3fdce6315 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.189440 Mar 12 20:48:44.908681 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 94/168] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:48:44 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:44.908995 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-bc190f72-3067-45ec-8df6-1dfaac3e7e6a tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:44.909616 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-bc190f72-3067-45ec-8df6-1dfaac3e7e6a tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:44.920273 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bc190f72-3067-45ec-8df6-1dfaac3e7e6a tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:44.920732 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bc190f72-3067-45ec-8df6-1dfaac3e7e6a tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:44.921520 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bc190f72-3067-45ec-8df6-1dfaac3e7e6a tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:44.921990 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bc190f72-3067-45ec-8df6-1dfaac3e7e6a tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:45.103244 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-bc190f72-3067-45ec-8df6-1dfaac3e7e6a tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:45.149610 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-bc190f72-3067-45ec-8df6-1dfaac3e7e6a tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1276 microversion: 2.1 time: 0.234179 Mar 12 20:48:45.150694 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 95/169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:44 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:45.156099 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-54ebd3b9-ff7b-4881-a7fe-60b42eaf99f0 req-6067a89a-a223-4066-b57d-5db58f97c89f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb40313-ddf5-44a6-8898-8c76ab6e1e29", "tag": "9350a43c-e942-483b-b81d-2affe8e464d3"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:45.166730 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-54ebd3b9-ff7b-4881-a7fe-60b42eaf99f0 req-6067a89a-a223-4066-b57d-5db58f97c89f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:45.168047 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-54ebd3b9-ff7b-4881-a7fe-60b42eaf99f0 req-6067a89a-a223-4066-b57d-5db58f97c89f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:45.175566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5b567f89-c13c-4810-b46d-0f6a6064622a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:45.183844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5b567f89-c13c-4810-b46d-0f6a6064622a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:45.184189 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-54ebd3b9-ff7b-4881-a7fe-60b42eaf99f0 req-6067a89a-a223-4066-b57d-5db58f97c89f service nova] Creating event network-changed:9350a43c-e942-483b-b81d-2affe8e464d3 for instance 2eb40313-ddf5-44a6-8898-8c76ab6e1e29 on nch1-master-1 Mar 12 20:48:45.185354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5b567f89-c13c-4810-b46d-0f6a6064622a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:45.186511 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5b567f89-c13c-4810-b46d-0f6a6064622a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1362 microversion: 2.25 time: 0.409344 Mar 12 20:48:45.192046 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 75/170] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:44 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:45.193939 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-54ebd3b9-ff7b-4881-a7fe-60b42eaf99f0 req-6067a89a-a223-4066-b57d-5db58f97c89f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041586 Mar 12 20:48:45.196755 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 96/171] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:45.206624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56a236ef-dae4-4878-862a-4b34269d30d2 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:45.208065 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:45.208065 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:45.237473 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56a236ef-dae4-4878-862a-4b34269d30d2 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.044141 Mar 12 20:48:45.240280 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 76/172] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:45 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:45.252033 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0da4ce7e-7eda-4e68-83ad-ba0ab1f3c610 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-17616900"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:45.254655 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:45.254655 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:45.256236 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-0da4ce7e-7eda-4e68-83ad-ba0ab1f3c610 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Generated uuid afc91273-8189-40e5-88a1-4d2f0fe81a00 for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:45.281130 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0da4ce7e-7eda-4e68-83ad-ba0ab1f3c610 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.033431 Mar 12 20:48:45.282073 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 97/173] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:45 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:45.292757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb18da76-3cc3-4091-8dcc-bf96d838274c tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:45.295013 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:45.295013 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:45.304857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb18da76-3cc3-4091-8dcc-bf96d838274c tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:45.305578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb18da76-3cc3-4091-8dcc-bf96d838274c tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:45.387139 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2e501595-d04e-402c-97b7-09060b740fb8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:45.388894 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-2e501595-d04e-402c-97b7-09060b740fb8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:45.398149 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2e501595-d04e-402c-97b7-09060b740fb8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:45.400252 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2e501595-d04e-402c-97b7-09060b740fb8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:45.401067 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2e501595-d04e-402c-97b7-09060b740fb8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:45.402292 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2e501595-d04e-402c-97b7-09060b740fb8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:45.422457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb18da76-3cc3-4091-8dcc-bf96d838274c tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 240 microversion: 2.1 time: 0.134089 Mar 12 20:48:45.423797 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 77/174] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:48:45 2022] POST /compute/v2.1/os-aggregates/4/action => generated 240 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:48:45.433924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c1e7b39-3cb6-485f-be68-6c1198fc79f0 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:45.435807 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:45.435807 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:45.446093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1e7b39-3cb6-485f-be68-6c1198fc79f0 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:45.447795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1e7b39-3cb6-485f-be68-6c1198fc79f0 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:45.595254 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c1e7b39-3cb6-485f-be68-6c1198fc79f0 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 225 microversion: 2.1 time: 0.164672 Mar 12 20:48:45.597185 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 78/175] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:48:45 2022] POST /compute/v2.1/os-aggregates/4/action => generated 225 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:45.616439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b24388a-a8b0-485d-9179-92547bd6e0ad tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:45.617535 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:45.617535 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:45.653858 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b24388a-a8b0-485d-9179-92547bd6e0ad tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.049483 Mar 12 20:48:45.655000 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 79/176] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:45 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Mar 12 20:48:45.664027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-921e1394-f04d-47d2-8aaa-cf6e79a5572a tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-172675149"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:45.666763 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:45.666763 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:45.670043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.aggregate [None req-921e1394-f04d-47d2-8aaa-cf6e79a5572a tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Generated uuid 4ea48844-14a9-483f-8367-59b88f3b8100 for aggregate {{(pid=136302) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:45.702956 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-921e1394-f04d-47d2-8aaa-cf6e79a5572a tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042665 Mar 12 20:48:45.703558 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 80/177] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:45.716314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-65801aa2-c9ba-4bd0-8c67-934a20ca2f04 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:45.717096 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:45.717096 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:45.760259 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-65801aa2-c9ba-4bd0-8c67-934a20ca2f04 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.050316 Mar 12 20:48:45.761436 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 81/178] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:45 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:45.768557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-083f9f11-8991-4040-94d0-8ab65f01c473 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:45.770666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-083f9f11-8991-4040-94d0-8ab65f01c473 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:45.781532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-083f9f11-8991-4040-94d0-8ab65f01c473 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:45.782727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-083f9f11-8991-4040-94d0-8ab65f01c473 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:45.784217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-083f9f11-8991-4040-94d0-8ab65f01c473 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:45.784677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-083f9f11-8991-4040-94d0-8ab65f01c473 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:45.979160 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2e501595-d04e-402c-97b7-09060b740fb8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:45.986835 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2e501595-d04e-402c-97b7-09060b740fb8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1311 microversion: 2.1 time: 0.606126 Mar 12 20:48:45.997393 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 98/179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:45 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1311 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:46.002501 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-682a27a9-9089-434a-a2e0-748f123c3074 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Calling method '.version_select at 0x7f6e377cb4c0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.004430 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.004430 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:46.005981 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-682a27a9-9089-434a-a2e0-748f123c3074 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.007060 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-682a27a9-9089-434a-a2e0-748f123c3074 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.008638 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-682a27a9-9089-434a-a2e0-748f123c3074 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.009267 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-682a27a9-9089-434a-a2e0-748f123c3074 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.045094 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-682a27a9-9089-434a-a2e0-748f123c3074 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.046158 Mar 12 20:48:46.045990 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 99/180] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Mar 12 20:48:45 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:46.050526 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-58b5f96a-bd60-4d63-80c7-677ac52a47ca tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.051478 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.051478 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:46.058361 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-58b5f96a-bd60-4d63-80c7-677ac52a47ca tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Mar 12 20:48:46.059205 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-58b5f96a-bd60-4d63-80c7-677ac52a47ca tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:46.060192 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-58b5f96a-bd60-4d63-80c7-677ac52a47ca tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.013153 Mar 12 20:48:46.060898 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 100/181] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Mar 12 20:48:46 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:48:46.069137 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-51711100-ed2b-418f-94e0-b9ae77a09909 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.070812 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-51711100-ed2b-418f-94e0-b9ae77a09909 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:46.073490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-083f9f11-8991-4040-94d0-8ab65f01c473 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:46.080528 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-51711100-ed2b-418f-94e0-b9ae77a09909 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.081171 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-51711100-ed2b-418f-94e0-b9ae77a09909 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.082629 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-51711100-ed2b-418f-94e0-b9ae77a09909 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.083838 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-51711100-ed2b-418f-94e0-b9ae77a09909 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.084980 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-083f9f11-8991-4040-94d0-8ab65f01c473 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1389 microversion: 2.1 time: 0.321172 Mar 12 20:48:46.086270 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 82/182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:45 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1389 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:46.106960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-54e0366f-bdfb-47a1-9df0-89150b1d3a73 req-e109a452-0fa0-47aa-9341-049f0bc29a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc87869-0e83-41a4-8949-ae7612a38be2", "tag": "a1cce536-fdef-4003-bb8c-2aa69b9cb257"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:46.128326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-54e0366f-bdfb-47a1-9df0-89150b1d3a73 req-e109a452-0fa0-47aa-9341-049f0bc29a71 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.128881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-54e0366f-bdfb-47a1-9df0-89150b1d3a73 req-e109a452-0fa0-47aa-9341-049f0bc29a71 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.143044 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-54e0366f-bdfb-47a1-9df0-89150b1d3a73 req-e109a452-0fa0-47aa-9341-049f0bc29a71 service nova] Creating event network-changed:a1cce536-fdef-4003-bb8c-2aa69b9cb257 for instance 7cc87869-0e83-41a4-8949-ae7612a38be2 on nch1-master-1 Mar 12 20:48:46.149419 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-54e0366f-bdfb-47a1-9df0-89150b1d3a73 req-e109a452-0fa0-47aa-9341-049f0bc29a71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049208 Mar 12 20:48:46.150371 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 83/183] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:46.155653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d2518b22-910b-4092-af4c-abdc964d26a3 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Calling method '.version_select at 0x7f6e376faee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.157364 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.157364 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:46.160891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2518b22-910b-4092-af4c-abdc964d26a3 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.161458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2518b22-910b-4092-af4c-abdc964d26a3 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.162419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2518b22-910b-4092-af4c-abdc964d26a3 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.162925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2518b22-910b-4092-af4c-abdc964d26a3 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.191029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d2518b22-910b-4092-af4c-abdc964d26a3 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.039489 Mar 12 20:48:46.200470 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 84/184] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:48:46 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:46.207003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-47794575-50af-456c-ae90-bb6116a7c770 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.208385 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.208385 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:46.227357 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-47794575-50af-456c-ae90-bb6116a7c770 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Mar 12 20:48:46.227758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-47794575-50af-456c-ae90-bb6116a7c770 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:46.228679 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-47794575-50af-456c-ae90-bb6116a7c770 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.027128 Mar 12 20:48:46.233489 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 85/185] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:46 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:48:46.239356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f942cdad-33fa-408e-bbd0-c9cdc2246c99 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.240164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f942cdad-33fa-408e-bbd0-c9cdc2246c99 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:46.247896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f942cdad-33fa-408e-bbd0-c9cdc2246c99 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.248443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f942cdad-33fa-408e-bbd0-c9cdc2246c99 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.249297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f942cdad-33fa-408e-bbd0-c9cdc2246c99 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.249846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f942cdad-33fa-408e-bbd0-c9cdc2246c99 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.458313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f942cdad-33fa-408e-bbd0-c9cdc2246c99 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:46.467037 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f942cdad-33fa-408e-bbd0-c9cdc2246c99 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.232369 Mar 12 20:48:46.467609 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 86/186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:46 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:46.472149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-41d024f5-36b0-4078-86f1-85f6ba91c390 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Calling method '.version_select at 0x7f6e376fa4c0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.473287 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.473287 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:46.474423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41d024f5-36b0-4078-86f1-85f6ba91c390 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.474870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41d024f5-36b0-4078-86f1-85f6ba91c390 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.475661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41d024f5-36b0-4078-86f1-85f6ba91c390 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.476096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41d024f5-36b0-4078-86f1-85f6ba91c390 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.500076 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-41d024f5-36b0-4078-86f1-85f6ba91c390 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.031416 Mar 12 20:48:46.500876 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 87/187] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Mar 12 20:48:46 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:46.505380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ec08462-8932-4dac-af12-b24890debb61 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.506034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8ec08462-8932-4dac-af12-b24890debb61 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:46.511709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ec08462-8932-4dac-af12-b24890debb61 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.512310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ec08462-8932-4dac-af12-b24890debb61 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.512918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ec08462-8932-4dac-af12-b24890debb61 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.513357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ec08462-8932-4dac-af12-b24890debb61 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.528656 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-51711100-ed2b-418f-94e0-b9ae77a09909 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:46.536177 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-51711100-ed2b-418f-94e0-b9ae77a09909 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.474121 Mar 12 20:48:46.537063 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 101/188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:46 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:46.542388 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-75bd527b-684d-4d5a-9300-fa4d53495459 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-99903249", "name": "tempest-test_aggregate-2096305456"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:46.561536 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.561536 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:46.562977 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-75bd527b-684d-4d5a-9300-fa4d53495459 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Generated uuid fa8fcd63-5e9f-48e2-8f85-f845d648ae5b for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:46.592305 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-75bd527b-684d-4d5a-9300-fa4d53495459 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.053765 Mar 12 20:48:46.596593 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 102/189] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Mar 12 20:48:46 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:46.602601 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0d701ba6-8f69-4de8-bee1-65a672246ba2 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1749973697"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:46.604157 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.604157 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:46.605342 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-0d701ba6-8f69-4de8-bee1-65a672246ba2 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Generated uuid cce0831b-e2fd-44ac-8762-ca742be12fbf for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:46.631244 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0d701ba6-8f69-4de8-bee1-65a672246ba2 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.033121 Mar 12 20:48:46.631851 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 103/190] 10.222.0.30 () {62 vars in 1204 bytes} [Sat Mar 12 20:48:46 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:46.636304 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-dbc016f2-78b9-4bc1-9f4f-236d9b8d9f32 req-77d60bc8-ce73-43b2-8897-eefd6077bbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb8e841-3f4c-4bb0-b6cd-6feab78be43c", "name": "network-vif-plugged", "status": "completed", "tag": "31853141-b24e-4296-ac44-006fdaa259f8"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:46.645008 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-dbc016f2-78b9-4bc1-9f4f-236d9b8d9f32 req-77d60bc8-ce73-43b2-8897-eefd6077bbb1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.645463 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-dbc016f2-78b9-4bc1-9f4f-236d9b8d9f32 req-77d60bc8-ce73-43b2-8897-eefd6077bbb1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.657132 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-dbc016f2-78b9-4bc1-9f4f-236d9b8d9f32 req-77d60bc8-ce73-43b2-8897-eefd6077bbb1 service nova] Creating event network-vif-plugged:31853141-b24e-4296-ac44-006fdaa259f8 for instance 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c on nch2-master-1 Mar 12 20:48:46.662076 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-dbc016f2-78b9-4bc1-9f4f-236d9b8d9f32 req-77d60bc8-ce73-43b2-8897-eefd6077bbb1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029076 Mar 12 20:48:46.666134 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 104/191] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:46.671305 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-87e77fa0-9336-4e84-91ad-22ef7741ebba tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Calling method '.version_select at 0x7f6e376f2820>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.672202 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.672202 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:46.679565 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-87e77fa0-9336-4e84-91ad-22ef7741ebba tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.680025 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-87e77fa0-9336-4e84-91ad-22ef7741ebba tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.695234 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-87e77fa0-9336-4e84-91ad-22ef7741ebba tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.695764 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-87e77fa0-9336-4e84-91ad-22ef7741ebba tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.704605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ec08462-8932-4dac-af12-b24890debb61 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:46.716972 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-87e77fa0-9336-4e84-91ad-22ef7741ebba tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.049469 Mar 12 20:48:46.721416 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 105/192] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Mar 12 20:48:46 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 598 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:46.725963 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-59e2b14e-bf9f-4e28-946c-0daa3b587f3d tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.727452 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.727452 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:46.728042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ec08462-8932-4dac-af12-b24890debb61 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:46.730025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ec08462-8932-4dac-af12-b24890debb61 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:46.731363 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ec08462-8932-4dac-af12-b24890debb61 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1362 microversion: 2.25 time: 0.229808 Mar 12 20:48:46.732402 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 88/193] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:46 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:46.737941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2aa35dc5-9885-49c8-8646-48786122db7b tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1827675237"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:46.754676 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-59e2b14e-bf9f-4e28-946c-0daa3b587f3d tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.032162 Mar 12 20:48:46.761504 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 106/194] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:46 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:46.767910 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-53bbb836-ec0f-47e7-bf96-79231fa8e320 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Calling method '.version_select at 0x7f6e376f2a60>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.768852 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.768852 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:46.777310 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-53bbb836-ec0f-47e7-bf96-79231fa8e320 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.777764 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-53bbb836-ec0f-47e7-bf96-79231fa8e320 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.792741 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-53bbb836-ec0f-47e7-bf96-79231fa8e320 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.793080 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-53bbb836-ec0f-47e7-bf96-79231fa8e320 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.816995 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-53bbb836-ec0f-47e7-bf96-79231fa8e320 tempest-HostsAdminTestJSON-1669166611 tempest-HostsAdminTestJSON-1669166611-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 729 microversion: 2.1 time: 0.053386 Mar 12 20:48:46.817961 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 107/195] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Mar 12 20:48:46 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 729 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:46.823205 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-23cba779-7c51-4c38-8b22-16d5786eab01 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.824009 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.824009 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:46.824730 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.824730 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:46.840358 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-23cba779-7c51-4c38-8b22-16d5786eab01 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Mar 12 20:48:46.843374 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-23cba779-7c51-4c38-8b22-16d5786eab01 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:46.844393 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-23cba779-7c51-4c38-8b22-16d5786eab01 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.025382 Mar 12 20:48:46.845068 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 108/196] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Mar 12 20:48:46 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:48:46.874177 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e7cd763a-004b-4754-96fe-089cfdf7e296 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.875937 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.875937 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:46.889475 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2aa35dc5-9885-49c8-8646-48786122db7b tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/7" status: 200 len: 299 microversion: 2.41 time: 0.155696 Mar 12 20:48:46.899814 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 89/197] 10.222.0.30 () {62 vars in 1209 bytes} [Sat Mar 12 20:48:46 2022] PUT /compute/v2.1/os-aggregates/7 => generated 299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:46.912770 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-e7cd763a-004b-4754-96fe-089cfdf7e296 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Mar 12 20:48:46.913578 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e7cd763a-004b-4754-96fe-089cfdf7e296 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:46.915097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd159df1-2873-4a29-9c7e-53e088bd6fa8 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.916195 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e7cd763a-004b-4754-96fe-089cfdf7e296 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.051795 Mar 12 20:48:46.916337 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.916337 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:46.925001 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 109/198] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:46 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:48:46.927736 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd159df1-2873-4a29-9c7e-53e088bd6fa8 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/7" status: 200 len: 299 microversion: 2.41 time: 0.019148 Mar 12 20:48:46.928512 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 90/199] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Mar 12 20:48:46 2022] GET /compute/v2.1/os-aggregates/7 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:46.931884 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-36cb18f8-bb63-430c-9809-f952ebb29f83 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-702143800"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:46.933944 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.933944 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:46.935378 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-36cb18f8-bb63-430c-9809-f952ebb29f83 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Generated uuid 9fec0d4c-f8ef-490a-bb32-276ccaa39e6a for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:46.944327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3662f13c-4102-46af-bf0c-68c2a73201d5 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:46.946294 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.946294 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:46.957375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3662f13c-4102-46af-bf0c-68c2a73201d5 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:46.957916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3662f13c-4102-46af-bf0c-68c2a73201d5 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:46.972276 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-36cb18f8-bb63-430c-9809-f952ebb29f83 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.045369 Mar 12 20:48:46.974327 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 110/200] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:46 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:46.990102 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-95f5837c-7bc9-46e5-b967-1befa5e8f092 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:46.991187 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:46.991187 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:47.000753 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-95f5837c-7bc9-46e5-b967-1befa5e8f092 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.014811 Mar 12 20:48:47.001803 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 111/201] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Mar 12 20:48:46 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:47.013586 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1d7416b4-c332-4d11-8a13-edb7413ca145 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:47.014728 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-1d7416b4-c332-4d11-8a13-edb7413ca145 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:47.022029 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d7416b4-c332-4d11-8a13-edb7413ca145 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:47.023723 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d7416b4-c332-4d11-8a13-edb7413ca145 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:47.024688 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d7416b4-c332-4d11-8a13-edb7413ca145 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:47.025375 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d7416b4-c332-4d11-8a13-edb7413ca145 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:47.110209 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3662f13c-4102-46af-bf0c-68c2a73201d5 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 314 microversion: 2.41 time: 0.175054 Mar 12 20:48:47.115845 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 91/202] 10.222.0.30 () {62 vars in 1231 bytes} [Sat Mar 12 20:48:46 2022] POST /compute/v2.1/os-aggregates/7/action => generated 314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:47.119618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d11caa9-834f-4470-a787-f1ea9cdf2359 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:47.121005 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:47.121005 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:47.145436 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d11caa9-834f-4470-a787-f1ea9cdf2359 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.033098 Mar 12 20:48:47.149931 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 92/203] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Mar 12 20:48:47 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:47.160037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1fdf71f7-2d07-41a8-808a-88fad5f82106 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:47.161011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1fdf71f7-2d07-41a8-808a-88fad5f82106 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:47.169442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fdf71f7-2d07-41a8-808a-88fad5f82106 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:47.169938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fdf71f7-2d07-41a8-808a-88fad5f82106 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:47.171685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fdf71f7-2d07-41a8-808a-88fad5f82106 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:47.172139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fdf71f7-2d07-41a8-808a-88fad5f82106 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:47.331092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1fdf71f7-2d07-41a8-808a-88fad5f82106 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:47.339461 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1fdf71f7-2d07-41a8-808a-88fad5f82106 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1389 microversion: 2.1 time: 0.191946 Mar 12 20:48:47.342365 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 93/204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:47 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1389 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:47.350774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-41ae9140-f61d-4768-9647-98ca188b8e99 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:47.352639 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:47.352639 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:47.364247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41ae9140-f61d-4768-9647-98ca188b8e99 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:47.364889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41ae9140-f61d-4768-9647-98ca188b8e99 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:47.480607 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-1d7416b4-c332-4d11-8a13-edb7413ca145 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:47.488420 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1d7416b4-c332-4d11-8a13-edb7413ca145 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1311 microversion: 2.1 time: 0.479306 Mar 12 20:48:47.493692 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-41ae9140-f61d-4768-9647-98ca188b8e99 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 299 microversion: 2.41 time: 0.152579 Mar 12 20:48:47.494343 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 94/205] 10.222.0.30 () {62 vars in 1231 bytes} [Sat Mar 12 20:48:47 2022] POST /compute/v2.1/os-aggregates/7/action => generated 299 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:47.503758 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 112/206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:47 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1311 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:47.503927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b07a8be0-75b8-4f1a-8e86-14ba4399ba2f tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:47.503927 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:47.503927 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:47.504161 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-177a2a9f-c5e5-4c2a-a6a5-5b9a92884d51 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:47.504516 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-177a2a9f-c5e5-4c2a-a6a5-5b9a92884d51 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:47.511541 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-177a2a9f-c5e5-4c2a-a6a5-5b9a92884d51 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:47.512498 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-177a2a9f-c5e5-4c2a-a6a5-5b9a92884d51 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:47.512498 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-177a2a9f-c5e5-4c2a-a6a5-5b9a92884d51 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:47.512956 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-177a2a9f-c5e5-4c2a-a6a5-5b9a92884d51 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:47.530934 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b07a8be0-75b8-4f1a-8e86-14ba4399ba2f tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.035527 Mar 12 20:48:47.531529 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 95/207] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Mar 12 20:48:47 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:47.541973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-064c16b2-cdf3-4d1b-845b-d1584d896bb6 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:47.544488 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:47.544488 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:47.581652 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-064c16b2-cdf3-4d1b-845b-d1584d896bb6 tempest-AggregatesAdminTestV241-175903214 tempest-AggregatesAdminTestV241-175903214-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.41 time: 0.048798 Mar 12 20:48:47.583868 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 96/208] 10.222.0.30 () {60 vars in 1192 bytes} [Sat Mar 12 20:48:47 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:47.595650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0edf1887-82c8-4a1f-a576-6a3cb96866c5 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:47.596637 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:47.596637 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:47.628409 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0edf1887-82c8-4a1f-a576-6a3cb96866c5 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.043072 Mar 12 20:48:47.628997 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 97/209] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:47 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:47.638687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b3665dfe-9da3-4335-829a-17d1dbe086a6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:47.640315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b3665dfe-9da3-4335-829a-17d1dbe086a6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:47.655271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3665dfe-9da3-4335-829a-17d1dbe086a6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:47.655720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3665dfe-9da3-4335-829a-17d1dbe086a6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:47.656502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3665dfe-9da3-4335-829a-17d1dbe086a6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:47.656938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3665dfe-9da3-4335-829a-17d1dbe086a6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:47.871516 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-177a2a9f-c5e5-4c2a-a6a5-5b9a92884d51 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:47.883546 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-177a2a9f-c5e5-4c2a-a6a5-5b9a92884d51 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.381795 Mar 12 20:48:47.884900 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 113/210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:47 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:47.907354 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a20ee12b-4bbf-4687-84a0-4f3465dcaa42 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-898551163", "availability_zone": "tempest-test_az-1235806374"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:47.920062 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:47.920062 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:47.921138 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-a20ee12b-4bbf-4687-84a0-4f3465dcaa42 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Generated uuid ae16fa82-d1f7-45d3-87b4-d9f63c866bba for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:47.972300 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a20ee12b-4bbf-4687-84a0-4f3465dcaa42 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.078984 Mar 12 20:48:47.984279 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 114/211] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Mar 12 20:48:47 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:47.991504 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3c8bb31d-eefb-49a7-9c6e-60673e4718fe tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:47.993708 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3c8bb31d-eefb-49a7-9c6e-60673e4718fe tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:48.000653 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3c8bb31d-eefb-49a7-9c6e-60673e4718fe tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.001369 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3c8bb31d-eefb-49a7-9c6e-60673e4718fe tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.002410 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3c8bb31d-eefb-49a7-9c6e-60673e4718fe tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.003119 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3c8bb31d-eefb-49a7-9c6e-60673e4718fe tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.089648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b3665dfe-9da3-4335-829a-17d1dbe086a6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:48.100468 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b3665dfe-9da3-4335-829a-17d1dbe086a6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.468422 Mar 12 20:48:48.102433 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 98/212] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:47 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:48.107962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e0d24cdc-29fa-40cf-b3f3-c676c22cfa4c tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-898551163_new", "availability_zone": "tempest-test_az-1235806374_new"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:48.130061 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:48.130061 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:48.174525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0d24cdc-29fa-40cf-b3f3-c676c22cfa4c tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.174525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0d24cdc-29fa-40cf-b3f3-c676c22cfa4c tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.230071 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e0d24cdc-29fa-40cf-b3f3-c676c22cfa4c tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 335 microversion: 2.1 time: 0.125938 Mar 12 20:48:48.238163 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 99/213] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Mar 12 20:48:48 2022] PUT /compute/v2.1/os-aggregates/9 => generated 335 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:48.243813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85b50b72-2790-4c48-803f-0e457d71ed1d tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:48.244979 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:48.244979 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:48.257010 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85b50b72-2790-4c48-803f-0e457d71ed1d tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.017315 Mar 12 20:48:48.259040 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 100/214] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 20:48:48 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:48.263789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7c5d48e4-3996-4a09-906b-1ed5dadbe6fe req-0f79c4ca-3d01-4fb6-9a91-68e5b3a91247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c88bacb8-65ca-46cd-abda-0bf2772c950e", "tag": "3403e4ee-cc92-406d-8b03-966986c25d77"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:48.272999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7c5d48e4-3996-4a09-906b-1ed5dadbe6fe req-0f79c4ca-3d01-4fb6-9a91-68e5b3a91247 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.273898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7c5d48e4-3996-4a09-906b-1ed5dadbe6fe req-0f79c4ca-3d01-4fb6-9a91-68e5b3a91247 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.285175 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3c8bb31d-eefb-49a7-9c6e-60673e4718fe tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:48.286010 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7c5d48e4-3996-4a09-906b-1ed5dadbe6fe req-0f79c4ca-3d01-4fb6-9a91-68e5b3a91247 service nova] Creating event network-changed:3403e4ee-cc92-406d-8b03-966986c25d77 for instance c88bacb8-65ca-46cd-abda-0bf2772c950e on nch1-master-1 Mar 12 20:48:48.291923 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7c5d48e4-3996-4a09-906b-1ed5dadbe6fe req-0f79c4ca-3d01-4fb6-9a91-68e5b3a91247 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031248 Mar 12 20:48:48.293096 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 101/215] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:48.293228 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3c8bb31d-eefb-49a7-9c6e-60673e4718fe tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:48.294670 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3c8bb31d-eefb-49a7-9c6e-60673e4718fe tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:48.295787 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3c8bb31d-eefb-49a7-9c6e-60673e4718fe tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1362 microversion: 2.25 time: 0.310272 Mar 12 20:48:48.296337 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 115/216] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:47 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:48.301644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5db0655-63d0-46c3-9364-383f73f6c354 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:48.302747 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:48.302747 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:48.348484 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c5db0655-63d0-46c3-9364-383f73f6c354 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.053377 Mar 12 20:48:48.349650 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 102/217] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:48 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:48.356155 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-6227ca08-1c80-49a8-9f0e-b33d19722ba7 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:48.356784 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-6227ca08-1c80-49a8-9f0e-b33d19722ba7 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:48.361955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8fe031cf-22f7-40b4-994e-9be6b67c7396 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-75195807"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:48.364217 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:48.364217 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:48.365738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.aggregate [None req-8fe031cf-22f7-40b4-994e-9be6b67c7396 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Generated uuid 4c80eff1-0337-43b0-902a-f0a92f87f90e for aggregate {{(pid=136302) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:48.370448 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6227ca08-1c80-49a8-9f0e-b33d19722ba7 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.371238 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6227ca08-1c80-49a8-9f0e-b33d19722ba7 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.383110 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6227ca08-1c80-49a8-9f0e-b33d19722ba7 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.383577 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6227ca08-1c80-49a8-9f0e-b33d19722ba7 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.399376 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8fe031cf-22f7-40b4-994e-9be6b67c7396 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042481 Mar 12 20:48:48.400399 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 103/218] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:48 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:48.410277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-79f9ca5f-a365-4b8d-b4ff-fec409fb072c tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:48.411062 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:48.411062 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:48.419617 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-79f9ca5f-a365-4b8d-b4ff-fec409fb072c tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 229 microversion: 2.1 time: 0.012267 Mar 12 20:48:48.420232 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 104/219] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 20:48:48 2022] GET /compute/v2.1/os-aggregates => generated 229 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:48:48.431984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b24707bf-0ff7-464a-b8b3-8930f07c56f3 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:48.432781 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:48.432781 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:48.468373 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b24707bf-0ff7-464a-b8b3-8930f07c56f3 tempest-AggregatesAdminTestJSON-1108607601 tempest-AggregatesAdminTestJSON-1108607601-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.041604 Mar 12 20:48:48.469414 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 105/220] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:48:48 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Mar 12 20:48:48.478549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4a182e4c-0c64-4af6-bc8a-dc160130906e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:48.479323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4a182e4c-0c64-4af6-bc8a-dc160130906e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:48.486534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a182e4c-0c64-4af6-bc8a-dc160130906e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.486998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a182e4c-0c64-4af6-bc8a-dc160130906e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.487786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a182e4c-0c64-4af6-bc8a-dc160130906e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.488231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a182e4c-0c64-4af6-bc8a-dc160130906e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.502688 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-4a182e4c-0c64-4af6-bc8a-dc160130906e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] HTTP exception thrown: Instance 6cd46d9b-8f4b-45b5-acd7-d0fad29477de could not be found. Mar 12 20:48:48.503324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4a182e4c-0c64-4af6-bc8a-dc160130906e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Returning 404 to user: Instance 6cd46d9b-8f4b-45b5-acd7-d0fad29477de could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:48.504118 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4a182e4c-0c64-4af6-bc8a-dc160130906e tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 404 len: 111 microversion: 2.1 time: 0.029728 Mar 12 20:48:48.505299 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 106/221] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:48:48 2022] DELETE /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:48.513113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7b093be-9f7d-4457-9a8d-fe1980e21ef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:48.513573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e7b093be-9f7d-4457-9a8d-fe1980e21ef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:48.520794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7b093be-9f7d-4457-9a8d-fe1980e21ef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.521264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7b093be-9f7d-4457-9a8d-fe1980e21ef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.522287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7b093be-9f7d-4457-9a8d-fe1980e21ef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.522729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7b093be-9f7d-4457-9a8d-fe1980e21ef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.686827 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-6227ca08-1c80-49a8-9f0e-b33d19722ba7 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:48.696114 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-6227ca08-1c80-49a8-9f0e-b33d19722ba7 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1389 microversion: 2.1 time: 0.343829 Mar 12 20:48:48.696805 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 116/222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:48 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1389 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:48.702737 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c6eff22a-484f-493d-a9f9-3bf8d723ed57 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:48.703709 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c6eff22a-484f-493d-a9f9-3bf8d723ed57 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] [instance: 6cd46d9b-8f4b-45b5-acd7-d0fad29477de] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:48.709794 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c6eff22a-484f-493d-a9f9-3bf8d723ed57 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.710313 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c6eff22a-484f-493d-a9f9-3bf8d723ed57 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.711212 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c6eff22a-484f-493d-a9f9-3bf8d723ed57 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.711716 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c6eff22a-484f-493d-a9f9-3bf8d723ed57 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.728215 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-c6eff22a-484f-493d-a9f9-3bf8d723ed57 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] HTTP exception thrown: Instance 6cd46d9b-8f4b-45b5-acd7-d0fad29477de could not be found. Mar 12 20:48:48.728952 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c6eff22a-484f-493d-a9f9-3bf8d723ed57 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] Returning 404 to user: Instance 6cd46d9b-8f4b-45b5-acd7-d0fad29477de could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:48.730185 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c6eff22a-484f-493d-a9f9-3bf8d723ed57 tempest-AggregatesAdminTestJSON-681655286 tempest-AggregatesAdminTestJSON-681655286-project] 10.222.0.30 "GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de" status: 404 len: 111 microversion: 2.1 time: 0.032068 Mar 12 20:48:48.735507 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 117/223] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:48 2022] GET /compute/v2.1/servers/6cd46d9b-8f4b-45b5-acd7-d0fad29477de => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:48.740747 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-6c68f148-3075-4b86-8e0a-ae57d01b4bd8 req-1dd42a64-3d67-4968-86ff-929a5978b8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609a3dcb-697d-4955-8b1f-23f2ba14cda4", "name": "network-vif-plugged", "status": "completed", "tag": "d4cfae29-d4f0-4e0c-a36c-dbcc83815e9b"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:48.751450 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-6c68f148-3075-4b86-8e0a-ae57d01b4bd8 req-1dd42a64-3d67-4968-86ff-929a5978b8a9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.752177 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-6c68f148-3075-4b86-8e0a-ae57d01b4bd8 req-1dd42a64-3d67-4968-86ff-929a5978b8a9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.764297 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-6c68f148-3075-4b86-8e0a-ae57d01b4bd8 req-1dd42a64-3d67-4968-86ff-929a5978b8a9 service nova] Creating event network-vif-plugged:d4cfae29-d4f0-4e0c-a36c-dbcc83815e9b for instance 609a3dcb-697d-4955-8b1f-23f2ba14cda4 on nch2-master-1 Mar 12 20:48:48.769963 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-6c68f148-3075-4b86-8e0a-ae57d01b4bd8 req-1dd42a64-3d67-4968-86ff-929a5978b8a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033570 Mar 12 20:48:48.774849 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 118/224] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:48.836255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e7b093be-9f7d-4457-9a8d-fe1980e21ef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:48.845063 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e7b093be-9f7d-4457-9a8d-fe1980e21ef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1311 microversion: 2.1 time: 0.338179 Mar 12 20:48:48.845655 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 107/225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:48 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1311 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:48.902867 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fccc2676-7a6c-4557-87a9-9af9207f4d63 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:48.903835 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-fccc2676-7a6c-4557-87a9-9af9207f4d63 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:48.920169 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fccc2676-7a6c-4557-87a9-9af9207f4d63 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.920739 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fccc2676-7a6c-4557-87a9-9af9207f4d63 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:48.922004 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fccc2676-7a6c-4557-87a9-9af9207f4d63 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:48.922881 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fccc2676-7a6c-4557-87a9-9af9207f4d63 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:49.117986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-61a1aa37-74ff-441c-8950-16330143cafb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:49.118608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-61a1aa37-74ff-441c-8950-16330143cafb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:49.124464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61a1aa37-74ff-441c-8950-16330143cafb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:49.124923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61a1aa37-74ff-441c-8950-16330143cafb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:49.125711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61a1aa37-74ff-441c-8950-16330143cafb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:49.126213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61a1aa37-74ff-441c-8950-16330143cafb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:49.358364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-61a1aa37-74ff-441c-8950-16330143cafb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:49.366011 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-61a1aa37-74ff-441c-8950-16330143cafb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.251941 Mar 12 20:48:49.377590 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 108/226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:49 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:48:49.382663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ade333e-3a05-4489-b1a9-39bb51ded5d9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:49.383091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8ade333e-3a05-4489-b1a9-39bb51ded5d9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:49.392459 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fccc2676-7a6c-4557-87a9-9af9207f4d63 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:49.396344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ade333e-3a05-4489-b1a9-39bb51ded5d9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:49.399630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ade333e-3a05-4489-b1a9-39bb51ded5d9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:49.403225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ade333e-3a05-4489-b1a9-39bb51ded5d9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:49.404066 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fccc2676-7a6c-4557-87a9-9af9207f4d63 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.507162 Mar 12 20:48:49.407818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ade333e-3a05-4489-b1a9-39bb51ded5d9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:49.416028 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 119/227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:48 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:49.663281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ade333e-3a05-4489-b1a9-39bb51ded5d9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:49.673517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ade333e-3a05-4489-b1a9-39bb51ded5d9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:49.675542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ade333e-3a05-4489-b1a9-39bb51ded5d9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:49.676801 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ade333e-3a05-4489-b1a9-39bb51ded5d9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1557 microversion: 2.25 time: 0.306759 Mar 12 20:48:49.677443 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 109/228] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:49 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1557 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:49.713858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1326f3e1-bed5-4860-af5c-6f5b26a52131 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:49.714743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1326f3e1-bed5-4860-af5c-6f5b26a52131 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:49.724742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1326f3e1-bed5-4860-af5c-6f5b26a52131 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:49.724742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1326f3e1-bed5-4860-af5c-6f5b26a52131 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:49.724742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1326f3e1-bed5-4860-af5c-6f5b26a52131 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:49.725108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1326f3e1-bed5-4860-af5c-6f5b26a52131 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:49.930101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1326f3e1-bed5-4860-af5c-6f5b26a52131 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:49.938986 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1326f3e1-bed5-4860-af5c-6f5b26a52131 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1389 microversion: 2.1 time: 0.230159 Mar 12 20:48:49.940041 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 110/229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:49 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1389 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:49.945012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51143f6b-cd54-4886-84ec-3023a19a1ac5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:49.946358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51143f6b-cd54-4886-84ec-3023a19a1ac5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:49.953635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51143f6b-cd54-4886-84ec-3023a19a1ac5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:49.954350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51143f6b-cd54-4886-84ec-3023a19a1ac5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:49.955315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51143f6b-cd54-4886-84ec-3023a19a1ac5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:49.956129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51143f6b-cd54-4886-84ec-3023a19a1ac5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.030042 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7c1f4889-731f-4c01-b4cc-2b1659a857eb tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:50.031771 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7c1f4889-731f-4c01-b4cc-2b1659a857eb tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:50.044736 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7c1f4889-731f-4c01-b4cc-2b1659a857eb tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:50.046136 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7c1f4889-731f-4c01-b4cc-2b1659a857eb tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.048631 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7c1f4889-731f-4c01-b4cc-2b1659a857eb tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:50.049752 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7c1f4889-731f-4c01-b4cc-2b1659a857eb tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.234929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51143f6b-cd54-4886-84ec-3023a19a1ac5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:50.247418 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51143f6b-cd54-4886-84ec-3023a19a1ac5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1311 microversion: 2.1 time: 0.306087 Mar 12 20:48:50.248007 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 111/230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:49 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1311 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:50.342480 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-7c1f4889-731f-4c01-b4cc-2b1659a857eb tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:48:50.387785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-610729b4-bd9c-4bbc-a4d7-ef5d2b716a3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:50.388625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-610729b4-bd9c-4bbc-a4d7-ef5d2b716a3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:50.399183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-610729b4-bd9c-4bbc-a4d7-ef5d2b716a3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:50.399637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-610729b4-bd9c-4bbc-a4d7-ef5d2b716a3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.400432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-610729b4-bd9c-4bbc-a4d7-ef5d2b716a3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:50.400886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-610729b4-bd9c-4bbc-a4d7-ef5d2b716a3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.432470 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7c1f4889-731f-4c01-b4cc-2b1659a857eb tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 2050 microversion: 2.25 time: 0.741196 Mar 12 20:48:50.433050 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 120/231] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:49 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 2050 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:50.437700 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c9235d5e-2fb2-41b7-b23e-a5bf3db8b56f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:50.438358 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c9235d5e-2fb2-41b7-b23e-a5bf3db8b56f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:50.444542 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c9235d5e-2fb2-41b7-b23e-a5bf3db8b56f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:50.445307 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c9235d5e-2fb2-41b7-b23e-a5bf3db8b56f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.446103 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c9235d5e-2fb2-41b7-b23e-a5bf3db8b56f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:50.446778 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c9235d5e-2fb2-41b7-b23e-a5bf3db8b56f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.631836 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c9235d5e-2fb2-41b7-b23e-a5bf3db8b56f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:50.640108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-610729b4-bd9c-4bbc-a4d7-ef5d2b716a3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:50.643975 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c9235d5e-2fb2-41b7-b23e-a5bf3db8b56f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.209573 Mar 12 20:48:50.646314 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 121/232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:50 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:50.651070 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-610729b4-bd9c-4bbc-a4d7-ef5d2b716a3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.268711 Mar 12 20:48:50.660851 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 112/233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:50 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:50.661061 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-36217350-24e2-43d0-b067-78305bc2f6f6 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:50.663253 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-36217350-24e2-43d0-b067-78305bc2f6f6 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:50.672890 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-36217350-24e2-43d0-b067-78305bc2f6f6 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:50.675528 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-36217350-24e2-43d0-b067-78305bc2f6f6 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.679070 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-36217350-24e2-43d0-b067-78305bc2f6f6 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:50.680265 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-36217350-24e2-43d0-b067-78305bc2f6f6 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.886956 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-36217350-24e2-43d0-b067-78305bc2f6f6 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:48:50.902714 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-36217350-24e2-43d0-b067-78305bc2f6f6 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 2050 microversion: 2.25 time: 0.255267 Mar 12 20:48:50.906164 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 122/234] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:50 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 2050 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:50.920397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72b3fd1b-ade6-45ca-8c63-6d233a0d9b4a tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:50.923384 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:50.923384 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:50.925039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72b3fd1b-ade6-45ca-8c63-6d233a0d9b4a tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:50.925710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72b3fd1b-ade6-45ca-8c63-6d233a0d9b4a tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.926759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72b3fd1b-ade6-45ca-8c63-6d233a0d9b4a tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:50.927413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72b3fd1b-ade6-45ca-8c63-6d233a0d9b4a tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.956582 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-38f7bfd5-d9d7-4e18-bffb-1a2b8b20b753 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:50.957403 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-38f7bfd5-d9d7-4e18-bffb-1a2b8b20b753 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:50.965808 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-38f7bfd5-d9d7-4e18-bffb-1a2b8b20b753 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:50.966266 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-38f7bfd5-d9d7-4e18-bffb-1a2b8b20b753 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.967051 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-38f7bfd5-d9d7-4e18-bffb-1a2b8b20b753 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:50.967494 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-38f7bfd5-d9d7-4e18-bffb-1a2b8b20b753 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:50.971572 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72b3fd1b-ade6-45ca-8c63-6d233a0d9b4a tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.054858 Mar 12 20:48:50.980107 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 113/235] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Mar 12 20:48:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:48:50.993718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-875919dc-5057-4c15-af04-ca3cd07e6707 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:50.995089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-875919dc-5057-4c15-af04-ca3cd07e6707 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:51.006154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-875919dc-5057-4c15-af04-ca3cd07e6707 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:51.006667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-875919dc-5057-4c15-af04-ca3cd07e6707 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:51.007988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-875919dc-5057-4c15-af04-ca3cd07e6707 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:51.008432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-875919dc-5057-4c15-af04-ca3cd07e6707 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:51.125362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-875919dc-5057-4c15-af04-ca3cd07e6707 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'flavor' on Instance uuid 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:48:51.200044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-875919dc-5057-4c15-af04-ca3cd07e6707 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Going to try to live migrate instance to nch1-master-1 {{(pid=136302) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 12 20:48:51.226323 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-38f7bfd5-d9d7-4e18-bffb-1a2b8b20b753 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:51.236144 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-38f7bfd5-d9d7-4e18-bffb-1a2b8b20b753 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1389 microversion: 2.1 time: 0.283766 Mar 12 20:48:51.248538 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 123/236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:50 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1389 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:48:51.267130 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ef35f044-1d25-4730-b229-09d51082402b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:51.269632 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ef35f044-1d25-4730-b229-09d51082402b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:51.283266 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef35f044-1d25-4730-b229-09d51082402b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:51.283971 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef35f044-1d25-4730-b229-09d51082402b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:51.285968 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef35f044-1d25-4730-b229-09d51082402b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:51.286429 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef35f044-1d25-4730-b229-09d51082402b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:51.480457 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ef35f044-1d25-4730-b229-09d51082402b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:51.489187 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ef35f044-1d25-4730-b229-09d51082402b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1494 microversion: 2.1 time: 0.227092 Mar 12 20:48:51.489786 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 124/237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:51 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1494 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:48:51.705214 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-73c0aca6-cb44-4dc9-ac78-77122225b37d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:51.706063 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-73c0aca6-cb44-4dc9-ac78-77122225b37d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:51.712355 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73c0aca6-cb44-4dc9-ac78-77122225b37d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:51.712805 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73c0aca6-cb44-4dc9-ac78-77122225b37d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:51.714845 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73c0aca6-cb44-4dc9-ac78-77122225b37d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:51.715791 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73c0aca6-cb44-4dc9-ac78-77122225b37d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:51.906160 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-73c0aca6-cb44-4dc9-ac78-77122225b37d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1645 microversion: 2.1 time: 0.402780 Mar 12 20:48:51.907485 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 125/238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:51 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1645 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:51.914710 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d40cace0-31e4-41a7-a65a-42a763709b2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:51.915682 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d40cace0-31e4-41a7-a65a-42a763709b2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:51.923781 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d40cace0-31e4-41a7-a65a-42a763709b2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:51.924486 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d40cace0-31e4-41a7-a65a-42a763709b2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:51.925509 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d40cace0-31e4-41a7-a65a-42a763709b2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:51.926263 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d40cace0-31e4-41a7-a65a-42a763709b2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:52.152206 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d40cace0-31e4-41a7-a65a-42a763709b2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:52.160735 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d40cace0-31e4-41a7-a65a-42a763709b2c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.251785 Mar 12 20:48:52.161324 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 126/239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:51 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:52.166710 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9f8bacf2-0e40-4a2a-86db-d0cbb12511c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:52.167536 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9f8bacf2-0e40-4a2a-86db-d0cbb12511c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:52.173616 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f8bacf2-0e40-4a2a-86db-d0cbb12511c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:52.174107 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f8bacf2-0e40-4a2a-86db-d0cbb12511c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:52.174892 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f8bacf2-0e40-4a2a-86db-d0cbb12511c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:52.175339 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f8bacf2-0e40-4a2a-86db-d0cbb12511c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:52.323605 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9f8bacf2-0e40-4a2a-86db-d0cbb12511c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:52.331025 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9f8bacf2-0e40-4a2a-86db-d0cbb12511c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.168708 Mar 12 20:48:52.331684 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 127/240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:52 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:52.647251 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3ae86956-5ffa-459f-8e8c-bcfda9f7902e tempest-InstanceUsageAuditLogTestJSON-1745863976 tempest-InstanceUsageAuditLogTestJSON-1745863976-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:52.649362 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:52.649362 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:52.671908 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3ae86956-5ffa-459f-8e8c-bcfda9f7902e tempest-InstanceUsageAuditLogTestJSON-1745863976 tempest-InstanceUsageAuditLogTestJSON-1745863976-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-03-12 20:48:51" status: 200 len: 318 microversion: 2.1 time: 0.329897 Mar 12 20:48:52.680423 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 128/241] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Mar 12 20:48:52 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-03-12%2020%3A48%3A51 => generated 318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:52.685907 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e4d018d4-4d63-4eb3-a2bc-d521106fe530 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:52.686722 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e4d018d4-4d63-4eb3-a2bc-d521106fe530 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:52.693638 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e4d018d4-4d63-4eb3-a2bc-d521106fe530 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:52.694446 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e4d018d4-4d63-4eb3-a2bc-d521106fe530 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:52.696679 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e4d018d4-4d63-4eb3-a2bc-d521106fe530 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:52.697374 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e4d018d4-4d63-4eb3-a2bc-d521106fe530 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:52.896806 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e4d018d4-4d63-4eb3-a2bc-d521106fe530 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1645 microversion: 2.1 time: 0.215103 Mar 12 20:48:52.897940 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 129/242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:52 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1645 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:52.904337 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b9186171-83d8-4386-886c-ab5552e11873 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:52.905791 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b9186171-83d8-4386-886c-ab5552e11873 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:52.914988 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b9186171-83d8-4386-886c-ab5552e11873 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:52.915627 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b9186171-83d8-4386-886c-ab5552e11873 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:52.916578 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b9186171-83d8-4386-886c-ab5552e11873 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:52.917280 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b9186171-83d8-4386-886c-ab5552e11873 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:53.070270 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b9186171-83d8-4386-886c-ab5552e11873 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:53.089523 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b9186171-83d8-4386-886c-ab5552e11873 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1389 microversion: 2.1 time: 0.190208 Mar 12 20:48:53.090800 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 130/243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:52 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1389 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:53.097326 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fc575a2c-6416-4a18-88b6-7163a7b16d09 tempest-InstanceUsageAuditLogTestJSON-1745863976 tempest-InstanceUsageAuditLogTestJSON-1745863976-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:53.098131 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:53.098131 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:53.111311 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fc575a2c-6416-4a18-88b6-7163a7b16d09 tempest-InstanceUsageAuditLogTestJSON-1745863976 tempest-InstanceUsageAuditLogTestJSON-1745863976-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.019081 Mar 12 20:48:53.113808 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 131/244] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Mar 12 20:48:53 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:53.116567 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ed9473f1-88ab-41ac-b3dd-a5c08c2e2d49 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:53.119827 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:53.119827 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:53.121300 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ed9473f1-88ab-41ac-b3dd-a5c08c2e2d49 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:53.121754 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ed9473f1-88ab-41ac-b3dd-a5c08c2e2d49 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:53.122608 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ed9473f1-88ab-41ac-b3dd-a5c08c2e2d49 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:53.123055 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ed9473f1-88ab-41ac-b3dd-a5c08c2e2d49 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:53.151958 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ed9473f1-88ab-41ac-b3dd-a5c08c2e2d49 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038506 Mar 12 20:48:53.152428 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 132/245] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Mar 12 20:48:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:53.165891 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-57307e79-f062-41a9-95a1-9afd69a524e9 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:53.167058 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-57307e79-f062-41a9-95a1-9afd69a524e9 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:53.182686 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-57307e79-f062-41a9-95a1-9afd69a524e9 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:53.183415 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-57307e79-f062-41a9-95a1-9afd69a524e9 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:53.184512 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-57307e79-f062-41a9-95a1-9afd69a524e9 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:53.185134 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-57307e79-f062-41a9-95a1-9afd69a524e9 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:53.290510 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-57307e79-f062-41a9-95a1-9afd69a524e9 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lazy-loading 'flavor' on Instance uuid 609a3dcb-697d-4955-8b1f-23f2ba14cda4 {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:48:53.341220 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-57307e79-f062-41a9-95a1-9afd69a524e9 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Going to try to live migrate instance to nch1-master-1 {{(pid=136303) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 12 20:48:53.886973 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-875919dc-5057-4c15-af04-ca3cd07e6707 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c/action" status: 202 len: 0 microversion: 2.25 time: 2.905509 Mar 12 20:48:53.887612 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 114/246] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 20:48:50 2022] POST /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c/action => generated 0 bytes in 2907 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:48:53.892442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0edec72f-b7ba-46e5-a283-98944bed9631 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:53.893054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0edec72f-b7ba-46e5-a283-98944bed9631 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:53.900954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0edec72f-b7ba-46e5-a283-98944bed9631 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:53.901414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0edec72f-b7ba-46e5-a283-98944bed9631 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:53.902214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0edec72f-b7ba-46e5-a283-98944bed9631 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:53.902651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0edec72f-b7ba-46e5-a283-98944bed9631 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:54.143267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0edec72f-b7ba-46e5-a283-98944bed9631 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:54.153712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0edec72f-b7ba-46e5-a283-98944bed9631 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.264584 Mar 12 20:48:54.154924 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 115/247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:53 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:54.458470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f1cacca-31d3-418d-9495-5dfbf042c7a9 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:54.459961 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:54.459961 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:54.462792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f1cacca-31d3-418d-9495-5dfbf042c7a9 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:54.463475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f1cacca-31d3-418d-9495-5dfbf042c7a9 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:54.464784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f1cacca-31d3-418d-9495-5dfbf042c7a9 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:54.468620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f1cacca-31d3-418d-9495-5dfbf042c7a9 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:54.497373 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4f1cacca-31d3-418d-9495-5dfbf042c7a9 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.340461 Mar 12 20:48:54.497888 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 116/248] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Mar 12 20:48:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:54.502678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab766bb1-f106-4e32-aaa4-0d48e3fdcf10 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:54.503449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ab766bb1-f106-4e32-aaa4-0d48e3fdcf10 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:54.514023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab766bb1-f106-4e32-aaa4-0d48e3fdcf10 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:54.514509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab766bb1-f106-4e32-aaa4-0d48e3fdcf10 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:54.515538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab766bb1-f106-4e32-aaa4-0d48e3fdcf10 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:54.515986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab766bb1-f106-4e32-aaa4-0d48e3fdcf10 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:54.768450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ab766bb1-f106-4e32-aaa4-0d48e3fdcf10 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:54.776370 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ab766bb1-f106-4e32-aaa4-0d48e3fdcf10 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.277112 Mar 12 20:48:54.777721 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 117/249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:54 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:54.958864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f46ee099-b936-44e4-ae6a-7e5bf23767bd tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1583638567", "id": 969674049, "os-flavor-access:is_public": "False"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:54.962933 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:54.962933 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:54.988015 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f46ee099-b936-44e4-ae6a-7e5bf23767bd tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.208898 Mar 12 20:48:54.988965 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 118/250] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:54 2022] POST /compute/v2.1/flavors => generated 436 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:54.994595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f34faec0-2f68-49c2-9e10-7a6043157bb7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:54.995429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f34faec0-2f68-49c2-9e10-7a6043157bb7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:55.002512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f34faec0-2f68-49c2-9e10-7a6043157bb7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:55.003972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f34faec0-2f68-49c2-9e10-7a6043157bb7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:55.004949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f34faec0-2f68-49c2-9e10-7a6043157bb7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:55.005581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f34faec0-2f68-49c2-9e10-7a6043157bb7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:55.339673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f34faec0-2f68-49c2-9e10-7a6043157bb7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:55.354319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f34faec0-2f68-49c2-9e10-7a6043157bb7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:55.355932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f34faec0-2f68-49c2-9e10-7a6043157bb7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:55.359031 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f34faec0-2f68-49c2-9e10-7a6043157bb7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1567 microversion: 2.25 time: 0.366984 Mar 12 20:48:55.371229 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 119/251] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:54 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1567 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:55.379377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-64043a53-1876-43b0-911c-ef73192b051d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:55.382126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-64043a53-1876-43b0-911c-ef73192b051d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:55.394399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64043a53-1876-43b0-911c-ef73192b051d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:55.395020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64043a53-1876-43b0-911c-ef73192b051d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:55.395975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64043a53-1876-43b0-911c-ef73192b051d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:55.396560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64043a53-1876-43b0-911c-ef73192b051d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:55.589178 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-57307e79-f062-41a9-95a1-9afd69a524e9 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4/action" status: 202 len: 0 microversion: 2.1 time: 2.428306 Mar 12 20:48:55.591163 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 133/252] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:48:53 2022] POST /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4/action => generated 0 bytes in 2431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:48:55.599236 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c4c83de2-77ae-43aa-9512-9ea0db1bc60f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2102242787"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:55.602222 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:55.602222 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:55.608272 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-c4c83de2-77ae-43aa-9512-9ea0db1bc60f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Generated uuid 8e317be6-42ed-412b-8d89-db8f2f440a06 for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:55.638222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-64043a53-1876-43b0-911c-ef73192b051d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:55.644865 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c4c83de2-77ae-43aa-9512-9ea0db1bc60f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.051168 Mar 12 20:48:55.646224 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 134/253] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:55 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:55.651935 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-64043a53-1876-43b0-911c-ef73192b051d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1389 microversion: 2.1 time: 0.279122 Mar 12 20:48:55.652638 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 120/254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:55 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1389 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:55.654320 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-dac04a04-e672-4cb8-a086-22d56d5af6c4 req-60c15192-a8c6-4bfd-9709-0240c88e5130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc87869-0e83-41a4-8949-ae7612a38be2", "name": "network-vif-plugged", "status": "completed", "tag": "a1cce536-fdef-4003-bb8c-2aa69b9cb257"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:55.666910 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-dac04a04-e672-4cb8-a086-22d56d5af6c4 req-60c15192-a8c6-4bfd-9709-0240c88e5130 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:55.667822 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-dac04a04-e672-4cb8-a086-22d56d5af6c4 req-60c15192-a8c6-4bfd-9709-0240c88e5130 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:55.671068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a525b354-d285-4f69-aa24-e2f024c58a36 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "895c6befcc9640a5a7bf5c7e5dcc4daa"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:55.672466 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:55.672466 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:55.681150 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-dac04a04-e672-4cb8-a086-22d56d5af6c4 req-60c15192-a8c6-4bfd-9709-0240c88e5130 service nova] Creating event network-vif-plugged:a1cce536-fdef-4003-bb8c-2aa69b9cb257 for instance 7cc87869-0e83-41a4-8949-ae7612a38be2 on nch1-master-1 Mar 12 20:48:55.686763 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-dac04a04-e672-4cb8-a086-22d56d5af6c4 req-60c15192-a8c6-4bfd-9709-0240c88e5130 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039048 Mar 12 20:48:55.687454 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 135/255] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:55.693758 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-67b0b45f-4eea-472d-bb7a-7f80ff4014cf tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:55.694497 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-67b0b45f-4eea-472d-bb7a-7f80ff4014cf tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:55.702657 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67b0b45f-4eea-472d-bb7a-7f80ff4014cf tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:55.703296 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67b0b45f-4eea-472d-bb7a-7f80ff4014cf tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:55.704263 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67b0b45f-4eea-472d-bb7a-7f80ff4014cf tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:55.704933 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67b0b45f-4eea-472d-bb7a-7f80ff4014cf tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:55.996767 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a525b354-d285-4f69-aa24-e2f024c58a36 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/969674049/action" status: 200 len: 96 microversion: 2.1 time: 0.343026 Mar 12 20:48:55.998528 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 121/256] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Mar 12 20:48:55 2022] POST /compute/v2.1/flavors/969674049/action => generated 96 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:56.006834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8176c6db-7037-4f96-b763-b86ce5e0dbd0 req-624a5202-34c5-479e-a7ce-38f1c540d889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb8e841-3f4c-4bb0-b6cd-6feab78be43c", "name": "network-vif-unplugged", "status": "completed", "tag": "31853141-b24e-4296-ac44-006fdaa259f8"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:56.016514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8176c6db-7037-4f96-b763-b86ce5e0dbd0 req-624a5202-34c5-479e-a7ce-38f1c540d889 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:56.017392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8176c6db-7037-4f96-b763-b86ce5e0dbd0 req-624a5202-34c5-479e-a7ce-38f1c540d889 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:56.029331 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8176c6db-7037-4f96-b763-b86ce5e0dbd0 req-624a5202-34c5-479e-a7ce-38f1c540d889 service nova] Creating event network-vif-unplugged:31853141-b24e-4296-ac44-006fdaa259f8 for instance 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c on nch2-master-1 Mar 12 20:48:56.034696 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8176c6db-7037-4f96-b763-b86ce5e0dbd0 req-624a5202-34c5-479e-a7ce-38f1c540d889 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034901 Mar 12 20:48:56.035786 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 122/257] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:56.042213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-55ebf4aa-5d5e-48f9-b119-98a5a32e8295 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:56.043245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-55ebf4aa-5d5e-48f9-b119-98a5a32e8295 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:56.049835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55ebf4aa-5d5e-48f9-b119-98a5a32e8295 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:56.050511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55ebf4aa-5d5e-48f9-b119-98a5a32e8295 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:56.051447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55ebf4aa-5d5e-48f9-b119-98a5a32e8295 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:56.052045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55ebf4aa-5d5e-48f9-b119-98a5a32e8295 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:56.078908 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-67b0b45f-4eea-472d-bb7a-7f80ff4014cf tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:56.091067 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-67b0b45f-4eea-472d-bb7a-7f80ff4014cf tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.401581 Mar 12 20:48:56.091733 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 136/258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:55 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:56.100209 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-945ea1a4-3521-4bef-997c-477a1a0fe801 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:56.103902 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:56.103902 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:56.114190 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-945ea1a4-3521-4bef-997c-477a1a0fe801 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:56.114894 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-945ea1a4-3521-4bef-997c-477a1a0fe801 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:56.232375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-55ebf4aa-5d5e-48f9-b119-98a5a32e8295 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:56.240997 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-55ebf4aa-5d5e-48f9-b119-98a5a32e8295 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.203868 Mar 12 20:48:56.242174 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 123/259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:56 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:56.243734 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-945ea1a4-3521-4bef-997c-477a1a0fe801 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.147559 Mar 12 20:48:56.249269 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 137/260] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:48:56 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:56.249401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21b2fc61-ba06-45db-bc11-a4e23adc1a23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:56.249401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-21b2fc61-ba06-45db-bc11-a4e23adc1a23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:56.254565 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-50a1cc67-16ba-4fd2-825a-2c6de0eac4d9 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "895c6befcc9640a5a7bf5c7e5dcc4daa"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:56.256432 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:56.256432 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:56.257902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21b2fc61-ba06-45db-bc11-a4e23adc1a23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:56.258384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21b2fc61-ba06-45db-bc11-a4e23adc1a23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:56.259157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21b2fc61-ba06-45db-bc11-a4e23adc1a23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:56.259605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21b2fc61-ba06-45db-bc11-a4e23adc1a23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:56.407808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21b2fc61-ba06-45db-bc11-a4e23adc1a23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:56.416689 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21b2fc61-ba06-45db-bc11-a4e23adc1a23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.173519 Mar 12 20:48:56.417276 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 124/261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:56 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:56.430533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fc067e06-f2d8-4a92-b35f-ea889da1584e tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:56.435063 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:56.435063 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:56.440504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc067e06-f2d8-4a92-b35f-ea889da1584e tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:56.440956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc067e06-f2d8-4a92-b35f-ea889da1584e tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:56.461009 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-50a1cc67-16ba-4fd2-825a-2c6de0eac4d9 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] HTTP exception thrown: Flavor access already exists for flavor 23 and project 895c6befcc9640a5a7bf5c7e5dcc4daa combination. Mar 12 20:48:56.461637 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-50a1cc67-16ba-4fd2-825a-2c6de0eac4d9 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Returning 409 to user: Flavor access already exists for flavor 23 and project 895c6befcc9640a5a7bf5c7e5dcc4daa combination. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:56.462513 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-50a1cc67-16ba-4fd2-825a-2c6de0eac4d9 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/969674049/action" status: 409 len: 152 microversion: 2.1 time: 0.217014 Mar 12 20:48:56.463837 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 138/262] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Mar 12 20:48:56 2022] POST /compute/v2.1/flavors/969674049/action => generated 152 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:48:56.464388 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-fc067e06-f2d8-4a92-b35f-ea889da1584e tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] HTTP exception thrown: Aggregate 11 already has host nch2-master-1. Mar 12 20:48:56.465038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fc067e06-f2d8-4a92-b35f-ea889da1584e tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Returning 409 to user: Aggregate 11 already has host nch2-master-1. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:56.466564 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fc067e06-f2d8-4a92-b35f-ea889da1584e tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.048279 Mar 12 20:48:56.467380 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 125/263] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:48:56 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Mar 12 20:48:56.472376 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-65416357-bd68-4f19-9051-76612e7830ae tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:56.473076 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-65416357-bd68-4f19-9051-76612e7830ae tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:56.473216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-44c7a469-42f2-43c1-945c-138da9563380 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "895c6befcc9640a5a7bf5c7e5dcc4daa"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:56.474506 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:56.474506 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:56.480635 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-65416357-bd68-4f19-9051-76612e7830ae tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:56.480889 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-65416357-bd68-4f19-9051-76612e7830ae tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:56.481827 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-65416357-bd68-4f19-9051-76612e7830ae tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:56.482421 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-65416357-bd68-4f19-9051-76612e7830ae tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:56.640683 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-65416357-bd68-4f19-9051-76612e7830ae tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:56.646898 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-65416357-bd68-4f19-9051-76612e7830ae tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:56.649103 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-65416357-bd68-4f19-9051-76612e7830ae tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:56.651768 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-65416357-bd68-4f19-9051-76612e7830ae tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1567 microversion: 2.25 time: 0.185331 Mar 12 20:48:56.667527 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 139/264] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:56 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:56.667527 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-aa46ad40-3f5a-4860-ae16-5c58f9652eb8 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:56.667527 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:56.667527 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:56.674907 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aa46ad40-3f5a-4860-ae16-5c58f9652eb8 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:56.675367 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aa46ad40-3f5a-4860-ae16-5c58f9652eb8 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:56.735328 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-44c7a469-42f2-43c1-945c-138da9563380 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/969674049/action" status: 200 len: 21 microversion: 2.1 time: 0.266593 Mar 12 20:48:56.735909 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 126/265] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Mar 12 20:48:56 2022] POST /compute/v2.1/flavors/969674049/action => generated 21 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:56.743203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bfa751f0-b56e-466d-88b6-9a602c007966 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:56.743821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bfa751f0-b56e-466d-88b6-9a602c007966 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:56.749590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfa751f0-b56e-466d-88b6-9a602c007966 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:56.750245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfa751f0-b56e-466d-88b6-9a602c007966 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:56.751189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfa751f0-b56e-466d-88b6-9a602c007966 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:56.751775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfa751f0-b56e-466d-88b6-9a602c007966 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:56.781401 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-aa46ad40-3f5a-4860-ae16-5c58f9652eb8 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.124755 Mar 12 20:48:56.786852 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 140/266] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:48:56 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:56.787179 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fbdbd9bc-3bf1-4955-9744-2719e80eae39 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:56.787950 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:56.787950 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:56.807189 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fbdbd9bc-3bf1-4955-9744-2719e80eae39 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/969674049" status: 202 len: 0 microversion: 2.1 time: 0.023716 Mar 12 20:48:56.807838 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 141/267] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:48:56 2022] DELETE /compute/v2.1/flavors/969674049 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:48:56.894868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bfa751f0-b56e-466d-88b6-9a602c007966 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:56.902449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bfa751f0-b56e-466d-88b6-9a602c007966 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1389 microversion: 2.1 time: 0.165451 Mar 12 20:48:56.903021 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 127/268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:56 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:56.907261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4ec8cb54-1d63-4944-b7ea-6508d8fa4ee9 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:56.908022 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:56.908022 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:56.924672 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2f7aa20d-9ea7-404a-8056-35131428a559 tempest-InstanceUsageAuditLogNegativeTestJSON-1027806865 tempest-InstanceUsageAuditLogNegativeTestJSON-1027806865-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:56.925540 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:56.925540 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:56.926806 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-2f7aa20d-9ea7-404a-8056-35131428a559 tempest-InstanceUsageAuditLogNegativeTestJSON-1027806865 tempest-InstanceUsageAuditLogNegativeTestJSON-1027806865-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Mar 12 20:48:56.927450 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2f7aa20d-9ea7-404a-8056-35131428a559 tempest-InstanceUsageAuditLogNegativeTestJSON-1027806865 tempest-InstanceUsageAuditLogNegativeTestJSON-1027806865-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:56.927740 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4ec8cb54-1d63-4944-b7ea-6508d8fa4ee9 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.023726 Mar 12 20:48:56.933192 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2f7aa20d-9ea7-404a-8056-35131428a559 tempest-InstanceUsageAuditLogNegativeTestJSON-1027806865 tempest-InstanceUsageAuditLogNegativeTestJSON-1027806865-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.119610 Mar 12 20:48:56.933348 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 128/269] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:48:56 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:56.933933 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 142/270] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Mar 12 20:48:56 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:48:56.937233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a2744b2d-6087-47f4-b672-a83946c637cd tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:56.938819 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-48470209-9888-47dc-81a8-e9f84bc47f3d tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-835569675"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:56.940646 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:56.940646 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:56.941510 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-48470209-9888-47dc-81a8-e9f84bc47f3d tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Generated uuid 1831e368-67ab-4038-becb-fbd6e48da347 for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:56.960737 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-48470209-9888-47dc-81a8-e9f84bc47f3d tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.025485 Mar 12 20:48:56.960961 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a2744b2d-6087-47f4-b672-a83946c637cd tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.030274 Mar 12 20:48:56.961815 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 143/271] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:56.965892 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 129/272] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:56 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:57.069122 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-730f2c1d-c159-46ad-917f-af9023575f0e tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343 tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.069968 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.069968 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.071034 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-730f2c1d-c159-46ad-917f-af9023575f0e tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343 tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '6ae93d6dfbbf49df9aa31d74bdde77c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0e868e011b4cd5b5925b1a551a320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.071670 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-730f2c1d-c159-46ad-917f-af9023575f0e tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343 tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:57.072461 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-730f2c1d-c159-46ad-917f-af9023575f0e tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343 tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.108980 Mar 12 20:48:57.073238 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 144/273] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Mar 12 20:48:56 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 111 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:57.073724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-45bbbdce-b055-4ea0-9f3f-513b1cde80f5 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.075085 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.075085 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:57.075979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-45bbbdce-b055-4ea0-9f3f-513b1cde80f5 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'db606c01a533480ba69dd5ba09f1c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d5fed36c2f4893ae1fda88d34bb4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.076926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-45bbbdce-b055-4ea0-9f3f-513b1cde80f5 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:57.077745 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-45bbbdce-b055-4ea0-9f3f-513b1cde80f5 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.107038 Mar 12 20:48:57.078309 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 130/274] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:48:56 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 108 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:57.079810 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-437dd20a-94b3-42fe-ab24-7392e8a2c6a8 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1261963736", "id": 1792253136, "os-flavor-access:is_public": "True"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.081278 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.081278 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.086044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4dfb084a-d07d-4d92-8f91-7c245682316f tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343 tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.086810 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.086810 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:57.087915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4dfb084a-d07d-4d92-8f91-7c245682316f tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343 tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '6ae93d6dfbbf49df9aa31d74bdde77c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0e868e011b4cd5b5925b1a551a320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.088621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4dfb084a-d07d-4d92-8f91-7c245682316f tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343 tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:57.089431 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4dfb084a-d07d-4d92-8f91-7c245682316f tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343 tempest-InstanceUsageAuditLogNegativeTestJSON-1023669343-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-03-12 20:48:57" status: 403 len: 128 microversion: 2.1 time: 0.007031 Mar 12 20:48:57.089969 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 131/275] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Mar 12 20:48:57 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-03-12%2020%3A48%3A57 => generated 128 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:57.094792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-29363880-e583-49b6-979b-43888171c8a1 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.095610 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.095610 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:57.108880 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-437dd20a-94b3-42fe-ab24-7392e8a2c6a8 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.034152 Mar 12 20:48:57.120538 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 145/276] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/flavors => generated 438 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:57.123385 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-29363880-e583-49b6-979b-43888171c8a1 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.032420 Mar 12 20:48:57.129043 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 132/277] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:48:57 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:57.129230 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4b62d11a-179f-4987-8317-474b6179e141 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.129230 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4b62d11a-179f-4987-8317-474b6179e141 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:57.129920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96bba059-5101-4fa3-8390-8da3117c1292 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.130767 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.130767 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:57.134308 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4b62d11a-179f-4987-8317-474b6179e141 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.134876 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4b62d11a-179f-4987-8317-474b6179e141 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.135663 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4b62d11a-179f-4987-8317-474b6179e141 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.136108 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4b62d11a-179f-4987-8317-474b6179e141 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.139275 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-96bba059-5101-4fa3-8390-8da3117c1292 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] HTTP exception thrown: Access list not available for public flavors. Mar 12 20:48:57.141014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96bba059-5101-4fa3-8390-8da3117c1292 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:57.141014 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96bba059-5101-4fa3-8390-8da3117c1292 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1792253136/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.015327 Mar 12 20:48:57.141554 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 133/278] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Mar 12 20:48:57 2022] GET /compute/v2.1/flavors/1792253136/os-flavor-access => generated 91 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:48:57.146263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f79bf5a9-a9d6-4712-86e7-f1daa5b33082 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-407245350"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.147621 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.147621 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:57.149054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.aggregate [None req-f79bf5a9-a9d6-4712-86e7-f1daa5b33082 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Generated uuid fd479a18-e2f3-45d9-9304-148af77bc681 for aggregate {{(pid=136302) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:57.171287 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f79bf5a9-a9d6-4712-86e7-f1daa5b33082 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.028480 Mar 12 20:48:57.173935 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 134/279] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:57.178908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-839186eb-2e18-45c6-a49f-abf62e05e820 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.179950 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.179950 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:57.198659 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-839186eb-2e18-45c6-a49f-abf62e05e820 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1792253136" status: 202 len: 0 microversion: 2.1 time: 0.023440 Mar 12 20:48:57.199707 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 135/280] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Mar 12 20:48:57 2022] DELETE /compute/v2.1/flavors/1792253136 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:48:57.204165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f71384b-3fd0-4fc5-a772-156ffceded0f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-827229858"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.205406 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.205406 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:57.214497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f71384b-3fd0-4fc5-a772-156ffceded0f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.214497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f71384b-3fd0-4fc5-a772-156ffceded0f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.221605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f71384b-3fd0-4fc5-a772-156ffceded0f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.222106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f71384b-3fd0-4fc5-a772-156ffceded0f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.230834 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-0f71384b-3fd0-4fc5-a772-156ffceded0f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-827229858 could not be found. Mar 12 20:48:57.231520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f71384b-3fd0-4fc5-a772-156ffceded0f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-827229858 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:57.232367 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f71384b-3fd0-4fc5-a772-156ffceded0f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.031848 Mar 12 20:48:57.233010 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 136/281] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:57.238091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37176246-f44c-4811-8ba4-2ad223509087 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.257791 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-37176246-f44c-4811-8ba4-2ad223509087 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.023219 Mar 12 20:48:57.258310 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 137/282] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:57 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:57.266285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b81f7dad-7654-4ea2-86cd-af384d38bd48 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.267148 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.267148 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:57.291660 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b81f7dad-7654-4ea2-86cd-af384d38bd48 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.028800 Mar 12 20:48:57.292343 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 138/283] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:48:57 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:57.300020 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4b62d11a-179f-4987-8317-474b6179e141 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.301156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2bbca054-2200-47d3-a42c-8249506e21fb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.301973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2bbca054-2200-47d3-a42c-8249506e21fb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:57.307900 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4b62d11a-179f-4987-8317-474b6179e141 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.186012 Mar 12 20:48:57.308067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2bbca054-2200-47d3-a42c-8249506e21fb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.308411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2bbca054-2200-47d3-a42c-8249506e21fb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.308787 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 146/284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:57 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:57.311159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2bbca054-2200-47d3-a42c-8249506e21fb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.311890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2bbca054-2200-47d3-a42c-8249506e21fb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.314446 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-093ccbef-aff2-4035-87ae-22bbbd3b3058 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-42946706", "id": 1244387672, "os-flavor-access:is_public": "False"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.316185 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.316185 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.332042 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-093ccbef-aff2-4035-87ae-22bbbd3b3058 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021988 Mar 12 20:48:57.332638 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 147/285] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:57.338177 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-380d244d-57ab-4bce-8924-9b6083f592c8 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.339619 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-380d244d-57ab-4bce-8924-9b6083f592c8 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:57.340601 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-380d244d-57ab-4bce-8924-9b6083f592c8 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.006886 Mar 12 20:48:57.341283 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 148/286] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:48:57.463263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2bbca054-2200-47d3-a42c-8249506e21fb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.471005 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2bbca054-2200-47d3-a42c-8249506e21fb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.175733 Mar 12 20:48:57.472197 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 139/287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:57 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:57.477464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e8f2f25d-e82c-40b4-bc99-4f01e37c60e3 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.478705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e8f2f25d-e82c-40b4-bc99-4f01e37c60e3 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:57.479667 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e8f2f25d-e82c-40b4-bc99-4f01e37c60e3 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.006563 Mar 12 20:48:57.485042 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 140/288] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:48:57.489871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6ece337-4912-443f-a7c3-56023d25b53d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.490493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d6ece337-4912-443f-a7c3-56023d25b53d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:57.498231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6ece337-4912-443f-a7c3-56023d25b53d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.498775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6ece337-4912-443f-a7c3-56023d25b53d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.499846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6ece337-4912-443f-a7c3-56023d25b53d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.500440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6ece337-4912-443f-a7c3-56023d25b53d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.541976 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ff94804e-c429-4082-b297-370fd62bb12d tempest-FlavorsAccessNegativeTestJSON-114382883 tempest-FlavorsAccessNegativeTestJSON-114382883-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "895c6befcc9640a5a7bf5c7e5dcc4daa"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.543131 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.543131 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.544019 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ff94804e-c429-4082-b297-370fd62bb12d tempest-FlavorsAccessNegativeTestJSON-114382883 tempest-FlavorsAccessNegativeTestJSON-114382883-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bb37e75e028f4feb96b21238d735d625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895c6befcc9640a5a7bf5c7e5dcc4daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.544820 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ff94804e-c429-4082-b297-370fd62bb12d tempest-FlavorsAccessNegativeTestJSON-114382883 tempest-FlavorsAccessNegativeTestJSON-114382883-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:57.547991 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ff94804e-c429-4082-b297-370fd62bb12d tempest-FlavorsAccessNegativeTestJSON-114382883 tempest-FlavorsAccessNegativeTestJSON-114382883-project] 10.222.0.30 "POST /compute/v2.1/flavors/1244387672/action" status: 403 len: 130 microversion: 2.1 time: 0.202778 Mar 12 20:48:57.548990 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 149/289] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/flavors/1244387672/action => generated 130 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:57.553563 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5779165b-167f-4711-a0b2-cfd05ea6f5e2 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-832276024"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.554925 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.554925 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.555915 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5779165b-167f-4711-a0b2-cfd05ea6f5e2 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'db606c01a533480ba69dd5ba09f1c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d5fed36c2f4893ae1fda88d34bb4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.556766 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5779165b-167f-4711-a0b2-cfd05ea6f5e2 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:57.557595 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5779165b-167f-4711-a0b2-cfd05ea6f5e2 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.007679 Mar 12 20:48:57.558165 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 150/290] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:57.566759 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-512db5ac-64cd-47da-bab8-cb93cfd0002d tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.567524 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.567524 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.588104 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-512db5ac-64cd-47da-bab8-cb93cfd0002d tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1244387672" status: 202 len: 0 microversion: 2.1 time: 0.024896 Mar 12 20:48:57.592221 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 151/291] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Mar 12 20:48:57 2022] DELETE /compute/v2.1/flavors/1244387672 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:48:57.594331 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-36ae1506-4622-47a2-9be9-f15537a0e6fb tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-887067155"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.596432 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-36ae1506-4622-47a2-9be9-f15537a0e6fb tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Generated uuid a316e516-18a9-40d4-ad65-58c01443cfc8 for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:57.617369 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-36ae1506-4622-47a2-9be9-f15537a0e6fb tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.026592 Mar 12 20:48:57.622921 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 152/292] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:57.622921 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-efa7e2ba-c504-4099-97f5-34200879d506 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.646880 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-efa7e2ba-c504-4099-97f5-34200879d506 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.027307 Mar 12 20:48:57.647561 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 153/293] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:57 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:57.652630 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-adee57c5-960d-494c-abf8-7c61431503e2 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-887067155"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.654188 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.654188 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.655070 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-adee57c5-960d-494c-abf8-7c61431503e2 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Generated uuid 44d3a94e-20d3-433a-bcda-fd9273723fda for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:57.665740 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-adee57c5-960d-494c-abf8-7c61431503e2 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-887067155 already exists. Mar 12 20:48:57.666366 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-adee57c5-960d-494c-abf8-7c61431503e2 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-887067155 already exists. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:57.667188 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-adee57c5-960d-494c-abf8-7c61431503e2 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.018218 Mar 12 20:48:57.667735 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 154/294] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 20 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:48:57.672894 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d459f689-3890-4b94-9a40-a601d9aa6c2a tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1345715323", "id": 269049605, "os-flavor-access:is_public": "False"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.674388 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.674388 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.682909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d6ece337-4912-443f-a7c3-56023d25b53d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.690715 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d6ece337-4912-443f-a7c3-56023d25b53d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.204379 Mar 12 20:48:57.691442 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 141/295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:57 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:57.693314 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d459f689-3890-4b94-9a40-a601d9aa6c2a tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.024560 Mar 12 20:48:57.694478 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 155/296] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/flavors => generated 436 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:57.699809 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-99ef50af-5710-48d3-860e-58f86e3d39f9 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.700804 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.700804 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.706106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abb19ae9-4a6e-4179-ba3e-d259c408a4ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.706777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-abb19ae9-4a6e-4179-ba3e-d259c408a4ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:57.713610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abb19ae9-4a6e-4179-ba3e-d259c408a4ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.714118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abb19ae9-4a6e-4179-ba3e-d259c408a4ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.714898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abb19ae9-4a6e-4179-ba3e-d259c408a4ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.715387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abb19ae9-4a6e-4179-ba3e-d259c408a4ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.723386 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-99ef50af-5710-48d3-860e-58f86e3d39f9 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.027126 Mar 12 20:48:57.724412 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 156/297] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:48:57 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:57.729355 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-95e4acdc-181e-4b66-823e-6e28b5e1de0a tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "895c6befcc9640a5a7bf5c7e5dcc4daa"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.730687 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.730687 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.881239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-abb19ae9-4a6e-4179-ba3e-d259c408a4ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.890903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-abb19ae9-4a6e-4179-ba3e-d259c408a4ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.893256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-abb19ae9-4a6e-4179-ba3e-d259c408a4ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.894495 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-abb19ae9-4a6e-4179-ba3e-d259c408a4ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1567 microversion: 2.25 time: 0.192508 Mar 12 20:48:57.895057 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 142/298] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:57 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:57.900014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-29a4f03b-4507-41c4-bec1-b474d3eefb96 req-4909622b-473c-40c4-9957-a6a7deef5c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88bacb8-65ca-46cd-abda-0bf2772c950e", "name": "network-vif-plugged", "status": "completed", "tag": "3403e4ee-cc92-406d-8b03-966986c25d77"}, {"server_uuid": "2eb40313-ddf5-44a6-8898-8c76ab6e1e29", "name": "network-vif-plugged", "status": "completed", "tag": "9350a43c-e942-483b-b81d-2affe8e464d3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.909051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-29a4f03b-4507-41c4-bec1-b474d3eefb96 req-4909622b-473c-40c4-9957-a6a7deef5c90 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.909791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-29a4f03b-4507-41c4-bec1-b474d3eefb96 req-4909622b-473c-40c4-9957-a6a7deef5c90 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.911186 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-95e4acdc-181e-4b66-823e-6e28b5e1de0a tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/269049605/action" status: 200 len: 96 microversion: 2.1 time: 0.185566 Mar 12 20:48:57.911785 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 157/299] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/flavors/269049605/action => generated 96 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:57.917018 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fedeaf2b-2841-49c7-b250-61baa9005a95 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-571722713"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.918388 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.918388 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.919262 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-fedeaf2b-2841-49c7-b250-61baa9005a95 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Generated uuid 9030e4dc-cf4c-4015-bc91-d2967840a87e for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:57.924843 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-29a4f03b-4507-41c4-bec1-b474d3eefb96 req-4909622b-473c-40c4-9957-a6a7deef5c90 service nova] Creating event network-vif-plugged:3403e4ee-cc92-406d-8b03-966986c25d77 for instance c88bacb8-65ca-46cd-abda-0bf2772c950e on nch1-master-1 Mar 12 20:48:57.925372 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-29a4f03b-4507-41c4-bec1-b474d3eefb96 req-4909622b-473c-40c4-9957-a6a7deef5c90 service nova] Creating event network-vif-plugged:9350a43c-e942-483b-b81d-2affe8e464d3 for instance 2eb40313-ddf5-44a6-8898-8c76ab6e1e29 on nch1-master-1 Mar 12 20:48:57.932380 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-29a4f03b-4507-41c4-bec1-b474d3eefb96 req-4909622b-473c-40c4-9957-a6a7deef5c90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036190 Mar 12 20:48:57.932949 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 143/300] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:57.939104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bfb76f3e-fcdf-4a5b-b999-62ba523ca338 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.939911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bfb76f3e-fcdf-4a5b-b999-62ba523ca338 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:57.943871 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fedeaf2b-2841-49c7-b250-61baa9005a95 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.031046 Mar 12 20:48:57.944892 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 158/301] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:57.950267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfb76f3e-fcdf-4a5b-b999-62ba523ca338 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.951063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfb76f3e-fcdf-4a5b-b999-62ba523ca338 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.955481 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-96f26431-197d-4dac-a394-d88ea80f60f3 tempest-FlavorsAccessNegativeTestJSON-114382883 tempest-FlavorsAccessNegativeTestJSON-114382883-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "895c6befcc9640a5a7bf5c7e5dcc4daa"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:57.956943 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.956943 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.958067 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-96f26431-197d-4dac-a394-d88ea80f60f3 tempest-FlavorsAccessNegativeTestJSON-114382883 tempest-FlavorsAccessNegativeTestJSON-114382883-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'bb37e75e028f4feb96b21238d735d625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895c6befcc9640a5a7bf5c7e5dcc4daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.958987 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-96f26431-197d-4dac-a394-d88ea80f60f3 tempest-FlavorsAccessNegativeTestJSON-114382883 tempest-FlavorsAccessNegativeTestJSON-114382883-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:57.959962 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-96f26431-197d-4dac-a394-d88ea80f60f3 tempest-FlavorsAccessNegativeTestJSON-114382883 tempest-FlavorsAccessNegativeTestJSON-114382883-project] 10.222.0.30 "POST /compute/v2.1/flavors/269049605/action" status: 403 len: 133 microversion: 2.1 time: 0.008561 Mar 12 20:48:57.961861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfb76f3e-fcdf-4a5b-b999-62ba523ca338 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:57.962044 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 159/302] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/flavors/269049605/action => generated 133 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:57.962949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfb76f3e-fcdf-4a5b-b999-62ba523ca338 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:57.969054 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a75fbf40-a73d-4d33-b8ee-ebfb59b2e269 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:57.969853 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:57.969853 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:57.971484 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a75fbf40-a73d-4d33-b8ee-ebfb59b2e269 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'db606c01a533480ba69dd5ba09f1c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d5fed36c2f4893ae1fda88d34bb4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:57.972238 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a75fbf40-a73d-4d33-b8ee-ebfb59b2e269 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:57.973045 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a75fbf40-a73d-4d33-b8ee-ebfb59b2e269 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.009959 Mar 12 20:48:57.978123 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 160/303] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:48:57 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:57.982821 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-70a9d5f3-9cee-430b-9b92-92423ebb3596 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "895c6befcc9640a5a7bf5c7e5dcc4daa"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:58.138456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bfb76f3e-fcdf-4a5b-b999-62ba523ca338 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:58.149690 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bfb76f3e-fcdf-4a5b-b999-62ba523ca338 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1389 microversion: 2.1 time: 0.215369 Mar 12 20:48:58.150647 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 144/304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:57 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1389 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:58.165196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-98fd26db-6f6d-4900-9ea8-59970bad751f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.166522 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.166522 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:58.190605 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-98fd26db-6f6d-4900-9ea8-59970bad751f tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.029382 Mar 12 20:48:58.192020 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 145/305] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:48:58 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:58.199767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8424e8fb-6cb8-40d4-bc30-1c4109421275 req-ab241e23-fcf2-4ece-85d6-b9e6b1395dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb8e841-3f4c-4bb0-b6cd-6feab78be43c", "tag": "31853141-b24e-4296-ac44-006fdaa259f8"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:58.214268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8424e8fb-6cb8-40d4-bc30-1c4109421275 req-ab241e23-fcf2-4ece-85d6-b9e6b1395dd7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:58.214923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8424e8fb-6cb8-40d4-bc30-1c4109421275 req-ab241e23-fcf2-4ece-85d6-b9e6b1395dd7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:58.226586 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8424e8fb-6cb8-40d4-bc30-1c4109421275 req-ab241e23-fcf2-4ece-85d6-b9e6b1395dd7 service nova] Creating event network-changed:31853141-b24e-4296-ac44-006fdaa259f8 for instance 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c on nch2-master-1 Mar 12 20:48:58.232030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8424e8fb-6cb8-40d4-bc30-1c4109421275 req-ab241e23-fcf2-4ece-85d6-b9e6b1395dd7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038458 Mar 12 20:48:58.232947 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 146/306] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:58.238734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c38d8bbf-726f-49c8-af07-da4c0914bb41 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.239752 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.239752 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:58.239977 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-70a9d5f3-9cee-430b-9b92-92423ebb3596 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/269049605/action" status: 200 len: 21 microversion: 2.1 time: 0.260584 Mar 12 20:48:58.240929 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 161/307] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Mar 12 20:48:57 2022] POST /compute/v2.1/flavors/269049605/action => generated 21 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:48:58.254479 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-da87a7f4-f6b1-4249-9479-c2b76183d42a tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.255084 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c38d8bbf-726f-49c8-af07-da4c0914bb41 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Mar 12 20:48:58.255261 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.255261 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:58.255866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c38d8bbf-726f-49c8-af07-da4c0914bb41 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:58.257262 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c38d8bbf-726f-49c8-af07-da4c0914bb41 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.022718 Mar 12 20:48:58.260294 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 147/308] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:48:58 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:48:58.267257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27b1fcca-e84a-410d-a5e7-acb658119a0d tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1136170931"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:58.268687 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.268687 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:58.269634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.aggregate [None req-27b1fcca-e84a-410d-a5e7-acb658119a0d tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Generated uuid 6fbca78f-8f90-4fe3-ad8a-74806eb35363 for aggregate {{(pid=136302) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:58.289122 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-da87a7f4-f6b1-4249-9479-c2b76183d42a tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/269049605" status: 202 len: 0 microversion: 2.1 time: 0.038555 Mar 12 20:48:58.289838 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 162/309] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:48:58 2022] DELETE /compute/v2.1/flavors/269049605 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:48:58.294258 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27b1fcca-e84a-410d-a5e7-acb658119a0d tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.030444 Mar 12 20:48:58.295158 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 148/310] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:58.300732 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-39fe4b1a-3f00-438a-94fb-8ebd247f06f4 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.307710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80af0f82-293f-4ab4-8340-ecb1fbd203b3 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.309188 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.309188 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:58.310923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80af0f82-293f-4ab4-8340-ecb1fbd203b3 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'db606c01a533480ba69dd5ba09f1c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d5fed36c2f4893ae1fda88d34bb4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:58.311905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80af0f82-293f-4ab4-8340-ecb1fbd203b3 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:58.313020 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80af0f82-293f-4ab4-8340-ecb1fbd203b3 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.010533 Mar 12 20:48:58.313732 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 149/311] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:58 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:58.323970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-18d41224-27cb-43e0-9006-3736ebe94f49 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.325180 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-39fe4b1a-3f00-438a-94fb-8ebd247f06f4 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.030216 Mar 12 20:48:58.326075 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.326075 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:58.335882 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 163/312] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:58 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:58.348068 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d1489645-462e-4129-b9c1-38325c3ec9af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.348900 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d1489645-462e-4129-b9c1-38325c3ec9af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:58.356360 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d1489645-462e-4129-b9c1-38325c3ec9af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:58.357489 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d1489645-462e-4129-b9c1-38325c3ec9af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:58.358822 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d1489645-462e-4129-b9c1-38325c3ec9af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:58.359503 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d1489645-462e-4129-b9c1-38325c3ec9af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:58.363275 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-18d41224-27cb-43e0-9006-3736ebe94f49 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.044156 Mar 12 20:48:58.364557 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 150/313] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:48:58 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:58.371578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eae76977-9aca-4ed9-8f79-e2498f10d081 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1213567307", "id": 575123270, "os-flavor-access:is_public": "False"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:58.373818 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.373818 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:58.396510 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eae76977-9aca-4ed9-8f79-e2498f10d081 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.030248 Mar 12 20:48:58.397180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 151/314] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:48:58 2022] POST /compute/v2.1/flavors => generated 436 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:58.403969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa179139-b4ef-4bd5-8dc3-e591c4d24fc3 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.405030 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.405030 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:58.415299 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-aa179139-b4ef-4bd5-8dc3-e591c4d24fc3 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Mar 12 20:48:58.416174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa179139-b4ef-4bd5-8dc3-e591c4d24fc3 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:58.417470 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aa179139-b4ef-4bd5-8dc3-e591c4d24fc3 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.018665 Mar 12 20:48:58.422638 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 152/315] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:48:58 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:48:58.426666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f6946f19-e8fe-4832-8b7f-b9ea49597d73 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "554b811e4fe24d85a083e43ac459accc"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:58.427974 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.427974 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:58.603955 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f6946f19-e8fe-4832-8b7f-b9ea49597d73 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] HTTP exception thrown: Flavor access not found for 27 / 554b811e4fe24d85a083e43ac459accc combination. Mar 12 20:48:58.604577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f6946f19-e8fe-4832-8b7f-b9ea49597d73 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Returning 404 to user: Flavor access not found for 27 / 554b811e4fe24d85a083e43ac459accc combination. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:58.605437 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f6946f19-e8fe-4832-8b7f-b9ea49597d73 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/575123270/action" status: 404 len: 124 microversion: 2.1 time: 0.185122 Mar 12 20:48:58.610432 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 153/316] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Mar 12 20:48:58 2022] POST /compute/v2.1/flavors/575123270/action => generated 124 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:58.616954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-174b5a7b-1650-4fc2-86a8-6175677c1f64 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.617729 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.617729 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:58.618886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-174b5a7b-1650-4fc2-86a8-6175677c1f64 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'db606c01a533480ba69dd5ba09f1c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d5fed36c2f4893ae1fda88d34bb4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:58.619527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-174b5a7b-1650-4fc2-86a8-6175677c1f64 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:58.620530 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-174b5a7b-1650-4fc2-86a8-6175677c1f64 tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.007987 Mar 12 20:48:58.621496 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 154/317] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 20:48:58 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:58.625807 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d1489645-462e-4129-b9c1-38325c3ec9af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:58.626481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c73fac71-0259-4b17-988e-c6e2c3dc640f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.627106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c73fac71-0259-4b17-988e-c6e2c3dc640f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:58.638587 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d1489645-462e-4129-b9c1-38325c3ec9af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.301378 Mar 12 20:48:58.639260 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 164/318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:58 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:58.645743 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3936273f-c7ca-4f08-af20-0604d37b6961 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.646508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c73fac71-0259-4b17-988e-c6e2c3dc640f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:58.646970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c73fac71-0259-4b17-988e-c6e2c3dc640f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:58.648541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c73fac71-0259-4b17-988e-c6e2c3dc640f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:58.648674 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.648674 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:58.651538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c73fac71-0259-4b17-988e-c6e2c3dc640f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:58.674905 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3936273f-c7ca-4f08-af20-0604d37b6961 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/575123270" status: 202 len: 0 microversion: 2.1 time: 0.034332 Mar 12 20:48:58.679568 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 165/319] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:48:58 2022] DELETE /compute/v2.1/flavors/575123270 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:48:58.692115 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-57f3a946-ccbb-4088-ad2e-5632d83443f2 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1346303260"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:58.693823 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.693823 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:58.695452 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.aggregate [None req-57f3a946-ccbb-4088-ad2e-5632d83443f2 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Generated uuid 6f170322-da23-461b-aea5-3c232163fdd6 for aggregate {{(pid=136303) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:58.725932 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-57f3a946-ccbb-4088-ad2e-5632d83443f2 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039224 Mar 12 20:48:58.726817 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 166/320] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:58.735301 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c06b8118-aa2d-4ddf-8c32-41549b86ff65 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.778751 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c06b8118-aa2d-4ddf-8c32-41549b86ff65 tempest-FlavorsAccessNegativeTestJSON-1244672634 tempest-FlavorsAccessNegativeTestJSON-1244672634-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.048554 Mar 12 20:48:58.779420 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 167/321] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:48:58 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:58.787149 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d17d4241-9368-4e56-a4d6-d69b9a194c94 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:58.787988 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d17d4241-9368-4e56-a4d6-d69b9a194c94 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:58.816151 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d17d4241-9368-4e56-a4d6-d69b9a194c94 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:58.816830 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d17d4241-9368-4e56-a4d6-d69b9a194c94 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:58.817961 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d17d4241-9368-4e56-a4d6-d69b9a194c94 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:58.818570 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d17d4241-9368-4e56-a4d6-d69b9a194c94 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:58.911069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c73fac71-0259-4b17-988e-c6e2c3dc640f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:58.921175 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c73fac71-0259-4b17-988e-c6e2c3dc640f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.297006 Mar 12 20:48:58.922472 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 155/322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:58 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:58.931375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52833462-4eec-44ec-9b9e-ed1b50c4d56a tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:58.933574 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:58.933574 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:58.944474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52833462-4eec-44ec-9b9e-ed1b50c4d56a tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:58.946291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52833462-4eec-44ec-9b9e-ed1b50c4d56a tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.091015 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d17d4241-9368-4e56-a4d6-d69b9a194c94 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:59.092227 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-52833462-4eec-44ec-9b9e-ed1b50c4d56a tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.168404 Mar 12 20:48:59.098662 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 156/323] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:48:58 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:59.105133 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d17d4241-9368-4e56-a4d6-d69b9a194c94 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.323108 Mar 12 20:48:59.105278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23c5b2ac-bbdd-4975-9906-f9ed5cd1e498 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:59.105904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-23c5b2ac-bbdd-4975-9906-f9ed5cd1e498 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:59.115908 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 168/324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:58 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:59.117907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23c5b2ac-bbdd-4975-9906-f9ed5cd1e498 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.118284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23c5b2ac-bbdd-4975-9906-f9ed5cd1e498 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.119744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23c5b2ac-bbdd-4975-9906-f9ed5cd1e498 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.120356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23c5b2ac-bbdd-4975-9906-f9ed5cd1e498 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.122330 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d424c7c7-23fc-4d52-b28b-6b31e07c976d tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:59.123663 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:59.123663 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:48:59.124972 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d424c7c7-23fc-4d52-b28b-6b31e07c976d tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'db606c01a533480ba69dd5ba09f1c2ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d5fed36c2f4893ae1fda88d34bb4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:59.125864 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d424c7c7-23fc-4d52-b28b-6b31e07c976d tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:59.126909 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d424c7c7-23fc-4d52-b28b-6b31e07c976d tempest-AggregatesAdminNegativeTestJSON-392893458 tempest-AggregatesAdminNegativeTestJSON-392893458-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.009162 Mar 12 20:48:59.127967 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 169/325] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:48:59 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:48:59.135444 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1bbbabd5-be35-4158-bbcd-ab10e4d86951 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:59.149961 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1bbbabd5-be35-4158-bbcd-ab10e4d86951 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.150809 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1bbbabd5-be35-4158-bbcd-ab10e4d86951 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.285875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-23c5b2ac-bbdd-4975-9906-f9ed5cd1e498 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:59.292113 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1bbbabd5-be35-4158-bbcd-ab10e4d86951 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.159960 Mar 12 20:48:59.293754 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 170/326] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:48:59 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:48:59.295495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-23c5b2ac-bbdd-4975-9906-f9ed5cd1e498 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:59.297222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-23c5b2ac-bbdd-4975-9906-f9ed5cd1e498 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:59.298476 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-23c5b2ac-bbdd-4975-9906-f9ed5cd1e498 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1567 microversion: 2.25 time: 0.198825 Mar 12 20:48:59.299104 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 157/327] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:48:59 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:48:59.303283 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-158e0ee9-3a4d-4982-8871-e959b1fad27d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:59.304747 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-158e0ee9-3a4d-4982-8871-e959b1fad27d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:59.309454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8267327a-aeae-479f-aba0-38c52e197537 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:59.310273 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:59.310273 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:59.316213 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-158e0ee9-3a4d-4982-8871-e959b1fad27d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.317041 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-158e0ee9-3a4d-4982-8871-e959b1fad27d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.318167 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-158e0ee9-3a4d-4982-8871-e959b1fad27d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.318833 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-158e0ee9-3a4d-4982-8871-e959b1fad27d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.335372 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8267327a-aeae-479f-aba0-38c52e197537 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.035229 Mar 12 20:48:59.337567 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 158/328] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:48:59 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:59.348311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d2506794-907c-46f7-bf9e-345a1341b5bf tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-123375718"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:59.350280 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:59.350280 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:59.353019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.aggregate [None req-d2506794-907c-46f7-bf9e-345a1341b5bf tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Generated uuid 16ba9c19-49fd-4e4b-b50b-6def47c16152 for aggregate {{(pid=136302) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 20:48:59.380863 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d2506794-907c-46f7-bf9e-345a1341b5bf tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037937 Mar 12 20:48:59.382384 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 159/329] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 20:48:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:59.393439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec11a09c-19fe-429c-b3e8-0576aa76dfd0 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:48:59.394870 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:59.394870 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:59.403873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec11a09c-19fe-429c-b3e8-0576aa76dfd0 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.404412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec11a09c-19fe-429c-b3e8-0576aa76dfd0 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.411151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec11a09c-19fe-429c-b3e8-0576aa76dfd0 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.411701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec11a09c-19fe-429c-b3e8-0576aa76dfd0 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.424124 ncdv-master-1 devstack@n-api.service[136302]: ERROR nova.api.openstack.compute.aggregates [None req-ec11a09c-19fe-429c-b3e8-0576aa76dfd0 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Mar 12 20:48:59.424681 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ec11a09c-19fe-429c-b3e8-0576aa76dfd0 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Mar 12 20:48:59.425284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec11a09c-19fe-429c-b3e8-0576aa76dfd0 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:48:59.426147 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec11a09c-19fe-429c-b3e8-0576aa76dfd0 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.037991 Mar 12 20:48:59.427155 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 160/330] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 20:48:59 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:48:59.440099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb3e54bd-9f76-4ace-aab0-7dd82ad92064 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:59.441715 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:48:59.441715 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:48:59.469035 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb3e54bd-9f76-4ace-aab0-7dd82ad92064 tempest-AggregatesAdminNegativeTestJSON-1276088865 tempest-AggregatesAdminNegativeTestJSON-1276088865-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.037427 Mar 12 20:48:59.470016 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 161/331] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:48:59 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 12 20:48:59.496438 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-158e0ee9-3a4d-4982-8871-e959b1fad27d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:59.507440 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-158e0ee9-3a4d-4982-8871-e959b1fad27d tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1587 microversion: 2.1 time: 0.212170 Mar 12 20:48:59.508255 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 171/332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:59 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1587 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:48:59.526039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f73624c5-607e-44ec-9895-94ef732cd6bd tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:59.526766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f73624c5-607e-44ec-9895-94ef732cd6bd tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:59.533280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f73624c5-607e-44ec-9895-94ef732cd6bd tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.534036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f73624c5-607e-44ec-9895-94ef732cd6bd tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.535004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f73624c5-607e-44ec-9895-94ef732cd6bd tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.535719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f73624c5-607e-44ec-9895-94ef732cd6bd tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.657629 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8ddf638e-72f6-44d3-8b3e-8e963945f2cd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:59.658351 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8ddf638e-72f6-44d3-8b3e-8e963945f2cd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:59.666584 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8ddf638e-72f6-44d3-8b3e-8e963945f2cd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.668378 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8ddf638e-72f6-44d3-8b3e-8e963945f2cd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.670385 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8ddf638e-72f6-44d3-8b3e-8e963945f2cd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.672130 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8ddf638e-72f6-44d3-8b3e-8e963945f2cd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.695063 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f73624c5-607e-44ec-9895-94ef732cd6bd tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174577 Mar 12 20:48:59.696333 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 162/333] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 20:48:59 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:48:59.919785 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8ddf638e-72f6-44d3-8b3e-8e963945f2cd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:48:59.928232 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8ddf638e-72f6-44d3-8b3e-8e963945f2cd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.275936 Mar 12 20:48:59.929068 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 172/334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:59 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:48:59.946695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7a2ab424-b029-455e-80f6-381e2e778519 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:48:59.947332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7a2ab424-b029-455e-80f6-381e2e778519 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:48:59.954283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a2ab424-b029-455e-80f6-381e2e778519 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.954964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a2ab424-b029-455e-80f6-381e2e778519 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:48:59.956157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a2ab424-b029-455e-80f6-381e2e778519 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:48:59.956864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a2ab424-b029-455e-80f6-381e2e778519 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:00.123607 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a9f980bd-5764-4d00-a695-6ae3b39cf8c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:00.124826 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a9f980bd-5764-4d00-a695-6ae3b39cf8c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:00.132998 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a9f980bd-5764-4d00-a695-6ae3b39cf8c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:00.133798 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a9f980bd-5764-4d00-a695-6ae3b39cf8c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:00.134754 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a9f980bd-5764-4d00-a695-6ae3b39cf8c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:00.135287 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a9f980bd-5764-4d00-a695-6ae3b39cf8c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:00.306623 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a9f980bd-5764-4d00-a695-6ae3b39cf8c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:00.316356 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a9f980bd-5764-4d00-a695-6ae3b39cf8c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.196058 Mar 12 20:49:00.318965 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 173/335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:00 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:00.337078 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-adb1d078-5b6c-4f79-a096-e7d5ce1ad2db tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:00.337705 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-adb1d078-5b6c-4f79-a096-e7d5ce1ad2db tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:00.347540 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-adb1d078-5b6c-4f79-a096-e7d5ce1ad2db tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:00.348819 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-adb1d078-5b6c-4f79-a096-e7d5ce1ad2db tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:00.349852 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-adb1d078-5b6c-4f79-a096-e7d5ce1ad2db tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:00.350457 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-adb1d078-5b6c-4f79-a096-e7d5ce1ad2db tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:00.431715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7a2ab424-b029-455e-80f6-381e2e778519 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:00.439454 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7a2ab424-b029-455e-80f6-381e2e778519 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.498327 Mar 12 20:49:00.440037 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 163/336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:48:59 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:00.592556 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-adb1d078-5b6c-4f79-a096-e7d5ce1ad2db tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:00.601477 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-adb1d078-5b6c-4f79-a096-e7d5ce1ad2db tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:00.602668 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-adb1d078-5b6c-4f79-a096-e7d5ce1ad2db tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:00.604288 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-adb1d078-5b6c-4f79-a096-e7d5ce1ad2db tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1567 microversion: 2.25 time: 0.282297 Mar 12 20:49:00.614594 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 174/337] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:00 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:00.947462 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-12c5a6e5-392a-4a80-ac3c-de06d442c42b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:00.949171 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-12c5a6e5-392a-4a80-ac3c-de06d442c42b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:00.958995 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-12c5a6e5-392a-4a80-ac3c-de06d442c42b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:00.960040 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-12c5a6e5-392a-4a80-ac3c-de06d442c42b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:00.961946 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-12c5a6e5-392a-4a80-ac3c-de06d442c42b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:00.962662 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-12c5a6e5-392a-4a80-ac3c-de06d442c42b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:01.155487 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-12c5a6e5-392a-4a80-ac3c-de06d442c42b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:01.167975 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-12c5a6e5-392a-4a80-ac3c-de06d442c42b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.226790 Mar 12 20:49:01.168751 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 175/338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:00 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:01.265893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-05650bfc-aa54-4077-bea2-2e622d03ac3d tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Action: 'update', calling method: .version_select at 0x7f6e373b2790>, body: {"quota_set": {"ram": "5120"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:01.336394 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-bb0f47b9-c3f0-4a34-a139-e861d53a9c3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:01.337020 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-bb0f47b9-c3f0-4a34-a139-e861d53a9c3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:01.345940 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bb0f47b9-c3f0-4a34-a139-e861d53a9c3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:01.346691 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bb0f47b9-c3f0-4a34-a139-e861d53a9c3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:01.349303 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bb0f47b9-c3f0-4a34-a139-e861d53a9c3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:01.351458 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bb0f47b9-c3f0-4a34-a139-e861d53a9c3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:01.618058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05650bfc-aa54-4077-bea2-2e622d03ac3d tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:01.620254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05650bfc-aa54-4077-bea2-2e622d03ac3d tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:01.622361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05650bfc-aa54-4077-bea2-2e622d03ac3d tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:01.623526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05650bfc-aa54-4077-bea2-2e622d03ac3d tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:01.654571 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-bb0f47b9-c3f0-4a34-a139-e861d53a9c3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:01.662599 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-bb0f47b9-c3f0-4a34-a139-e861d53a9c3e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.331196 Mar 12 20:49:01.666687 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 176/339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:01 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:01.676578 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5eda39ed-f88e-41e2-a682-f843fe04daf2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:01.677760 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5eda39ed-f88e-41e2-a682-f843fe04daf2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:01.687990 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5eda39ed-f88e-41e2-a682-f843fe04daf2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:01.687990 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5eda39ed-f88e-41e2-a682-f843fe04daf2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:01.688820 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5eda39ed-f88e-41e2-a682-f843fe04daf2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:01.689542 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5eda39ed-f88e-41e2-a682-f843fe04daf2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:01.737973 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-05650bfc-aa54-4077-bea2-2e622d03ac3d tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/db27b14b8a3d4b48a703259e51c27702" status: 200 len: 240 microversion: 2.36 time: 0.807657 Mar 12 20:49:01.739514 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 164/340] 10.222.0.30 () {62 vars in 1302 bytes} [Sat Mar 12 20:49:00 2022] PUT /compute/v2.1/os-quota-sets/db27b14b8a3d4b48a703259e51c27702 => generated 240 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:49:01.755299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e0b63305-ceaf-41b3-aba8-77d47469ec65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:01.756294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e0b63305-ceaf-41b3-aba8-77d47469ec65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:01.764654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0b63305-ceaf-41b3-aba8-77d47469ec65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:01.765340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0b63305-ceaf-41b3-aba8-77d47469ec65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:01.766491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0b63305-ceaf-41b3-aba8-77d47469ec65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:01.767305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0b63305-ceaf-41b3-aba8-77d47469ec65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:01.943306 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5eda39ed-f88e-41e2-a682-f843fe04daf2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:01.961502 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5eda39ed-f88e-41e2-a682-f843fe04daf2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.293685 Mar 12 20:49:01.965574 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 177/341] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:01 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:01.979367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e0b63305-ceaf-41b3-aba8-77d47469ec65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:01.979860 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-bcce29e3-6725-46d3-bab8-dac4d8c600af tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:01.981856 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-bcce29e3-6725-46d3-bab8-dac4d8c600af tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:01.992369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e0b63305-ceaf-41b3-aba8-77d47469ec65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:01.995424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e0b63305-ceaf-41b3-aba8-77d47469ec65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:01.997044 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e0b63305-ceaf-41b3-aba8-77d47469ec65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1567 microversion: 2.25 time: 0.250206 Mar 12 20:49:01.998143 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 165/342] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:01 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:02.003082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fa7e641b-c857-4b4b-9041-8815654045d0 req-25bbd6dc-c767-40b0-9bd0-4dfeed023ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc87869-0e83-41a4-8949-ae7612a38be2", "tag": "a1cce536-fdef-4003-bb8c-2aa69b9cb257"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:02.010587 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bcce29e3-6725-46d3-bab8-dac4d8c600af tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:02.011121 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bcce29e3-6725-46d3-bab8-dac4d8c600af tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:02.011988 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bcce29e3-6725-46d3-bab8-dac4d8c600af tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:02.012499 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bcce29e3-6725-46d3-bab8-dac4d8c600af tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:02.015482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fa7e641b-c857-4b4b-9041-8815654045d0 req-25bbd6dc-c767-40b0-9bd0-4dfeed023ef2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:02.016139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fa7e641b-c857-4b4b-9041-8815654045d0 req-25bbd6dc-c767-40b0-9bd0-4dfeed023ef2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:02.031050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fa7e641b-c857-4b4b-9041-8815654045d0 req-25bbd6dc-c767-40b0-9bd0-4dfeed023ef2 service nova] Creating event network-changed:a1cce536-fdef-4003-bb8c-2aa69b9cb257 for instance 7cc87869-0e83-41a4-8949-ae7612a38be2 on nch1-master-1 Mar 12 20:49:02.036697 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fa7e641b-c857-4b4b-9041-8815654045d0 req-25bbd6dc-c767-40b0-9bd0-4dfeed023ef2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037032 Mar 12 20:49:02.037728 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 166/343] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:02.062591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd63031d-ae07-49ff-81da-5dad74122257 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Calling method '.version_select at 0x7f6e37487f70>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:02.335120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd63031d-ae07-49ff-81da-5dad74122257 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:02.335805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd63031d-ae07-49ff-81da-5dad74122257 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:02.337493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd63031d-ae07-49ff-81da-5dad74122257 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:02.338191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd63031d-ae07-49ff-81da-5dad74122257 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:02.354039 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-bcce29e3-6725-46d3-bab8-dac4d8c600af tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:02.361671 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd63031d-ae07-49ff-81da-5dad74122257 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/db27b14b8a3d4b48a703259e51c27702/detail" status: 200 len: 672 microversion: 2.36 time: 0.317132 Mar 12 20:49:02.362854 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 167/344] 10.222.0.30 () {60 vars in 1303 bytes} [Sat Mar 12 20:49:02 2022] GET /compute/v2.1/os-quota-sets/db27b14b8a3d4b48a703259e51c27702/detail => generated 672 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:49:02.368952 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-bcce29e3-6725-46d3-bab8-dac4d8c600af tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 200 len: 1587 microversion: 2.1 time: 0.402072 Mar 12 20:49:02.375777 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 178/345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:01 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 1587 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:02.378730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25143cd8-b61e-41e9-b55f-e501b0cce8cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:02.379699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-25143cd8-b61e-41e9-b55f-e501b0cce8cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:02.392179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25143cd8-b61e-41e9-b55f-e501b0cce8cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:02.392645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25143cd8-b61e-41e9-b55f-e501b0cce8cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:02.393450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25143cd8-b61e-41e9-b55f-e501b0cce8cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:02.394541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25143cd8-b61e-41e9-b55f-e501b0cce8cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:02.652532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-25143cd8-b61e-41e9-b55f-e501b0cce8cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:02.667640 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-25143cd8-b61e-41e9-b55f-e501b0cce8cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.302439 Mar 12 20:49:02.669167 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 168/346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:02 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:02.685061 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c86b1d70-af41-4c93-9625-89746f081258 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:02.686060 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c86b1d70-af41-4c93-9625-89746f081258 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:02.692195 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c86b1d70-af41-4c93-9625-89746f081258 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:02.692954 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c86b1d70-af41-4c93-9625-89746f081258 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:02.694006 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c86b1d70-af41-4c93-9625-89746f081258 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:02.694701 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c86b1d70-af41-4c93-9625-89746f081258 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:02.950526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e003e3b5-2954-4700-8920-a43a59e0f372 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Action: 'update', calling method: .version_select at 0x7f6e37378dc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:03.299621 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c86b1d70-af41-4c93-9625-89746f081258 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:03.308356 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c86b1d70-af41-4c93-9625-89746f081258 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.628006 Mar 12 20:49:03.312833 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 179/347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:02 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:03.318520 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-56151652-1055-498c-8de6-96b9b3729f3b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:03.319139 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-56151652-1055-498c-8de6-96b9b3729f3b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:03.336631 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-56151652-1055-498c-8de6-96b9b3729f3b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:03.337091 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-56151652-1055-498c-8de6-96b9b3729f3b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:03.337929 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-56151652-1055-498c-8de6-96b9b3729f3b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:03.338354 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-56151652-1055-498c-8de6-96b9b3729f3b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:03.369483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e003e3b5-2954-4700-8920-a43a59e0f372 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:03.370289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e003e3b5-2954-4700-8920-a43a59e0f372 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:03.371406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e003e3b5-2954-4700-8920-a43a59e0f372 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:03.372054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e003e3b5-2954-4700-8920-a43a59e0f372 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:03.464809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e003e3b5-2954-4700-8920-a43a59e0f372 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:03.465264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e003e3b5-2954-4700-8920-a43a59e0f372 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:03.466107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e003e3b5-2954-4700-8920-a43a59e0f372 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:03.466729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e003e3b5-2954-4700-8920-a43a59e0f372 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:03.553147 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e003e3b5-2954-4700-8920-a43a59e0f372 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/db27b14b8a3d4b48a703259e51c27702?user_id=b04ffe071590467f9bc9dab3ee5f212f" status: 200 len: 240 microversion: 2.36 time: 0.606680 Mar 12 20:49:03.554419 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 169/348] 10.222.0.30 () {62 vars in 1383 bytes} [Sat Mar 12 20:49:02 2022] PUT /compute/v2.1/os-quota-sets/db27b14b8a3d4b48a703259e51c27702?user_id=b04ffe071590467f9bc9dab3ee5f212f => generated 240 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 20:49:03.562113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c95b89c-c5a1-40ad-a312-7ba2988d289c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:03.562946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c95b89c-c5a1-40ad-a312-7ba2988d289c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:03.570064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c95b89c-c5a1-40ad-a312-7ba2988d289c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:03.570643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c95b89c-c5a1-40ad-a312-7ba2988d289c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:03.572850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c95b89c-c5a1-40ad-a312-7ba2988d289c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:03.573354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c95b89c-c5a1-40ad-a312-7ba2988d289c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:03.793152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c95b89c-c5a1-40ad-a312-7ba2988d289c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:03.804777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c95b89c-c5a1-40ad-a312-7ba2988d289c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:03.806918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c95b89c-c5a1-40ad-a312-7ba2988d289c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:03.808344 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c95b89c-c5a1-40ad-a312-7ba2988d289c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1567 microversion: 2.25 time: 0.252972 Mar 12 20:49:03.809454 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 170/349] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:03 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:03.814266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7830e3d5-9ea3-4def-a4f8-b75494894744 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] Calling method '.version_select at 0x7f6e3731a700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:03.835800 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-56151652-1055-498c-8de6-96b9b3729f3b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:03.845800 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-56151652-1055-498c-8de6-96b9b3729f3b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.531301 Mar 12 20:49:03.846468 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 180/350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:03 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:03.854507 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-6fa72d30-182a-4d92-a157-45442f38b034 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:03.855758 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-6fa72d30-182a-4d92-a157-45442f38b034 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:03.869641 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6fa72d30-182a-4d92-a157-45442f38b034 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:03.870335 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6fa72d30-182a-4d92-a157-45442f38b034 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:03.871126 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6fa72d30-182a-4d92-a157-45442f38b034 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:03.871716 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6fa72d30-182a-4d92-a157-45442f38b034 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.144383 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-6fa72d30-182a-4d92-a157-45442f38b034 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:04.156995 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-6fa72d30-182a-4d92-a157-45442f38b034 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1318 microversion: 2.1 time: 0.308981 Mar 12 20:49:04.159240 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 181/351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:03 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:04.219220 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7830e3d5-9ea3-4def-a4f8-b75494894744 tempest-QuotasAdminTestV236-508747835 tempest-QuotasAdminTestV236-508747835-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/db27b14b8a3d4b48a703259e51c27702?user_id=b04ffe071590467f9bc9dab3ee5f212f" status: 200 len: 282 microversion: 2.36 time: 0.408237 Mar 12 20:49:04.230856 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 171/352] 10.222.0.30 () {60 vars in 1363 bytes} [Sat Mar 12 20:49:03 2022] GET /compute/v2.1/os-quota-sets/db27b14b8a3d4b48a703259e51c27702?user_id=b04ffe071590467f9bc9dab3ee5f212f => generated 282 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:49:04.341055 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-abd98597-727f-4d71-91ef-bd990a588521 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:04.343393 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-abd98597-727f-4d71-91ef-bd990a588521 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:04.349307 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-abd98597-727f-4d71-91ef-bd990a588521 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.349885 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-abd98597-727f-4d71-91ef-bd990a588521 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.351655 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-abd98597-727f-4d71-91ef-bd990a588521 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.352700 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-abd98597-727f-4d71-91ef-bd990a588521 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.613366 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-abd98597-727f-4d71-91ef-bd990a588521 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:04.620590 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-abd98597-727f-4d71-91ef-bd990a588521 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.294724 Mar 12 20:49:04.621159 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 182/353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:04 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:04.640353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-77311d37-582d-4a66-801d-fb02d78b3590 tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Calling method '.version_select at 0x7f6e37322550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:04.643585 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:04.643585 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:04.645413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77311d37-582d-4a66-801d-fb02d78b3590 tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.646248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77311d37-582d-4a66-801d-fb02d78b3590 tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.664380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77311d37-582d-4a66-801d-fb02d78b3590 tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.665052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77311d37-582d-4a66-801d-fb02d78b3590 tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.710811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77311d37-582d-4a66-801d-fb02d78b3590 tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.711505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77311d37-582d-4a66-801d-fb02d78b3590 tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.727098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77311d37-582d-4a66-801d-fb02d78b3590 tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.728473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77311d37-582d-4a66-801d-fb02d78b3590 tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.760177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77311d37-582d-4a66-801d-fb02d78b3590 tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.760642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77311d37-582d-4a66-801d-fb02d78b3590 tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.767961 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-77311d37-582d-4a66-801d-fb02d78b3590 tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.433218 Mar 12 20:49:04.768873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 172/354] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Mar 12 20:49:04 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:49:04.782372 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d822c57c-2d88-4419-b728-5a41045a28cf tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Calling method '.version_select at 0x7f6e3748c040>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:04.783852 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:04.783852 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:49:04.785214 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d822c57c-2d88-4419-b728-5a41045a28cf tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.785744 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d822c57c-2d88-4419-b728-5a41045a28cf tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.805933 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d822c57c-2d88-4419-b728-5a41045a28cf tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.806648 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d822c57c-2d88-4419-b728-5a41045a28cf tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.827899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-382b44dd-0a8a-45a1-951f-97eeacd344d2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:04.828820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-382b44dd-0a8a-45a1-951f-97eeacd344d2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:04.831790 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d822c57c-2d88-4419-b728-5a41045a28cf tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.832465 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d822c57c-2d88-4419-b728-5a41045a28cf tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.842212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-382b44dd-0a8a-45a1-951f-97eeacd344d2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.842705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-382b44dd-0a8a-45a1-951f-97eeacd344d2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.843526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-382b44dd-0a8a-45a1-951f-97eeacd344d2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.843969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-382b44dd-0a8a-45a1-951f-97eeacd344d2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.846973 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d822c57c-2d88-4419-b728-5a41045a28cf tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.847516 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d822c57c-2d88-4419-b728-5a41045a28cf tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.891608 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d822c57c-2d88-4419-b728-5a41045a28cf tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.894058 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d822c57c-2d88-4419-b728-5a41045a28cf tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.905297 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d822c57c-2d88-4419-b728-5a41045a28cf tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 686 microversion: 2.53 time: 0.126509 Mar 12 20:49:04.910138 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 183/355] 10.222.0.30 () {60 vars in 1221 bytes} [Sat Mar 12 20:49:04 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 686 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:49:04.928238 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3d1eec17-8532-42b0-9684-ec84bd20970a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:04.929413 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3d1eec17-8532-42b0-9684-ec84bd20970a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:04.937739 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3d1eec17-8532-42b0-9684-ec84bd20970a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.938673 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3d1eec17-8532-42b0-9684-ec84bd20970a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:04.939696 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3d1eec17-8532-42b0-9684-ec84bd20970a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:04.940337 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3d1eec17-8532-42b0-9684-ec84bd20970a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.076113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-382b44dd-0a8a-45a1-951f-97eeacd344d2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:05.091464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-382b44dd-0a8a-45a1-951f-97eeacd344d2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:05.093092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-382b44dd-0a8a-45a1-951f-97eeacd344d2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:05.098279 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-382b44dd-0a8a-45a1-951f-97eeacd344d2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1567 microversion: 2.25 time: 0.271165 Mar 12 20:49:05.098915 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 173/356] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:04 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:49:05.103995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f8929e1e-7de4-49bc-8bae-9f7d256d638e tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Calling method '.version_select at 0x7f6e3731a820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:05.105241 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:05.105241 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:05.106505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8929e1e-7de4-49bc-8bae-9f7d256d638e tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.106995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8929e1e-7de4-49bc-8bae-9f7d256d638e tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.124069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8929e1e-7de4-49bc-8bae-9f7d256d638e tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.124536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8929e1e-7de4-49bc-8bae-9f7d256d638e tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.131013 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f8929e1e-7de4-49bc-8bae-9f7d256d638e tempest-HypervisorAdminV253TestBase-448832114 tempest-HypervisorAdminV253TestBase-448832114-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/37d1b07f-381c-425d-876d-1cd35192da29" status: 200 len: 792 microversion: 2.53 time: 0.031017 Mar 12 20:49:05.131869 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 174/357] 10.222.0.30 () {60 vars in 1297 bytes} [Sat Mar 12 20:49:05 2022] GET /compute/v2.1/os-hypervisors/37d1b07f-381c-425d-876d-1cd35192da29 => generated 792 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:49:05.161081 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3d1eec17-8532-42b0-9684-ec84bd20970a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:05.171848 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3d1eec17-8532-42b0-9684-ec84bd20970a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.263144 Mar 12 20:49:05.183884 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 184/358] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:04 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:05.189736 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-322d17df-d649-4cdf-a08f-8955e52ec5b6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:05.190550 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-322d17df-d649-4cdf-a08f-8955e52ec5b6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:05.197236 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-322d17df-d649-4cdf-a08f-8955e52ec5b6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.197985 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-322d17df-d649-4cdf-a08f-8955e52ec5b6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.198813 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-322d17df-d649-4cdf-a08f-8955e52ec5b6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.199253 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-322d17df-d649-4cdf-a08f-8955e52ec5b6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.385241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3f6cafff-e43f-49a6-932b-aaec4a5e9cf2 tempest-AZAdminV2TestJSON-1664126321 tempest-AZAdminV2TestJSON-1664126321-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:05.390571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f6cafff-e43f-49a6-932b-aaec4a5e9cf2 tempest-AZAdminV2TestJSON-1664126321 tempest-AZAdminV2TestJSON-1664126321-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.391448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f6cafff-e43f-49a6-932b-aaec4a5e9cf2 tempest-AZAdminV2TestJSON-1664126321 tempest-AZAdminV2TestJSON-1664126321-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.392943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f6cafff-e43f-49a6-932b-aaec4a5e9cf2 tempest-AZAdminV2TestJSON-1664126321 tempest-AZAdminV2TestJSON-1664126321-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.393715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f6cafff-e43f-49a6-932b-aaec4a5e9cf2 tempest-AZAdminV2TestJSON-1664126321 tempest-AZAdminV2TestJSON-1664126321-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.417608 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-322d17df-d649-4cdf-a08f-8955e52ec5b6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:05.425575 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-322d17df-d649-4cdf-a08f-8955e52ec5b6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1468 microversion: 2.1 time: 0.240461 Mar 12 20:49:05.428320 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3f6cafff-e43f-49a6-932b-aaec4a5e9cf2 tempest-AZAdminV2TestJSON-1664126321 tempest-AZAdminV2TestJSON-1664126321-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.289107 Mar 12 20:49:05.429680 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 175/359] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Mar 12 20:49:05 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:05.435721 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 185/360] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:05 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1468 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:05.440580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ca7fe45-e7ab-457d-98ea-09083f827233 tempest-AZAdminV2TestJSON-1664126321 tempest-AZAdminV2TestJSON-1664126321-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:05.442215 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:05.442215 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:05.443416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ca7fe45-e7ab-457d-98ea-09083f827233 tempest-AZAdminV2TestJSON-1664126321 tempest-AZAdminV2TestJSON-1664126321-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.444218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ca7fe45-e7ab-457d-98ea-09083f827233 tempest-AZAdminV2TestJSON-1664126321 tempest-AZAdminV2TestJSON-1664126321-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.445256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ca7fe45-e7ab-457d-98ea-09083f827233 tempest-AZAdminV2TestJSON-1664126321 tempest-AZAdminV2TestJSON-1664126321-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.446253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ca7fe45-e7ab-457d-98ea-09083f827233 tempest-AZAdminV2TestJSON-1664126321 tempest-AZAdminV2TestJSON-1664126321-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.476617 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ca7fe45-e7ab-457d-98ea-09083f827233 tempest-AZAdminV2TestJSON-1664126321 tempest-AZAdminV2TestJSON-1664126321-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.039494 Mar 12 20:49:05.477502 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 176/361] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Mar 12 20:49:05 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:05.639832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b41ef475-cabb-48a9-8efb-3f85c47420bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:05.642287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b41ef475-cabb-48a9-8efb-3f85c47420bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:05.652496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b41ef475-cabb-48a9-8efb-3f85c47420bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.653154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b41ef475-cabb-48a9-8efb-3f85c47420bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.654285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b41ef475-cabb-48a9-8efb-3f85c47420bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.654959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b41ef475-cabb-48a9-8efb-3f85c47420bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.731139 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d013b760-422c-44d0-91fe-b3f6b09ea131 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1260464029", "block_migration": true, "disk_over_commit": false}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:05.732427 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d013b760-422c-44d0-91fe-b3f6b09ea131 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:05.739382 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d013b760-422c-44d0-91fe-b3f6b09ea131 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.740301 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d013b760-422c-44d0-91fe-b3f6b09ea131 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.742110 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d013b760-422c-44d0-91fe-b3f6b09ea131 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.742801 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d013b760-422c-44d0-91fe-b3f6b09ea131 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.769748 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-d013b760-422c-44d0-91fe-b3f6b09ea131 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lazy-loading 'flavor' on Instance uuid c88bacb8-65ca-46cd-abda-0bf2772c950e {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:49:05.783482 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d013b760-422c-44d0-91fe-b3f6b09ea131 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Going to try to live migrate instance to tempest-host-1260464029 {{(pid=136303) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 12 20:49:05.791388 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-d013b760-422c-44d0-91fe-b3f6b09ea131 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] HTTP exception thrown: Compute host tempest-host-1260464029 could not be found. Mar 12 20:49:05.792003 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d013b760-422c-44d0-91fe-b3f6b09ea131 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Returning 400 to user: Compute host tempest-host-1260464029 could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:05.792861 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d013b760-422c-44d0-91fe-b3f6b09ea131 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e/action" status: 400 len: 100 microversion: 2.1 time: 0.343140 Mar 12 20:49:05.796703 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 186/362] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Mar 12 20:49:05 2022] POST /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e/action => generated 100 bytes in 344 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:49:05.801565 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9e4fabea-dc33-4bac-b09e-dec4c60141af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:05.802323 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9e4fabea-dc33-4bac-b09e-dec4c60141af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:05.810754 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9e4fabea-dc33-4bac-b09e-dec4c60141af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.811294 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9e4fabea-dc33-4bac-b09e-dec4c60141af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:05.812162 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9e4fabea-dc33-4bac-b09e-dec4c60141af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:05.812689 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9e4fabea-dc33-4bac-b09e-dec4c60141af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:06.051555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b41ef475-cabb-48a9-8efb-3f85c47420bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:06.059163 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9e4fabea-dc33-4bac-b09e-dec4c60141af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:06.060573 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b41ef475-cabb-48a9-8efb-3f85c47420bb tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.427118 Mar 12 20:49:06.062681 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 177/363] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:05 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:06.076110 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9e4fabea-dc33-4bac-b09e-dec4c60141af tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1468 microversion: 2.1 time: 0.278162 Mar 12 20:49:06.077206 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 187/364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:05 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1468 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:06.118020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c132aaf-f503-422d-8d63-712c64106258 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:06.118980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c132aaf-f503-422d-8d63-712c64106258 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:06.126857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c132aaf-f503-422d-8d63-712c64106258 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:06.127646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c132aaf-f503-422d-8d63-712c64106258 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:06.128882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c132aaf-f503-422d-8d63-712c64106258 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:06.129531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c132aaf-f503-422d-8d63-712c64106258 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:06.201305 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a5ceeb52-2873-4b51-85b2-cb274abe0b44 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:06.202261 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a5ceeb52-2873-4b51-85b2-cb274abe0b44 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:06.211965 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a5ceeb52-2873-4b51-85b2-cb274abe0b44 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:06.212473 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a5ceeb52-2873-4b51-85b2-cb274abe0b44 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:06.213315 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a5ceeb52-2873-4b51-85b2-cb274abe0b44 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:06.214129 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a5ceeb52-2873-4b51-85b2-cb274abe0b44 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:06.384065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0c132aaf-f503-422d-8d63-712c64106258 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:06.393963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0c132aaf-f503-422d-8d63-712c64106258 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:06.395841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0c132aaf-f503-422d-8d63-712c64106258 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:06.397404 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c132aaf-f503-422d-8d63-712c64106258 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1557 microversion: 2.25 time: 0.284665 Mar 12 20:49:06.398278 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 178/365] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:06 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1557 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:06.404717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-321645229", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:06.477316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:49:06.536603 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a5ceeb52-2873-4b51-85b2-cb274abe0b44 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:06.546023 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a5ceeb52-2873-4b51-85b2-cb274abe0b44 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.354585 Mar 12 20:49:06.547121 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 188/366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:06 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:06.553562 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-23ec5095-9d97-44e1-877c-a467fc3f77d6 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '.version_select at 0x7f6e374af430>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:06.557886 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-23ec5095-9d97-44e1-877c-a467fc3f77d6 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:06.558580 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-23ec5095-9d97-44e1-877c-a467fc3f77d6 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:06.586499 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-23ec5095-9d97-44e1-877c-a467fc3f77d6 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1102 microversion: 2.25 time: 0.037913 Mar 12 20:49:06.588336 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 189/367] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Mar 12 20:49:06 2022] GET /compute/v2.1/os-migrations => generated 1102 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:06.605526 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e4ef7f42-a875-430c-97cc-a8197e097393 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:06.606190 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e4ef7f42-a875-430c-97cc-a8197e097393 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:06.632447 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f42-a875-430c-97cc-a8197e097393 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:06.637806 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f42-a875-430c-97cc-a8197e097393 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:06.640128 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f42-a875-430c-97cc-a8197e097393 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:06.641704 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e4ef7f42-a875-430c-97cc-a8197e097393 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:06.847408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:49:06.847872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:49:06.849064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:49:06.849692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:49:06.850346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:49:06.864706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:06.865179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:06.866057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:06.867297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:06.889146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Getting quotas for project 3758c472ec7d47d6a85c9eb1cae6e39b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:06.894160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Getting quotas for user 073b94a21f4049fe9ca8fd5f908f498e and project 3758c472ec7d47d6a85c9eb1cae6e39b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:06.907000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:49:06.909951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:49:06.981596 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-e4ef7f42-a875-430c-97cc-a8197e097393 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:49:06.993263 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c932f7e-c1cc-47f3-8595-d414dee70353 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593536 Mar 12 20:49:07.002926 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 179/368] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:49:07.009106 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e4ef7f42-a875-430c-97cc-a8197e097393 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 2050 microversion: 2.25 time: 0.413194 Mar 12 20:49:07.009688 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 190/369] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:06 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 2050 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:49:07.031549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25c4bc8c-dc59-4426-9500-21b4ececf6f5 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:07.032174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-25c4bc8c-dc59-4426-9500-21b4ececf6f5 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:07.080181 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d003e8a6-ad75-46b9-b09e-72fd214ee18a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:07.080929 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d003e8a6-ad75-46b9-b09e-72fd214ee18a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:07.093394 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d003e8a6-ad75-46b9-b09e-72fd214ee18a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:07.093915 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d003e8a6-ad75-46b9-b09e-72fd214ee18a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:07.095026 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d003e8a6-ad75-46b9-b09e-72fd214ee18a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:07.095476 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d003e8a6-ad75-46b9-b09e-72fd214ee18a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:07.160194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-25c4bc8c-dc59-4426-9500-21b4ececf6f5 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:07.176502 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-25c4bc8c-dc59-4426-9500-21b4ececf6f5 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1218 microversion: 2.1 time: 0.165957 Mar 12 20:49:07.192836 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 180/370] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:07 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1218 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:07.290241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-559063191", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "1c06f7bd-57f3-494e-b107-2b7e9aae71ae"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:07.387804 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d003e8a6-ad75-46b9-b09e-72fd214ee18a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:07.396472 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d003e8a6-ad75-46b9-b09e-72fd214ee18a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1312 microversion: 2.1 time: 0.320672 Mar 12 20:49:07.409233 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 191/371] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:07 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:07.423376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] validate_networks() for [('1c06f7bd-57f3-494e-b107-2b7e9aae71ae', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:49:07.568682 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a71870d8-7ccc-4024-97db-569023d61aec tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:07.571121 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a71870d8-7ccc-4024-97db-569023d61aec tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:07.587790 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a71870d8-7ccc-4024-97db-569023d61aec tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:07.588244 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a71870d8-7ccc-4024-97db-569023d61aec tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:07.589025 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a71870d8-7ccc-4024-97db-569023d61aec tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:07.589460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a71870d8-7ccc-4024-97db-569023d61aec tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:07.908240 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a71870d8-7ccc-4024-97db-569023d61aec tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:07.923290 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a71870d8-7ccc-4024-97db-569023d61aec tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.362130 Mar 12 20:49:07.924065 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 192/372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:07 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:08.155454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:49:08.156523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:49:08.157178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:49:08.157753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:49:08.158369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:49:08.172566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:08.173661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:08.174977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:08.175861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:08.201460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4ea86e54-593f-4604-b10c-cef1e0e0a336 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:08.202260 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4ea86e54-593f-4604-b10c-cef1e0e0a336 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:08.205226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Getting quotas for project 7417ea19a899461e99596d0df881a336. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:08.209419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Getting quotas for user 9c3556ea8eba477e92c2f6f765a30c1f and project 7417ea19a899461e99596d0df881a336. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:08.213474 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4ea86e54-593f-4604-b10c-cef1e0e0a336 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:08.214210 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4ea86e54-593f-4604-b10c-cef1e0e0a336 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:08.215983 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4ea86e54-593f-4604-b10c-cef1e0e0a336 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:08.218264 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4ea86e54-593f-4604-b10c-cef1e0e0a336 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:08.222278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:49:08.224637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:49:08.283895 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d40b10e-35da-4660-b5ab-fd8527123867 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.001589 Mar 12 20:49:08.285203 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 181/373] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 20:49:08.298829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-498d40ba-ad03-494b-8408-2c9ec39aa26e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:08.299447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-498d40ba-ad03-494b-8408-2c9ec39aa26e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:08.365086 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4ea86e54-593f-4604-b10c-cef1e0e0a336 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:08.378892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-498d40ba-ad03-494b-8408-2c9ec39aa26e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:08.380760 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4ea86e54-593f-4604-b10c-cef1e0e0a336 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1270 microversion: 2.1 time: 0.184100 Mar 12 20:49:08.382563 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 193/374] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:08 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:08.394107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-498d40ba-ad03-494b-8408-2c9ec39aa26e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:08.395642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-498d40ba-ad03-494b-8408-2c9ec39aa26e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:08.396793 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-498d40ba-ad03-494b-8408-2c9ec39aa26e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1261 microversion: 2.25 time: 0.101932 Mar 12 20:49:08.408606 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 182/375] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:08 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1261 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:08.420492 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-48d4ff37-87b5-4ffe-b183-c565a8fb27b2 req-61ffa65a-a5c9-4358-8ca2-a4bb6d44b7cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609a3dcb-697d-4955-8b1f-23f2ba14cda4", "name": "network-vif-unplugged", "status": "completed", "tag": "d4cfae29-d4f0-4e0c-a36c-dbcc83815e9b"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:08.434933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5f63f446-7c75-4a63-904d-dbdbab65d48c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:08.439251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5f63f446-7c75-4a63-904d-dbdbab65d48c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:08.441019 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-48d4ff37-87b5-4ffe-b183-c565a8fb27b2 req-61ffa65a-a5c9-4358-8ca2-a4bb6d44b7cc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:08.443422 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-48d4ff37-87b5-4ffe-b183-c565a8fb27b2 req-61ffa65a-a5c9-4358-8ca2-a4bb6d44b7cc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:08.455060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f63f446-7c75-4a63-904d-dbdbab65d48c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:08.456588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f63f446-7c75-4a63-904d-dbdbab65d48c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:08.463615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f63f446-7c75-4a63-904d-dbdbab65d48c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:08.464942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f63f446-7c75-4a63-904d-dbdbab65d48c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:08.481200 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-48d4ff37-87b5-4ffe-b183-c565a8fb27b2 req-61ffa65a-a5c9-4358-8ca2-a4bb6d44b7cc service nova] Creating event network-vif-unplugged:d4cfae29-d4f0-4e0c-a36c-dbcc83815e9b for instance 609a3dcb-697d-4955-8b1f-23f2ba14cda4 on nch2-master-1 Mar 12 20:49:08.521939 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-48d4ff37-87b5-4ffe-b183-c565a8fb27b2 req-61ffa65a-a5c9-4358-8ca2-a4bb6d44b7cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108968 Mar 12 20:49:08.526454 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 194/376] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:08.695342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f63f446-7c75-4a63-904d-dbdbab65d48c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:08.706958 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5f63f446-7c75-4a63-904d-dbdbab65d48c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1462 microversion: 2.1 time: 0.296189 Mar 12 20:49:08.708473 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 183/377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:08 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1462 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:08.951509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f2f3db9-0f59-466a-ba72-bd729bed341d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:08.951886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4f2f3db9-0f59-466a-ba72-bd729bed341d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:08.961448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f2f3db9-0f59-466a-ba72-bd729bed341d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:08.963009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f2f3db9-0f59-466a-ba72-bd729bed341d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:08.964111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f2f3db9-0f59-466a-ba72-bd729bed341d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:08.964908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f2f3db9-0f59-466a-ba72-bd729bed341d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:09.237538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4f2f3db9-0f59-466a-ba72-bd729bed341d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:09.246379 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4f2f3db9-0f59-466a-ba72-bd729bed341d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.299462 Mar 12 20:49:09.248515 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 184/378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:08 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:09.248774 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-45254c28-19b0-4a94-a15f-57b2d29d8cd8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:09.249606 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-45254c28-19b0-4a94-a15f-57b2d29d8cd8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:09.264170 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-45254c28-19b0-4a94-a15f-57b2d29d8cd8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:09.266943 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-45254c28-19b0-4a94-a15f-57b2d29d8cd8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:09.271109 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-45254c28-19b0-4a94-a15f-57b2d29d8cd8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:09.274371 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-45254c28-19b0-4a94-a15f-57b2d29d8cd8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:09.403241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2173c3a3-38df-4ae5-a0e6-5b110087db24 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:09.404145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2173c3a3-38df-4ae5-a0e6-5b110087db24 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:09.412606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2173c3a3-38df-4ae5-a0e6-5b110087db24 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:09.413998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2173c3a3-38df-4ae5-a0e6-5b110087db24 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:09.415608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2173c3a3-38df-4ae5-a0e6-5b110087db24 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:09.416295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2173c3a3-38df-4ae5-a0e6-5b110087db24 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:09.501743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2173c3a3-38df-4ae5-a0e6-5b110087db24 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:09.513365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2173c3a3-38df-4ae5-a0e6-5b110087db24 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1276 microversion: 2.1 time: 0.116651 Mar 12 20:49:09.514927 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 185/379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:09 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1276 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:09.528665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30593745-379f-40f0-9b55-5f11d3c9b03b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:09.529556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-30593745-379f-40f0-9b55-5f11d3c9b03b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:09.547887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30593745-379f-40f0-9b55-5f11d3c9b03b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:09.548355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30593745-379f-40f0-9b55-5f11d3c9b03b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:09.549150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30593745-379f-40f0-9b55-5f11d3c9b03b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:09.549601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30593745-379f-40f0-9b55-5f11d3c9b03b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:09.742575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-30593745-379f-40f0-9b55-5f11d3c9b03b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:09.754935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-30593745-379f-40f0-9b55-5f11d3c9b03b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:09.757378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-30593745-379f-40f0-9b55-5f11d3c9b03b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:09.766874 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30593745-379f-40f0-9b55-5f11d3c9b03b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1313 microversion: 2.25 time: 0.242730 Mar 12 20:49:09.768042 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 186/380] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:09 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:10.264552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ccbf84bb-7035-4b75-bcfb-a7a33089c348 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:10.266039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ccbf84bb-7035-4b75-bcfb-a7a33089c348 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:10.274924 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-45254c28-19b0-4a94-a15f-57b2d29d8cd8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1613 microversion: 2.1 time: 1.551219 Mar 12 20:49:10.275374 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 195/381] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:08 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1613 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:10.288447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccbf84bb-7035-4b75-bcfb-a7a33089c348 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:10.291708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccbf84bb-7035-4b75-bcfb-a7a33089c348 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:10.293962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccbf84bb-7035-4b75-bcfb-a7a33089c348 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:10.294655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccbf84bb-7035-4b75-bcfb-a7a33089c348 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:10.295417 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9f744193-db74-40d0-b264-e4f140403f3f tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:10.297373 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9f744193-db74-40d0-b264-e4f140403f3f tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:10.325434 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f744193-db74-40d0-b264-e4f140403f3f tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:10.326128 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f744193-db74-40d0-b264-e4f140403f3f tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:10.326978 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f744193-db74-40d0-b264-e4f140403f3f tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:10.327430 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f744193-db74-40d0-b264-e4f140403f3f tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:10.517038 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9f744193-db74-40d0-b264-e4f140403f3f tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4909aae0562140f1abbf15fa479a68fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7513b5c3eaeb4fabb701947798f27daa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:10.526236 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9f744193-db74-40d0-b264-e4f140403f3f tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] flavor_id is None. Assuming migration. {{(pid=136303) resize /opt/stack/nova/nova/compute/api.py:4140}} Mar 12 20:49:10.526236 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9f744193-db74-40d0-b264-e4f140403f3f tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136303) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 20:49:10.894097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ccbf84bb-7035-4b75-bcfb-a7a33089c348 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:10.902914 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ccbf84bb-7035-4b75-bcfb-a7a33089c348 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.642278 Mar 12 20:49:10.912557 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 187/382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:10 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:10.917959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6836cbef-b2de-4997-947d-28d63606f4bb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:10.918783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6836cbef-b2de-4997-947d-28d63606f4bb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:10.924899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6836cbef-b2de-4997-947d-28d63606f4bb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:10.925546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6836cbef-b2de-4997-947d-28d63606f4bb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:10.926573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6836cbef-b2de-4997-947d-28d63606f4bb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:10.927171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6836cbef-b2de-4997-947d-28d63606f4bb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:11.157117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6836cbef-b2de-4997-947d-28d63606f4bb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:11.170920 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6836cbef-b2de-4997-947d-28d63606f4bb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1318 microversion: 2.1 time: 0.256509 Mar 12 20:49:11.172493 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 188/383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:10 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:11.181758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-08a0f442-f9f0-4999-8602-713c3c980b99 req-cf089c25-3e1f-4eff-997d-5b350873bfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609a3dcb-697d-4955-8b1f-23f2ba14cda4", "tag": "d4cfae29-d4f0-4e0c-a36c-dbcc83815e9b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:11.206104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-08a0f442-f9f0-4999-8602-713c3c980b99 req-cf089c25-3e1f-4eff-997d-5b350873bfd7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:11.206860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-08a0f442-f9f0-4999-8602-713c3c980b99 req-cf089c25-3e1f-4eff-997d-5b350873bfd7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:11.230223 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-08a0f442-f9f0-4999-8602-713c3c980b99 req-cf089c25-3e1f-4eff-997d-5b350873bfd7 service nova] Creating event network-changed:d4cfae29-d4f0-4e0c-a36c-dbcc83815e9b for instance 609a3dcb-697d-4955-8b1f-23f2ba14cda4 on nch2-master-1 Mar 12 20:49:11.242804 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-08a0f442-f9f0-4999-8602-713c3c980b99 req-cf089c25-3e1f-4eff-997d-5b350873bfd7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067940 Mar 12 20:49:11.244030 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 189/384] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:11.323639 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9f744193-db74-40d0-b264-e4f140403f3f tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29/action" status: 202 len: 0 microversion: 2.1 time: 1.033973 Mar 12 20:49:11.327997 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 196/385] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:49:10 2022] POST /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29/action => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:11.334291 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e55c24fe-978e-4c6c-a3e2-1cc7757be66b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:11.335483 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e55c24fe-978e-4c6c-a3e2-1cc7757be66b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:11.343272 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e55c24fe-978e-4c6c-a3e2-1cc7757be66b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:11.343989 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e55c24fe-978e-4c6c-a3e2-1cc7757be66b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:11.345142 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e55c24fe-978e-4c6c-a3e2-1cc7757be66b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:11.345734 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e55c24fe-978e-4c6c-a3e2-1cc7757be66b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:11.467962 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e55c24fe-978e-4c6c-a3e2-1cc7757be66b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:11.487284 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e55c24fe-978e-4c6c-a3e2-1cc7757be66b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:11.488940 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e55c24fe-978e-4c6c-a3e2-1cc7757be66b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:11.490155 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e55c24fe-978e-4c6c-a3e2-1cc7757be66b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1319 microversion: 2.25 time: 0.160938 Mar 12 20:49:11.491491 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 197/386] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:11 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:11.496157 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3daac2aa-ec75-4337-aefc-79245deed53f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:11.496766 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3daac2aa-ec75-4337-aefc-79245deed53f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:11.508201 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3daac2aa-ec75-4337-aefc-79245deed53f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:11.509067 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3daac2aa-ec75-4337-aefc-79245deed53f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:11.510045 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3daac2aa-ec75-4337-aefc-79245deed53f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:11.510880 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3daac2aa-ec75-4337-aefc-79245deed53f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:11.750352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f793033c-a48f-405a-8743-3041909e022b tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Calling method '.version_select at 0x7f6e37283a60>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:11.895049 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f793033c-a48f-405a-8743-3041909e022b tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4" status: 200 len: 371 microversion: 2.1 time: 0.643731 Mar 12 20:49:11.902103 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 190/387] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Mar 12 20:49:11 2022] GET /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4 => generated 371 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:11.990036 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3daac2aa-ec75-4337-aefc-79245deed53f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:12.007800 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3daac2aa-ec75-4337-aefc-79245deed53f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1471 microversion: 2.1 time: 0.506589 Mar 12 20:49:12.010438 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 198/388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:11 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1471 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:12.098645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f3ab8db8-141b-4031-9279-eaafe60507fc tempest-NetworksTest-676545600 tempest-NetworksTest-676545600-project-admin] Calling method '.version_select at 0x7f6e3734ff70>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:12.137379 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-33084769-3d34-413b-8713-a6db5a74e89a tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1848430127", "id": 617847880, "os-flavor-access:is_public": "True"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:12.139736 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:12.139736 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:49:12.162554 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-33084769-3d34-413b-8713-a6db5a74e89a tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.151183 Mar 12 20:49:12.169209 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 199/389] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:12 2022] POST /compute/v2.1/flavors => generated 427 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:12.174236 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ea3f610e-663f-4def-ab79-1338470b6c04 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Action: 'update', calling method: .version_select at 0x7f6e37417700>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:12.279687 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ea3f610e-663f-4def-ab79-1338470b6c04 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:12.280336 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ea3f610e-663f-4def-ab79-1338470b6c04 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:12.281902 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ea3f610e-663f-4def-ab79-1338470b6c04 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:12.282626 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ea3f610e-663f-4def-ab79-1338470b6c04 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:12.332044 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f3ab8db8-141b-4031-9279-eaafe60507fc tempest-NetworksTest-676545600 tempest-NetworksTest-676545600-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 6067 microversion: 2.1 time: 0.432932 Mar 12 20:49:12.332650 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 191/390] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:49:11 2022] GET /compute/v2.1/os-networks => generated 6067 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:12.340699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f67fde2b-176f-44b1-84f0-b0b2e20417a2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:12.341434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f67fde2b-176f-44b1-84f0-b0b2e20417a2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:12.357343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f67fde2b-176f-44b1-84f0-b0b2e20417a2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:12.357830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f67fde2b-176f-44b1-84f0-b0b2e20417a2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:12.358633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f67fde2b-176f-44b1-84f0-b0b2e20417a2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:12.359802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f67fde2b-176f-44b1-84f0-b0b2e20417a2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:12.395307 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ea3f610e-663f-4def-ab79-1338470b6c04 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4" status: 200 len: 328 microversion: 2.1 time: 0.224818 Mar 12 20:49:12.395944 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 200/391] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Mar 12 20:49:12 2022] PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4 => generated 328 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:12.400676 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-df663efb-87d2-476a-813a-98ddabcb9870 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:12.401927 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:12.401927 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:49:12.437624 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-df663efb-87d2-476a-813a-98ddabcb9870 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/617847880" status: 202 len: 0 microversion: 2.1 time: 0.040167 Mar 12 20:49:12.441989 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 201/392] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:49:12 2022] DELETE /compute/v2.1/flavors/617847880 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:12.449218 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-04e07c53-6abd-43c4-9ce0-6463a436ec08 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:12.450131 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-04e07c53-6abd-43c4-9ce0-6463a436ec08 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:12.459846 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-04e07c53-6abd-43c4-9ce0-6463a436ec08 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:12.460677 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-04e07c53-6abd-43c4-9ce0-6463a436ec08 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:12.461653 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-04e07c53-6abd-43c4-9ce0-6463a436ec08 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:12.463267 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-04e07c53-6abd-43c4-9ce0-6463a436ec08 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:12.610269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f67fde2b-176f-44b1-84f0-b0b2e20417a2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:12.618684 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f67fde2b-176f-44b1-84f0-b0b2e20417a2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.284353 Mar 12 20:49:12.619266 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 192/393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:12 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:12.632794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f207a81d-861a-4d73-9f5e-ae0852466411 tempest-NetworksTest-676545600 tempest-NetworksTest-676545600-project-admin] Calling method '.version_select at 0x7f6e376fab80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:12.739887 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f207a81d-861a-4d73-9f5e-ae0852466411 tempest-NetworksTest-676545600 tempest-NetworksTest-676545600-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks/3252baf5-f0b3-4623-ae48-9d502be240a5" status: 200 len: 652 microversion: 2.1 time: 0.110621 Mar 12 20:49:12.740686 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 193/394] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 20:49:12 2022] GET /compute/v2.1/os-networks/3252baf5-f0b3-4623-ae48-9d502be240a5 => generated 652 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:12.751040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-acd76fff-73c4-4db9-b32c-7f36fe475092 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:12.778569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-acd76fff-73c4-4db9-b32c-7f36fe475092 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.035993 Mar 12 20:49:12.781847 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 194/395] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:12 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:12.793932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b1161083-a1a2-42a8-aa48-91219480d840 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:12.794647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b1161083-a1a2-42a8-aa48-91219480d840 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:12.803203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1161083-a1a2-42a8-aa48-91219480d840 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:12.805991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1161083-a1a2-42a8-aa48-91219480d840 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:12.808219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1161083-a1a2-42a8-aa48-91219480d840 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:12.809078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1161083-a1a2-42a8-aa48-91219480d840 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:12.866906 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-04e07c53-6abd-43c4-9ce0-6463a436ec08 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:12.880332 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-04e07c53-6abd-43c4-9ce0-6463a436ec08 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1318 microversion: 2.1 time: 0.434636 Mar 12 20:49:12.880332 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 202/396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:12 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:13.019470 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1568115995", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:13.056234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b1161083-a1a2-42a8-aa48-91219480d840 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:13.065107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b1161083-a1a2-42a8-aa48-91219480d840 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:13.066731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b1161083-a1a2-42a8-aa48-91219480d840 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:13.068509 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b1161083-a1a2-42a8-aa48-91219480d840 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1361 microversion: 2.25 time: 0.287987 Mar 12 20:49:13.069266 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 195/397] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:12 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:13.074400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3bac1688-d776-4e08-901c-94b1adb50d27 tempest-NetworksTest-676545600 tempest-NetworksTest-676545600-project-admin] Calling method '.version_select at 0x7f6e37365700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:13.077521 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.neutron [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] validate_networks() for None {{(pid=136303) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:49:13.210760 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3bac1688-d776-4e08-901c-94b1adb50d27 tempest-NetworksTest-676545600 tempest-NetworksTest-676545600-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 6067 microversion: 2.1 time: 0.139609 Mar 12 20:49:13.211475 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 196/398] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:49:13 2022] GET /compute/v2.1/os-networks => generated 6067 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:13.217633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c3d8f95-7aef-40f1-adc8-db1296b82888 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1776840324", "id": 288646237, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:13.219469 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:13.219469 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:13.240111 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c3d8f95-7aef-40f1-adc8-db1296b82888 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.026703 Mar 12 20:49:13.241547 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 197/399] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:13 2022] POST /compute/v2.1/flavors => generated 414 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:13.248516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc10acab-b583-4c59-85f2-ac6261fdc436 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:13.249948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc10acab-b583-4c59-85f2-ac6261fdc436 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:13.261644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc10acab-b583-4c59-85f2-ac6261fdc436 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:13.265542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc10acab-b583-4c59-85f2-ac6261fdc436 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:13.266441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc10acab-b583-4c59-85f2-ac6261fdc436 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:13.266878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc10acab-b583-4c59-85f2-ac6261fdc436 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:13.438680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc10acab-b583-4c59-85f2-ac6261fdc436 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:13.448121 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc10acab-b583-4c59-85f2-ac6261fdc436 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1471 microversion: 2.1 time: 0.205306 Mar 12 20:49:13.448764 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 198/400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:13 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:13.455713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d8f1817a-d065-41b3-9a59-e2012aa9437e tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:13.476952 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d8f1817a-d065-41b3-9a59-e2012aa9437e tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.025899 Mar 12 20:49:13.477542 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 199/401] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:13 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:13.482159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5461314d-010a-4cde-953d-d9600dde8e1a req-4db71649-256e-4255-af16-c5abe56dcc9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14193145-27d3-461c-90a6-4073d822b2ed", "tag": "af3d31be-a410-4472-8a18-7fb92f819cfb"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:13.492041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5461314d-010a-4cde-953d-d9600dde8e1a req-4db71649-256e-4255-af16-c5abe56dcc9a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:13.492492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5461314d-010a-4cde-953d-d9600dde8e1a req-4db71649-256e-4255-af16-c5abe56dcc9a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:13.503426 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5461314d-010a-4cde-953d-d9600dde8e1a req-4db71649-256e-4255-af16-c5abe56dcc9a service nova] Creating event network-changed:af3d31be-a410-4472-8a18-7fb92f819cfb for instance 14193145-27d3-461c-90a6-4073d822b2ed on nch2-master-1 Mar 12 20:49:13.508712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5461314d-010a-4cde-953d-d9600dde8e1a req-4db71649-256e-4255-af16-c5abe56dcc9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029833 Mar 12 20:49:13.509450 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 200/402] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:13.514094 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:49:13.514562 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:49:13.514682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e58a09ed-87c3-4f69-b6e2-c95d99775578 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:13.514990 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:49:13.516068 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:13.516068 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:13.526926 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:49:13.527493 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:49:13.533048 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e58a09ed-87c3-4f69-b6e2-c95d99775578 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/288646237" status: 202 len: 0 microversion: 2.1 time: 0.022184 Mar 12 20:49:13.536765 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 201/403] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:49:13 2022] DELETE /compute/v2.1/flavors/288646237 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:13.544695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8952a184-8aa9-4d49-9bb8-e158294a7e91 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:13.548217 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:13.548934 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:13.550450 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:13.551641 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:13.567593 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8952a184-8aa9-4d49-9bb8-e158294a7e91 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026373 Mar 12 20:49:13.580714 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 202/404] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:13 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:13.580925 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Getting quotas for project c754c7d2b193497ea0b56f777ed534f4. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:13.585360 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Getting quotas for user 890437ebb8de4f269358469845cdd8d9 and project c754c7d2b193497ea0b56f777ed534f4. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:13.587274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99d3088b-ae75-45d2-9c39-b4ae91d58d93 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1376409500", "id": 350439255, "os-flavor-access:is_public": "True"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:13.591434 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:13.591434 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:13.596742 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.utils [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] cores quota exceeded for c754c7d2b193497ea0b56f777ed534f4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136303) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Mar 12 20:49:13.597642 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Mar 12 20:49:13.598351 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:13.599269 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-91a44d32-1c0a-4171-befd-b053e4b8d715 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.718487 Mar 12 20:49:13.606923 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 203/405] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:12 2022] POST /compute/v2.1/servers => generated 111 bytes in 723 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:13.611933 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-cd3e5ccf-a27c-412e-85af-d9d8dd2ea7df tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Action: 'update', calling method: .version_select at 0x7f6e372dd430>, body: {"quota_set": {"cores": 20}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:13.616795 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99d3088b-ae75-45d2-9c39-b4ae91d58d93 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.034206 Mar 12 20:49:13.622024 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 203/406] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:13 2022] POST /compute/v2.1/flavors => generated 426 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:13.635088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2710111a-4f9d-4abd-aeec-5e395ece2bfa tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:13.661958 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2710111a-4f9d-4abd-aeec-5e395ece2bfa tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/350439255" status: 202 len: 0 microversion: 2.1 time: 0.032140 Mar 12 20:49:13.665830 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 204/407] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:49:13 2022] DELETE /compute/v2.1/flavors/350439255 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:13.672334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da7b970c-3252-45f2-ac93-96b8c0d9b802 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:13.673132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da7b970c-3252-45f2-ac93-96b8c0d9b802 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:13.681997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da7b970c-3252-45f2-ac93-96b8c0d9b802 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:13.682467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da7b970c-3252-45f2-ac93-96b8c0d9b802 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:13.683495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da7b970c-3252-45f2-ac93-96b8c0d9b802 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:13.683984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da7b970c-3252-45f2-ac93-96b8c0d9b802 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:13.878833 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cd3e5ccf-a27c-412e-85af-d9d8dd2ea7df tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:13.879907 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cd3e5ccf-a27c-412e-85af-d9d8dd2ea7df tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:13.880746 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cd3e5ccf-a27c-412e-85af-d9d8dd2ea7df tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:13.881190 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cd3e5ccf-a27c-412e-85af-d9d8dd2ea7df tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:13.909206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da7b970c-3252-45f2-ac93-96b8c0d9b802 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:13.921313 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da7b970c-3252-45f2-ac93-96b8c0d9b802 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.254276 Mar 12 20:49:13.922676 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 205/408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:13 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:13.936196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f06c53c-f568-45b8-aafe-9ecd5d6c2de8 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:13.957143 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-cd3e5ccf-a27c-412e-85af-d9d8dd2ea7df tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4" status: 200 len: 329 microversion: 2.1 time: 0.348888 Mar 12 20:49:13.964738 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 204/409] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Mar 12 20:49:13 2022] PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4 => generated 329 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:13.974976 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5cb24c12-7e2f-4ad7-b9b0-c368a82addb6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:13.975754 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5cb24c12-7e2f-4ad7-b9b0-c368a82addb6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:13.976524 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f06c53c-f568-45b8-aafe-9ecd5d6c2de8 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.051991 Mar 12 20:49:13.977908 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 206/410] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:13 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:13.989405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1e1dfc41-f8b5-4980-a1d8-caef89ea0b0b tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Calling method '.version_select at 0x7f6e37365a60>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:13.994091 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5cb24c12-7e2f-4ad7-b9b0-c368a82addb6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:13.994550 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5cb24c12-7e2f-4ad7-b9b0-c368a82addb6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:13.995836 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5cb24c12-7e2f-4ad7-b9b0-c368a82addb6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:13.998069 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5cb24c12-7e2f-4ad7-b9b0-c368a82addb6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:14.123426 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1e1dfc41-f8b5-4980-a1d8-caef89ea0b0b tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4" status: 200 len: 371 microversion: 2.1 time: 0.144126 Mar 12 20:49:14.129825 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 207/411] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Mar 12 20:49:13 2022] GET /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4 => generated 371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:14.135052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-113811e3-9147-44bf-9bb1-7107776a02f7 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-597736212", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:14.137370 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:14.137370 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:14.153722 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-113811e3-9147-44bf-9bb1-7107776a02f7 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.022485 Mar 12 20:49:14.154674 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 208/412] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:14 2022] POST /compute/v2.1/flavors => generated 506 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:14.159522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52e59da7-e149-484d-9655-1c3d1535ca37 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:14.160367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-52e59da7-e149-484d-9655-1c3d1535ca37 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:14.167197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52e59da7-e149-484d-9655-1c3d1535ca37 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:14.167655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52e59da7-e149-484d-9655-1c3d1535ca37 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:14.168439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52e59da7-e149-484d-9655-1c3d1535ca37 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:14.168883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52e59da7-e149-484d-9655-1c3d1535ca37 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:14.332344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-52e59da7-e149-484d-9655-1c3d1535ca37 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:14.341889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-52e59da7-e149-484d-9655-1c3d1535ca37 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:14.343848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-52e59da7-e149-484d-9655-1c3d1535ca37 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:14.346058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-52e59da7-e149-484d-9655-1c3d1535ca37 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1361 microversion: 2.25 time: 0.190052 Mar 12 20:49:14.347352 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 209/413] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:14 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:14.352391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ad04a21-97cc-4178-b189-9722c2dae5fa tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Action: 'update', calling method: .version_select at 0x7f6e37365790>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:14.518402 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5cb24c12-7e2f-4ad7-b9b0-c368a82addb6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:14.527728 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5cb24c12-7e2f-4ad7-b9b0-c368a82addb6 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1318 microversion: 2.1 time: 0.562148 Mar 12 20:49:14.538362 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 205/414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:13 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:14.544072 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-be11fcf7-0c34-410b-ae51-314ec312e15d tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:14.544950 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:14.544950 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:49:14.562565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ad04a21-97cc-4178-b189-9722c2dae5fa tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:14.563363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ad04a21-97cc-4178-b189-9722c2dae5fa tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:14.564111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ad04a21-97cc-4178-b189-9722c2dae5fa tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:14.565017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ad04a21-97cc-4178-b189-9722c2dae5fa tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:14.570912 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-be11fcf7-0c34-410b-ae51-314ec312e15d tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/96f542ef-9a5b-4c8c-9791-bc1b89e45bf8" status: 202 len: 0 microversion: 2.1 time: 0.031296 Mar 12 20:49:14.575571 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 206/415] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:49:14 2022] DELETE /compute/v2.1/flavors/96f542ef-9a5b-4c8c-9791-bc1b89e45bf8 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:14.581552 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ee090a32-2da6-462b-8eb3-47d183dd8bbe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:14.582670 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ee090a32-2da6-462b-8eb3-47d183dd8bbe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:14.591403 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ee090a32-2da6-462b-8eb3-47d183dd8bbe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:14.592744 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ee090a32-2da6-462b-8eb3-47d183dd8bbe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:14.594637 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ee090a32-2da6-462b-8eb3-47d183dd8bbe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:14.595462 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ee090a32-2da6-462b-8eb3-47d183dd8bbe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:14.616894 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ad04a21-97cc-4178-b189-9722c2dae5fa tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4" status: 200 len: 328 microversion: 2.1 time: 0.268323 Mar 12 20:49:14.618753 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 210/416] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Mar 12 20:49:14 2022] PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4 => generated 328 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:14.624379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9834d11f-196f-4e68-a543-40c882a4e6da tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:14.647689 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9834d11f-196f-4e68-a543-40c882a4e6da tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026848 Mar 12 20:49:14.648857 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 211/417] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:14 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:14.666706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b8f0eb48-b8e8-4aaf-b196-e7e5f4cf44c5 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1179690341", "id": "bb64f6ea-ff78-4ca5-b956-4d9e7b8c0970", "os-flavor-access:is_public": "True"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:14.674952 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:14.674952 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:14.705387 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b8f0eb48-b8e8-4aaf-b196-e7e5f4cf44c5 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.043175 Mar 12 20:49:14.712593 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 212/418] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:14 2022] POST /compute/v2.1/flavors => generated 507 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:14.718054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8436a5de-f26c-4ff9-ab2a-f01cc1c7ead4 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:14.719100 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:14.719100 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:14.739005 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8436a5de-f26c-4ff9-ab2a-f01cc1c7ead4 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/bb64f6ea-ff78-4ca5-b956-4d9e7b8c0970" status: 202 len: 0 microversion: 2.1 time: 0.025048 Mar 12 20:49:14.746283 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 213/419] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:49:14 2022] DELETE /compute/v2.1/flavors/bb64f6ea-ff78-4ca5-b956-4d9e7b8c0970 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:14.755427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9437e44-d3b5-459d-ad91-5ddbc5c8f542 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:14.782404 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9437e44-d3b5-459d-ad91-5ddbc5c8f542 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.033120 Mar 12 20:49:14.783710 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 214/420] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:14 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:14.803092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f56e828b-41c4-4762-939e-c9f5f0f2d062 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1010215177", "id": 46937990, "os-flavor-access:is_public": "True"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:14.821001 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f56e828b-41c4-4762-939e-c9f5f0f2d062 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.021944 Mar 12 20:49:14.821811 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 215/421] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:14.833160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1482289263", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:14.900568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:49:15.073599 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ee090a32-2da6-462b-8eb3-47d183dd8bbe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:15.081705 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ee090a32-2da6-462b-8eb3-47d183dd8bbe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1471 microversion: 2.1 time: 0.504701 Mar 12 20:49:15.082316 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 207/422] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:14 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1471 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:15.087499 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-aef45268-f940-45b8-b96b-26da31dc12c7 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:15.095009 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-aef45268-f940-45b8-b96b-26da31dc12c7 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/46937990" status: 200 len: 408 microversion: 2.1 time: 0.011348 Mar 12 20:49:15.095614 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 208/423] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:49:15 2022] GET /compute/v2.1/flavors/46937990 => generated 408 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:15.105388 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-942c826a-45dc-48ef-83e9-b0eb041d8b39 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:15.106049 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-942c826a-45dc-48ef-83e9-b0eb041d8b39 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:15.122754 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-942c826a-45dc-48ef-83e9-b0eb041d8b39 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:15.124382 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-942c826a-45dc-48ef-83e9-b0eb041d8b39 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:15.128584 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-942c826a-45dc-48ef-83e9-b0eb041d8b39 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:15.130220 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-942c826a-45dc-48ef-83e9-b0eb041d8b39 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:15.155006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:49:15.155456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:49:15.155886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:49:15.156472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:49:15.157179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:49:15.167578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:15.168170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:15.169086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:15.169579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:15.187660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Getting quotas for project c754c7d2b193497ea0b56f777ed534f4. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:15.191891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Getting quotas for user 890437ebb8de4f269358469845cdd8d9 and project c754c7d2b193497ea0b56f777ed534f4. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:15.205122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.utils [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] instances quota exceeded for c754c7d2b193497ea0b56f777ed534f4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136302) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Mar 12 20:49:15.205977 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Mar 12 20:49:15.206560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:15.207563 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dcffa16c-6c85-485d-a11d-b5747db80bda tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.379187 Mar 12 20:49:15.208695 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 216/424] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:14 2022] POST /compute/v2.1/servers => generated 119 bytes in 386 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:15.404730 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-942c826a-45dc-48ef-83e9-b0eb041d8b39 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:15.411921 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-942c826a-45dc-48ef-83e9-b0eb041d8b39 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.310246 Mar 12 20:49:15.412813 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 209/425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:15 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:15.422633 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-dce2bbc4-966a-4a5e-a092-d278ad9194da tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Action: 'update', calling method: .version_select at 0x7f6e372d6c10>, body: {"quota_set": {"instances": 10}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:15.512999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94f3f0ee-f966-47a5-8496-7ea61bc84134 tempest-FlavorsAdminTestJSON-166328575 tempest-FlavorsAdminTestJSON-166328575-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:15.549524 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94f3f0ee-f966-47a5-8496-7ea61bc84134 tempest-FlavorsAdminTestJSON-166328575 tempest-FlavorsAdminTestJSON-166328575-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6212 microversion: 2.1 time: 0.339611 Mar 12 20:49:15.550760 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 217/426] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:15 2022] GET /compute/v2.1/flavors/detail => generated 6212 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:15.558368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aca0a28c-d79e-4189-989c-a23bb1bfde36 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:15.559125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aca0a28c-d79e-4189-989c-a23bb1bfde36 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:15.569602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aca0a28c-d79e-4189-989c-a23bb1bfde36 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:15.570275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aca0a28c-d79e-4189-989c-a23bb1bfde36 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:15.571300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aca0a28c-d79e-4189-989c-a23bb1bfde36 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:15.571819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aca0a28c-d79e-4189-989c-a23bb1bfde36 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:15.585064 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dce2bbc4-966a-4a5e-a092-d278ad9194da tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:15.585552 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dce2bbc4-966a-4a5e-a092-d278ad9194da tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:15.586402 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dce2bbc4-966a-4a5e-a092-d278ad9194da tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:15.586847 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dce2bbc4-966a-4a5e-a092-d278ad9194da tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:15.643461 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-dce2bbc4-966a-4a5e-a092-d278ad9194da tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4" status: 200 len: 329 microversion: 2.1 time: 0.229378 Mar 12 20:49:15.644038 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 210/427] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Mar 12 20:49:15 2022] PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4 => generated 329 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:15.649034 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8b6e0b1e-f3ec-40e7-b935-c0f8d2667ea3 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:15.649792 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8b6e0b1e-f3ec-40e7-b935-c0f8d2667ea3 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:15.655793 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8b6e0b1e-f3ec-40e7-b935-c0f8d2667ea3 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:15.656484 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8b6e0b1e-f3ec-40e7-b935-c0f8d2667ea3 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:15.657275 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8b6e0b1e-f3ec-40e7-b935-c0f8d2667ea3 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:15.657720 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8b6e0b1e-f3ec-40e7-b935-c0f8d2667ea3 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:15.730999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aca0a28c-d79e-4189-989c-a23bb1bfde36 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:15.744384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aca0a28c-d79e-4189-989c-a23bb1bfde36 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:15.746358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aca0a28c-d79e-4189-989c-a23bb1bfde36 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:15.748050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aca0a28c-d79e-4189-989c-a23bb1bfde36 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1361 microversion: 2.25 time: 0.196157 Mar 12 20:49:15.759992 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 218/428] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:15 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:15.759992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1f196235-beae-4728-b1d2-d26335ffd5cd req-9a2fe7f1-fc9f-41d9-b884-708d6565f159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9c242e-54fc-4196-9994-8f4ee1f315bb", "tag": "82ff1918-4a6e-4bbf-8c05-c4ed1a053981"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:15.762343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1f196235-beae-4728-b1d2-d26335ffd5cd req-9a2fe7f1-fc9f-41d9-b884-708d6565f159 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:15.763238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1f196235-beae-4728-b1d2-d26335ffd5cd req-9a2fe7f1-fc9f-41d9-b884-708d6565f159 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:15.776104 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1f196235-beae-4728-b1d2-d26335ffd5cd req-9a2fe7f1-fc9f-41d9-b884-708d6565f159 service nova] Creating event network-changed:82ff1918-4a6e-4bbf-8c05-c4ed1a053981 for instance 4f9c242e-54fc-4196-9994-8f4ee1f315bb on nch2-master-1 Mar 12 20:49:15.781319 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1f196235-beae-4728-b1d2-d26335ffd5cd req-9a2fe7f1-fc9f-41d9-b884-708d6565f159 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031588 Mar 12 20:49:15.782313 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 219/429] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:15.787248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-48b6c0ee-dc8f-4984-bae8-7b02054eb96d tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:15.789010 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:15.789010 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:15.811467 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-48b6c0ee-dc8f-4984-bae8-7b02054eb96d tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/46937990" status: 202 len: 0 microversion: 2.1 time: 0.027757 Mar 12 20:49:15.812861 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8b6e0b1e-f3ec-40e7-b935-c0f8d2667ea3 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:15.815881 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 220/430] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:49:15 2022] DELETE /compute/v2.1/flavors/46937990 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:15.821503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-adb817ef-7d88-4f8e-9495-1e7e2a972ae2 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Calling method '.version_select at 0x7f6e373344c0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:15.826331 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8b6e0b1e-f3ec-40e7-b935-c0f8d2667ea3 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1318 microversion: 2.1 time: 0.180804 Mar 12 20:49:15.827502 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 211/431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:15 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:15.840369 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b21e1f4a-1736-42df-b95a-f6387f623f53 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:15.863547 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b21e1f4a-1736-42df-b95a-f6387f623f53 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.034659 Mar 12 20:49:15.870326 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 212/432] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:15 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:15.884158 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e11cbfb8-9dd4-4b0a-a4a9-137941176be6 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-31946858", "id": 74739285, "os-flavor-access:is_public": "False"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:15.887912 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:15.887912 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:49:15.906440 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e11cbfb8-9dd4-4b0a-a4a9-137941176be6 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.029752 Mar 12 20:49:15.913087 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 213/433] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:15 2022] POST /compute/v2.1/flavors => generated 422 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:15.918903 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ddd314f3-71db-4c9d-b6a4-fdf6bd5105ab tempest-FlavorsAdminTestJSON-166328575 tempest-FlavorsAdminTestJSON-166328575-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "74739285"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:15.930858 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-ddd314f3-71db-4c9d-b6a4-fdf6bd5105ab tempest-FlavorsAdminTestJSON-166328575 tempest-FlavorsAdminTestJSON-166328575-project] HTTP exception thrown: Flavor 74739285 could not be found. Mar 12 20:49:15.931461 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ddd314f3-71db-4c9d-b6a4-fdf6bd5105ab tempest-FlavorsAdminTestJSON-166328575 tempest-FlavorsAdminTestJSON-166328575-project] Returning 400 to user: Flavor 74739285 could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:15.932291 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ddd314f3-71db-4c9d-b6a4-fdf6bd5105ab tempest-FlavorsAdminTestJSON-166328575 tempest-FlavorsAdminTestJSON-166328575-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 79 microversion: 2.1 time: 0.018250 Mar 12 20:49:15.933948 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 214/434] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:15 2022] POST /compute/v2.1/servers => generated 79 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:49:15.943827 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b3df02ac-568c-453c-bf00-0d4e1fe1bdb7 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:15.945362 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:15.945362 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:49:15.965196 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b3df02ac-568c-453c-bf00-0d4e1fe1bdb7 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/74739285" status: 202 len: 0 microversion: 2.1 time: 0.027170 Mar 12 20:49:15.966063 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 215/435] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 20:49:15 2022] DELETE /compute/v2.1/flavors/74739285 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 20:49:15.974415 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a3a0eb27-55fb-4c40-8517-10331f9bd354 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:15.996010 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a3a0eb27-55fb-4c40-8517-10331f9bd354 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.025145 Mar 12 20:49:15.996823 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 216/436] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:15 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:16.012965 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4fa9f26e-74c3-4461-b22e-53f3ec4695a6 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-789250529", "id": 582212136, "os-flavor-access:is_public": "False"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:16.034020 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4fa9f26e-74c3-4461-b22e-53f3ec4695a6 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.023659 Mar 12 20:49:16.034759 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 217/437] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:16 2022] POST /compute/v2.1/flavors => generated 411 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:16.045376 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2253b672-2b83-4399-9108-13ad2c8ec6cc tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1196836368", "id": 1990004364, "os-flavor-access:is_public": "True"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:16.066658 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2253b672-2b83-4399-9108-13ad2c8ec6cc tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.025565 Mar 12 20:49:16.067480 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 218/438] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:16 2022] POST /compute/v2.1/flavors => generated 414 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:16.079792 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f46480cc-7b5d-423d-a0b7-67e181d344cd tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.097726 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f46480cc-7b5d-423d-a0b7-67e181d344cd tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.022756 Mar 12 20:49:16.098669 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 219/439] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:16.109007 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0eb945ae-1012-43b7-96db-d7f696581f7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.109625 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-0eb945ae-1012-43b7-96db-d7f696581f7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:16.115696 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0eb945ae-1012-43b7-96db-d7f696581f7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:16.116934 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0eb945ae-1012-43b7-96db-d7f696581f7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:16.117969 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0eb945ae-1012-43b7-96db-d7f696581f7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:16.118600 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0eb945ae-1012-43b7-96db-d7f696581f7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:16.163571 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-adb817ef-7d88-4f8e-9495-1e7e2a972ae2 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4" status: 200 len: 371 microversion: 2.1 time: 0.346553 Mar 12 20:49:16.164153 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 221/440] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Mar 12 20:49:15 2022] GET /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4 => generated 371 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:16.174079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dca7b631-fe1d-4158-98af-30c7b819b601 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.190862 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dca7b631-fe1d-4158-98af-30c7b819b601 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.020338 Mar 12 20:49:16.191435 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 222/441] 10.222.0.30 () {58 vars in 1176 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:16.203543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-936d44d1-ee42-406a-9c96-15ab8a27dc56 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Action: 'update', calling method: .version_select at 0x7f6e376fa4c0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:16.372301 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-0eb945ae-1012-43b7-96db-d7f696581f7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:16.380807 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0eb945ae-1012-43b7-96db-d7f696581f7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.280700 Mar 12 20:49:16.391755 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 220/442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:16.398417 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c1824a98-14d2-4ff7-9e56-227c5a936ff3 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.398748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-936d44d1-ee42-406a-9c96-15ab8a27dc56 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:16.399576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-936d44d1-ee42-406a-9c96-15ab8a27dc56 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:16.400594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-936d44d1-ee42-406a-9c96-15ab8a27dc56 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:16.401217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-936d44d1-ee42-406a-9c96-15ab8a27dc56 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:16.409149 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c1824a98-14d2-4ff7-9e56-227c5a936ff3 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.016178 Mar 12 20:49:16.413901 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 221/443] 10.222.0.30 () {58 vars in 1170 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:16.430773 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-35aec552-45e9-42a3-ac2c-9ac44724c6fe tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.439986 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-35aec552-45e9-42a3-ac2c-9ac44724c6fe tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.020030 Mar 12 20:49:16.440732 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 222/444] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:16.447572 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2da5ba9e-d325-4933-a82d-ef08277d09db tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.448193 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-2da5ba9e-d325-4933-a82d-ef08277d09db tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:16.456168 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2da5ba9e-d325-4933-a82d-ef08277d09db tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:16.456628 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2da5ba9e-d325-4933-a82d-ef08277d09db tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:16.457056 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-936d44d1-ee42-406a-9c96-15ab8a27dc56 tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4" status: 200 len: 325 microversion: 2.1 time: 0.257926 Mar 12 20:49:16.457423 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2da5ba9e-d325-4933-a82d-ef08277d09db tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:16.468210 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 223/445] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Mar 12 20:49:16 2022] PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4 => generated 325 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:16.468422 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2da5ba9e-d325-4933-a82d-ef08277d09db tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:16.468525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35d8fd3e-053f-4bef-bd88-f59f4574df90 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.497302 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-35d8fd3e-053f-4bef-bd88-f59f4574df90 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6218 microversion: 2.1 time: 0.038417 Mar 12 20:49:16.498420 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 224/446] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6218 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:16.513454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-77445d2f-6386-4ac0-88c3-fb631fb28e09 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.537754 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-77445d2f-6386-4ac0-88c3-fb631fb28e09 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6218 microversion: 2.1 time: 0.027699 Mar 12 20:49:16.538475 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 225/447] 10.222.0.30 () {58 vars in 1174 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6218 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:16.553047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4201b081-6c76-4e96-a4a6-8cb71e962917 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.577128 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4201b081-6c76-4e96-a4a6-8cb71e962917 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6218 microversion: 2.1 time: 0.027792 Mar 12 20:49:16.578048 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 226/448] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6218 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:16.592938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1c8a1fe-c267-49c8-b9c1-db2b6dfaed1d tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.613449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1c8a1fe-c267-49c8-b9c1-db2b6dfaed1d tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6218 microversion: 2.1 time: 0.023961 Mar 12 20:49:16.614222 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 227/449] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6218 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:16.627433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1020446871", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:16.657583 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2da5ba9e-d325-4933-a82d-ef08277d09db tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:16.665280 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2da5ba9e-d325-4933-a82d-ef08277d09db tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.223567 Mar 12 20:49:16.674852 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 223/450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:16.674852 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-6fae8cf4-ba00-4262-ad76-eb570498ace9 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.674852 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:16.674852 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:49:16.683499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:49:16.691226 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-6fae8cf4-ba00-4262-ad76-eb570498ace9 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1990004364" status: 202 len: 0 microversion: 2.1 time: 0.024279 Mar 12 20:49:16.692117 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 224/451] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Mar 12 20:49:16 2022] DELETE /compute/v2.1/flavors/1990004364 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:16.702570 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7abf2f33-fe3f-434d-9ba7-14775ffe585a tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.722357 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7abf2f33-fe3f-434d-9ba7-14775ffe585a tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.023422 Mar 12 20:49:16.723040 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 225/452] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:16.737123 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3956d43e-d0d3-47dd-bfad-e9777f2d10ad tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.758678 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3956d43e-d0d3-47dd-bfad-e9777f2d10ad tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/582212136" status: 202 len: 0 microversion: 2.1 time: 0.024864 Mar 12 20:49:16.762980 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 226/453] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:49:16 2022] DELETE /compute/v2.1/flavors/582212136 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 20:49:16.769242 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9b2c95f4-997b-4ab9-b23d-839fac264344 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.770405 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9b2c95f4-997b-4ab9-b23d-839fac264344 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:16.776456 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9b2c95f4-997b-4ab9-b23d-839fac264344 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:16.776931 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9b2c95f4-997b-4ab9-b23d-839fac264344 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:16.778086 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9b2c95f4-997b-4ab9-b23d-839fac264344 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:16.778910 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9b2c95f4-997b-4ab9-b23d-839fac264344 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:16.901939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:49:16.902369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:49:16.902851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:49:16.903267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:49:16.903697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:49:16.912597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:16.913063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:16.913918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:16.914361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:16.932820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Getting quotas for project c754c7d2b193497ea0b56f777ed534f4. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:16.936985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Getting quotas for user 890437ebb8de4f269358469845cdd8d9 and project c754c7d2b193497ea0b56f777ed534f4. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:16.948557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.utils [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] ram quota exceeded for c754c7d2b193497ea0b56f777ed534f4, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136302) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Mar 12 20:49:16.949180 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Mar 12 20:49:16.949871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:16.950797 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3590f591-cc6a-4a6c-9fc5-b63f25b293fc tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.335755 Mar 12 20:49:16.951662 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 228/454] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:16 2022] POST /compute/v2.1/servers => generated 110 bytes in 337 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:16.955835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a288f4d2-ae1f-4eb5-bdeb-b906b27a52a2 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.976058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a288f4d2-ae1f-4eb5-bdeb-b906b27a52a2 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.023028 Mar 12 20:49:16.976774 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 229/455] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:16.987347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-182eb2d9-aa69-45da-bd02-278dc9148fd8 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:16.988410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-182eb2d9-aa69-45da-bd02-278dc9148fd8 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:16.994863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-182eb2d9-aa69-45da-bd02-278dc9148fd8 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:16.995358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-182eb2d9-aa69-45da-bd02-278dc9148fd8 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:16.996143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-182eb2d9-aa69-45da-bd02-278dc9148fd8 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:16.996786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-182eb2d9-aa69-45da-bd02-278dc9148fd8 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:17.056025 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9b2c95f4-997b-4ab9-b23d-839fac264344 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:17.068397 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9b2c95f4-997b-4ab9-b23d-839fac264344 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:17.071209 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9b2c95f4-997b-4ab9-b23d-839fac264344 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:17.072601 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9b2c95f4-997b-4ab9-b23d-839fac264344 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1361 microversion: 2.25 time: 0.308152 Mar 12 20:49:17.073346 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 227/456] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:17.079066 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-743e6632-cb1c-4e11-83b4-332be315471b tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Action: 'update', calling method: .version_select at 0x7f6e372dd9d0>, body: {"quota_set": {"ram": 51200}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:17.152100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-182eb2d9-aa69-45da-bd02-278dc9148fd8 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:17.162492 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-182eb2d9-aa69-45da-bd02-278dc9148fd8 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1318 microversion: 2.1 time: 0.184619 Mar 12 20:49:17.163967 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 230/457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:16 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:17.289570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ee1e45d-6c95-4966-bd0c-af3922104f29 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Calling method '.version_select at 0x7f6e37334700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:17.301070 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-743e6632-cb1c-4e11-83b4-332be315471b tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:17.301588 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-743e6632-cb1c-4e11-83b4-332be315471b tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:17.302583 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-743e6632-cb1c-4e11-83b4-332be315471b tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:17.303020 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-743e6632-cb1c-4e11-83b4-332be315471b tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:17.362160 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-743e6632-cb1c-4e11-83b4-332be315471b tempest-QuotasAdminNegativeTest-1051043359 tempest-QuotasAdminNegativeTest-1051043359-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4" status: 200 len: 329 microversion: 2.1 time: 0.287515 Mar 12 20:49:17.363111 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 228/458] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Mar 12 20:49:17 2022] PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4 => generated 329 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:17.369912 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d4a8368e-b6c6-42a9-98c1-6d971f64fa45 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1403900642", "id": 357928909, "os-flavor-access:is_public": "False"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:17.372110 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:17.372110 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:49:17.382091 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ee1e45d-6c95-4966-bd0c-af3922104f29 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/71274c5a62f54bb2946a024c7a2b7ea5" status: 200 len: 371 microversion: 2.1 time: 0.215386 Mar 12 20:49:17.386309 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 231/459] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Mar 12 20:49:17 2022] GET /compute/v2.1/os-quota-sets/71274c5a62f54bb2946a024c7a2b7ea5 => generated 371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:17.393660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5fcdb5b3-8f78-4745-9cbe-d8e3b7ba6a63 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Action: 'update', calling method: .version_select at 0x7f6e37365dc0>, body: {"quota_set": {"ram": 0}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:17.393909 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d4a8368e-b6c6-42a9-98c1-6d971f64fa45 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.029398 Mar 12 20:49:17.395235 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 229/460] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:17 2022] POST /compute/v2.1/flavors => generated 412 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:17.395345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5fcdb5b3-8f78-4745-9cbe-d8e3b7ba6a63 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '890437ebb8de4f269358469845cdd8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c754c7d2b193497ea0b56f777ed534f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:17.395950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5fcdb5b3-8f78-4745-9cbe-d8e3b7ba6a63 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:17.396749 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5fcdb5b3-8f78-4745-9cbe-d8e3b7ba6a63 tempest-QuotasAdminNegativeTest-1868000985 tempest-QuotasAdminNegativeTest-1868000985-project] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4" status: 403 len: 116 microversion: 2.1 time: 0.009055 Mar 12 20:49:17.398105 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 232/461] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Mar 12 20:49:17 2022] PUT /compute/v2.1/os-quota-sets/c754c7d2b193497ea0b56f777ed534f4 => generated 116 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:17.400681 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2351f287-259a-4e08-a913-b934651a8c84 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Action: 'update', calling method: .version_select at 0x7f6e374bda60>, body: {"quota_set": {"ram": "5120"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:17.407783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd092d87-264b-4535-97d9-27bfe1070a47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:17.408608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dd092d87-264b-4535-97d9-27bfe1070a47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:17.415179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd092d87-264b-4535-97d9-27bfe1070a47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:17.415863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd092d87-264b-4535-97d9-27bfe1070a47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:17.417195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd092d87-264b-4535-97d9-27bfe1070a47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:17.417834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd092d87-264b-4535-97d9-27bfe1070a47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:17.474879 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2351f287-259a-4e08-a913-b934651a8c84 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:17.475831 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2351f287-259a-4e08-a913-b934651a8c84 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:17.476764 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2351f287-259a-4e08-a913-b934651a8c84 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:17.477314 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2351f287-259a-4e08-a913-b934651a8c84 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:17.529621 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2351f287-259a-4e08-a913-b934651a8c84 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/71274c5a62f54bb2946a024c7a2b7ea5" status: 200 len: 328 microversion: 2.1 time: 0.133449 Mar 12 20:49:17.535027 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 230/462] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Mar 12 20:49:17 2022] PUT /compute/v2.1/os-quota-sets/71274c5a62f54bb2946a024c7a2b7ea5 => generated 328 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:17.540678 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9db5e368-9bc1-4dde-bb84-f04ae4f5becb tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:17.562052 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9db5e368-9bc1-4dde-bb84-f04ae4f5becb tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.025320 Mar 12 20:49:17.562872 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 231/463] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:17 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:17.577357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dd092d87-264b-4535-97d9-27bfe1070a47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:17.578262 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9588c212-8dc9-4d37-87c4-31843b665c34 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:17.586716 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd092d87-264b-4535-97d9-27bfe1070a47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.187370 Mar 12 20:49:17.587876 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 233/464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:17 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:17.592098 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9588c212-8dc9-4d37-87c4-31843b665c34 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-quota-sets/71274c5a62f54bb2946a024c7a2b7ea5" status: 202 len: 0 microversion: 2.1 time: 0.017722 Mar 12 20:49:17.592984 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 232/465] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 20:49:17 2022] DELETE /compute/v2.1/os-quota-sets/71274c5a62f54bb2946a024c7a2b7ea5 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:17.593660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d56b4b49-1c2a-4357-a32b-a06040fb6a02 tempest-FlavorsAdminTestJSON-166328575 tempest-FlavorsAdminTestJSON-166328575-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:17.601827 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a5a143b9-8577-4cef-ae31-fcda2f94f5e0 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Calling method '.version_select at 0x7f6e3743b310>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:17.630919 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d56b4b49-1c2a-4357-a32b-a06040fb6a02 tempest-FlavorsAdminTestJSON-166328575 tempest-FlavorsAdminTestJSON-166328575-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.040814 Mar 12 20:49:17.632358 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 234/466] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:17 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:17.648241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-833df5a0-1daf-49f2-8cd9-21ba304fdf6f tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:17.648751 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:17.648751 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:17.666471 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-833df5a0-1daf-49f2-8cd9-21ba304fdf6f tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/357928909" status: 202 len: 0 microversion: 2.1 time: 0.023250 Mar 12 20:49:17.667060 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 235/467] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:49:17 2022] DELETE /compute/v2.1/flavors/357928909 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:17.675039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d77ff35-3c3f-437f-a649-4e4d1c51ae4b tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:17.695843 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d77ff35-3c3f-437f-a649-4e4d1c51ae4b tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.024252 Mar 12 20:49:17.696444 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 236/468] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:17 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:17.723044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a81a715c-7a99-445f-ba72-2dddece8b717 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:17.723668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a81a715c-7a99-445f-ba72-2dddece8b717 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:17.733009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a81a715c-7a99-445f-ba72-2dddece8b717 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:17.733549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a81a715c-7a99-445f-ba72-2dddece8b717 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:17.734278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a81a715c-7a99-445f-ba72-2dddece8b717 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:17.734720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a81a715c-7a99-445f-ba72-2dddece8b717 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:17.800396 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a5a143b9-8577-4cef-ae31-fcda2f94f5e0 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/71274c5a62f54bb2946a024c7a2b7ea5" status: 200 len: 371 microversion: 2.1 time: 0.203588 Mar 12 20:49:17.800984 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 233/469] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Mar 12 20:49:17 2022] GET /compute/v2.1/os-quota-sets/71274c5a62f54bb2946a024c7a2b7ea5 => generated 371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:17.809597 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b89a17de-21e7-4f69-8f75-d779699e0c2f tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1314375580", "id": 1404302662, "os-flavor-access:is_public": "True"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:17.851300 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b89a17de-21e7-4f69-8f75-d779699e0c2f tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.045962 Mar 12 20:49:17.852233 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 234/470] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:17 2022] POST /compute/v2.1/flavors => generated 414 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:17.864797 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-776aac27-2d1b-4c87-905a-8b530d6c1fd7 tempest-FlavorsAdminTestJSON-166328575 tempest-FlavorsAdminTestJSON-166328575-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:17.905576 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-776aac27-2d1b-4c87-905a-8b530d6c1fd7 tempest-FlavorsAdminTestJSON-166328575 tempest-FlavorsAdminTestJSON-166328575-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.046711 Mar 12 20:49:17.907372 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 235/471] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:17 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:17.934605 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f25e7bdd-55ab-4654-8603-7c6237268421 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:17.935587 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:17.935587 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:49:17.972274 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f25e7bdd-55ab-4654-8603-7c6237268421 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1404302662" status: 202 len: 0 microversion: 2.1 time: 0.050083 Mar 12 20:49:17.973653 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 236/472] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Mar 12 20:49:17 2022] DELETE /compute/v2.1/flavors/1404302662 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:17.982078 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-35440da0-c85a-4650-ab91-2cf0966ea363 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:17.990333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a81a715c-7a99-445f-ba72-2dddece8b717 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:17.999732 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a81a715c-7a99-445f-ba72-2dddece8b717 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.290950 Mar 12 20:49:18.003963 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 237/473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:17 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:18.023990 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-35440da0-c85a-4650-ab91-2cf0966ea363 tempest-FlavorsAdminTestJSON-1504672836 tempest-FlavorsAdminTestJSON-1504672836-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.044978 Mar 12 20:49:18.030871 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 237/474] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:17 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:18.031752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25a945ec-de09-40e0-9159-f576f853f119 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Calling method '.version_select at 0x7f6e376fab80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:18.092728 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8b1a4942-580f-464c-9438-83fdc6c97c06 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:18.093288 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8b1a4942-580f-464c-9438-83fdc6c97c06 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:18.103601 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8b1a4942-580f-464c-9438-83fdc6c97c06 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:18.104068 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8b1a4942-580f-464c-9438-83fdc6c97c06 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:18.110217 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8b1a4942-580f-464c-9438-83fdc6c97c06 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:18.110791 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8b1a4942-580f-464c-9438-83fdc6c97c06 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:18.399887 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-25a945ec-de09-40e0-9159-f576f853f119 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/18d52938f6f24453af94c6d6af92ef4e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.372363 Mar 12 20:49:18.408091 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 238/475] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 20:49:18 2022] GET /compute/v2.1/os-quota-sets/18d52938f6f24453af94c6d6af92ef4e/defaults => generated 371 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:18.413697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9d8741d4-caa7-46ce-9c88-64ae3d6886cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:18.414377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9d8741d4-caa7-46ce-9c88-64ae3d6886cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:18.430701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d8741d4-caa7-46ce-9c88-64ae3d6886cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:18.431278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d8741d4-caa7-46ce-9c88-64ae3d6886cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:18.432167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d8741d4-caa7-46ce-9c88-64ae3d6886cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:18.432558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d8741d4-caa7-46ce-9c88-64ae3d6886cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:18.641544 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8b1a4942-580f-464c-9438-83fdc6c97c06 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:18.652549 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8b1a4942-580f-464c-9438-83fdc6c97c06 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:18.656399 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8b1a4942-580f-464c-9438-83fdc6c97c06 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:18.658651 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8b1a4942-580f-464c-9438-83fdc6c97c06 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1361 microversion: 2.25 time: 0.570673 Mar 12 20:49:18.672904 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 238/476] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:18 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1361 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:49:18.689394 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-bffa1768-962d-4dd0-850d-09ad6d091d23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:18.692439 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-bffa1768-962d-4dd0-850d-09ad6d091d23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:18.708224 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bffa1768-962d-4dd0-850d-09ad6d091d23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:18.711794 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bffa1768-962d-4dd0-850d-09ad6d091d23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:18.712845 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bffa1768-962d-4dd0-850d-09ad6d091d23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:18.713297 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bffa1768-962d-4dd0-850d-09ad6d091d23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:18.723518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9d8741d4-caa7-46ce-9c88-64ae3d6886cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:18.740806 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9d8741d4-caa7-46ce-9c88-64ae3d6886cb tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1318 microversion: 2.1 time: 0.337614 Mar 12 20:49:18.753008 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 239/477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:18 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:18.961855 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-bffa1768-962d-4dd0-850d-09ad6d091d23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:18.974700 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-bffa1768-962d-4dd0-850d-09ad6d091d23 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.296735 Mar 12 20:49:18.976220 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 239/478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:18 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:19.019959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-514be478-e63a-4194-a4ad-632123e1bb7c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:19.020625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-514be478-e63a-4194-a4ad-632123e1bb7c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:19.030324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-514be478-e63a-4194-a4ad-632123e1bb7c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:19.031074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-514be478-e63a-4194-a4ad-632123e1bb7c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:19.032056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-514be478-e63a-4194-a4ad-632123e1bb7c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:19.032668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-514be478-e63a-4194-a4ad-632123e1bb7c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:19.128870 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-65ea881c-6903-42ca-b51d-b244abad7aac tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Action: 'update', calling method: .version_select at 0x7f6e372dd1f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:19.346533 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-65ea881c-6903-42ca-b51d-b244abad7aac tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:19.346989 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-65ea881c-6903-42ca-b51d-b244abad7aac tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:19.348004 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-65ea881c-6903-42ca-b51d-b244abad7aac tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:19.348450 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-65ea881c-6903-42ca-b51d-b244abad7aac tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:19.388567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-514be478-e63a-4194-a4ad-632123e1bb7c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:19.396544 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-514be478-e63a-4194-a4ad-632123e1bb7c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1504 microversion: 2.1 time: 0.382013 Mar 12 20:49:19.397479 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 240/479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:19 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:19.399320 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-65ea881c-6903-42ca-b51d-b244abad7aac tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/a1c43e35f47f42cf84c0f32dbb50b0cf" status: 200 len: 328 microversion: 2.1 time: 0.274048 Mar 12 20:49:19.400011 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 240/480] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Mar 12 20:49:19 2022] PUT /compute/v2.1/os-quota-sets/a1c43e35f47f42cf84c0f32dbb50b0cf => generated 328 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:19.410158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce8af941-4945-491b-8a7f-6a4294ddc343 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Calling method '.version_select at 0x7f6e37365550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:19.577290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce8af941-4945-491b-8a7f-6a4294ddc343 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:19.577742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce8af941-4945-491b-8a7f-6a4294ddc343 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:19.578786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce8af941-4945-491b-8a7f-6a4294ddc343 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:19.579470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce8af941-4945-491b-8a7f-6a4294ddc343 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:19.599475 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce8af941-4945-491b-8a7f-6a4294ddc343 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/a1c43e35f47f42cf84c0f32dbb50b0cf/detail" status: 200 len: 916 microversion: 2.1 time: 0.193246 Mar 12 20:49:19.600682 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 241/481] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:49:19 2022] GET /compute/v2.1/os-quota-sets/a1c43e35f47f42cf84c0f32dbb50b0cf/detail => generated 916 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:19.682616 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ded0e21f-0a54-406c-b8cb-ec0ae2409306 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:19.683480 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ded0e21f-0a54-406c-b8cb-ec0ae2409306 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:19.690487 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ded0e21f-0a54-406c-b8cb-ec0ae2409306 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:19.691198 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ded0e21f-0a54-406c-b8cb-ec0ae2409306 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:19.692358 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ded0e21f-0a54-406c-b8cb-ec0ae2409306 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:19.693061 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ded0e21f-0a54-406c-b8cb-ec0ae2409306 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:19.759431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-afbb94ca-6521-4dc3-b0f8-ea1da87f30ac tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:19.760067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-afbb94ca-6521-4dc3-b0f8-ea1da87f30ac tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:19.775503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afbb94ca-6521-4dc3-b0f8-ea1da87f30ac tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:19.781238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afbb94ca-6521-4dc3-b0f8-ea1da87f30ac tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:19.782246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afbb94ca-6521-4dc3-b0f8-ea1da87f30ac tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:19.782703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afbb94ca-6521-4dc3-b0f8-ea1da87f30ac tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:19.873589 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ded0e21f-0a54-406c-b8cb-ec0ae2409306 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:19.882691 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ded0e21f-0a54-406c-b8cb-ec0ae2409306 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:19.886456 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ded0e21f-0a54-406c-b8cb-ec0ae2409306 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:19.888075 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ded0e21f-0a54-406c-b8cb-ec0ae2409306 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1361 microversion: 2.25 time: 0.210686 Mar 12 20:49:19.894942 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 241/482] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:19 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:19.978669 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-175221f1-598d-45c7-8773-1eb2ffb3558e req-ef2fb147-271c-46c7-a8d6-d09272ed6f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14193145-27d3-461c-90a6-4073d822b2ed", "name": "network-vif-plugged", "status": "completed", "tag": "af3d31be-a410-4472-8a18-7fb92f819cfb"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:19.994734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-afbb94ca-6521-4dc3-b0f8-ea1da87f30ac tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:19.994858 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-175221f1-598d-45c7-8773-1eb2ffb3558e req-ef2fb147-271c-46c7-a8d6-d09272ed6f9b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:19.997111 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-175221f1-598d-45c7-8773-1eb2ffb3558e req-ef2fb147-271c-46c7-a8d6-d09272ed6f9b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.004081 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-afbb94ca-6521-4dc3-b0f8-ea1da87f30ac tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1318 microversion: 2.1 time: 0.249060 Mar 12 20:49:20.015588 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 242/483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:19 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:20.021385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9af0039b-82b4-48a5-83f8-23f3e6d0194b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:20.022769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9af0039b-82b4-48a5-83f8-23f3e6d0194b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:20.030165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9af0039b-82b4-48a5-83f8-23f3e6d0194b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.030777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9af0039b-82b4-48a5-83f8-23f3e6d0194b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.031853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9af0039b-82b4-48a5-83f8-23f3e6d0194b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.032474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9af0039b-82b4-48a5-83f8-23f3e6d0194b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.036760 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-175221f1-598d-45c7-8773-1eb2ffb3558e req-ef2fb147-271c-46c7-a8d6-d09272ed6f9b service nova] Creating event network-vif-plugged:af3d31be-a410-4472-8a18-7fb92f819cfb for instance 14193145-27d3-461c-90a6-4073d822b2ed on nch2-master-1 Mar 12 20:49:20.049278 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-175221f1-598d-45c7-8773-1eb2ffb3558e req-ef2fb147-271c-46c7-a8d6-d09272ed6f9b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076673 Mar 12 20:49:20.054306 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 242/484] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:20.091342 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7b7540c6-8891-4242-be4d-2e9d60cd6c34 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Action: 'update', calling method: .version_select at 0x7f6e3731baf0>, body: {"quota_set": {"ram": "2048"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:20.246140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9af0039b-82b4-48a5-83f8-23f3e6d0194b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:20.256837 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9af0039b-82b4-48a5-83f8-23f3e6d0194b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.239367 Mar 12 20:49:20.258479 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 243/485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:20 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:20.415602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1682d0bb-8b06-44fe-8e70-13d88e4296ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:20.416874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1682d0bb-8b06-44fe-8e70-13d88e4296ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:20.429892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1682d0bb-8b06-44fe-8e70-13d88e4296ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.431165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1682d0bb-8b06-44fe-8e70-13d88e4296ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.432874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1682d0bb-8b06-44fe-8e70-13d88e4296ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.434012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1682d0bb-8b06-44fe-8e70-13d88e4296ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.445141 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b7540c6-8891-4242-be4d-2e9d60cd6c34 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.445653 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b7540c6-8891-4242-be4d-2e9d60cd6c34 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.446564 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b7540c6-8891-4242-be4d-2e9d60cd6c34 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.447014 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b7540c6-8891-4242-be4d-2e9d60cd6c34 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.504040 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b7540c6-8891-4242-be4d-2e9d60cd6c34 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.504639 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b7540c6-8891-4242-be4d-2e9d60cd6c34 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.505449 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b7540c6-8891-4242-be4d-2e9d60cd6c34 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.506212 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b7540c6-8891-4242-be4d-2e9d60cd6c34 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.575175 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7b7540c6-8891-4242-be4d-2e9d60cd6c34 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/a1c43e35f47f42cf84c0f32dbb50b0cf?user_id=bffb52f154b240cd8520f3e79c6fb5c8" status: 200 len: 328 microversion: 2.1 time: 0.487827 Mar 12 20:49:20.576051 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 243/486] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Mar 12 20:49:20 2022] PUT /compute/v2.1/os-quota-sets/a1c43e35f47f42cf84c0f32dbb50b0cf?user_id=bffb52f154b240cd8520f3e79c6fb5c8 => generated 328 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:20.586148 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-db211be3-66cd-436e-9b21-b3f4ac2ebd6c tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Calling method '.version_select at 0x7f6e37283a60>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:20.656563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1682d0bb-8b06-44fe-8e70-13d88e4296ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:20.667688 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1682d0bb-8b06-44fe-8e70-13d88e4296ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1494 microversion: 2.1 time: 0.256572 Mar 12 20:49:20.668549 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 244/487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:20 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1494 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:20.688220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ffba5d24-c286-4584-ac37-fe74918cc02f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '.version_select at 0x7f6e3731fdc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:20.691173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffba5d24-c286-4584-ac37-fe74918cc02f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.691783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffba5d24-c286-4584-ac37-fe74918cc02f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.710967 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ffba5d24-c286-4584-ac37-fe74918cc02f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.028885 Mar 12 20:49:20.711568 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 245/488] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 20:49:20 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:20.724303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-19c06792-6617-4307-b968-ce4b8658cc06 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:20.724888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19c06792-6617-4307-b968-ce4b8658cc06 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:20.731326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19c06792-6617-4307-b968-ce4b8658cc06 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.732049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19c06792-6617-4307-b968-ce4b8658cc06 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.732858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19c06792-6617-4307-b968-ce4b8658cc06 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.733302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19c06792-6617-4307-b968-ce4b8658cc06 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.894585 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-19c06792-6617-4307-b968-ce4b8658cc06 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1645 microversion: 2.1 time: 0.175132 Mar 12 20:49:20.907707 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 246/489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:20 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1645 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:20.926440 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-db211be3-66cd-436e-9b21-b3f4ac2ebd6c tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/a1c43e35f47f42cf84c0f32dbb50b0cf?user_id=bffb52f154b240cd8520f3e79c6fb5c8" status: 200 len: 370 microversion: 2.1 time: 0.344131 Mar 12 20:49:20.927425 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 244/490] 10.222.0.30 () {58 vars in 1322 bytes} [Sat Mar 12 20:49:20 2022] GET /compute/v2.1/os-quota-sets/a1c43e35f47f42cf84c0f32dbb50b0cf?user_id=bffb52f154b240cd8520f3e79c6fb5c8 => generated 370 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:20.928164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0caaea37-9a33-4620-8ba1-6f2ceb3d3f32 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:20.929309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0caaea37-9a33-4620-8ba1-6f2ceb3d3f32 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:20.935575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0caaea37-9a33-4620-8ba1-6f2ceb3d3f32 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.936039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0caaea37-9a33-4620-8ba1-6f2ceb3d3f32 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:20.936828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0caaea37-9a33-4620-8ba1-6f2ceb3d3f32 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:20.937276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0caaea37-9a33-4620-8ba1-6f2ceb3d3f32 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:21.027554 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d64f1160-b539-43fe-9b97-c95d34817af2 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:21.029108 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d64f1160-b539-43fe-9b97-c95d34817af2 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:21.035838 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d64f1160-b539-43fe-9b97-c95d34817af2 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:21.036989 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d64f1160-b539-43fe-9b97-c95d34817af2 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:21.038948 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d64f1160-b539-43fe-9b97-c95d34817af2 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:21.039948 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d64f1160-b539-43fe-9b97-c95d34817af2 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:21.091080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0caaea37-9a33-4620-8ba1-6f2ceb3d3f32 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:21.104068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0caaea37-9a33-4620-8ba1-6f2ceb3d3f32 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:21.106169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0caaea37-9a33-4620-8ba1-6f2ceb3d3f32 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:21.107767 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0caaea37-9a33-4620-8ba1-6f2ceb3d3f32 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1361 microversion: 2.25 time: 0.198573 Mar 12 20:49:21.108590 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 247/491] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:20 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:21.120956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1953756830", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "4b8a32df-ad87-496b-8291-8d1bc2a20fb0"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:21.179279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] validate_networks() for [('4b8a32df-ad87-496b-8291-8d1bc2a20fb0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:49:21.212362 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d64f1160-b539-43fe-9b97-c95d34817af2 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:21.224460 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d64f1160-b539-43fe-9b97-c95d34817af2 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1318 microversion: 2.1 time: 0.204715 Mar 12 20:49:21.225898 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 245/492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:21 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:21.276779 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f9df5845-9ab9-4a44-a323-e00db81fa438 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:21.277733 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f9df5845-9ab9-4a44-a323-e00db81fa438 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:21.290777 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f9df5845-9ab9-4a44-a323-e00db81fa438 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:21.291808 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f9df5845-9ab9-4a44-a323-e00db81fa438 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:21.293137 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f9df5845-9ab9-4a44-a323-e00db81fa438 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:21.293961 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f9df5845-9ab9-4a44-a323-e00db81fa438 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:21.483464 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f9df5845-9ab9-4a44-a323-e00db81fa438 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:21.495858 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f9df5845-9ab9-4a44-a323-e00db81fa438 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.224758 Mar 12 20:49:21.505430 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 246/493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:21 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:21.561533 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d522b29a-23c8-411f-98cf-1ec9664c2b03 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Calling method '.version_select at 0x7f6e372b2a60>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:21.653536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:49:21.654108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:49:21.654459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:49:21.654803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:49:21.655795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:49:21.665338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:21.665814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:21.666570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:21.667011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:21.685640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Getting quotas for project c248ec2e2f0c457291cd412812c08e5a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:21.689682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Getting quotas for user a7854cfb82544a70aee1a7d421bfce55 and project c248ec2e2f0c457291cd412812c08e5a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:21.702279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:49:21.705870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:49:21.767956 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d38289b-0806-41db-979c-74b15864530b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657094 Mar 12 20:49:21.775077 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 248/494] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:49:21.781451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a51395d9-7980-4cb3-aed0-402145c87f6f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:21.782462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a51395d9-7980-4cb3-aed0-402145c87f6f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:21.850663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a51395d9-7980-4cb3-aed0-402145c87f6f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:21.858504 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a51395d9-7980-4cb3-aed0-402145c87f6f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1211 microversion: 2.1 time: 0.082272 Mar 12 20:49:21.860351 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 249/495] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:21 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:21.968576 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d522b29a-23c8-411f-98cf-1ec9664c2b03 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/18d52938f6f24453af94c6d6af92ef4e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.414683 Mar 12 20:49:21.969911 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 247/496] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 20:49:21 2022] GET /compute/v2.1/os-quota-sets/18d52938f6f24453af94c6d6af92ef4e/defaults => generated 371 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:21.981291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eb789297-543d-4583-8e7f-20a3ab864a97 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Action: 'update', calling method: .version_select at 0x7f6e37334c10>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:22.075582 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-8a96d742-a02c-4f4f-a727-04912598f50e req-faeb93c4-fefe-4e7f-9d25-6f11bd537796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9c242e-54fc-4196-9994-8f4ee1f315bb", "name": "network-vif-plugged", "status": "completed", "tag": "82ff1918-4a6e-4bbf-8c05-c4ed1a053981"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:22.091244 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-8a96d742-a02c-4f4f-a727-04912598f50e req-faeb93c4-fefe-4e7f-9d25-6f11bd537796 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:22.091698 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-8a96d742-a02c-4f4f-a727-04912598f50e req-faeb93c4-fefe-4e7f-9d25-6f11bd537796 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:22.120225 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-8a96d742-a02c-4f4f-a727-04912598f50e req-faeb93c4-fefe-4e7f-9d25-6f11bd537796 service nova] Creating event network-vif-plugged:82ff1918-4a6e-4bbf-8c05-c4ed1a053981 for instance 4f9c242e-54fc-4196-9994-8f4ee1f315bb on nch2-master-1 Mar 12 20:49:22.129935 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-8a96d742-a02c-4f4f-a727-04912598f50e req-faeb93c4-fefe-4e7f-9d25-6f11bd537796 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056833 Mar 12 20:49:22.139485 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 248/497] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:22.144898 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8c16f2b4-396f-48ff-b606-efd683dfb762 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:22.145597 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8c16f2b4-396f-48ff-b606-efd683dfb762 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:22.164633 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8c16f2b4-396f-48ff-b606-efd683dfb762 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:22.164991 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8c16f2b4-396f-48ff-b606-efd683dfb762 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:22.169998 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8c16f2b4-396f-48ff-b606-efd683dfb762 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:22.170545 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8c16f2b4-396f-48ff-b606-efd683dfb762 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:22.365332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb789297-543d-4583-8e7f-20a3ab864a97 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:22.367595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb789297-543d-4583-8e7f-20a3ab864a97 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:22.368625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb789297-543d-4583-8e7f-20a3ab864a97 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:22.369991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb789297-543d-4583-8e7f-20a3ab864a97 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:22.381918 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8c16f2b4-396f-48ff-b606-efd683dfb762 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:22.391199 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8c16f2b4-396f-48ff-b606-efd683dfb762 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:22.393228 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8c16f2b4-396f-48ff-b606-efd683dfb762 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:22.394842 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8c16f2b4-396f-48ff-b606-efd683dfb762 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1361 microversion: 2.25 time: 0.254151 Mar 12 20:49:22.395574 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 249/498] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:22 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:22.400193 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-87e8f28d-65a6-4648-b105-fd1f3ecff3d9 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:22.401007 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-87e8f28d-65a6-4648-b105-fd1f3ecff3d9 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:22.411056 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-87e8f28d-65a6-4648-b105-fd1f3ecff3d9 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:22.411842 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-87e8f28d-65a6-4648-b105-fd1f3ecff3d9 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:22.413730 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-87e8f28d-65a6-4648-b105-fd1f3ecff3d9 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:22.414465 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-87e8f28d-65a6-4648-b105-fd1f3ecff3d9 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:22.572319 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-87e8f28d-65a6-4648-b105-fd1f3ecff3d9 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:22.584609 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-87e8f28d-65a6-4648-b105-fd1f3ecff3d9 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1467 microversion: 2.1 time: 0.187111 Mar 12 20:49:22.585542 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 250/499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:22 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1467 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:22.632588 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eb789297-543d-4583-8e7f-20a3ab864a97 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/18d52938f6f24453af94c6d6af92ef4e" status: 200 len: 329 microversion: 2.1 time: 0.656153 Mar 12 20:49:22.633632 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 250/500] 10.222.0.30 () {60 vars in 1262 bytes} [Sat Mar 12 20:49:21 2022] PUT /compute/v2.1/os-quota-sets/18d52938f6f24453af94c6d6af92ef4e => generated 329 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:22.642523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-98165186-0ec7-4d29-9db0-0c4e3bd58417 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:22.643768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-98165186-0ec7-4d29-9db0-0c4e3bd58417 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:22.651563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98165186-0ec7-4d29-9db0-0c4e3bd58417 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:22.652092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98165186-0ec7-4d29-9db0-0c4e3bd58417 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:22.652948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98165186-0ec7-4d29-9db0-0c4e3bd58417 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:22.653490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98165186-0ec7-4d29-9db0-0c4e3bd58417 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:22.783787 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-623013214", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:22.827959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-98165186-0ec7-4d29-9db0-0c4e3bd58417 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:22.841262 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-98165186-0ec7-4d29-9db0-0c4e3bd58417 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.206449 Mar 12 20:49:22.841790 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.neutron [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] validate_networks() for None {{(pid=136303) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:49:22.841922 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 251/501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:22 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:22.846318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25143568-0b2c-4deb-a180-6794747fbff4 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:22.846846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-25143568-0b2c-4deb-a180-6794747fbff4 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:22.857048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25143568-0b2c-4deb-a180-6794747fbff4 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:22.857635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25143568-0b2c-4deb-a180-6794747fbff4 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:22.858605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25143568-0b2c-4deb-a180-6794747fbff4 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:22.859303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25143568-0b2c-4deb-a180-6794747fbff4 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:22.883504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-25143568-0b2c-4deb-a180-6794747fbff4 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lazy-loading 'flavor' on Instance uuid 14193145-27d3-461c-90a6-4073d822b2ed {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:49:22.953987 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-25143568-0b2c-4deb-a180-6794747fbff4 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed/action" status: 202 len: 0 microversion: 2.1 time: 0.109631 Mar 12 20:49:22.954730 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 252/502] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:49:22 2022] POST /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:22.961060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09db1c9b-8721-4e1d-996a-7510ed9486f7 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Action: 'update', calling method: .version_select at 0x7f6e37283a60>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:23.062267 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:49:23.063173 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:49:23.064015 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:49:23.064657 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:49:23.065473 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:49:23.080092 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:23.081548 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:23.082722 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:23.083304 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:23.104882 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Getting quotas for project f569aa4fb0c34fbf8b56338342d08162. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:23.109483 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Getting quotas for user 07b0de7f0b2847e9a6cf5effd9c43a50 and project f569aa4fb0c34fbf8b56338342d08162. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:23.122636 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Going to run 1 instances... {{(pid=136303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:49:23.125493 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:49:23.185826 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a2144d84-1c6f-42b3-831a-c92d2b2b5550 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598411 Mar 12 20:49:23.186573 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 251/503] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:49:23.191542 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4e97c780-c8a0-4ff9-b92d-15732a1ff00a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:23.192430 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4e97c780-c8a0-4ff9-b92d-15732a1ff00a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:23.197603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09db1c9b-8721-4e1d-996a-7510ed9486f7 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:23.198547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09db1c9b-8721-4e1d-996a-7510ed9486f7 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:23.200175 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4e97c780-c8a0-4ff9-b92d-15732a1ff00a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:23.200767 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4e97c780-c8a0-4ff9-b92d-15732a1ff00a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:23.201508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09db1c9b-8721-4e1d-996a-7510ed9486f7 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:23.202116 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4e97c780-c8a0-4ff9-b92d-15732a1ff00a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:23.202638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09db1c9b-8721-4e1d-996a-7510ed9486f7 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:23.202874 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4e97c780-c8a0-4ff9-b92d-15732a1ff00a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:23.296775 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4e97c780-c8a0-4ff9-b92d-15732a1ff00a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:23.305411 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4e97c780-c8a0-4ff9-b92d-15732a1ff00a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1281 microversion: 2.1 time: 0.117678 Mar 12 20:49:23.306304 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 252/504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:23 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:23.311827 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b253f50f-87f3-4767-94a2-9f91f0c86733 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:23.312678 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b253f50f-87f3-4767-94a2-9f91f0c86733 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:23.319483 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b253f50f-87f3-4767-94a2-9f91f0c86733 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:23.320094 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b253f50f-87f3-4767-94a2-9f91f0c86733 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:23.321131 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b253f50f-87f3-4767-94a2-9f91f0c86733 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:23.321785 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b253f50f-87f3-4767-94a2-9f91f0c86733 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:23.612779 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b253f50f-87f3-4767-94a2-9f91f0c86733 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:23.623163 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b253f50f-87f3-4767-94a2-9f91f0c86733 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1475 microversion: 2.1 time: 0.315605 Mar 12 20:49:23.627170 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 253/505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:23 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1475 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:23.644032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09db1c9b-8721-4e1d-996a-7510ed9486f7 tempest-QuotasAdminTestJSON-1239025561 tempest-QuotasAdminTestJSON-1239025561-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/18d52938f6f24453af94c6d6af92ef4e" status: 200 len: 329 microversion: 2.1 time: 0.687411 Mar 12 20:49:23.644862 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 253/506] 10.222.0.30 () {60 vars in 1262 bytes} [Sat Mar 12 20:49:22 2022] PUT /compute/v2.1/os-quota-sets/18d52938f6f24453af94c6d6af92ef4e => generated 329 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:23.664297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-31934dc0-d2f6-41ce-bc74-a044f7c0b9e9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:23.664893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-31934dc0-d2f6-41ce-bc74-a044f7c0b9e9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:23.711248 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-216eb206-b8a0-42da-8575-d5d6f94ac7d0 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-173633658", "ram": 512, "vcpus": 1, "disk": 10, "id": 1624935045, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:23.713047 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:23.713047 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:49:23.726966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-31934dc0-d2f6-41ce-bc74-a044f7c0b9e9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:23.738900 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-31934dc0-d2f6-41ce-bc74-a044f7c0b9e9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1221 microversion: 2.1 time: 0.083729 Mar 12 20:49:23.740024 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 254/507] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:23 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:23.756361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4bddb360-629d-4191-b539-9da304a92d70 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:23.756769 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-216eb206-b8a0-42da-8575-d5d6f94ac7d0 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.126513 Mar 12 20:49:23.756983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4bddb360-629d-4191-b539-9da304a92d70 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:23.758669 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 254/508] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:23 2022] POST /compute/v2.1/flavors => generated 415 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:23.767300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bddb360-629d-4191-b539-9da304a92d70 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:23.767736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bddb360-629d-4191-b539-9da304a92d70 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:23.768679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bddb360-629d-4191-b539-9da304a92d70 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:23.769120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bddb360-629d-4191-b539-9da304a92d70 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:23.962921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4bddb360-629d-4191-b539-9da304a92d70 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:23.974105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4bddb360-629d-4191-b539-9da304a92d70 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:23.976450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4bddb360-629d-4191-b539-9da304a92d70 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:23.979350 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4bddb360-629d-4191-b539-9da304a92d70 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1556 microversion: 2.25 time: 0.238318 Mar 12 20:49:23.979921 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 255/509] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:23 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1556 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:23.984968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-10d82db3-2169-419b-941a-ebf31dbc18ae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:23.986082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-10d82db3-2169-419b-941a-ebf31dbc18ae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:23.992459 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c699049a-c026-4d73-b6d8-b26717877fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:23.993570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10d82db3-2169-419b-941a-ebf31dbc18ae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:23.994253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10d82db3-2169-419b-941a-ebf31dbc18ae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:23.996215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10d82db3-2169-419b-941a-ebf31dbc18ae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:23.996643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10d82db3-2169-419b-941a-ebf31dbc18ae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.009947 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-c699049a-c026-4d73-b6d8-b26717877fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] HTTP exception thrown: Flavor 1624935045 has no extra specs with key hw:cpu_thread_policy. Mar 12 20:49:24.013508 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c699049a-c026-4d73-b6d8-b26717877fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] Returning 404 to user: Flavor 1624935045 has no extra specs with key hw:cpu_thread_policy. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:24.016793 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c699049a-c026-4d73-b6d8-b26717877fd9 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] 10.222.0.30 "GET /compute/v2.1/flavors/1624935045/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.250332 Mar 12 20:49:24.020075 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 255/510] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 20:49:23 2022] GET /compute/v2.1/flavors/1624935045/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:49:24.027240 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-528e325b-5829-438d-97ca-5b83a644ce19 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:24.028215 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-528e325b-5829-438d-97ca-5b83a644ce19 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:24.035503 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-528e325b-5829-438d-97ca-5b83a644ce19 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.036403 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-528e325b-5829-438d-97ca-5b83a644ce19 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.037483 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-528e325b-5829-438d-97ca-5b83a644ce19 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.038167 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-528e325b-5829-438d-97ca-5b83a644ce19 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.177209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-10d82db3-2169-419b-941a-ebf31dbc18ae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:24.190190 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-10d82db3-2169-419b-941a-ebf31dbc18ae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.208763 Mar 12 20:49:24.191687 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 256/511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:23 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:24.197505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2300f8db-739e-4a78-acf7-4095081930b6 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:24.199404 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:24.199404 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:24.200692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2300f8db-739e-4a78-acf7-4095081930b6 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '68c5ce8213bb4ac8ad70eb4ffeb2535c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448188ab8e8e4161a1ef1c428ea1cc33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:24.201959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2300f8db-739e-4a78-acf7-4095081930b6 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:24.202782 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2300f8db-739e-4a78-acf7-4095081930b6 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] 10.222.0.30 "POST /compute/v2.1/flavors/1624935045/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.009921 Mar 12 20:49:24.203305 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 257/512] 10.222.0.30 () {60 vars in 1223 bytes} [Sat Mar 12 20:49:24 2022] POST /compute/v2.1/flavors/1624935045/os-extra_specs => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:24.214261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7747da6-6605-457b-b660-97b8a8bfb644 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:24.243365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7747da6-6605-457b-b660-97b8a8bfb644 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1624935045/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032859 Mar 12 20:49:24.243969 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 258/513] 10.222.0.30 () {60 vars in 1223 bytes} [Sat Mar 12 20:49:24 2022] POST /compute/v2.1/flavors/1624935045/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 12 20:49:24.253392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4a17415e-65b7-4632-8f76-0501a27596d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:24.254218 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:24.254218 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:24.255024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4a17415e-65b7-4632-8f76-0501a27596d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '68c5ce8213bb4ac8ad70eb4ffeb2535c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448188ab8e8e4161a1ef1c428ea1cc33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:24.255667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4a17415e-65b7-4632-8f76-0501a27596d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:24.257042 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4a17415e-65b7-4632-8f76-0501a27596d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] 10.222.0.30 "DELETE /compute/v2.1/flavors/1624935045/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.007299 Mar 12 20:49:24.262275 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 259/514] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 20:49:24 2022] DELETE /compute/v2.1/flavors/1624935045/os-extra_specs/hw:numa_nodes => generated 124 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:49:24.266764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-68e9f517-f39c-4568-9c95-d368eb0b3cc6 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:24.270195 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-528e325b-5829-438d-97ca-5b83a644ce19 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid 4f9c242e-54fc-4196-9994-8f4ee1f315bb {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:49:24.285876 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-528e325b-5829-438d-97ca-5b83a644ce19 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 2048 microversion: 2.25 time: 0.264472 Mar 12 20:49:24.287221 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 256/515] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:24 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 2048 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:24.300035 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-68e9f517-f39c-4568-9c95-d368eb0b3cc6 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1624935045/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036720 Mar 12 20:49:24.302371 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 260/516] 10.222.0.30 () {60 vars in 1223 bytes} [Sat Mar 12 20:49:24 2022] POST /compute/v2.1/flavors/1624935045/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:24.306769 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ced1256c-d489-4bf9-a7ba-aa2316904dfa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:24.308055 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ced1256c-d489-4bf9-a7ba-aa2316904dfa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:24.312006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1b280ac-c973-4e4a-b657-1669e3e0223f tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:24.313214 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:24.313214 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:24.314094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1b280ac-c973-4e4a-b657-1669e3e0223f tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '68c5ce8213bb4ac8ad70eb4ffeb2535c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448188ab8e8e4161a1ef1c428ea1cc33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:24.314747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1b280ac-c973-4e4a-b657-1669e3e0223f tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:24.315552 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ced1256c-d489-4bf9-a7ba-aa2316904dfa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.315688 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1b280ac-c973-4e4a-b657-1669e3e0223f tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563 tempest-FlavorsExtraSpecsNegativeTestJSON-1071351563-project] 10.222.0.30 "PUT /compute/v2.1/flavors/1624935045/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.007412 Mar 12 20:49:24.316234 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 261/517] 10.222.0.30 () {60 vars in 1264 bytes} [Sat Mar 12 20:49:24 2022] PUT /compute/v2.1/flavors/1624935045/os-extra_specs/hw:numa_nodes => generated 124 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:49:24.316338 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ced1256c-d489-4bf9-a7ba-aa2316904dfa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.319225 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ced1256c-d489-4bf9-a7ba-aa2316904dfa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.319919 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ced1256c-d489-4bf9-a7ba-aa2316904dfa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.326517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d8b1505-9b39-417d-a027-0940bcbf18df tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:24.327135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8d8b1505-9b39-417d-a027-0940bcbf18df tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:24.337638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d8b1505-9b39-417d-a027-0940bcbf18df tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.338133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d8b1505-9b39-417d-a027-0940bcbf18df tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.339039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d8b1505-9b39-417d-a027-0940bcbf18df tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.339485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d8b1505-9b39-417d-a027-0940bcbf18df tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.479951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d8b1505-9b39-417d-a027-0940bcbf18df tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:24.490308 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d8b1505-9b39-417d-a027-0940bcbf18df tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1311 microversion: 2.1 time: 0.170091 Mar 12 20:49:24.492073 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 262/518] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:24 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1311 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:24.497157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1522c50-afae-4836-a12c-fe5a6306709b tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:24.498675 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:24.498675 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:24.507191 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a1522c50-afae-4836-a12c-fe5a6306709b tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] HTTP exception thrown: Flavor 1624935045 has no extra specs with key hw:cpu_thread_policy. Mar 12 20:49:24.508128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1522c50-afae-4836-a12c-fe5a6306709b tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] Returning 404 to user: Flavor 1624935045 has no extra specs with key hw:cpu_thread_policy. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:24.509223 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1522c50-afae-4836-a12c-fe5a6306709b tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1624935045/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.016046 Mar 12 20:49:24.516134 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 263/519] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 20:49:24 2022] DELETE /compute/v2.1/flavors/1624935045/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:24.523576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2df69dee-8ed4-4888-b612-0fa8d4b85aae tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:24.524996 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:24.524996 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:24.526690 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-2df69dee-8ed4-4888-b612-0fa8d4b85aae tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] HTTP exception thrown: Request body and URI mismatch Mar 12 20:49:24.528076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2df69dee-8ed4-4888-b612-0fa8d4b85aae tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:24.528305 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2df69dee-8ed4-4888-b612-0fa8d4b85aae tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1624935045/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.009081 Mar 12 20:49:24.533823 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 264/520] 10.222.0.30 () {60 vars in 1264 bytes} [Sat Mar 12 20:49:24 2022] PUT /compute/v2.1/flavors/1624935045/os-extra_specs/hw:numa_nodes => generated 73 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Mar 12 20:49:24.542061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9bbfc9f2-e7cd-44ee-9d76-f2af698a890c tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:24.543287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9bbfc9f2-e7cd-44ee-9d76-f2af698a890c tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:24.544156 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9bbfc9f2-e7cd-44ee-9d76-f2af698a890c tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1624935045/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.007181 Mar 12 20:49:24.545223 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 265/521] 10.222.0.30 () {60 vars in 1264 bytes} [Sat Mar 12 20:49:24 2022] PUT /compute/v2.1/flavors/1624935045/os-extra_specs/hw:numa_nodes => generated 117 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:49:24.559141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e89870eb-362e-4639-8cf5-0f78854f54f2 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:24.560025 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:24.560025 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:24.580479 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e89870eb-362e-4639-8cf5-0f78854f54f2 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1624935045" status: 202 len: 0 microversion: 2.1 time: 0.025552 Mar 12 20:49:24.581290 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 266/522] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Mar 12 20:49:24 2022] DELETE /compute/v2.1/flavors/1624935045 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 20:49:24.590718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d8bdad8c-3cdd-4470-88fc-deed36c09761 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:24.616740 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d8bdad8c-3cdd-4470-88fc-deed36c09761 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231 tempest-FlavorsExtraSpecsNegativeTestJSON-1908445231-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.030980 Mar 12 20:49:24.617333 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 267/523] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:49:24 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:24.646046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa78431e-0bd3-4fcd-8fd7-6439112ffe09 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:24.647117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aa78431e-0bd3-4fcd-8fd7-6439112ffe09 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:24.659321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa78431e-0bd3-4fcd-8fd7-6439112ffe09 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.660521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa78431e-0bd3-4fcd-8fd7-6439112ffe09 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.661580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa78431e-0bd3-4fcd-8fd7-6439112ffe09 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.662831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa78431e-0bd3-4fcd-8fd7-6439112ffe09 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.751746 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-ced1256c-d489-4bf9-a7ba-aa2316904dfa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid 4f9c242e-54fc-4196-9994-8f4ee1f315bb {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:49:24.781500 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ced1256c-d489-4bf9-a7ba-aa2316904dfa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 2048 microversion: 2.25 time: 0.480052 Mar 12 20:49:24.784511 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 257/524] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:24 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 2048 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:24.789931 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-287ec798-0ba9-4143-b084-6e81357e71bb tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:24.796243 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-287ec798-0ba9-4143-b084-6e81357e71bb tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:24.807720 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-287ec798-0ba9-4143-b084-6e81357e71bb tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.808438 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-287ec798-0ba9-4143-b084-6e81357e71bb tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.809483 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-287ec798-0ba9-4143-b084-6e81357e71bb tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.810051 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-287ec798-0ba9-4143-b084-6e81357e71bb tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.885159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aa78431e-0bd3-4fcd-8fd7-6439112ffe09 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:24.897706 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aa78431e-0bd3-4fcd-8fd7-6439112ffe09 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1458 microversion: 2.1 time: 0.256853 Mar 12 20:49:24.899208 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 268/525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:24 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1458 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:24.904453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e6207cfe-219c-40cb-8b10-ea92c6ee84f9 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:24.906137 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:24.906137 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:24.907343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6207cfe-219c-40cb-8b10-ea92c6ee84f9 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.907846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6207cfe-219c-40cb-8b10-ea92c6ee84f9 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.908652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6207cfe-219c-40cb-8b10-ea92c6ee84f9 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.909085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6207cfe-219c-40cb-8b10-ea92c6ee84f9 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.927106 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-287ec798-0ba9-4143-b084-6e81357e71bb tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:24.935516 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-287ec798-0ba9-4143-b084-6e81357e71bb tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1279 microversion: 2.1 time: 0.149723 Mar 12 20:49:24.936716 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 258/526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:24 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1279 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:24.941207 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3a19dfdd-454f-41ec-ad73-a9b3b13f7a7c tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:24.942009 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3a19dfdd-454f-41ec-ad73-a9b3b13f7a7c tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:24.948605 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3a19dfdd-454f-41ec-ad73-a9b3b13f7a7c tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.949351 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3a19dfdd-454f-41ec-ad73-a9b3b13f7a7c tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:24.950369 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3a19dfdd-454f-41ec-ad73-a9b3b13f7a7c tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:24.950959 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3a19dfdd-454f-41ec-ad73-a9b3b13f7a7c tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:25.233141 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e6207cfe-219c-40cb-8b10-ea92c6ee84f9 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.332668 Mar 12 20:49:25.234090 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 269/527] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Mar 12 20:49:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:49:25.240752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e78ddf11-fea9-46a4-ba71-a4a39dc8bc55 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:25.241383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e78ddf11-fea9-46a4-ba71-a4a39dc8bc55 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:25.247591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e78ddf11-fea9-46a4-ba71-a4a39dc8bc55 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:25.248372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e78ddf11-fea9-46a4-ba71-a4a39dc8bc55 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:25.249048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e78ddf11-fea9-46a4-ba71-a4a39dc8bc55 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:25.249697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e78ddf11-fea9-46a4-ba71-a4a39dc8bc55 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:25.549005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e78ddf11-fea9-46a4-ba71-a4a39dc8bc55 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:25.558549 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e78ddf11-fea9-46a4-ba71-a4a39dc8bc55 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.322627 Mar 12 20:49:25.559130 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 270/528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:25 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:25.564452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a2875a2-274b-4264-80c5-3683243e2b90 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:25.564972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a2875a2-274b-4264-80c5-3683243e2b90 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:25.573010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a2875a2-274b-4264-80c5-3683243e2b90 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:25.573547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a2875a2-274b-4264-80c5-3683243e2b90 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:25.574678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a2875a2-274b-4264-80c5-3683243e2b90 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:25.575382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a2875a2-274b-4264-80c5-3683243e2b90 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:25.665591 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a2875a2-274b-4264-80c5-3683243e2b90 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb/action" status: 202 len: 0 microversion: 2.25 time: 0.104751 Mar 12 20:49:25.666481 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 271/529] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 20:49:25 2022] POST /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:49:25.674281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-45eba458-73bb-421f-b64a-f817fc11cb08 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:25.675405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-45eba458-73bb-421f-b64a-f817fc11cb08 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:25.684392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45eba458-73bb-421f-b64a-f817fc11cb08 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:25.684945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45eba458-73bb-421f-b64a-f817fc11cb08 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:25.686013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45eba458-73bb-421f-b64a-f817fc11cb08 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:25.686486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45eba458-73bb-421f-b64a-f817fc11cb08 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:25.694956 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3a19dfdd-454f-41ec-ad73-a9b3b13f7a7c tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1609 microversion: 2.1 time: 0.755577 Mar 12 20:49:25.710499 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 259/530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:24 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1609 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:25.721837 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-f8aa2c10-de4c-485d-b56d-e4316ca0b8fe req-f6c20cbe-2909-4cae-a28e-bf86ec5364d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab950cd9-846a-49c5-964c-7f8f96d7bed2", "tag": "8139ec0e-8f41-45a1-a748-a770dd994696"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:25.739953 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-f8aa2c10-de4c-485d-b56d-e4316ca0b8fe req-f6c20cbe-2909-4cae-a28e-bf86ec5364d8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:25.740660 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-f8aa2c10-de4c-485d-b56d-e4316ca0b8fe req-f6c20cbe-2909-4cae-a28e-bf86ec5364d8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:25.768140 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-f8aa2c10-de4c-485d-b56d-e4316ca0b8fe req-f6c20cbe-2909-4cae-a28e-bf86ec5364d8 service nova] Creating event network-changed:8139ec0e-8f41-45a1-a748-a770dd994696 for instance ab950cd9-846a-49c5-964c-7f8f96d7bed2 on nch2-master-1 Mar 12 20:49:25.781807 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-f8aa2c10-de4c-485d-b56d-e4316ca0b8fe req-f6c20cbe-2909-4cae-a28e-bf86ec5364d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069896 Mar 12 20:49:25.785668 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 260/531] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:25.796348 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-581b7ab2-72d6-4d94-b0e2-5ef82691519c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:25.801221 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-581b7ab2-72d6-4d94-b0e2-5ef82691519c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:25.811345 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-581b7ab2-72d6-4d94-b0e2-5ef82691519c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:25.811986 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-581b7ab2-72d6-4d94-b0e2-5ef82691519c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:25.813027 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-581b7ab2-72d6-4d94-b0e2-5ef82691519c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:25.813623 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-581b7ab2-72d6-4d94-b0e2-5ef82691519c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:25.947604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-45eba458-73bb-421f-b64a-f817fc11cb08 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:25.957971 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-45eba458-73bb-421f-b64a-f817fc11cb08 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1311 microversion: 2.1 time: 0.289827 Mar 12 20:49:25.968820 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 272/532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:25 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1311 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:25.975033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-70f88309-f314-4fd8-863e-e4240c7eb7b7 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:25.976607 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:25.976607 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:25.978006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70f88309-f314-4fd8-863e-e4240c7eb7b7 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:25.978784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70f88309-f314-4fd8-863e-e4240c7eb7b7 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:25.979719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70f88309-f314-4fd8-863e-e4240c7eb7b7 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:25.980704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70f88309-f314-4fd8-863e-e4240c7eb7b7 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:26.010124 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-70f88309-f314-4fd8-863e-e4240c7eb7b7 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040245 Mar 12 20:49:26.010909 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 273/533] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Mar 12 20:49:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:26.015411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0730477-24ca-447c-a68f-2e60b900ade1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:26.016113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b0730477-24ca-447c-a68f-2e60b900ade1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:26.024159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0730477-24ca-447c-a68f-2e60b900ade1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:26.025103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0730477-24ca-447c-a68f-2e60b900ade1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:26.026331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0730477-24ca-447c-a68f-2e60b900ade1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:26.026922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0730477-24ca-447c-a68f-2e60b900ade1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:26.091952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b0730477-24ca-447c-a68f-2e60b900ade1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:26.100731 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0730477-24ca-447c-a68f-2e60b900ade1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1279 microversion: 2.1 time: 0.087854 Mar 12 20:49:26.101330 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 274/534] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:26 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:26.106398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c86daf6-3e2d-4480-a26a-4c50c0101832 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:26.107556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c86daf6-3e2d-4480-a26a-4c50c0101832 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:26.115464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c86daf6-3e2d-4480-a26a-4c50c0101832 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:26.116441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c86daf6-3e2d-4480-a26a-4c50c0101832 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:26.117240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c86daf6-3e2d-4480-a26a-4c50c0101832 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:26.117694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c86daf6-3e2d-4480-a26a-4c50c0101832 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:26.144238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-8c86daf6-3e2d-4480-a26a-4c50c0101832 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Lazy-loading 'flavor' on Instance uuid 14193145-27d3-461c-90a6-4073d822b2ed {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:49:26.157128 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8c86daf6-3e2d-4480-a26a-4c50c0101832 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 14193145-27d3-461c-90a6-4073d822b2ed while it is in vm_state suspended Mar 12 20:49:26.158078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c86daf6-3e2d-4480-a26a-4c50c0101832 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 14193145-27d3-461c-90a6-4073d822b2ed while it is in vm_state suspended {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:26.159282 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c86daf6-3e2d-4480-a26a-4c50c0101832 tempest-LiveMigrationNegativeTest-981742581 tempest-LiveMigrationNegativeTest-981742581-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed/action" status: 409 len: 155 microversion: 2.1 time: 0.056922 Mar 12 20:49:26.165368 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 275/535] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:49:26 2022] POST /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed/action => generated 155 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:49:26.170766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fcb931c1-6e4e-43ca-ac18-5015df792c3b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:26.171282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fcb931c1-6e4e-43ca-ac18-5015df792c3b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:26.177442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcb931c1-6e4e-43ca-ac18-5015df792c3b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:26.178090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcb931c1-6e4e-43ca-ac18-5015df792c3b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:26.179053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcb931c1-6e4e-43ca-ac18-5015df792c3b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:26.179586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcb931c1-6e4e-43ca-ac18-5015df792c3b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:26.208377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fcb931c1-6e4e-43ca-ac18-5015df792c3b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:49:26.343569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fcb931c1-6e4e-43ca-ac18-5015df792c3b tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "DELETE /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 204 len: 0 microversion: 2.1 time: 0.176445 Mar 12 20:49:26.347947 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 276/536] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:49:26 2022] DELETE /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:49:26.359016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2d35eeb-e150-4133-bf7f-155284af145c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:26.360552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2d35eeb-e150-4133-bf7f-155284af145c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:26.369431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d35eeb-e150-4133-bf7f-155284af145c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:26.369925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d35eeb-e150-4133-bf7f-155284af145c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:26.370722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d35eeb-e150-4133-bf7f-155284af145c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:26.371166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d35eeb-e150-4133-bf7f-155284af145c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:26.511193 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-581b7ab2-72d6-4d94-b0e2-5ef82691519c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid 4f9c242e-54fc-4196-9994-8f4ee1f315bb {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:49:26.535959 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-581b7ab2-72d6-4d94-b0e2-5ef82691519c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 2053 microversion: 2.25 time: 0.748738 Mar 12 20:49:26.536542 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 261/537] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:25 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 2053 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:26.579207 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b22caebf-9233-4385-af87-f3747243c721 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:26.581971 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b22caebf-9233-4385-af87-f3747243c721 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:26.597417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f2d35eeb-e150-4133-bf7f-155284af145c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:26.607228 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2d35eeb-e150-4133-bf7f-155284af145c tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1464 microversion: 2.1 time: 0.256307 Mar 12 20:49:26.607820 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 277/538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:26 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1464 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:26.617319 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b22caebf-9233-4385-af87-f3747243c721 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:26.617319 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b22caebf-9233-4385-af87-f3747243c721 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:26.617319 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b22caebf-9233-4385-af87-f3747243c721 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:26.617319 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b22caebf-9233-4385-af87-f3747243c721 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:26.965949 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b22caebf-9233-4385-af87-f3747243c721 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:26.972403 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b22caebf-9233-4385-af87-f3747243c721 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.400154 Mar 12 20:49:26.973142 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 262/539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:26 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:26.979301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0df8b15-408b-4076-945a-bfb95bc853b8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:26.980453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b0df8b15-408b-4076-945a-bfb95bc853b8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:26.988130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0df8b15-408b-4076-945a-bfb95bc853b8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:26.989017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0df8b15-408b-4076-945a-bfb95bc853b8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:26.992031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0df8b15-408b-4076-945a-bfb95bc853b8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:26.993290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0df8b15-408b-4076-945a-bfb95bc853b8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:27.121022 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5d5c97f1-9b86-4e62-979b-6aa05728364a tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:27.122344 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5d5c97f1-9b86-4e62-979b-6aa05728364a tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:27.132476 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5d5c97f1-9b86-4e62-979b-6aa05728364a tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:27.133779 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5d5c97f1-9b86-4e62-979b-6aa05728364a tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:27.135254 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5d5c97f1-9b86-4e62-979b-6aa05728364a tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:27.136093 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5d5c97f1-9b86-4e62-979b-6aa05728364a tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:27.222910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b0df8b15-408b-4076-945a-bfb95bc853b8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:27.231451 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0df8b15-408b-4076-945a-bfb95bc853b8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1311 microversion: 2.1 time: 0.260204 Mar 12 20:49:27.232034 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 278/540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:26 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1311 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:27.558014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d21fb980-01cd-4d57-8d1d-a814b9b1ee16 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:27.559904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d21fb980-01cd-4d57-8d1d-a814b9b1ee16 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:27.572447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d21fb980-01cd-4d57-8d1d-a814b9b1ee16 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:27.574558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d21fb980-01cd-4d57-8d1d-a814b9b1ee16 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:27.575739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d21fb980-01cd-4d57-8d1d-a814b9b1ee16 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:27.576396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d21fb980-01cd-4d57-8d1d-a814b9b1ee16 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:27.627124 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5d5c97f1-9b86-4e62-979b-6aa05728364a tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:27.636310 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5d5c97f1-9b86-4e62-979b-6aa05728364a tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.522196 Mar 12 20:49:27.641187 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 263/541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:27 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:27.649924 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3979b3a7-380a-4f17-92f6-3b22b5c19097 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:27.650555 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3979b3a7-380a-4f17-92f6-3b22b5c19097 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:27.663480 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3979b3a7-380a-4f17-92f6-3b22b5c19097 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:27.663941 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3979b3a7-380a-4f17-92f6-3b22b5c19097 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:27.664728 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3979b3a7-380a-4f17-92f6-3b22b5c19097 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:27.665169 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3979b3a7-380a-4f17-92f6-3b22b5c19097 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:27.785015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-d21fb980-01cd-4d57-8d1d-a814b9b1ee16 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid 4f9c242e-54fc-4196-9994-8f4ee1f315bb {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:49:27.872709 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d21fb980-01cd-4d57-8d1d-a814b9b1ee16 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 2033 microversion: 2.25 time: 0.319876 Mar 12 20:49:27.881918 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 279/542] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:27 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 2033 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:27.892279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e3326a3e-61d3-45c3-b665-2c8a612d5645 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:27.893533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e3326a3e-61d3-45c3-b665-2c8a612d5645 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:27.901139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3326a3e-61d3-45c3-b665-2c8a612d5645 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:27.902452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3326a3e-61d3-45c3-b665-2c8a612d5645 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:27.903906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3326a3e-61d3-45c3-b665-2c8a612d5645 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:27.904365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3326a3e-61d3-45c3-b665-2c8a612d5645 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:27.939117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-e3326a3e-61d3-45c3-b665-2c8a612d5645 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'flavor' on Instance uuid 4f9c242e-54fc-4196-9994-8f4ee1f315bb {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:49:27.951901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e3326a3e-61d3-45c3-b665-2c8a612d5645 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Going to try to live migrate instance to nch1-master-1 {{(pid=136302) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 12 20:49:28.169616 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3979b3a7-380a-4f17-92f6-3b22b5c19097 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:28.177667 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3979b3a7-380a-4f17-92f6-3b22b5c19097 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 200 len: 1464 microversion: 2.1 time: 0.535347 Mar 12 20:49:28.180563 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 264/543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:27 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 1464 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:28.198299 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b3e6d848-210c-4e27-91e9-96f962b97ee1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:28.199205 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b3e6d848-210c-4e27-91e9-96f962b97ee1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:28.208569 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b3e6d848-210c-4e27-91e9-96f962b97ee1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:28.209302 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b3e6d848-210c-4e27-91e9-96f962b97ee1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:28.211374 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b3e6d848-210c-4e27-91e9-96f962b97ee1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:28.213150 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b3e6d848-210c-4e27-91e9-96f962b97ee1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:28.695969 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b3e6d848-210c-4e27-91e9-96f962b97ee1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:28.707109 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b3e6d848-210c-4e27-91e9-96f962b97ee1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.525255 Mar 12 20:49:28.711895 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 265/544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:28 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:28.719803 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-82121084-fd05-407e-9c2d-7d313ad1e391 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:28.720669 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-82121084-fd05-407e-9c2d-7d313ad1e391 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:28.728918 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-82121084-fd05-407e-9c2d-7d313ad1e391 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:28.729638 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-82121084-fd05-407e-9c2d-7d313ad1e391 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:28.730665 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-82121084-fd05-407e-9c2d-7d313ad1e391 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:28.731363 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-82121084-fd05-407e-9c2d-7d313ad1e391 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:29.167074 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-82121084-fd05-407e-9c2d-7d313ad1e391 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:29.176170 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-82121084-fd05-407e-9c2d-7d313ad1e391 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1311 microversion: 2.1 time: 0.462743 Mar 12 20:49:29.176972 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 266/545] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:28 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1311 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:29.441636 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8c10acee-74a0-44a3-ae58-bde18a88fa4c tempest-SecurityGroupsTestAdminJSON-1383587862 tempest-SecurityGroupsTestAdminJSON-1383587862-project] Action: 'create', calling method: .version_select at 0x7f6e3724aee0>, body: {"security_group": {"name": "tempest-securitygroup-1806969223", "description": "tempest-description-1459050352"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:29.670201 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e3326a3e-61d3-45c3-b665-2c8a612d5645 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb/action" status: 202 len: 0 microversion: 2.25 time: 1.781604 Mar 12 20:49:29.672031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 280/546] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 20:49:27 2022] POST /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb/action => generated 0 bytes in 1785 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:49:29.678352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-86b95610-7e5e-4679-972f-93a51bd12a24 req-4caf7948-d841-42dd-9808-8228a6135db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3364cfe2-8555-4de1-9fd9-29e3d2cfabab", "tag": "84a71a9a-c3a4-4a15-927a-2a83d6d25f3d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:29.690524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-86b95610-7e5e-4679-972f-93a51bd12a24 req-4caf7948-d841-42dd-9808-8228a6135db4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:29.691053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-86b95610-7e5e-4679-972f-93a51bd12a24 req-4caf7948-d841-42dd-9808-8228a6135db4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:29.704580 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-86b95610-7e5e-4679-972f-93a51bd12a24 req-4caf7948-d841-42dd-9808-8228a6135db4 service nova] Creating event network-changed:84a71a9a-c3a4-4a15-927a-2a83d6d25f3d for instance 3364cfe2-8555-4de1-9fd9-29e3d2cfabab on nch1-master-1 Mar 12 20:49:29.710294 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-86b95610-7e5e-4679-972f-93a51bd12a24 req-4caf7948-d841-42dd-9808-8228a6135db4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036327 Mar 12 20:49:29.711556 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 281/547] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:29.721211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7c1d284a-f5a1-4f12-85a2-9f814eaf2f44 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:29.722323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7c1d284a-f5a1-4f12-85a2-9f814eaf2f44 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:29.730059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c1d284a-f5a1-4f12-85a2-9f814eaf2f44 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:29.730705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c1d284a-f5a1-4f12-85a2-9f814eaf2f44 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:29.731796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c1d284a-f5a1-4f12-85a2-9f814eaf2f44 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:29.732400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c1d284a-f5a1-4f12-85a2-9f814eaf2f44 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:29.748497 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8c10acee-74a0-44a3-ae58-bde18a88fa4c tempest-SecurityGroupsTestAdminJSON-1383587862 tempest-SecurityGroupsTestAdminJSON-1383587862-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.570355 Mar 12 20:49:29.755840 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 267/548] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:49:29 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:29.758026 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8c10acee-74a0-44a3-ae58-bde18a88fa4c tempest-SecurityGroupsTestAdminJSON-1383587862 tempest-SecurityGroupsTestAdminJSON-1383587862-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:29.759559 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8c10acee-74a0-44a3-ae58-bde18a88fa4c tempest-SecurityGroupsTestAdminJSON-1383587862 tempest-SecurityGroupsTestAdminJSON-1383587862-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001830 Mar 12 20:49:29.760354 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 268/549] 10.222.0.30 () {56 vars in 885 bytes} [Sat Mar 12 20:49:29 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 12 20:49:29.775839 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f782ef85-09fe-4cb6-a03d-cb8b1aa69754 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:29.779315 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f782ef85-09fe-4cb6-a03d-cb8b1aa69754 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: 14193145-27d3-461c-90a6-4073d822b2ed] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:29.801478 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f782ef85-09fe-4cb6-a03d-cb8b1aa69754 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:29.808298 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f782ef85-09fe-4cb6-a03d-cb8b1aa69754 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:29.811690 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f782ef85-09fe-4cb6-a03d-cb8b1aa69754 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:29.812412 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f782ef85-09fe-4cb6-a03d-cb8b1aa69754 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:29.849233 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-f782ef85-09fe-4cb6-a03d-cb8b1aa69754 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] HTTP exception thrown: Instance 14193145-27d3-461c-90a6-4073d822b2ed could not be found. Mar 12 20:49:29.852185 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f782ef85-09fe-4cb6-a03d-cb8b1aa69754 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Returning 404 to user: Instance 14193145-27d3-461c-90a6-4073d822b2ed could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:29.854195 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f782ef85-09fe-4cb6-a03d-cb8b1aa69754 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed" status: 404 len: 111 microversion: 2.1 time: 0.091560 Mar 12 20:49:29.860841 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 269/550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:29 2022] GET /compute/v2.1/servers/14193145-27d3-461c-90a6-4073d822b2ed => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:29.882054 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fcfd8681-a64d-4663-9143-ccbb80627086 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:29.882681 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-fcfd8681-a64d-4663-9143-ccbb80627086 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:29.890251 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fcfd8681-a64d-4663-9143-ccbb80627086 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:29.891468 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fcfd8681-a64d-4663-9143-ccbb80627086 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:29.893265 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fcfd8681-a64d-4663-9143-ccbb80627086 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:29.894409 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fcfd8681-a64d-4663-9143-ccbb80627086 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:29.971611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7c1d284a-f5a1-4f12-85a2-9f814eaf2f44 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:29.981428 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7c1d284a-f5a1-4f12-85a2-9f814eaf2f44 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.268185 Mar 12 20:49:29.983062 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 282/551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:29 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:29.988510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc5ace09-55f9-424b-a49c-ae936e8bc7fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:29.989517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc5ace09-55f9-424b-a49c-ae936e8bc7fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:29.997598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc5ace09-55f9-424b-a49c-ae936e8bc7fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:29.998173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc5ace09-55f9-424b-a49c-ae936e8bc7fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:29.999361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc5ace09-55f9-424b-a49c-ae936e8bc7fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:30.000095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc5ace09-55f9-424b-a49c-ae936e8bc7fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:30.164381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc5ace09-55f9-424b-a49c-ae936e8bc7fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:30.175493 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc5ace09-55f9-424b-a49c-ae936e8bc7fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.189703 Mar 12 20:49:30.176801 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 283/552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:29 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:30.182177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-388ea09c-4712-470f-be6c-73f30833bc9c tempest-SecurityGroupsTestAdminJSON-1383587862 tempest-SecurityGroupsTestAdminJSON-1383587862-project] Action: 'create', calling method: .version_select at 0x7f6e373b2280>, body: {"security_group": {"name": "tempest-securitygroup-1812805285", "description": "tempest-description-466798656"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:30.339500 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-388ea09c-4712-470f-be6c-73f30833bc9c tempest-SecurityGroupsTestAdminJSON-1383587862 tempest-SecurityGroupsTestAdminJSON-1383587862-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.161328 Mar 12 20:49:30.340557 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 284/553] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:49:30 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:30.347493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-93c13910-c554-48e0-b62b-db7b5f471267 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:30.347995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-93c13910-c554-48e0-b62b-db7b5f471267 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:30.355133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93c13910-c554-48e0-b62b-db7b5f471267 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:30.356202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93c13910-c554-48e0-b62b-db7b5f471267 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:30.356988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93c13910-c554-48e0-b62b-db7b5f471267 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:30.357425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93c13910-c554-48e0-b62b-db7b5f471267 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:30.382936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-93c13910-c554-48e0-b62b-db7b5f471267 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:49:30.471288 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-93c13910-c554-48e0-b62b-db7b5f471267 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 204 len: 0 microversion: 2.1 time: 0.128413 Mar 12 20:49:30.472489 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 285/554] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:49:30 2022] DELETE /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:49:30.482799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d660766a-d0f5-4bb1-8394-136cbf921cc7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:30.483514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d660766a-d0f5-4bb1-8394-136cbf921cc7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:30.489748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d660766a-d0f5-4bb1-8394-136cbf921cc7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:30.490750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d660766a-d0f5-4bb1-8394-136cbf921cc7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:30.491567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d660766a-d0f5-4bb1-8394-136cbf921cc7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:30.492205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d660766a-d0f5-4bb1-8394-136cbf921cc7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:30.554145 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fcfd8681-a64d-4663-9143-ccbb80627086 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:30.565416 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fcfd8681-a64d-4663-9143-ccbb80627086 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:30.566986 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fcfd8681-a64d-4663-9143-ccbb80627086 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:30.568456 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fcfd8681-a64d-4663-9143-ccbb80627086 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.698018 Mar 12 20:49:30.569548 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 270/555] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:29 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:30.650934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d660766a-d0f5-4bb1-8394-136cbf921cc7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:30.658733 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d660766a-d0f5-4bb1-8394-136cbf921cc7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1311 microversion: 2.1 time: 0.180522 Mar 12 20:49:30.659683 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 286/556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:30 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1311 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:30.665013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0496ef0b-6f88-406e-a436-c7f530a57fe1 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:30.665631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0496ef0b-6f88-406e-a436-c7f530a57fe1 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:30.671585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0496ef0b-6f88-406e-a436-c7f530a57fe1 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:30.672201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0496ef0b-6f88-406e-a436-c7f530a57fe1 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:30.673052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0496ef0b-6f88-406e-a436-c7f530a57fe1 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:30.674223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0496ef0b-6f88-406e-a436-c7f530a57fe1 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:30.772624 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ae4bd4dd-b908-4472-9ab9-a8e7aa0dbee5 tempest-SecurityGroupsTestAdminJSON-1838539291 tempest-SecurityGroupsTestAdminJSON-1838539291-project-admin] Action: 'create', calling method: .version_select at 0x7f6e372d6670>, body: {"security_group": {"name": "tempest-securitygroup-1278237327", "description": "tempest-description-1668854872"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:30.816886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0496ef0b-6f88-406e-a436-c7f530a57fe1 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:30.825212 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0496ef0b-6f88-406e-a436-c7f530a57fe1 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1474 microversion: 2.1 time: 0.164344 Mar 12 20:49:30.825879 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 287/557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:30 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1474 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:31.000691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3cfd2325-deae-4d14-95fb-9d0a8ec1744c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:31.001920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3cfd2325-deae-4d14-95fb-9d0a8ec1744c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:31.010328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cfd2325-deae-4d14-95fb-9d0a8ec1744c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:31.010783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cfd2325-deae-4d14-95fb-9d0a8ec1744c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:31.011568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cfd2325-deae-4d14-95fb-9d0a8ec1744c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:31.012006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cfd2325-deae-4d14-95fb-9d0a8ec1744c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:31.183861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3cfd2325-deae-4d14-95fb-9d0a8ec1744c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:31.191828 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3cfd2325-deae-4d14-95fb-9d0a8ec1744c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.195829 Mar 12 20:49:31.202031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 288/558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:30 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:31.207656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0fe7f49f-d94e-4da8-b5b1-3dbeb838f963 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:31.208782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0fe7f49f-d94e-4da8-b5b1-3dbeb838f963 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:31.215206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fe7f49f-d94e-4da8-b5b1-3dbeb838f963 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:31.215963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fe7f49f-d94e-4da8-b5b1-3dbeb838f963 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:31.218177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fe7f49f-d94e-4da8-b5b1-3dbeb838f963 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:31.218824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fe7f49f-d94e-4da8-b5b1-3dbeb838f963 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:31.382112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0fe7f49f-d94e-4da8-b5b1-3dbeb838f963 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:31.390921 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0fe7f49f-d94e-4da8-b5b1-3dbeb838f963 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.187358 Mar 12 20:49:31.401162 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 289/559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:31 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:31.404713 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ae4bd4dd-b908-4472-9ab9-a8e7aa0dbee5 tempest-SecurityGroupsTestAdminJSON-1838539291 tempest-SecurityGroupsTestAdminJSON-1838539291-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.833622 Mar 12 20:49:31.405320 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 271/560] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:49:30 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:31.417171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37efe5c1-9e55-43cd-9652-9c2ea167d55a tempest-SecurityGroupsTestAdminJSON-1838539291 tempest-SecurityGroupsTestAdminJSON-1838539291-project-admin] Action: 'create', calling method: .version_select at 0x7f6e37235af0>, body: {"security_group": {"name": "tempest-securitygroup-1547401161", "description": "tempest-description-262077244"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:31.546641 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-37efe5c1-9e55-43cd-9652-9c2ea167d55a tempest-SecurityGroupsTestAdminJSON-1838539291 tempest-SecurityGroupsTestAdminJSON-1838539291-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.133106 Mar 12 20:49:31.547271 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 290/561] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:49:31 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:31.558197 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0dede199-7a35-45e7-b108-17b76b7f57c1 tempest-SecurityGroupsTestAdminJSON-1838539291 tempest-SecurityGroupsTestAdminJSON-1838539291-project-admin] Calling method '.version_select at 0x7f6e3724a430>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:31.588902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9e0dd79-82ed-40da-a0c0-a313e25fb1ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:31.589526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9e0dd79-82ed-40da-a0c0-a313e25fb1ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:31.595833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e0dd79-82ed-40da-a0c0-a313e25fb1ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:31.596295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e0dd79-82ed-40da-a0c0-a313e25fb1ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:31.597080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e0dd79-82ed-40da-a0c0-a313e25fb1ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:31.597527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e0dd79-82ed-40da-a0c0-a313e25fb1ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:31.736990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f9e0dd79-82ed-40da-a0c0-a313e25fb1ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:31.746668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f9e0dd79-82ed-40da-a0c0-a313e25fb1ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:31.748350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f9e0dd79-82ed-40da-a0c0-a313e25fb1ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:31.749534 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9e0dd79-82ed-40da-a0c0-a313e25fb1ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.165793 Mar 12 20:49:31.750303 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 291/562] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:31 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:49:31.755123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b77ebade-dcd1-4df2-8fc1-565e66324cdd tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:31.756458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b77ebade-dcd1-4df2-8fc1-565e66324cdd tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:31.765560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b77ebade-dcd1-4df2-8fc1-565e66324cdd tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:31.766626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b77ebade-dcd1-4df2-8fc1-565e66324cdd tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:31.769813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b77ebade-dcd1-4df2-8fc1-565e66324cdd tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:31.769813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b77ebade-dcd1-4df2-8fc1-565e66324cdd tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:31.981743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b77ebade-dcd1-4df2-8fc1-565e66324cdd tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:31.993379 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b77ebade-dcd1-4df2-8fc1-565e66324cdd tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1311 microversion: 2.1 time: 0.241669 Mar 12 20:49:32.012311 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 292/563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:31 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1311 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:32.023322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b7c6de66-b267-4e37-bb10-d14556423206 req-f8fb64a7-5716-49ad-8340-018e6c4195a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14193145-27d3-461c-90a6-4073d822b2ed", "name": "network-vif-deleted", "tag": "af3d31be-a410-4472-8a18-7fb92f819cfb"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:32.033258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b7c6de66-b267-4e37-bb10-d14556423206 req-f8fb64a7-5716-49ad-8340-018e6c4195a2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:32.033810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b7c6de66-b267-4e37-bb10-d14556423206 req-f8fb64a7-5716-49ad-8340-018e6c4195a2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:32.046522 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b7c6de66-b267-4e37-bb10-d14556423206 req-f8fb64a7-5716-49ad-8340-018e6c4195a2 service nova] Creating event network-vif-deleted:af3d31be-a410-4472-8a18-7fb92f819cfb for instance 14193145-27d3-461c-90a6-4073d822b2ed on nch2-master-1 Mar 12 20:49:32.051943 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b7c6de66-b267-4e37-bb10-d14556423206 req-f8fb64a7-5716-49ad-8340-018e6c4195a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038319 Mar 12 20:49:32.053637 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 293/564] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:32.059335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ff9d2ae-491f-401a-bccd-fef0ed9a1394 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:32.060295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ff9d2ae-491f-401a-bccd-fef0ed9a1394 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:32.069190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ff9d2ae-491f-401a-bccd-fef0ed9a1394 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:32.070233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ff9d2ae-491f-401a-bccd-fef0ed9a1394 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:32.071489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ff9d2ae-491f-401a-bccd-fef0ed9a1394 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:32.072440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ff9d2ae-491f-401a-bccd-fef0ed9a1394 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:32.246769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6ff9d2ae-491f-401a-bccd-fef0ed9a1394 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:32.256250 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ff9d2ae-491f-401a-bccd-fef0ed9a1394 tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1474 microversion: 2.1 time: 0.200754 Mar 12 20:49:32.257032 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 294/565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:32 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1474 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:32.261460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-52e8132b-f3d1-4cbc-a4ba-607c6deec069 req-8c046824-f622-4486-b68f-47d1e986075c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab950cd9-846a-49c5-964c-7f8f96d7bed2", "name": "network-vif-plugged", "status": "completed", "tag": "8139ec0e-8f41-45a1-a748-a770dd994696"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:32.269478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-52e8132b-f3d1-4cbc-a4ba-607c6deec069 req-8c046824-f622-4486-b68f-47d1e986075c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:32.269884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-52e8132b-f3d1-4cbc-a4ba-607c6deec069 req-8c046824-f622-4486-b68f-47d1e986075c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:32.283002 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-52e8132b-f3d1-4cbc-a4ba-607c6deec069 req-8c046824-f622-4486-b68f-47d1e986075c service nova] Creating event network-vif-plugged:8139ec0e-8f41-45a1-a748-a770dd994696 for instance ab950cd9-846a-49c5-964c-7f8f96d7bed2 on nch2-master-1 Mar 12 20:49:32.287994 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-52e8132b-f3d1-4cbc-a4ba-607c6deec069 req-8c046824-f622-4486-b68f-47d1e986075c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029789 Mar 12 20:49:32.288679 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 295/566] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:32.294041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3fc3461d-d221-4fc3-8a5f-00c5acd0da1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:32.294944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3fc3461d-d221-4fc3-8a5f-00c5acd0da1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:32.301761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fc3461d-d221-4fc3-8a5f-00c5acd0da1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:32.302250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fc3461d-d221-4fc3-8a5f-00c5acd0da1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:32.303082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fc3461d-d221-4fc3-8a5f-00c5acd0da1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:32.303523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fc3461d-d221-4fc3-8a5f-00c5acd0da1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:32.514320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3fc3461d-d221-4fc3-8a5f-00c5acd0da1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:32.531886 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3fc3461d-d221-4fc3-8a5f-00c5acd0da1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.241806 Mar 12 20:49:32.545476 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 296/567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:32 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:32.584696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1307bcbb-6982-4088-8eb5-1febf79d60a8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:32.586639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1307bcbb-6982-4088-8eb5-1febf79d60a8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:32.616973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1307bcbb-6982-4088-8eb5-1febf79d60a8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:32.619611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1307bcbb-6982-4088-8eb5-1febf79d60a8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:32.620671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1307bcbb-6982-4088-8eb5-1febf79d60a8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:32.622374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1307bcbb-6982-4088-8eb5-1febf79d60a8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:32.878178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1307bcbb-6982-4088-8eb5-1febf79d60a8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:32.889427 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1307bcbb-6982-4088-8eb5-1febf79d60a8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1476 microversion: 2.1 time: 0.322499 Mar 12 20:49:32.898583 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 297/568] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:32 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:32.904381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0e9ea473-396a-49c4-aa1f-b834ffeb22f4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:32.905079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0e9ea473-396a-49c4-aa1f-b834ffeb22f4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:32.911100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e9ea473-396a-49c4-aa1f-b834ffeb22f4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:32.911860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e9ea473-396a-49c4-aa1f-b834ffeb22f4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:32.912760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e9ea473-396a-49c4-aa1f-b834ffeb22f4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:32.913264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e9ea473-396a-49c4-aa1f-b834ffeb22f4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:33.051527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0e9ea473-396a-49c4-aa1f-b834ffeb22f4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:33.059818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0e9ea473-396a-49c4-aa1f-b834ffeb22f4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:33.061606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0e9ea473-396a-49c4-aa1f-b834ffeb22f4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:33.063031 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0e9ea473-396a-49c4-aa1f-b834ffeb22f4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.162929 Mar 12 20:49:33.063921 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 298/569] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:32 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:33.069186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4bc4f161-50a9-4e74-b460-57b60e3123ab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:33.069919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4bc4f161-50a9-4e74-b460-57b60e3123ab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:33.076649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bc4f161-50a9-4e74-b460-57b60e3123ab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:33.077225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bc4f161-50a9-4e74-b460-57b60e3123ab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:33.078317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bc4f161-50a9-4e74-b460-57b60e3123ab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:33.078980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bc4f161-50a9-4e74-b460-57b60e3123ab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:33.229611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4bc4f161-50a9-4e74-b460-57b60e3123ab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:33.238801 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4bc4f161-50a9-4e74-b460-57b60e3123ab tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1311 microversion: 2.1 time: 0.173653 Mar 12 20:49:33.252637 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 299/570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:33 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1311 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:33.275575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-45be0e04-fb76-48ea-ae09-8801bdbc23bd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:33.276416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-45be0e04-fb76-48ea-ae09-8801bdbc23bd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:33.283140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45be0e04-fb76-48ea-ae09-8801bdbc23bd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:33.283777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45be0e04-fb76-48ea-ae09-8801bdbc23bd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:33.284765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45be0e04-fb76-48ea-ae09-8801bdbc23bd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:33.285214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45be0e04-fb76-48ea-ae09-8801bdbc23bd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:33.358544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-45be0e04-fb76-48ea-ae09-8801bdbc23bd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '073b94a21f4049fe9ca8fd5f908f498e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3758c472ec7d47d6a85c9eb1cae6e39b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:33.367167 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-45be0e04-fb76-48ea-ae09-8801bdbc23bd tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 200 len: 1432 microversion: 2.1 time: 0.096069 Mar 12 20:49:33.367777 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 300/571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:33 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 1432 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:33.551435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f26fbb13-45d9-40bf-b33c-63c21bff3f1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:33.552163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f26fbb13-45d9-40bf-b33c-63c21bff3f1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:33.559571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f26fbb13-45d9-40bf-b33c-63c21bff3f1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:33.560365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f26fbb13-45d9-40bf-b33c-63c21bff3f1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:33.561397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f26fbb13-45d9-40bf-b33c-63c21bff3f1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:33.562153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f26fbb13-45d9-40bf-b33c-63c21bff3f1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:33.707245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f26fbb13-45d9-40bf-b33c-63c21bff3f1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:33.715735 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f26fbb13-45d9-40bf-b33c-63c21bff3f1b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.168440 Mar 12 20:49:33.716409 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 301/572] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:33 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:33.892151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-73a5e1de-56f9-487d-a485-e94fbcfa20fd tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Calling method '.version_select at 0x7f6e372490d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:33.893477 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:33.893477 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:33.894814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73a5e1de-56f9-487d-a485-e94fbcfa20fd tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:33.895271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73a5e1de-56f9-487d-a485-e94fbcfa20fd tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:33.896084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73a5e1de-56f9-487d-a485-e94fbcfa20fd tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:33.897059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73a5e1de-56f9-487d-a485-e94fbcfa20fd tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:33.925667 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-73a5e1de-56f9-487d-a485-e94fbcfa20fd tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.207855 Mar 12 20:49:33.926332 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 302/573] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Mar 12 20:49:33 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:33.931203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-53435d1a-323d-4909-a167-19f9272358f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:33.932084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-53435d1a-323d-4909-a167-19f9272358f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:33.937959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53435d1a-323d-4909-a167-19f9272358f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:33.943727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53435d1a-323d-4909-a167-19f9272358f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:33.944524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53435d1a-323d-4909-a167-19f9272358f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:33.944972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53435d1a-323d-4909-a167-19f9272358f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:34.086838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-53435d1a-323d-4909-a167-19f9272358f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:34.094748 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-53435d1a-323d-4909-a167-19f9272358f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1475 microversion: 2.1 time: 0.167444 Mar 12 20:49:34.095319 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 303/574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:33 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1475 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:34.235072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-31b479da-162a-4244-8ca5-93f9b242f981 tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Calling method '.version_select at 0x7f6e37334670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:34.238712 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:34.238712 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:34.240659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-31b479da-162a-4244-8ca5-93f9b242f981 tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '6f11d3dd025a4970af2c871c048c3f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded39b772f034268b19e57a15fa1dd79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:34.241609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-31b479da-162a-4244-8ca5-93f9b242f981 tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:34.246682 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-31b479da-162a-4244-8ca5-93f9b242f981 tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.150383 Mar 12 20:49:34.247777 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 304/575] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Mar 12 20:49:34 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 152 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:34.257299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-076886dd-460a-4af7-9f37-e6587bddfc45 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:34.262799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-076886dd-460a-4af7-9f37-e6587bddfc45 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:34.275842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-076886dd-460a-4af7-9f37-e6587bddfc45 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:34.276628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-076886dd-460a-4af7-9f37-e6587bddfc45 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:34.277642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-076886dd-460a-4af7-9f37-e6587bddfc45 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:34.278820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-076886dd-460a-4af7-9f37-e6587bddfc45 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:34.438379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-076886dd-460a-4af7-9f37-e6587bddfc45 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:34.450105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-076886dd-460a-4af7-9f37-e6587bddfc45 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:34.452239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-076886dd-460a-4af7-9f37-e6587bddfc45 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:34.453841 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-076886dd-460a-4af7-9f37-e6587bddfc45 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.204808 Mar 12 20:49:34.455472 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 305/576] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:34 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:34.462360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-709b7409-aecd-444b-8039-59c478634fcc req-985003e3-82a2-4d80-bc40-d1704d783697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9c242e-54fc-4196-9994-8f4ee1f315bb", "name": "network-vif-unplugged", "status": "completed", "tag": "82ff1918-4a6e-4bbf-8c05-c4ed1a053981"}, {"name": "network-changed", "server_uuid": "4f9c242e-54fc-4196-9994-8f4ee1f315bb", "tag": "82ff1918-4a6e-4bbf-8c05-c4ed1a053981"}, {"server_uuid": "c88bacb8-65ca-46cd-abda-0bf2772c950e", "name": "network-vif-deleted", "tag": "3403e4ee-cc92-406d-8b03-966986c25d77"}, {"server_uuid": "2eb40313-ddf5-44a6-8898-8c76ab6e1e29", "name": "network-vif-unplugged", "status": "completed", "tag": "9350a43c-e942-483b-b81d-2affe8e464d3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:34.475092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-709b7409-aecd-444b-8039-59c478634fcc req-985003e3-82a2-4d80-bc40-d1704d783697 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:34.476559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-709b7409-aecd-444b-8039-59c478634fcc req-985003e3-82a2-4d80-bc40-d1704d783697 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:34.493826 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-709b7409-aecd-444b-8039-59c478634fcc req-985003e3-82a2-4d80-bc40-d1704d783697 service nova] Creating event network-vif-unplugged:82ff1918-4a6e-4bbf-8c05-c4ed1a053981 for instance 4f9c242e-54fc-4196-9994-8f4ee1f315bb on nch2-master-1 Mar 12 20:49:34.494343 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-709b7409-aecd-444b-8039-59c478634fcc req-985003e3-82a2-4d80-bc40-d1704d783697 service nova] Creating event network-changed:82ff1918-4a6e-4bbf-8c05-c4ed1a053981 for instance 4f9c242e-54fc-4196-9994-8f4ee1f315bb on nch2-master-1 Mar 12 20:49:34.496120 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-709b7409-aecd-444b-8039-59c478634fcc req-985003e3-82a2-4d80-bc40-d1704d783697 service nova] Creating event network-vif-deleted:3403e4ee-cc92-406d-8b03-966986c25d77 for instance c88bacb8-65ca-46cd-abda-0bf2772c950e on nch1-master-1 Mar 12 20:49:34.496642 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-709b7409-aecd-444b-8039-59c478634fcc req-985003e3-82a2-4d80-bc40-d1704d783697 service nova] Creating event network-vif-unplugged:9350a43c-e942-483b-b81d-2affe8e464d3 for instance 2eb40313-ddf5-44a6-8898-8c76ab6e1e29 on nch2-master-1 Mar 12 20:49:34.509297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-709b7409-aecd-444b-8039-59c478634fcc req-985003e3-82a2-4d80-bc40-d1704d783697 service nova] Instance 2eb40313-ddf5-44a6-8898-8c76ab6e1e29 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:49:34.526805 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-709b7409-aecd-444b-8039-59c478634fcc req-985003e3-82a2-4d80-bc40-d1704d783697 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.069501 Mar 12 20:49:34.527426 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 306/577] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:34.532926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ef6a599-5cc7-4314-bcf6-b319b0efdcef tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Calling method '.version_select at 0x7f6e37322dc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:34.533856 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:34.533856 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:34.535043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ef6a599-5cc7-4314-bcf6-b319b0efdcef tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '6f11d3dd025a4970af2c871c048c3f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded39b772f034268b19e57a15fa1dd79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:34.535622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ef6a599-5cc7-4314-bcf6-b319b0efdcef tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:34.538546 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ef6a599-5cc7-4314-bcf6-b319b0efdcef tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.009387 Mar 12 20:49:34.542917 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 307/578] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Mar 12 20:49:34 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:34.547834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2b7d766d-a50f-4d33-9a60-40bca720d9c5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:34.548575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2b7d766d-a50f-4d33-9a60-40bca720d9c5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:34.557017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b7d766d-a50f-4d33-9a60-40bca720d9c5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:34.557671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b7d766d-a50f-4d33-9a60-40bca720d9c5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:34.559245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b7d766d-a50f-4d33-9a60-40bca720d9c5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:34.559700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b7d766d-a50f-4d33-9a60-40bca720d9c5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:34.707362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2b7d766d-a50f-4d33-9a60-40bca720d9c5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:34.716692 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2b7d766d-a50f-4d33-9a60-40bca720d9c5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1494 microversion: 2.1 time: 0.173673 Mar 12 20:49:34.717202 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 308/579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:34 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1494 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:34.727256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26cfc474-4047-423b-bbb8-27073c00043f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:34.728141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-26cfc474-4047-423b-bbb8-27073c00043f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] [instance: c88bacb8-65ca-46cd-abda-0bf2772c950e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:34.734000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26cfc474-4047-423b-bbb8-27073c00043f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:34.734469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26cfc474-4047-423b-bbb8-27073c00043f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:34.735252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26cfc474-4047-423b-bbb8-27073c00043f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:34.735699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26cfc474-4047-423b-bbb8-27073c00043f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:34.750110 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-26cfc474-4047-423b-bbb8-27073c00043f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] HTTP exception thrown: Instance c88bacb8-65ca-46cd-abda-0bf2772c950e could not be found. Mar 12 20:49:34.750744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26cfc474-4047-423b-bbb8-27073c00043f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] Returning 404 to user: Instance c88bacb8-65ca-46cd-abda-0bf2772c950e could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:34.751582 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-26cfc474-4047-423b-bbb8-27073c00043f tempest-LiveMigrationNegativeTest-861293148 tempest-LiveMigrationNegativeTest-861293148-project] 10.222.0.30 "GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e" status: 404 len: 111 microversion: 2.1 time: 0.033465 Mar 12 20:49:34.752138 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 309/580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:34 2022] GET /compute/v2.1/servers/c88bacb8-65ca-46cd-abda-0bf2772c950e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:34.757549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd7c82be-7da5-4c65-92d7-e240b06ff08d tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Calling method '.version_select at 0x7f6e372e5280>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:34.758032 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:34.758032 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:34.766153 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bd7c82be-7da5-4c65-92d7-e240b06ff08d tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 12 20:49:34.766754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd7c82be-7da5-4c65-92d7-e240b06ff08d tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:34.767579 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd7c82be-7da5-4c65-92d7-e240b06ff08d tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.014535 Mar 12 20:49:34.768118 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 310/581] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Mar 12 20:49:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:49:34.772525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-753e43a8-1d13-4fae-9e0a-5060b6184df2 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:34.773171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-753e43a8-1d13-4fae-9e0a-5060b6184df2 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:34.780020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-753e43a8-1d13-4fae-9e0a-5060b6184df2 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:34.780482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-753e43a8-1d13-4fae-9e0a-5060b6184df2 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:34.781528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-753e43a8-1d13-4fae-9e0a-5060b6184df2 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:34.781818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-753e43a8-1d13-4fae-9e0a-5060b6184df2 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:34.959140 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-753e43a8-1d13-4fae-9e0a-5060b6184df2 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1645 microversion: 2.1 time: 0.189777 Mar 12 20:49:34.960853 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 311/582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:34 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1645 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:34.979531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-efb3965b-eea9-4721-a33e-8881ef278ffe tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:34.980766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-efb3965b-eea9-4721-a33e-8881ef278ffe tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:34.990870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb3965b-eea9-4721-a33e-8881ef278ffe tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:34.991512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb3965b-eea9-4721-a33e-8881ef278ffe tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:34.992467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb3965b-eea9-4721-a33e-8881ef278ffe tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:34.993118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb3965b-eea9-4721-a33e-8881ef278ffe tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:35.177310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-efb3965b-eea9-4721-a33e-8881ef278ffe tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:35.185925 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-efb3965b-eea9-4721-a33e-8881ef278ffe tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.223747 Mar 12 20:49:35.186832 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 312/583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:34 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:35.191351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1fa338b8-d364-420a-83bb-dc513c5cca82 tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Calling method '.version_select at 0x7f6e37322700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:35.192161 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:35.192161 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:35.193268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1fa338b8-d364-420a-83bb-dc513c5cca82 tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '6f11d3dd025a4970af2c871c048c3f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded39b772f034268b19e57a15fa1dd79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:35.193944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1fa338b8-d364-420a-83bb-dc513c5cca82 tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:35.194753 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1fa338b8-d364-420a-83bb-dc513c5cca82 tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.007156 Mar 12 20:49:35.195257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 313/584] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Mar 12 20:49:35 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:35.201943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4dd86151-48d7-4d3d-9107-b555791a05a4 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:35.202579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4dd86151-48d7-4d3d-9107-b555791a05a4 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:35.211434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4dd86151-48d7-4d3d-9107-b555791a05a4 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:35.212228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4dd86151-48d7-4d3d-9107-b555791a05a4 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:35.213387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4dd86151-48d7-4d3d-9107-b555791a05a4 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:35.214189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4dd86151-48d7-4d3d-9107-b555791a05a4 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:35.381525 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4dd86151-48d7-4d3d-9107-b555791a05a4 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1645 microversion: 2.1 time: 0.185261 Mar 12 20:49:35.382142 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 314/585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:35 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1645 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:35.386798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d264bf91-0e70-4407-825c-218208ea0ee7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:35.387429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d264bf91-0e70-4407-825c-218208ea0ee7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:35.393387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d264bf91-0e70-4407-825c-218208ea0ee7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:35.393872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d264bf91-0e70-4407-825c-218208ea0ee7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:35.394664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d264bf91-0e70-4407-825c-218208ea0ee7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:35.395109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d264bf91-0e70-4407-825c-218208ea0ee7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:35.532933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d264bf91-0e70-4407-825c-218208ea0ee7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:35.541136 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d264bf91-0e70-4407-825c-218208ea0ee7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1475 microversion: 2.1 time: 0.157992 Mar 12 20:49:35.541717 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 315/586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:35 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1475 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:35.546147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4fe03b39-6e82-4997-b557-cc9d33824312 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Calling method '.version_select at 0x7f6e375d3550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:35.547003 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:35.547003 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:35.552233 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-4fe03b39-6e82-4997-b557-cc9d33824312 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 12 20:49:35.552854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4fe03b39-6e82-4997-b557-cc9d33824312 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:35.553669 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4fe03b39-6e82-4997-b557-cc9d33824312 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.011028 Mar 12 20:49:35.554233 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 316/587] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Mar 12 20:49:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:49:35.558871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8bfe3924-0c61-4572-b907-508ba124246e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:35.560553 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:35.560553 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:35.563166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8bfe3924-0c61-4572-b907-508ba124246e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:35.563634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8bfe3924-0c61-4572-b907-508ba124246e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:35.564460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8bfe3924-0c61-4572-b907-508ba124246e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:35.564910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8bfe3924-0c61-4572-b907-508ba124246e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:35.591943 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8bfe3924-0c61-4572-b907-508ba124246e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036633 Mar 12 20:49:35.593979 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 317/588] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Mar 12 20:49:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:35.602530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-92f3b983-a3d9-4b8c-9e42-5ae0757eb36d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:35.603628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-92f3b983-a3d9-4b8c-9e42-5ae0757eb36d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:35.612011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92f3b983-a3d9-4b8c-9e42-5ae0757eb36d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:35.612479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92f3b983-a3d9-4b8c-9e42-5ae0757eb36d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:35.613723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92f3b983-a3d9-4b8c-9e42-5ae0757eb36d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:35.614350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92f3b983-a3d9-4b8c-9e42-5ae0757eb36d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:35.777691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-92f3b983-a3d9-4b8c-9e42-5ae0757eb36d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:35.788401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-92f3b983-a3d9-4b8c-9e42-5ae0757eb36d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:35.790514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-92f3b983-a3d9-4b8c-9e42-5ae0757eb36d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:35.792171 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-92f3b983-a3d9-4b8c-9e42-5ae0757eb36d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.196664 Mar 12 20:49:35.793095 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 318/589] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:35 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:35.797943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43a15cf0-da98-4c06-b656-a56005895e9c tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Calling method '.version_select at 0x7f6e373220d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:35.798744 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:35.798744 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:35.799823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-43a15cf0-da98-4c06-b656-a56005895e9c tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '6f11d3dd025a4970af2c871c048c3f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded39b772f034268b19e57a15fa1dd79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:35.800513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43a15cf0-da98-4c06-b656-a56005895e9c tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:35.801316 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-43a15cf0-da98-4c06-b656-a56005895e9c tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.007493 Mar 12 20:49:35.801850 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 319/590] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Mar 12 20:49:35 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:35.806802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80f83c23-2a91-4880-adb9-65da20fef76e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:35.807349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80f83c23-2a91-4880-adb9-65da20fef76e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:35.814148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80f83c23-2a91-4880-adb9-65da20fef76e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:35.815254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80f83c23-2a91-4880-adb9-65da20fef76e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:35.819341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80f83c23-2a91-4880-adb9-65da20fef76e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:35.819856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80f83c23-2a91-4880-adb9-65da20fef76e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:35.925814 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80f83c23-2a91-4880-adb9-65da20fef76e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2/action" status: 202 len: 0 microversion: 2.1 time: 0.122167 Mar 12 20:49:35.929228 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 320/591] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:49:35 2022] POST /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:35.931902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-482445e4-b446-4881-ade3-376c3364f0a0 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Calling method '.version_select at 0x7f6e3728d3a0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:35.932776 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:35.932776 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:35.946073 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-482445e4-b446-4881-ade3-376c3364f0a0 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 12 20:49:35.947089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-482445e4-b446-4881-ade3-376c3364f0a0 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:35.947938 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-482445e4-b446-4881-ade3-376c3364f0a0 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.020459 Mar 12 20:49:35.948673 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 321/592] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Mar 12 20:49:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:49:35.955863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de0fb30f-2a1e-46c8-87eb-af948774cd3e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:35.956995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-de0fb30f-2a1e-46c8-87eb-af948774cd3e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:35.965883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de0fb30f-2a1e-46c8-87eb-af948774cd3e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:35.967116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de0fb30f-2a1e-46c8-87eb-af948774cd3e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:35.969077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de0fb30f-2a1e-46c8-87eb-af948774cd3e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:35.969902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de0fb30f-2a1e-46c8-87eb-af948774cd3e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:36.079998 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0dede199-7a35-45e7-b108-17b76b7f57c1 tempest-SecurityGroupsTestAdminJSON-1838539291 tempest-SecurityGroupsTestAdminJSON-1838539291-project-admin] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12428 microversion: 2.1 time: 4.525833 Mar 12 20:49:36.080616 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 272/593] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Mar 12 20:49:31 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12428 bytes in 4527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:49:36.086106 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-47809a15-c298-4e38-ae5d-92d7ac21178d tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Calling method '.version_select at 0x7f6e372d68b0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:36.087174 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:36.087174 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:49:36.088522 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-47809a15-c298-4e38-ae5d-92d7ac21178d tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '6f11d3dd025a4970af2c871c048c3f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded39b772f034268b19e57a15fa1dd79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:36.089338 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-47809a15-c298-4e38-ae5d-92d7ac21178d tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:36.090320 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-47809a15-c298-4e38-ae5d-92d7ac21178d tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.008833 Mar 12 20:49:36.096614 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 273/594] 10.222.0.30 () {58 vars in 1193 bytes} [Sat Mar 12 20:49:36 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:36.101405 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3578429a-7a94-42c2-b301-1f583dfb2cc4 tempest-SecurityGroupsTestAdminJSON-1383587862 tempest-SecurityGroupsTestAdminJSON-1383587862-project] Calling method '.version_select at 0x7f6e37250550>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:36.142791 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de0fb30f-2a1e-46c8-87eb-af948774cd3e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1650 microversion: 2.1 time: 0.192690 Mar 12 20:49:36.146274 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 322/595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:35 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1650 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:36.154047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-feeba53c-7609-4fe0-8397-0fad2e0f630e tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Calling method '.version_select at 0x7f6e373c1e50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:36.154861 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:36.154861 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:36.163529 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-feeba53c-7609-4fe0-8397-0fad2e0f630e tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 12 20:49:36.164141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-feeba53c-7609-4fe0-8397-0fad2e0f630e tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:36.165058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-feeba53c-7609-4fe0-8397-0fad2e0f630e tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.016129 Mar 12 20:49:36.166126 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 323/596] 10.222.0.30 () {58 vars in 1214 bytes} [Sat Mar 12 20:49:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:49:36.185095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ce05f54-3599-4f6b-b54d-1cccbe8055fb tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Action: 'update', calling method: .version_select at 0x7f6e3728d8b0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:36.186404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ce05f54-3599-4f6b-b54d-1cccbe8055fb tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:36.187241 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ce05f54-3599-4f6b-b54d-1cccbe8055fb tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.015484 Mar 12 20:49:36.191643 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 324/597] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Mar 12 20:49:36 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:49:36.202706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c76f143-6293-4f47-8d46-447bce09333e tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Action: 'update', calling method: .version_select at 0x7f6e37235700>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:36.203935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c76f143-6293-4f47-8d46-447bce09333e tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:36.207289 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c76f143-6293-4f47-8d46-447bce09333e tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.011225 Mar 12 20:49:36.207892 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 325/598] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Mar 12 20:49:36 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:49:36.217280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-03ac6ed2-d84d-4410-a961-889e77b15b11 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:36.218134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-03ac6ed2-d84d-4410-a961-889e77b15b11 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:36.225186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03ac6ed2-d84d-4410-a961-889e77b15b11 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:36.225639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03ac6ed2-d84d-4410-a961-889e77b15b11 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:36.227316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03ac6ed2-d84d-4410-a961-889e77b15b11 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:36.227921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03ac6ed2-d84d-4410-a961-889e77b15b11 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:36.311801 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3578429a-7a94-42c2-b301-1f583dfb2cc4 tempest-SecurityGroupsTestAdminJSON-1383587862 tempest-SecurityGroupsTestAdminJSON-1383587862-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.214052 Mar 12 20:49:36.319117 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 274/599] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Mar 12 20:49:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:36.319117 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c068362b-803c-4615-99bd-b957957d5d64 tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Action: 'update', calling method: .version_select at 0x7f6e37250160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:36.319948 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:36.319948 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:49:36.321241 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c068362b-803c-4615-99bd-b957957d5d64 tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '6f11d3dd025a4970af2c871c048c3f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded39b772f034268b19e57a15fa1dd79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:36.322616 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c068362b-803c-4615-99bd-b957957d5d64 tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:36.323045 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c068362b-803c-4615-99bd-b957957d5d64 tempest-HostsAdminNegativeTestJSON-540830411 tempest-HostsAdminNegativeTestJSON-540830411-project] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.009242 Mar 12 20:49:36.323573 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 275/600] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Mar 12 20:49:36 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:36.327902 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9b5ed3a3-5bdc-404e-b60f-4653143cbc61 tempest-SecurityGroupsTestAdminJSON-1838539291 tempest-SecurityGroupsTestAdminJSON-1838539291-project-admin] Calling method '.version_select at 0x7f6e37387f70>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:36.430555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-03ac6ed2-d84d-4410-a961-889e77b15b11 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:36.442313 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-03ac6ed2-d84d-4410-a961-889e77b15b11 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.233261 Mar 12 20:49:36.452927 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 326/601] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:36 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:36.461796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ee90c60-a48c-4ffc-a74b-49e7383521ce tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Action: 'update', calling method: .version_select at 0x7f6e372e5940>, body: {"status": null, "maintenance_mode": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:36.461796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ee90c60-a48c-4ffc-a74b-49e7383521ce tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:36.461796 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ee90c60-a48c-4ffc-a74b-49e7383521ce tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.012388 Mar 12 20:49:36.462254 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 327/602] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Mar 12 20:49:36 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:49:36.488431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37b08828-3c49-4c8a-85f4-8f0a4cd77472 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Action: 'update', calling method: .version_select at 0x7f6e37515dc0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:36.489682 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:36.489682 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:36.491517 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.hosts [None req-37b08828-3c49-4c8a-85f4-8f0a4cd77472 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Enabling host nonexistent_hostname. Mar 12 20:49:36.491757 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9b5ed3a3-5bdc-404e-b60f-4653143cbc61 tempest-SecurityGroupsTestAdminJSON-1838539291 tempest-SecurityGroupsTestAdminJSON-1838539291-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c938bf07-f61b-477c-a99a-e4312b726e8e" status: 202 len: 0 microversion: 2.1 time: 0.167074 Mar 12 20:49:36.492417 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 276/603] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:49:36 2022] DELETE /compute/v2.1/os-security-groups/c938bf07-f61b-477c-a99a-e4312b726e8e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:36.500986 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ecfb54c8-bc97-46d5-8b90-295ec1c86f92 tempest-SecurityGroupsTestAdminJSON-1838539291 tempest-SecurityGroupsTestAdminJSON-1838539291-project-admin] Calling method '.version_select at 0x7f6e372ddaf0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:36.518097 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-37b08828-3c49-4c8a-85f4-8f0a4cd77472 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 12 20:49:36.518717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37b08828-3c49-4c8a-85f4-8f0a4cd77472 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:36.519678 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-37b08828-3c49-4c8a-85f4-8f0a4cd77472 tempest-HostsAdminNegativeTestJSON-1400197956 tempest-HostsAdminNegativeTestJSON-1400197956-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.051856 Mar 12 20:49:36.521155 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 328/604] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Mar 12 20:49:36 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:49:36.551775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a3991590-5f1c-470d-b918-c51101a3bdce req-b03dd7aa-0d98-44e9-8127-20fae9d4f5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb40313-ddf5-44a6-8898-8c76ab6e1e29", "tag": "9350a43c-e942-483b-b81d-2affe8e464d3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:36.570549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a3991590-5f1c-470d-b918-c51101a3bdce req-b03dd7aa-0d98-44e9-8127-20fae9d4f5b7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:36.571009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a3991590-5f1c-470d-b918-c51101a3bdce req-b03dd7aa-0d98-44e9-8127-20fae9d4f5b7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:36.586498 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a3991590-5f1c-470d-b918-c51101a3bdce req-b03dd7aa-0d98-44e9-8127-20fae9d4f5b7 service nova] Creating event network-changed:9350a43c-e942-483b-b81d-2affe8e464d3 for instance 2eb40313-ddf5-44a6-8898-8c76ab6e1e29 on nch2-master-1 Mar 12 20:49:36.592264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-a3991590-5f1c-470d-b918-c51101a3bdce req-b03dd7aa-0d98-44e9-8127-20fae9d4f5b7 service nova] Instance 2eb40313-ddf5-44a6-8898-8c76ab6e1e29 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:49:36.614066 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a3991590-5f1c-470d-b918-c51101a3bdce req-b03dd7aa-0d98-44e9-8127-20fae9d4f5b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066851 Mar 12 20:49:36.615901 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 329/605] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:36.637944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d146e387-2d47-459e-9762-0ee14b84fbc1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:36.638691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d146e387-2d47-459e-9762-0ee14b84fbc1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:36.651149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d146e387-2d47-459e-9762-0ee14b84fbc1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:36.651934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d146e387-2d47-459e-9762-0ee14b84fbc1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:36.653277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d146e387-2d47-459e-9762-0ee14b84fbc1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:36.654185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d146e387-2d47-459e-9762-0ee14b84fbc1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:36.845814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d146e387-2d47-459e-9762-0ee14b84fbc1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:36.854786 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d146e387-2d47-459e-9762-0ee14b84fbc1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1473 microversion: 2.1 time: 0.237361 Mar 12 20:49:36.855642 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 330/606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:36 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1473 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:36.876583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c030044b-dae8-4ead-b8b6-0165f0fe15fd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:36.877435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c030044b-dae8-4ead-b8b6-0165f0fe15fd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:36.886040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c030044b-dae8-4ead-b8b6-0165f0fe15fd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:36.886500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c030044b-dae8-4ead-b8b6-0165f0fe15fd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:36.887872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c030044b-dae8-4ead-b8b6-0165f0fe15fd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:36.887872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c030044b-dae8-4ead-b8b6-0165f0fe15fd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:36.938715 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ecfb54c8-bc97-46d5-8b90-295ec1c86f92 tempest-SecurityGroupsTestAdminJSON-1838539291 tempest-SecurityGroupsTestAdminJSON-1838539291-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2411db49-e94e-4f7b-a2f4-e4621590cf9b" status: 202 len: 0 microversion: 2.1 time: 0.441825 Mar 12 20:49:36.940763 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 277/607] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:49:36 2022] DELETE /compute/v2.1/os-security-groups/2411db49-e94e-4f7b-a2f4-e4621590cf9b => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:36.948855 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-62526a35-39d4-441e-979d-8e46ccc33781 tempest-SecurityGroupsTestAdminJSON-1383587862 tempest-SecurityGroupsTestAdminJSON-1383587862-project] Calling method '.version_select at 0x7f6e3731bc10>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:37.170949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c030044b-dae8-4ead-b8b6-0165f0fe15fd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:37.186239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c030044b-dae8-4ead-b8b6-0165f0fe15fd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:37.192027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c030044b-dae8-4ead-b8b6-0165f0fe15fd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:37.193431 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c030044b-dae8-4ead-b8b6-0165f0fe15fd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.336570 Mar 12 20:49:37.196267 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 331/608] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:36 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:37.202236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-451e20a8-8625-4274-866a-ad3f07c1db96 req-eb6c2d4c-3c7b-4c1d-bc28-bd096798f249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3364cfe2-8555-4de1-9fd9-29e3d2cfabab", "name": "network-vif-plugged", "status": "completed", "tag": "84a71a9a-c3a4-4a15-927a-2a83d6d25f3d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:37.231841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-451e20a8-8625-4274-866a-ad3f07c1db96 req-eb6c2d4c-3c7b-4c1d-bc28-bd096798f249 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:37.234592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-451e20a8-8625-4274-866a-ad3f07c1db96 req-eb6c2d4c-3c7b-4c1d-bc28-bd096798f249 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:37.260427 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-451e20a8-8625-4274-866a-ad3f07c1db96 req-eb6c2d4c-3c7b-4c1d-bc28-bd096798f249 service nova] Creating event network-vif-plugged:84a71a9a-c3a4-4a15-927a-2a83d6d25f3d for instance 3364cfe2-8555-4de1-9fd9-29e3d2cfabab on nch1-master-1 Mar 12 20:49:37.270609 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-451e20a8-8625-4274-866a-ad3f07c1db96 req-eb6c2d4c-3c7b-4c1d-bc28-bd096798f249 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069418 Mar 12 20:49:37.270609 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 332/609] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:37.276317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-703986c5-8332-45f9-9ec4-940986a73395 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:37.278856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-703986c5-8332-45f9-9ec4-940986a73395 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:37.286485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-703986c5-8332-45f9-9ec4-940986a73395 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:37.288447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-703986c5-8332-45f9-9ec4-940986a73395 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:37.289962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-703986c5-8332-45f9-9ec4-940986a73395 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:37.290691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-703986c5-8332-45f9-9ec4-940986a73395 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:37.495157 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-62526a35-39d4-441e-979d-8e46ccc33781 tempest-SecurityGroupsTestAdminJSON-1383587862 tempest-SecurityGroupsTestAdminJSON-1383587862-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/57b40cca-a49d-4aea-8ee6-354be5b89a1f" status: 202 len: 0 microversion: 2.1 time: 0.551151 Mar 12 20:49:37.495898 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 278/610] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:49:36 2022] DELETE /compute/v2.1/os-security-groups/57b40cca-a49d-4aea-8ee6-354be5b89a1f => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 20:49:37.503362 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-84748dff-3a47-48f0-970f-363641d7ae17 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:37.503992 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-84748dff-3a47-48f0-970f-363641d7ae17 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:37.511879 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-84748dff-3a47-48f0-970f-363641d7ae17 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:37.512753 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-84748dff-3a47-48f0-970f-363641d7ae17 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:37.513977 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-84748dff-3a47-48f0-970f-363641d7ae17 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:37.514734 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-84748dff-3a47-48f0-970f-363641d7ae17 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:37.678324 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-703986c5-8332-45f9-9ec4-940986a73395 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1630 microversion: 2.1 time: 0.406139 Mar 12 20:49:37.690736 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 333/611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:37 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1630 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:37.692960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eab4145f-896f-437f-9e8d-86b874c76012 tempest-SecurityGroupsTestAdminJSON-1383587862 tempest-SecurityGroupsTestAdminJSON-1383587862-project] Calling method '.version_select at 0x7f6e3751b040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:38.060717 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-84748dff-3a47-48f0-970f-363641d7ae17 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:38.072034 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-84748dff-3a47-48f0-970f-363641d7ae17 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.572419 Mar 12 20:49:38.073809 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 279/612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:37 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:38.079578 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eab4145f-896f-437f-9e8d-86b874c76012 tempest-SecurityGroupsTestAdminJSON-1383587862 tempest-SecurityGroupsTestAdminJSON-1383587862-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/42036db1-2e2a-4c51-a4ab-1b0dafdff772" status: 202 len: 0 microversion: 2.1 time: 0.385995 Mar 12 20:49:38.082177 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 334/613] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:49:37 2022] DELETE /compute/v2.1/os-security-groups/42036db1-2e2a-4c51-a4ab-1b0dafdff772 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:38.085431 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-11ad5b6e-5471-4660-9c38-37545e2fee0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:38.087973 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-11ad5b6e-5471-4660-9c38-37545e2fee0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:38.091356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f5a3aca-2229-4a4e-980a-dcaa5dcf115e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:38.092241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f5a3aca-2229-4a4e-980a-dcaa5dcf115e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:38.099453 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-11ad5b6e-5471-4660-9c38-37545e2fee0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:38.100035 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-11ad5b6e-5471-4660-9c38-37545e2fee0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:38.100725 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-11ad5b6e-5471-4660-9c38-37545e2fee0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:38.101168 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-11ad5b6e-5471-4660-9c38-37545e2fee0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:38.117164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f5a3aca-2229-4a4e-980a-dcaa5dcf115e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:38.117663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f5a3aca-2229-4a4e-980a-dcaa5dcf115e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:38.118817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f5a3aca-2229-4a4e-980a-dcaa5dcf115e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:38.120073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f5a3aca-2229-4a4e-980a-dcaa5dcf115e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:38.132674 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-11ad5b6e-5471-4660-9c38-37545e2fee0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lazy-loading 'flavor' on Instance uuid ab950cd9-846a-49c5-964c-7f8f96d7bed2 {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:49:38.164299 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-11ad5b6e-5471-4660-9c38-37545e2fee0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Going to try to live migrate instance to nch1-master-1 {{(pid=136303) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 12 20:49:38.374195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8f5a3aca-2229-4a4e-980a-dcaa5dcf115e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:38.382476 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f5a3aca-2229-4a4e-980a-dcaa5dcf115e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.299244 Mar 12 20:49:38.383050 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 335/614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:38 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:38.387792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cf368f9d-6abe-4f45-96d8-ec1d5216a678 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:38.388447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cf368f9d-6abe-4f45-96d8-ec1d5216a678 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:38.394131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf368f9d-6abe-4f45-96d8-ec1d5216a678 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:38.394785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf368f9d-6abe-4f45-96d8-ec1d5216a678 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:38.395682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf368f9d-6abe-4f45-96d8-ec1d5216a678 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:38.396180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf368f9d-6abe-4f45-96d8-ec1d5216a678 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:38.557734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cf368f9d-6abe-4f45-96d8-ec1d5216a678 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:38.565885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cf368f9d-6abe-4f45-96d8-ec1d5216a678 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:38.567315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cf368f9d-6abe-4f45-96d8-ec1d5216a678 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:38.569072 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cf368f9d-6abe-4f45-96d8-ec1d5216a678 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.184949 Mar 12 20:49:38.569745 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 336/615] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:38 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:38.578062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-583706a4-cbe8-4182-b4c5-e0433bef4b7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:38.578602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-583706a4-cbe8-4182-b4c5-e0433bef4b7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:38.585025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-583706a4-cbe8-4182-b4c5-e0433bef4b7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:38.585540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-583706a4-cbe8-4182-b4c5-e0433bef4b7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:38.586579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-583706a4-cbe8-4182-b4c5-e0433bef4b7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:38.587068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-583706a4-cbe8-4182-b4c5-e0433bef4b7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:38.668747 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-583706a4-cbe8-4182-b4c5-e0433bef4b7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "POST /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29/action" status: 204 len: 0 microversion: 2.1 time: 0.094160 Mar 12 20:49:38.669699 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 337/616] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:49:38 2022] POST /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29/action => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:49:38.681584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-790fa7d0-3d7e-4c52-a1dc-d20a657ae804 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:38.682480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-790fa7d0-3d7e-4c52-a1dc-d20a657ae804 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:38.691408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-790fa7d0-3d7e-4c52-a1dc-d20a657ae804 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:38.692279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-790fa7d0-3d7e-4c52-a1dc-d20a657ae804 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:38.693876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-790fa7d0-3d7e-4c52-a1dc-d20a657ae804 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:38.694499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-790fa7d0-3d7e-4c52-a1dc-d20a657ae804 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:38.937437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-790fa7d0-3d7e-4c52-a1dc-d20a657ae804 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:38.956579 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-790fa7d0-3d7e-4c52-a1dc-d20a657ae804 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.282774 Mar 12 20:49:38.957994 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 338/617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:38 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:39.284383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee2e25cf-dc93-4767-b803-84357e42fd6d tempest-QuotaClassesAdminTestJSON-1123490388 tempest-QuotaClassesAdminTestJSON-1123490388-project-admin] Calling method '.version_select at 0x7f6e3728ddc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:39.285345 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:39.285345 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:39.298157 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee2e25cf-dc93-4767-b803-84357e42fd6d tempest-QuotaClassesAdminTestJSON-1123490388 tempest-QuotaClassesAdminTestJSON-1123490388-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.338524 Mar 12 20:49:39.299122 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 339/618] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Mar 12 20:49:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:39.307396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d21e71a0-8fdc-4045-831a-191ae5f06ce8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:39.308180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d21e71a0-8fdc-4045-831a-191ae5f06ce8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:39.316005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d21e71a0-8fdc-4045-831a-191ae5f06ce8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:39.316467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d21e71a0-8fdc-4045-831a-191ae5f06ce8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:39.317255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d21e71a0-8fdc-4045-831a-191ae5f06ce8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:39.317700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d21e71a0-8fdc-4045-831a-191ae5f06ce8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:39.538970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d21e71a0-8fdc-4045-831a-191ae5f06ce8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:39.556309 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d21e71a0-8fdc-4045-831a-191ae5f06ce8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.255801 Mar 12 20:49:39.559585 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 340/619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:39 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:39.571256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-82f9c404-d1e0-40db-b59b-7a28ccee5047 tempest-QuotaClassesAdminTestJSON-1123490388 tempest-QuotaClassesAdminTestJSON-1123490388-project-admin] Action: 'update', calling method: .version_select at 0x7f6e3728d3a0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:39.573763 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:39.573763 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:40.091288 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-82f9c404-d1e0-40db-b59b-7a28ccee5047 tempest-QuotaClassesAdminTestJSON-1123490388 tempest-QuotaClassesAdminTestJSON-1123490388-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.528889 Mar 12 20:49:40.091994 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 341/620] 10.222.0.30 () {60 vars in 1205 bytes} [Sat Mar 12 20:49:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:40.103566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-837856b0-3754-4325-b03b-bf43c09c3f29 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:40.104175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-837856b0-3754-4325-b03b-bf43c09c3f29 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:40.111113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-837856b0-3754-4325-b03b-bf43c09c3f29 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:40.111835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-837856b0-3754-4325-b03b-bf43c09c3f29 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:40.112862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-837856b0-3754-4325-b03b-bf43c09c3f29 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:40.113479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-837856b0-3754-4325-b03b-bf43c09c3f29 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:40.265182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-837856b0-3754-4325-b03b-bf43c09c3f29 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:40.275468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-837856b0-3754-4325-b03b-bf43c09c3f29 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:40.277537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-837856b0-3754-4325-b03b-bf43c09c3f29 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:40.279398 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-837856b0-3754-4325-b03b-bf43c09c3f29 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.185940 Mar 12 20:49:40.280236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 342/621] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:40 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:40.285361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9d6669f6-6956-40a2-bb37-de6d7b084c6f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:40.286004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9d6669f6-6956-40a2-bb37-de6d7b084c6f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:40.292722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d6669f6-6956-40a2-bb37-de6d7b084c6f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:40.293189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d6669f6-6956-40a2-bb37-de6d7b084c6f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:40.294445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d6669f6-6956-40a2-bb37-de6d7b084c6f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:40.294895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d6669f6-6956-40a2-bb37-de6d7b084c6f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:40.514644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9d6669f6-6956-40a2-bb37-de6d7b084c6f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:40.523763 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9d6669f6-6956-40a2-bb37-de6d7b084c6f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.242347 Mar 12 20:49:40.524325 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 343/622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:40 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:40.528532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce0a1a65-c91c-4b6a-b5e0-09b272b7483b tempest-QuotaClassesAdminTestJSON-1123490388 tempest-QuotaClassesAdminTestJSON-1123490388-project-admin] Calling method '.version_select at 0x7f6e37688820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:40.529334 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:40.529334 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:40.538989 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce0a1a65-c91c-4b6a-b5e0-09b272b7483b tempest-QuotaClassesAdminTestJSON-1123490388 tempest-QuotaClassesAdminTestJSON-1123490388-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.013674 Mar 12 20:49:40.539671 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 344/623] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Mar 12 20:49:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:40.549891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bdb8bf9a-95eb-427c-838c-9f75ce706060 tempest-QuotaClassesAdminTestJSON-1123490388 tempest-QuotaClassesAdminTestJSON-1123490388-project-admin] Action: 'update', calling method: .version_select at 0x7f6e37688430>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:40.552204 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:49:40.552204 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:49:40.666902 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bdb8bf9a-95eb-427c-838c-9f75ce706060 tempest-QuotaClassesAdminTestJSON-1123490388 tempest-QuotaClassesAdminTestJSON-1123490388-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.120408 Mar 12 20:49:40.667510 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 345/624] 10.222.0.30 () {60 vars in 1205 bytes} [Sat Mar 12 20:49:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:40.672507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a467a938-71be-4c19-bea2-0299d2bbf360 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:40.673299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a467a938-71be-4c19-bea2-0299d2bbf360 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:40.680980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a467a938-71be-4c19-bea2-0299d2bbf360 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:40.681795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a467a938-71be-4c19-bea2-0299d2bbf360 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:40.682665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a467a938-71be-4c19-bea2-0299d2bbf360 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:40.683114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a467a938-71be-4c19-bea2-0299d2bbf360 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:40.826159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a467a938-71be-4c19-bea2-0299d2bbf360 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:40.834541 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a467a938-71be-4c19-bea2-0299d2bbf360 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.165683 Mar 12 20:49:40.844223 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 346/625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:40 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:41.104960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-44071f9b-78a7-4960-ba74-29ab3dc61098 tempest-FlavorsV2NegativeTest-1064866572 tempest-FlavorsV2NegativeTest-1064866572-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:41.112877 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-44071f9b-78a7-4960-ba74-29ab3dc61098 tempest-FlavorsV2NegativeTest-1064866572 tempest-FlavorsV2NegativeTest-1064866572-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.234319 Mar 12 20:49:41.113738 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 347/626] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:49:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:41.248327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2092006368", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:41.304452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:49:41.529487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:49:41.535061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:49:41.535767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:49:41.536337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:49:41.537647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:49:41.549887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:41.550495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:41.551143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:41.551583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:41.570373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Getting quotas for project e30e7ec4eede46af8cbd1864dcd1138d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:41.576353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Getting quotas for user ccddd2d92af14ad5b2e799d284a435b4 and project e30e7ec4eede46af8cbd1864dcd1138d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:41.590739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:49:41.593238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:49:41.651892 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-19678a66-e143-4e3c-a7b2-9e3754c46214 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.463664 Mar 12 20:49:41.652657 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 348/627] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 20:49:41.662420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16e95330-2853-40e9-aedd-dc91ac7ea9f9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:41.662420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16e95330-2853-40e9-aedd-dc91ac7ea9f9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:41.669327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16e95330-2853-40e9-aedd-dc91ac7ea9f9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:41.669807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16e95330-2853-40e9-aedd-dc91ac7ea9f9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:41.670599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16e95330-2853-40e9-aedd-dc91ac7ea9f9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:41.671071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16e95330-2853-40e9-aedd-dc91ac7ea9f9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:41.873319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16e95330-2853-40e9-aedd-dc91ac7ea9f9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:41.885316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16e95330-2853-40e9-aedd-dc91ac7ea9f9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:41.887000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16e95330-2853-40e9-aedd-dc91ac7ea9f9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:41.888396 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16e95330-2853-40e9-aedd-dc91ac7ea9f9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.234415 Mar 12 20:49:41.889485 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 349/628] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:41 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:41.894719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a196a35-1d16-4689-849a-059634268fac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:41.895504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a196a35-1d16-4689-849a-059634268fac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:41.902390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a196a35-1d16-4689-849a-059634268fac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:41.902853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a196a35-1d16-4689-849a-059634268fac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:41.903639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a196a35-1d16-4689-849a-059634268fac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:41.904084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a196a35-1d16-4689-849a-059634268fac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:42.089415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5a196a35-1d16-4689-849a-059634268fac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:42.098455 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a196a35-1d16-4689-849a-059634268fac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.207706 Mar 12 20:49:42.099492 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 350/629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:41 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:42.104426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b94b8a7-2200-4b24-bed1-97ae374ab1dd tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:42.105227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b94b8a7-2200-4b24-bed1-97ae374ab1dd tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:42.160404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b94b8a7-2200-4b24-bed1-97ae374ab1dd tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccddd2d92af14ad5b2e799d284a435b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30e7ec4eede46af8cbd1864dcd1138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:42.167267 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b94b8a7-2200-4b24-bed1-97ae374ab1dd tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400" status: 200 len: 1223 microversion: 2.1 time: 0.066456 Mar 12 20:49:42.167842 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 351/630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:42 2022] GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400 => generated 1223 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:42.172511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f63e698e-fe4f-4e40-8659-80f8d9026c68 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:42.173116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f63e698e-fe4f-4e40-8659-80f8d9026c68 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:42.179436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f63e698e-fe4f-4e40-8659-80f8d9026c68 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:42.179894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f63e698e-fe4f-4e40-8659-80f8d9026c68 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:42.180668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f63e698e-fe4f-4e40-8659-80f8d9026c68 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:42.181107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f63e698e-fe4f-4e40-8659-80f8d9026c68 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:42.336772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f63e698e-fe4f-4e40-8659-80f8d9026c68 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:42.345073 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f63e698e-fe4f-4e40-8659-80f8d9026c68 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.175947 Mar 12 20:49:42.346368 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 352/631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:42 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:42.351607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8e3f660-952f-4f87-bfe0-103155b33d6c tempest-FlavorsV2NegativeTest-1064866572 tempest-FlavorsV2NegativeTest-1064866572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1007357120", "imageRef": "97e331cb-accb-4fd0-9e9f-acd0151adf13", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:42.403459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-c8e3f660-952f-4f87-bfe0-103155b33d6c tempest-FlavorsV2NegativeTest-1064866572 tempest-FlavorsV2NegativeTest-1064866572-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:49:42.607931 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c8e3f660-952f-4f87-bfe0-103155b33d6c tempest-FlavorsV2NegativeTest-1064866572 tempest-FlavorsV2NegativeTest-1064866572-project] HTTP exception thrown: Flavor's memory is too small for requested image. Mar 12 20:49:42.608540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8e3f660-952f-4f87-bfe0-103155b33d6c tempest-FlavorsV2NegativeTest-1064866572 tempest-FlavorsV2NegativeTest-1064866572-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:42.609425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8e3f660-952f-4f87-bfe0-103155b33d6c tempest-FlavorsV2NegativeTest-1064866572 tempest-FlavorsV2NegativeTest-1064866572-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.261817 Mar 12 20:49:42.610036 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 353/632] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:42 2022] POST /compute/v2.1/servers => generated 93 bytes in 263 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:49:42.619819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0018527a-fd68-40a1-b473-088e79145410 req-ffc0b039-3769-4cfa-a3f5-77f59ca2daee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb40313-ddf5-44a6-8898-8c76ab6e1e29", "name": "network-vif-plugged", "status": "completed", "tag": "9350a43c-e942-483b-b81d-2affe8e464d3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:42.631260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0018527a-fd68-40a1-b473-088e79145410 req-ffc0b039-3769-4cfa-a3f5-77f59ca2daee service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:42.631791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0018527a-fd68-40a1-b473-088e79145410 req-ffc0b039-3769-4cfa-a3f5-77f59ca2daee service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:42.643853 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0018527a-fd68-40a1-b473-088e79145410 req-ffc0b039-3769-4cfa-a3f5-77f59ca2daee service nova] Creating event network-vif-plugged:9350a43c-e942-483b-b81d-2affe8e464d3 for instance 2eb40313-ddf5-44a6-8898-8c76ab6e1e29 on nch2-master-1 Mar 12 20:49:42.650083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-0018527a-fd68-40a1-b473-088e79145410 req-ffc0b039-3769-4cfa-a3f5-77f59ca2daee service nova] Instance 2eb40313-ddf5-44a6-8898-8c76ab6e1e29 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:49:42.663050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0018527a-fd68-40a1-b473-088e79145410 req-ffc0b039-3769-4cfa-a3f5-77f59ca2daee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047674 Mar 12 20:49:42.663737 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 354/633] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:42.908472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0084bb2f-8f3b-4ccc-aa2e-2c7c87cfb423 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:42.909076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0084bb2f-8f3b-4ccc-aa2e-2c7c87cfb423 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:42.923735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0084bb2f-8f3b-4ccc-aa2e-2c7c87cfb423 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:42.924195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0084bb2f-8f3b-4ccc-aa2e-2c7c87cfb423 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:42.925911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0084bb2f-8f3b-4ccc-aa2e-2c7c87cfb423 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:42.926358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0084bb2f-8f3b-4ccc-aa2e-2c7c87cfb423 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:43.107472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0084bb2f-8f3b-4ccc-aa2e-2c7c87cfb423 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:43.117930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0084bb2f-8f3b-4ccc-aa2e-2c7c87cfb423 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:43.119755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0084bb2f-8f3b-4ccc-aa2e-2c7c87cfb423 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:43.121224 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0084bb2f-8f3b-4ccc-aa2e-2c7c87cfb423 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.217449 Mar 12 20:49:43.122288 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 355/634] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:42 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:49:43.127245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33f18e56-147d-46af-8b94-b53b8b5cdef2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:43.128075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-33f18e56-147d-46af-8b94-b53b8b5cdef2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:43.135022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33f18e56-147d-46af-8b94-b53b8b5cdef2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:43.135715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33f18e56-147d-46af-8b94-b53b8b5cdef2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:43.136686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33f18e56-147d-46af-8b94-b53b8b5cdef2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:43.137265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33f18e56-147d-46af-8b94-b53b8b5cdef2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:43.305807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-33f18e56-147d-46af-8b94-b53b8b5cdef2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:43.313621 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-33f18e56-147d-46af-8b94-b53b8b5cdef2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.190107 Mar 12 20:49:43.314515 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 356/635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:43 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:43.328805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a2b5e11f-21b8-47ef-a7a5-5e566ece2bf1 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:43.329888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a2b5e11f-21b8-47ef-a7a5-5e566ece2bf1 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:43.338052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2b5e11f-21b8-47ef-a7a5-5e566ece2bf1 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:43.338672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2b5e11f-21b8-47ef-a7a5-5e566ece2bf1 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:43.339753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2b5e11f-21b8-47ef-a7a5-5e566ece2bf1 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:43.340279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2b5e11f-21b8-47ef-a7a5-5e566ece2bf1 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:43.439893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a2b5e11f-21b8-47ef-a7a5-5e566ece2bf1 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccddd2d92af14ad5b2e799d284a435b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30e7ec4eede46af8cbd1864dcd1138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:43.450263 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a2b5e11f-21b8-47ef-a7a5-5e566ece2bf1 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400" status: 200 len: 1281 microversion: 2.1 time: 0.134506 Mar 12 20:49:43.451393 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 357/636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:43 2022] GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400 => generated 1281 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:43.456485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab238f81-c4b1-4a5a-bc07-62da2e4a3d1f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:43.457098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ab238f81-c4b1-4a5a-bc07-62da2e4a3d1f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:43.465473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab238f81-c4b1-4a5a-bc07-62da2e4a3d1f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:43.466041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab238f81-c4b1-4a5a-bc07-62da2e4a3d1f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:43.466994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab238f81-c4b1-4a5a-bc07-62da2e4a3d1f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:43.467617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab238f81-c4b1-4a5a-bc07-62da2e4a3d1f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:43.639721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ab238f81-c4b1-4a5a-bc07-62da2e4a3d1f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:43.651191 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ab238f81-c4b1-4a5a-bc07-62da2e4a3d1f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.198457 Mar 12 20:49:43.660713 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 358/637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:43 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:43.930006 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-deab3817-e755-4927-8472-45d91d7a42bd tempest-TenantUsagesNegativeTestJSON-888079947 tempest-TenantUsagesNegativeTestJSON-888079947-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-03-11T20%3A49%3A43.755235&end=2022-03-13T20%3A49%3A43.755235" status: 404 len: 112 microversion: - time: 0.170442 Mar 12 20:49:43.930669 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 359/638] 10.222.0.30 () {58 vars in 1315 bytes} [Sat Mar 12 20:49:43 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-03-11T20%3A49%3A43.755235&end=2022-03-13T20%3A49%3A43.755235 => generated 112 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 12 20:49:43.941780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eae35b6a-f46b-43ed-b013-514f0e06fe59 tempest-TenantUsagesNegativeTestJSON-888079947 tempest-TenantUsagesNegativeTestJSON-888079947-project-admin] Calling method '.version_select at 0x7f6e37659dc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:43.950032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-eae35b6a-f46b-43ed-b013-514f0e06fe59 tempest-TenantUsagesNegativeTestJSON-888079947 tempest-TenantUsagesNegativeTestJSON-888079947-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Mar 12 20:49:43.950768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eae35b6a-f46b-43ed-b013-514f0e06fe59 tempest-TenantUsagesNegativeTestJSON-888079947 tempest-TenantUsagesNegativeTestJSON-888079947-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:43.952360 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eae35b6a-f46b-43ed-b013-514f0e06fe59 tempest-TenantUsagesNegativeTestJSON-888079947 tempest-TenantUsagesNegativeTestJSON-888079947-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/567e22b811174be8a43b20e6691a0247?start=2022-03-13T20%3A49%3A43.755235&end=2022-03-11T20%3A49%3A43.755235" status: 400 len: 111 microversion: 2.1 time: 0.014398 Mar 12 20:49:43.953021 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 360/639] 10.222.0.30 () {58 vars in 1411 bytes} [Sat Mar 12 20:49:43 2022] GET /compute/v2.1/os-simple-tenant-usage/567e22b811174be8a43b20e6691a0247?start=2022-03-13T20%3A49%3A43.755235&end=2022-03-11T20%3A49%3A43.755235 => generated 111 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:49:44.100867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b1a46fa5-c840-4ec2-bde2-2151269ee229 tempest-TenantUsagesNegativeTestJSON-662978142 tempest-TenantUsagesNegativeTestJSON-662978142-project] Calling method '.version_select at 0x7f6e3728d8b0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:44.103251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b1a46fa5-c840-4ec2-bde2-2151269ee229 tempest-TenantUsagesNegativeTestJSON-662978142 tempest-TenantUsagesNegativeTestJSON-662978142-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'b761e28549c04716af8b02624a92f388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567e22b811174be8a43b20e6691a0247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:44.104204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b1a46fa5-c840-4ec2-bde2-2151269ee229 tempest-TenantUsagesNegativeTestJSON-662978142 tempest-TenantUsagesNegativeTestJSON-662978142-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:44.105096 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b1a46fa5-c840-4ec2-bde2-2151269ee229 tempest-TenantUsagesNegativeTestJSON-662978142 tempest-TenantUsagesNegativeTestJSON-662978142-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-11T20%3A49%3A43.755235&end=2022-03-13T20%3A49%3A43.755235&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.141918 Mar 12 20:49:44.105638 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 361/640] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Mar 12 20:49:43 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-11T20%3A49%3A43.755235&end=2022-03-13T20%3A49%3A43.755235&detailed=1 => generated 123 bytes in 143 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:44.140993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c9276b7e-48c3-488a-a408-b212ce3e4c88 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:44.141873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c9276b7e-48c3-488a-a408-b212ce3e4c88 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:44.151568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9276b7e-48c3-488a-a408-b212ce3e4c88 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:44.153555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9276b7e-48c3-488a-a408-b212ce3e4c88 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:44.154583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9276b7e-48c3-488a-a408-b212ce3e4c88 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:44.155241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9276b7e-48c3-488a-a408-b212ce3e4c88 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:44.331546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c9276b7e-48c3-488a-a408-b212ce3e4c88 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:44.343905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c9276b7e-48c3-488a-a408-b212ce3e4c88 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:44.346046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c9276b7e-48c3-488a-a408-b212ce3e4c88 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:44.347522 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c9276b7e-48c3-488a-a408-b212ce3e4c88 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.212637 Mar 12 20:49:44.348368 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 362/641] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:44 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:44.354125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e6deb482-9839-4386-95f5-1b15301e3d22 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:44.355102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e6deb482-9839-4386-95f5-1b15301e3d22 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:44.362191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6deb482-9839-4386-95f5-1b15301e3d22 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:44.362874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6deb482-9839-4386-95f5-1b15301e3d22 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:44.363854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6deb482-9839-4386-95f5-1b15301e3d22 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:44.364470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6deb482-9839-4386-95f5-1b15301e3d22 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:44.584706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e6deb482-9839-4386-95f5-1b15301e3d22 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:44.594068 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e6deb482-9839-4386-95f5-1b15301e3d22 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.243901 Mar 12 20:49:44.595081 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 363/642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:44 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:44.609723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b17e2ed-d275-4dd8-a215-1f0e46ba0dd0 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:44.610731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b17e2ed-d275-4dd8-a215-1f0e46ba0dd0 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:44.617514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b17e2ed-d275-4dd8-a215-1f0e46ba0dd0 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:44.618378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b17e2ed-d275-4dd8-a215-1f0e46ba0dd0 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:44.619546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b17e2ed-d275-4dd8-a215-1f0e46ba0dd0 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:44.620783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b17e2ed-d275-4dd8-a215-1f0e46ba0dd0 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:44.819690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b17e2ed-d275-4dd8-a215-1f0e46ba0dd0 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccddd2d92af14ad5b2e799d284a435b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30e7ec4eede46af8cbd1864dcd1138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:44.837953 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b17e2ed-d275-4dd8-a215-1f0e46ba0dd0 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400" status: 200 len: 1323 microversion: 2.1 time: 0.241422 Mar 12 20:49:44.838551 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 364/643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:44 2022] GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400 => generated 1323 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:44.854297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26000a64-c883-4635-a8c6-c78ed75d16a7 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:44.858805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-26000a64-c883-4635-a8c6-c78ed75d16a7 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:44.870804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26000a64-c883-4635-a8c6-c78ed75d16a7 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:44.871337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26000a64-c883-4635-a8c6-c78ed75d16a7 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:44.872564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26000a64-c883-4635-a8c6-c78ed75d16a7 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:44.873375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26000a64-c883-4635-a8c6-c78ed75d16a7 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:45.112653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-26000a64-c883-4635-a8c6-c78ed75d16a7 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:45.121533 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-26000a64-c883-4635-a8c6-c78ed75d16a7 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.272937 Mar 12 20:49:45.123617 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 365/644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:44 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:45.129116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-639b617c-330d-453e-a894-1c1d7ea5b380 req-54a35c9c-79e7-4185-9726-66363dc68cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "913bf27d-ca17-4eb2-9c0b-94e944f64400", "tag": "fc2a9599-3bf7-48c2-9b3c-b1f4f5ffa0c9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:45.139024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-639b617c-330d-453e-a894-1c1d7ea5b380 req-54a35c9c-79e7-4185-9726-66363dc68cb9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:45.139729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-639b617c-330d-453e-a894-1c1d7ea5b380 req-54a35c9c-79e7-4185-9726-66363dc68cb9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:45.153129 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-639b617c-330d-453e-a894-1c1d7ea5b380 req-54a35c9c-79e7-4185-9726-66363dc68cb9 service nova] Creating event network-changed:fc2a9599-3bf7-48c2-9b3c-b1f4f5ffa0c9 for instance 913bf27d-ca17-4eb2-9c0b-94e944f64400 on nch2-master-1 Mar 12 20:49:45.158087 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-639b617c-330d-453e-a894-1c1d7ea5b380 req-54a35c9c-79e7-4185-9726-66363dc68cb9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032596 Mar 12 20:49:45.158886 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 366/645] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:45.369156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8de813f6-fac9-4eb0-a7cb-c65132d28742 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:45.370033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8de813f6-fac9-4eb0-a7cb-c65132d28742 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:45.377732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8de813f6-fac9-4eb0-a7cb-c65132d28742 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:45.378671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8de813f6-fac9-4eb0-a7cb-c65132d28742 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:45.379696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8de813f6-fac9-4eb0-a7cb-c65132d28742 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:45.380880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8de813f6-fac9-4eb0-a7cb-c65132d28742 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:45.546746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8de813f6-fac9-4eb0-a7cb-c65132d28742 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:45.563766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8de813f6-fac9-4eb0-a7cb-c65132d28742 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:45.566742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8de813f6-fac9-4eb0-a7cb-c65132d28742 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:45.568685 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8de813f6-fac9-4eb0-a7cb-c65132d28742 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.205244 Mar 12 20:49:45.571093 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 367/646] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:45 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:49:45.612188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fbcabf31-9d9e-4e10-9681-bb721edacdd4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:45.612811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fbcabf31-9d9e-4e10-9681-bb721edacdd4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:45.621123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbcabf31-9d9e-4e10-9681-bb721edacdd4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:45.621568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbcabf31-9d9e-4e10-9681-bb721edacdd4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:45.622676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbcabf31-9d9e-4e10-9681-bb721edacdd4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:45.623312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbcabf31-9d9e-4e10-9681-bb721edacdd4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:45.781335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fbcabf31-9d9e-4e10-9681-bb721edacdd4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:45.790083 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fbcabf31-9d9e-4e10-9681-bb721edacdd4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.181670 Mar 12 20:49:45.790667 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 368/647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:45 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:45.855097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-174db00e-269e-41ff-9b93-ca15b8f236cc tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:45.855705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-174db00e-269e-41ff-9b93-ca15b8f236cc tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:45.866170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-174db00e-269e-41ff-9b93-ca15b8f236cc tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:45.866685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-174db00e-269e-41ff-9b93-ca15b8f236cc tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:45.872942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-174db00e-269e-41ff-9b93-ca15b8f236cc tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:45.873330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-174db00e-269e-41ff-9b93-ca15b8f236cc tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:46.086715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-174db00e-269e-41ff-9b93-ca15b8f236cc tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccddd2d92af14ad5b2e799d284a435b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30e7ec4eede46af8cbd1864dcd1138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:46.093962 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-174db00e-269e-41ff-9b93-ca15b8f236cc tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400" status: 200 len: 1323 microversion: 2.1 time: 0.243035 Mar 12 20:49:46.094539 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 369/648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:45 2022] GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400 => generated 1323 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:46.099820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd46153d-8dae-4ecb-bca4-d394b6e55255 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Calling method '.version_select at 0x7f6e377c1550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:46.141263 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd46153d-8dae-4ecb-bca4-d394b6e55255 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15" status: 200 len: 637 microversion: 2.1 time: 0.045432 Mar 12 20:49:46.146338 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 370/649] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:49:46 2022] GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15 => generated 637 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:46.146953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-10d38b0c-3951-4548-93f6-689541c65d6f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:46.147612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-10d38b0c-3951-4548-93f6-689541c65d6f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:46.153853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10d38b0c-3951-4548-93f6-689541c65d6f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:46.156851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10d38b0c-3951-4548-93f6-689541c65d6f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:46.156851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10d38b0c-3951-4548-93f6-689541c65d6f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:46.156851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10d38b0c-3951-4548-93f6-689541c65d6f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:46.297060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-10d38b0c-3951-4548-93f6-689541c65d6f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:46.304974 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-10d38b0c-3951-4548-93f6-689541c65d6f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.161981 Mar 12 20:49:46.305731 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 371/650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:46 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:46.318879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e4bdae1b-3323-4d5d-afd7-f6ce9a7f6dd8 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Action: 'update_all', calling method: .version_select at 0x7f6e3775d0d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:46.366579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e4bdae1b-3323-4d5d-afd7-f6ce9a7f6dd8 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:46.372108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e4bdae1b-3323-4d5d-afd7-f6ce9a7f6dd8 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for user c1643e7a47594217ae3320ff1a89637d and project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:46.691999 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e4bdae1b-3323-4d5d-afd7-f6ce9a7f6dd8 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.385146 Mar 12 20:49:46.692597 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 372/651] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:49:46 2022] PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 61 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:46.697899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4eb6a648-f388-4d78-bbcf-14a559fad7c9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:46.698544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4eb6a648-f388-4d78-bbcf-14a559fad7c9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:46.705068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eb6a648-f388-4d78-bbcf-14a559fad7c9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:46.705521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eb6a648-f388-4d78-bbcf-14a559fad7c9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:46.709993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eb6a648-f388-4d78-bbcf-14a559fad7c9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:46.709993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eb6a648-f388-4d78-bbcf-14a559fad7c9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:46.843706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4eb6a648-f388-4d78-bbcf-14a559fad7c9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:46.851837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4eb6a648-f388-4d78-bbcf-14a559fad7c9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:46.853362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4eb6a648-f388-4d78-bbcf-14a559fad7c9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:46.854637 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4eb6a648-f388-4d78-bbcf-14a559fad7c9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.160955 Mar 12 20:49:46.857861 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 373/652] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:46 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:46.865933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0697ae3-4ab2-4c1d-af07-c4d93078336f tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Calling method '.version_select at 0x7f6e37522700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:47.195670 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0697ae3-4ab2-4c1d-af07-c4d93078336f tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "DELETE /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.338985 Mar 12 20:49:47.196278 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 374/653] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Mar 12 20:49:46 2022] DELETE /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata/os_version => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:49:47.204107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e347e2a9-a7b1-46f1-b485-7ffd681f3466 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:47.204720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e347e2a9-a7b1-46f1-b485-7ffd681f3466 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:47.220893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e347e2a9-a7b1-46f1-b485-7ffd681f3466 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:47.224447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e347e2a9-a7b1-46f1-b485-7ffd681f3466 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:47.225335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e347e2a9-a7b1-46f1-b485-7ffd681f3466 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:47.225815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e347e2a9-a7b1-46f1-b485-7ffd681f3466 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:47.449932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e347e2a9-a7b1-46f1-b485-7ffd681f3466 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:47.457542 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e347e2a9-a7b1-46f1-b485-7ffd681f3466 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.257097 Mar 12 20:49:47.458759 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 375/654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:47 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:47.463626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6d39c6b-890f-48f0-a1db-8b5f52ed960e tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:47.464330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d6d39c6b-890f-48f0-a1db-8b5f52ed960e tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:47.470704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6d39c6b-890f-48f0-a1db-8b5f52ed960e tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:47.471161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6d39c6b-890f-48f0-a1db-8b5f52ed960e tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:47.471940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6d39c6b-890f-48f0-a1db-8b5f52ed960e tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:47.472383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6d39c6b-890f-48f0-a1db-8b5f52ed960e tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:47.682047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d6d39c6b-890f-48f0-a1db-8b5f52ed960e tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccddd2d92af14ad5b2e799d284a435b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30e7ec4eede46af8cbd1864dcd1138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:47.693474 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d6d39c6b-890f-48f0-a1db-8b5f52ed960e tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400" status: 200 len: 1323 microversion: 2.1 time: 0.233576 Mar 12 20:49:47.694491 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 376/655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:47 2022] GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400 => generated 1323 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:47.699437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72763437-24ab-4d96-88dd-17a7ea764b63 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Calling method '.version_select at 0x7f6e37529820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:47.747293 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72763437-24ab-4d96-88dd-17a7ea764b63 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 37 microversion: 2.1 time: 0.051587 Mar 12 20:49:47.747868 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 377/656] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Mar 12 20:49:47 2022] GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 37 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:47.752512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e3500459-3288-475a-8e0d-4db42f28e6ce tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:47.753372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e3500459-3288-475a-8e0d-4db42f28e6ce tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:47.760857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3500459-3288-475a-8e0d-4db42f28e6ce tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:47.761486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3500459-3288-475a-8e0d-4db42f28e6ce tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:47.763081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3500459-3288-475a-8e0d-4db42f28e6ce tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:47.763878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3500459-3288-475a-8e0d-4db42f28e6ce tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:47.937816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e3500459-3288-475a-8e0d-4db42f28e6ce tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:47.945842 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e3500459-3288-475a-8e0d-4db42f28e6ce tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.196753 Mar 12 20:49:47.946841 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 378/657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:47 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:47.951750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f0a539ec-b043-4e9b-a14d-70701c9f07af tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Action: 'update_all', calling method: .version_select at 0x7f6e373229d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:48.002758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f0a539ec-b043-4e9b-a14d-70701c9f07af tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:48.008269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f0a539ec-b043-4e9b-a14d-70701c9f07af tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for user c1643e7a47594217ae3320ff1a89637d and project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:48.307516 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f0a539ec-b043-4e9b-a14d-70701c9f07af tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.359622 Mar 12 20:49:48.308133 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 379/658] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:49:47 2022] PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 61 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:48.312782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86f790dd-62c3-40ce-a079-c7d8280b2b7d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:48.313408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86f790dd-62c3-40ce-a079-c7d8280b2b7d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:48.321130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86f790dd-62c3-40ce-a079-c7d8280b2b7d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:48.321883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86f790dd-62c3-40ce-a079-c7d8280b2b7d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:48.322656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86f790dd-62c3-40ce-a079-c7d8280b2b7d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:48.323107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86f790dd-62c3-40ce-a079-c7d8280b2b7d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:48.451840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86f790dd-62c3-40ce-a079-c7d8280b2b7d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:48.461136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86f790dd-62c3-40ce-a079-c7d8280b2b7d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:48.462816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86f790dd-62c3-40ce-a079-c7d8280b2b7d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:48.464102 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86f790dd-62c3-40ce-a079-c7d8280b2b7d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.154976 Mar 12 20:49:48.464686 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 380/659] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:48 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:48.584201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-918167132", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "f9820f27-69e7-43b5-9215-94ce6d672d9b"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:48.636229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] validate_networks() for [('f9820f27-69e7-43b5-9215-94ce6d672d9b', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:49:48.955174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:49:48.955655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:49:48.956064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:49:48.956505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:49:48.956925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:49:48.965459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:48.965949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:48.966753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:48.967192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:48.983489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Getting quotas for project c0c046eb0b9248d3bde469b35342ff50. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:48.988548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Getting quotas for user 1b433353e06247bfbd0897c84912256f and project c0c046eb0b9248d3bde469b35342ff50. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:49.000841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:49:49.003114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:49:49.046820 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c37e8ad-8826-4501-b160-9cd44d106216 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581050 Mar 12 20:49:49.047476 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 381/660] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:49:49.052519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf7778b8-cc06-4e9c-b918-9df423875eda tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Calling method '.version_select at 0x7f6e440baee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:49.091624 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bf7778b8-cc06-4e9c-b918-9df423875eda tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.043119 Mar 12 20:49:49.092181 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 382/661] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Mar 12 20:49:49 2022] GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata/os_distro => generated 33 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:49.097039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-58648aa8-cc77-4981-ad1c-91ff9fa11743 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:49.097652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-58648aa8-cc77-4981-ad1c-91ff9fa11743 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:49.103689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58648aa8-cc77-4981-ad1c-91ff9fa11743 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:49.104132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58648aa8-cc77-4981-ad1c-91ff9fa11743 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:49.104900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58648aa8-cc77-4981-ad1c-91ff9fa11743 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:49.105332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58648aa8-cc77-4981-ad1c-91ff9fa11743 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:49.239095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-58648aa8-cc77-4981-ad1c-91ff9fa11743 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:49.247904 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-58648aa8-cc77-4981-ad1c-91ff9fa11743 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.154776 Mar 12 20:49:49.257792 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 383/662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:49 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:49.257792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f43275c4-cd05-4c7a-ae53-6fab6ca23c44 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:49.257792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f43275c4-cd05-4c7a-ae53-6fab6ca23c44 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:49.260273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f43275c4-cd05-4c7a-ae53-6fab6ca23c44 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:49.260727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f43275c4-cd05-4c7a-ae53-6fab6ca23c44 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:49.261532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f43275c4-cd05-4c7a-ae53-6fab6ca23c44 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:49.262091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f43275c4-cd05-4c7a-ae53-6fab6ca23c44 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:49.407282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f43275c4-cd05-4c7a-ae53-6fab6ca23c44 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccddd2d92af14ad5b2e799d284a435b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30e7ec4eede46af8cbd1864dcd1138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:49.415377 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f43275c4-cd05-4c7a-ae53-6fab6ca23c44 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400" status: 200 len: 1323 microversion: 2.1 time: 0.165488 Mar 12 20:49:49.416136 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 384/663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:49 2022] GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400 => generated 1323 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:49.420827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-89fc52e7-9b04-4ec6-9993-8b748664c0a3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:49.421678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89fc52e7-9b04-4ec6-9993-8b748664c0a3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:49.428417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89fc52e7-9b04-4ec6-9993-8b748664c0a3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:49.428872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89fc52e7-9b04-4ec6-9993-8b748664c0a3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:49.429647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89fc52e7-9b04-4ec6-9993-8b748664c0a3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:49.430116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89fc52e7-9b04-4ec6-9993-8b748664c0a3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:49.565316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-89fc52e7-9b04-4ec6-9993-8b748664c0a3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:49.577259 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-89fc52e7-9b04-4ec6-9993-8b748664c0a3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.159503 Mar 12 20:49:49.578422 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 385/664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:49 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:49.586402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8dda88d-cef2-41b2-b57b-863464a2a61f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:49.586402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8dda88d-cef2-41b2-b57b-863464a2a61f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:49.593575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8dda88d-cef2-41b2-b57b-863464a2a61f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:49.594418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8dda88d-cef2-41b2-b57b-863464a2a61f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:49.594845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8dda88d-cef2-41b2-b57b-863464a2a61f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:49.595288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8dda88d-cef2-41b2-b57b-863464a2a61f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:49.654886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a8dda88d-cef2-41b2-b57b-863464a2a61f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:49.663222 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8dda88d-cef2-41b2-b57b-863464a2a61f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 200 len: 1203 microversion: 2.1 time: 0.083584 Mar 12 20:49:49.663831 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 386/665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:49 2022] GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 1203 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:49.670013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6703abcf-de23-44c2-ab86-29c9b3d18878 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Action: 'update_all', calling method: .version_select at 0x7f6e373229d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:49.713539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6703abcf-de23-44c2-ab86-29c9b3d18878 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:49.718291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6703abcf-de23-44c2-ab86-29c9b3d18878 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for user c1643e7a47594217ae3320ff1a89637d and project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:49.951852 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6703abcf-de23-44c2-ab86-29c9b3d18878 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.286739 Mar 12 20:49:49.952811 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 387/666] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:49:49 2022] PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 61 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:49.959094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a668d86b-6ac9-4fbc-8add-0e275d9e2a9a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:49.959710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a668d86b-6ac9-4fbc-8add-0e275d9e2a9a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:49.968274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a668d86b-6ac9-4fbc-8add-0e275d9e2a9a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:49.968834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a668d86b-6ac9-4fbc-8add-0e275d9e2a9a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:49.969890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a668d86b-6ac9-4fbc-8add-0e275d9e2a9a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:49.970437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a668d86b-6ac9-4fbc-8add-0e275d9e2a9a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:50.337014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a668d86b-6ac9-4fbc-8add-0e275d9e2a9a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:50.344996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a668d86b-6ac9-4fbc-8add-0e275d9e2a9a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:50.346596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a668d86b-6ac9-4fbc-8add-0e275d9e2a9a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:50.347772 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a668d86b-6ac9-4fbc-8add-0e275d9e2a9a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.394378 Mar 12 20:49:50.348331 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 388/667] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:49 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:50.362375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-846916ee-8406-4cad-93ae-c005e90fb471 req-614bdf8e-9976-4e52-b3f5-5d4405270277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913bf27d-ca17-4eb2-9c0b-94e944f64400", "name": "network-vif-plugged", "status": "completed", "tag": "fc2a9599-3bf7-48c2-9b3c-b1f4f5ffa0c9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:50.370327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-846916ee-8406-4cad-93ae-c005e90fb471 req-614bdf8e-9976-4e52-b3f5-5d4405270277 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:50.370838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-846916ee-8406-4cad-93ae-c005e90fb471 req-614bdf8e-9976-4e52-b3f5-5d4405270277 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:50.383206 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-846916ee-8406-4cad-93ae-c005e90fb471 req-614bdf8e-9976-4e52-b3f5-5d4405270277 service nova] Creating event network-vif-plugged:fc2a9599-3bf7-48c2-9b3c-b1f4f5ffa0c9 for instance 913bf27d-ca17-4eb2-9c0b-94e944f64400 on nch2-master-1 Mar 12 20:49:50.388458 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-846916ee-8406-4cad-93ae-c005e90fb471 req-614bdf8e-9976-4e52-b3f5-5d4405270277 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039011 Mar 12 20:49:50.389515 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 389/668] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:50.394506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6bb70bd1-f99d-4522-818e-8e1b3c9ea4b5 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Calling method '.version_select at 0x7f6e441a3280>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:50.447997 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6bb70bd1-f99d-4522-818e-8e1b3c9ea4b5 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.057255 Mar 12 20:49:50.448571 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 390/669] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Mar 12 20:49:50 2022] GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 61 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:50.453385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4758d6b5-300f-4e62-8f10-cf8d75392265 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:50.454152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4758d6b5-300f-4e62-8f10-cf8d75392265 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:50.460961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4758d6b5-300f-4e62-8f10-cf8d75392265 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:50.461418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4758d6b5-300f-4e62-8f10-cf8d75392265 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:50.462227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4758d6b5-300f-4e62-8f10-cf8d75392265 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:50.462676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4758d6b5-300f-4e62-8f10-cf8d75392265 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:50.607894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4758d6b5-300f-4e62-8f10-cf8d75392265 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:50.615362 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4758d6b5-300f-4e62-8f10-cf8d75392265 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.165654 Mar 12 20:49:50.615937 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 391/670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:50 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:50.620569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5bea0e7a-1db4-4c53-87bb-ca28b8b02200 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:50.621179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5bea0e7a-1db4-4c53-87bb-ca28b8b02200 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:50.627281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bea0e7a-1db4-4c53-87bb-ca28b8b02200 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:50.627712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bea0e7a-1db4-4c53-87bb-ca28b8b02200 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:50.628568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bea0e7a-1db4-4c53-87bb-ca28b8b02200 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:50.629033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bea0e7a-1db4-4c53-87bb-ca28b8b02200 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:50.766848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5bea0e7a-1db4-4c53-87bb-ca28b8b02200 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccddd2d92af14ad5b2e799d284a435b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30e7ec4eede46af8cbd1864dcd1138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:50.774596 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5bea0e7a-1db4-4c53-87bb-ca28b8b02200 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400" status: 200 len: 1323 microversion: 2.1 time: 0.157701 Mar 12 20:49:50.775168 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 392/671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:50 2022] GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400 => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:50.779725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-54443603-eb4f-422d-bcc7-511aeed41100 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Action: 'update_all', calling method: .version_select at 0x7f6e37529af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:50.825290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-54443603-eb4f-422d-bcc7-511aeed41100 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:50.830349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-54443603-eb4f-422d-bcc7-511aeed41100 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for user c1643e7a47594217ae3320ff1a89637d and project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:51.066067 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-54443603-eb4f-422d-bcc7-511aeed41100 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.289788 Mar 12 20:49:51.066673 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 393/672] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:49:50 2022] PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 61 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:51.072074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f56c834-9f57-4a6f-adab-a321922c95c5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:51.072701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6f56c834-9f57-4a6f-adab-a321922c95c5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:51.078682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f56c834-9f57-4a6f-adab-a321922c95c5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:51.079147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f56c834-9f57-4a6f-adab-a321922c95c5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:51.079931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f56c834-9f57-4a6f-adab-a321922c95c5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:51.080381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f56c834-9f57-4a6f-adab-a321922c95c5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:51.215128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6f56c834-9f57-4a6f-adab-a321922c95c5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:51.222570 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f56c834-9f57-4a6f-adab-a321922c95c5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.154903 Mar 12 20:49:51.223350 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 394/673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:51 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:51.228030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8d4692b-64f1-422f-b054-e8a40f4ba049 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:51.228846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8d4692b-64f1-422f-b054-e8a40f4ba049 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:51.234810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8d4692b-64f1-422f-b054-e8a40f4ba049 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:51.235263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8d4692b-64f1-422f-b054-e8a40f4ba049 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:51.236032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8d4692b-64f1-422f-b054-e8a40f4ba049 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:51.236465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8d4692b-64f1-422f-b054-e8a40f4ba049 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:51.369905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a8d4692b-64f1-422f-b054-e8a40f4ba049 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:51.379032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8d4692b-64f1-422f-b054-e8a40f4ba049 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 200 len: 1307 microversion: 2.1 time: 0.154724 Mar 12 20:49:51.379620 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 395/674] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:51 2022] GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:51.386195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ddbaa21d-af2e-4efc-b0ff-387d13f3589a tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Action: 'update_all', calling method: .version_select at 0x7f6e37659c10>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:51.436733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ddbaa21d-af2e-4efc-b0ff-387d13f3589a tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:51.442436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ddbaa21d-af2e-4efc-b0ff-387d13f3589a tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for user c1643e7a47594217ae3320ff1a89637d and project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:51.774946 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ddbaa21d-af2e-4efc-b0ff-387d13f3589a tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 64 microversion: 2.1 time: 0.393685 Mar 12 20:49:51.775670 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 396/675] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:49:51 2022] PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 64 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:51.780179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9d30ec4-0f3d-44ea-bf9d-d8f147d1c401 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:51.780792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9d30ec4-0f3d-44ea-bf9d-d8f147d1c401 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:51.787590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9d30ec4-0f3d-44ea-bf9d-d8f147d1c401 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:51.788052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9d30ec4-0f3d-44ea-bf9d-d8f147d1c401 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:51.788847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9d30ec4-0f3d-44ea-bf9d-d8f147d1c401 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:51.789330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9d30ec4-0f3d-44ea-bf9d-d8f147d1c401 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:51.922115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9d30ec4-0f3d-44ea-bf9d-d8f147d1c401 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:51.930548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9d30ec4-0f3d-44ea-bf9d-d8f147d1c401 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:51.932088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9d30ec4-0f3d-44ea-bf9d-d8f147d1c401 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:51.933266 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9d30ec4-0f3d-44ea-bf9d-d8f147d1c401 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.156801 Mar 12 20:49:51.935059 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 397/676] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:51 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:51.942435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-522fae9c-db54-40f6-a295-a085db9559f2 req-d17d2e5e-14d2-4540-9178-e234dbea30e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378f100b-bc86-4e26-8462-2b6ab20b1e04", "tag": "bc5ebba0-ee77-4f1a-8fd8-11584ea45c51"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:51.956355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-522fae9c-db54-40f6-a295-a085db9559f2 req-d17d2e5e-14d2-4540-9178-e234dbea30e4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:51.956807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-522fae9c-db54-40f6-a295-a085db9559f2 req-d17d2e5e-14d2-4540-9178-e234dbea30e4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:51.968652 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-522fae9c-db54-40f6-a295-a085db9559f2 req-d17d2e5e-14d2-4540-9178-e234dbea30e4 service nova] Creating event network-changed:bc5ebba0-ee77-4f1a-8fd8-11584ea45c51 for instance 378f100b-bc86-4e26-8462-2b6ab20b1e04 on nch2-master-1 Mar 12 20:49:51.974810 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-522fae9c-db54-40f6-a295-a085db9559f2 req-d17d2e5e-14d2-4540-9178-e234dbea30e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038079 Mar 12 20:49:51.975420 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 398/677] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:51.980405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a2652ff3-bbf0-430f-bb99-6058739b8d21 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:51.981107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a2652ff3-bbf0-430f-bb99-6058739b8d21 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:51.987484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2652ff3-bbf0-430f-bb99-6058739b8d21 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:51.987945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2652ff3-bbf0-430f-bb99-6058739b8d21 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:51.988731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2652ff3-bbf0-430f-bb99-6058739b8d21 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:51.989425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2652ff3-bbf0-430f-bb99-6058739b8d21 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:52.126895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a2652ff3-bbf0-430f-bb99-6058739b8d21 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:52.135011 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a2652ff3-bbf0-430f-bb99-6058739b8d21 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.158441 Mar 12 20:49:52.136495 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 399/678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:51 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:52.141256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d9383ca-bbe2-4571-ba2e-56cff0a2bb66 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Calling method '.version_select at 0x7f6e37688430>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:52.182762 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d9383ca-bbe2-4571-ba2e-56cff0a2bb66 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 64 microversion: 2.1 time: 0.045169 Mar 12 20:49:52.183344 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 400/679] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Mar 12 20:49:52 2022] GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 64 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:52.188216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb7ea850-4386-4d46-96a5-0eb3661d888b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:52.188841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fb7ea850-4386-4d46-96a5-0eb3661d888b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:52.194884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb7ea850-4386-4d46-96a5-0eb3661d888b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:52.195342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb7ea850-4386-4d46-96a5-0eb3661d888b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:52.196132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb7ea850-4386-4d46-96a5-0eb3661d888b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:52.196909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb7ea850-4386-4d46-96a5-0eb3661d888b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:52.336687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fb7ea850-4386-4d46-96a5-0eb3661d888b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccddd2d92af14ad5b2e799d284a435b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30e7ec4eede46af8cbd1864dcd1138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:52.345066 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb7ea850-4386-4d46-96a5-0eb3661d888b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400" status: 200 len: 1472 microversion: 2.1 time: 0.160744 Mar 12 20:49:52.345646 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 401/680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:52 2022] GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400 => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:52.350376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb961441-c2d6-4c11-90ec-7d6652f524e1 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Action: 'update_all', calling method: .version_select at 0x7f6e441bc3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:52.396994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fb961441-c2d6-4c11-90ec-7d6652f524e1 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:52.402033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fb961441-c2d6-4c11-90ec-7d6652f524e1 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for user c1643e7a47594217ae3320ff1a89637d and project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:52.719217 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb961441-c2d6-4c11-90ec-7d6652f524e1 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.372448 Mar 12 20:49:52.719807 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 402/681] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:49:52 2022] PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 61 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:52.724348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c0dc7bb5-e70c-40d6-b400-354ad409a04e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:52.724950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c0dc7bb5-e70c-40d6-b400-354ad409a04e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:52.730841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0dc7bb5-e70c-40d6-b400-354ad409a04e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:52.731288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0dc7bb5-e70c-40d6-b400-354ad409a04e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:52.732047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0dc7bb5-e70c-40d6-b400-354ad409a04e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:52.732482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0dc7bb5-e70c-40d6-b400-354ad409a04e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:52.860015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0dc7bb5-e70c-40d6-b400-354ad409a04e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:52.868493 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c0dc7bb5-e70c-40d6-b400-354ad409a04e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.147707 Mar 12 20:49:52.869064 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 403/682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:52 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:52.873486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b521b5c1-8631-4c17-9314-d75b56ca08ca tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:52.874001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b521b5c1-8631-4c17-9314-d75b56ca08ca tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:52.879525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b521b5c1-8631-4c17-9314-d75b56ca08ca tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:52.880606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b521b5c1-8631-4c17-9314-d75b56ca08ca tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:52.881418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b521b5c1-8631-4c17-9314-d75b56ca08ca tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:52.881881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b521b5c1-8631-4c17-9314-d75b56ca08ca tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:52.911243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b521b5c1-8631-4c17-9314-d75b56ca08ca tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'ccddd2d92af14ad5b2e799d284a435b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30e7ec4eede46af8cbd1864dcd1138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:52.911923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b521b5c1-8631-4c17-9314-d75b56ca08ca tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:52.912761 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b521b5c1-8631-4c17-9314-d75b56ca08ca tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.042797 Mar 12 20:49:52.913299 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 404/683] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:49:52 2022] GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400/diagnostics => generated 117 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:52.917622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8790297-955e-4bb3-8786-a8705f9c32b5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:52.918262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8790297-955e-4bb3-8786-a8705f9c32b5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:52.924038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8790297-955e-4bb3-8786-a8705f9c32b5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:52.924494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8790297-955e-4bb3-8786-a8705f9c32b5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:52.925260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8790297-955e-4bb3-8786-a8705f9c32b5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:52.925699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8790297-955e-4bb3-8786-a8705f9c32b5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:53.057163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a8790297-955e-4bb3-8786-a8705f9c32b5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:53.064418 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8790297-955e-4bb3-8786-a8705f9c32b5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 200 len: 1307 microversion: 2.1 time: 0.150168 Mar 12 20:49:53.064982 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 405/684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:52 2022] GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 1307 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:53.069365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eef2922e-1895-4ffd-9827-de8172ac59a8 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Action: 'update', calling method: .version_select at 0x7f6e441bc820>, body: {"meta": {"os_version": "alt"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:53.117949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-eef2922e-1895-4ffd-9827-de8172ac59a8 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:53.123268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-eef2922e-1895-4ffd-9827-de8172ac59a8 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for user c1643e7a47594217ae3320ff1a89637d and project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:53.413396 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eef2922e-1895-4ffd-9827-de8172ac59a8 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.347375 Mar 12 20:49:53.414048 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 406/685] 10.222.0.30 () {60 vars in 1312 bytes} [Sat Mar 12 20:49:53 2022] PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata/os_version => generated 31 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:53.418639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f6d1c8f-7b97-4c57-a5f7-186aba0c38d8 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:53.419131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f6d1c8f-7b97-4c57-a5f7-186aba0c38d8 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:53.424977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f6d1c8f-7b97-4c57-a5f7-186aba0c38d8 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:53.425424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f6d1c8f-7b97-4c57-a5f7-186aba0c38d8 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:53.426217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f6d1c8f-7b97-4c57-a5f7-186aba0c38d8 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:53.426651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f6d1c8f-7b97-4c57-a5f7-186aba0c38d8 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:53.451196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f6d1c8f-7b97-4c57-a5f7-186aba0c38d8 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:49:53.524378 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f6d1c8f-7b97-4c57-a5f7-186aba0c38d8 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "DELETE /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400" status: 204 len: 0 microversion: 2.1 time: 0.108381 Mar 12 20:49:53.525074 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 407/686] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:49:53 2022] DELETE /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:49:53.530746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ca2815f-b7fd-4f03-b9da-a2e5300ed8c7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:53.531520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ca2815f-b7fd-4f03-b9da-a2e5300ed8c7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:53.538097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ca2815f-b7fd-4f03-b9da-a2e5300ed8c7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:53.538851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ca2815f-b7fd-4f03-b9da-a2e5300ed8c7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:53.539636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ca2815f-b7fd-4f03-b9da-a2e5300ed8c7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:53.540078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ca2815f-b7fd-4f03-b9da-a2e5300ed8c7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:53.670845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ca2815f-b7fd-4f03-b9da-a2e5300ed8c7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:53.678598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ca2815f-b7fd-4f03-b9da-a2e5300ed8c7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:53.680120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ca2815f-b7fd-4f03-b9da-a2e5300ed8c7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:53.681265 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ca2815f-b7fd-4f03-b9da-a2e5300ed8c7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1566 microversion: 2.25 time: 0.155120 Mar 12 20:49:53.681846 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 408/687] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:53 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:53.686296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52f92b6e-1973-4e2c-baed-064b4703860f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:53.686895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-52f92b6e-1973-4e2c-baed-064b4703860f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:53.692336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52f92b6e-1973-4e2c-baed-064b4703860f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:53.692789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52f92b6e-1973-4e2c-baed-064b4703860f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:53.693553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52f92b6e-1973-4e2c-baed-064b4703860f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:53.694022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52f92b6e-1973-4e2c-baed-064b4703860f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:53.819377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-52f92b6e-1973-4e2c-baed-064b4703860f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:53.826877 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-52f92b6e-1973-4e2c-baed-064b4703860f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.144095 Mar 12 20:49:53.827441 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 409/688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:53 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:53.831924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-452f45a1-a907-4db6-bf62-da1613b03d5b tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Calling method '.version_select at 0x7f6e441bc8b0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:53.871829 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-452f45a1-a907-4db6-bf62-da1613b03d5b tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 58 microversion: 2.1 time: 0.043304 Mar 12 20:49:53.872347 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 410/689] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Mar 12 20:49:53 2022] GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 58 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:53.876865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1ec2290-78d6-41f8-817c-7db32a006c2b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:53.877472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f1ec2290-78d6-41f8-817c-7db32a006c2b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:53.883746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1ec2290-78d6-41f8-817c-7db32a006c2b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:53.884198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1ec2290-78d6-41f8-817c-7db32a006c2b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:53.884967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1ec2290-78d6-41f8-817c-7db32a006c2b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:53.885414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1ec2290-78d6-41f8-817c-7db32a006c2b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:54.190695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f1ec2290-78d6-41f8-817c-7db32a006c2b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccddd2d92af14ad5b2e799d284a435b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30e7ec4eede46af8cbd1864dcd1138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:54.202371 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1ec2290-78d6-41f8-817c-7db32a006c2b tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400" status: 200 len: 1478 microversion: 2.1 time: 0.328901 Mar 12 20:49:54.203524 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 411/690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:53 2022] GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400 => generated 1478 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:54.216955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-24eb7531-668f-4ab9-a936-ef0cb9252953 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Action: 'update_all', calling method: .version_select at 0x7f6e441a3af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:54.273039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-24eb7531-668f-4ab9-a936-ef0cb9252953 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:54.279014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-24eb7531-668f-4ab9-a936-ef0cb9252953 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for user c1643e7a47594217ae3320ff1a89637d and project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:54.641538 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-24eb7531-668f-4ab9-a936-ef0cb9252953 tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 61 microversion: 2.1 time: 0.435303 Mar 12 20:49:54.642986 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 412/691] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:49:54 2022] PUT /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 61 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:54.648542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21c421eb-b081-42fa-b85b-42449e38472e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:54.649574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-21c421eb-b081-42fa-b85b-42449e38472e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:54.656852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21c421eb-b081-42fa-b85b-42449e38472e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:54.657896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21c421eb-b081-42fa-b85b-42449e38472e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:54.659096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21c421eb-b081-42fa-b85b-42449e38472e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:54.659767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21c421eb-b081-42fa-b85b-42449e38472e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:54.759438 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-11ad5b6e-5471-4660-9c38-37545e2fee0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2/action" status: 202 len: 0 microversion: 2.1 time: 16.684379 Mar 12 20:49:54.760465 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 280/692] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:49:38 2022] POST /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2/action => generated 0 bytes in 16686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:49:54.768042 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ee0e7b2d-d8d9-43ca-ba05-22267aa1191f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:54.769147 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ee0e7b2d-d8d9-43ca-ba05-22267aa1191f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:54.778020 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ee0e7b2d-d8d9-43ca-ba05-22267aa1191f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:54.779183 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ee0e7b2d-d8d9-43ca-ba05-22267aa1191f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:54.784269 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ee0e7b2d-d8d9-43ca-ba05-22267aa1191f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:54.785001 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ee0e7b2d-d8d9-43ca-ba05-22267aa1191f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:54.945261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21c421eb-b081-42fa-b85b-42449e38472e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:54.955537 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21c421eb-b081-42fa-b85b-42449e38472e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.311730 Mar 12 20:49:54.965824 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 413/693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:54 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:54.970723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-83a86652-d0f7-4954-8fc7-06b0815356ac tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Action: 'create', calling method: .version_select at 0x7f6e37688430>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:55.026729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-83a86652-d0f7-4954-8fc7-06b0815356ac tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:55.032139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-83a86652-d0f7-4954-8fc7-06b0815356ac tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Getting quotas for user c1643e7a47594217ae3320ff1a89637d and project dc8450acd03d4f24a2b0eb529a825af9. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:55.370129 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-83a86652-d0f7-4954-8fc7-06b0815356ac tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "POST /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 85 microversion: 2.1 time: 0.403046 Mar 12 20:49:55.370939 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 414/694] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Mar 12 20:49:54 2022] POST /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 85 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:55.376474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-052b0fa2-dff5-4c2d-b67a-da9c703dcaa8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:55.377099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-052b0fa2-dff5-4c2d-b67a-da9c703dcaa8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:55.385091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-052b0fa2-dff5-4c2d-b67a-da9c703dcaa8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:55.385621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-052b0fa2-dff5-4c2d-b67a-da9c703dcaa8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:55.386376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-052b0fa2-dff5-4c2d-b67a-da9c703dcaa8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:55.386844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-052b0fa2-dff5-4c2d-b67a-da9c703dcaa8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:55.455109 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ee0e7b2d-d8d9-43ca-ba05-22267aa1191f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:55.463326 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ee0e7b2d-d8d9-43ca-ba05-22267aa1191f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 200 len: 1307 microversion: 2.1 time: 0.701670 Mar 12 20:49:55.463943 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 281/695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:54 2022] GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 1307 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:55.468649 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-76f447e9-78a3-49c2-87fc-d3c3933d7f23 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:55.469421 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-76f447e9-78a3-49c2-87fc-d3c3933d7f23 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:55.478101 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-76f447e9-78a3-49c2-87fc-d3c3933d7f23 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:55.478685 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-76f447e9-78a3-49c2-87fc-d3c3933d7f23 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:55.479666 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-76f447e9-78a3-49c2-87fc-d3c3933d7f23 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:55.480111 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-76f447e9-78a3-49c2-87fc-d3c3933d7f23 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:55.553993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-052b0fa2-dff5-4c2d-b67a-da9c703dcaa8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:55.562343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-052b0fa2-dff5-4c2d-b67a-da9c703dcaa8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:55.563903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-052b0fa2-dff5-4c2d-b67a-da9c703dcaa8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:55.565062 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-052b0fa2-dff5-4c2d-b67a-da9c703dcaa8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1541 microversion: 2.25 time: 0.193193 Mar 12 20:49:55.565623 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 415/696] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:55 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1541 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:55.572327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-13adcabd-9a41-444b-8ea8-e7a3accd2490 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:55.572941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-13adcabd-9a41-444b-8ea8-e7a3accd2490 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:55.579254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13adcabd-9a41-444b-8ea8-e7a3accd2490 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:55.579667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13adcabd-9a41-444b-8ea8-e7a3accd2490 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:55.580730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13adcabd-9a41-444b-8ea8-e7a3accd2490 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:55.581194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13adcabd-9a41-444b-8ea8-e7a3accd2490 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:55.715829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-13adcabd-9a41-444b-8ea8-e7a3accd2490 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:55.723785 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-13adcabd-9a41-444b-8ea8-e7a3accd2490 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1470 microversion: 2.1 time: 0.155495 Mar 12 20:49:55.724914 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 416/697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:55 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:55.730660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f703db1-9b3c-4a82-b25e-44c284fc3a70 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:55.731383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f703db1-9b3c-4a82-b25e-44c284fc3a70 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:55.737471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f703db1-9b3c-4a82-b25e-44c284fc3a70 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:55.738094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f703db1-9b3c-4a82-b25e-44c284fc3a70 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:55.738985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f703db1-9b3c-4a82-b25e-44c284fc3a70 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:55.739568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f703db1-9b3c-4a82-b25e-44c284fc3a70 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:55.783941 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-76f447e9-78a3-49c2-87fc-d3c3933d7f23 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:55.822812 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-76f447e9-78a3-49c2-87fc-d3c3933d7f23 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1504 microversion: 2.1 time: 0.355756 Mar 12 20:49:55.825404 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 282/698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:55 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1504 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:55.842566 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a7cc5962-35b2-49bb-ba5f-0151cf046a7c tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] Calling method '.version_select at 0x7f6e372154c0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:55.901887 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a7cc5962-35b2-49bb-ba5f-0151cf046a7c tempest-ImagesMetadataTestJSON-270312510 tempest-ImagesMetadataTestJSON-270312510-project] 10.222.0.30 "GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata" status: 200 len: 85 microversion: 2.1 time: 0.069602 Mar 12 20:49:55.902894 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 283/699] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Mar 12 20:49:55 2022] GET /compute/v2.1/images/478c6ed3-cdec-489a-893c-e2748df73d15/metadata => generated 85 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:49:55.916425 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2a695305-955f-4966-8632-b4239de635db tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '.version_select at 0x7f6e372d6af0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:55.920680 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2a695305-955f-4966-8632-b4239de635db tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:55.921144 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2a695305-955f-4966-8632-b4239de635db tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:55.949121 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2a695305-955f-4966-8632-b4239de635db tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2607 microversion: 2.25 time: 0.044841 Mar 12 20:49:55.950268 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 284/700] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Mar 12 20:49:55 2022] GET /compute/v2.1/os-migrations => generated 2607 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:55.974055 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c859f6b9-3707-4f61-878d-76592d8814ef tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:55.977049 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c859f6b9-3707-4f61-878d-76592d8814ef tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:55.977710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f703db1-9b3c-4a82-b25e-44c284fc3a70 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccddd2d92af14ad5b2e799d284a435b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30e7ec4eede46af8cbd1864dcd1138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:55.986185 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f703db1-9b3c-4a82-b25e-44c284fc3a70 tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400" status: 200 len: 1478 microversion: 2.1 time: 0.260142 Mar 12 20:49:55.998947 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 417/701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:55 2022] GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400 => generated 1478 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:56.001291 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c859f6b9-3707-4f61-878d-76592d8814ef tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:56.002104 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c859f6b9-3707-4f61-878d-76592d8814ef tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:56.003194 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c859f6b9-3707-4f61-878d-76592d8814ef tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:56.003871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a123bc02-d123-427a-8e22-88249a211396 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:56.003987 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c859f6b9-3707-4f61-878d-76592d8814ef tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:56.004603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a123bc02-d123-427a-8e22-88249a211396 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:56.011427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a123bc02-d123-427a-8e22-88249a211396 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:56.011888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a123bc02-d123-427a-8e22-88249a211396 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:56.012654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a123bc02-d123-427a-8e22-88249a211396 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:56.013091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a123bc02-d123-427a-8e22-88249a211396 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:56.312751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a123bc02-d123-427a-8e22-88249a211396 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:56.322355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a123bc02-d123-427a-8e22-88249a211396 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.322234 Mar 12 20:49:56.323869 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-c859f6b9-3707-4f61-878d-76592d8814ef tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid 4f9c242e-54fc-4196-9994-8f4ee1f315bb {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:49:56.340537 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 418/702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:55 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:56.347021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b93be34f-5642-4053-9524-32f121bde301 req-98debea9-34e5-403d-8516-b5c5cf555fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913bf27d-ca17-4eb2-9c0b-94e944f64400", "name": "network-vif-deleted", "tag": "fc2a9599-3bf7-48c2-9b3c-b1f4f5ffa0c9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:56.364621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b93be34f-5642-4053-9524-32f121bde301 req-98debea9-34e5-403d-8516-b5c5cf555fe3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:56.365127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b93be34f-5642-4053-9524-32f121bde301 req-98debea9-34e5-403d-8516-b5c5cf555fe3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:56.372873 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c859f6b9-3707-4f61-878d-76592d8814ef tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 2033 microversion: 2.25 time: 0.410735 Mar 12 20:49:56.373588 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 285/703] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:55 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 2033 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:56.415012 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b93be34f-5642-4053-9524-32f121bde301 req-98debea9-34e5-403d-8516-b5c5cf555fe3 service nova] Creating event network-vif-deleted:fc2a9599-3bf7-48c2-9b3c-b1f4f5ffa0c9 for instance 913bf27d-ca17-4eb2-9c0b-94e944f64400 on nch2-master-1 Mar 12 20:49:56.427169 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b93be34f-5642-4053-9524-32f121bde301 req-98debea9-34e5-403d-8516-b5c5cf555fe3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096996 Mar 12 20:49:56.428347 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 419/704] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:56.484269 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f56ec654-c97e-47d5-91cf-fbad6ab659aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:56.485594 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f56ec654-c97e-47d5-91cf-fbad6ab659aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:56.509092 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f56ec654-c97e-47d5-91cf-fbad6ab659aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:56.513178 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f56ec654-c97e-47d5-91cf-fbad6ab659aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:56.514432 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f56ec654-c97e-47d5-91cf-fbad6ab659aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:56.529922 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f56ec654-c97e-47d5-91cf-fbad6ab659aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:56.569728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-468644816", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "1c06f7bd-57f3-494e-b107-2b7e9aae71ae"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:56.654620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] validate_networks() for [('1c06f7bd-57f3-494e-b107-2b7e9aae71ae', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:49:56.866893 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f56ec654-c97e-47d5-91cf-fbad6ab659aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:56.876692 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f56ec654-c97e-47d5-91cf-fbad6ab659aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 200 len: 1307 microversion: 2.1 time: 0.398990 Mar 12 20:49:56.887325 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 286/705] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:56 2022] GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 1307 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:56.896869 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9be346e1-cb78-4e87-990e-61e975aefee0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:56.897498 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9be346e1-cb78-4e87-990e-61e975aefee0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:56.903769 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9be346e1-cb78-4e87-990e-61e975aefee0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:56.904233 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9be346e1-cb78-4e87-990e-61e975aefee0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:56.905019 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9be346e1-cb78-4e87-990e-61e975aefee0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:56.905722 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9be346e1-cb78-4e87-990e-61e975aefee0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.184589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:49:57.185742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:49:57.186437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:49:57.187313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:49:57.187902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:49:57.195367 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9be346e1-cb78-4e87-990e-61e975aefee0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:57.199808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.200401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.201600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.202698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.208854 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9be346e1-cb78-4e87-990e-61e975aefee0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1462 microversion: 2.1 time: 0.320144 Mar 12 20:49:57.210248 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 287/706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:56 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1462 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:57.234071 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c0f290fd-0b7c-40a1-b9f0-f29c5efc9880 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:57.235313 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c0f290fd-0b7c-40a1-b9f0-f29c5efc9880 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:57.244036 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c0f290fd-0b7c-40a1-b9f0-f29c5efc9880 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.244934 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c0f290fd-0b7c-40a1-b9f0-f29c5efc9880 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.245099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Getting quotas for project 7417ea19a899461e99596d0df881a336. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:57.246332 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c0f290fd-0b7c-40a1-b9f0-f29c5efc9880 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.247320 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c0f290fd-0b7c-40a1-b9f0-f29c5efc9880 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.251373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Getting quotas for user 9c3556ea8eba477e92c2f6f765a30c1f and project 7417ea19a899461e99596d0df881a336. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:57.266226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:49:57.269313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:49:57.321693 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9eab6fe-3da3-4783-ad94-3d3043266c57 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.755147 Mar 12 20:49:57.324684 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 420/707] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:49:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 20:49:57.329408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20c3612e-4c83-4e0d-9535-473ac119a0fe tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:57.330114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20c3612e-4c83-4e0d-9535-473ac119a0fe tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] [instance: 913bf27d-ca17-4eb2-9c0b-94e944f64400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:57.338291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20c3612e-4c83-4e0d-9535-473ac119a0fe tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.338745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20c3612e-4c83-4e0d-9535-473ac119a0fe tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.339789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20c3612e-4c83-4e0d-9535-473ac119a0fe tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.340252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20c3612e-4c83-4e0d-9535-473ac119a0fe tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.356974 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-20c3612e-4c83-4e0d-9535-473ac119a0fe tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] HTTP exception thrown: Instance 913bf27d-ca17-4eb2-9c0b-94e944f64400 could not be found. Mar 12 20:49:57.357953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20c3612e-4c83-4e0d-9535-473ac119a0fe tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] Returning 404 to user: Instance 913bf27d-ca17-4eb2-9c0b-94e944f64400 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:49:57.358430 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20c3612e-4c83-4e0d-9535-473ac119a0fe tempest-ServerDiagnosticsNegativeTest-1489902246 tempest-ServerDiagnosticsNegativeTest-1489902246-project] 10.222.0.30 "GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400" status: 404 len: 111 microversion: 2.1 time: 0.032874 Mar 12 20:49:57.358984 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 421/708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:57 2022] GET /compute/v2.1/servers/913bf27d-ca17-4eb2-9c0b-94e944f64400 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:49:57.364241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-368407af-1288-480d-ad14-95846d13ebb8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:57.365388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-368407af-1288-480d-ad14-95846d13ebb8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:57.372283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-368407af-1288-480d-ad14-95846d13ebb8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.372489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-368407af-1288-480d-ad14-95846d13ebb8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.373316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-368407af-1288-480d-ad14-95846d13ebb8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.373759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-368407af-1288-480d-ad14-95846d13ebb8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.545354 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c0f290fd-0b7c-40a1-b9f0-f29c5efc9880 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:57.558022 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c0f290fd-0b7c-40a1-b9f0-f29c5efc9880 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1504 microversion: 2.1 time: 0.345617 Mar 12 20:49:57.560823 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 288/709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:57 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1504 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:57.584643 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-368407af-1288-480d-ad14-95846d13ebb8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1613 microversion: 2.1 time: 0.224608 Mar 12 20:49:57.585907 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 422/710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:57 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1613 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:57.590077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-206268b0-ee8d-4372-a413-4c131cf69fed tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:57.590783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-206268b0-ee8d-4372-a413-4c131cf69fed tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:57.592671 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-cd69e386-c4a1-4fbb-8f1a-e3b29b135b60 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:57.593317 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-cd69e386-c4a1-4fbb-8f1a-e3b29b135b60 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:57.598304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206268b0-ee8d-4372-a413-4c131cf69fed tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.599023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206268b0-ee8d-4372-a413-4c131cf69fed tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.600588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206268b0-ee8d-4372-a413-4c131cf69fed tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.601249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206268b0-ee8d-4372-a413-4c131cf69fed tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.753302 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-cd69e386-c4a1-4fbb-8f1a-e3b29b135b60 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:57.766817 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-cd69e386-c4a1-4fbb-8f1a-e3b29b135b60 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:57.774128 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-cd69e386-c4a1-4fbb-8f1a-e3b29b135b60 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:57.776374 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-cd69e386-c4a1-4fbb-8f1a-e3b29b135b60 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1261 microversion: 2.25 time: 0.212783 Mar 12 20:49:57.779215 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 289/711] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:57 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:57.799594 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-26ab9289-7124-48f2-b71d-22455547019d tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Calling method '.version_select at 0x7f6e372d6820>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:57.804733 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-26ab9289-7124-48f2-b71d-22455547019d tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.805387 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-26ab9289-7124-48f2-b71d-22455547019d tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.835433 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-26ab9289-7124-48f2-b71d-22455547019d tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.1 time: 0.052340 Mar 12 20:49:57.841596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-206268b0-ee8d-4372-a413-4c131cf69fed tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:57.852485 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 290/712] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 20:49:57 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:57.853734 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-206268b0-ee8d-4372-a413-4c131cf69fed tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.266720 Mar 12 20:49:57.866207 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 423/713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:57 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:57.897324 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-efd8c535-e848-41c6-8825-74b25febb666 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:57.898669 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-efd8c535-e848-41c6-8825-74b25febb666 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:57.916215 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-efd8c535-e848-41c6-8825-74b25febb666 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.918478 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-efd8c535-e848-41c6-8825-74b25febb666 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:57.919489 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-efd8c535-e848-41c6-8825-74b25febb666 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:57.920882 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-efd8c535-e848-41c6-8825-74b25febb666 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:58.125115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-362525094", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:58.206881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:49:58.276568 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-efd8c535-e848-41c6-8825-74b25febb666 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:58.286324 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-efd8c535-e848-41c6-8825-74b25febb666 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 200 len: 1307 microversion: 2.1 time: 0.395090 Mar 12 20:49:58.287137 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 291/714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:57 2022] GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:58.301121 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-ea09d4e7-f63a-45d9-af7f-8e26c897f641 req-fd8f5708-7039-4d6b-8943-2742c6e85d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378f100b-bc86-4e26-8462-2b6ab20b1e04", "name": "network-vif-plugged", "status": "completed", "tag": "bc5ebba0-ee77-4f1a-8fd8-11584ea45c51"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:58.311155 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-ea09d4e7-f63a-45d9-af7f-8e26c897f641 req-fd8f5708-7039-4d6b-8943-2742c6e85d46 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:58.312011 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-ea09d4e7-f63a-45d9-af7f-8e26c897f641 req-fd8f5708-7039-4d6b-8943-2742c6e85d46 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:58.330718 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-ea09d4e7-f63a-45d9-af7f-8e26c897f641 req-fd8f5708-7039-4d6b-8943-2742c6e85d46 service nova] Creating event network-vif-plugged:bc5ebba0-ee77-4f1a-8fd8-11584ea45c51 for instance 378f100b-bc86-4e26-8462-2b6ab20b1e04 on nch2-master-1 Mar 12 20:49:58.339694 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-ea09d4e7-f63a-45d9-af7f-8e26c897f641 req-fd8f5708-7039-4d6b-8943-2742c6e85d46 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042397 Mar 12 20:49:58.340417 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 292/715] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:49:58.449440 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-3101496b-a669-47a7-9f5c-40eb6fc79925 req-9d8f5fb7-8c7c-487a-bd16-ada81a662729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab950cd9-846a-49c5-964c-7f8f96d7bed2", "name": "network-vif-unplugged", "status": "completed", "tag": "8139ec0e-8f41-45a1-a748-a770dd994696"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:58.458373 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-3101496b-a669-47a7-9f5c-40eb6fc79925 req-9d8f5fb7-8c7c-487a-bd16-ada81a662729 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:58.459800 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-3101496b-a669-47a7-9f5c-40eb6fc79925 req-9d8f5fb7-8c7c-487a-bd16-ada81a662729 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:58.472699 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-3101496b-a669-47a7-9f5c-40eb6fc79925 req-9d8f5fb7-8c7c-487a-bd16-ada81a662729 service nova] Creating event network-vif-unplugged:8139ec0e-8f41-45a1-a748-a770dd994696 for instance ab950cd9-846a-49c5-964c-7f8f96d7bed2 on nch2-master-1 Mar 12 20:49:58.480733 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-3101496b-a669-47a7-9f5c-40eb6fc79925 req-9d8f5fb7-8c7c-487a-bd16-ada81a662729 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035180 Mar 12 20:49:58.481674 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 293/716] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:49:58.505950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:49:58.506379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:49:58.507247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:49:58.507694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:49:58.508409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:49:58.518092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:58.518707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:58.519727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:58.520445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:58.542465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Getting quotas for project d8057df76c4c4652a22bb659969dbb31. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:58.548031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Getting quotas for user b404502bb19242c385bc7d6ca5bff2de and project d8057df76c4c4652a22bb659969dbb31. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:58.560981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:49:58.563352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:49:58.577193 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7173aa47-8f50-4679-8c61-e4ef9f622001 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:58.578834 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7173aa47-8f50-4679-8c61-e4ef9f622001 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:58.587784 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7173aa47-8f50-4679-8c61-e4ef9f622001 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:58.589197 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7173aa47-8f50-4679-8c61-e4ef9f622001 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:58.590364 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7173aa47-8f50-4679-8c61-e4ef9f622001 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:58.591498 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7173aa47-8f50-4679-8c61-e4ef9f622001 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:58.616973 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-271ead5e-c4ba-4c0c-93d3-8dd3ecbbaad1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501876 Mar 12 20:49:58.618253 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 424/717] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:49:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:49:58.628369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc084229-5434-414e-ac35-4c936d3a9cbf tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:58.629561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc084229-5434-414e-ac35-4c936d3a9cbf tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:58.702961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc084229-5434-414e-ac35-4c936d3a9cbf tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:58.712042 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc084229-5434-414e-ac35-4c936d3a9cbf tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1212 microversion: 2.1 time: 0.088024 Mar 12 20:49:58.712825 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 425/718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:58 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:58.800021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f3272903-895c-49a0-b2f9-5b6b7bcecd1c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:58.800978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f3272903-895c-49a0-b2f9-5b6b7bcecd1c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:58.812165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3272903-895c-49a0-b2f9-5b6b7bcecd1c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:58.813345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3272903-895c-49a0-b2f9-5b6b7bcecd1c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:58.815412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3272903-895c-49a0-b2f9-5b6b7bcecd1c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:58.816584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3272903-895c-49a0-b2f9-5b6b7bcecd1c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:58.934321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f3272903-895c-49a0-b2f9-5b6b7bcecd1c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:58.949106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f3272903-895c-49a0-b2f9-5b6b7bcecd1c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:58.952008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f3272903-895c-49a0-b2f9-5b6b7bcecd1c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:58.953792 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f3272903-895c-49a0-b2f9-5b6b7bcecd1c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1321 microversion: 2.25 time: 0.161226 Mar 12 20:49:58.967953 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 426/719] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:58 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:49:58.975051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-716bc8d6-8de7-4ac3-b447-e0bcc3962564 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:58.978078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-716bc8d6-8de7-4ac3-b447-e0bcc3962564 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:58.985022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-716bc8d6-8de7-4ac3-b447-e0bcc3962564 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:58.985572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-716bc8d6-8de7-4ac3-b447-e0bcc3962564 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:58.986601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-716bc8d6-8de7-4ac3-b447-e0bcc3962564 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:58.988426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-716bc8d6-8de7-4ac3-b447-e0bcc3962564 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:59.055348 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7173aa47-8f50-4679-8c61-e4ef9f622001 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:59.065033 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7173aa47-8f50-4679-8c61-e4ef9f622001 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1504 microversion: 2.1 time: 0.492119 Mar 12 20:49:59.066009 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 294/720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:58 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1504 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:59.263332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-716bc8d6-8de7-4ac3-b447-e0bcc3962564 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:59.272445 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-716bc8d6-8de7-4ac3-b447-e0bcc3962564 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.302993 Mar 12 20:49:59.273471 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 427/721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:58 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:49:59.303771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1a222613-6328-4656-967d-b2d108188f7a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:59.304494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1a222613-6328-4656-967d-b2d108188f7a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:59.310800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a222613-6328-4656-967d-b2d108188f7a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:59.311147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a222613-6328-4656-967d-b2d108188f7a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:59.312122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a222613-6328-4656-967d-b2d108188f7a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:59.312567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a222613-6328-4656-967d-b2d108188f7a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:59.468549 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-61e56023-8614-4fae-9f43-4b2675b280c0 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Action: 'create', calling method: .version_select at 0x7f6e372d6c10>, body: {"keypair": {"name": "tempest-keypair-1616321439"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:49:59.492280 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-61e56023-8614-4fae-9f43-4b2675b280c0 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:49:59.503732 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-61e56023-8614-4fae-9f43-4b2675b280c0 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for user e46587c7c0cf46adb5fca5249059aaf1 and project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:49:59.518512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1a222613-6328-4656-967d-b2d108188f7a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:59.528714 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1a222613-6328-4656-967d-b2d108188f7a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 200 len: 1307 microversion: 2.1 time: 0.229431 Mar 12 20:49:59.529931 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 428/722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:59 2022] GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:59.731919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d60235c3-42cd-49d8-bac7-53dff1d4f07c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:59.733403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d60235c3-42cd-49d8-bac7-53dff1d4f07c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:59.741937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d60235c3-42cd-49d8-bac7-53dff1d4f07c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:59.743016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d60235c3-42cd-49d8-bac7-53dff1d4f07c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:59.744256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d60235c3-42cd-49d8-bac7-53dff1d4f07c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:59.744852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d60235c3-42cd-49d8-bac7-53dff1d4f07c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:59.827262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d60235c3-42cd-49d8-bac7-53dff1d4f07c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:49:59.851947 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d60235c3-42cd-49d8-bac7-53dff1d4f07c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1264 microversion: 2.1 time: 0.126055 Mar 12 20:49:59.853050 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 429/723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:49:59 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1264 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:49:59.973201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2e30ca0-df8e-4b5d-a228-2a964a35e623 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:49:59.975220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2e30ca0-df8e-4b5d-a228-2a964a35e623 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:49:59.983470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2e30ca0-df8e-4b5d-a228-2a964a35e623 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:59.985045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2e30ca0-df8e-4b5d-a228-2a964a35e623 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:49:59.986729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2e30ca0-df8e-4b5d-a228-2a964a35e623 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:49:59.987358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2e30ca0-df8e-4b5d-a228-2a964a35e623 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:00.110487 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-61e56023-8614-4fae-9f43-4b2675b280c0 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:00.117716 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-61e56023-8614-4fae-9f43-4b2675b280c0 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for user e46587c7c0cf46adb5fca5249059aaf1 and project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:00.138082 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-61e56023-8614-4fae-9f43-4b2675b280c0 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.070668 Mar 12 20:50:00.143283 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 295/724] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:49:59 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:00.145602 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-71b85347-abef-48f5-b652-0895795597a1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:00.146980 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-71b85347-abef-48f5-b652-0895795597a1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:00.175655 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-71b85347-abef-48f5-b652-0895795597a1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:00.176559 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-71b85347-abef-48f5-b652-0895795597a1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:00.179406 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-71b85347-abef-48f5-b652-0895795597a1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:00.181419 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-71b85347-abef-48f5-b652-0895795597a1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:00.184510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e2e30ca0-df8e-4b5d-a228-2a964a35e623 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:00.198246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e2e30ca0-df8e-4b5d-a228-2a964a35e623 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:00.200141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e2e30ca0-df8e-4b5d-a228-2a964a35e623 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:00.201824 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2e30ca0-df8e-4b5d-a228-2a964a35e623 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1361 microversion: 2.25 time: 0.232821 Mar 12 20:50:00.202611 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 430/725] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:49:59 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:00.209027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d93ea79e-1ef8-4455-a77b-5edaf21ba3c2 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Calling method '.version_select at 0x7f6e441bc8b0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:00.219271 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d93ea79e-1ef8-4455-a77b-5edaf21ba3c2 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1616321439" status: 200 len: 691 microversion: 2.1 time: 0.015328 Mar 12 20:50:00.220216 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 431/726] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Mar 12 20:50:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1616321439 => generated 691 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:00.233362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f98d9240-24ca-4749-a3fc-6e32262a09f3 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Calling method '.version_select at 0x7f6e3731af70>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:00.256311 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f98d9240-24ca-4749-a3fc-6e32262a09f3 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1616321439" status: 202 len: 0 microversion: 2.1 time: 0.027186 Mar 12 20:50:00.262502 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 432/727] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Mar 12 20:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1616321439 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:00.268200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5091c6d6-d17c-4733-8958-a5bf31216b7c tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Action: 'create', calling method: .version_select at 0x7f6e44084040>, body: {"keypair": {"name": "tempest-keypair-1353445423"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:00.298882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-5091c6d6-d17c-4733-8958-a5bf31216b7c tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:00.307714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-5091c6d6-d17c-4733-8958-a5bf31216b7c tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for user e46587c7c0cf46adb5fca5249059aaf1 and project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:00.608057 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-71b85347-abef-48f5-b652-0895795597a1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:00.615566 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-71b85347-abef-48f5-b652-0895795597a1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1504 microversion: 2.1 time: 0.475216 Mar 12 20:50:00.616514 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 296/728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:00 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1504 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:00.621259 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-387af804-2cba-45d3-93b3-6e5d5c94a01e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:00.622135 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-387af804-2cba-45d3-93b3-6e5d5c94a01e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:00.629103 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-387af804-2cba-45d3-93b3-6e5d5c94a01e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:00.629797 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-387af804-2cba-45d3-93b3-6e5d5c94a01e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:00.631022 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-387af804-2cba-45d3-93b3-6e5d5c94a01e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:00.631667 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-387af804-2cba-45d3-93b3-6e5d5c94a01e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:00.719605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-5091c6d6-d17c-4733-8958-a5bf31216b7c tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:00.724852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-5091c6d6-d17c-4733-8958-a5bf31216b7c tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for user e46587c7c0cf46adb5fca5249059aaf1 and project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:00.742436 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5091c6d6-d17c-4733-8958-a5bf31216b7c tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.478472 Mar 12 20:50:00.743065 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 433/729] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:50:00 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:00.748107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1faa29f5-6d10-4cc7-ae61-c67baeb86e00 req-8f51488b-7af6-46f8-a928-6af1d0c41af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab950cd9-846a-49c5-964c-7f8f96d7bed2", "tag": "8139ec0e-8f41-45a1-a748-a770dd994696"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:00.756270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1faa29f5-6d10-4cc7-ae61-c67baeb86e00 req-8f51488b-7af6-46f8-a928-6af1d0c41af9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:00.756728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1faa29f5-6d10-4cc7-ae61-c67baeb86e00 req-8f51488b-7af6-46f8-a928-6af1d0c41af9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:00.768167 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1faa29f5-6d10-4cc7-ae61-c67baeb86e00 req-8f51488b-7af6-46f8-a928-6af1d0c41af9 service nova] Creating event network-changed:8139ec0e-8f41-45a1-a748-a770dd994696 for instance ab950cd9-846a-49c5-964c-7f8f96d7bed2 on nch2-master-1 Mar 12 20:50:00.773932 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1faa29f5-6d10-4cc7-ae61-c67baeb86e00 req-8f51488b-7af6-46f8-a928-6af1d0c41af9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029556 Mar 12 20:50:00.774824 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 434/730] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:00.780049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1036af0f-b786-4772-b67d-8a190197a3a4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:00.780758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1036af0f-b786-4772-b67d-8a190197a3a4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:00.787840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1036af0f-b786-4772-b67d-8a190197a3a4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:00.788738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1036af0f-b786-4772-b67d-8a190197a3a4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:00.789103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1036af0f-b786-4772-b67d-8a190197a3a4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:00.789530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1036af0f-b786-4772-b67d-8a190197a3a4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:00.954020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1036af0f-b786-4772-b67d-8a190197a3a4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:00.962713 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1036af0f-b786-4772-b67d-8a190197a3a4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 200 len: 1487 microversion: 2.1 time: 0.185995 Mar 12 20:50:00.963549 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 435/731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:00 2022] GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 1487 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:00.985625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ea17abb-e460-49ee-8c72-68967e1b6ab9 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Calling method '.version_select at 0x7f6e44182f70>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:01.014851 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ea17abb-e460-49ee-8c72-68967e1b6ab9 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1353445423" status: 202 len: 0 microversion: 2.1 time: 0.038131 Mar 12 20:50:01.020556 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 436/732] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Mar 12 20:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1353445423 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:01.026589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99d030f5-f626-4126-b71a-4f75f2de4e47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:01.027460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-99d030f5-f626-4126-b71a-4f75f2de4e47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:01.034786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99d030f5-f626-4126-b71a-4f75f2de4e47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:01.035539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99d030f5-f626-4126-b71a-4f75f2de4e47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:01.037037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99d030f5-f626-4126-b71a-4f75f2de4e47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:01.037630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99d030f5-f626-4126-b71a-4f75f2de4e47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:01.123816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-99d030f5-f626-4126-b71a-4f75f2de4e47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:01.132180 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99d030f5-f626-4126-b71a-4f75f2de4e47 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1270 microversion: 2.1 time: 0.109967 Mar 12 20:50:01.132774 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 437/733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:01 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:01.149340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0b69dce5-8a43-44fc-8be0-108a3026f5c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:01.149936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0b69dce5-8a43-44fc-8be0-108a3026f5c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:01.162222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b69dce5-8a43-44fc-8be0-108a3026f5c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:01.162789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b69dce5-8a43-44fc-8be0-108a3026f5c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:01.163684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b69dce5-8a43-44fc-8be0-108a3026f5c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:01.164553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b69dce5-8a43-44fc-8be0-108a3026f5c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:01.246915 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0b69dce5-8a43-44fc-8be0-108a3026f5c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "POST /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04/action" status: 202 len: 0 microversion: 2.1 time: 0.101503 Mar 12 20:50:01.248305 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 438/734] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:50:01 2022] POST /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:01.253158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67709b80-39d9-4a0f-a52a-2f2586760afb tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Action: 'create', calling method: .version_select at 0x7f6e441bc700>, body: {"keypair": {"name": "tempest-keypair-685055935", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:01.271269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-67709b80-39d9-4a0f-a52a-2f2586760afb tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:01.278956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-67709b80-39d9-4a0f-a52a-2f2586760afb tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for user e46587c7c0cf46adb5fca5249059aaf1 and project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:01.308046 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67709b80-39d9-4a0f-a52a-2f2586760afb tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.058878 Mar 12 20:50:01.314920 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 439/735] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Mar 12 20:50:01 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:01.314920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20619e8e-2d10-4b9e-8c45-6dadf1d7df23 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:01.314920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20619e8e-2d10-4b9e-8c45-6dadf1d7df23 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:01.317964 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-387af804-2cba-45d3-93b3-6e5d5c94a01e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:01.323210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20619e8e-2d10-4b9e-8c45-6dadf1d7df23 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:01.323788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20619e8e-2d10-4b9e-8c45-6dadf1d7df23 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:01.325110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20619e8e-2d10-4b9e-8c45-6dadf1d7df23 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:01.325714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20619e8e-2d10-4b9e-8c45-6dadf1d7df23 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:01.327085 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-387af804-2cba-45d3-93b3-6e5d5c94a01e tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.709368 Mar 12 20:50:01.327836 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 297/736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:00 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:01.332596 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ab4adc5f-7b04-435f-aa87-13a3a830d3a1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:01.333939 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ab4adc5f-7b04-435f-aa87-13a3a830d3a1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:01.339729 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ab4adc5f-7b04-435f-aa87-13a3a830d3a1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:01.340178 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ab4adc5f-7b04-435f-aa87-13a3a830d3a1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:01.341123 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ab4adc5f-7b04-435f-aa87-13a3a830d3a1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:01.341719 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ab4adc5f-7b04-435f-aa87-13a3a830d3a1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:01.487331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-20619e8e-2d10-4b9e-8c45-6dadf1d7df23 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:01.497875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-20619e8e-2d10-4b9e-8c45-6dadf1d7df23 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:01.499804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-20619e8e-2d10-4b9e-8c45-6dadf1d7df23 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:01.501574 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20619e8e-2d10-4b9e-8c45-6dadf1d7df23 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1361 microversion: 2.25 time: 0.191630 Mar 12 20:50:01.502541 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 440/737] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:01 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:01.508461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fed8923e-198b-4d83-9d44-d7d30ad5b717 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Calling method '.version_select at 0x7f6e3715b280>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:01.531594 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fed8923e-198b-4d83-9d44-d7d30ad5b717 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-685055935" status: 202 len: 0 microversion: 2.1 time: 0.027716 Mar 12 20:50:01.532672 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 441/738] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Mar 12 20:50:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-685055935 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:01.545457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cae648e2-1a2f-4c59-bd53-e076894dbfca tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Action: 'create', calling method: .version_select at 0x7f6e3731aaf0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1529088099"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:01.563227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cae648e2-1a2f-4c59-bd53-e076894dbfca tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:01.570491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cae648e2-1a2f-4c59-bd53-e076894dbfca tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for user e46587c7c0cf46adb5fca5249059aaf1 and project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:01.740891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cae648e2-1a2f-4c59-bd53-e076894dbfca tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:01.745758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cae648e2-1a2f-4c59-bd53-e076894dbfca tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for user e46587c7c0cf46adb5fca5249059aaf1 and project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:01.760511 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cae648e2-1a2f-4c59-bd53-e076894dbfca tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.220464 Mar 12 20:50:01.765602 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 442/739] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:50:01 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:01.766131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5db233c7-a3f9-469e-87e6-56939500e760 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:01.766742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5db233c7-a3f9-469e-87e6-56939500e760 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:01.773148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5db233c7-a3f9-469e-87e6-56939500e760 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:01.773596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5db233c7-a3f9-469e-87e6-56939500e760 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:01.774396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5db233c7-a3f9-469e-87e6-56939500e760 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:01.774829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5db233c7-a3f9-469e-87e6-56939500e760 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:01.842953 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ab4adc5f-7b04-435f-aa87-13a3a830d3a1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:01.850750 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ab4adc5f-7b04-435f-aa87-13a3a830d3a1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 200 len: 1492 microversion: 2.1 time: 0.521770 Mar 12 20:50:01.851740 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 298/740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:01 2022] GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 1492 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:01.915362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5db233c7-a3f9-469e-87e6-56939500e760 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:01.924032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5db233c7-a3f9-469e-87e6-56939500e760 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1504 microversion: 2.1 time: 0.161821 Mar 12 20:50:01.924791 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 443/741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:01 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:01.929661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7617f67e-0686-4e01-b0b6-3058f8229f02 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Action: 'create', calling method: .version_select at 0x7f6e44034b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1403390135"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:01.944596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7617f67e-0686-4e01-b0b6-3058f8229f02 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:01.950105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7617f67e-0686-4e01-b0b6-3058f8229f02 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for user e46587c7c0cf46adb5fca5249059aaf1 and project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:01.988965 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1039308619", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": "none"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:02.053337 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:50:02.054153 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:50:02.054991 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:50:02.055847 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:50:02.057025 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:50:02.069847 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:02.070600 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:02.071826 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:02.072436 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:02.093399 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Getting quotas for project 07f2b47fc8614e54ac931e5e91f0dfd2. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:02.098693 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Getting quotas for user 0d1c4c4b875345debd5168821369b310 and project 07f2b47fc8614e54ac931e5e91f0dfd2. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:02.111927 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Going to run 1 instances... {{(pid=136303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:50:02.114356 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:50:02.166601 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e829384b-dbaa-40be-b648-6585099091aa tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.313408 Mar 12 20:50:02.167693 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 299/742] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:50:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 315 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 20:50:02.173555 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-78a8b33b-00b8-4b7d-aeda-7cc493557961 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:02.174199 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-78a8b33b-00b8-4b7d-aeda-7cc493557961 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:02.181792 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-78a8b33b-00b8-4b7d-aeda-7cc493557961 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:02.182517 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-78a8b33b-00b8-4b7d-aeda-7cc493557961 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:02.183452 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-78a8b33b-00b8-4b7d-aeda-7cc493557961 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:02.184070 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-78a8b33b-00b8-4b7d-aeda-7cc493557961 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:02.265130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7617f67e-0686-4e01-b0b6-3058f8229f02 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:02.271009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7617f67e-0686-4e01-b0b6-3058f8229f02 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for user e46587c7c0cf46adb5fca5249059aaf1 and project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:02.285351 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7617f67e-0686-4e01-b0b6-3058f8229f02 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.359209 Mar 12 20:50:02.290629 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 444/743] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:50:01 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:02.290800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-28c7c459-a7bf-4b06-95ac-2e2c42b41bc9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:02.291784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-28c7c459-a7bf-4b06-95ac-2e2c42b41bc9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:02.303720 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-78a8b33b-00b8-4b7d-aeda-7cc493557961 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:02.313573 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-78a8b33b-00b8-4b7d-aeda-7cc493557961 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1270 microversion: 2.1 time: 0.144629 Mar 12 20:50:02.314731 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 300/744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:02 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1270 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:02.322213 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-329765a1-8a21-41a3-a72a-27d2d304eebb tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Action: 'create', calling method: .version_select at 0x7f6e3743b5e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1249643211"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:02.342334 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-329765a1-8a21-41a3-a72a-27d2d304eebb tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:02.351061 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-329765a1-8a21-41a3-a72a-27d2d304eebb tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for user e46587c7c0cf46adb5fca5249059aaf1 and project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:02.393826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-28c7c459-a7bf-4b06-95ac-2e2c42b41bc9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:02.403047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-28c7c459-a7bf-4b06-95ac-2e2c42b41bc9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:02.405384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-28c7c459-a7bf-4b06-95ac-2e2c42b41bc9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:02.415878 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-28c7c459-a7bf-4b06-95ac-2e2c42b41bc9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "PUT /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1359 microversion: 2.75 time: 0.128823 Mar 12 20:50:02.417208 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 445/745] 10.222.0.30 () {62 vars in 1296 bytes} [Sat Mar 12 20:50:02 2022] PUT /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1359 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:02.422837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1974e6ed-eb30-4cd5-a989-f6c82052b291 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:02.423456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1974e6ed-eb30-4cd5-a989-f6c82052b291 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:02.456669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1974e6ed-eb30-4cd5-a989-f6c82052b291 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:02.457262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1974e6ed-eb30-4cd5-a989-f6c82052b291 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:02.459930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1974e6ed-eb30-4cd5-a989-f6c82052b291 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:02.460504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1974e6ed-eb30-4cd5-a989-f6c82052b291 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:02.750182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1974e6ed-eb30-4cd5-a989-f6c82052b291 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:02.768538 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1974e6ed-eb30-4cd5-a989-f6c82052b291 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.349358 Mar 12 20:50:02.769366 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 446/746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:02 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:02.782713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4bec4d7d-b5ea-48e0-bc6b-dd14d217ce3f tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:02.783698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4bec4d7d-b5ea-48e0-bc6b-dd14d217ce3f tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:02.852312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4bec4d7d-b5ea-48e0-bc6b-dd14d217ce3f tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:02.866120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4bec4d7d-b5ea-48e0-bc6b-dd14d217ce3f tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:02.868377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4bec4d7d-b5ea-48e0-bc6b-dd14d217ce3f tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:02.875481 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4bec4d7d-b5ea-48e0-bc6b-dd14d217ce3f tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1359 microversion: 2.75 time: 0.104243 Mar 12 20:50:02.883489 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-329765a1-8a21-41a3-a72a-27d2d304eebb tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:02.888328 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 447/747] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:02 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1359 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:02.893726 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-329765a1-8a21-41a3-a72a-27d2d304eebb tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Getting quotas for user e46587c7c0cf46adb5fca5249059aaf1 and project eabe26e1e72b41d88467759fe81fb7c5. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:02.894526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-757910d5-d1c0-420d-934a-74ee3a52138e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:02.895395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-757910d5-d1c0-420d-934a-74ee3a52138e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:02.902365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-757910d5-d1c0-420d-934a-74ee3a52138e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:02.903129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-757910d5-d1c0-420d-934a-74ee3a52138e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:02.904293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-757910d5-d1c0-420d-934a-74ee3a52138e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:02.904970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-757910d5-d1c0-420d-934a-74ee3a52138e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:02.921945 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-329765a1-8a21-41a3-a72a-27d2d304eebb tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.605531 Mar 12 20:50:02.922868 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 301/748] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:50:02 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:02.927882 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-dce58dce-e1dc-489e-8663-0172393e52cd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:02.928702 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-dce58dce-e1dc-489e-8663-0172393e52cd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:02.935085 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dce58dce-e1dc-489e-8663-0172393e52cd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:02.936079 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dce58dce-e1dc-489e-8663-0172393e52cd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:02.937231 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dce58dce-e1dc-489e-8663-0172393e52cd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:02.937857 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dce58dce-e1dc-489e-8663-0172393e52cd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:03.093119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-757910d5-d1c0-420d-934a-74ee3a52138e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:03.104714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-757910d5-d1c0-420d-934a-74ee3a52138e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:03.107162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-757910d5-d1c0-420d-934a-74ee3a52138e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:03.108306 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-757910d5-d1c0-420d-934a-74ee3a52138e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1361 microversion: 2.25 time: 0.218667 Mar 12 20:50:03.109184 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 448/749] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:02 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:03.117836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-93306acb-d6bc-400d-82f4-12a16ed647a0 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Calling method '.version_select at 0x7f6e374871f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:03.120668 ncdv-master-1 devstack@n-api.service[136302]: WARNING oslo_db.sqlalchemy.utils [None req-93306acb-d6bc-400d-82f4-12a16ed647a0 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 12 20:50:03.128235 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-93306acb-d6bc-400d-82f4-12a16ed647a0 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1676 microversion: 2.1 time: 0.017855 Mar 12 20:50:03.129144 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 449/750] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:50:03 2022] GET /compute/v2.1/os-keypairs => generated 1676 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:03.134612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-365a4562-746b-4bdb-ae64-e7c74d8ab6cf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:03.135522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-365a4562-746b-4bdb-ae64-e7c74d8ab6cf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:03.142487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-365a4562-746b-4bdb-ae64-e7c74d8ab6cf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:03.143021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-365a4562-746b-4bdb-ae64-e7c74d8ab6cf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:03.144096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-365a4562-746b-4bdb-ae64-e7c74d8ab6cf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:03.144657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-365a4562-746b-4bdb-ae64-e7c74d8ab6cf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:03.219714 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-dce58dce-e1dc-489e-8663-0172393e52cd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:03.228804 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-dce58dce-e1dc-489e-8663-0172393e52cd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 200 len: 1472 microversion: 2.1 time: 0.303746 Mar 12 20:50:03.234254 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 302/751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:02 2022] GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 1472 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:03.239482 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-f20c71a0-47f2-425c-9770-0404294598c2 req-807c0fd4-c6cd-4abc-aa08-1513c92cb9ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b3b4cce-d19a-479c-adcf-03afc06cf8e0", "tag": "70b96b8e-4df3-42a1-a05b-4818b836f46f"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:03.248788 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-f20c71a0-47f2-425c-9770-0404294598c2 req-807c0fd4-c6cd-4abc-aa08-1513c92cb9ef service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:03.250123 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-f20c71a0-47f2-425c-9770-0404294598c2 req-807c0fd4-c6cd-4abc-aa08-1513c92cb9ef service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:03.265574 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-f20c71a0-47f2-425c-9770-0404294598c2 req-807c0fd4-c6cd-4abc-aa08-1513c92cb9ef service nova] Creating event network-changed:70b96b8e-4df3-42a1-a05b-4818b836f46f for instance 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 on nch2-master-1 Mar 12 20:50:03.272737 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-f20c71a0-47f2-425c-9770-0404294598c2 req-807c0fd4-c6cd-4abc-aa08-1513c92cb9ef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037026 Mar 12 20:50:03.273547 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 303/752] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:03.278723 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3af26a9e-8515-46c6-ad2c-72f169e7b8e8 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Calling method '.version_select at 0x7f6e3724aa60>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:03.291481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-365a4562-746b-4bdb-ae64-e7c74d8ab6cf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:03.300410 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3af26a9e-8515-46c6-ad2c-72f169e7b8e8 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1249643211" status: 202 len: 0 microversion: 2.1 time: 0.025636 Mar 12 20:50:03.301011 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 304/753] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Mar 12 20:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1249643211 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:03.302272 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-365a4562-746b-4bdb-ae64-e7c74d8ab6cf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1504 microversion: 2.1 time: 0.171597 Mar 12 20:50:03.303183 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 450/754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:03 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:03.309252 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a16f785a-1c37-4fe0-91ed-bbf8c980f5fa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1662946390"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:03.310433 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a16f785a-1c37-4fe0-91ed-bbf8c980f5fa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:03.310783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90a027d9-a22d-459c-bcfa-1d17ac16dfc6 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Calling method '.version_select at 0x7f6e3715bc10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:03.317575 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a16f785a-1c37-4fe0-91ed-bbf8c980f5fa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:03.318751 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a16f785a-1c37-4fe0-91ed-bbf8c980f5fa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:03.319544 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a16f785a-1c37-4fe0-91ed-bbf8c980f5fa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:03.319987 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a16f785a-1c37-4fe0-91ed-bbf8c980f5fa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:03.335611 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90a027d9-a22d-459c-bcfa-1d17ac16dfc6 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1403390135" status: 202 len: 0 microversion: 2.1 time: 0.029346 Mar 12 20:50:03.336834 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 451/755] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Mar 12 20:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1403390135 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:03.344735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34be0801-ada1-4f61-ba9c-03269e7449ee tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:03.345126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34be0801-ada1-4f61-ba9c-03269e7449ee tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:03.354814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34be0801-ada1-4f61-ba9c-03269e7449ee tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:03.355276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34be0801-ada1-4f61-ba9c-03269e7449ee tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:03.356126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34be0801-ada1-4f61-ba9c-03269e7449ee tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:03.356563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34be0801-ada1-4f61-ba9c-03269e7449ee tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:03.584973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34be0801-ada1-4f61-ba9c-03269e7449ee tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:03.595467 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34be0801-ada1-4f61-ba9c-03269e7449ee tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.257293 Mar 12 20:50:03.595988 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 452/756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:03 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:03.608940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-032dda6c-d28a-493b-93b5-38071bc67ce9 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] Calling method '.version_select at 0x7f6e376fa670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:03.631137 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-032dda6c-d28a-493b-93b5-38071bc67ce9 tempest-KeyPairsV2TestJSON-749812055 tempest-KeyPairsV2TestJSON-749812055-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1529088099" status: 202 len: 0 microversion: 2.1 time: 0.028044 Mar 12 20:50:03.632375 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 453/757] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Mar 12 20:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1529088099 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:03.711243 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a16f785a-1c37-4fe0-91ed-bbf8c980f5fa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "POST /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04/action" status: 202 len: 0 microversion: 2.1 time: 0.408409 Mar 12 20:50:03.712531 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 305/758] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:50:03 2022] POST /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 12 20:50:03.722406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb4d8817-1a82-453e-8906-838d719923d5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e3731a5e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:03.792989 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ff8606be-3a17-4fd0-b7e4-47f96d468fda tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:03.797051 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ff8606be-3a17-4fd0-b7e4-47f96d468fda tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:03.810049 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb4d8817-1a82-453e-8906-838d719923d5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.091897 Mar 12 20:50:03.813364 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 454/759] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:03 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:03.814407 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ff8606be-3a17-4fd0-b7e4-47f96d468fda tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:03.815529 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ff8606be-3a17-4fd0-b7e4-47f96d468fda tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:03.816528 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ff8606be-3a17-4fd0-b7e4-47f96d468fda tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:03.817033 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ff8606be-3a17-4fd0-b7e4-47f96d468fda tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:03.899521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8edc38db-653d-43c8-97ed-2f2a3ae917b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:03.901444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8edc38db-653d-43c8-97ed-2f2a3ae917b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:03.919705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8edc38db-653d-43c8-97ed-2f2a3ae917b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:03.920424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8edc38db-653d-43c8-97ed-2f2a3ae917b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:03.922974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8edc38db-653d-43c8-97ed-2f2a3ae917b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:03.923593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8edc38db-653d-43c8-97ed-2f2a3ae917b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:04.121112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8edc38db-653d-43c8-97ed-2f2a3ae917b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:04.134028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8edc38db-653d-43c8-97ed-2f2a3ae917b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:04.136388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8edc38db-653d-43c8-97ed-2f2a3ae917b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:04.143923 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8edc38db-653d-43c8-97ed-2f2a3ae917b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1417 microversion: 2.75 time: 0.248993 Mar 12 20:50:04.145445 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 455/760] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:03 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1417 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:04.154054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee33cd9c-adf3-43f6-960b-d36ba90fb959 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:04.155010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee33cd9c-adf3-43f6-960b-d36ba90fb959 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:04.164749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee33cd9c-adf3-43f6-960b-d36ba90fb959 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:04.165479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee33cd9c-adf3-43f6-960b-d36ba90fb959 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:04.166648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee33cd9c-adf3-43f6-960b-d36ba90fb959 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:04.167268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee33cd9c-adf3-43f6-960b-d36ba90fb959 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:04.365582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee33cd9c-adf3-43f6-960b-d36ba90fb959 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:04.374368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee33cd9c-adf3-43f6-960b-d36ba90fb959 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:04.376017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee33cd9c-adf3-43f6-960b-d36ba90fb959 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:04.377328 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee33cd9c-adf3-43f6-960b-d36ba90fb959 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1361 microversion: 2.25 time: 0.230370 Mar 12 20:50:04.378233 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 456/761] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:04 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:04.382841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7aa9444-7f0f-4c83-be17-f3da09c43f89 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:04.383453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7aa9444-7f0f-4c83-be17-f3da09c43f89 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:04.390949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7aa9444-7f0f-4c83-be17-f3da09c43f89 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:04.391147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7aa9444-7f0f-4c83-be17-f3da09c43f89 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:04.391916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7aa9444-7f0f-4c83-be17-f3da09c43f89 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:04.392440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7aa9444-7f0f-4c83-be17-f3da09c43f89 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:04.546579 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ff8606be-3a17-4fd0-b7e4-47f96d468fda tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:04.557090 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ff8606be-3a17-4fd0-b7e4-47f96d468fda tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.774110 Mar 12 20:50:04.558217 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 306/762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:03 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:04.610900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c7aa9444-7f0f-4c83-be17-f3da09c43f89 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:04.613492 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a34023c2-c922-47b8-ae24-e4e5136c471c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:04.614534 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a34023c2-c922-47b8-ae24-e4e5136c471c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:04.621708 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7aa9444-7f0f-4c83-be17-f3da09c43f89 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1504 microversion: 2.1 time: 0.242531 Mar 12 20:50:04.623070 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 457/763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:04 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:04.634250 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a34023c2-c922-47b8-ae24-e4e5136c471c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:04.634712 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a34023c2-c922-47b8-ae24-e4e5136c471c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:04.635503 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a34023c2-c922-47b8-ae24-e4e5136c471c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:04.635950 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a34023c2-c922-47b8-ae24-e4e5136c471c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:04.827621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-399dbd57-1cb3-4f62-8cb9-d0586298eb3b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e37170a60>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:04.878487 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-399dbd57-1cb3-4f62-8cb9-d0586298eb3b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.054716 Mar 12 20:50:04.879462 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 458/764] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:04 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:04.903370 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a34023c2-c922-47b8-ae24-e4e5136c471c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:04.920357 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a34023c2-c922-47b8-ae24-e4e5136c471c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.311714 Mar 12 20:50:04.921674 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 307/765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:04 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:05.164366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-659fcc10-29a3-4743-bd29-5761d0020372 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:05.164980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-659fcc10-29a3-4743-bd29-5761d0020372 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:05.171043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-659fcc10-29a3-4743-bd29-5761d0020372 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:05.171531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-659fcc10-29a3-4743-bd29-5761d0020372 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:05.172251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-659fcc10-29a3-4743-bd29-5761d0020372 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:05.172696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-659fcc10-29a3-4743-bd29-5761d0020372 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:05.246739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-659fcc10-29a3-4743-bd29-5761d0020372 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:05.257437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-659fcc10-29a3-4743-bd29-5761d0020372 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:05.259095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-659fcc10-29a3-4743-bd29-5761d0020372 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:05.263987 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-659fcc10-29a3-4743-bd29-5761d0020372 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1417 microversion: 2.75 time: 0.103550 Mar 12 20:50:05.264739 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 459/766] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:05 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1417 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:05.288585 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-7ec5511a-22fe-46bb-a22b-c0af49d11891 req-ec336992-2f67-474e-999a-a7857b860129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f7f5155-9258-4c32-894e-ef4ffcc25a28", "tag": "5c2b07b8-3063-4abf-8d95-04a1b3c25a29"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:05.296914 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-7ec5511a-22fe-46bb-a22b-c0af49d11891 req-ec336992-2f67-474e-999a-a7857b860129 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:05.297360 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-7ec5511a-22fe-46bb-a22b-c0af49d11891 req-ec336992-2f67-474e-999a-a7857b860129 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:05.395926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ac53690c-4dd4-4d04-923a-9b86a673d18a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:05.396655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ac53690c-4dd4-4d04-923a-9b86a673d18a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:05.402879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac53690c-4dd4-4d04-923a-9b86a673d18a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:05.403421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac53690c-4dd4-4d04-923a-9b86a673d18a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:05.404281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac53690c-4dd4-4d04-923a-9b86a673d18a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:05.404788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac53690c-4dd4-4d04-923a-9b86a673d18a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:05.473267 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-7ec5511a-22fe-46bb-a22b-c0af49d11891 req-ec336992-2f67-474e-999a-a7857b860129 service nova] Creating event network-changed:5c2b07b8-3063-4abf-8d95-04a1b3c25a29 for instance 1f7f5155-9258-4c32-894e-ef4ffcc25a28 on nch1-master-1 Mar 12 20:50:05.479229 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-7ec5511a-22fe-46bb-a22b-c0af49d11891 req-ec336992-2f67-474e-999a-a7857b860129 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194138 Mar 12 20:50:05.479922 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 308/767] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:05.576862 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5b9b5611-683d-46b3-a501-4fe905f909c2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:05.578430 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5b9b5611-683d-46b3-a501-4fe905f909c2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:05.585657 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5b9b5611-683d-46b3-a501-4fe905f909c2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:05.586553 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5b9b5611-683d-46b3-a501-4fe905f909c2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:05.588334 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5b9b5611-683d-46b3-a501-4fe905f909c2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:05.590124 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5b9b5611-683d-46b3-a501-4fe905f909c2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:05.596511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ac53690c-4dd4-4d04-923a-9b86a673d18a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:05.606711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ac53690c-4dd4-4d04-923a-9b86a673d18a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:05.608737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ac53690c-4dd4-4d04-923a-9b86a673d18a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:05.611200 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ac53690c-4dd4-4d04-923a-9b86a673d18a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1361 microversion: 2.25 time: 0.219296 Mar 12 20:50:05.626311 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 460/768] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:05 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:05.639266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-849e0607-6391-4ffa-bba9-9cc66728fa3a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:05.639888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-849e0607-6391-4ffa-bba9-9cc66728fa3a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:05.648367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-849e0607-6391-4ffa-bba9-9cc66728fa3a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:05.649317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-849e0607-6391-4ffa-bba9-9cc66728fa3a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:05.650303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-849e0607-6391-4ffa-bba9-9cc66728fa3a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:05.651134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-849e0607-6391-4ffa-bba9-9cc66728fa3a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:05.872432 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5b9b5611-683d-46b3-a501-4fe905f909c2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:05.884929 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5b9b5611-683d-46b3-a501-4fe905f909c2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.313424 Mar 12 20:50:05.899614 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 309/769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:05 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:05.914135 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d5ded760-9dc8-47d4-843c-ffb0a6a1ee63 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e371ce280>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:05.915234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-849e0607-6391-4ffa-bba9-9cc66728fa3a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:05.923806 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-849e0607-6391-4ffa-bba9-9cc66728fa3a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1504 microversion: 2.1 time: 0.288023 Mar 12 20:50:05.923982 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 461/770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:05 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:05.938446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2afca357-5ae3-405b-8dab-7f172d89ef9b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:05.939128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2afca357-5ae3-405b-8dab-7f172d89ef9b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:05.945879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2afca357-5ae3-405b-8dab-7f172d89ef9b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:05.946918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2afca357-5ae3-405b-8dab-7f172d89ef9b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:05.949933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2afca357-5ae3-405b-8dab-7f172d89ef9b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:05.950648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2afca357-5ae3-405b-8dab-7f172d89ef9b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:05.963018 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d5ded760-9dc8-47d4-843c-ffb0a6a1ee63 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.061905 Mar 12 20:50:05.963897 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 310/771] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:05 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:06.096140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2afca357-5ae3-405b-8dab-7f172d89ef9b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:06.104377 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2afca357-5ae3-405b-8dab-7f172d89ef9b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.169994 Mar 12 20:50:06.104944 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 462/772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:05 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:06.283573 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-87fe9c85-d5c7-48c9-8702-be743c1ad308 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:06.284175 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-87fe9c85-d5c7-48c9-8702-be743c1ad308 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:06.290087 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-87fe9c85-d5c7-48c9-8702-be743c1ad308 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:06.290570 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-87fe9c85-d5c7-48c9-8702-be743c1ad308 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:06.291335 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-87fe9c85-d5c7-48c9-8702-be743c1ad308 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:06.292056 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-87fe9c85-d5c7-48c9-8702-be743c1ad308 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:06.442382 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-87fe9c85-d5c7-48c9-8702-be743c1ad308 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:06.454365 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-87fe9c85-d5c7-48c9-8702-be743c1ad308 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:06.456340 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-87fe9c85-d5c7-48c9-8702-be743c1ad308 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:06.473673 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-87fe9c85-d5c7-48c9-8702-be743c1ad308 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1417 microversion: 2.75 time: 0.193979 Mar 12 20:50:06.474745 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 311/773] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:06 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1417 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:06.636659 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4c0dd726-25f1-464a-a246-9f794c7121a7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:06.637442 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4c0dd726-25f1-464a-a246-9f794c7121a7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:06.645057 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4c0dd726-25f1-464a-a246-9f794c7121a7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:06.645759 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4c0dd726-25f1-464a-a246-9f794c7121a7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:06.646959 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4c0dd726-25f1-464a-a246-9f794c7121a7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:06.648320 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4c0dd726-25f1-464a-a246-9f794c7121a7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:06.789358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5f751502-e339-4604-af47-029c924d137f tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e441a3af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1620661382", "description": "tempest-description-1366140186"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:06.817541 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4c0dd726-25f1-464a-a246-9f794c7121a7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:06.828897 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4c0dd726-25f1-464a-a246-9f794c7121a7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:06.830955 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4c0dd726-25f1-464a-a246-9f794c7121a7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:06.834590 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4c0dd726-25f1-464a-a246-9f794c7121a7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1361 microversion: 2.25 time: 0.205057 Mar 12 20:50:06.835163 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 312/774] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:06 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:06.905135 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-94e612eb-f311-49f0-8a39-9b359410e3b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:06.905763 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-94e612eb-f311-49f0-8a39-9b359410e3b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:06.912919 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-94e612eb-f311-49f0-8a39-9b359410e3b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:06.914053 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-94e612eb-f311-49f0-8a39-9b359410e3b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:06.914939 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-94e612eb-f311-49f0-8a39-9b359410e3b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:06.915492 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-94e612eb-f311-49f0-8a39-9b359410e3b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:06.932521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5f751502-e339-4604-af47-029c924d137f tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.336356 Mar 12 20:50:06.933131 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 463/775] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:50:06 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:06.946542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-92f6b8cd-3264-4c68-92cd-7c3b812ea8c7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:06.947220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-92f6b8cd-3264-4c68-92cd-7c3b812ea8c7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:06.956186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92f6b8cd-3264-4c68-92cd-7c3b812ea8c7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:06.956659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92f6b8cd-3264-4c68-92cd-7c3b812ea8c7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:06.957469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92f6b8cd-3264-4c68-92cd-7c3b812ea8c7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:06.957964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92f6b8cd-3264-4c68-92cd-7c3b812ea8c7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:07.085151 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-94e612eb-f311-49f0-8a39-9b359410e3b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:07.094325 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-94e612eb-f311-49f0-8a39-9b359410e3b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.193095 Mar 12 20:50:07.105466 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 313/776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:06 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:07.115370 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e72214de-414c-488a-b1be-7f89c1ee703d tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e3743b1f0>, body: {"security_group_rule": {"parent_group_id": "504e3aad-1b9d-461e-911e-a6f928682499", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:07.382740 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e72214de-414c-488a-b1be-7f89c1ee703d tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.275471 Mar 12 20:50:07.383427 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 314/777] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:07 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:07.390477 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9d96961d-59c4-4193-a5ed-a48f30667b60 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e37387280>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:07.415580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-92f6b8cd-3264-4c68-92cd-7c3b812ea8c7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:07.423578 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-92f6b8cd-3264-4c68-92cd-7c3b812ea8c7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1504 microversion: 2.1 time: 0.487143 Mar 12 20:50:07.425193 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 464/778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:06 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1504 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:07.430404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9623e73-ca17-42a4-98ed-74845458070a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:07.433905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9623e73-ca17-42a4-98ed-74845458070a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:07.447867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9623e73-ca17-42a4-98ed-74845458070a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:07.448336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9623e73-ca17-42a4-98ed-74845458070a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:07.449143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9623e73-ca17-42a4-98ed-74845458070a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:07.449592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9623e73-ca17-42a4-98ed-74845458070a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:07.450426 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9d96961d-59c4-4193-a5ed-a48f30667b60 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.065297 Mar 12 20:50:07.451654 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 315/779] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:07 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:07.456794 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-05060f7b-20be-4684-92d3-e87f696234f2 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e374bd790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1177016808", "description": "tempest-description-1542486715"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:07.654470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f9623e73-ca17-42a4-98ed-74845458070a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:07.673873 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9623e73-ca17-42a4-98ed-74845458070a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.247305 Mar 12 20:50:07.674827 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 465/780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:07 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:07.680548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c519066-21cc-4a53-8667-d6d8d958dc47 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:07.685637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2c519066-21cc-4a53-8667-d6d8d958dc47 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:07.693417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c519066-21cc-4a53-8667-d6d8d958dc47 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:07.694195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c519066-21cc-4a53-8667-d6d8d958dc47 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:07.695195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c519066-21cc-4a53-8667-d6d8d958dc47 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:07.695877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c519066-21cc-4a53-8667-d6d8d958dc47 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:07.773715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c519066-21cc-4a53-8667-d6d8d958dc47 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:07.780530 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-05060f7b-20be-4684-92d3-e87f696234f2 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.327653 Mar 12 20:50:07.781877 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 316/781] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:50:07 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:07.783988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c519066-21cc-4a53-8667-d6d8d958dc47 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:07.786245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c519066-21cc-4a53-8667-d6d8d958dc47 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:07.796673 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c519066-21cc-4a53-8667-d6d8d958dc47 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1438 microversion: 2.75 time: 0.119300 Mar 12 20:50:07.798038 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 466/782] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:07 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1438 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:07.801383 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ecf9c5f7-8c82-4f6a-94a8-b8760d63b74e tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e3743b5e0>, body: {"security_group_rule": {"parent_group_id": "85d8f888-25b0-4935-84fb-174454afed1c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:07.817337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:07.819497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:07.828598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:07.829136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:07.830012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:07.830516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:07.951704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:50:07.952556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:50:07.953304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:50:07.954708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:50:07.955501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:50:08.090526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:08.102743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:08.108911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:08.110341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:08.110969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:08.222681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:08.234447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:08.240756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:08.268637 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0a3bf4a1-ee3f-44dd-9164-32f88d9fae86 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "POST /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e/action" status: 202 len: 1495 microversion: 2.75 time: 0.454739 Mar 12 20:50:08.270312 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 467/783] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 20:50:07 2022] POST /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e/action => generated 1495 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 12 20:50:08.278095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56826079-9489-447d-807e-7fe774c7a219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:08.279508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-56826079-9489-447d-807e-7fe774c7a219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:08.289333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56826079-9489-447d-807e-7fe774c7a219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:08.289821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56826079-9489-447d-807e-7fe774c7a219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:08.290716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56826079-9489-447d-807e-7fe774c7a219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:08.291314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56826079-9489-447d-807e-7fe774c7a219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:08.530044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-56826079-9489-447d-807e-7fe774c7a219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:08.541449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-56826079-9489-447d-807e-7fe774c7a219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:08.544132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-56826079-9489-447d-807e-7fe774c7a219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:08.545556 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56826079-9489-447d-807e-7fe774c7a219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1361 microversion: 2.25 time: 0.273329 Mar 12 20:50:08.546739 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 468/784] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:08 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:08.561746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a4f4de2e-2c4b-431e-9842-4b5811c57a8b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:08.562774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a4f4de2e-2c4b-431e-9842-4b5811c57a8b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:08.574619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4f4de2e-2c4b-431e-9842-4b5811c57a8b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:08.590143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4f4de2e-2c4b-431e-9842-4b5811c57a8b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:08.594034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4f4de2e-2c4b-431e-9842-4b5811c57a8b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:08.595355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4f4de2e-2c4b-431e-9842-4b5811c57a8b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:08.644395 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ecf9c5f7-8c82-4f6a-94a8-b8760d63b74e tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.855276 Mar 12 20:50:08.646265 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 317/785] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:07 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:08.655178 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e5e40d75-bdc7-478e-871f-ba28b49c607d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:08.656982 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e5e40d75-bdc7-478e-871f-ba28b49c607d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:08.664211 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e5e40d75-bdc7-478e-871f-ba28b49c607d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:08.665008 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e5e40d75-bdc7-478e-871f-ba28b49c607d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:08.666120 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e5e40d75-bdc7-478e-871f-ba28b49c607d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:08.666627 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e5e40d75-bdc7-478e-871f-ba28b49c607d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:08.808668 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e5e40d75-bdc7-478e-871f-ba28b49c607d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:08.825948 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e5e40d75-bdc7-478e-871f-ba28b49c607d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:08.835382 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e5e40d75-bdc7-478e-871f-ba28b49c607d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:08.841235 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e5e40d75-bdc7-478e-871f-ba28b49c607d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.193242 Mar 12 20:50:08.842155 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 318/786] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:08 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:08.874314 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9baabe66-f8d2-4cc0-a8f4-39a2045fbf1f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:08.875243 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9baabe66-f8d2-4cc0-a8f4-39a2045fbf1f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:08.883752 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9baabe66-f8d2-4cc0-a8f4-39a2045fbf1f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:08.884540 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9baabe66-f8d2-4cc0-a8f4-39a2045fbf1f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:08.886688 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9baabe66-f8d2-4cc0-a8f4-39a2045fbf1f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:08.887432 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9baabe66-f8d2-4cc0-a8f4-39a2045fbf1f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:08.898880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a4f4de2e-2c4b-431e-9842-4b5811c57a8b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:08.908290 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a4f4de2e-2c4b-431e-9842-4b5811c57a8b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.360139 Mar 12 20:50:08.919277 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 469/787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:08 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:08.927493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca0c212b-b8ae-471f-82ad-aea020a5cb2c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e3713e8b0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:08.991741 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca0c212b-b8ae-471f-82ad-aea020a5cb2c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.070071 Mar 12 20:50:08.993384 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 470/788] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:08 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:09.000437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3cf5d03a-2f9a-420f-86ad-dd5d17ccf1b2 req-05fc2b46-07b3-4da2-804a-c7cc29198b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b3b4cce-d19a-479c-adcf-03afc06cf8e0", "name": "network-vif-plugged", "status": "completed", "tag": "70b96b8e-4df3-42a1-a05b-4818b836f46f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:09.009261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3cf5d03a-2f9a-420f-86ad-dd5d17ccf1b2 req-05fc2b46-07b3-4da2-804a-c7cc29198b61 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:09.009921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3cf5d03a-2f9a-420f-86ad-dd5d17ccf1b2 req-05fc2b46-07b3-4da2-804a-c7cc29198b61 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:09.024319 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3cf5d03a-2f9a-420f-86ad-dd5d17ccf1b2 req-05fc2b46-07b3-4da2-804a-c7cc29198b61 service nova] Creating event network-vif-plugged:70b96b8e-4df3-42a1-a05b-4818b836f46f for instance 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 on nch2-master-1 Mar 12 20:50:09.029197 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3cf5d03a-2f9a-420f-86ad-dd5d17ccf1b2 req-05fc2b46-07b3-4da2-804a-c7cc29198b61 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034545 Mar 12 20:50:09.029963 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 471/789] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:09.038135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-df3ab464-21fc-473b-99e9-296d30aa293a tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e371708b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-674411776", "description": "tempest-description-1162076372"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:09.215786 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9baabe66-f8d2-4cc0-a8f4-39a2045fbf1f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:09.228273 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9baabe66-f8d2-4cc0-a8f4-39a2045fbf1f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1504 microversion: 2.1 time: 0.359486 Mar 12 20:50:09.239479 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 319/790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:08 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:09.242043 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3f89f4a6-b786-4bca-a49f-c84b4ea0f39a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:09.246578 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3f89f4a6-b786-4bca-a49f-c84b4ea0f39a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:09.262795 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-df3ab464-21fc-473b-99e9-296d30aa293a tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.231605 Mar 12 20:50:09.263639 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 472/791] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:50:09 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:09.275253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-150d9719-1319-477e-acf5-bad653dbba49 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e3716ff70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-945758", "description": "tempest-description-1752201662"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:09.282062 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3f89f4a6-b786-4bca-a49f-c84b4ea0f39a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:09.282697 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3f89f4a6-b786-4bca-a49f-c84b4ea0f39a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:09.284963 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3f89f4a6-b786-4bca-a49f-c84b4ea0f39a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:09.285374 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3f89f4a6-b786-4bca-a49f-c84b4ea0f39a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:09.531774 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-150d9719-1319-477e-acf5-bad653dbba49 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.260972 Mar 12 20:50:09.532452 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 473/792] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:50:09 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:09.543376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cff48f6b-b54b-4dc3-a645-9f6603a30d69 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e3716f1f0>, body: {"security_group_rule": {"parent_group_id": "51ea37ec-ea4f-4b38-b53e-b791ce881dbe", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "53c73231-212d-48fb-927a-00607f1f8ed4"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:09.901348 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cff48f6b-b54b-4dc3-a645-9f6603a30d69 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 327 microversion: 2.1 time: 0.361718 Mar 12 20:50:09.902922 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 474/793] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:09 2022] POST /compute/v2.1/os-security-group-rules => generated 327 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:09.908864 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3f89f4a6-b786-4bca-a49f-c84b4ea0f39a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:09.917424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d9d6c87-7531-4a84-855d-525fe2424c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:09.918101 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3f89f4a6-b786-4bca-a49f-c84b4ea0f39a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.685167 Mar 12 20:50:09.918609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2d9d6c87-7531-4a84-855d-525fe2424c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:09.921312 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 320/794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:09 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:09.931017 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-eb9c0ef9-03b1-454c-8233-9361f5cef073 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:09.933380 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-eb9c0ef9-03b1-454c-8233-9361f5cef073 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:09.935499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d9d6c87-7531-4a84-855d-525fe2424c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:09.936475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d9d6c87-7531-4a84-855d-525fe2424c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:09.937791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d9d6c87-7531-4a84-855d-525fe2424c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:09.938257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d9d6c87-7531-4a84-855d-525fe2424c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:09.946877 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-eb9c0ef9-03b1-454c-8233-9361f5cef073 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:09.947601 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-eb9c0ef9-03b1-454c-8233-9361f5cef073 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:09.949812 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-eb9c0ef9-03b1-454c-8233-9361f5cef073 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:09.955896 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-eb9c0ef9-03b1-454c-8233-9361f5cef073 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:10.090631 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-eb9c0ef9-03b1-454c-8233-9361f5cef073 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:10.100660 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-eb9c0ef9-03b1-454c-8233-9361f5cef073 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:10.107316 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-eb9c0ef9-03b1-454c-8233-9361f5cef073 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:10.120522 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-eb9c0ef9-03b1-454c-8233-9361f5cef073 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.197901 Mar 12 20:50:10.125697 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 321/795] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:09 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:10.137664 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a53282ac-192f-4413-bc9e-6784bddd478e tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e3742baf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1101535166", "description": "tempest-description-1835977531"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:10.276446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2d9d6c87-7531-4a84-855d-525fe2424c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:10.285684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2d9d6c87-7531-4a84-855d-525fe2424c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:10.292987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2d9d6c87-7531-4a84-855d-525fe2424c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:10.298774 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d9d6c87-7531-4a84-855d-525fe2424c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1361 microversion: 2.25 time: 0.388673 Mar 12 20:50:10.300133 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 475/796] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:09 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1361 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:10.316477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3e859c25-9127-4579-94ee-1e315956ad6c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:10.318057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3e859c25-9127-4579-94ee-1e315956ad6c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:10.324788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e859c25-9127-4579-94ee-1e315956ad6c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:10.325334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e859c25-9127-4579-94ee-1e315956ad6c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:10.326251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e859c25-9127-4579-94ee-1e315956ad6c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:10.326768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e859c25-9127-4579-94ee-1e315956ad6c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:10.513019 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a53282ac-192f-4413-bc9e-6784bddd478e tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.385860 Mar 12 20:50:10.513897 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 322/797] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:50:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:10.524407 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-98be65be-6d0e-4f2d-848b-4811d3bf56d9 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e377cbc10>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:10.580240 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-98be65be-6d0e-4f2d-848b-4811d3bf56d9 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.062868 Mar 12 20:50:10.587917 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 323/798] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:10 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:10.594828 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4106b239-19e2-43c4-941e-ae6d0035c8cc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:10.595573 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4106b239-19e2-43c4-941e-ae6d0035c8cc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:10.603714 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4106b239-19e2-43c4-941e-ae6d0035c8cc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:10.604437 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4106b239-19e2-43c4-941e-ae6d0035c8cc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:10.605508 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4106b239-19e2-43c4-941e-ae6d0035c8cc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:10.606223 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4106b239-19e2-43c4-941e-ae6d0035c8cc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:10.675586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3e859c25-9127-4579-94ee-1e315956ad6c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:10.686085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3e859c25-9127-4579-94ee-1e315956ad6c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.383094 Mar 12 20:50:10.697753 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 476/799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:10 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:10.703865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7b37f54-6688-41fd-b29d-8a1f430ff972 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e3716f670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1180521547", "description": "tempest-description-287393853"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:10.835111 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4106b239-19e2-43c4-941e-ae6d0035c8cc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:10.847782 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4106b239-19e2-43c4-941e-ae6d0035c8cc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1504 microversion: 2.1 time: 0.257209 Mar 12 20:50:10.849815 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 324/800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:10 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:10.900248 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7b37f54-6688-41fd-b29d-8a1f430ff972 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.200947 Mar 12 20:50:10.900884 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 477/801] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:50:10 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:10.914189 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9d11eea2-f3e2-4cdd-b891-7dc0ff368577 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e3743ff70>, body: {"security_group_rule": {"parent_group_id": "c7c23243-f191-43ad-820d-d1a277800b06", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c51b1262-d34e-4519-8863-3995ec77188a"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:10.936372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-712d7a57-6cdf-41fc-8ff6-4d0f95bd1625 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:10.937573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-712d7a57-6cdf-41fc-8ff6-4d0f95bd1625 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:10.946735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-712d7a57-6cdf-41fc-8ff6-4d0f95bd1625 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:10.947207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-712d7a57-6cdf-41fc-8ff6-4d0f95bd1625 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:10.947992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-712d7a57-6cdf-41fc-8ff6-4d0f95bd1625 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:10.948435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-712d7a57-6cdf-41fc-8ff6-4d0f95bd1625 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:11.143017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-712d7a57-6cdf-41fc-8ff6-4d0f95bd1625 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:11.155865 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-712d7a57-6cdf-41fc-8ff6-4d0f95bd1625 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.223537 Mar 12 20:50:11.156793 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 478/802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:10 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:11.167239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b8c7a413-9bb3-4746-9700-35f09a698b49 req-06e69e65-3072-4703-9545-620b9403d27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378f100b-bc86-4e26-8462-2b6ab20b1e04", "name": "network-vif-plugged", "status": "completed", "tag": "bc5ebba0-ee77-4f1a-8fd8-11584ea45c51"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:11.178705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b8c7a413-9bb3-4746-9700-35f09a698b49 req-06e69e65-3072-4703-9545-620b9403d27a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:11.179444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b8c7a413-9bb3-4746-9700-35f09a698b49 req-06e69e65-3072-4703-9545-620b9403d27a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:11.193267 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b8c7a413-9bb3-4746-9700-35f09a698b49 req-06e69e65-3072-4703-9545-620b9403d27a service nova] Creating event network-vif-plugged:bc5ebba0-ee77-4f1a-8fd8-11584ea45c51 for instance 378f100b-bc86-4e26-8462-2b6ab20b1e04 on nch2-master-1 Mar 12 20:50:11.199204 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b8c7a413-9bb3-4746-9700-35f09a698b49 req-06e69e65-3072-4703-9545-620b9403d27a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035533 Mar 12 20:50:11.200058 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 479/803] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:11.206235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-10e96d77-8f4f-4c61-9855-f5b4731fc11b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:11.207120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-10e96d77-8f4f-4c61-9855-f5b4731fc11b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:11.214102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10e96d77-8f4f-4c61-9855-f5b4731fc11b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:11.214561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10e96d77-8f4f-4c61-9855-f5b4731fc11b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:11.215400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10e96d77-8f4f-4c61-9855-f5b4731fc11b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:11.215847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10e96d77-8f4f-4c61-9855-f5b4731fc11b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:11.285660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-10e96d77-8f4f-4c61-9855-f5b4731fc11b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:11.296841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-10e96d77-8f4f-4c61-9855-f5b4731fc11b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:11.300034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-10e96d77-8f4f-4c61-9855-f5b4731fc11b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:11.305964 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-10e96d77-8f4f-4c61-9855-f5b4731fc11b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.104420 Mar 12 20:50:11.307169 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 480/804] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:11 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:11.319213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f5091ac-f15b-4978-8d00-53a08204c9cb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:11.319882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f5091ac-f15b-4978-8d00-53a08204c9cb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:11.323977 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9d11eea2-f3e2-4cdd-b891-7dc0ff368577 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.415830 Mar 12 20:50:11.324998 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 325/805] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:10 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:11.327777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f5091ac-f15b-4978-8d00-53a08204c9cb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:11.328606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f5091ac-f15b-4978-8d00-53a08204c9cb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:11.329489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f5091ac-f15b-4978-8d00-53a08204c9cb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:11.330062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f5091ac-f15b-4978-8d00-53a08204c9cb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:11.335787 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2d12cb72-ace0-4276-abd3-c9ccd611e357 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Calling method '.version_select at 0x7f6e376bb9d0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:11.526276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f5091ac-f15b-4978-8d00-53a08204c9cb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:11.534952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f5091ac-f15b-4978-8d00-53a08204c9cb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:11.536529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f5091ac-f15b-4978-8d00-53a08204c9cb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:11.537742 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f5091ac-f15b-4978-8d00-53a08204c9cb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1556 microversion: 2.25 time: 0.223381 Mar 12 20:50:11.539354 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 481/806] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:11 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1556 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:11.562923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b903de0a-60ef-4170-97ae-adc45acb643c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:11.563787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b903de0a-60ef-4170-97ae-adc45acb643c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:11.572053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b903de0a-60ef-4170-97ae-adc45acb643c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:11.572511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b903de0a-60ef-4170-97ae-adc45acb643c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:11.573392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b903de0a-60ef-4170-97ae-adc45acb643c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:11.574047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b903de0a-60ef-4170-97ae-adc45acb643c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:11.754257 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2d12cb72-ace0-4276-abd3-c9ccd611e357 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c51b1262-d34e-4519-8863-3995ec77188a" status: 202 len: 0 microversion: 2.1 time: 0.422739 Mar 12 20:50:11.754860 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 326/807] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:11 2022] DELETE /compute/v2.1/os-security-groups/c51b1262-d34e-4519-8863-3995ec77188a => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 20:50:11.778686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-b903de0a-60ef-4170-97ae-adc45acb643c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:11.780500 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5904e637-2dc5-43e4-90e7-e87a4c671570 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e3724a310>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:11.793327 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b903de0a-60ef-4170-97ae-adc45acb643c tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 2048 microversion: 2.25 time: 0.235053 Mar 12 20:50:11.797600 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 482/808] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:11 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 2048 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:11.803028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9e300e74-6d72-4feb-ae1f-3647b8cb6cb8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:11.804773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9e300e74-6d72-4feb-ae1f-3647b8cb6cb8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:11.811257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e300e74-6d72-4feb-ae1f-3647b8cb6cb8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:11.811727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e300e74-6d72-4feb-ae1f-3647b8cb6cb8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:11.812553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e300e74-6d72-4feb-ae1f-3647b8cb6cb8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:11.812957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e300e74-6d72-4feb-ae1f-3647b8cb6cb8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:11.860506 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5904e637-2dc5-43e4-90e7-e87a4c671570 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.103333 Mar 12 20:50:11.865985 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 327/809] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:11 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:11.871983 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9254c78a-9f5f-4262-9cb1-ee55c085a4d3 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Calling method '.version_select at 0x7f6e3748c820>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:11.953311 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9254c78a-9f5f-4262-9cb1-ee55c085a4d3 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/c7c23243-f191-43ad-820d-d1a277800b06" status: 200 len: 248 microversion: 2.1 time: 0.085400 Mar 12 20:50:11.954090 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 328/810] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 20:50:11 2022] GET /compute/v2.1/os-security-groups/c7c23243-f191-43ad-820d-d1a277800b06 => generated 248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:11.959487 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-6f06abe3-1674-42fa-9728-38fa75f6bee4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:11.963781 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:50:11.963781 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:50:11.965361 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6f06abe3-1674-42fa-9728-38fa75f6bee4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:11.965866 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6f06abe3-1674-42fa-9728-38fa75f6bee4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:11.966688 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6f06abe3-1674-42fa-9728-38fa75f6bee4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:11.967132 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6f06abe3-1674-42fa-9728-38fa75f6bee4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:11.994360 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-6f06abe3-1674-42fa-9728-38fa75f6bee4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.038777 Mar 12 20:50:11.995027 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 329/811] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Mar 12 20:50:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:50:11.999970 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-df5027aa-cd5d-4f59-bcac-fae2c32ce28c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:12.001135 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-df5027aa-cd5d-4f59-bcac-fae2c32ce28c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:12.010849 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-df5027aa-cd5d-4f59-bcac-fae2c32ce28c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:12.011652 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-df5027aa-cd5d-4f59-bcac-fae2c32ce28c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:12.012605 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-df5027aa-cd5d-4f59-bcac-fae2c32ce28c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:12.013048 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-df5027aa-cd5d-4f59-bcac-fae2c32ce28c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:12.042914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9e300e74-6d72-4feb-ae1f-3647b8cb6cb8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:12.056243 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9e300e74-6d72-4feb-ae1f-3647b8cb6cb8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.257320 Mar 12 20:50:12.066700 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 483/812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:11 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:12.080111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f184f74b-4ce5-47a8-ae31-26b95f3e59e2 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e3731a670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-603210602", "description": "tempest-description-1135736504"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:12.240527 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-df5027aa-cd5d-4f59-bcac-fae2c32ce28c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:12.248859 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-df5027aa-cd5d-4f59-bcac-fae2c32ce28c tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1479 microversion: 2.1 time: 0.252814 Mar 12 20:50:12.253698 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 330/813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:11 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1479 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:12.264658 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4944e03f-8d96-4bcb-a4ac-c8d52df1e560 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:12.265360 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4944e03f-8d96-4bcb-a4ac-c8d52df1e560 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:12.280841 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4944e03f-8d96-4bcb-a4ac-c8d52df1e560 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:12.281873 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4944e03f-8d96-4bcb-a4ac-c8d52df1e560 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:12.283834 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4944e03f-8d96-4bcb-a4ac-c8d52df1e560 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:12.284303 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4944e03f-8d96-4bcb-a4ac-c8d52df1e560 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:12.325857 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f184f74b-4ce5-47a8-ae31-26b95f3e59e2 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.257201 Mar 12 20:50:12.327071 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 484/814] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:50:12 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:12.336574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1a61da15-9e02-46e5-a675-068f65a91b74 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '.version_select at 0x7f6e3725e5e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:12.339197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a61da15-9e02-46e5-a675-068f65a91b74 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:12.339656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a61da15-9e02-46e5-a675-068f65a91b74 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:12.362908 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1a61da15-9e02-46e5-a675-068f65a91b74 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.1 time: 0.029619 Mar 12 20:50:12.363905 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 485/815] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 20:50:12 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:12.372076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9065f06f-fc2c-48db-aa42-9ea429e9187c tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:12.372465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9065f06f-fc2c-48db-aa42-9ea429e9187c tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:12.379239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9065f06f-fc2c-48db-aa42-9ea429e9187c tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:12.379781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9065f06f-fc2c-48db-aa42-9ea429e9187c tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:12.381114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9065f06f-fc2c-48db-aa42-9ea429e9187c tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:12.381549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9065f06f-fc2c-48db-aa42-9ea429e9187c tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:12.465399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9065f06f-fc2c-48db-aa42-9ea429e9187c tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:12.474561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9065f06f-fc2c-48db-aa42-9ea429e9187c tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:12.476090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9065f06f-fc2c-48db-aa42-9ea429e9187c tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:12.481579 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9065f06f-fc2c-48db-aa42-9ea429e9187c tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.115729 Mar 12 20:50:12.482133 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 486/816] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:12 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:12.486654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd8c30bf-c980-490f-bc5d-6e1df5c73750 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e3713e670>, body: {"security_group_rule": {"parent_group_id": "4712b759-0527-4959-bb98-70f1fc8fef12", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:12.542809 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4944e03f-8d96-4bcb-a4ac-c8d52df1e560 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:12.556592 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4944e03f-8d96-4bcb-a4ac-c8d52df1e560 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.299267 Mar 12 20:50:12.557369 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 331/817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:12 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:12.562309 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-10920854-50de-42d4-9915-aff982dc477a tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:12.562926 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-10920854-50de-42d4-9915-aff982dc477a tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:12.570055 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10920854-50de-42d4-9915-aff982dc477a tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:12.571280 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10920854-50de-42d4-9915-aff982dc477a tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:12.572087 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10920854-50de-42d4-9915-aff982dc477a tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:12.572672 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10920854-50de-42d4-9915-aff982dc477a tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:12.766318 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-10920854-50de-42d4-9915-aff982dc477a tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1630 microversion: 2.1 time: 0.207321 Mar 12 20:50:12.767087 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 332/818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:12 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1630 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:12.873153 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-31681891-63c2-478d-81d6-83e098f5f350 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e377dddc0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:12.892484 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd8c30bf-c980-490f-bc5d-6e1df5c73750 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.409112 Mar 12 20:50:12.898115 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 487/819] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:12 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:12.903748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7ec8d421-2a0f-43c1-b8aa-d3bf4ef1514a tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Action: 'create', calling method: .version_select at 0x7f6e3708a5e0>, body: {"security_group_rule": {"parent_group_id": "4712b759-0527-4959-bb98-70f1fc8fef12", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:12.945810 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-31681891-63c2-478d-81d6-83e098f5f350 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.076789 Mar 12 20:50:12.946668 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 333/820] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:12 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:12.966897 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-996789756", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "4b8a32df-ad87-496b-8291-8d1bc2a20fb0"}]}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:13.031773 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.neutron [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] validate_networks() for [('4b8a32df-ad87-496b-8291-8d1bc2a20fb0', None, None, None, None, None)] {{(pid=136303) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:50:13.164454 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7ec8d421-2a0f-43c1-b8aa-d3bf4ef1514a tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.264650 Mar 12 20:50:13.165078 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 488/821] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:12 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:13.172037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-caa20852-e158-4c7d-b7d5-e209d91daae8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:13.173466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-caa20852-e158-4c7d-b7d5-e209d91daae8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:13.194822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caa20852-e158-4c7d-b7d5-e209d91daae8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:13.195570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caa20852-e158-4c7d-b7d5-e209d91daae8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:13.197057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caa20852-e158-4c7d-b7d5-e209d91daae8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:13.197759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caa20852-e158-4c7d-b7d5-e209d91daae8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:13.406590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-caa20852-e158-4c7d-b7d5-e209d91daae8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:13.415945 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-caa20852-e158-4c7d-b7d5-e209d91daae8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.248749 Mar 12 20:50:13.426536 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 489/822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:13 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:13.431603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04ded6fd-cd54-4e41-81d3-043f39293636 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Calling method '.version_select at 0x7f6e3731a5e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:13.501491 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04ded6fd-cd54-4e41-81d3-043f39293636 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/4712b759-0527-4959-bb98-70f1fc8fef12" status: 200 len: 664 microversion: 2.1 time: 0.073425 Mar 12 20:50:13.502878 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 490/823] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 20:50:13 2022] GET /compute/v2.1/os-security-groups/4712b759-0527-4959-bb98-70f1fc8fef12 => generated 664 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:13.507469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-146eafb9-fe2b-445a-b1ed-1a1ef6260c7e req-de7d91d0-039a-4036-a645-b1cc65399d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7f5155-9258-4c32-894e-ef4ffcc25a28", "name": "network-vif-plugged", "status": "completed", "tag": "5c2b07b8-3063-4abf-8d95-04a1b3c25a29"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:13.517523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-146eafb9-fe2b-445a-b1ed-1a1ef6260c7e req-de7d91d0-039a-4036-a645-b1cc65399d0a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:13.518019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-146eafb9-fe2b-445a-b1ed-1a1ef6260c7e req-de7d91d0-039a-4036-a645-b1cc65399d0a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:13.531657 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-146eafb9-fe2b-445a-b1ed-1a1ef6260c7e req-de7d91d0-039a-4036-a645-b1cc65399d0a service nova] Creating event network-vif-plugged:5c2b07b8-3063-4abf-8d95-04a1b3c25a29 for instance 1f7f5155-9258-4c32-894e-ef4ffcc25a28 on nch1-master-1 Mar 12 20:50:13.538084 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-146eafb9-fe2b-445a-b1ed-1a1ef6260c7e req-de7d91d0-039a-4036-a645-b1cc65399d0a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033199 Mar 12 20:50:13.538715 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 491/824] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:13.546475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aef9e77b-828a-4cb8-9dd0-e0850e79d238 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:13.549419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aef9e77b-828a-4cb8-9dd0-e0850e79d238 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:13.572080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aef9e77b-828a-4cb8-9dd0-e0850e79d238 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:13.573455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aef9e77b-828a-4cb8-9dd0-e0850e79d238 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:13.575567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aef9e77b-828a-4cb8-9dd0-e0850e79d238 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:13.576256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aef9e77b-828a-4cb8-9dd0-e0850e79d238 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:13.595692 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:50:13.596118 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:50:13.596595 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:50:13.597030 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:50:13.597442 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:50:13.623833 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:13.624296 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:13.625122 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:13.629313 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:13.658594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aef9e77b-828a-4cb8-9dd0-e0850e79d238 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:13.670664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aef9e77b-828a-4cb8-9dd0-e0850e79d238 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:13.672568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aef9e77b-828a-4cb8-9dd0-e0850e79d238 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:13.680115 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aef9e77b-828a-4cb8-9dd0-e0850e79d238 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.140186 Mar 12 20:50:13.692236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 492/825] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:13 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:13.692236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dad7c206-c880-4103-99f9-7b9dc424fe8c tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Calling method '.version_select at 0x7f6e3725eca0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:13.701703 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Getting quotas for project c248ec2e2f0c457291cd412812c08e5a. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:13.712934 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Getting quotas for user a7854cfb82544a70aee1a7d421bfce55 and project c248ec2e2f0c457291cd412812c08e5a. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:13.733703 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Going to run 1 instances... {{(pid=136303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:50:13.736193 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:50:13.800623 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-358cb3fb-51b4-45cb-afe9-272fe0a7dc22 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839877 Mar 12 20:50:13.801676 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 334/826] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:50:13.812209 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-aab7009f-75e4-4fd9-a649-ec0cabc99965 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:13.813394 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-aab7009f-75e4-4fd9-a649-ec0cabc99965 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:13.839107 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aab7009f-75e4-4fd9-a649-ec0cabc99965 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:13.839845 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aab7009f-75e4-4fd9-a649-ec0cabc99965 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:13.840887 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aab7009f-75e4-4fd9-a649-ec0cabc99965 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:13.842193 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aab7009f-75e4-4fd9-a649-ec0cabc99965 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:13.953427 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dad7c206-c880-4103-99f9-7b9dc424fe8c tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/88a0baa5-9a9f-441e-a61e-7728df4a9ae4" status: 202 len: 0 microversion: 2.1 time: 0.271235 Mar 12 20:50:13.954771 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 493/827] 10.222.0.30 () {58 vars in 1286 bytes} [Sat Mar 12 20:50:13 2022] DELETE /compute/v2.1/os-security-group-rules/88a0baa5-9a9f-441e-a61e-7728df4a9ae4 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:13.976748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d2a15e8-c1de-4a7a-862e-ee443b8e2e27 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:13.980006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d2a15e8-c1de-4a7a-862e-ee443b8e2e27 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:14.059498 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-aab7009f-75e4-4fd9-a649-ec0cabc99965 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:14.071298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d2a15e8-c1de-4a7a-862e-ee443b8e2e27 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:14.076979 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-aab7009f-75e4-4fd9-a649-ec0cabc99965 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.268961 Mar 12 20:50:14.078754 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 335/828] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:13 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:14.087069 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8cc1fcb2-2670-4c78-b31b-8582d5681050 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e374bd790>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:14.090067 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d2a15e8-c1de-4a7a-862e-ee443b8e2e27 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1210 microversion: 2.1 time: 0.133059 Mar 12 20:50:14.090786 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 494/829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:13 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1210 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:14.100949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14ab6974-089c-4956-8984-bfabc9bc2a3a tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Calling method '.version_select at 0x7f6e37093700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:14.153562 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8cc1fcb2-2670-4c78-b31b-8582d5681050 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.073103 Mar 12 20:50:14.154791 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 336/830] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:14 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:14.162052 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-cf01a733-e890-4caa-8950-da0ceac73bbc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef287d20-f6d2-4dff-bb11-f7a93fffa821", "device": "/dev/xvdb"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:14.163925 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-cf01a733-e890-4caa-8950-da0ceac73bbc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:14.171136 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cf01a733-e890-4caa-8950-da0ceac73bbc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:14.171894 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cf01a733-e890-4caa-8950-da0ceac73bbc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:14.172756 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cf01a733-e890-4caa-8950-da0ceac73bbc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:14.173382 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cf01a733-e890-4caa-8950-da0ceac73bbc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:14.437911 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14ab6974-089c-4956-8984-bfabc9bc2a3a tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/4712b759-0527-4959-bb98-70f1fc8fef12" status: 202 len: 0 microversion: 2.1 time: 0.345699 Mar 12 20:50:14.439038 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 495/831] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:14 2022] DELETE /compute/v2.1/os-security-groups/4712b759-0527-4959-bb98-70f1fc8fef12 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:14.451031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-df6e4a57-2238-4b2b-8326-91215915f6df tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:14.451705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-df6e4a57-2238-4b2b-8326-91215915f6df tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:14.469016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df6e4a57-2238-4b2b-8326-91215915f6df tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:14.470914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df6e4a57-2238-4b2b-8326-91215915f6df tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:14.472895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df6e4a57-2238-4b2b-8326-91215915f6df tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:14.475720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df6e4a57-2238-4b2b-8326-91215915f6df tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:14.592417 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-cf01a733-e890-4caa-8950-da0ceac73bbc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "POST /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.434897 Mar 12 20:50:14.593159 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 337/832] 10.222.0.30 () {62 vars in 1363 bytes} [Sat Mar 12 20:50:14 2022] POST /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:50:14.602210 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c3dcab69-31a8-4fa5-ab9b-de6fbdb057d0 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Calling method '.version_select at 0x7f6e371848b0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:14.631710 ncdv-master-1 devstack@n-api.service[136303]: DEBUG neutronclient.v2_0.client [None req-c3dcab69-31a8-4fa5-ab9b-de6fbdb057d0 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c51b1262-d34e-4519-8863-3995ec77188a does not exist", "detail": ""}} {{(pid=136303) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:50:14.632822 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.security_group_api [None req-c3dcab69-31a8-4fa5-ab9b-de6fbdb057d0 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Neutron security group c51b1262-d34e-4519-8863-3995ec77188a not found {{(pid=136303) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:50:14.634082 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-c3dcab69-31a8-4fa5-ab9b-de6fbdb057d0 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] HTTP exception thrown: Security group c51b1262-d34e-4519-8863-3995ec77188a does not exist Mar 12 20:50:14.634082 ncdv-master-1 devstack@n-api.service[136303]: Neutron server returns request_ids: ['req-5d756774-c325-490d-8dcd-193273b7661f'] Mar 12 20:50:14.634995 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c3dcab69-31a8-4fa5-ab9b-de6fbdb057d0 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Returning 404 to user: Security group c51b1262-d34e-4519-8863-3995ec77188a does not exist Mar 12 20:50:14.634995 ncdv-master-1 devstack@n-api.service[136303]: Neutron server returns request_ids: ['req-5d756774-c325-490d-8dcd-193273b7661f'] {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:14.636570 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c3dcab69-31a8-4fa5-ab9b-de6fbdb057d0 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c51b1262-d34e-4519-8863-3995ec77188a" status: 404 len: 194 microversion: 2.1 time: 0.042007 Mar 12 20:50:14.638058 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 338/833] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:14 2022] DELETE /compute/v2.1/os-security-groups/c51b1262-d34e-4519-8863-3995ec77188a => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:50:14.647702 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fd69a638-5d81-45a8-98ac-685ebb2c84da tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Calling method '.version_select at 0x7f6e376bb3a0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:14.728578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-df6e4a57-2238-4b2b-8326-91215915f6df tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:14.740872 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-df6e4a57-2238-4b2b-8326-91215915f6df tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.300732 Mar 12 20:50:14.741843 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 496/834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:14 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:14.755318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86981398-a344-4b72-a37c-c4bb6d35f646 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:14.756219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86981398-a344-4b72-a37c-c4bb6d35f646 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:14.762793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86981398-a344-4b72-a37c-c4bb6d35f646 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:14.763464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86981398-a344-4b72-a37c-c4bb6d35f646 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:14.764253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86981398-a344-4b72-a37c-c4bb6d35f646 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:14.764695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86981398-a344-4b72-a37c-c4bb6d35f646 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:14.877114 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fd69a638-5d81-45a8-98ac-685ebb2c84da tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c7c23243-f191-43ad-820d-d1a277800b06" status: 202 len: 0 microversion: 2.1 time: 0.235445 Mar 12 20:50:14.877754 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 339/835] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:14 2022] DELETE /compute/v2.1/os-security-groups/c7c23243-f191-43ad-820d-d1a277800b06 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:14.887060 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9f742ffd-3524-4b68-a91f-c825bff34cd2 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Calling method '.version_select at 0x7f6e371843a0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:14.915243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86981398-a344-4b72-a37c-c4bb6d35f646 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:14.942776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86981398-a344-4b72-a37c-c4bb6d35f646 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:14.945541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86981398-a344-4b72-a37c-c4bb6d35f646 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:14.953452 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86981398-a344-4b72-a37c-c4bb6d35f646 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.210177 Mar 12 20:50:14.954606 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 497/836] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:14 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:15.095744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2a76de08-b94d-4fb1-9478-42b5e2834c7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:15.096467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2a76de08-b94d-4fb1-9478-42b5e2834c7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:15.105849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a76de08-b94d-4fb1-9478-42b5e2834c7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:15.106660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a76de08-b94d-4fb1-9478-42b5e2834c7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:15.107674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a76de08-b94d-4fb1-9478-42b5e2834c7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:15.108334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a76de08-b94d-4fb1-9478-42b5e2834c7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:15.137154 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9f742ffd-3524-4b68-a91f-c825bff34cd2 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/53c73231-212d-48fb-927a-00607f1f8ed4" status: 202 len: 0 microversion: 2.1 time: 0.254361 Mar 12 20:50:15.137935 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 340/837] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:14 2022] DELETE /compute/v2.1/os-security-groups/53c73231-212d-48fb-927a-00607f1f8ed4 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:15.143038 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-59f04256-3618-4251-a7d2-aa11e787ec69 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:15.144496 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-59f04256-3618-4251-a7d2-aa11e787ec69 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:15.168035 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-59f04256-3618-4251-a7d2-aa11e787ec69 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:15.168507 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-59f04256-3618-4251-a7d2-aa11e787ec69 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:15.169311 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-59f04256-3618-4251-a7d2-aa11e787ec69 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:15.170957 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-59f04256-3618-4251-a7d2-aa11e787ec69 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:15.264058 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-59f04256-3618-4251-a7d2-aa11e787ec69 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:15.272848 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-59f04256-3618-4251-a7d2-aa11e787ec69 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1262 microversion: 2.1 time: 0.133871 Mar 12 20:50:15.274010 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 341/838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:15 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1262 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:15.278830 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5be08cdf-69ec-4d71-821b-0813d9c27bed tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Calling method '.version_select at 0x7f6e3742b040>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:15.328301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2a76de08-b94d-4fb1-9478-42b5e2834c7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:15.338727 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2a76de08-b94d-4fb1-9478-42b5e2834c7f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.246959 Mar 12 20:50:15.340057 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 498/839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:15 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:15.352595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-54cec1ad-59a2-4534-b8fb-fea8583641ad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e3731a8b0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:15.440794 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-54cec1ad-59a2-4534-b8fb-fea8583641ad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.099190 Mar 12 20:50:15.441433 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 499/840] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:15 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:15.781050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96727bd4-5e38-4219-b5ea-f9032eb16652 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:15.781664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96727bd4-5e38-4219-b5ea-f9032eb16652 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:15.788193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96727bd4-5e38-4219-b5ea-f9032eb16652 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:15.788647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96727bd4-5e38-4219-b5ea-f9032eb16652 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:15.789423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96727bd4-5e38-4219-b5ea-f9032eb16652 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:15.789892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96727bd4-5e38-4219-b5ea-f9032eb16652 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:16.002490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96727bd4-5e38-4219-b5ea-f9032eb16652 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:16.010364 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5be08cdf-69ec-4d71-821b-0813d9c27bed tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/51ea37ec-ea4f-4b38-b53e-b791ce881dbe" status: 202 len: 0 microversion: 2.1 time: 0.735125 Mar 12 20:50:16.013728 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 342/841] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:15 2022] DELETE /compute/v2.1/os-security-groups/51ea37ec-ea4f-4b38-b53e-b791ce881dbe => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:16.016784 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96727bd4-5e38-4219-b5ea-f9032eb16652 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.261914 Mar 12 20:50:16.017015 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4fb7eb66-5541-42f0-82cc-4b98a847c47a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:16.017630 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4fb7eb66-5541-42f0-82cc-4b98a847c47a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:16.018385 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 500/842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:15 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:16.024111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c577946d-c8db-4477-a675-3bb024e08e9f tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Calling method '.version_select at 0x7f6e37093af0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:16.034988 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4fb7eb66-5541-42f0-82cc-4b98a847c47a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:16.035454 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4fb7eb66-5541-42f0-82cc-4b98a847c47a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:16.042700 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4fb7eb66-5541-42f0-82cc-4b98a847c47a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:16.043308 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4fb7eb66-5541-42f0-82cc-4b98a847c47a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:16.212855 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4fb7eb66-5541-42f0-82cc-4b98a847c47a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:16.228275 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4fb7eb66-5541-42f0-82cc-4b98a847c47a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:16.230384 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4fb7eb66-5541-42f0-82cc-4b98a847c47a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:16.237115 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4fb7eb66-5541-42f0-82cc-4b98a847c47a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.223631 Mar 12 20:50:16.250196 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 343/843] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:16 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:16.292073 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-02402707-2e50-44f4-a6ed-b2e6217b8469 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:16.292692 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-02402707-2e50-44f4-a6ed-b2e6217b8469 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:16.295951 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c577946d-c8db-4477-a675-3bb024e08e9f tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/85d8f888-25b0-4935-84fb-174454afed1c" status: 202 len: 0 microversion: 2.1 time: 0.276317 Mar 12 20:50:16.296548 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 501/844] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:16 2022] DELETE /compute/v2.1/os-security-groups/85d8f888-25b0-4935-84fb-174454afed1c => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:16.305369 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-02402707-2e50-44f4-a6ed-b2e6217b8469 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:16.306159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-10bd2c12-8111-4930-af26-79d72df91487 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] Calling method '.version_select at 0x7f6e3708a700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:16.319021 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-02402707-2e50-44f4-a6ed-b2e6217b8469 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:16.320305 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-02402707-2e50-44f4-a6ed-b2e6217b8469 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:16.323040 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-02402707-2e50-44f4-a6ed-b2e6217b8469 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:16.443275 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-02402707-2e50-44f4-a6ed-b2e6217b8469 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:16.452280 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-02402707-2e50-44f4-a6ed-b2e6217b8469 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1268 microversion: 2.1 time: 0.163947 Mar 12 20:50:16.456019 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 344/845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:16 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:16.469993 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-10388bcd-dbe8-40c3-98e2-2ab2e296dfb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:16.470628 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-10388bcd-dbe8-40c3-98e2-2ab2e296dfb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:16.480075 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10388bcd-dbe8-40c3-98e2-2ab2e296dfb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:16.483471 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10388bcd-dbe8-40c3-98e2-2ab2e296dfb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:16.488870 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10388bcd-dbe8-40c3-98e2-2ab2e296dfb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:16.489451 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10388bcd-dbe8-40c3-98e2-2ab2e296dfb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:16.599128 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-10bd2c12-8111-4930-af26-79d72df91487 tempest-SecurityGroupRulesTestJSON-1862994901 tempest-SecurityGroupRulesTestJSON-1862994901-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/504e3aad-1b9d-461e-911e-a6f928682499" status: 202 len: 0 microversion: 2.1 time: 0.298254 Mar 12 20:50:16.604364 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 502/846] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:16 2022] DELETE /compute/v2.1/os-security-groups/504e3aad-1b9d-461e-911e-a6f928682499 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:16.606260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-584eae5b-8bb8-4283-9f69-475fefc08f1a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e37170dc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:16.707606 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-584eae5b-8bb8-4283-9f69-475fefc08f1a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.104987 Mar 12 20:50:16.714462 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 503/847] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:16 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:16.924586 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-10388bcd-dbe8-40c3-98e2-2ab2e296dfb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:16.941832 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-10388bcd-dbe8-40c3-98e2-2ab2e296dfb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.483883 Mar 12 20:50:16.955272 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 345/848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:16 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:17.035949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a0fd3d23-2c6d-464e-83b1-3d50afcad7f9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:17.036576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a0fd3d23-2c6d-464e-83b1-3d50afcad7f9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:17.057268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0fd3d23-2c6d-464e-83b1-3d50afcad7f9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:17.057638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0fd3d23-2c6d-464e-83b1-3d50afcad7f9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:17.058482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0fd3d23-2c6d-464e-83b1-3d50afcad7f9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:17.058937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0fd3d23-2c6d-464e-83b1-3d50afcad7f9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:17.240392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a0fd3d23-2c6d-464e-83b1-3d50afcad7f9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:17.255887 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a0fd3d23-2c6d-464e-83b1-3d50afcad7f9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.223251 Mar 12 20:50:17.257269 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 504/849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:17 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:17.257763 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9beeea7d-7365-4c09-8094-eb199db884c9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:17.258460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9beeea7d-7365-4c09-8094-eb199db884c9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:17.283561 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9beeea7d-7365-4c09-8094-eb199db884c9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:17.284055 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9beeea7d-7365-4c09-8094-eb199db884c9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:17.284864 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9beeea7d-7365-4c09-8094-eb199db884c9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:17.286895 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9beeea7d-7365-4c09-8094-eb199db884c9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:17.419952 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9beeea7d-7365-4c09-8094-eb199db884c9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:17.429477 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9beeea7d-7365-4c09-8094-eb199db884c9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:17.437166 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9beeea7d-7365-4c09-8094-eb199db884c9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:17.447040 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9beeea7d-7365-4c09-8094-eb199db884c9 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.194163 Mar 12 20:50:17.464800 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 346/850] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:17 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:17.470014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59b4f8f5-92c5-4ff1-a6c2-c71915214f7a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:17.470638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59b4f8f5-92c5-4ff1-a6c2-c71915214f7a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:17.482665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59b4f8f5-92c5-4ff1-a6c2-c71915214f7a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:17.483218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59b4f8f5-92c5-4ff1-a6c2-c71915214f7a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:17.483964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59b4f8f5-92c5-4ff1-a6c2-c71915214f7a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:17.484832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59b4f8f5-92c5-4ff1-a6c2-c71915214f7a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:17.734412 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e5f25c6a-5079-4c13-8fb2-98a4b2c23134 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e371984c0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:17.820186 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e5f25c6a-5079-4c13-8fb2-98a4b2c23134 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.103594 Mar 12 20:50:17.821159 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 347/851] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:17 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:17.910523 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7bcf0efb-981b-4ffc-8d6c-44a7b622e884 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:17.911186 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7bcf0efb-981b-4ffc-8d6c-44a7b622e884 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:17.921906 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7bcf0efb-981b-4ffc-8d6c-44a7b622e884 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:17.922655 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7bcf0efb-981b-4ffc-8d6c-44a7b622e884 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:17.924442 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7bcf0efb-981b-4ffc-8d6c-44a7b622e884 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:17.926704 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7bcf0efb-981b-4ffc-8d6c-44a7b622e884 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:17.997278 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7bcf0efb-981b-4ffc-8d6c-44a7b622e884 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:50:18.001233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-59b4f8f5-92c5-4ff1-a6c2-c71915214f7a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:18.014045 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59b4f8f5-92c5-4ff1-a6c2-c71915214f7a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1310 microversion: 2.1 time: 0.546251 Mar 12 20:50:18.032520 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 505/852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:17 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1310 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:18.042270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21cb6015-915c-4e3a-b2a8-a51c2bce421f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:18.057293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-21cb6015-915c-4e3a-b2a8-a51c2bce421f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:18.077718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21cb6015-915c-4e3a-b2a8-a51c2bce421f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:18.079231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21cb6015-915c-4e3a-b2a8-a51c2bce421f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:18.080266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21cb6015-915c-4e3a-b2a8-a51c2bce421f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:18.081318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21cb6015-915c-4e3a-b2a8-a51c2bce421f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:18.169191 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7bcf0efb-981b-4ffc-8d6c-44a7b622e884 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 204 len: 0 microversion: 2.1 time: 0.262761 Mar 12 20:50:18.170056 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 348/853] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:50:17 2022] DELETE /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:50:18.177327 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-0ad9e6a8-2922-4f14-affc-11bd1590e243 req-0b05366f-b898-4672-8ae8-7cf314c9f83f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e40005ee-4cc8-49d8-a826-236d4aad98a0", "tag": "fee78365-562c-495b-80e2-d01504c255bf"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:18.199942 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-0ad9e6a8-2922-4f14-affc-11bd1590e243 req-0b05366f-b898-4672-8ae8-7cf314c9f83f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:18.200403 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-0ad9e6a8-2922-4f14-affc-11bd1590e243 req-0b05366f-b898-4672-8ae8-7cf314c9f83f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:18.219070 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-0ad9e6a8-2922-4f14-affc-11bd1590e243 req-0b05366f-b898-4672-8ae8-7cf314c9f83f service nova] Creating event network-changed:fee78365-562c-495b-80e2-d01504c255bf for instance e40005ee-4cc8-49d8-a826-236d4aad98a0 on nch2-master-1 Mar 12 20:50:18.224839 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-0ad9e6a8-2922-4f14-affc-11bd1590e243 req-0b05366f-b898-4672-8ae8-7cf314c9f83f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053011 Mar 12 20:50:18.225830 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 349/854] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:18.273756 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7bf7c6fb-38cb-4879-9ca6-584af1dfcab8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:18.275505 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7bf7c6fb-38cb-4879-9ca6-584af1dfcab8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:18.294080 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7bf7c6fb-38cb-4879-9ca6-584af1dfcab8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:18.294850 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7bf7c6fb-38cb-4879-9ca6-584af1dfcab8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:18.295885 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7bf7c6fb-38cb-4879-9ca6-584af1dfcab8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:18.296565 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7bf7c6fb-38cb-4879-9ca6-584af1dfcab8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:18.318922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21cb6015-915c-4e3a-b2a8-a51c2bce421f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:18.334457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21cb6015-915c-4e3a-b2a8-a51c2bce421f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.298508 Mar 12 20:50:18.335034 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 506/855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:18 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:18.340017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1951767864", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "377171495", "adminPass": "***", "networks": [{"uuid": "6d81997f-04c7-4abe-983f-03c84afabe15"}], "security_groups": [{"name": "tempest-securitygroup--1402957834"}], "key_name": "tempest-keypair-1383205792", "user_data": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:18.501490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] validate_networks() for [('6d81997f-04c7-4abe-983f-03c84afabe15', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:50:18.996120 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7bf7c6fb-38cb-4879-9ca6-584af1dfcab8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:19.003501 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7bf7c6fb-38cb-4879-9ca6-584af1dfcab8 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.734754 Mar 12 20:50:19.007586 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 350/856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:18 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:19.012259 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5574b3a5-85cf-428c-a3d2-10fab0eec56b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:19.012871 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5574b3a5-85cf-428c-a3d2-10fab0eec56b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:19.014588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:50:19.016156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:50:19.016801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:50:19.017361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:50:19.017955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:50:19.029583 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5574b3a5-85cf-428c-a3d2-10fab0eec56b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:19.030136 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5574b3a5-85cf-428c-a3d2-10fab0eec56b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:19.031028 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5574b3a5-85cf-428c-a3d2-10fab0eec56b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:19.031702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:19.031841 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5574b3a5-85cf-428c-a3d2-10fab0eec56b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:19.032421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:19.034275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:19.034904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:19.084644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Getting quotas for project 2f8c425aaac144c2aa98af4365bf84a6. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:19.094787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Getting quotas for user df10426ae3e14b428a1a7dc944867ce2 and project 2f8c425aaac144c2aa98af4365bf84a6. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:19.117627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:50:19.121188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:50:19.178396 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5574b3a5-85cf-428c-a3d2-10fab0eec56b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:19.182977 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a211cbfb-4bde-45d4-a022-32f855b1a025 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.846833 Mar 12 20:50:19.189046 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 507/857] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:50:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:50:19.195671 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5574b3a5-85cf-428c-a3d2-10fab0eec56b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:19.196781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b57c4e3-1a56-4400-ae18-b235a431bdaa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e376fa670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:19.197470 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5574b3a5-85cf-428c-a3d2-10fab0eec56b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:19.213022 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5574b3a5-85cf-428c-a3d2-10fab0eec56b tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.204434 Mar 12 20:50:19.215572 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 351/858] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:19 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:19.250246 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-6d563f34-3b13-4a1d-a548-868142249a76 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:19.252531 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-6d563f34-3b13-4a1d-a548-868142249a76 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:19.265412 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6d563f34-3b13-4a1d-a548-868142249a76 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:19.265908 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6d563f34-3b13-4a1d-a548-868142249a76 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:19.267004 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6d563f34-3b13-4a1d-a548-868142249a76 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:19.267698 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6d563f34-3b13-4a1d-a548-868142249a76 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:19.289175 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b57c4e3-1a56-4400-ae18-b235a431bdaa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.099447 Mar 12 20:50:19.291632 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 508/859] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:19 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:19.310400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-347b6ae1-ee15-4fb7-8129-c4e42a51f522 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:19.311030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-347b6ae1-ee15-4fb7-8129-c4e42a51f522 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:19.448585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-347b6ae1-ee15-4fb7-8129-c4e42a51f522 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:19.457516 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-347b6ae1-ee15-4fb7-8129-c4e42a51f522 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1263 microversion: 2.1 time: 0.162602 Mar 12 20:50:19.458751 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 509/860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:19 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:19.467278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee9d87eb-a512-4f2a-8706-b79a7bc3c7cf tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:19.470767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee9d87eb-a512-4f2a-8706-b79a7bc3c7cf tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:19.489914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee9d87eb-a512-4f2a-8706-b79a7bc3c7cf tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:19.490397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee9d87eb-a512-4f2a-8706-b79a7bc3c7cf tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:19.491214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee9d87eb-a512-4f2a-8706-b79a7bc3c7cf tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:19.491668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee9d87eb-a512-4f2a-8706-b79a7bc3c7cf tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:19.757590 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-6d563f34-3b13-4a1d-a548-868142249a76 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:19.761440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee9d87eb-a512-4f2a-8706-b79a7bc3c7cf tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:19.770661 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-6d563f34-3b13-4a1d-a548-868142249a76 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1310 microversion: 2.1 time: 0.529934 Mar 12 20:50:19.771251 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 352/861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:19 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1310 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:19.772563 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee9d87eb-a512-4f2a-8706-b79a7bc3c7cf tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.312753 Mar 12 20:50:19.782811 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 510/862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:19 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:20.021167 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3230b402-3e5f-4d67-99c3-c88c5262e227 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:20.021984 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3230b402-3e5f-4d67-99c3-c88c5262e227 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:20.029288 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3230b402-3e5f-4d67-99c3-c88c5262e227 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:20.032569 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3230b402-3e5f-4d67-99c3-c88c5262e227 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:20.034724 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3230b402-3e5f-4d67-99c3-c88c5262e227 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:20.035531 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3230b402-3e5f-4d67-99c3-c88c5262e227 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:20.234473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d34061b4-9da6-4c77-97f7-2ddce514a2f7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:20.235673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d34061b4-9da6-4c77-97f7-2ddce514a2f7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:20.245419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d34061b4-9da6-4c77-97f7-2ddce514a2f7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:20.249193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d34061b4-9da6-4c77-97f7-2ddce514a2f7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:20.252167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d34061b4-9da6-4c77-97f7-2ddce514a2f7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:20.252883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d34061b4-9da6-4c77-97f7-2ddce514a2f7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:20.288543 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3230b402-3e5f-4d67-99c3-c88c5262e227 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:20.301230 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3230b402-3e5f-4d67-99c3-c88c5262e227 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.284196 Mar 12 20:50:20.310503 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 353/863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:20 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:20.325226 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-730f58ca-3d9c-4b41-9d44-7aa4523bf9cc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e37148dc0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:20.412167 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-730f58ca-3d9c-4b41-9d44-7aa4523bf9cc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.091345 Mar 12 20:50:20.413902 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 354/864] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:20 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:20.420085 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9032cab7-b359-4cde-abd6-fe42780317e1 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:20.421037 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9032cab7-b359-4cde-abd6-fe42780317e1 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:20.428908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d34061b4-9da6-4c77-97f7-2ddce514a2f7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:20.434057 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9032cab7-b359-4cde-abd6-fe42780317e1 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:20.434870 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9032cab7-b359-4cde-abd6-fe42780317e1 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:20.435963 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9032cab7-b359-4cde-abd6-fe42780317e1 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:20.436544 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9032cab7-b359-4cde-abd6-fe42780317e1 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:20.444281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d34061b4-9da6-4c77-97f7-2ddce514a2f7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:20.446370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d34061b4-9da6-4c77-97f7-2ddce514a2f7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:20.455626 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d34061b4-9da6-4c77-97f7-2ddce514a2f7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.224883 Mar 12 20:50:20.456845 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 511/865] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:20 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:20.475431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-386686bc-3efb-45e7-91df-7e09c73984e3 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:20.476070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-386686bc-3efb-45e7-91df-7e09c73984e3 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:20.485540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-386686bc-3efb-45e7-91df-7e09c73984e3 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:20.486058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-386686bc-3efb-45e7-91df-7e09c73984e3 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:20.487130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-386686bc-3efb-45e7-91df-7e09c73984e3 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:20.487588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-386686bc-3efb-45e7-91df-7e09c73984e3 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:20.592266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-386686bc-3efb-45e7-91df-7e09c73984e3 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:20.605659 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-386686bc-3efb-45e7-91df-7e09c73984e3 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1315 microversion: 2.1 time: 0.133508 Mar 12 20:50:20.612902 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 512/866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:20 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:20.642224 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-9032cab7-b359-4cde-abd6-fe42780317e1 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:20.659971 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9032cab7-b359-4cde-abd6-fe42780317e1 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 2126 microversion: 2.25 time: 0.243943 Mar 12 20:50:20.661843 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 355/867] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:20 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 2126 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:20.681494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-852b220a-5bd9-4c57-aefb-618d962b39fa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:20.682695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-852b220a-5bd9-4c57-aefb-618d962b39fa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:20.696374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-852b220a-5bd9-4c57-aefb-618d962b39fa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:20.696835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-852b220a-5bd9-4c57-aefb-618d962b39fa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:20.698148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-852b220a-5bd9-4c57-aefb-618d962b39fa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:20.698606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-852b220a-5bd9-4c57-aefb-618d962b39fa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:20.730770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-852b220a-5bd9-4c57-aefb-618d962b39fa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'flavor' on Instance uuid 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:20.750937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-852b220a-5bd9-4c57-aefb-618d962b39fa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Going to try to live migrate instance to nch1-master-1 {{(pid=136302) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 12 20:50:20.788041 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fa5213c1-0fe0-4c70-a3be-e63924306729 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:20.789020 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-fa5213c1-0fe0-4c70-a3be-e63924306729 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:20.803246 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa5213c1-0fe0-4c70-a3be-e63924306729 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:20.806361 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa5213c1-0fe0-4c70-a3be-e63924306729 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:20.810472 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa5213c1-0fe0-4c70-a3be-e63924306729 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:20.814491 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa5213c1-0fe0-4c70-a3be-e63924306729 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:21.288785 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fa5213c1-0fe0-4c70-a3be-e63924306729 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:21.305029 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fa5213c1-0fe0-4c70-a3be-e63924306729 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1310 microversion: 2.1 time: 0.514358 Mar 12 20:50:21.309046 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 356/868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:20 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1310 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:21.328190 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2a890464-2355-4c67-b5be-31934e4880b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:21.334967 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-2a890464-2355-4c67-b5be-31934e4880b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:21.353901 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2a890464-2355-4c67-b5be-31934e4880b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:21.354360 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2a890464-2355-4c67-b5be-31934e4880b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:21.355157 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2a890464-2355-4c67-b5be-31934e4880b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:21.355596 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2a890464-2355-4c67-b5be-31934e4880b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:21.658526 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2a890464-2355-4c67-b5be-31934e4880b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:21.670590 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2a890464-2355-4c67-b5be-31934e4880b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.358951 Mar 12 20:50:21.680933 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 357/869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:21 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:21.686489 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f13e4c99-f8e5-4d5e-8e90-1068d37cdafd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:21.689984 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f13e4c99-f8e5-4d5e-8e90-1068d37cdafd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:21.700956 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f13e4c99-f8e5-4d5e-8e90-1068d37cdafd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:21.701483 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f13e4c99-f8e5-4d5e-8e90-1068d37cdafd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:21.702756 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f13e4c99-f8e5-4d5e-8e90-1068d37cdafd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:21.703399 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f13e4c99-f8e5-4d5e-8e90-1068d37cdafd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:21.989646 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f13e4c99-f8e5-4d5e-8e90-1068d37cdafd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:21.998536 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f13e4c99-f8e5-4d5e-8e90-1068d37cdafd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.316511 Mar 12 20:50:21.999126 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 358/870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:21 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:22.005594 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1e3c88bf-4f61-4776-8f6a-180731388ef4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e371b7f70>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:22.082725 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1e3c88bf-4f61-4776-8f6a-180731388ef4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1412 microversion: 2.1 time: 0.082345 Mar 12 20:50:22.083651 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 359/871] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:21 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:22.088926 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7c674006-6692-4bf3-9b8c-66c29ed8d28e tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:22.089724 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7c674006-6692-4bf3-9b8c-66c29ed8d28e tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:22.096404 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7c674006-6692-4bf3-9b8c-66c29ed8d28e tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:22.097109 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7c674006-6692-4bf3-9b8c-66c29ed8d28e tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:22.099094 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7c674006-6692-4bf3-9b8c-66c29ed8d28e tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:22.099711 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7c674006-6692-4bf3-9b8c-66c29ed8d28e tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:22.204386 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7c674006-6692-4bf3-9b8c-66c29ed8d28e tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:22.244419 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7c674006-6692-4bf3-9b8c-66c29ed8d28e tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:22.247804 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7c674006-6692-4bf3-9b8c-66c29ed8d28e tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:22.259430 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7c674006-6692-4bf3-9b8c-66c29ed8d28e tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.174436 Mar 12 20:50:22.260027 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 360/872] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:22 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:22.265372 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-96acfa0c-eeb0-4a18-a535-edb69b1dab0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:22.266310 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-96acfa0c-eeb0-4a18-a535-edb69b1dab0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:22.275694 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-96acfa0c-eeb0-4a18-a535-edb69b1dab0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:22.276477 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-96acfa0c-eeb0-4a18-a535-edb69b1dab0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:22.277313 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-96acfa0c-eeb0-4a18-a535-edb69b1dab0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:22.277884 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-96acfa0c-eeb0-4a18-a535-edb69b1dab0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:22.496948 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-96acfa0c-eeb0-4a18-a535-edb69b1dab0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:22.504923 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-96acfa0c-eeb0-4a18-a535-edb69b1dab0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1389 microversion: 2.1 time: 0.243744 Mar 12 20:50:22.505693 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 361/873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:22 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1389 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:22.640648 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7bb37a46-007b-4fcd-b302-f87d1c13b44a tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e371913a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1796493628", "description": "tempest-description-625722262"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:22.897427 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7bb37a46-007b-4fcd-b302-f87d1c13b44a tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.390705 Mar 12 20:50:22.898249 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 362/874] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:50:22 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:22.910463 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3cd35554-ce87-4951-88f0-7fe57d7afefc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:22.911075 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3cd35554-ce87-4951-88f0-7fe57d7afefc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:22.919354 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3cd35554-ce87-4951-88f0-7fe57d7afefc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:22.920055 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3cd35554-ce87-4951-88f0-7fe57d7afefc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:22.921543 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3cd35554-ce87-4951-88f0-7fe57d7afefc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:22.922185 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3cd35554-ce87-4951-88f0-7fe57d7afefc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:23.144546 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3cd35554-ce87-4951-88f0-7fe57d7afefc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:23.154294 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3cd35554-ce87-4951-88f0-7fe57d7afefc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1310 microversion: 2.1 time: 0.248723 Mar 12 20:50:23.155011 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 363/875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:22 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1310 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:23.163855 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-bfff0b52-58cb-474f-9248-8b7f477f9ea2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:23.165825 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-bfff0b52-58cb-474f-9248-8b7f477f9ea2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:23.175720 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bfff0b52-58cb-474f-9248-8b7f477f9ea2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:23.176500 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bfff0b52-58cb-474f-9248-8b7f477f9ea2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:23.177603 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bfff0b52-58cb-474f-9248-8b7f477f9ea2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:23.178141 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bfff0b52-58cb-474f-9248-8b7f477f9ea2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:23.444095 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-bfff0b52-58cb-474f-9248-8b7f477f9ea2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:23.453022 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-bfff0b52-58cb-474f-9248-8b7f477f9ea2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.296638 Mar 12 20:50:23.453705 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 364/876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:23 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:23.462058 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7d8c7a7a-5058-447b-82fb-cac1ec0774bc tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e37184f70>, body: {"security_group_rule": {"parent_group_id": "82bdac7a-a643-4fa7-8581-3fcd37bd1919", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:23.786126 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7d8c7a7a-5058-447b-82fb-cac1ec0774bc tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.330680 Mar 12 20:50:23.786862 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 365/877] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:23.794130 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0abaa059-d7cb-4d66-b0f5-24775d5e7e7b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:23.794757 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-0abaa059-d7cb-4d66-b0f5-24775d5e7e7b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:23.801453 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0abaa059-d7cb-4d66-b0f5-24775d5e7e7b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:23.801961 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0abaa059-d7cb-4d66-b0f5-24775d5e7e7b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:23.802763 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0abaa059-d7cb-4d66-b0f5-24775d5e7e7b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:23.803222 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0abaa059-d7cb-4d66-b0f5-24775d5e7e7b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:23.937727 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-0abaa059-d7cb-4d66-b0f5-24775d5e7e7b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:23.946309 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0abaa059-d7cb-4d66-b0f5-24775d5e7e7b tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.157919 Mar 12 20:50:23.946997 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 366/878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:23 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:23.955472 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-63551f64-8309-401b-a589-a988b5f1517e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e371ce550>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:24.000070 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-63551f64-8309-401b-a589-a988b5f1517e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1421 microversion: 2.1 time: 0.051968 Mar 12 20:50:24.000740 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 367/879] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:23 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1421 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:24.005975 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-7796d0fd-a847-4497-93be-e4a60e103fa2 req-eded5b61-9210-490d-a53e-1373e4b26bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa543f4a-cb64-4ec9-9863-2f1fb751ef01", "tag": "b56cfd9b-9a8c-494a-8ad8-518a7d6a9a02"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:24.014133 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-7796d0fd-a847-4497-93be-e4a60e103fa2 req-eded5b61-9210-490d-a53e-1373e4b26bf1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:24.014582 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-7796d0fd-a847-4497-93be-e4a60e103fa2 req-eded5b61-9210-490d-a53e-1373e4b26bf1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:24.025208 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-7796d0fd-a847-4497-93be-e4a60e103fa2 req-eded5b61-9210-490d-a53e-1373e4b26bf1 service nova] Creating event network-changed:b56cfd9b-9a8c-494a-8ad8-518a7d6a9a02 for instance aa543f4a-cb64-4ec9-9863-2f1fb751ef01 on nch2-master-1 Mar 12 20:50:24.030021 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-7796d0fd-a847-4497-93be-e4a60e103fa2 req-eded5b61-9210-490d-a53e-1373e4b26bf1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027905 Mar 12 20:50:24.030810 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 368/880] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:24.035677 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5ebeb433-5221-42ea-9468-b27c72a99c10 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:24.036362 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5ebeb433-5221-42ea-9468-b27c72a99c10 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:24.042505 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5ebeb433-5221-42ea-9468-b27c72a99c10 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:24.042952 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5ebeb433-5221-42ea-9468-b27c72a99c10 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:24.043912 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5ebeb433-5221-42ea-9468-b27c72a99c10 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:24.044506 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5ebeb433-5221-42ea-9468-b27c72a99c10 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:24.124590 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5ebeb433-5221-42ea-9468-b27c72a99c10 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:24.133061 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5ebeb433-5221-42ea-9468-b27c72a99c10 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:24.134608 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5ebeb433-5221-42ea-9468-b27c72a99c10 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:24.139563 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5ebeb433-5221-42ea-9468-b27c72a99c10 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.107802 Mar 12 20:50:24.140326 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 369/881] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:24 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:24.151578 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-37d83a93-dce3-4426-9256-0beaebfd701a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:24.152851 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-37d83a93-dce3-4426-9256-0beaebfd701a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:24.158867 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-37d83a93-dce3-4426-9256-0beaebfd701a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:24.159317 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-37d83a93-dce3-4426-9256-0beaebfd701a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:24.160268 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-37d83a93-dce3-4426-9256-0beaebfd701a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:24.160884 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-37d83a93-dce3-4426-9256-0beaebfd701a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:24.389418 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-37d83a93-dce3-4426-9256-0beaebfd701a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:24.397210 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-37d83a93-dce3-4426-9256-0beaebfd701a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1389 microversion: 2.1 time: 0.251432 Mar 12 20:50:24.397806 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 370/882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:24 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1389 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:24.402248 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0d5c5f72-7bf8-481d-8c4b-ec776f6c3ca6 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e371a1c10>, body: {"security_group_rule": {"parent_group_id": "82bdac7a-a643-4fa7-8581-3fcd37bd1919", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:24.477495 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-0d5c5f72-7bf8-481d-8c4b-ec776f6c3ca6 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] HTTP exception thrown: This rule already exists in group 82bdac7a-a643-4fa7-8581-3fcd37bd1919 Mar 12 20:50:24.478158 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0d5c5f72-7bf8-481d-8c4b-ec776f6c3ca6 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Returning 400 to user: This rule already exists in group 82bdac7a-a643-4fa7-8581-3fcd37bd1919 {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:24.479003 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0d5c5f72-7bf8-481d-8c4b-ec776f6c3ca6 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.080284 Mar 12 20:50:24.479592 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 371/883] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:24 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:50:24.484487 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-898c0597-8805-4843-8cf8-5378ea3d5f9a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e371ce550>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:24.531087 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-898c0597-8805-4843-8cf8-5378ea3d5f9a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 200 len: 1421 microversion: 2.1 time: 0.050230 Mar 12 20:50:24.538571 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 372/884] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:50:24 2022] GET /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 1421 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:24.538571 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-e2e0b5fb-5cf8-42ba-ac9e-f762570036bc req-3681ab75-abd5-497e-82eb-c8bc04cdfd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40005ee-4cc8-49d8-a826-236d4aad98a0", "name": "network-vif-plugged", "status": "completed", "tag": "fee78365-562c-495b-80e2-d01504c255bf"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:24.544601 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-e2e0b5fb-5cf8-42ba-ac9e-f762570036bc req-3681ab75-abd5-497e-82eb-c8bc04cdfd20 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:24.545050 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-e2e0b5fb-5cf8-42ba-ac9e-f762570036bc req-3681ab75-abd5-497e-82eb-c8bc04cdfd20 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:24.555783 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-e2e0b5fb-5cf8-42ba-ac9e-f762570036bc req-3681ab75-abd5-497e-82eb-c8bc04cdfd20 service nova] Creating event network-vif-plugged:fee78365-562c-495b-80e2-d01504c255bf for instance e40005ee-4cc8-49d8-a826-236d4aad98a0 on nch2-master-1 Mar 12 20:50:24.560594 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-e2e0b5fb-5cf8-42ba-ac9e-f762570036bc req-3681ab75-abd5-497e-82eb-c8bc04cdfd20 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027996 Mar 12 20:50:24.561280 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 373/885] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:24.566199 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-384f45e2-97fa-4e4c-bd2b-7c4b061cd79d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:24.566885 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-384f45e2-97fa-4e4c-bd2b-7c4b061cd79d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:24.575176 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-384f45e2-97fa-4e4c-bd2b-7c4b061cd79d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:24.575727 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-384f45e2-97fa-4e4c-bd2b-7c4b061cd79d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:24.576662 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-384f45e2-97fa-4e4c-bd2b-7c4b061cd79d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:24.577112 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-384f45e2-97fa-4e4c-bd2b-7c4b061cd79d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:24.833298 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-384f45e2-97fa-4e4c-bd2b-7c4b061cd79d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:24.840667 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-384f45e2-97fa-4e4c-bd2b-7c4b061cd79d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1310 microversion: 2.1 time: 0.278278 Mar 12 20:50:24.841223 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 374/886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:24 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1310 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:24.845558 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-bcd8483c-9ae7-4270-bddb-9430dc6ca88e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:24.846219 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-bcd8483c-9ae7-4270-bddb-9430dc6ca88e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:24.852175 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bcd8483c-9ae7-4270-bddb-9430dc6ca88e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:24.852630 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bcd8483c-9ae7-4270-bddb-9430dc6ca88e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:24.853397 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bcd8483c-9ae7-4270-bddb-9430dc6ca88e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:24.853862 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bcd8483c-9ae7-4270-bddb-9430dc6ca88e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:24.981909 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-bcd8483c-9ae7-4270-bddb-9430dc6ca88e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:24.989126 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-bcd8483c-9ae7-4270-bddb-9430dc6ca88e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.146942 Mar 12 20:50:24.989684 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 375/887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:24 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:24.994297 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-69f63d41-73f9-46d0-b24a-43ebafdda8fd tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Calling method '.version_select at 0x7f6e3743f550>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:25.133868 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-69f63d41-73f9-46d0-b24a-43ebafdda8fd tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/afadaeb0-427e-404e-a535-00bbd34d4d29" status: 202 len: 0 microversion: 2.1 time: 0.143078 Mar 12 20:50:25.134459 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 376/888] 10.222.0.30 () {58 vars in 1286 bytes} [Sat Mar 12 20:50:24 2022] DELETE /compute/v2.1/os-security-group-rules/afadaeb0-427e-404e-a535-00bbd34d4d29 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:25.138986 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e51f00af-0f8c-4388-bf88-f518d0dce54c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e371a7c10>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:25.615686 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e51f00af-0f8c-4388-bf88-f518d0dce54c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 204 len: 0 microversion: 2.1 time: 0.480182 Mar 12 20:50:25.616294 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 377/889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:25 2022] DELETE /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:50:25.620704 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e92f2ed1-9ba0-4085-a9a2-5e258f23dbaf tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:25.621306 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e92f2ed1-9ba0-4085-a9a2-5e258f23dbaf tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:25.627986 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e92f2ed1-9ba0-4085-a9a2-5e258f23dbaf tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:25.628439 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e92f2ed1-9ba0-4085-a9a2-5e258f23dbaf tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:25.629201 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e92f2ed1-9ba0-4085-a9a2-5e258f23dbaf tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:25.629639 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e92f2ed1-9ba0-4085-a9a2-5e258f23dbaf tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:25.763692 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e92f2ed1-9ba0-4085-a9a2-5e258f23dbaf tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:25.771526 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e92f2ed1-9ba0-4085-a9a2-5e258f23dbaf tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.154333 Mar 12 20:50:25.772087 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 378/890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:25 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:25.776450 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-59c6d172-a04c-4ab6-a483-548e8e130eed tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e371a7c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1354797625", "description": "tempest-description-1452500333"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:25.902993 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-59c6d172-a04c-4ab6-a483-548e8e130eed tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.129844 Mar 12 20:50:25.903746 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 379/891] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:50:25 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:25.909640 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-91104ad6-a77c-4202-b075-ed3fb2158889 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:25.909640 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-91104ad6-a77c-4202-b075-ed3fb2158889 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:25.915648 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-91104ad6-a77c-4202-b075-ed3fb2158889 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:25.916188 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-91104ad6-a77c-4202-b075-ed3fb2158889 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:25.917048 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-91104ad6-a77c-4202-b075-ed3fb2158889 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:25.917565 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-91104ad6-a77c-4202-b075-ed3fb2158889 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:25.981338 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-91104ad6-a77c-4202-b075-ed3fb2158889 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:25.989900 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-91104ad6-a77c-4202-b075-ed3fb2158889 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:25.991510 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-91104ad6-a77c-4202-b075-ed3fb2158889 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:25.996835 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-91104ad6-a77c-4202-b075-ed3fb2158889 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.091860 Mar 12 20:50:26.010292 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 380/892] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:25 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:26.010292 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-39d5836d-f581-4285-8995-1c3b006cda07 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:26.010292 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-39d5836d-f581-4285-8995-1c3b006cda07 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:26.016257 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-39d5836d-f581-4285-8995-1c3b006cda07 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:26.016257 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-39d5836d-f581-4285-8995-1c3b006cda07 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:26.016257 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-39d5836d-f581-4285-8995-1c3b006cda07 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:26.016618 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-39d5836d-f581-4285-8995-1c3b006cda07 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:26.156978 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-39d5836d-f581-4285-8995-1c3b006cda07 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:26.164953 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-39d5836d-f581-4285-8995-1c3b006cda07 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1389 microversion: 2.1 time: 0.165793 Mar 12 20:50:26.171039 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 381/893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:25 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:26.171039 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-30edf582-9e67-4b47-ac97-40390d886d18 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:26.171039 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-30edf582-9e67-4b47-ac97-40390d886d18 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:26.177235 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-30edf582-9e67-4b47-ac97-40390d886d18 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:26.177711 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-30edf582-9e67-4b47-ac97-40390d886d18 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:26.178688 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-30edf582-9e67-4b47-ac97-40390d886d18 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:26.179131 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-30edf582-9e67-4b47-ac97-40390d886d18 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:26.203481 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-30edf582-9e67-4b47-ac97-40390d886d18 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:50:26.275858 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-30edf582-9e67-4b47-ac97-40390d886d18 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 204 len: 0 microversion: 2.1 time: 0.108937 Mar 12 20:50:26.276627 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 382/894] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:50:26 2022] DELETE /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:50:26.282744 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-67f2bd46-5dc8-4e1b-8d17-d68e42934e7f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:26.283451 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-67f2bd46-5dc8-4e1b-8d17-d68e42934e7f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:26.292670 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67f2bd46-5dc8-4e1b-8d17-d68e42934e7f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:26.293182 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67f2bd46-5dc8-4e1b-8d17-d68e42934e7f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:26.294057 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67f2bd46-5dc8-4e1b-8d17-d68e42934e7f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:26.294501 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67f2bd46-5dc8-4e1b-8d17-d68e42934e7f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:26.427085 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-67f2bd46-5dc8-4e1b-8d17-d68e42934e7f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:26.434307 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-67f2bd46-5dc8-4e1b-8d17-d68e42934e7f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1493 microversion: 2.1 time: 0.156564 Mar 12 20:50:26.435036 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 383/895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:26 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1493 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:26.440471 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a731ca04-d4ff-4574-86b6-14aac687fea1 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e37191040>, body: {"security_group_rule": {"parent_group_id": "bae0da98-b4bf-43b7-8211-8de814a459f7", "ip_protocol": "tcp", "from_port": 1036029404, "to_port": 22}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:26.484193 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-a731ca04-d4ff-4574-86b6-14aac687fea1 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] HTTP exception thrown: Invalid port range 1036029404:22. Former value cannot be greater than the later Mar 12 20:50:26.484824 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a731ca04-d4ff-4574-86b6-14aac687fea1 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Returning 400 to user: Invalid port range 1036029404:22. Former value cannot be greater than the later {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:26.485676 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a731ca04-d4ff-4574-86b6-14aac687fea1 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.048836 Mar 12 20:50:26.486263 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 384/896] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:26 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:50:26.491345 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a4962958-b1f8-4b5b-bf65-460fa9449138 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:26.491949 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a4962958-b1f8-4b5b-bf65-460fa9449138 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:26.498428 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a4962958-b1f8-4b5b-bf65-460fa9449138 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:26.498879 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a4962958-b1f8-4b5b-bf65-460fa9449138 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:26.499667 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a4962958-b1f8-4b5b-bf65-460fa9449138 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:26.500103 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a4962958-b1f8-4b5b-bf65-460fa9449138 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:26.631703 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a4962958-b1f8-4b5b-bf65-460fa9449138 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:26.639172 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a4962958-b1f8-4b5b-bf65-460fa9449138 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.151992 Mar 12 20:50:26.639723 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 385/897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:26 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:26.644082 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-620765529", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "f9820f27-69e7-43b5-9215-94ce6d672d9b"}]}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:26.692778 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.neutron [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] validate_networks() for [('f9820f27-69e7-43b5-9215-94ce6d672d9b', None, None, None, None, None)] {{(pid=136303) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:50:27.041846 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:50:27.042269 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:50:27.042740 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:50:27.043177 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:50:27.043589 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:50:27.052512 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.052968 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:27.053819 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.054262 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:27.072242 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Getting quotas for project c0c046eb0b9248d3bde469b35342ff50. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:27.077659 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Getting quotas for user 1b433353e06247bfbd0897c84912256f and project c0c046eb0b9248d3bde469b35342ff50. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:27.090899 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Going to run 1 instances... {{(pid=136303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:50:27.093274 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:50:27.139155 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-506d11bc-e675-48dc-96df-2a870bd13525 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498329 Mar 12 20:50:27.139975 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 386/898] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:50:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:50:27.144769 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7a85e74f-dbb5-4073-9e38-353b05bbf5ce tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:27.145694 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7a85e74f-dbb5-4073-9e38-353b05bbf5ce tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:27.151605 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7a85e74f-dbb5-4073-9e38-353b05bbf5ce tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.152072 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7a85e74f-dbb5-4073-9e38-353b05bbf5ce tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:27.152839 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7a85e74f-dbb5-4073-9e38-353b05bbf5ce tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.153271 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7a85e74f-dbb5-4073-9e38-353b05bbf5ce tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:27.521899 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7a85e74f-dbb5-4073-9e38-353b05bbf5ce tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1644 microversion: 2.1 time: 0.370627 Mar 12 20:50:27.529944 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 387/899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:27 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1644 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:27.534751 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b71f7750-857d-4315-847f-6fca447784ae tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e37191550>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1942395235", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:27.538468 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-b71f7750-857d-4315-847f-6fca447784ae tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] HTTP exception thrown: Security group id should be uuid Mar 12 20:50:27.539180 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b71f7750-857d-4315-847f-6fca447784ae tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Returning 400 to user: Security group id should be uuid {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:27.540152 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b71f7750-857d-4315-847f-6fca447784ae tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.014383 Mar 12 20:50:27.550002 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 388/900] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:27 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:50:27.551906 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-ad272052-b475-48df-8d79-dd2b69b7b465 req-4a934f02-bf09-4c80-ba11-8481e94dd25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378f100b-bc86-4e26-8462-2b6ab20b1e04", "name": "network-vif-unplugged", "status": "completed", "tag": "bc5ebba0-ee77-4f1a-8fd8-11584ea45c51"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:27.561388 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-ad272052-b475-48df-8d79-dd2b69b7b465 req-4a934f02-bf09-4c80-ba11-8481e94dd25b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.562019 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-ad272052-b475-48df-8d79-dd2b69b7b465 req-4a934f02-bf09-4c80-ba11-8481e94dd25b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:27.574326 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-ad272052-b475-48df-8d79-dd2b69b7b465 req-4a934f02-bf09-4c80-ba11-8481e94dd25b service nova] Creating event network-vif-unplugged:bc5ebba0-ee77-4f1a-8fd8-11584ea45c51 for instance 378f100b-bc86-4e26-8462-2b6ab20b1e04 on nch2-master-1 Mar 12 20:50:27.579530 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-ad272052-b475-48df-8d79-dd2b69b7b465 req-4a934f02-bf09-4c80-ba11-8481e94dd25b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032282 Mar 12 20:50:27.580129 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 389/901] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:27.585452 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c45c1a90-4803-47b7-a375-1ab56d074025 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:27.586534 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c45c1a90-4803-47b7-a375-1ab56d074025 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:27.593607 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c45c1a90-4803-47b7-a375-1ab56d074025 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.594116 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c45c1a90-4803-47b7-a375-1ab56d074025 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:27.594917 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c45c1a90-4803-47b7-a375-1ab56d074025 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.595359 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c45c1a90-4803-47b7-a375-1ab56d074025 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:27.733568 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c45c1a90-4803-47b7-a375-1ab56d074025 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:27.741885 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c45c1a90-4803-47b7-a375-1ab56d074025 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.160511 Mar 12 20:50:27.742777 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 390/902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:27 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:27.747442 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ffcc3d0a-719a-4962-a0c8-42e9296c65de tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:27.748161 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ffcc3d0a-719a-4962-a0c8-42e9296c65de tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:27.754867 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ffcc3d0a-719a-4962-a0c8-42e9296c65de tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.755592 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ffcc3d0a-719a-4962-a0c8-42e9296c65de tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:27.756765 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ffcc3d0a-719a-4962-a0c8-42e9296c65de tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.757292 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ffcc3d0a-719a-4962-a0c8-42e9296c65de tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:27.830336 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ffcc3d0a-719a-4962-a0c8-42e9296c65de tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:27.839055 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ffcc3d0a-719a-4962-a0c8-42e9296c65de tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:27.840597 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ffcc3d0a-719a-4962-a0c8-42e9296c65de tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:27.845441 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ffcc3d0a-719a-4962-a0c8-42e9296c65de tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.101581 Mar 12 20:50:27.846048 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 391/903] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:27 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:27.850761 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3f94df4b-34ce-4739-8881-8220a5b53f72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:27.851606 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3f94df4b-34ce-4739-8881-8220a5b53f72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:27.857705 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3f94df4b-34ce-4739-8881-8220a5b53f72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.858385 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3f94df4b-34ce-4739-8881-8220a5b53f72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:27.859331 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3f94df4b-34ce-4739-8881-8220a5b53f72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.859926 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3f94df4b-34ce-4739-8881-8220a5b53f72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:27.920422 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3f94df4b-34ce-4739-8881-8220a5b53f72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:27.928259 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3f94df4b-34ce-4739-8881-8220a5b53f72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1259 microversion: 2.1 time: 0.081096 Mar 12 20:50:27.928828 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 392/904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:27 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:27.938518 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c3b958d4-fd63-447b-87f9-e3e186abba09 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:27.938518 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c3b958d4-fd63-447b-87f9-e3e186abba09 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:27.939471 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c3b958d4-fd63-447b-87f9-e3e186abba09 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.939922 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c3b958d4-fd63-447b-87f9-e3e186abba09 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:27.940714 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c3b958d4-fd63-447b-87f9-e3e186abba09 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:27.941163 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c3b958d4-fd63-447b-87f9-e3e186abba09 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:28.089402 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c3b958d4-fd63-447b-87f9-e3e186abba09 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:28.098966 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c3b958d4-fd63-447b-87f9-e3e186abba09 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1389 microversion: 2.1 time: 0.168491 Mar 12 20:50:28.104446 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-852b220a-5bd9-4c57-aefb-618d962b39fa tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0/action" status: 202 len: 0 microversion: 2.25 time: 7.429113 Mar 12 20:50:28.105194 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 513/906] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 20:50:20 2022] POST /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0/action => generated 0 bytes in 7431 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:50:28.110224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1548aaca-f5d7-476a-8717-6fa304632f80 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:28.110945 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 393/906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:27 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1389 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:28.111857 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:50:28.111857 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:50:28.114934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1548aaca-f5d7-476a-8717-6fa304632f80 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:28.115818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1548aaca-f5d7-476a-8717-6fa304632f80 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:28.116950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1548aaca-f5d7-476a-8717-6fa304632f80 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:28.117642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1548aaca-f5d7-476a-8717-6fa304632f80 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:28.119765 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1f6fe88f-9245-45cc-973c-35f01d9822e7 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e3719fca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1159391121", "description": "tempest-description-863113055"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:28.151944 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1548aaca-f5d7-476a-8717-6fa304632f80 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045143 Mar 12 20:50:28.152834 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 514/907] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Mar 12 20:50:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:28.164596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-337d9c38-ec42-419f-9923-9b7fae131014 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:28.165218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-337d9c38-ec42-419f-9923-9b7fae131014 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:28.187172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-337d9c38-ec42-419f-9923-9b7fae131014 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:28.188229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-337d9c38-ec42-419f-9923-9b7fae131014 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:28.189104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-337d9c38-ec42-419f-9923-9b7fae131014 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:28.194994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-337d9c38-ec42-419f-9923-9b7fae131014 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:28.421660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-337d9c38-ec42-419f-9923-9b7fae131014 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:28.430126 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-337d9c38-ec42-419f-9923-9b7fae131014 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.276045 Mar 12 20:50:28.432866 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 515/908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:28 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:28.438360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21e3cca6-f417-49c6-a69b-60a6d9f721d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:28.439191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-21e3cca6-f417-49c6-a69b-60a6d9f721d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:28.446065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21e3cca6-f417-49c6-a69b-60a6d9f721d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:28.446511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21e3cca6-f417-49c6-a69b-60a6d9f721d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:28.447341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21e3cca6-f417-49c6-a69b-60a6d9f721d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:28.447774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21e3cca6-f417-49c6-a69b-60a6d9f721d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:28.603106 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1f6fe88f-9245-45cc-973c-35f01d9822e7 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.490888 Mar 12 20:50:28.621713 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 394/909] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:50:28 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:28.634424 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-81bd7dbe-cdec-4bf2-b06b-4b2e692019f5 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e37198ee0>, body: {"security_group_rule": {"parent_group_id": "d7163404-d05f-40ca-8dd5-60befed15d36", "ip_protocol": "tempest-999-834327737", "from_port": 22, "to_port": 22}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:28.662131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21e3cca6-f417-49c6-a69b-60a6d9f721d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:28.671564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21e3cca6-f417-49c6-a69b-60a6d9f721d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:28.673318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21e3cca6-f417-49c6-a69b-60a6d9f721d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:28.674784 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21e3cca6-f417-49c6-a69b-60a6d9f721d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.240811 Mar 12 20:50:28.675454 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 516/910] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:28 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:28.760070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-38c83566-4502-490c-a1e7-e15fe41a80c6 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:28.761278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-38c83566-4502-490c-a1e7-e15fe41a80c6 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:28.770156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38c83566-4502-490c-a1e7-e15fe41a80c6 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:28.776477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38c83566-4502-490c-a1e7-e15fe41a80c6 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:28.778774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38c83566-4502-490c-a1e7-e15fe41a80c6 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:28.779230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38c83566-4502-490c-a1e7-e15fe41a80c6 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:28.901410 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-81bd7dbe-cdec-4bf2-b06b-4b2e692019f5 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] HTTP exception thrown: Invalid IP protocol tempest-999-834327737. Mar 12 20:50:28.902830 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-81bd7dbe-cdec-4bf2-b06b-4b2e692019f5 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Returning 400 to user: Invalid IP protocol tempest-999-834327737. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:28.903689 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-81bd7dbe-cdec-4bf2-b06b-4b2e692019f5 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.279301 Mar 12 20:50:28.904265 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 395/911] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:28 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:50:28.913052 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a7b364b2-5f33-4074-a79f-0869533ad0a7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:28.917542 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a7b364b2-5f33-4074-a79f-0869533ad0a7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:28.947579 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a7b364b2-5f33-4074-a79f-0869533ad0a7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:28.947953 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a7b364b2-5f33-4074-a79f-0869533ad0a7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:28.948807 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a7b364b2-5f33-4074-a79f-0869533ad0a7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:28.949251 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a7b364b2-5f33-4074-a79f-0869533ad0a7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:29.034874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-38c83566-4502-490c-a1e7-e15fe41a80c6 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:29.044934 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-38c83566-4502-490c-a1e7-e15fe41a80c6 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1321 microversion: 2.1 time: 0.289430 Mar 12 20:50:29.045595 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 517/912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:28 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:29.053271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-22b29ec5-604a-4bb3-8cab-f6d759ef4703 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e370b9c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1433696616", "description": "tempest-description-2089417822"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:29.110393 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a7b364b2-5f33-4074-a79f-0869533ad0a7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:29.121398 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a7b364b2-5f33-4074-a79f-0869533ad0a7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:29.124739 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a7b364b2-5f33-4074-a79f-0869533ad0a7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:29.134148 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a7b364b2-5f33-4074-a79f-0869533ad0a7 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.228642 Mar 12 20:50:29.135041 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 396/913] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:28 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:29.140152 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fab484c1-81ab-49da-bdf3-6615e841e563 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:29.141017 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-fab484c1-81ab-49da-bdf3-6615e841e563 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:29.151928 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fab484c1-81ab-49da-bdf3-6615e841e563 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:29.152838 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fab484c1-81ab-49da-bdf3-6615e841e563 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:29.154102 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fab484c1-81ab-49da-bdf3-6615e841e563 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:29.155171 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fab484c1-81ab-49da-bdf3-6615e841e563 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:29.240927 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-22b29ec5-604a-4bb3-8cab-f6d759ef4703 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.194029 Mar 12 20:50:29.241746 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 518/914] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:50:29 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:29.247924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f67eb68-a002-4ecd-901e-b9530a5955cb tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:29.248681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f67eb68-a002-4ecd-901e-b9530a5955cb tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:29.260891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f67eb68-a002-4ecd-901e-b9530a5955cb tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:29.261453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f67eb68-a002-4ecd-901e-b9530a5955cb tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:29.262362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f67eb68-a002-4ecd-901e-b9530a5955cb tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:29.262861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f67eb68-a002-4ecd-901e-b9530a5955cb tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:29.285299 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fab484c1-81ab-49da-bdf3-6615e841e563 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:29.293284 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fab484c1-81ab-49da-bdf3-6615e841e563 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1265 microversion: 2.1 time: 0.157020 Mar 12 20:50:29.294183 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 397/915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:29 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:29.298718 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3a57669c-5d27-41c5-b25b-82274a0509ea tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e3719e940>, body: {"security_group_rule": {"parent_group_id": "82bc0e13-6900-445b-aa23-9af93fe40e47", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:29.398374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8f67eb68-a002-4ecd-901e-b9530a5955cb tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:29.407097 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f67eb68-a002-4ecd-901e-b9530a5955cb tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1389 microversion: 2.1 time: 0.163382 Mar 12 20:50:29.408274 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 519/916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:29 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:29.449410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37e1cb8c-588b-41ce-b5cd-62b7893f00c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:29.450057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-37e1cb8c-588b-41ce-b5cd-62b7893f00c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:29.456232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37e1cb8c-588b-41ce-b5cd-62b7893f00c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:29.456883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37e1cb8c-588b-41ce-b5cd-62b7893f00c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:29.457657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37e1cb8c-588b-41ce-b5cd-62b7893f00c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:29.458120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37e1cb8c-588b-41ce-b5cd-62b7893f00c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:29.506668 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-3a57669c-5d27-41c5-b25b-82274a0509ea tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Mar 12 20:50:29.507563 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3a57669c-5d27-41c5-b25b-82274a0509ea tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:29.508585 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3a57669c-5d27-41c5-b25b-82274a0509ea tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.213490 Mar 12 20:50:29.514653 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 398/917] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:29 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:50:29.520391 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-40816c92-99cd-4d0d-b48e-967152efaede tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e37198d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1227830374", "description": "tempest-description-316183884"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:29.678674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-37e1cb8c-588b-41ce-b5cd-62b7893f00c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:29.687012 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-37e1cb8c-588b-41ce-b5cd-62b7893f00c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1312 microversion: 2.1 time: 0.241890 Mar 12 20:50:29.697186 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 520/918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:29 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1312 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:29.700866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-427fdad9-bf74-43eb-8d00-0ccbcad6c4ce tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:29.701480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-427fdad9-bf74-43eb-8d00-0ccbcad6c4ce tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:29.709420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-427fdad9-bf74-43eb-8d00-0ccbcad6c4ce tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:29.709982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-427fdad9-bf74-43eb-8d00-0ccbcad6c4ce tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:29.710768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-427fdad9-bf74-43eb-8d00-0ccbcad6c4ce tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:29.711393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-427fdad9-bf74-43eb-8d00-0ccbcad6c4ce tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:30.087062 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-40816c92-99cd-4d0d-b48e-967152efaede tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.571038 Mar 12 20:50:30.093055 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 399/919] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:50:29 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:30.116482 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-41ede5d0-20ef-42ad-a313-cd6b3aabdf66 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff97fd5d-587f-4513-8af9-0e14cbb1f919", "device": "/dev/xvdb"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:30.121002 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-41ede5d0-20ef-42ad-a313-cd6b3aabdf66 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:30.149785 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-41ede5d0-20ef-42ad-a313-cd6b3aabdf66 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:30.150418 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-41ede5d0-20ef-42ad-a313-cd6b3aabdf66 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:30.153144 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-41ede5d0-20ef-42ad-a313-cd6b3aabdf66 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:30.157237 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-41ede5d0-20ef-42ad-a313-cd6b3aabdf66 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:30.262658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-427fdad9-bf74-43eb-8d00-0ccbcad6c4ce tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:30.284144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-427fdad9-bf74-43eb-8d00-0ccbcad6c4ce tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:30.287036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-427fdad9-bf74-43eb-8d00-0ccbcad6c4ce tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:30.292359 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-427fdad9-bf74-43eb-8d00-0ccbcad6c4ce tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.593003 Mar 12 20:50:30.301955 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 521/920] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:29 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:30.302173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e6d650d0-bd7f-4c29-97dd-af0569547e2a req-29a3361c-7aad-426f-b553-7a070f66f70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378f100b-bc86-4e26-8462-2b6ab20b1e04", "name": "network-vif-deleted", "tag": "bc5ebba0-ee77-4f1a-8fd8-11584ea45c51"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:30.327881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e6d650d0-bd7f-4c29-97dd-af0569547e2a req-29a3361c-7aad-426f-b553-7a070f66f70c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:30.328406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e6d650d0-bd7f-4c29-97dd-af0569547e2a req-29a3361c-7aad-426f-b553-7a070f66f70c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:30.356430 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e6d650d0-bd7f-4c29-97dd-af0569547e2a req-29a3361c-7aad-426f-b553-7a070f66f70c service nova] Creating event network-vif-deleted:bc5ebba0-ee77-4f1a-8fd8-11584ea45c51 for instance 378f100b-bc86-4e26-8462-2b6ab20b1e04 on nch2-master-1 Mar 12 20:50:30.370186 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e6d650d0-bd7f-4c29-97dd-af0569547e2a req-29a3361c-7aad-426f-b553-7a070f66f70c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071516 Mar 12 20:50:30.370820 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 522/921] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:30.383893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-820a524c-ec11-4f80-b6af-edde7d1441e1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:30.385611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-820a524c-ec11-4f80-b6af-edde7d1441e1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:30.402250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-820a524c-ec11-4f80-b6af-edde7d1441e1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:30.402844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-820a524c-ec11-4f80-b6af-edde7d1441e1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:30.403663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-820a524c-ec11-4f80-b6af-edde7d1441e1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:30.404883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-820a524c-ec11-4f80-b6af-edde7d1441e1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:30.638759 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-41ede5d0-20ef-42ad-a313-cd6b3aabdf66 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "POST /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.531948 Mar 12 20:50:30.668982 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 400/922] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 20:50:30 2022] POST /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0/os-volume_attachments => generated 194 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:30.685664 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f0338529-ad36-493d-83ce-5df5ae9ef773 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e3719e700>, body: {"security_group_rule": {"parent_group_id": "84a701fc-9343-4623-8519-4b459aab76b0", "ip_protocol": "tcp", "from_port": 22, "to_port": 2047875220}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:30.768321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-820a524c-ec11-4f80-b6af-edde7d1441e1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:30.781048 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-820a524c-ec11-4f80-b6af-edde7d1441e1 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1471 microversion: 2.1 time: 0.408893 Mar 12 20:50:30.782051 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 523/923] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:30 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1471 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:30.790600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af0d4205-b85a-4fc7-b95f-336d9670207a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:30.791568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af0d4205-b85a-4fc7-b95f-336d9670207a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:30.798785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af0d4205-b85a-4fc7-b95f-336d9670207a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:30.799683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af0d4205-b85a-4fc7-b95f-336d9670207a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:30.801820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af0d4205-b85a-4fc7-b95f-336d9670207a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:30.804915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af0d4205-b85a-4fc7-b95f-336d9670207a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:30.810654 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-f0338529-ad36-493d-83ce-5df5ae9ef773 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] HTTP exception thrown: Invalid port range 22:2047875220. Valid TCP ports should be between 1-65535 Mar 12 20:50:30.812145 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f0338529-ad36-493d-83ce-5df5ae9ef773 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Returning 400 to user: Invalid port range 22:2047875220. Valid TCP ports should be between 1-65535 {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:30.824502 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f0338529-ad36-493d-83ce-5df5ae9ef773 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.142044 Mar 12 20:50:30.827226 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 401/924] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:30 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:50:30.838002 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3eda84b5-480f-4eed-a901-a4822df8f848 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:30.839151 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3eda84b5-480f-4eed-a901-a4822df8f848 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:30.856599 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3eda84b5-480f-4eed-a901-a4822df8f848 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:30.857055 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3eda84b5-480f-4eed-a901-a4822df8f848 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:30.857861 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3eda84b5-480f-4eed-a901-a4822df8f848 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:30.863123 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3eda84b5-480f-4eed-a901-a4822df8f848 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:30.943105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-af0d4205-b85a-4fc7-b95f-336d9670207a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:30.968482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-af0d4205-b85a-4fc7-b95f-336d9670207a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:30.970025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-af0d4205-b85a-4fc7-b95f-336d9670207a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:30.990124 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af0d4205-b85a-4fc7-b95f-336d9670207a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.206481 Mar 12 20:50:30.991690 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 524/925] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:30 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:30.997547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6ccf4125-6d6a-4a2d-bf56-285d331e945b req-9795072a-4818-4b24-8935-94e172fd5150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa543f4a-cb64-4ec9-9863-2f1fb751ef01", "name": "network-vif-plugged", "status": "completed", "tag": "b56cfd9b-9a8c-494a-8ad8-518a7d6a9a02"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:31.009057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6ccf4125-6d6a-4a2d-bf56-285d331e945b req-9795072a-4818-4b24-8935-94e172fd5150 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:31.009680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6ccf4125-6d6a-4a2d-bf56-285d331e945b req-9795072a-4818-4b24-8935-94e172fd5150 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:31.059347 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6ccf4125-6d6a-4a2d-bf56-285d331e945b req-9795072a-4818-4b24-8935-94e172fd5150 service nova] Creating event network-vif-plugged:b56cfd9b-9a8c-494a-8ad8-518a7d6a9a02 for instance aa543f4a-cb64-4ec9-9863-2f1fb751ef01 on nch2-master-1 Mar 12 20:50:31.071268 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6ccf4125-6d6a-4a2d-bf56-285d331e945b req-9795072a-4818-4b24-8935-94e172fd5150 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077889 Mar 12 20:50:31.071874 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 525/926] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:31.084936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a57a1de-4691-4ba7-9ba7-81739b8863a9 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:31.085632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0a57a1de-4691-4ba7-9ba7-81739b8863a9 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:31.099014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a57a1de-4691-4ba7-9ba7-81739b8863a9 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:31.099471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a57a1de-4691-4ba7-9ba7-81739b8863a9 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:31.100255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a57a1de-4691-4ba7-9ba7-81739b8863a9 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:31.100693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a57a1de-4691-4ba7-9ba7-81739b8863a9 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:31.368140 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3eda84b5-480f-4eed-a901-a4822df8f848 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:31.380309 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3eda84b5-480f-4eed-a901-a4822df8f848 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.550699 Mar 12 20:50:31.383796 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 402/927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:30 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:31.395119 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-19ae7a28-9946-4ee8-88c6-00db6881ef07 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:31.396568 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-19ae7a28-9946-4ee8-88c6-00db6881ef07 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:31.410502 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-19ae7a28-9946-4ee8-88c6-00db6881ef07 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:31.416883 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-19ae7a28-9946-4ee8-88c6-00db6881ef07 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:31.418234 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-19ae7a28-9946-4ee8-88c6-00db6881ef07 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:31.418856 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-19ae7a28-9946-4ee8-88c6-00db6881ef07 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:31.539003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0a57a1de-4691-4ba7-9ba7-81739b8863a9 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:31.548332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0a57a1de-4691-4ba7-9ba7-81739b8863a9 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1389 microversion: 2.1 time: 0.475279 Mar 12 20:50:31.552098 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 526/928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:31 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1389 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:31.893408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5ac42af-640b-4be5-a6cb-cbd2777d6ed3 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:31.894230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c5ac42af-640b-4be5-a6cb-cbd2777d6ed3 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] [instance: 1f67c856-0d6e-4196-ad7a-f4d5e1ca2082] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:31.908805 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c5ac42af-640b-4be5-a6cb-cbd2777d6ed3 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] HTTP exception thrown: Instance 1f67c856-0d6e-4196-ad7a-f4d5e1ca2082 could not be found. Mar 12 20:50:31.909661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5ac42af-640b-4be5-a6cb-cbd2777d6ed3 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Returning 404 to user: Instance 1f67c856-0d6e-4196-ad7a-f4d5e1ca2082 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:31.910899 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c5ac42af-640b-4be5-a6cb-cbd2777d6ed3 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/1f67c856-0d6e-4196-ad7a-f4d5e1ca2082/action" status: 404 len: 111 microversion: 2.1 time: 0.357122 Mar 12 20:50:31.911674 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 527/929] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:50:31 2022] POST /compute/v2.1/servers/1f67c856-0d6e-4196-ad7a-f4d5e1ca2082/action => generated 111 bytes in 358 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:50:31.923997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a26c249-4e7d-4e34-b325-4240fb18515e tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Action: 'create', calling method: .version_select at 0x7f6e37093430>, body: {"security_group_rule": {"parent_group_id": "06cc0b2f-1dda-4154-93c3-6afb0ccfb103", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:31.969908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-0a26c249-4e7d-4e34-b325-4240fb18515e tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 06cc0b2f-1dda-4154-93c3-6afb0ccfb103 does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:50:31.970519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-0a26c249-4e7d-4e34-b325-4240fb18515e tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Neutron security group 06cc0b2f-1dda-4154-93c3-6afb0ccfb103 not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:50:31.971227 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-0a26c249-4e7d-4e34-b325-4240fb18515e tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] HTTP exception thrown: Security group 06cc0b2f-1dda-4154-93c3-6afb0ccfb103 does not exist Mar 12 20:50:31.971227 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-1489e3ce-d7fe-4cca-af12-79abec78eefd'] Mar 12 20:50:31.972054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a26c249-4e7d-4e34-b325-4240fb18515e tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Returning 404 to user: Security group 06cc0b2f-1dda-4154-93c3-6afb0ccfb103 does not exist Mar 12 20:50:31.972054 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-1489e3ce-d7fe-4cca-af12-79abec78eefd'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:31.973178 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0a26c249-4e7d-4e34-b325-4240fb18515e tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.060378 Mar 12 20:50:31.973939 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 528/930] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Mar 12 20:50:31 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:50:31.980117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af7d02f8-39e6-40a1-a869-360820d7771f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:31.987516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af7d02f8-39e6-40a1-a869-360820d7771f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:32.015209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af7d02f8-39e6-40a1-a869-360820d7771f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:32.015857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af7d02f8-39e6-40a1-a869-360820d7771f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:32.016843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af7d02f8-39e6-40a1-a869-360820d7771f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:32.017468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af7d02f8-39e6-40a1-a869-360820d7771f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:32.221652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-af7d02f8-39e6-40a1-a869-360820d7771f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:32.232777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-af7d02f8-39e6-40a1-a869-360820d7771f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:32.234757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-af7d02f8-39e6-40a1-a869-360820d7771f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:32.236272 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af7d02f8-39e6-40a1-a869-360820d7771f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.261243 Mar 12 20:50:32.238148 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 529/931] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:31 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:32.244263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7bc4644b-0e9a-4b82-8e0d-b73e0e7992e3 req-42682580-dc39-48ee-bfc2-a8ab68e62cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc87869-0e83-41a4-8949-ae7612a38be2", "name": "network-vif-deleted", "tag": "a1cce536-fdef-4003-bb8c-2aa69b9cb257"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:32.267661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7bc4644b-0e9a-4b82-8e0d-b73e0e7992e3 req-42682580-dc39-48ee-bfc2-a8ab68e62cac service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:32.268116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7bc4644b-0e9a-4b82-8e0d-b73e0e7992e3 req-42682580-dc39-48ee-bfc2-a8ab68e62cac service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:32.287182 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7bc4644b-0e9a-4b82-8e0d-b73e0e7992e3 req-42682580-dc39-48ee-bfc2-a8ab68e62cac service nova] Creating event network-vif-deleted:a1cce536-fdef-4003-bb8c-2aa69b9cb257 for instance 7cc87869-0e83-41a4-8949-ae7612a38be2 on nch1-master-1 Mar 12 20:50:32.294233 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7bc4644b-0e9a-4b82-8e0d-b73e0e7992e3 req-42682580-dc39-48ee-bfc2-a8ab68e62cac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054132 Mar 12 20:50:32.297009 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 530/932] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:32.304777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d922c01-ae6a-4c28-b399-5179daddcb21 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Calling method '.version_select at 0x7f6e370a65e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:32.331057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-8d922c01-ae6a-4c28-b399-5179daddcb21 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 8c545dfd-55d0-4144-b9a5-2791391b659f does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:50:32.331935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-8d922c01-ae6a-4c28-b399-5179daddcb21 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Neutron security group rule 8c545dfd-55d0-4144-b9a5-2791391b659f not found {{(pid=136302) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Mar 12 20:50:32.333226 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8d922c01-ae6a-4c28-b399-5179daddcb21 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] HTTP exception thrown: Security group rule 8c545dfd-55d0-4144-b9a5-2791391b659f does not exist Mar 12 20:50:32.333226 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-1158f101-cd19-46dc-83ae-a62ed9535dc8'] Mar 12 20:50:32.334169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d922c01-ae6a-4c28-b399-5179daddcb21 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Returning 404 to user: Security group rule 8c545dfd-55d0-4144-b9a5-2791391b659f does not exist Mar 12 20:50:32.334169 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-1158f101-cd19-46dc-83ae-a62ed9535dc8'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:32.335351 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d922c01-ae6a-4c28-b399-5179daddcb21 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/8c545dfd-55d0-4144-b9a5-2791391b659f" status: 404 len: 199 microversion: 2.1 time: 0.036944 Mar 12 20:50:32.336135 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 531/933] 10.222.0.30 () {58 vars in 1286 bytes} [Sat Mar 12 20:50:32 2022] DELETE /compute/v2.1/os-security-group-rules/8c545dfd-55d0-4144-b9a5-2791391b659f => generated 199 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:50:32.345275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ce271d1-f735-4e96-b2f7-8b79c17c2bc6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:32.346382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ce271d1-f735-4e96-b2f7-8b79c17c2bc6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:32.356117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ce271d1-f735-4e96-b2f7-8b79c17c2bc6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:32.356868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ce271d1-f735-4e96-b2f7-8b79c17c2bc6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:32.358369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ce271d1-f735-4e96-b2f7-8b79c17c2bc6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:32.359043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ce271d1-f735-4e96-b2f7-8b79c17c2bc6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:32.435949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ce271d1-f735-4e96-b2f7-8b79c17c2bc6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:32.446675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ce271d1-f735-4e96-b2f7-8b79c17c2bc6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:32.449232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ce271d1-f735-4e96-b2f7-8b79c17c2bc6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:32.455023 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ce271d1-f735-4e96-b2f7-8b79c17c2bc6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.117619 Mar 12 20:50:32.455999 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 532/934] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:32 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:32.463166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-70511598", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:32.468376 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-19ae7a28-9946-4ee8-88c6-00db6881ef07 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:32.476808 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-19ae7a28-9946-4ee8-88c6-00db6881ef07 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1462 microversion: 2.1 time: 1.091073 Mar 12 20:50:32.477392 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 403/935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:31 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1462 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:32.486068 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-909a04cc-733d-43d5-a4dc-d1ddd4520bfc tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Calling method '.version_select at 0x7f6e371a1940>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:32.523522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:50:32.762486 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-909a04cc-733d-43d5-a4dc-d1ddd4520bfc tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/84a701fc-9343-4623-8519-4b459aab76b0" status: 202 len: 0 microversion: 2.1 time: 0.282732 Mar 12 20:50:32.766354 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 404/936] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:32 2022] DELETE /compute/v2.1/os-security-groups/84a701fc-9343-4623-8519-4b459aab76b0 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:32.777422 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c2ae2460-67fe-4861-985b-404d55038c23 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:32.778838 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c2ae2460-67fe-4861-985b-404d55038c23 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:32.791063 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c2ae2460-67fe-4861-985b-404d55038c23 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:32.797580 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c2ae2460-67fe-4861-985b-404d55038c23 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:32.799004 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c2ae2460-67fe-4861-985b-404d55038c23 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:32.802364 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c2ae2460-67fe-4861-985b-404d55038c23 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:32.809525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:50:32.810215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:50:32.810529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:50:32.810951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:50:32.811367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:50:32.846419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:32.846835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:32.848226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:32.849286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:32.891297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Getting quotas for project f569aa4fb0c34fbf8b56338342d08162. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:32.909670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Getting quotas for user 07b0de7f0b2847e9a6cf5effd9c43a50 and project f569aa4fb0c34fbf8b56338342d08162. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:32.934704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:50:32.939665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:50:32.999474 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-66f810d0-0f81-4dec-9fa7-bb1b2597a7d3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541336 Mar 12 20:50:33.000139 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 533/937] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:50:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:50:33.011636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5d3a5284-5c0e-48fc-99dc-cf178f903232 req-60d1c69d-6fda-4047-a15b-c9862fe1c035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7052bc-c2a6-4c11-85b5-e31c7f79adfb", "tag": "72ad719c-17da-4caf-89cd-ae46166479db"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:33.034802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5d3a5284-5c0e-48fc-99dc-cf178f903232 req-60d1c69d-6fda-4047-a15b-c9862fe1c035 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:33.035294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5d3a5284-5c0e-48fc-99dc-cf178f903232 req-60d1c69d-6fda-4047-a15b-c9862fe1c035 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:33.050531 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5d3a5284-5c0e-48fc-99dc-cf178f903232 req-60d1c69d-6fda-4047-a15b-c9862fe1c035 service nova] Creating event network-changed:72ad719c-17da-4caf-89cd-ae46166479db for instance 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb on nch1-master-1 Mar 12 20:50:33.056084 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5d3a5284-5c0e-48fc-99dc-cf178f903232 req-60d1c69d-6fda-4047-a15b-c9862fe1c035 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048612 Mar 12 20:50:33.057184 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 534/938] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:33.059305 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c2ae2460-67fe-4861-985b-404d55038c23 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:33.062821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:33.064041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:33.072380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:33.072832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:33.073610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:33.074105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:33.075250 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c2ae2460-67fe-4861-985b-404d55038c23 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.307492 Mar 12 20:50:33.075832 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 405/939] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:32 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:33.089422 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3b8483d7-b4cb-410d-97cb-9d2ae25ab4a2 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:33.090127 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3b8483d7-b4cb-410d-97cb-9d2ae25ab4a2 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:33.097852 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3b8483d7-b4cb-410d-97cb-9d2ae25ab4a2 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:33.098952 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3b8483d7-b4cb-410d-97cb-9d2ae25ab4a2 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:33.100102 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3b8483d7-b4cb-410d-97cb-9d2ae25ab4a2 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:33.101046 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3b8483d7-b4cb-410d-97cb-9d2ae25ab4a2 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:33.178820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:33.186745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Old instance type m1.heat2, new instance type m1.heat {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 20:50:33.194093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:50:33.194515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:50:33.194994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:50:33.195655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:50:33.196070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:50:33.372369 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3b8483d7-b4cb-410d-97cb-9d2ae25ab4a2 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:33.386849 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3b8483d7-b4cb-410d-97cb-9d2ae25ab4a2 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1389 microversion: 2.1 time: 0.301751 Mar 12 20:50:33.399287 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 406/940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:33 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1389 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:33.399693 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-33fafa60-4802-4abd-9201-ad3c76e3b182 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "POST /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28/action" status: 202 len: 0 microversion: 2.1 time: 0.341095 Mar 12 20:50:33.400427 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 535/941] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:50:33 2022] POST /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:33.406775 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1e57bb04-d637-4fdd-9287-2e05a6d31994 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Calling method '.version_select at 0x7f6e371785e0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:33.416173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab76c380-7c71-46c3-9696-d983eb891d8c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:33.417634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ab76c380-7c71-46c3-9696-d983eb891d8c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:33.489645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ab76c380-7c71-46c3-9696-d983eb891d8c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:33.501579 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ab76c380-7c71-46c3-9696-d983eb891d8c tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1220 microversion: 2.1 time: 0.099505 Mar 12 20:50:33.505762 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 536/942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:33 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:33.518975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5f5510bd-5f4f-4652-8041-ef57332e73ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:33.520391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5f5510bd-5f4f-4652-8041-ef57332e73ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:33.531818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f5510bd-5f4f-4652-8041-ef57332e73ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:33.532283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f5510bd-5f4f-4652-8041-ef57332e73ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:33.540036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f5510bd-5f4f-4652-8041-ef57332e73ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:33.540871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f5510bd-5f4f-4652-8041-ef57332e73ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:33.804267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f5510bd-5f4f-4652-8041-ef57332e73ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:33.813649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f5510bd-5f4f-4652-8041-ef57332e73ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:33.817299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f5510bd-5f4f-4652-8041-ef57332e73ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:33.819115 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5f5510bd-5f4f-4652-8041-ef57332e73ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.310355 Mar 12 20:50:33.821128 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 537/943] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:33 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:33.833218 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1e57bb04-d637-4fdd-9287-2e05a6d31994 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/82bc0e13-6900-445b-aa23-9af93fe40e47" status: 202 len: 0 microversion: 2.1 time: 0.429827 Mar 12 20:50:33.834604 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 407/944] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:33 2022] DELETE /compute/v2.1/os-security-groups/82bc0e13-6900-445b-aa23-9af93fe40e47 => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:33.840435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5ebbcb5-7652-4241-ac46-3f98b3fa2e66 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:33.841273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c5ebbcb5-7652-4241-ac46-3f98b3fa2e66 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:33.841427 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-aa903a0f-cad9-4239-852b-fd631ad0fcbc tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:33.841929 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-aa903a0f-cad9-4239-852b-fd631ad0fcbc tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:33.854179 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aa903a0f-cad9-4239-852b-fd631ad0fcbc tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:33.854715 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aa903a0f-cad9-4239-852b-fd631ad0fcbc tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:33.855622 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aa903a0f-cad9-4239-852b-fd631ad0fcbc tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:33.856269 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aa903a0f-cad9-4239-852b-fd631ad0fcbc tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:33.858540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5ebbcb5-7652-4241-ac46-3f98b3fa2e66 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:33.859181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5ebbcb5-7652-4241-ac46-3f98b3fa2e66 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:33.860602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5ebbcb5-7652-4241-ac46-3f98b3fa2e66 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:33.861225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5ebbcb5-7652-4241-ac46-3f98b3fa2e66 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:33.961667 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-aa903a0f-cad9-4239-852b-fd631ad0fcbc tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:33.984639 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-aa903a0f-cad9-4239-852b-fd631ad0fcbc tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:33.991861 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-aa903a0f-cad9-4239-852b-fd631ad0fcbc tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:34.001483 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-aa903a0f-cad9-4239-852b-fd631ad0fcbc tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.165270 Mar 12 20:50:34.002644 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 408/945] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:33 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:34.008614 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3a78d19e-d9ff-4f90-8671-5d6ead29ae79 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Calling method '.version_select at 0x7f6e371a7c10>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:34.089021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c5ebbcb5-7652-4241-ac46-3f98b3fa2e66 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:34.103351 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c5ebbcb5-7652-4241-ac46-3f98b3fa2e66 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1471 microversion: 2.1 time: 0.267246 Mar 12 20:50:34.104839 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 538/946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:33 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1471 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:34.110973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9e73b5e6-0731-4009-8ac5-bcc5e6b66cd3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:34.112108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9e73b5e6-0731-4009-8ac5-bcc5e6b66cd3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:34.118681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e73b5e6-0731-4009-8ac5-bcc5e6b66cd3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:34.119749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e73b5e6-0731-4009-8ac5-bcc5e6b66cd3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:34.121346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e73b5e6-0731-4009-8ac5-bcc5e6b66cd3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:34.122196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e73b5e6-0731-4009-8ac5-bcc5e6b66cd3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:34.302972 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3a78d19e-d9ff-4f90-8671-5d6ead29ae79 tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d7163404-d05f-40ca-8dd5-60befed15d36" status: 202 len: 0 microversion: 2.1 time: 0.298884 Mar 12 20:50:34.307616 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 409/947] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:34 2022] DELETE /compute/v2.1/os-security-groups/d7163404-d05f-40ca-8dd5-60befed15d36 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:34.319913 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c997c2af-4c15-4411-9126-1c05244bedfb tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:34.320946 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c997c2af-4c15-4411-9126-1c05244bedfb tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:34.328735 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c997c2af-4c15-4411-9126-1c05244bedfb tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:34.329264 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c997c2af-4c15-4411-9126-1c05244bedfb tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:34.330221 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c997c2af-4c15-4411-9126-1c05244bedfb tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:34.330672 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c997c2af-4c15-4411-9126-1c05244bedfb tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:34.403384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9e73b5e6-0731-4009-8ac5-bcc5e6b66cd3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:34.413023 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9e73b5e6-0731-4009-8ac5-bcc5e6b66cd3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.306676 Mar 12 20:50:34.420063 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 539/948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:34 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:34.433256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-29d08dad-5920-45a6-a752-b715aac7817e tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Calling method '.version_select at 0x7f6e37053c10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:34.580757 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c997c2af-4c15-4411-9126-1c05244bedfb tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1690 microversion: 2.1 time: 0.271490 Mar 12 20:50:34.581880 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 410/949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:34 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1690 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:34.587313 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fc1a9880-b31b-4c03-a507-f5068605a414 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:34.587959 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-fc1a9880-b31b-4c03-a507-f5068605a414 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:34.594998 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fc1a9880-b31b-4c03-a507-f5068605a414 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:34.595907 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fc1a9880-b31b-4c03-a507-f5068605a414 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:34.596320 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fc1a9880-b31b-4c03-a507-f5068605a414 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:34.596801 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fc1a9880-b31b-4c03-a507-f5068605a414 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:34.730557 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-29d08dad-5920-45a6-a752-b715aac7817e tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/bae0da98-b4bf-43b7-8211-8de814a459f7" status: 202 len: 0 microversion: 2.1 time: 0.307493 Mar 12 20:50:34.734430 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 540/950] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:34 2022] DELETE /compute/v2.1/os-security-groups/bae0da98-b4bf-43b7-8211-8de814a459f7 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:34.737493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd3fedf9-e40c-4f58-8b7b-13fb950af1e5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:34.738375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd3fedf9-e40c-4f58-8b7b-13fb950af1e5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:34.757231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3fedf9-e40c-4f58-8b7b-13fb950af1e5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:34.759182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3fedf9-e40c-4f58-8b7b-13fb950af1e5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:34.762563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3fedf9-e40c-4f58-8b7b-13fb950af1e5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:34.763128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3fedf9-e40c-4f58-8b7b-13fb950af1e5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:34.868523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bd3fedf9-e40c-4f58-8b7b-13fb950af1e5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:34.878036 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd3fedf9-e40c-4f58-8b7b-13fb950af1e5 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1290 microversion: 2.1 time: 0.144989 Mar 12 20:50:34.888881 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 541/951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:34 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1290 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:34.894054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e70258a-6065-4497-b689-ce581acce19c tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:34.895290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5e70258a-6065-4497-b689-ce581acce19c tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:34.901196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e70258a-6065-4497-b689-ce581acce19c tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:34.901667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e70258a-6065-4497-b689-ce581acce19c tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:34.902463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e70258a-6065-4497-b689-ce581acce19c tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:34.903062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e70258a-6065-4497-b689-ce581acce19c tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:34.929512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-5e70258a-6065-4497-b689-ce581acce19c tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lazy-loading 'flavor' on Instance uuid e40005ee-4cc8-49d8-a826-236d4aad98a0 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:34.941540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5e70258a-6065-4497-b689-ce581acce19c tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Going to try to live migrate instance to nch1-master-1 {{(pid=136302) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 12 20:50:34.996013 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fc1a9880-b31b-4c03-a507-f5068605a414 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:35.006565 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fc1a9880-b31b-4c03-a507-f5068605a414 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1588 microversion: 2.1 time: 0.423416 Mar 12 20:50:35.008959 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 411/952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:34 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1588 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:35.016109 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9695f6fc-3403-4c9b-aea6-eb8579928adf tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] Calling method '.version_select at 0x7f6e37172f70>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:35.357096 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9695f6fc-3403-4c9b-aea6-eb8579928adf tempest-SecurityGroupRulesNegativeTestJSON-2098680225 tempest-SecurityGroupRulesNegativeTestJSON-2098680225-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/82bdac7a-a643-4fa7-8581-3fcd37bd1919" status: 202 len: 0 microversion: 2.1 time: 0.345337 Mar 12 20:50:35.357096 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 412/953] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:50:35 2022] DELETE /compute/v2.1/os-security-groups/82bdac7a-a643-4fa7-8581-3fcd37bd1919 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:35.367893 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9201c3fc-04a1-4604-82e1-e479dd0634b9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:35.368836 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9201c3fc-04a1-4604-82e1-e479dd0634b9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:35.375759 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9201c3fc-04a1-4604-82e1-e479dd0634b9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:35.376405 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9201c3fc-04a1-4604-82e1-e479dd0634b9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:35.377381 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9201c3fc-04a1-4604-82e1-e479dd0634b9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:35.378022 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9201c3fc-04a1-4604-82e1-e479dd0634b9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:35.632944 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9201c3fc-04a1-4604-82e1-e479dd0634b9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:35.642883 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9201c3fc-04a1-4604-82e1-e479dd0634b9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:35.644818 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9201c3fc-04a1-4604-82e1-e479dd0634b9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:35.646333 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9201c3fc-04a1-4604-82e1-e479dd0634b9 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.288321 Mar 12 20:50:35.647043 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 413/954] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:35 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:35.652325 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8bbbe408-7114-4bad-a64b-3efbfc32b340 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:35.653987 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8bbbe408-7114-4bad-a64b-3efbfc32b340 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:35.661790 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8bbbe408-7114-4bad-a64b-3efbfc32b340 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:35.662479 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8bbbe408-7114-4bad-a64b-3efbfc32b340 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:35.663482 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8bbbe408-7114-4bad-a64b-3efbfc32b340 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:35.664141 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8bbbe408-7114-4bad-a64b-3efbfc32b340 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:35.753134 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8bbbe408-7114-4bad-a64b-3efbfc32b340 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:35.763300 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8bbbe408-7114-4bad-a64b-3efbfc32b340 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:35.765464 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8bbbe408-7114-4bad-a64b-3efbfc32b340 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:35.772304 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8bbbe408-7114-4bad-a64b-3efbfc32b340 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.123364 Mar 12 20:50:35.773596 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 414/955] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:35 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:35.778887 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-85fcf29f-dacf-4d37-b94e-b6813b8d0e12 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:35.779709 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-85fcf29f-dacf-4d37-b94e-b6813b8d0e12 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:35.786909 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-85fcf29f-dacf-4d37-b94e-b6813b8d0e12 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:35.787684 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-85fcf29f-dacf-4d37-b94e-b6813b8d0e12 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:35.788852 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-85fcf29f-dacf-4d37-b94e-b6813b8d0e12 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:35.789712 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-85fcf29f-dacf-4d37-b94e-b6813b8d0e12 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:35.956012 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-85fcf29f-dacf-4d37-b94e-b6813b8d0e12 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180861 Mar 12 20:50:35.956756 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 415/956] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 20:50:35 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:35.962867 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-959234d6-cd4d-4b09-a5f1-d77b6d494d81 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:35.964674 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-959234d6-cd4d-4b09-a5f1-d77b6d494d81 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:35.972094 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-959234d6-cd4d-4b09-a5f1-d77b6d494d81 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:35.973341 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-959234d6-cd4d-4b09-a5f1-d77b6d494d81 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:35.974489 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-959234d6-cd4d-4b09-a5f1-d77b6d494d81 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:35.975186 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-959234d6-cd4d-4b09-a5f1-d77b6d494d81 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:36.279484 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-959234d6-cd4d-4b09-a5f1-d77b6d494d81 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:36.288800 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-959234d6-cd4d-4b09-a5f1-d77b6d494d81 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1471 microversion: 2.1 time: 0.329867 Mar 12 20:50:36.289739 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 416/957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:35 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:36.294544 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b6274792-a5cf-4d96-9f28-45db25411147 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:36.295268 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b6274792-a5cf-4d96-9f28-45db25411147 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:36.301472 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b6274792-a5cf-4d96-9f28-45db25411147 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:36.302111 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b6274792-a5cf-4d96-9f28-45db25411147 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:36.303210 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b6274792-a5cf-4d96-9f28-45db25411147 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:36.304318 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b6274792-a5cf-4d96-9f28-45db25411147 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:36.637610 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b6274792-a5cf-4d96-9f28-45db25411147 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:36.671002 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b6274792-a5cf-4d96-9f28-45db25411147 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.380273 Mar 12 20:50:36.671991 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 417/958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:36 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:36.677468 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-75fc75c0-4260-410b-8321-ed6e7bdcc40d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:36.678106 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-75fc75c0-4260-410b-8321-ed6e7bdcc40d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:36.684962 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-75fc75c0-4260-410b-8321-ed6e7bdcc40d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:36.685638 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-75fc75c0-4260-410b-8321-ed6e7bdcc40d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:36.686636 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-75fc75c0-4260-410b-8321-ed6e7bdcc40d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:36.687236 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-75fc75c0-4260-410b-8321-ed6e7bdcc40d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:37.167441 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-75fc75c0-4260-410b-8321-ed6e7bdcc40d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:37.182631 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-75fc75c0-4260-410b-8321-ed6e7bdcc40d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1320 microversion: 2.1 time: 0.508888 Mar 12 20:50:37.194362 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 418/959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:36 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1320 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:37.214288 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5e766787-6a00-4479-836e-848a9feb9995 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:37.217219 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5e766787-6a00-4479-836e-848a9feb9995 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:37.235111 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5e766787-6a00-4479-836e-848a9feb9995 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:37.237305 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5e766787-6a00-4479-836e-848a9feb9995 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:37.239198 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5e766787-6a00-4479-836e-848a9feb9995 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:37.239912 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5e766787-6a00-4479-836e-848a9feb9995 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:37.875361 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5e766787-6a00-4479-836e-848a9feb9995 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:37.887246 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5e766787-6a00-4479-836e-848a9feb9995 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:37.891552 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5e766787-6a00-4479-836e-848a9feb9995 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:37.896017 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5e766787-6a00-4479-836e-848a9feb9995 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.697697 Mar 12 20:50:37.909344 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 419/960] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:37 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:37.917704 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f3bbd777-7d26-4713-83aa-e2f6b2e9d8b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:37.920562 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f3bbd777-7d26-4713-83aa-e2f6b2e9d8b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:37.947209 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f3bbd777-7d26-4713-83aa-e2f6b2e9d8b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:37.947668 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f3bbd777-7d26-4713-83aa-e2f6b2e9d8b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:37.948459 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f3bbd777-7d26-4713-83aa-e2f6b2e9d8b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:37.951423 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f3bbd777-7d26-4713-83aa-e2f6b2e9d8b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:38.130023 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f3bbd777-7d26-4713-83aa-e2f6b2e9d8b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:38.138987 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f3bbd777-7d26-4713-83aa-e2f6b2e9d8b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:38.144971 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f3bbd777-7d26-4713-83aa-e2f6b2e9d8b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:38.156283 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f3bbd777-7d26-4713-83aa-e2f6b2e9d8b5 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.245178 Mar 12 20:50:38.165711 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 420/961] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:37 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:38.173790 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-35bb73a1-b24e-453d-bc9b-4e68bcbc7974 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:38.174723 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-35bb73a1-b24e-453d-bc9b-4e68bcbc7974 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:38.187631 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-35bb73a1-b24e-453d-bc9b-4e68bcbc7974 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:38.189843 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-35bb73a1-b24e-453d-bc9b-4e68bcbc7974 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:38.193384 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-35bb73a1-b24e-453d-bc9b-4e68bcbc7974 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:38.193875 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-35bb73a1-b24e-453d-bc9b-4e68bcbc7974 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:38.328212 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e70258a-6065-4497-b689-ce581acce19c tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0/action" status: 202 len: 0 microversion: 2.1 time: 3.437115 Mar 12 20:50:38.332712 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 542/962] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:50:34 2022] POST /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0/action => generated 0 bytes in 3443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:38.340610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0bfffd3c-0f4d-4c15-9d1f-3ab229b5c66c req-c208e005-8e99-4046-9ef7-b628eebe33b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd6521d-0ecb-4305-b6ed-3bb25beb06f0", "tag": "cf141759-7771-46fc-9b0d-eae4f5b9bbb0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:38.355059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0bfffd3c-0f4d-4c15-9d1f-3ab229b5c66c req-c208e005-8e99-4046-9ef7-b628eebe33b3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:38.356064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0bfffd3c-0f4d-4c15-9d1f-3ab229b5c66c req-c208e005-8e99-4046-9ef7-b628eebe33b3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:38.380027 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0bfffd3c-0f4d-4c15-9d1f-3ab229b5c66c req-c208e005-8e99-4046-9ef7-b628eebe33b3 service nova] Creating event network-changed:cf141759-7771-46fc-9b0d-eae4f5b9bbb0 for instance 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 on nch2-master-1 Mar 12 20:50:38.391587 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0bfffd3c-0f4d-4c15-9d1f-3ab229b5c66c req-c208e005-8e99-4046-9ef7-b628eebe33b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056280 Mar 12 20:50:38.393646 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 543/963] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:38.405317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5146baff-39c3-43b5-a625-ff4cfdd33e9d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:38.407167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5146baff-39c3-43b5-a625-ff4cfdd33e9d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:38.421810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5146baff-39c3-43b5-a625-ff4cfdd33e9d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:38.422713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5146baff-39c3-43b5-a625-ff4cfdd33e9d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:38.426390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5146baff-39c3-43b5-a625-ff4cfdd33e9d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:38.427418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5146baff-39c3-43b5-a625-ff4cfdd33e9d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:38.695039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5146baff-39c3-43b5-a625-ff4cfdd33e9d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:38.705391 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5146baff-39c3-43b5-a625-ff4cfdd33e9d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.309539 Mar 12 20:50:38.706110 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 544/964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:38 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:38.719054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e0855242-8e52-4c3b-88d6-81a53c622f86 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:38.720010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e0855242-8e52-4c3b-88d6-81a53c622f86 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:38.727462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0855242-8e52-4c3b-88d6-81a53c622f86 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:38.728482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0855242-8e52-4c3b-88d6-81a53c622f86 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:38.729495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0855242-8e52-4c3b-88d6-81a53c622f86 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:38.730185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0855242-8e52-4c3b-88d6-81a53c622f86 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:38.993953 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-35bb73a1-b24e-453d-bc9b-4e68bcbc7974 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:39.006244 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-35bb73a1-b24e-453d-bc9b-4e68bcbc7974 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1471 microversion: 2.1 time: 0.838610 Mar 12 20:50:39.010148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e0855242-8e52-4c3b-88d6-81a53c622f86 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:39.018410 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 421/965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:38 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1471 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:39.019474 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e0855242-8e52-4c3b-88d6-81a53c622f86 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1588 microversion: 2.1 time: 0.311074 Mar 12 20:50:39.021322 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 545/966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:38 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1588 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:39.026496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51ec473d-2914-4737-99ff-5f0e6cd95721 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:39.027112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51ec473d-2914-4737-99ff-5f0e6cd95721 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:39.033171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51ec473d-2914-4737-99ff-5f0e6cd95721 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:39.033890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51ec473d-2914-4737-99ff-5f0e6cd95721 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:39.034830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51ec473d-2914-4737-99ff-5f0e6cd95721 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:39.035461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51ec473d-2914-4737-99ff-5f0e6cd95721 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:39.061976 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-5597983c-e4a0-4d9d-926d-3de0fd84db1b req-e18b5857-7ca2-4fc9-a9d0-fc83e11c0157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa543f4a-cb64-4ec9-9863-2f1fb751ef01", "tag": "b56cfd9b-9a8c-494a-8ad8-518a7d6a9a02"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:39.086848 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-5597983c-e4a0-4d9d-926d-3de0fd84db1b req-e18b5857-7ca2-4fc9-a9d0-fc83e11c0157 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:39.087375 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-5597983c-e4a0-4d9d-926d-3de0fd84db1b req-e18b5857-7ca2-4fc9-a9d0-fc83e11c0157 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:39.112143 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-5597983c-e4a0-4d9d-926d-3de0fd84db1b req-e18b5857-7ca2-4fc9-a9d0-fc83e11c0157 service nova] Creating event network-changed:b56cfd9b-9a8c-494a-8ad8-518a7d6a9a02 for instance aa543f4a-cb64-4ec9-9863-2f1fb751ef01 on nch2-master-1 Mar 12 20:50:39.118357 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-5597983c-e4a0-4d9d-926d-3de0fd84db1b req-e18b5857-7ca2-4fc9-a9d0-fc83e11c0157 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098336 Mar 12 20:50:39.130211 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 422/967] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:39.139555 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f1a8d0bb-acc2-4edc-b5e3-8521aefc7306 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:39.141163 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f1a8d0bb-acc2-4edc-b5e3-8521aefc7306 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:39.148275 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f1a8d0bb-acc2-4edc-b5e3-8521aefc7306 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:39.154239 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f1a8d0bb-acc2-4edc-b5e3-8521aefc7306 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:39.155569 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f1a8d0bb-acc2-4edc-b5e3-8521aefc7306 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:39.156087 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f1a8d0bb-acc2-4edc-b5e3-8521aefc7306 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:39.345548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51ec473d-2914-4737-99ff-5f0e6cd95721 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:39.354839 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51ec473d-2914-4737-99ff-5f0e6cd95721 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1320 microversion: 2.1 time: 0.332219 Mar 12 20:50:39.355650 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 546/968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:39 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1320 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:39.360443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b5916dc8-aa57-4d18-b701-2073145be13f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:39.361257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b5916dc8-aa57-4d18-b701-2073145be13f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:39.368044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5916dc8-aa57-4d18-b701-2073145be13f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:39.368700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5916dc8-aa57-4d18-b701-2073145be13f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:39.369491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5916dc8-aa57-4d18-b701-2073145be13f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:39.369968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5916dc8-aa57-4d18-b701-2073145be13f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:39.512565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b5916dc8-aa57-4d18-b701-2073145be13f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:39.521926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b5916dc8-aa57-4d18-b701-2073145be13f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:39.523873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b5916dc8-aa57-4d18-b701-2073145be13f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:39.526344 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b5916dc8-aa57-4d18-b701-2073145be13f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.169502 Mar 12 20:50:39.539763 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 547/969] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:39 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:39.545692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35409e68-7b6d-4c75-b3e8-b0cb005404c6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:39.546662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-35409e68-7b6d-4c75-b3e8-b0cb005404c6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:39.554106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35409e68-7b6d-4c75-b3e8-b0cb005404c6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:39.554763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35409e68-7b6d-4c75-b3e8-b0cb005404c6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:39.555749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35409e68-7b6d-4c75-b3e8-b0cb005404c6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:39.556348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35409e68-7b6d-4c75-b3e8-b0cb005404c6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:39.652061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-35409e68-7b6d-4c75-b3e8-b0cb005404c6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:39.661463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-35409e68-7b6d-4c75-b3e8-b0cb005404c6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:39.662996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-35409e68-7b6d-4c75-b3e8-b0cb005404c6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:39.668772 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-35409e68-7b6d-4c75-b3e8-b0cb005404c6 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1447 microversion: 2.75 time: 0.127568 Mar 12 20:50:39.669356 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 548/970] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:39 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:39.715403 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f1a8d0bb-acc2-4edc-b5e3-8521aefc7306 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:39.724589 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f1a8d0bb-acc2-4edc-b5e3-8521aefc7306 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.592351 Mar 12 20:50:39.734605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-feb24ee0-3650-4d65-b188-49c09f434e2e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:39.734791 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 423/971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:39 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:39.734913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-feb24ee0-3650-4d65-b188-49c09f434e2e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:39.734913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feb24ee0-3650-4d65-b188-49c09f434e2e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:39.734913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feb24ee0-3650-4d65-b188-49c09f434e2e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:39.734913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feb24ee0-3650-4d65-b188-49c09f434e2e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:39.735275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feb24ee0-3650-4d65-b188-49c09f434e2e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:39.879313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-feb24ee0-3650-4d65-b188-49c09f434e2e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:39.887567 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-feb24ee0-3650-4d65-b188-49c09f434e2e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.168787 Mar 12 20:50:39.888470 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 549/972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:39 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:40.024574 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c3d8b2c7-cc0c-4d8e-80b3-7af40c5a468d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:40.025138 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c3d8b2c7-cc0c-4d8e-80b3-7af40c5a468d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:40.031718 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c3d8b2c7-cc0c-4d8e-80b3-7af40c5a468d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:40.032317 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c3d8b2c7-cc0c-4d8e-80b3-7af40c5a468d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:40.033225 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c3d8b2c7-cc0c-4d8e-80b3-7af40c5a468d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:40.034189 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c3d8b2c7-cc0c-4d8e-80b3-7af40c5a468d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:40.310795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cfc1a662-614e-43f8-96d0-01a4639e81d0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Action: 'create', calling method: .version_select at 0x7f6e36f440d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1904610733", "policies": ["affinity"]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:40.329530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cfc1a662-614e-43f8-96d0-01a4639e81d0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:40.336038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cfc1a662-614e-43f8-96d0-01a4639e81d0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:40.387425 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c3d8b2c7-cc0c-4d8e-80b3-7af40c5a468d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:40.390811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cfc1a662-614e-43f8-96d0-01a4639e81d0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:40.394920 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c3d8b2c7-cc0c-4d8e-80b3-7af40c5a468d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.375283 Mar 12 20:50:40.395538 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 424/973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:40 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:40.396066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cfc1a662-614e-43f8-96d0-01a4639e81d0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:40.400543 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ad1d32b5-f7a1-4ae2-9188-7fed0cef3aff tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:40.401145 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ad1d32b5-f7a1-4ae2-9188-7fed0cef3aff tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:40.407082 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ad1d32b5-f7a1-4ae2-9188-7fed0cef3aff tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:40.407537 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ad1d32b5-f7a1-4ae2-9188-7fed0cef3aff tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:40.408337 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ad1d32b5-f7a1-4ae2-9188-7fed0cef3aff tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:40.408786 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ad1d32b5-f7a1-4ae2-9188-7fed0cef3aff tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:40.419560 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cfc1a662-614e-43f8-96d0-01a4639e81d0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.271572 Mar 12 20:50:40.421929 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 550/974] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Mar 12 20:50:40 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:40.431729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fff07a1f-da79-49d3-ae07-7debb4faf7b3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Action: 'create', calling method: .version_select at 0x7f6e36f46dc0>, body: {"server_group": {"name": "tempest-server-group-30885258", "policies": ["affinity"]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:40.447524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fff07a1f-da79-49d3-ae07-7debb4faf7b3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:40.452551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fff07a1f-da79-49d3-ae07-7debb4faf7b3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:40.494035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fff07a1f-da79-49d3-ae07-7debb4faf7b3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:40.498796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fff07a1f-da79-49d3-ae07-7debb4faf7b3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:40.511934 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fff07a1f-da79-49d3-ae07-7debb4faf7b3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.083949 Mar 12 20:50:40.512553 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 551/975] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Mar 12 20:50:40 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:40.522831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-931d7f3a-ebda-444e-a9ba-73fd71a8cd3e tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Action: 'create', calling method: .version_select at 0x7f6e36fa4dc0>, body: {"server_group": {"name": "tempest-server-group-30885258", "policies": ["affinity"]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:40.543107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-931d7f3a-ebda-444e-a9ba-73fd71a8cd3e tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:40.548520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-931d7f3a-ebda-444e-a9ba-73fd71a8cd3e tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:40.596094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-931d7f3a-ebda-444e-a9ba-73fd71a8cd3e tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:40.602469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-931d7f3a-ebda-444e-a9ba-73fd71a8cd3e tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:40.616868 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-931d7f3a-ebda-444e-a9ba-73fd71a8cd3e tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.098608 Mar 12 20:50:40.622100 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 552/976] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Mar 12 20:50:40 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:40.625940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39556aa8-750e-4748-b265-5328cff5ba8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:40.626563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39556aa8-750e-4748-b265-5328cff5ba8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:40.635834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39556aa8-750e-4748-b265-5328cff5ba8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:40.636879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39556aa8-750e-4748-b265-5328cff5ba8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:40.638479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39556aa8-750e-4748-b265-5328cff5ba8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:40.639185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39556aa8-750e-4748-b265-5328cff5ba8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:40.649742 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ad1d32b5-f7a1-4ae2-9188-7fed0cef3aff tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:40.658166 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ad1d32b5-f7a1-4ae2-9188-7fed0cef3aff tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1320 microversion: 2.1 time: 0.261308 Mar 12 20:50:40.658737 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 425/977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:40 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:40.667376 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-03e9a360-4495-4e52-9e24-9c21dcb7adc9 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:40.710111 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-03e9a360-4495-4e52-9e24-9c21dcb7adc9 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/fd09df0e-2a82-4952-b325-fe765f1095eb" status: 204 len: 0 microversion: 2.1 time: 0.046097 Mar 12 20:50:40.710616 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 426/978] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 20:50:40 2022] DELETE /compute/v2.1/os-server-groups/fd09df0e-2a82-4952-b325-fe765f1095eb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:50:40.715298 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e226f150-30ed-4c24-8941-84b5d01d975a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:40.715926 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e226f150-30ed-4c24-8941-84b5d01d975a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:40.723332 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e226f150-30ed-4c24-8941-84b5d01d975a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:40.723802 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e226f150-30ed-4c24-8941-84b5d01d975a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:40.724719 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e226f150-30ed-4c24-8941-84b5d01d975a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:40.725169 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e226f150-30ed-4c24-8941-84b5d01d975a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:40.782793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39556aa8-750e-4748-b265-5328cff5ba8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:40.787411 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e226f150-30ed-4c24-8941-84b5d01d975a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:40.791753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39556aa8-750e-4748-b265-5328cff5ba8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:40.793276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39556aa8-750e-4748-b265-5328cff5ba8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:40.794452 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39556aa8-750e-4748-b265-5328cff5ba8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.175718 Mar 12 20:50:40.795010 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 553/979] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:40 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:40.795216 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e226f150-30ed-4c24-8941-84b5d01d975a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:40.796786 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e226f150-30ed-4c24-8941-84b5d01d975a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:40.799479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-695bb9b6-1ecf-4797-87d3-094fc662e559 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:40.802384 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e226f150-30ed-4c24-8941-84b5d01d975a tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1453 microversion: 2.75 time: 0.090820 Mar 12 20:50:40.803235 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 427/980] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:40 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:40.810778 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-90aa82ad-abf4-4163-a15a-49aa7f6c0cd9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:40.812320 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-90aa82ad-abf4-4163-a15a-49aa7f6c0cd9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:40.817204 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-695bb9b6-1ecf-4797-87d3-094fc662e559 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.021169 Mar 12 20:50:40.817353 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-90aa82ad-abf4-4163-a15a-49aa7f6c0cd9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:40.817748 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 554/981] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:50:40 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:40.817922 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-90aa82ad-abf4-4163-a15a-49aa7f6c0cd9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:40.818711 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-90aa82ad-abf4-4163-a15a-49aa7f6c0cd9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:40.819156 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-90aa82ad-abf4-4163-a15a-49aa7f6c0cd9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:40.827618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0929b79-6a0a-46fd-97b8-e6548ae1e319 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:40.867802 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0929b79-6a0a-46fd-97b8-e6548ae1e319 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/a9daf5be-22be-44d7-a1e4-4b4cfd3d1b5d" status: 204 len: 0 microversion: 2.1 time: 0.043766 Mar 12 20:50:40.868604 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 555/982] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 20:50:40 2022] DELETE /compute/v2.1/os-server-groups/a9daf5be-22be-44d7-a1e4-4b4cfd3d1b5d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 20:50:40.876117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-707a8815-cce4-4635-9e3c-55c5f85057f0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:40.885260 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-707a8815-cce4-4635-9e3c-55c5f85057f0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.012729 Mar 12 20:50:40.885919 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 556/983] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:50:40 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:40.896993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3036e43c-dda5-4479-be67-982c55cd75a0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Action: 'create', calling method: .version_select at 0x7f6e3709adc0>, body: {"server_group": {"name": "tempest-server-group-1191804656", "policies": ["affinity"]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:40.913637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3036e43c-dda5-4479-be67-982c55cd75a0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:40.918494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3036e43c-dda5-4479-be67-982c55cd75a0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:40.958734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3036e43c-dda5-4479-be67-982c55cd75a0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:40.963516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3036e43c-dda5-4479-be67-982c55cd75a0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:40.967238 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-90aa82ad-abf4-4163-a15a-49aa7f6c0cd9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:40.975661 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-90aa82ad-abf4-4163-a15a-49aa7f6c0cd9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.168515 Mar 12 20:50:40.976139 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3036e43c-dda5-4479-be67-982c55cd75a0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.083225 Mar 12 20:50:40.976596 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 428/984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:40 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:40.981113 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-41e83a24-696b-4a12-b129-7c50542ecd94 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:40.981666 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 557/985] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Mar 12 20:50:40 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:40.981882 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-41e83a24-696b-4a12-b129-7c50542ecd94 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:40.987868 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-41e83a24-696b-4a12-b129-7c50542ecd94 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:40.988962 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-41e83a24-696b-4a12-b129-7c50542ecd94 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:40.989785 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-41e83a24-696b-4a12-b129-7c50542ecd94 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:40.990230 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-41e83a24-696b-4a12-b129-7c50542ecd94 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:40.991664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2815c1cf-2e0a-4373-9a09-b8cf83da1daa tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:41.014823 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2815c1cf-2e0a-4373-9a09-b8cf83da1daa tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/dff69bbd-a75b-47ff-b6f9-4ab5a4fa81b0" status: 204 len: 0 microversion: 2.1 time: 0.027475 Mar 12 20:50:41.015589 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 558/986] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 20:50:40 2022] DELETE /compute/v2.1/os-server-groups/dff69bbd-a75b-47ff-b6f9-4ab5a4fa81b0 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 20:50:41.023179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be1118dc-2373-413c-b8fd-4b2a290af98a tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:41.031551 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be1118dc-2373-413c-b8fd-4b2a290af98a tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.012121 Mar 12 20:50:41.032125 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 559/987] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:50:41 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:41.042639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2a5c4eef-6cde-42cc-bc9e-805451daf4eb tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Action: 'create', calling method: .version_select at 0x7f6e3708a550>, body: {"server_group": {"name": "tempest-server-group-1789813601", "policies": ["anti-affinity"]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:41.059037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2a5c4eef-6cde-42cc-bc9e-805451daf4eb tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:41.064927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2a5c4eef-6cde-42cc-bc9e-805451daf4eb tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:41.105616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2a5c4eef-6cde-42cc-bc9e-805451daf4eb tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:41.110395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2a5c4eef-6cde-42cc-bc9e-805451daf4eb tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:41.122481 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2a5c4eef-6cde-42cc-bc9e-805451daf4eb tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.083410 Mar 12 20:50:41.123087 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 560/988] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Mar 12 20:50:41 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:41.127608 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-41e83a24-696b-4a12-b129-7c50542ecd94 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:41.132482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8923de99-034e-4139-95f0-e9f7721aa25b tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:41.135172 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-41e83a24-696b-4a12-b129-7c50542ecd94 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.157585 Mar 12 20:50:41.135749 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 429/989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:40 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:41.155273 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8923de99-034e-4139-95f0-e9f7721aa25b tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/b917db8b-7e74-454c-8052-ae9e69d4d044" status: 204 len: 0 microversion: 2.1 time: 0.026415 Mar 12 20:50:41.155844 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 561/990] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 20:50:41 2022] DELETE /compute/v2.1/os-server-groups/b917db8b-7e74-454c-8052-ae9e69d4d044 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 20:50:41.164227 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-88c843d9-91e7-4023-a23c-3ae719d7ff8a tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:41.176371 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-88c843d9-91e7-4023-a23c-3ae719d7ff8a tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016433 Mar 12 20:50:41.177125 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 430/991] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:50:41 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:41.226182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-215962265", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "c6cf1b59-7cd4-4151-9ee6-c5f1d44a25f5"}]}, "os:scheduler_hints": {"group": "a2528881-9c10-485f-810f-f5d2952372d5"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:41.276266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] validate_networks() for [('c6cf1b59-7cd4-4151-9ee6-c5f1d44a25f5', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:50:41.412646 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-452c7406-65a7-45f6-817b-c616f7d08edc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:41.413268 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-452c7406-65a7-45f6-817b-c616f7d08edc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:41.420432 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-452c7406-65a7-45f6-817b-c616f7d08edc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:41.420891 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-452c7406-65a7-45f6-817b-c616f7d08edc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:41.421669 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-452c7406-65a7-45f6-817b-c616f7d08edc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:41.422144 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-452c7406-65a7-45f6-817b-c616f7d08edc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:41.579014 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-452c7406-65a7-45f6-817b-c616f7d08edc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:41.590012 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-452c7406-65a7-45f6-817b-c616f7d08edc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.181763 Mar 12 20:50:41.590830 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 431/992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:41 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:41.634835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:50:41.635326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:50:41.635759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:50:41.636173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:50:41.636591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:50:41.652515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:41.653090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:41.654107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:41.654630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:41.671000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:41.675149 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-028d27c1-df56-40b7-9005-8cf4246a9cb3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:41.675829 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-028d27c1-df56-40b7-9005-8cf4246a9cb3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:41.676093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:41.682156 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-028d27c1-df56-40b7-9005-8cf4246a9cb3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:41.682875 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-028d27c1-df56-40b7-9005-8cf4246a9cb3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:41.683545 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-028d27c1-df56-40b7-9005-8cf4246a9cb3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:41.684165 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-028d27c1-df56-40b7-9005-8cf4246a9cb3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:41.695951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:50:41.699028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:50:41.737854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=136302) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Mar 12 20:50:41.756501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:41.761567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:41.803858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:50:41.808829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Getting quotas for user 6faf510273c94084909be1629e28c4a8 and project 5891231c0d2941fb97d87e989c3bdd67. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:50:41.818888 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-028d27c1-df56-40b7-9005-8cf4246a9cb3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:41.826741 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-028d27c1-df56-40b7-9005-8cf4246a9cb3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1320 microversion: 2.1 time: 0.155592 Mar 12 20:50:41.831816 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 432/993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:41 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:41.832399 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-04e6be04-afbc-40a2-bbdd-b3ff2345f8ed tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:41.833151 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-04e6be04-afbc-40a2-bbdd-b3ff2345f8ed tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:41.839213 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9e3a318-9a09-41e2-b4d9-a41e38f811a3 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617434 Mar 12 20:50:41.839864 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 562/994] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:50:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:50:41.844828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cd7afa06-0357-4deb-9a75-8b0eea2a3f5d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:41.845504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cd7afa06-0357-4deb-9a75-8b0eea2a3f5d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:41.851622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd7afa06-0357-4deb-9a75-8b0eea2a3f5d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:41.852083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd7afa06-0357-4deb-9a75-8b0eea2a3f5d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:41.852796 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-04e6be04-afbc-40a2-bbdd-b3ff2345f8ed tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:41.852945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd7afa06-0357-4deb-9a75-8b0eea2a3f5d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:41.853261 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-04e6be04-afbc-40a2-bbdd-b3ff2345f8ed tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:41.853377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd7afa06-0357-4deb-9a75-8b0eea2a3f5d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:41.854077 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-04e6be04-afbc-40a2-bbdd-b3ff2345f8ed tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:41.854524 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-04e6be04-afbc-40a2-bbdd-b3ff2345f8ed tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:41.929275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd7afa06-0357-4deb-9a75-8b0eea2a3f5d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:41.937299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd7afa06-0357-4deb-9a75-8b0eea2a3f5d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:41.938949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd7afa06-0357-4deb-9a75-8b0eea2a3f5d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:41.944830 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cd7afa06-0357-4deb-9a75-8b0eea2a3f5d tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1453 microversion: 2.75 time: 0.103992 Mar 12 20:50:41.945878 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 563/995] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:41 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:41.961270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4f772fd-4a15-43b4-88e6-af89a87c2a7d tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:41.961913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b4f772fd-4a15-43b4-88e6-af89a87c2a7d tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:42.005657 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-04e6be04-afbc-40a2-bbdd-b3ff2345f8ed tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:42.014746 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-04e6be04-afbc-40a2-bbdd-b3ff2345f8ed tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:42.015136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b4f772fd-4a15-43b4-88e6-af89a87c2a7d tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:42.016151 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-04e6be04-afbc-40a2-bbdd-b3ff2345f8ed tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:42.017302 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-04e6be04-afbc-40a2-bbdd-b3ff2345f8ed tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.188806 Mar 12 20:50:42.018178 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 433/996] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:41 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:42.022748 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-270b96ab-3446-46fc-9a4c-93e1d86af622 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:42.023354 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-270b96ab-3446-46fc-9a4c-93e1d86af622 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:42.026841 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b4f772fd-4a15-43b4-88e6-af89a87c2a7d tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1212 microversion: 2.1 time: 0.068871 Mar 12 20:50:42.027840 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 564/997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:41 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1212 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:42.029061 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-270b96ab-3446-46fc-9a4c-93e1d86af622 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:42.029525 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-270b96ab-3446-46fc-9a4c-93e1d86af622 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:42.030361 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-270b96ab-3446-46fc-9a4c-93e1d86af622 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:42.030754 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-270b96ab-3446-46fc-9a4c-93e1d86af622 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:42.151715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4253d0f2-8d8c-44af-9e25-5dcbe8e1f48c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:42.152360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4253d0f2-8d8c-44af-9e25-5dcbe8e1f48c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:42.164235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4253d0f2-8d8c-44af-9e25-5dcbe8e1f48c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:42.164689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4253d0f2-8d8c-44af-9e25-5dcbe8e1f48c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:42.165479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4253d0f2-8d8c-44af-9e25-5dcbe8e1f48c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:42.165952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4253d0f2-8d8c-44af-9e25-5dcbe8e1f48c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:42.198994 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-270b96ab-3446-46fc-9a4c-93e1d86af622 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:42.218906 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-270b96ab-3446-46fc-9a4c-93e1d86af622 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.199732 Mar 12 20:50:42.229992 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 434/998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:42 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:42.325562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4253d0f2-8d8c-44af-9e25-5dcbe8e1f48c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:42.334383 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4253d0f2-8d8c-44af-9e25-5dcbe8e1f48c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.186436 Mar 12 20:50:42.334973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 565/999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:42 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:42.608271 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-bc834139-0788-41ae-8167-de716b6568d2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:42.608966 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-bc834139-0788-41ae-8167-de716b6568d2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:42.620300 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bc834139-0788-41ae-8167-de716b6568d2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:42.620772 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bc834139-0788-41ae-8167-de716b6568d2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:42.621568 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bc834139-0788-41ae-8167-de716b6568d2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:42.622065 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bc834139-0788-41ae-8167-de716b6568d2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:42.774623 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-bc834139-0788-41ae-8167-de716b6568d2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:42.782538 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-bc834139-0788-41ae-8167-de716b6568d2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.179062 Mar 12 20:50:42.783201 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 435/1000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:42 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:42.843774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-485e8fb4-fde2-44f9-b3d1-8587eaa54389 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:42.844380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-485e8fb4-fde2-44f9-b3d1-8587eaa54389 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:42.851350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-485e8fb4-fde2-44f9-b3d1-8587eaa54389 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:42.851796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-485e8fb4-fde2-44f9-b3d1-8587eaa54389 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:42.852581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-485e8fb4-fde2-44f9-b3d1-8587eaa54389 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:42.853016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-485e8fb4-fde2-44f9-b3d1-8587eaa54389 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:42.964162 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-056bc602-1106-427a-af43-c8f10bf64752 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:42.964877 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-056bc602-1106-427a-af43-c8f10bf64752 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:42.970825 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-056bc602-1106-427a-af43-c8f10bf64752 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:42.971302 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-056bc602-1106-427a-af43-c8f10bf64752 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:42.972081 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-056bc602-1106-427a-af43-c8f10bf64752 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:42.972683 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-056bc602-1106-427a-af43-c8f10bf64752 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:42.987034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-485e8fb4-fde2-44f9-b3d1-8587eaa54389 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:42.995457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-485e8fb4-fde2-44f9-b3d1-8587eaa54389 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1320 microversion: 2.1 time: 0.155397 Mar 12 20:50:43.005219 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 566/1001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:42 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:43.035586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-522278d8-4b1c-4a04-87b6-2f886472b28e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:43.036249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-522278d8-4b1c-4a04-87b6-2f886472b28e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:43.042517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-522278d8-4b1c-4a04-87b6-2f886472b28e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:43.043053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-522278d8-4b1c-4a04-87b6-2f886472b28e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:43.043847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-522278d8-4b1c-4a04-87b6-2f886472b28e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:43.044293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-522278d8-4b1c-4a04-87b6-2f886472b28e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:43.057261 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-056bc602-1106-427a-af43-c8f10bf64752 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:43.066800 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-056bc602-1106-427a-af43-c8f10bf64752 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:43.068333 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-056bc602-1106-427a-af43-c8f10bf64752 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:43.073990 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-056bc602-1106-427a-af43-c8f10bf64752 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1453 microversion: 2.75 time: 0.113732 Mar 12 20:50:43.077842 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 436/1002] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:42 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:43.085894 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ef25597b-0d98-42d1-8621-871b8ce3cde6 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:43.086276 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ef25597b-0d98-42d1-8621-871b8ce3cde6 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:43.093809 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef25597b-0d98-42d1-8621-871b8ce3cde6 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:43.094267 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef25597b-0d98-42d1-8621-871b8ce3cde6 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:43.095053 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef25597b-0d98-42d1-8621-871b8ce3cde6 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:43.095496 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef25597b-0d98-42d1-8621-871b8ce3cde6 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:43.183836 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ef25597b-0d98-42d1-8621-871b8ce3cde6 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:43.185382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-522278d8-4b1c-4a04-87b6-2f886472b28e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:43.192349 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ef25597b-0d98-42d1-8621-871b8ce3cde6 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1264 microversion: 2.1 time: 0.116435 Mar 12 20:50:43.193271 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 437/1003] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:43 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1264 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:43.197924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-522278d8-4b1c-4a04-87b6-2f886472b28e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:43.199601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-522278d8-4b1c-4a04-87b6-2f886472b28e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:43.200829 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-522278d8-4b1c-4a04-87b6-2f886472b28e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.169357 Mar 12 20:50:43.201563 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 567/1004] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:43 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:43.237575 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f53c2586-5bd7-4480-a1ed-be6f1599a0b7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:43.238618 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f53c2586-5bd7-4480-a1ed-be6f1599a0b7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:43.244847 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f53c2586-5bd7-4480-a1ed-be6f1599a0b7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:43.245280 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f53c2586-5bd7-4480-a1ed-be6f1599a0b7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:43.246121 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f53c2586-5bd7-4480-a1ed-be6f1599a0b7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:43.246560 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f53c2586-5bd7-4480-a1ed-be6f1599a0b7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:43.351489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-57ac548c-0a6b-4aa6-bde1-c352a81061c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:43.352435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-57ac548c-0a6b-4aa6-bde1-c352a81061c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:43.364391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57ac548c-0a6b-4aa6-bde1-c352a81061c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:43.365388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57ac548c-0a6b-4aa6-bde1-c352a81061c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:43.366580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57ac548c-0a6b-4aa6-bde1-c352a81061c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:43.367219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57ac548c-0a6b-4aa6-bde1-c352a81061c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:43.550068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-57ac548c-0a6b-4aa6-bde1-c352a81061c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:43.558588 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-57ac548c-0a6b-4aa6-bde1-c352a81061c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.211328 Mar 12 20:50:43.559172 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 568/1005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:43 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:43.801191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-74e16d50-b4e4-4242-9d09-69e5cdfd1290 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:43.801734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-74e16d50-b4e4-4242-9d09-69e5cdfd1290 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:43.807927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74e16d50-b4e4-4242-9d09-69e5cdfd1290 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:43.808383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74e16d50-b4e4-4242-9d09-69e5cdfd1290 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:43.809161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74e16d50-b4e4-4242-9d09-69e5cdfd1290 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:43.809747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74e16d50-b4e4-4242-9d09-69e5cdfd1290 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:43.852460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f53c2586-5bd7-4480-a1ed-be6f1599a0b7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:43.868521 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f53c2586-5bd7-4480-a1ed-be6f1599a0b7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.634888 Mar 12 20:50:43.869302 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 438/1006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:43 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:43.967007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-74e16d50-b4e4-4242-9d09-69e5cdfd1290 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:43.982624 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-5f037266-3d5b-466a-a9c7-ec79ad55fe7b req-a0bba6d9-7f71-41c9-9914-9d8e99d282d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b3b4cce-d19a-479c-adcf-03afc06cf8e0", "name": "network-vif-unplugged", "status": "completed", "tag": "70b96b8e-4df3-42a1-a05b-4818b836f46f"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:43.983437 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-74e16d50-b4e4-4242-9d09-69e5cdfd1290 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.186384 Mar 12 20:50:43.986552 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 569/1007] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:43 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:43.992300 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-5f037266-3d5b-466a-a9c7-ec79ad55fe7b req-a0bba6d9-7f71-41c9-9914-9d8e99d282d5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:43.992747 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-5f037266-3d5b-466a-a9c7-ec79ad55fe7b req-a0bba6d9-7f71-41c9-9914-9d8e99d282d5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.007432 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-5f037266-3d5b-466a-a9c7-ec79ad55fe7b req-a0bba6d9-7f71-41c9-9914-9d8e99d282d5 service nova] Creating event network-vif-unplugged:70b96b8e-4df3-42a1-a05b-4818b836f46f for instance 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 on nch2-master-1 Mar 12 20:50:44.014664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bcde1a28-7893-497c-b698-5fbdddcf05b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:44.015846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bcde1a28-7893-497c-b698-5fbdddcf05b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:44.025755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcde1a28-7893-497c-b698-5fbdddcf05b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.026342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcde1a28-7893-497c-b698-5fbdddcf05b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.027021 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-5f037266-3d5b-466a-a9c7-ec79ad55fe7b req-a0bba6d9-7f71-41c9-9914-9d8e99d282d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049283 Mar 12 20:50:44.027740 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 439/1008] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:44.028111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcde1a28-7893-497c-b698-5fbdddcf05b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.028645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcde1a28-7893-497c-b698-5fbdddcf05b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.095880 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f2f31198-2c84-42f8-8654-3416a5b47194 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:44.102299 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f2f31198-2c84-42f8-8654-3416a5b47194 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:44.110636 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f2f31198-2c84-42f8-8654-3416a5b47194 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.116142 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f2f31198-2c84-42f8-8654-3416a5b47194 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.118001 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f2f31198-2c84-42f8-8654-3416a5b47194 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.118461 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f2f31198-2c84-42f8-8654-3416a5b47194 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.232890 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f2f31198-2c84-42f8-8654-3416a5b47194 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:44.245409 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f2f31198-2c84-42f8-8654-3416a5b47194 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:44.248136 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f2f31198-2c84-42f8-8654-3416a5b47194 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:44.251344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bcde1a28-7893-497c-b698-5fbdddcf05b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:44.256160 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f2f31198-2c84-42f8-8654-3416a5b47194 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1438 microversion: 2.75 time: 0.163905 Mar 12 20:50:44.257306 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 440/1009] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:44 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1438 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:44.262752 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e79b5081-157b-42f8-ab34-95ea52259ca4 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:44.263454 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e79b5081-157b-42f8-ab34-95ea52259ca4 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:44.273824 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bcde1a28-7893-497c-b698-5fbdddcf05b3 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1320 microversion: 2.1 time: 0.264446 Mar 12 20:50:44.274597 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 570/1010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:44 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:44.279490 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e79b5081-157b-42f8-ab34-95ea52259ca4 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.279988 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e79b5081-157b-42f8-ab34-95ea52259ca4 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.282146 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e79b5081-157b-42f8-ab34-95ea52259ca4 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.283216 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e79b5081-157b-42f8-ab34-95ea52259ca4 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.288511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ccc48b8e-c2e8-4655-b838-acdcac6878ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:44.289129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ccc48b8e-c2e8-4655-b838-acdcac6878ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:44.296004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccc48b8e-c2e8-4655-b838-acdcac6878ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.296451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccc48b8e-c2e8-4655-b838-acdcac6878ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.297243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccc48b8e-c2e8-4655-b838-acdcac6878ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.298006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccc48b8e-c2e8-4655-b838-acdcac6878ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.377812 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e79b5081-157b-42f8-ab34-95ea52259ca4 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:44.389025 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e79b5081-157b-42f8-ab34-95ea52259ca4 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1270 microversion: 2.1 time: 0.130294 Mar 12 20:50:44.389970 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 441/1011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:44 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1270 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:44.475266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ccc48b8e-c2e8-4655-b838-acdcac6878ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:44.484730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ccc48b8e-c2e8-4655-b838-acdcac6878ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:44.486261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ccc48b8e-c2e8-4655-b838-acdcac6878ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:44.488004 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ccc48b8e-c2e8-4655-b838-acdcac6878ea tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.203868 Mar 12 20:50:44.489088 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 571/1012] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:44 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:44.493660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-62554121-459e-45f6-a2a6-f54f9b419ccb req-a4543ea7-c56f-465d-9daf-82218e97532c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd6521d-0ecb-4305-b6ed-3bb25beb06f0", "name": "network-vif-plugged", "status": "completed", "tag": "cf141759-7771-46fc-9b0d-eae4f5b9bbb0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:44.501972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-62554121-459e-45f6-a2a6-f54f9b419ccb req-a4543ea7-c56f-465d-9daf-82218e97532c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.502930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-62554121-459e-45f6-a2a6-f54f9b419ccb req-a4543ea7-c56f-465d-9daf-82218e97532c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.513932 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-62554121-459e-45f6-a2a6-f54f9b419ccb req-a4543ea7-c56f-465d-9daf-82218e97532c service nova] Creating event network-vif-plugged:cf141759-7771-46fc-9b0d-eae4f5b9bbb0 for instance 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 on nch2-master-1 Mar 12 20:50:44.520128 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-62554121-459e-45f6-a2a6-f54f9b419ccb req-a4543ea7-c56f-465d-9daf-82218e97532c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029199 Mar 12 20:50:44.520737 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 572/1013] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:44.526733 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:44.528392 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:44.536895 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.537349 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.538465 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.539922 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.577760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f0c59736-4371-4bf9-bf15-f1062791d37c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:44.578641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f0c59736-4371-4bf9-bf15-f1062791d37c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:44.588027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0c59736-4371-4bf9-bf15-f1062791d37c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.588408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0c59736-4371-4bf9-bf15-f1062791d37c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.589718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0c59736-4371-4bf9-bf15-f1062791d37c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.590580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0c59736-4371-4bf9-bf15-f1062791d37c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.653060 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:50:44.653500 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:50:44.654013 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:50:44.654768 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:50:44.655356 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:50:44.757139 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:44.773065 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.774832 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.775663 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.776238 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.822598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f0c59736-4371-4bf9-bf15-f1062791d37c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:44.839718 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f0c59736-4371-4bf9-bf15-f1062791d37c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.267749 Mar 12 20:50:44.852879 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 573/1014] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:44 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:44.890632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e27233d-17f1-4206-994f-ec3a7f7978f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:44.894294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e27233d-17f1-4206-994f-ec3a7f7978f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:44.926871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e27233d-17f1-4206-994f-ec3a7f7978f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.927416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e27233d-17f1-4206-994f-ec3a7f7978f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.929460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e27233d-17f1-4206-994f-ec3a7f7978f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:44.929944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e27233d-17f1-4206-994f-ec3a7f7978f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:44.987327 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:45.005318 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1d6b378a-2858-4a4a-a83e-7242b3482993 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e/action" status: 202 len: 1942 microversion: 2.75 time: 0.613504 Mar 12 20:50:45.006372 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 442/1015] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 20:50:44 2022] POST /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e/action => generated 1942 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 12 20:50:45.011508 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c435fe59-cfda-42e7-9e0a-fa7f35a8a9ec tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:45.012121 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c435fe59-cfda-42e7-9e0a-fa7f35a8a9ec tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:45.018171 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c435fe59-cfda-42e7-9e0a-fa7f35a8a9ec tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:45.018707 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c435fe59-cfda-42e7-9e0a-fa7f35a8a9ec tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:45.019543 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c435fe59-cfda-42e7-9e0a-fa7f35a8a9ec tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:45.020042 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c435fe59-cfda-42e7-9e0a-fa7f35a8a9ec tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:45.127382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8e27233d-17f1-4206-994f-ec3a7f7978f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:45.136429 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8e27233d-17f1-4206-994f-ec3a7f7978f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.254795 Mar 12 20:50:45.136998 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 574/1016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:44 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:45.141454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ef67f35-09c7-452d-bcab-8ef30388738e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:45.142092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8ef67f35-09c7-452d-bcab-8ef30388738e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:45.157908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ef67f35-09c7-452d-bcab-8ef30388738e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:45.158438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ef67f35-09c7-452d-bcab-8ef30388738e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:45.159210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ef67f35-09c7-452d-bcab-8ef30388738e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:45.159856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ef67f35-09c7-452d-bcab-8ef30388738e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:45.276091 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c435fe59-cfda-42e7-9e0a-fa7f35a8a9ec tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:45.295183 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c435fe59-cfda-42e7-9e0a-fa7f35a8a9ec tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.287659 Mar 12 20:50:45.295844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-8ef67f35-09c7-452d-bcab-8ef30388738e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:45.297214 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 443/1017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:45 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:45.318179 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ef67f35-09c7-452d-bcab-8ef30388738e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.179908 Mar 12 20:50:45.322201 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fb51e922-64be-4a0b-83f9-eed2b1bf0245 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:45.324322 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-fb51e922-64be-4a0b-83f9-eed2b1bf0245 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:45.331298 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 575/1018] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:45 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:45.341682 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fb51e922-64be-4a0b-83f9-eed2b1bf0245 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:45.345369 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fb51e922-64be-4a0b-83f9-eed2b1bf0245 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:45.347200 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fb51e922-64be-4a0b-83f9-eed2b1bf0245 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:45.348405 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fb51e922-64be-4a0b-83f9-eed2b1bf0245 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:45.408199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0997cee6-e7d4-4c0a-b47d-063d701966fa tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:45.408904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0997cee6-e7d4-4c0a-b47d-063d701966fa tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:45.417623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0997cee6-e7d4-4c0a-b47d-063d701966fa tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:45.418564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0997cee6-e7d4-4c0a-b47d-063d701966fa tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:45.418931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0997cee6-e7d4-4c0a-b47d-063d701966fa tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:45.419479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0997cee6-e7d4-4c0a-b47d-063d701966fa tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:45.569322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0997cee6-e7d4-4c0a-b47d-063d701966fa tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:45.580819 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0997cee6-e7d4-4c0a-b47d-063d701966fa tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1312 microversion: 2.1 time: 0.176751 Mar 12 20:50:45.582487 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 576/1019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:45 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:45.588051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5dfb0bfa-4ebc-4e26-998c-ef095647994e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:45.588794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5dfb0bfa-4ebc-4e26-998c-ef095647994e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:45.593166 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fb51e922-64be-4a0b-83f9-eed2b1bf0245 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:45.596117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5dfb0bfa-4ebc-4e26-998c-ef095647994e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:45.596698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5dfb0bfa-4ebc-4e26-998c-ef095647994e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:45.598588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5dfb0bfa-4ebc-4e26-998c-ef095647994e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:45.599113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5dfb0bfa-4ebc-4e26-998c-ef095647994e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:45.605072 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fb51e922-64be-4a0b-83f9-eed2b1bf0245 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1320 microversion: 2.1 time: 0.306059 Mar 12 20:50:45.605675 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 444/1020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:45 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1320 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:45.761189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5dfb0bfa-4ebc-4e26-998c-ef095647994e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:45.770634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5dfb0bfa-4ebc-4e26-998c-ef095647994e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:45.772217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5dfb0bfa-4ebc-4e26-998c-ef095647994e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:45.773553 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5dfb0bfa-4ebc-4e26-998c-ef095647994e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.190160 Mar 12 20:50:45.777817 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 577/1021] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:45 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:45.858039 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3d55314b-5c0e-4500-9cb3-fecbfa7ee089 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:45.858877 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3d55314b-5c0e-4500-9cb3-fecbfa7ee089 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:45.865620 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3d55314b-5c0e-4500-9cb3-fecbfa7ee089 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:45.866233 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3d55314b-5c0e-4500-9cb3-fecbfa7ee089 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:45.867014 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3d55314b-5c0e-4500-9cb3-fecbfa7ee089 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:45.867456 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3d55314b-5c0e-4500-9cb3-fecbfa7ee089 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.092859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-87847e88-10b9-45a0-96c5-3f65bcd519cd req-42464af7-5eba-49ab-a47f-bffa6b389a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b3b4cce-d19a-479c-adcf-03afc06cf8e0", "tag": "70b96b8e-4df3-42a1-a05b-4818b836f46f"}, {"name": "network-changed", "server_uuid": "373aba85-cb1c-4089-a05b-d4d3af08220e", "tag": "4e48581c-4e8c-4ca7-8d63-e97ece047f5b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:46.102360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-87847e88-10b9-45a0-96c5-3f65bcd519cd req-42464af7-5eba-49ab-a47f-bffa6b389a8e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.102927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-87847e88-10b9-45a0-96c5-3f65bcd519cd req-42464af7-5eba-49ab-a47f-bffa6b389a8e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.105801 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3d55314b-5c0e-4500-9cb3-fecbfa7ee089 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:46.113611 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3d55314b-5c0e-4500-9cb3-fecbfa7ee089 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.259982 Mar 12 20:50:46.115177 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 445/1022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:45 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:46.115313 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-87847e88-10b9-45a0-96c5-3f65bcd519cd req-42464af7-5eba-49ab-a47f-bffa6b389a8e service nova] Creating event network-changed:70b96b8e-4df3-42a1-a05b-4818b836f46f for instance 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 on nch2-master-1 Mar 12 20:50:46.115967 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-87847e88-10b9-45a0-96c5-3f65bcd519cd req-42464af7-5eba-49ab-a47f-bffa6b389a8e service nova] Creating event network-changed:4e48581c-4e8c-4ca7-8d63-e97ece047f5b for instance 373aba85-cb1c-4089-a05b-d4d3af08220e on nch2-master-1 Mar 12 20:50:46.122282 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-87847e88-10b9-45a0-96c5-3f65bcd519cd req-42464af7-5eba-49ab-a47f-bffa6b389a8e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033015 Mar 12 20:50:46.122873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 578/1023] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:46.153595 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4d93d1a2-7ddb-4c69-bad3-426a87756f60 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:46.154316 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4d93d1a2-7ddb-4c69-bad3-426a87756f60 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:46.160359 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4d93d1a2-7ddb-4c69-bad3-426a87756f60 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.160823 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4d93d1a2-7ddb-4c69-bad3-426a87756f60 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.161600 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4d93d1a2-7ddb-4c69-bad3-426a87756f60 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.162077 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4d93d1a2-7ddb-4c69-bad3-426a87756f60 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.317216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1081353e-c353-4c01-84e6-982ffd54bbff tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:46.318044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1081353e-c353-4c01-84e6-982ffd54bbff tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:46.324391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1081353e-c353-4c01-84e6-982ffd54bbff tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.324920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1081353e-c353-4c01-84e6-982ffd54bbff tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.325850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1081353e-c353-4c01-84e6-982ffd54bbff tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.326376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1081353e-c353-4c01-84e6-982ffd54bbff tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.466836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1081353e-c353-4c01-84e6-982ffd54bbff tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:46.474534 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1081353e-c353-4c01-84e6-982ffd54bbff tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.162129 Mar 12 20:50:46.474825 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4d93d1a2-7ddb-4c69-bad3-426a87756f60 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:46.478425 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 579/1024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:46 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:46.486114 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4d93d1a2-7ddb-4c69-bad3-426a87756f60 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.336333 Mar 12 20:50:46.486848 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 446/1025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:46 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:46.488694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-651f2d2c-b608-4806-9c69-42db67d37ba1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:46.489304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-651f2d2c-b608-4806-9c69-42db67d37ba1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:46.496530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-651f2d2c-b608-4806-9c69-42db67d37ba1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.496980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-651f2d2c-b608-4806-9c69-42db67d37ba1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.497745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-651f2d2c-b608-4806-9c69-42db67d37ba1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.498203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-651f2d2c-b608-4806-9c69-42db67d37ba1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.535787 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-eb8ff304-e8e7-4e0c-80b3-a85dfc4b33a0 req-cb93a99e-bfa6-47c6-aff1-175072cdf18b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7052bc-c2a6-4c11-85b5-e31c7f79adfb", "name": "network-vif-plugged", "status": "completed", "tag": "72ad719c-17da-4caf-89cd-ae46166479db"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:46.545720 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-eb8ff304-e8e7-4e0c-80b3-a85dfc4b33a0 req-cb93a99e-bfa6-47c6-aff1-175072cdf18b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.546336 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-eb8ff304-e8e7-4e0c-80b3-a85dfc4b33a0 req-cb93a99e-bfa6-47c6-aff1-175072cdf18b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.558766 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-eb8ff304-e8e7-4e0c-80b3-a85dfc4b33a0 req-cb93a99e-bfa6-47c6-aff1-175072cdf18b service nova] Creating event network-vif-plugged:72ad719c-17da-4caf-89cd-ae46166479db for instance 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb on nch1-master-1 Mar 12 20:50:46.564112 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-eb8ff304-e8e7-4e0c-80b3-a85dfc4b33a0 req-cb93a99e-bfa6-47c6-aff1-175072cdf18b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031976 Mar 12 20:50:46.568484 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 447/1026] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:46.572702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-651f2d2c-b608-4806-9c69-42db67d37ba1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:46.591299 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-651f2d2c-b608-4806-9c69-42db67d37ba1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.108638 Mar 12 20:50:46.592288 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 580/1027] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:46 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:46.599108 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d99d9f86-b94a-4d1f-9b0b-b49fab8b35c1 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:46.600053 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d99d9f86-b94a-4d1f-9b0b-b49fab8b35c1 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:46.607048 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d99d9f86-b94a-4d1f-9b0b-b49fab8b35c1 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.607510 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d99d9f86-b94a-4d1f-9b0b-b49fab8b35c1 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.608594 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d99d9f86-b94a-4d1f-9b0b-b49fab8b35c1 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.609051 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d99d9f86-b94a-4d1f-9b0b-b49fab8b35c1 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.622640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b3babb1-6f4d-4cbc-8d90-a5ed9e770ff9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:46.623277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b3babb1-6f4d-4cbc-8d90-a5ed9e770ff9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:46.630271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b3babb1-6f4d-4cbc-8d90-a5ed9e770ff9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.630730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b3babb1-6f4d-4cbc-8d90-a5ed9e770ff9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.631605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b3babb1-6f4d-4cbc-8d90-a5ed9e770ff9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.632050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b3babb1-6f4d-4cbc-8d90-a5ed9e770ff9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.767771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b3babb1-6f4d-4cbc-8d90-a5ed9e770ff9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:46.775360 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b3babb1-6f4d-4cbc-8d90-a5ed9e770ff9 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1469 microversion: 2.1 time: 0.157208 Mar 12 20:50:46.775931 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 581/1028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:46 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:46.791911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-576e5d26-bbf3-413a-ab1c-f958e9bd7b35 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:46.792648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-576e5d26-bbf3-413a-ab1c-f958e9bd7b35 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:46.798741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-576e5d26-bbf3-413a-ab1c-f958e9bd7b35 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.799264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-576e5d26-bbf3-413a-ab1c-f958e9bd7b35 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.800123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-576e5d26-bbf3-413a-ab1c-f958e9bd7b35 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.801379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-576e5d26-bbf3-413a-ab1c-f958e9bd7b35 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.938120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-576e5d26-bbf3-413a-ab1c-f958e9bd7b35 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:46.947310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-576e5d26-bbf3-413a-ab1c-f958e9bd7b35 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:46.948942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-576e5d26-bbf3-413a-ab1c-f958e9bd7b35 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:46.950143 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-576e5d26-bbf3-413a-ab1c-f958e9bd7b35 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.162111 Mar 12 20:50:46.950726 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 582/1029] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:46 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:46.955430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e6eeb2a4-e2da-4a44-917b-796905c6f506 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:46.955969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e6eeb2a4-e2da-4a44-917b-796905c6f506 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:46.962100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6eeb2a4-e2da-4a44-917b-796905c6f506 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.962550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6eeb2a4-e2da-4a44-917b-796905c6f506 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.963331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6eeb2a4-e2da-4a44-917b-796905c6f506 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:46.963764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6eeb2a4-e2da-4a44-917b-796905c6f506 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:46.987823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-e6eeb2a4-e2da-4a44-917b-796905c6f506 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lazy-loading 'flavor' on Instance uuid 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:47.057348 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e6eeb2a4-e2da-4a44-917b-796905c6f506 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0/action" status: 202 len: 0 microversion: 2.1 time: 0.105359 Mar 12 20:50:47.061033 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 583/1030] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:50:46 2022] POST /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:50:47.066886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69320b78-f461-4c76-8241-bf53497a2954 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:47.067596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-69320b78-f461-4c76-8241-bf53497a2954 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:47.076506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69320b78-f461-4c76-8241-bf53497a2954 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:47.076955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69320b78-f461-4c76-8241-bf53497a2954 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:47.077844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69320b78-f461-4c76-8241-bf53497a2954 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:47.078227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69320b78-f461-4c76-8241-bf53497a2954 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:47.134771 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d99d9f86-b94a-4d1f-9b0b-b49fab8b35c1 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:47.143059 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d99d9f86-b94a-4d1f-9b0b-b49fab8b35c1 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1312 microversion: 2.1 time: 0.548485 Mar 12 20:50:47.149926 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 448/1031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:46 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1312 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:47.154989 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-63deb1a8-dd03-455b-9d7a-eb670f0d8f33 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:47.155611 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-63deb1a8-dd03-455b-9d7a-eb670f0d8f33 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:47.162051 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-63deb1a8-dd03-455b-9d7a-eb670f0d8f33 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:47.162521 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-63deb1a8-dd03-455b-9d7a-eb670f0d8f33 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:47.163300 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-63deb1a8-dd03-455b-9d7a-eb670f0d8f33 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:47.163938 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-63deb1a8-dd03-455b-9d7a-eb670f0d8f33 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:47.333657 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-69320b78-f461-4c76-8241-bf53497a2954 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1628 microversion: 2.1 time: 0.270894 Mar 12 20:50:47.342174 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 584/1032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:47 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1628 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:47.349281 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-63deb1a8-dd03-455b-9d7a-eb670f0d8f33 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:47.356764 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-63deb1a8-dd03-455b-9d7a-eb670f0d8f33 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.205490 Mar 12 20:50:47.357348 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 449/1033] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:47 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:47.492141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7a44afb-d402-4e86-ac8a-b1b2315114e2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:47.492977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f7a44afb-d402-4e86-ac8a-b1b2315114e2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:47.499518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7a44afb-d402-4e86-ac8a-b1b2315114e2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:47.499980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7a44afb-d402-4e86-ac8a-b1b2315114e2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:47.500770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7a44afb-d402-4e86-ac8a-b1b2315114e2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:47.501214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7a44afb-d402-4e86-ac8a-b1b2315114e2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:47.503681 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c772b409-0c29-4ab1-b7f8-c5a089a4240f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:47.504295 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c772b409-0c29-4ab1-b7f8-c5a089a4240f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:47.510163 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c772b409-0c29-4ab1-b7f8-c5a089a4240f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:47.510617 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c772b409-0c29-4ab1-b7f8-c5a089a4240f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:47.511382 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c772b409-0c29-4ab1-b7f8-c5a089a4240f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:47.511844 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c772b409-0c29-4ab1-b7f8-c5a089a4240f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:47.635722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f7a44afb-d402-4e86-ac8a-b1b2315114e2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:47.644081 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f7a44afb-d402-4e86-ac8a-b1b2315114e2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.156199 Mar 12 20:50:47.644554 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 585/1034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:47 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:47.649282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-89b7cf31-46fc-4bd2-950d-fec39b4f5df7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:47.649923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89b7cf31-46fc-4bd2-950d-fec39b4f5df7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:47.655566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89b7cf31-46fc-4bd2-950d-fec39b4f5df7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:47.656023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89b7cf31-46fc-4bd2-950d-fec39b4f5df7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:47.656859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89b7cf31-46fc-4bd2-950d-fec39b4f5df7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:47.657445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89b7cf31-46fc-4bd2-950d-fec39b4f5df7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:47.729170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-89b7cf31-46fc-4bd2-950d-fec39b4f5df7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:47.741881 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c772b409-0c29-4ab1-b7f8-c5a089a4240f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:47.747001 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-89b7cf31-46fc-4bd2-950d-fec39b4f5df7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.101427 Mar 12 20:50:47.747782 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 586/1035] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:47 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:47.756756 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c772b409-0c29-4ab1-b7f8-c5a089a4240f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.256900 Mar 12 20:50:47.757441 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 450/1036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:47 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:47.968531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee81b5ba-5be3-4464-a168-9fd5db78a972 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:47.969121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee81b5ba-5be3-4464-a168-9fd5db78a972 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:47.975048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee81b5ba-5be3-4464-a168-9fd5db78a972 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:47.975504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee81b5ba-5be3-4464-a168-9fd5db78a972 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:47.976274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee81b5ba-5be3-4464-a168-9fd5db78a972 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:47.976720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee81b5ba-5be3-4464-a168-9fd5db78a972 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.104657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee81b5ba-5be3-4464-a168-9fd5db78a972 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:48.113505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee81b5ba-5be3-4464-a168-9fd5db78a972 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:48.115076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee81b5ba-5be3-4464-a168-9fd5db78a972 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:48.116269 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee81b5ba-5be3-4464-a168-9fd5db78a972 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.151826 Mar 12 20:50:48.116837 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 587/1037] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:47 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:48.160721 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e358de24-5e51-4bb2-9702-3650f2500a1f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:48.161653 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e358de24-5e51-4bb2-9702-3650f2500a1f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:48.168175 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e358de24-5e51-4bb2-9702-3650f2500a1f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.168628 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e358de24-5e51-4bb2-9702-3650f2500a1f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.169391 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e358de24-5e51-4bb2-9702-3650f2500a1f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.169857 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e358de24-5e51-4bb2-9702-3650f2500a1f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.302209 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e358de24-5e51-4bb2-9702-3650f2500a1f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:48.309507 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e358de24-5e51-4bb2-9702-3650f2500a1f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1312 microversion: 2.1 time: 0.153054 Mar 12 20:50:48.310107 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 451/1038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:48 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:48.351282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-616a0c80-c772-4195-8f08-d435599248b3 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:48.351892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-616a0c80-c772-4195-8f08-d435599248b3 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:48.357856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-616a0c80-c772-4195-8f08-d435599248b3 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.358308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-616a0c80-c772-4195-8f08-d435599248b3 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.359072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-616a0c80-c772-4195-8f08-d435599248b3 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.359508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-616a0c80-c772-4195-8f08-d435599248b3 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.373945 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f187e4f0-b180-4338-8f72-8c85d38ed602 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:48.374555 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f187e4f0-b180-4338-8f72-8c85d38ed602 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:48.380716 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f187e4f0-b180-4338-8f72-8c85d38ed602 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.381164 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f187e4f0-b180-4338-8f72-8c85d38ed602 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.381987 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f187e4f0-b180-4338-8f72-8c85d38ed602 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.382426 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f187e4f0-b180-4338-8f72-8c85d38ed602 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.488668 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-616a0c80-c772-4195-8f08-d435599248b3 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1611 microversion: 2.1 time: 0.140913 Mar 12 20:50:48.489338 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 588/1039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:48 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1611 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:48.504947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c090512-f7f1-414b-8061-508f70113082 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:48.505454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c090512-f7f1-414b-8061-508f70113082 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:48.511630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c090512-f7f1-414b-8061-508f70113082 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.512090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c090512-f7f1-414b-8061-508f70113082 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.512868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c090512-f7f1-414b-8061-508f70113082 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.513313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c090512-f7f1-414b-8061-508f70113082 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.517738 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f187e4f0-b180-4338-8f72-8c85d38ed602 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:48.525091 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f187e4f0-b180-4338-8f72-8c85d38ed602 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.155015 Mar 12 20:50:48.525781 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 452/1040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:48 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:48.592010 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8c090512-f7f1-414b-8061-508f70113082 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] HTTP exception thrown: Cannot 'migrate' instance 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 while it is in vm_state suspended Mar 12 20:50:48.592600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c090512-f7f1-414b-8061-508f70113082 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Returning 409 to user: Cannot 'migrate' instance 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 while it is in vm_state suspended {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:48.593427 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c090512-f7f1-414b-8061-508f70113082 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0/action" status: 409 len: 148 microversion: 2.1 time: 0.092257 Mar 12 20:50:48.594366 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 589/1041] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:50:48 2022] POST /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0/action => generated 148 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:50:48.606231 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-aba16266-8703-4adb-819d-281c0fb5addc tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:48.607505 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-aba16266-8703-4adb-819d-281c0fb5addc tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:48.608547 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-aba16266-8703-4adb-819d-281c0fb5addc tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab/action" status: 400 len: 144 microversion: 2.1 time: 0.005995 Mar 12 20:50:48.613610 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 453/1042] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:50:48 2022] POST /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab/action => generated 144 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 12 20:50:48.620225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7a282bd2-573b-4786-abf0-05023dd95281 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:48.621416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7a282bd2-573b-4786-abf0-05023dd95281 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:48.622242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7a282bd2-573b-4786-abf0-05023dd95281 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab/action" status: 400 len: 120 microversion: 2.1 time: 0.006984 Mar 12 20:50:48.622752 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 590/1043] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:50:48 2022] POST /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab/action => generated 120 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:50:48.631402 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-eba12db0-6301-4f9a-a776-5dbfed4f7250 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:48.632343 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-eba12db0-6301-4f9a-a776-5dbfed4f7250 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Failed to fetch instance by id 999 {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 12 20:50:48.632938 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-eba12db0-6301-4f9a-a776-5dbfed4f7250 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] HTTP exception thrown: Instance 999 could not be found. Mar 12 20:50:48.633589 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-eba12db0-6301-4f9a-a776-5dbfed4f7250 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:48.634392 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-eba12db0-6301-4f9a-a776-5dbfed4f7250 tempest-ServersAdminNegativeTestJSON-256581510 tempest-ServersAdminNegativeTestJSON-256581510-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.006793 Mar 12 20:50:48.634888 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 454/1044] 10.222.0.30 () {60 vars in 1178 bytes} [Sat Mar 12 20:50:48 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:50:48.642877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a0ebe58-b645-43fc-a41a-1f50be93935d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:48.643376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a0ebe58-b645-43fc-a41a-1f50be93935d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:48.652643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a0ebe58-b645-43fc-a41a-1f50be93935d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.653099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a0ebe58-b645-43fc-a41a-1f50be93935d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.653913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a0ebe58-b645-43fc-a41a-1f50be93935d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.654358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a0ebe58-b645-43fc-a41a-1f50be93935d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.661466 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-63cd6d28-0a35-46e7-b4a2-f8697a48dc72 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:48.662110 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-63cd6d28-0a35-46e7-b4a2-f8697a48dc72 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:48.667943 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-63cd6d28-0a35-46e7-b4a2-f8697a48dc72 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.668405 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-63cd6d28-0a35-46e7-b4a2-f8697a48dc72 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.669191 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-63cd6d28-0a35-46e7-b4a2-f8697a48dc72 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.669636 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-63cd6d28-0a35-46e7-b4a2-f8697a48dc72 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.678428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a0ebe58-b645-43fc-a41a-1f50be93935d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:50:48.753715 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a0ebe58-b645-43fc-a41a-1f50be93935d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 204 len: 0 microversion: 2.1 time: 0.114151 Mar 12 20:50:48.754584 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 591/1045] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:50:48 2022] DELETE /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:50:48.764569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8267c041-43a1-49d6-a14a-625f353deec2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:48.765463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8267c041-43a1-49d6-a14a-625f353deec2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:48.772277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8267c041-43a1-49d6-a14a-625f353deec2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.772732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8267c041-43a1-49d6-a14a-625f353deec2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.773527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8267c041-43a1-49d6-a14a-625f353deec2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.774048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8267c041-43a1-49d6-a14a-625f353deec2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.811107 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-63cd6d28-0a35-46e7-b4a2-f8697a48dc72 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:48.818758 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-63cd6d28-0a35-46e7-b4a2-f8697a48dc72 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.162388 Mar 12 20:50:48.819335 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 455/1046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:48 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:48.832721 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1d6731f8-997a-4a79-acba-6ada8c66465d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:48.833612 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-1d6731f8-997a-4a79-acba-6ada8c66465d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:48.839925 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d6731f8-997a-4a79-acba-6ada8c66465d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.840467 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d6731f8-997a-4a79-acba-6ada8c66465d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.841381 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d6731f8-997a-4a79-acba-6ada8c66465d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.842121 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d6731f8-997a-4a79-acba-6ada8c66465d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.911373 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-1d6731f8-997a-4a79-acba-6ada8c66465d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:48.911531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8267c041-43a1-49d6-a14a-625f353deec2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:48.919164 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8267c041-43a1-49d6-a14a-625f353deec2 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1466 microversion: 2.1 time: 0.160468 Mar 12 20:50:48.927151 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 592/1047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:48 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1466 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:48.927151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3879249-06f2-4519-864c-bd9702db0fde tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:48.927151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c3879249-06f2-4519-864c-bd9702db0fde tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:48.930551 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1d6731f8-997a-4a79-acba-6ada8c66465d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.109524 Mar 12 20:50:48.931135 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 456/1048] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:48 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:48.931737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3879249-06f2-4519-864c-bd9702db0fde tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.932301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3879249-06f2-4519-864c-bd9702db0fde tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:48.933145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3879249-06f2-4519-864c-bd9702db0fde tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:48.933656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3879249-06f2-4519-864c-bd9702db0fde tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:49.062416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c3879249-06f2-4519-864c-bd9702db0fde tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:49.070352 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3879249-06f2-4519-864c-bd9702db0fde tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.149383 Mar 12 20:50:49.070911 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 593/1049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:48 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:49.134305 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9ae0d4b0-fe12-4820-8ccb-1f7aee94079a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:49.134925 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9ae0d4b0-fe12-4820-8ccb-1f7aee94079a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:49.140783 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9ae0d4b0-fe12-4820-8ccb-1f7aee94079a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:49.141244 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9ae0d4b0-fe12-4820-8ccb-1f7aee94079a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:49.142053 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9ae0d4b0-fe12-4820-8ccb-1f7aee94079a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:49.142502 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9ae0d4b0-fe12-4820-8ccb-1f7aee94079a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:49.275084 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9ae0d4b0-fe12-4820-8ccb-1f7aee94079a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:49.283306 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9ae0d4b0-fe12-4820-8ccb-1f7aee94079a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:49.285303 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9ae0d4b0-fe12-4820-8ccb-1f7aee94079a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:49.286490 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9ae0d4b0-fe12-4820-8ccb-1f7aee94079a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.156138 Mar 12 20:50:49.287083 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 457/1050] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:49 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:49.326528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-15b02332-e444-4d0e-a151-9d974fcf2aac tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:49.327145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-15b02332-e444-4d0e-a151-9d974fcf2aac tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:49.333958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15b02332-e444-4d0e-a151-9d974fcf2aac tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:49.334413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15b02332-e444-4d0e-a151-9d974fcf2aac tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:49.335188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15b02332-e444-4d0e-a151-9d974fcf2aac tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:49.335632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15b02332-e444-4d0e-a151-9d974fcf2aac tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:49.465764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-15b02332-e444-4d0e-a151-9d974fcf2aac tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:49.473551 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-15b02332-e444-4d0e-a151-9d974fcf2aac tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1312 microversion: 2.1 time: 0.150833 Mar 12 20:50:49.474144 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 594/1051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:49 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:49.542051 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b55584d2-4b19-4edf-be0d-a7ea3d02665b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:49.542604 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b55584d2-4b19-4edf-be0d-a7ea3d02665b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:49.548785 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b55584d2-4b19-4edf-be0d-a7ea3d02665b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:49.549239 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b55584d2-4b19-4edf-be0d-a7ea3d02665b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:49.550105 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b55584d2-4b19-4edf-be0d-a7ea3d02665b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:49.550546 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b55584d2-4b19-4edf-be0d-a7ea3d02665b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:49.679012 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b55584d2-4b19-4edf-be0d-a7ea3d02665b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:49.686156 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b55584d2-4b19-4edf-be0d-a7ea3d02665b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.147965 Mar 12 20:50:49.686718 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 458/1052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:49 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:49.836906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-13c0bab9-e151-4a34-a62a-826b18d164f3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:49.837543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-13c0bab9-e151-4a34-a62a-826b18d164f3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:49.843956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13c0bab9-e151-4a34-a62a-826b18d164f3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:49.844405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13c0bab9-e151-4a34-a62a-826b18d164f3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:49.845165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13c0bab9-e151-4a34-a62a-826b18d164f3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:49.845600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13c0bab9-e151-4a34-a62a-826b18d164f3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:49.937459 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-53cddc8b-41ef-4118-8119-843b212f6001 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:49.938255 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-53cddc8b-41ef-4118-8119-843b212f6001 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:49.944731 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-53cddc8b-41ef-4118-8119-843b212f6001 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:49.945447 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-53cddc8b-41ef-4118-8119-843b212f6001 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:49.946256 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-53cddc8b-41ef-4118-8119-843b212f6001 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:49.946698 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-53cddc8b-41ef-4118-8119-843b212f6001 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:49.976541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-13c0bab9-e151-4a34-a62a-826b18d164f3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:49.983889 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-13c0bab9-e151-4a34-a62a-826b18d164f3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.151207 Mar 12 20:50:49.984458 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 595/1053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:49 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:49.988822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e97a46a8-b7d8-4579-b0a0-93c4b59d1a37 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:49.989423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e97a46a8-b7d8-4579-b0a0-93c4b59d1a37 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:49.995112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e97a46a8-b7d8-4579-b0a0-93c4b59d1a37 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:49.995561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e97a46a8-b7d8-4579-b0a0-93c4b59d1a37 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:49.996328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e97a46a8-b7d8-4579-b0a0-93c4b59d1a37 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:49.996762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e97a46a8-b7d8-4579-b0a0-93c4b59d1a37 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:50.073520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-e97a46a8-b7d8-4579-b0a0-93c4b59d1a37 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:50.086400 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-53cddc8b-41ef-4118-8119-843b212f6001 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:50.090520 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e97a46a8-b7d8-4579-b0a0-93c4b59d1a37 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.105047 Mar 12 20:50:50.091100 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 596/1054] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:49 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:50.095494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27e1e7da-03c4-48bc-ab9f-3888ae546837 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:50.096095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27e1e7da-03c4-48bc-ab9f-3888ae546837 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:50.102277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27e1e7da-03c4-48bc-ab9f-3888ae546837 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:50.102735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27e1e7da-03c4-48bc-ab9f-3888ae546837 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:50.103504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27e1e7da-03c4-48bc-ab9f-3888ae546837 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:50.103939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27e1e7da-03c4-48bc-ab9f-3888ae546837 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:50.105661 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-53cddc8b-41ef-4118-8119-843b212f6001 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1466 microversion: 2.1 time: 0.171851 Mar 12 20:50:50.106557 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 459/1055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:49 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1466 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:50.239910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27e1e7da-03c4-48bc-ab9f-3888ae546837 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:50.247702 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27e1e7da-03c4-48bc-ab9f-3888ae546837 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.155665 Mar 12 20:50:50.248263 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 597/1056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:50 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:50.305748 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a038785c-7393-4bdb-a0e0-29182f1dc1b2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:50.306426 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a038785c-7393-4bdb-a0e0-29182f1dc1b2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:50.312508 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a038785c-7393-4bdb-a0e0-29182f1dc1b2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:50.312961 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a038785c-7393-4bdb-a0e0-29182f1dc1b2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:50.313733 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a038785c-7393-4bdb-a0e0-29182f1dc1b2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:50.314195 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a038785c-7393-4bdb-a0e0-29182f1dc1b2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:50.444058 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a038785c-7393-4bdb-a0e0-29182f1dc1b2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:50.452722 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a038785c-7393-4bdb-a0e0-29182f1dc1b2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:50.454249 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a038785c-7393-4bdb-a0e0-29182f1dc1b2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:50.455410 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a038785c-7393-4bdb-a0e0-29182f1dc1b2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.154828 Mar 12 20:50:50.455971 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 460/1057] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:50 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:50.490553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a9843d73-85b9-4978-9541-6545bb844751 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:50.491166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a9843d73-85b9-4978-9541-6545bb844751 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:50.497458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9843d73-85b9-4978-9541-6545bb844751 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:50.497965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9843d73-85b9-4978-9541-6545bb844751 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:50.498736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9843d73-85b9-4978-9541-6545bb844751 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:50.499177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9843d73-85b9-4978-9541-6545bb844751 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:50.635456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a9843d73-85b9-4978-9541-6545bb844751 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:50.643702 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a9843d73-85b9-4978-9541-6545bb844751 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1312 microversion: 2.1 time: 0.157500 Mar 12 20:50:50.653097 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 598/1058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:50 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:50.703543 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1d24463e-26a3-425f-a4ed-9756435375b6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:50.704154 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-1d24463e-26a3-425f-a4ed-9756435375b6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:50.710410 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d24463e-26a3-425f-a4ed-9756435375b6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:50.710864 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d24463e-26a3-425f-a4ed-9756435375b6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:50.711639 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d24463e-26a3-425f-a4ed-9756435375b6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:50.712076 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1d24463e-26a3-425f-a4ed-9756435375b6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:50.918251 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-1d24463e-26a3-425f-a4ed-9756435375b6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:50.925739 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1d24463e-26a3-425f-a4ed-9756435375b6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.226102 Mar 12 20:50:50.926354 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 461/1059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:50 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:51.000943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e9f4e20-fe78-40a6-8f2c-00d7c71e3e93 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:51.001593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5e9f4e20-fe78-40a6-8f2c-00d7c71e3e93 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:51.008114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e9f4e20-fe78-40a6-8f2c-00d7c71e3e93 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.008645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e9f4e20-fe78-40a6-8f2c-00d7c71e3e93 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.009842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e9f4e20-fe78-40a6-8f2c-00d7c71e3e93 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.010002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e9f4e20-fe78-40a6-8f2c-00d7c71e3e93 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.097687 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-84af1345-25b5-48a7-8692-66c365dcbddb req-b9e9e023-17fd-40f4-b500-2aa6d71971a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd6521d-0ecb-4305-b6ed-3bb25beb06f0", "name": "network-vif-deleted", "tag": "cf141759-7771-46fc-9b0d-eae4f5b9bbb0"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:51.108818 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-84af1345-25b5-48a7-8692-66c365dcbddb req-b9e9e023-17fd-40f4-b500-2aa6d71971a6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.109601 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-84af1345-25b5-48a7-8692-66c365dcbddb req-b9e9e023-17fd-40f4-b500-2aa6d71971a6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.154804 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-84af1345-25b5-48a7-8692-66c365dcbddb req-b9e9e023-17fd-40f4-b500-2aa6d71971a6 service nova] Creating event network-vif-deleted:cf141759-7771-46fc-9b0d-eae4f5b9bbb0 for instance 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 on nch2-master-1 Mar 12 20:50:51.166930 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-84af1345-25b5-48a7-8692-66c365dcbddb req-b9e9e023-17fd-40f4-b500-2aa6d71971a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069906 Mar 12 20:50:51.167555 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 462/1060] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:51.196803 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ecd68a7d-e1b0-4bee-9300-35263b44352c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:51.209436 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ecd68a7d-e1b0-4bee-9300-35263b44352c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:51.212156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5e9f4e20-fe78-40a6-8f2c-00d7c71e3e93 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:51.222688 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ecd68a7d-e1b0-4bee-9300-35263b44352c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.223152 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ecd68a7d-e1b0-4bee-9300-35263b44352c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.223954 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ecd68a7d-e1b0-4bee-9300-35263b44352c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.224406 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ecd68a7d-e1b0-4bee-9300-35263b44352c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.232843 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e9f4e20-fe78-40a6-8f2c-00d7c71e3e93 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.235704 Mar 12 20:50:51.234025 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 599/1061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:50 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:51.238640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c3bd2fc-e77c-4468-9604-4ad7c94f3493 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:51.239325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c3bd2fc-e77c-4468-9604-4ad7c94f3493 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:51.251996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3bd2fc-e77c-4468-9604-4ad7c94f3493 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.252542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3bd2fc-e77c-4468-9604-4ad7c94f3493 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.254027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3bd2fc-e77c-4468-9604-4ad7c94f3493 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.254533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3bd2fc-e77c-4468-9604-4ad7c94f3493 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.307857 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-ecd68a7d-e1b0-4bee-9300-35263b44352c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:51.310949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3bd2fc-e77c-4468-9604-4ad7c94f3493 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.311512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3bd2fc-e77c-4468-9604-4ad7c94f3493 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.312093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-3c3bd2fc-e77c-4468-9604-4ad7c94f3493 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lazy-loading 'fault' on Instance uuid 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:51.326874 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ecd68a7d-e1b0-4bee-9300-35263b44352c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.141589 Mar 12 20:50:51.327569 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 463/1062] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:51 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:51.332593 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9ba338ee-cb9f-4d12-99f2-25ee7a13e526 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:51.333210 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9ba338ee-cb9f-4d12-99f2-25ee7a13e526 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:51.339547 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9ba338ee-cb9f-4d12-99f2-25ee7a13e526 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.340181 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9ba338ee-cb9f-4d12-99f2-25ee7a13e526 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.340992 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9ba338ee-cb9f-4d12-99f2-25ee7a13e526 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.341439 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9ba338ee-cb9f-4d12-99f2-25ee7a13e526 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.360657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c3bd2fc-e77c-4468-9604-4ad7c94f3493 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:51.368124 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c3bd2fc-e77c-4468-9604-4ad7c94f3493 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 200 len: 1310 microversion: 2.1 time: 0.133119 Mar 12 20:50:51.368885 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 600/1063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:51 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 1310 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:51.472501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90374df8-dccd-41f7-83c0-046de77c792d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:51.473117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90374df8-dccd-41f7-83c0-046de77c792d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:51.479194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90374df8-dccd-41f7-83c0-046de77c792d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.479645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90374df8-dccd-41f7-83c0-046de77c792d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.479992 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9ba338ee-cb9f-4d12-99f2-25ee7a13e526 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:51.481029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90374df8-dccd-41f7-83c0-046de77c792d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.481794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90374df8-dccd-41f7-83c0-046de77c792d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.488392 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9ba338ee-cb9f-4d12-99f2-25ee7a13e526 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.159849 Mar 12 20:50:51.489052 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 464/1064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:51 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:51.621192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90374df8-dccd-41f7-83c0-046de77c792d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:51.633062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90374df8-dccd-41f7-83c0-046de77c792d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:51.635061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90374df8-dccd-41f7-83c0-046de77c792d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:51.636752 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90374df8-dccd-41f7-83c0-046de77c792d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.168030 Mar 12 20:50:51.637310 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 601/1065] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:51 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:51.660439 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7efd1b38-94e9-4b66-aa50-c8e2ff1a3d43 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:51.661078 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7efd1b38-94e9-4b66-aa50-c8e2ff1a3d43 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:51.668098 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7efd1b38-94e9-4b66-aa50-c8e2ff1a3d43 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.668565 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7efd1b38-94e9-4b66-aa50-c8e2ff1a3d43 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.669345 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7efd1b38-94e9-4b66-aa50-c8e2ff1a3d43 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.669813 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7efd1b38-94e9-4b66-aa50-c8e2ff1a3d43 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.809005 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7efd1b38-94e9-4b66-aa50-c8e2ff1a3d43 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:51.816993 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7efd1b38-94e9-4b66-aa50-c8e2ff1a3d43 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1312 microversion: 2.1 time: 0.160465 Mar 12 20:50:51.817565 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 465/1066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:51 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:51.943459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c6b93c1-0034-4702-847a-5d0154c4932c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:51.944108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c6b93c1-0034-4702-847a-5d0154c4932c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:51.950326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c6b93c1-0034-4702-847a-5d0154c4932c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.950781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c6b93c1-0034-4702-847a-5d0154c4932c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:51.951568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c6b93c1-0034-4702-847a-5d0154c4932c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:51.951990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c6b93c1-0034-4702-847a-5d0154c4932c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.104509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0c6b93c1-0034-4702-847a-5d0154c4932c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:52.113311 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c6b93c1-0034-4702-847a-5d0154c4932c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.173684 Mar 12 20:50:52.113911 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 602/1067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:51 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:52.234818 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-84a5ba55-ce66-49db-bf37-cd12a7792611 req-706d7c2e-97b7-4fd2-8502-d4aa57160993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373aba85-cb1c-4089-a05b-d4d3af08220e", "name": "network-vif-plugged", "status": "completed", "tag": "4e48581c-4e8c-4ca7-8d63-e97ece047f5b"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:52.244100 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-84a5ba55-ce66-49db-bf37-cd12a7792611 req-706d7c2e-97b7-4fd2-8502-d4aa57160993 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.244613 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-84a5ba55-ce66-49db-bf37-cd12a7792611 req-706d7c2e-97b7-4fd2-8502-d4aa57160993 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.249744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34ee0beb-85f0-4cf2-8753-bb0b6a524cda tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:52.250424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34ee0beb-85f0-4cf2-8753-bb0b6a524cda tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:52.256625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34ee0beb-85f0-4cf2-8753-bb0b6a524cda tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.257096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34ee0beb-85f0-4cf2-8753-bb0b6a524cda tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.258045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34ee0beb-85f0-4cf2-8753-bb0b6a524cda tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.258233 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-84a5ba55-ce66-49db-bf37-cd12a7792611 req-706d7c2e-97b7-4fd2-8502-d4aa57160993 service nova] Creating event network-vif-plugged:4e48581c-4e8c-4ca7-8d63-e97ece047f5b for instance 373aba85-cb1c-4089-a05b-d4d3af08220e on nch2-master-1 Mar 12 20:50:52.258489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34ee0beb-85f0-4cf2-8753-bb0b6a524cda tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.277153 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-84a5ba55-ce66-49db-bf37-cd12a7792611 req-706d7c2e-97b7-4fd2-8502-d4aa57160993 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046106 Mar 12 20:50:52.278252 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 466/1068] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:52.351734 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5bcb76d9-ecb7-4587-9a35-c58449dd732c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:52.353034 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5bcb76d9-ecb7-4587-9a35-c58449dd732c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:52.367149 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5bcb76d9-ecb7-4587-9a35-c58449dd732c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.367839 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5bcb76d9-ecb7-4587-9a35-c58449dd732c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.368813 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5bcb76d9-ecb7-4587-9a35-c58449dd732c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.369421 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5bcb76d9-ecb7-4587-9a35-c58449dd732c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.409017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34ee0beb-85f0-4cf2-8753-bb0b6a524cda tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:52.417386 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34ee0beb-85f0-4cf2-8753-bb0b6a524cda tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.171519 Mar 12 20:50:52.417995 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 603/1069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:52 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:52.427291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab94f597-906e-41c6-83c4-d6821ec11385 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:52.427291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ab94f597-906e-41c6-83c4-d6821ec11385 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:52.429033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab94f597-906e-41c6-83c4-d6821ec11385 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.429488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab94f597-906e-41c6-83c4-d6821ec11385 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.430283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab94f597-906e-41c6-83c4-d6821ec11385 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.430722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab94f597-906e-41c6-83c4-d6821ec11385 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.444059 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ab94f597-906e-41c6-83c4-d6821ec11385 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] HTTP exception thrown: Instance 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 could not be found. Mar 12 20:50:52.444659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab94f597-906e-41c6-83c4-d6821ec11385 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Returning 404 to user: Instance 3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:52.445748 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ab94f597-906e-41c6-83c4-d6821ec11385 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0" status: 404 len: 111 microversion: 2.1 time: 0.026862 Mar 12 20:50:52.446657 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 604/1070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:52 2022] GET /compute/v2.1/servers/3dd6521d-0ecb-4305-b6ed-3bb25beb06f0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:50:52.452566 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-5bcb76d9-ecb7-4587-9a35-c58449dd732c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:52.453946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9496001b-4f10-4c43-8b0f-a9cb17b75a2d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:52.454440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9496001b-4f10-4c43-8b0f-a9cb17b75a2d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:52.460768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9496001b-4f10-4c43-8b0f-a9cb17b75a2d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.461225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9496001b-4f10-4c43-8b0f-a9cb17b75a2d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.462085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9496001b-4f10-4c43-8b0f-a9cb17b75a2d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.462522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9496001b-4f10-4c43-8b0f-a9cb17b75a2d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.472806 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5bcb76d9-ecb7-4587-9a35-c58449dd732c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.125543 Mar 12 20:50:52.473592 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 467/1071] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:52 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:52.488242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9496001b-4f10-4c43-8b0f-a9cb17b75a2d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:50:52.505046 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-369d77ab-1a0e-4213-a2e5-8871f55be601 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:52.505813 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-369d77ab-1a0e-4213-a2e5-8871f55be601 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:52.511552 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-369d77ab-1a0e-4213-a2e5-8871f55be601 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.512082 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-369d77ab-1a0e-4213-a2e5-8871f55be601 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.512931 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-369d77ab-1a0e-4213-a2e5-8871f55be601 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.513448 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-369d77ab-1a0e-4213-a2e5-8871f55be601 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.563231 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9496001b-4f10-4c43-8b0f-a9cb17b75a2d tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 204 len: 0 microversion: 2.1 time: 0.112589 Mar 12 20:50:52.563862 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 605/1072] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:50:52 2022] DELETE /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 20:50:52.572424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b62945f6-5cdb-4b55-ae03-dd015c6c1d3f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:52.573090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b62945f6-5cdb-4b55-ae03-dd015c6c1d3f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:52.579800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b62945f6-5cdb-4b55-ae03-dd015c6c1d3f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.580264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b62945f6-5cdb-4b55-ae03-dd015c6c1d3f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.581049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b62945f6-5cdb-4b55-ae03-dd015c6c1d3f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.582130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b62945f6-5cdb-4b55-ae03-dd015c6c1d3f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.656828 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-369d77ab-1a0e-4213-a2e5-8871f55be601 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:52.665924 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-369d77ab-1a0e-4213-a2e5-8871f55be601 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.164568 Mar 12 20:50:52.666596 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 468/1073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:52 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:52.673227 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-021c84d3-b2fd-45d4-8893-6aa4708554d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:52.673956 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-021c84d3-b2fd-45d4-8893-6aa4708554d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:52.679814 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-021c84d3-b2fd-45d4-8893-6aa4708554d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.680343 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-021c84d3-b2fd-45d4-8893-6aa4708554d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.681134 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-021c84d3-b2fd-45d4-8893-6aa4708554d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.681552 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-021c84d3-b2fd-45d4-8893-6aa4708554d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.717497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b62945f6-5cdb-4b55-ae03-dd015c6c1d3f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:52.725241 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b62945f6-5cdb-4b55-ae03-dd015c6c1d3f tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1477 microversion: 2.1 time: 0.157229 Mar 12 20:50:52.725845 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 606/1074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:52 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:52.816458 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-021c84d3-b2fd-45d4-8893-6aa4708554d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:52.824841 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-021c84d3-b2fd-45d4-8893-6aa4708554d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:52.826567 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-021c84d3-b2fd-45d4-8893-6aa4708554d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:52.827761 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-021c84d3-b2fd-45d4-8893-6aa4708554d4 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.160363 Mar 12 20:50:52.828514 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 469/1075] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:52 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:52.834471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c172f732-eda9-4cc5-93e3-ac5070d511ab tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:52.835091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c172f732-eda9-4cc5-93e3-ac5070d511ab tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:52.841111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c172f732-eda9-4cc5-93e3-ac5070d511ab tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.841561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c172f732-eda9-4cc5-93e3-ac5070d511ab tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.842422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c172f732-eda9-4cc5-93e3-ac5070d511ab tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:52.842858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c172f732-eda9-4cc5-93e3-ac5070d511ab tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:52.975127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c172f732-eda9-4cc5-93e3-ac5070d511ab tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:52.982389 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c172f732-eda9-4cc5-93e3-ac5070d511ab tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1312 microversion: 2.1 time: 0.152368 Mar 12 20:50:52.982958 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 607/1076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:52 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:53.130557 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-edef4de0-fbad-44e9-bb78-a96110bce8c4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:53.131108 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-edef4de0-fbad-44e9-bb78-a96110bce8c4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:53.137015 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-edef4de0-fbad-44e9-bb78-a96110bce8c4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:53.137481 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-edef4de0-fbad-44e9-bb78-a96110bce8c4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:53.138281 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-edef4de0-fbad-44e9-bb78-a96110bce8c4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:53.138724 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-edef4de0-fbad-44e9-bb78-a96110bce8c4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:53.266147 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-edef4de0-fbad-44e9-bb78-a96110bce8c4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:53.273341 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-edef4de0-fbad-44e9-bb78-a96110bce8c4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.147368 Mar 12 20:50:53.273940 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 470/1077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:53 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:53.434906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a70c4b4-63b4-4318-ad3e-c258545d53a3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:53.435445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a70c4b4-63b4-4318-ad3e-c258545d53a3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:53.442401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a70c4b4-63b4-4318-ad3e-c258545d53a3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:53.442861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a70c4b4-63b4-4318-ad3e-c258545d53a3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:53.443636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a70c4b4-63b4-4318-ad3e-c258545d53a3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:53.444080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a70c4b4-63b4-4318-ad3e-c258545d53a3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:53.491990 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4d4a2b10-19b0-437a-938c-fb09efec59c1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:53.492603 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4d4a2b10-19b0-437a-938c-fb09efec59c1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:53.498442 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4d4a2b10-19b0-437a-938c-fb09efec59c1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:53.498903 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4d4a2b10-19b0-437a-938c-fb09efec59c1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:53.499682 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4d4a2b10-19b0-437a-938c-fb09efec59c1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:53.500129 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4d4a2b10-19b0-437a-938c-fb09efec59c1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:53.567345 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-4d4a2b10-19b0-437a-938c-fb09efec59c1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:53.575085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9a70c4b4-63b4-4318-ad3e-c258545d53a3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:53.583401 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a70c4b4-63b4-4318-ad3e-c258545d53a3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.152551 Mar 12 20:50:53.583973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 608/1078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:53 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:53.584415 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4d4a2b10-19b0-437a-938c-fb09efec59c1 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.096894 Mar 12 20:50:53.585064 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 471/1079] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:53 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:53.682829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-875b4dba-ff19-414b-ae62-3b5f6adb0e1b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:53.683442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-875b4dba-ff19-414b-ae62-3b5f6adb0e1b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:53.690102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-875b4dba-ff19-414b-ae62-3b5f6adb0e1b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:53.690477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-875b4dba-ff19-414b-ae62-3b5f6adb0e1b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:53.691255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-875b4dba-ff19-414b-ae62-3b5f6adb0e1b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:53.691878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-875b4dba-ff19-414b-ae62-3b5f6adb0e1b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:53.742596 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d6af1e94-4199-400b-8458-9cdb2c129807 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:53.743203 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d6af1e94-4199-400b-8458-9cdb2c129807 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:53.749575 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d6af1e94-4199-400b-8458-9cdb2c129807 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:53.750309 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d6af1e94-4199-400b-8458-9cdb2c129807 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:53.751290 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d6af1e94-4199-400b-8458-9cdb2c129807 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:53.751837 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d6af1e94-4199-400b-8458-9cdb2c129807 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:53.848842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-875b4dba-ff19-414b-ae62-3b5f6adb0e1b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:53.857145 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-875b4dba-ff19-414b-ae62-3b5f6adb0e1b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.178118 Mar 12 20:50:53.866837 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 609/1080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:53 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:53.866837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9bf19d26-9d99-4dbe-a699-4f3c2fa4d953 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:53.866837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9bf19d26-9d99-4dbe-a699-4f3c2fa4d953 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:53.868933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bf19d26-9d99-4dbe-a699-4f3c2fa4d953 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:53.869381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bf19d26-9d99-4dbe-a699-4f3c2fa4d953 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:53.870185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bf19d26-9d99-4dbe-a699-4f3c2fa4d953 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:53.870618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bf19d26-9d99-4dbe-a699-4f3c2fa4d953 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:53.902878 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d6af1e94-4199-400b-8458-9cdb2c129807 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:53.911096 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d6af1e94-4199-400b-8458-9cdb2c129807 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1477 microversion: 2.1 time: 0.172337 Mar 12 20:50:53.911769 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 472/1081] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:53 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1477 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:53.999199 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-946eba94-1865-4221-945f-793dc19c2d63 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:53.999860 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-946eba94-1865-4221-945f-793dc19c2d63 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:54.001432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9bf19d26-9d99-4dbe-a699-4f3c2fa4d953 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:54.006937 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-946eba94-1865-4221-945f-793dc19c2d63 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.007569 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-946eba94-1865-4221-945f-793dc19c2d63 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.008765 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-946eba94-1865-4221-945f-793dc19c2d63 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.009448 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-946eba94-1865-4221-945f-793dc19c2d63 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.010409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9bf19d26-9d99-4dbe-a699-4f3c2fa4d953 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:54.011955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9bf19d26-9d99-4dbe-a699-4f3c2fa4d953 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:54.013182 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9bf19d26-9d99-4dbe-a699-4f3c2fa4d953 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.154481 Mar 12 20:50:54.013743 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 610/1082] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:53 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:54.143409 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-946eba94-1865-4221-945f-793dc19c2d63 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:54.151224 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-946eba94-1865-4221-945f-793dc19c2d63 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1496 microversion: 2.1 time: 0.155931 Mar 12 20:50:54.151791 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 473/1083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:53 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:54.168259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f8ff3f0b-b375-4ac0-b224-f1d168424079 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:54.180406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.compute.server_groups [None req-f8ff3f0b-b375-4ac0-b224-f1d168424079 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Querying cell 4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) for 1 instances {{(pid=136302) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 12 20:50:54.181186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8ff3f0b-b375-4ac0-b224-f1d168424079 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.181634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8ff3f0b-b375-4ac0-b224-f1d168424079 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.210283 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f8ff3f0b-b375-4ac0-b224-f1d168424079 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/a2528881-9c10-485f-810f-f5d2952372d5" status: 200 len: 222 microversion: 2.1 time: 0.045580 Mar 12 20:50:54.212258 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 611/1084] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:50:54 2022] GET /compute/v2.1/os-server-groups/a2528881-9c10-485f-810f-f5d2952372d5 => generated 222 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:54.220725 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-6a19db11-f91c-4885-b55d-f7c977f35c52 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:54.221814 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-6a19db11-f91c-4885-b55d-f7c977f35c52 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:54.227246 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6a19db11-f91c-4885-b55d-f7c977f35c52 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.227698 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6a19db11-f91c-4885-b55d-f7c977f35c52 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.228465 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6a19db11-f91c-4885-b55d-f7c977f35c52 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.228903 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6a19db11-f91c-4885-b55d-f7c977f35c52 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.255106 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-6a19db11-f91c-4885-b55d-f7c977f35c52 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:50:54.290093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-40e563e5-0164-4b61-9f14-bc649fc81869 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:54.290680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-40e563e5-0164-4b61-9f14-bc649fc81869 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:54.298170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40e563e5-0164-4b61-9f14-bc649fc81869 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.298810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40e563e5-0164-4b61-9f14-bc649fc81869 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.300604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40e563e5-0164-4b61-9f14-bc649fc81869 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.301567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40e563e5-0164-4b61-9f14-bc649fc81869 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.347989 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-6a19db11-f91c-4885-b55d-f7c977f35c52 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "DELETE /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 204 len: 0 microversion: 2.1 time: 0.130730 Mar 12 20:50:54.352400 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 474/1085] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:50:54 2022] DELETE /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:50:54.358861 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fa74ea4b-5f09-48b6-bfed-8d43f74da1bd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:54.359575 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-fa74ea4b-5f09-48b6-bfed-8d43f74da1bd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:54.366171 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa74ea4b-5f09-48b6-bfed-8d43f74da1bd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.366648 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa74ea4b-5f09-48b6-bfed-8d43f74da1bd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.368021 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa74ea4b-5f09-48b6-bfed-8d43f74da1bd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.368757 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa74ea4b-5f09-48b6-bfed-8d43f74da1bd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.455369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-40e563e5-0164-4b61-9f14-bc649fc81869 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:54.463551 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-40e563e5-0164-4b61-9f14-bc649fc81869 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.177377 Mar 12 20:50:54.464059 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 612/1086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:54 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:54.600086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4e74320a-11b9-4b21-b827-5c5b6f6d2329 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:54.600734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4e74320a-11b9-4b21-b827-5c5b6f6d2329 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:54.604065 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fa74ea4b-5f09-48b6-bfed-8d43f74da1bd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:54.607466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e74320a-11b9-4b21-b827-5c5b6f6d2329 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.607922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e74320a-11b9-4b21-b827-5c5b6f6d2329 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.608706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e74320a-11b9-4b21-b827-5c5b6f6d2329 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.609279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e74320a-11b9-4b21-b827-5c5b6f6d2329 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.612224 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fa74ea4b-5f09-48b6-bfed-8d43f74da1bd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1502 microversion: 2.1 time: 0.257945 Mar 12 20:50:54.613497 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 475/1087] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:54 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1502 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:54.621943 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-bf26be0d-318a-4ee1-8d63-28cb74234890 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:54.622562 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-bf26be0d-318a-4ee1-8d63-28cb74234890 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:54.628855 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bf26be0d-318a-4ee1-8d63-28cb74234890 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.629332 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bf26be0d-318a-4ee1-8d63-28cb74234890 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.630623 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bf26be0d-318a-4ee1-8d63-28cb74234890 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.630623 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bf26be0d-318a-4ee1-8d63-28cb74234890 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.723776 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-bf26be0d-318a-4ee1-8d63-28cb74234890 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:54.741526 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-bf26be0d-318a-4ee1-8d63-28cb74234890 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.123030 Mar 12 20:50:54.742143 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 476/1088] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:54 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:54.767651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4e74320a-11b9-4b21-b827-5c5b6f6d2329 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:54.775477 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4e74320a-11b9-4b21-b827-5c5b6f6d2329 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.179560 Mar 12 20:50:54.776046 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 613/1089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:54 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:54.874051 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f91f3ef8-7ce6-4f79-83cc-84ef37b61cd7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:54.874666 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f91f3ef8-7ce6-4f79-83cc-84ef37b61cd7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:54.881479 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f91f3ef8-7ce6-4f79-83cc-84ef37b61cd7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.882034 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f91f3ef8-7ce6-4f79-83cc-84ef37b61cd7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.882803 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f91f3ef8-7ce6-4f79-83cc-84ef37b61cd7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.883237 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f91f3ef8-7ce6-4f79-83cc-84ef37b61cd7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.927599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c239fb27-c3e7-41a3-9718-696cef7eac95 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:54.928217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c239fb27-c3e7-41a3-9718-696cef7eac95 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:54.934142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c239fb27-c3e7-41a3-9718-696cef7eac95 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.934606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c239fb27-c3e7-41a3-9718-696cef7eac95 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:54.935385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c239fb27-c3e7-41a3-9718-696cef7eac95 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:54.935827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c239fb27-c3e7-41a3-9718-696cef7eac95 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:55.016921 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f91f3ef8-7ce6-4f79-83cc-84ef37b61cd7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:55.024886 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f91f3ef8-7ce6-4f79-83cc-84ef37b61cd7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.154829 Mar 12 20:50:55.025455 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 477/1090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:54 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:55.039977 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-84c60d80-1bb7-4d3a-8155-a4a76d2428dc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:55.040586 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-84c60d80-1bb7-4d3a-8155-a4a76d2428dc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:55.046259 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-84c60d80-1bb7-4d3a-8155-a4a76d2428dc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:55.046710 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-84c60d80-1bb7-4d3a-8155-a4a76d2428dc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:55.047472 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-84c60d80-1bb7-4d3a-8155-a4a76d2428dc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:55.047905 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-84c60d80-1bb7-4d3a-8155-a4a76d2428dc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:55.067256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c239fb27-c3e7-41a3-9718-696cef7eac95 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:55.075050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c239fb27-c3e7-41a3-9718-696cef7eac95 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1477 microversion: 2.1 time: 0.151762 Mar 12 20:50:55.075614 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 614/1091] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:54 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:55.177530 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-84c60d80-1bb7-4d3a-8155-a4a76d2428dc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:55.185748 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-84c60d80-1bb7-4d3a-8155-a4a76d2428dc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:55.187281 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-84c60d80-1bb7-4d3a-8155-a4a76d2428dc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:55.188424 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-84c60d80-1bb7-4d3a-8155-a4a76d2428dc tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.152335 Mar 12 20:50:55.188988 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 478/1092] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:55 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:55.480506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30283804-a926-4864-a128-b945202cc4ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:55.481114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-30283804-a926-4864-a128-b945202cc4ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:55.487457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30283804-a926-4864-a128-b945202cc4ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:55.487925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30283804-a926-4864-a128-b945202cc4ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:55.488680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30283804-a926-4864-a128-b945202cc4ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:55.489116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30283804-a926-4864-a128-b945202cc4ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:55.620163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-30283804-a926-4864-a128-b945202cc4ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:55.627457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30283804-a926-4864-a128-b945202cc4ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.151114 Mar 12 20:50:55.628026 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 615/1093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:55 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:55.629793 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5d6515a4-ffa7-4903-bb60-b785e34f728f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:55.630415 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5d6515a4-ffa7-4903-bb60-b785e34f728f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:55.636765 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5d6515a4-ffa7-4903-bb60-b785e34f728f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:55.637218 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5d6515a4-ffa7-4903-bb60-b785e34f728f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:55.638031 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5d6515a4-ffa7-4903-bb60-b785e34f728f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:55.638475 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5d6515a4-ffa7-4903-bb60-b785e34f728f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:55.761171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21579f4f-3fe9-49aa-8461-ac2b0f2d2a56 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:55.761796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-21579f4f-3fe9-49aa-8461-ac2b0f2d2a56 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:55.769479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21579f4f-3fe9-49aa-8461-ac2b0f2d2a56 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:55.770856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21579f4f-3fe9-49aa-8461-ac2b0f2d2a56 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:55.771752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21579f4f-3fe9-49aa-8461-ac2b0f2d2a56 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:55.772302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21579f4f-3fe9-49aa-8461-ac2b0f2d2a56 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:55.788200 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5d6515a4-ffa7-4903-bb60-b785e34f728f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:55.795571 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5d6515a4-ffa7-4903-bb60-b785e34f728f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1502 microversion: 2.1 time: 0.169726 Mar 12 20:50:55.796143 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 479/1094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:55 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:55.800679 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-40c58c68-4700-40c3-99d7-bc6a6d528fed tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:55.801279 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-40c58c68-4700-40c3-99d7-bc6a6d528fed tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:55.807413 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-40c58c68-4700-40c3-99d7-bc6a6d528fed tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:55.807948 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-40c58c68-4700-40c3-99d7-bc6a6d528fed tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:55.808792 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-40c58c68-4700-40c3-99d7-bc6a6d528fed tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:55.809306 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-40c58c68-4700-40c3-99d7-bc6a6d528fed tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:55.848035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-21579f4f-3fe9-49aa-8461-ac2b0f2d2a56 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:55.865178 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21579f4f-3fe9-49aa-8461-ac2b0f2d2a56 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.107611 Mar 12 20:50:55.866032 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 616/1095] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:55 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:55.944418 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-40c58c68-4700-40c3-99d7-bc6a6d528fed tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:55.952024 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-40c58c68-4700-40c3-99d7-bc6a6d528fed tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.154788 Mar 12 20:50:55.952587 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 480/1096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:55 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:56.047721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d37d384d-d6ab-404e-a90a-056140b5e209 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:56.048342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d37d384d-d6ab-404e-a90a-056140b5e209 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:56.054772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d37d384d-d6ab-404e-a90a-056140b5e209 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.055298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d37d384d-d6ab-404e-a90a-056140b5e209 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.056182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d37d384d-d6ab-404e-a90a-056140b5e209 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.056605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d37d384d-d6ab-404e-a90a-056140b5e209 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.091799 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-82234839-24e2-4881-9b9c-19127992cedd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:56.092434 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-82234839-24e2-4881-9b9c-19127992cedd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:56.100900 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-82234839-24e2-4881-9b9c-19127992cedd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.101466 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-82234839-24e2-4881-9b9c-19127992cedd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.102371 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-82234839-24e2-4881-9b9c-19127992cedd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.102886 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-82234839-24e2-4881-9b9c-19127992cedd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.189573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d37d384d-d6ab-404e-a90a-056140b5e209 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:56.198438 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d37d384d-d6ab-404e-a90a-056140b5e209 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.159660 Mar 12 20:50:56.199005 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 617/1097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:56 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:56.207368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e109bb4f-9c3c-43a8-a270-6fd8d841b276 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:56.208047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e109bb4f-9c3c-43a8-a270-6fd8d841b276 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:56.213944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e109bb4f-9c3c-43a8-a270-6fd8d841b276 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.214468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e109bb4f-9c3c-43a8-a270-6fd8d841b276 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.215304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e109bb4f-9c3c-43a8-a270-6fd8d841b276 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.215806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e109bb4f-9c3c-43a8-a270-6fd8d841b276 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.351633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e109bb4f-9c3c-43a8-a270-6fd8d841b276 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:56.360063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e109bb4f-9c3c-43a8-a270-6fd8d841b276 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:56.361564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e109bb4f-9c3c-43a8-a270-6fd8d841b276 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:56.363257 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e109bb4f-9c3c-43a8-a270-6fd8d841b276 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.160185 Mar 12 20:50:56.363818 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 618/1098] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:56 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:56.437004 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-82234839-24e2-4881-9b9c-19127992cedd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:56.445430 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-82234839-24e2-4881-9b9c-19127992cedd tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1477 microversion: 2.1 time: 0.357268 Mar 12 20:50:56.446037 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 481/1099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:56 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1477 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:56.643607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd96f892-bd28-45df-a848-856324438259 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:56.644219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dd96f892-bd28-45df-a848-856324438259 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:56.650870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd96f892-bd28-45df-a848-856324438259 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.651314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd96f892-bd28-45df-a848-856324438259 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.652080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd96f892-bd28-45df-a848-856324438259 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.652512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd96f892-bd28-45df-a848-856324438259 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.801756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dd96f892-bd28-45df-a848-856324438259 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:56.810318 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd96f892-bd28-45df-a848-856324438259 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.170431 Mar 12 20:50:56.811465 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 619/1100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:56 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:56.812528 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ef2e659a-a579-4f1a-8b3f-42543d771b36 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:56.813155 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ef2e659a-a579-4f1a-8b3f-42543d771b36 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:56.821519 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef2e659a-a579-4f1a-8b3f-42543d771b36 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.822039 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef2e659a-a579-4f1a-8b3f-42543d771b36 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.822911 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef2e659a-a579-4f1a-8b3f-42543d771b36 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.823350 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef2e659a-a579-4f1a-8b3f-42543d771b36 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.870600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7182623e-82b8-4297-a226-90f786cb0635 req-696df0ef-e0f2-4a97-bde4-4cb7cbddc1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3364cfe2-8555-4de1-9fd9-29e3d2cfabab", "name": "network-vif-deleted", "tag": "84a71a9a-c3a4-4a15-927a-2a83d6d25f3d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:56.879983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7182623e-82b8-4297-a226-90f786cb0635 req-696df0ef-e0f2-4a97-bde4-4cb7cbddc1b6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.880709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7182623e-82b8-4297-a226-90f786cb0635 req-696df0ef-e0f2-4a97-bde4-4cb7cbddc1b6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.892726 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7182623e-82b8-4297-a226-90f786cb0635 req-696df0ef-e0f2-4a97-bde4-4cb7cbddc1b6 service nova] Creating event network-vif-deleted:84a71a9a-c3a4-4a15-927a-2a83d6d25f3d for instance 3364cfe2-8555-4de1-9fd9-29e3d2cfabab on nch1-master-1 Mar 12 20:50:56.898285 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7182623e-82b8-4297-a226-90f786cb0635 req-696df0ef-e0f2-4a97-bde4-4cb7cbddc1b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034245 Mar 12 20:50:56.899223 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 620/1101] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:56.905937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ed0867d-abd3-4fa5-82db-daa80df91a5c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:56.905937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ed0867d-abd3-4fa5-82db-daa80df91a5c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:56.912685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ed0867d-abd3-4fa5-82db-daa80df91a5c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.913223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ed0867d-abd3-4fa5-82db-daa80df91a5c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.914049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ed0867d-abd3-4fa5-82db-daa80df91a5c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.914501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ed0867d-abd3-4fa5-82db-daa80df91a5c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.951864 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ef2e659a-a579-4f1a-8b3f-42543d771b36 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6faf510273c94084909be1629e28c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5891231c0d2941fb97d87e989c3bdd67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:56.967737 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ef2e659a-a579-4f1a-8b3f-42543d771b36 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 200 len: 1460 microversion: 2.1 time: 0.159039 Mar 12 20:50:56.969236 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 482/1102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:56 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 1460 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:56.982375 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c5ed507f-1f7f-4a35-a079-6ff7f1242d14 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:56.983034 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c5ed507f-1f7f-4a35-a079-6ff7f1242d14 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:56.990944 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c5ed507f-1f7f-4a35-a079-6ff7f1242d14 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.991419 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c5ed507f-1f7f-4a35-a079-6ff7f1242d14 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:56.992264 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c5ed507f-1f7f-4a35-a079-6ff7f1242d14 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:56.992754 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c5ed507f-1f7f-4a35-a079-6ff7f1242d14 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:57.015463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-0ed0867d-abd3-4fa5-82db-daa80df91a5c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:57.040472 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ed0867d-abd3-4fa5-82db-daa80df91a5c tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.140037 Mar 12 20:50:57.053111 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 621/1103] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:56 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:57.147703 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c5ed507f-1f7f-4a35-a079-6ff7f1242d14 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:57.155115 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c5ed507f-1f7f-4a35-a079-6ff7f1242d14 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.184597 Mar 12 20:50:57.155931 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 483/1104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:56 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:57.215213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23f407a2-86ee-43dd-9d55-8c03c83bbbb9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:57.215828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-23f407a2-86ee-43dd-9d55-8c03c83bbbb9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:57.221562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23f407a2-86ee-43dd-9d55-8c03c83bbbb9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:57.222602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23f407a2-86ee-43dd-9d55-8c03c83bbbb9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:57.223407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23f407a2-86ee-43dd-9d55-8c03c83bbbb9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:57.223847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23f407a2-86ee-43dd-9d55-8c03c83bbbb9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:57.357639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-23f407a2-86ee-43dd-9d55-8c03c83bbbb9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:57.366105 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-23f407a2-86ee-43dd-9d55-8c03c83bbbb9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.154698 Mar 12 20:50:57.366670 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 622/1105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:57 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:57.381111 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f6fc299b-5f15-4a3e-baec-9d5f39c7d918 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:57.381725 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f6fc299b-5f15-4a3e-baec-9d5f39c7d918 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:57.387713 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f6fc299b-5f15-4a3e-baec-9d5f39c7d918 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:57.388170 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f6fc299b-5f15-4a3e-baec-9d5f39c7d918 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:57.388947 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f6fc299b-5f15-4a3e-baec-9d5f39c7d918 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:57.389463 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f6fc299b-5f15-4a3e-baec-9d5f39c7d918 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:57.464821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ecf89d79-d317-4321-a0b9-9664b1e30556 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:57.471148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ecf89d79-d317-4321-a0b9-9664b1e30556 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:57.483869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecf89d79-d317-4321-a0b9-9664b1e30556 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:57.484745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecf89d79-d317-4321-a0b9-9664b1e30556 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:57.485792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecf89d79-d317-4321-a0b9-9664b1e30556 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:57.486322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecf89d79-d317-4321-a0b9-9664b1e30556 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:57.521105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecf89d79-d317-4321-a0b9-9664b1e30556 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:57.521597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecf89d79-d317-4321-a0b9-9664b1e30556 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:57.522200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-ecf89d79-d317-4321-a0b9-9664b1e30556 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lazy-loading 'fault' on Instance uuid 3364cfe2-8555-4de1-9fd9-29e3d2cfabab {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:57.553811 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f6fc299b-5f15-4a3e-baec-9d5f39c7d918 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:57.562735 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f6fc299b-5f15-4a3e-baec-9d5f39c7d918 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:57.564169 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f6fc299b-5f15-4a3e-baec-9d5f39c7d918 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:57.565229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ecf89d79-d317-4321-a0b9-9664b1e30556 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07b0de7f0b2847e9a6cf5effd9c43a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f569aa4fb0c34fbf8b56338342d08162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:57.565375 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f6fc299b-5f15-4a3e-baec-9d5f39c7d918 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.188082 Mar 12 20:50:57.565998 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 484/1106] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:57 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:57.573077 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ecf89d79-d317-4321-a0b9-9664b1e30556 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 200 len: 1311 microversion: 2.1 time: 0.114059 Mar 12 20:50:57.573599 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 623/1107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:57 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:57.827310 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-48a500d4-3614-429c-8700-a3e8d89c4e6d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:57.827924 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-48a500d4-3614-429c-8700-a3e8d89c4e6d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:57.834752 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-48a500d4-3614-429c-8700-a3e8d89c4e6d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:57.835206 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-48a500d4-3614-429c-8700-a3e8d89c4e6d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:57.835980 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-48a500d4-3614-429c-8700-a3e8d89c4e6d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:57.836421 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-48a500d4-3614-429c-8700-a3e8d89c4e6d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:57.970022 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-48a500d4-3614-429c-8700-a3e8d89c4e6d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:57.977202 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-48a500d4-3614-429c-8700-a3e8d89c4e6d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.153797 Mar 12 20:50:57.977762 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 485/1108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:57 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:57.984877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d3cfcff-83ff-49a9-b526-e7758afc9a91 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:57.985498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5d3cfcff-83ff-49a9-b526-e7758afc9a91 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:57.992133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d3cfcff-83ff-49a9-b526-e7758afc9a91 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:57.992596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d3cfcff-83ff-49a9-b526-e7758afc9a91 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:57.993372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d3cfcff-83ff-49a9-b526-e7758afc9a91 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:57.993845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d3cfcff-83ff-49a9-b526-e7758afc9a91 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.007365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-5d3cfcff-83ff-49a9-b526-e7758afc9a91 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] HTTP exception thrown: Instance 373aba85-cb1c-4089-a05b-d4d3af08220e could not be found. Mar 12 20:50:58.007952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d3cfcff-83ff-49a9-b526-e7758afc9a91 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Returning 404 to user: Instance 373aba85-cb1c-4089-a05b-d4d3af08220e could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:58.008768 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5d3cfcff-83ff-49a9-b526-e7758afc9a91 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 404 len: 111 microversion: 2.1 time: 0.027781 Mar 12 20:50:58.009286 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 624/1109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:57 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:50:58.019365 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d2488890-0c3e-4ca3-b22f-fc367653be2f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.032357 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.compute.server_groups [None req-d2488890-0c3e-4ca3-b22f-fc367653be2f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Querying cell 4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) for 1 instances {{(pid=136303) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 12 20:50:58.033163 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d2488890-0c3e-4ca3-b22f-fc367653be2f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.033607 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d2488890-0c3e-4ca3-b22f-fc367653be2f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.053420 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d2488890-0c3e-4ca3-b22f-fc367653be2f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.038383 Mar 12 20:50:58.054013 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 486/1110] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:50:58 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:50:58.060632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a6516c4-df24-4c3e-8ccf-e903d42e7455 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.061238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a6516c4-df24-4c3e-8ccf-e903d42e7455 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:58.063929 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a54d064c-1a06-4a96-a5c8-67421304506f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.067626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a6516c4-df24-4c3e-8ccf-e903d42e7455 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.068151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a6516c4-df24-4c3e-8ccf-e903d42e7455 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.068920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a6516c4-df24-4c3e-8ccf-e903d42e7455 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.069353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a6516c4-df24-4c3e-8ccf-e903d42e7455 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.077280 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.compute.server_groups [None req-a54d064c-1a06-4a96-a5c8-67421304506f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Querying cell 4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) for 1 instances {{(pid=136303) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 12 20:50:58.078154 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a54d064c-1a06-4a96-a5c8-67421304506f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.079177 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a54d064c-1a06-4a96-a5c8-67421304506f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.090160 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a54d064c-1a06-4a96-a5c8-67421304506f tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/a2528881-9c10-485f-810f-f5d2952372d5" status: 200 len: 184 microversion: 2.1 time: 0.029761 Mar 12 20:50:58.090956 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 487/1111] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:50:58 2022] GET /compute/v2.1/os-server-groups/a2528881-9c10-485f-810f-f5d2952372d5 => generated 184 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:58.100944 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-93f1fdae-aea8-4ec4-a4ee-53b0473cf8cd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.101533 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-93f1fdae-aea8-4ec4-a4ee-53b0473cf8cd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:58.107555 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-93f1fdae-aea8-4ec4-a4ee-53b0473cf8cd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.108017 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-93f1fdae-aea8-4ec4-a4ee-53b0473cf8cd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.108817 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-93f1fdae-aea8-4ec4-a4ee-53b0473cf8cd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.109289 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-93f1fdae-aea8-4ec4-a4ee-53b0473cf8cd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.122261 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-93f1fdae-aea8-4ec4-a4ee-53b0473cf8cd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] HTTP exception thrown: Instance 373aba85-cb1c-4089-a05b-d4d3af08220e could not be found. Mar 12 20:50:58.122845 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-93f1fdae-aea8-4ec4-a4ee-53b0473cf8cd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Returning 404 to user: Instance 373aba85-cb1c-4089-a05b-d4d3af08220e could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:58.123676 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-93f1fdae-aea8-4ec4-a4ee-53b0473cf8cd tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "DELETE /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 404 len: 111 microversion: 2.1 time: 0.026381 Mar 12 20:50:58.124246 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 488/1112] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:50:58 2022] DELETE /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:50:58.132348 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a64c4e77-ff8f-46c2-b82d-73ac34d3b3b0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.132998 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a64c4e77-ff8f-46c2-b82d-73ac34d3b3b0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] [instance: 373aba85-cb1c-4089-a05b-d4d3af08220e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:58.137711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-9a6516c4-df24-4c3e-8ccf-e903d42e7455 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:58.139098 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a64c4e77-ff8f-46c2-b82d-73ac34d3b3b0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.139567 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a64c4e77-ff8f-46c2-b82d-73ac34d3b3b0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.140340 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a64c4e77-ff8f-46c2-b82d-73ac34d3b3b0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.140783 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a64c4e77-ff8f-46c2-b82d-73ac34d3b3b0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.154421 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a6516c4-df24-4c3e-8ccf-e903d42e7455 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.097782 Mar 12 20:50:58.154989 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 625/1113] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:58 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:50:58.156243 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-a64c4e77-ff8f-46c2-b82d-73ac34d3b3b0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] HTTP exception thrown: Instance 373aba85-cb1c-4089-a05b-d4d3af08220e could not be found. Mar 12 20:50:58.156843 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a64c4e77-ff8f-46c2-b82d-73ac34d3b3b0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Returning 404 to user: Instance 373aba85-cb1c-4089-a05b-d4d3af08220e could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:58.157665 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a64c4e77-ff8f-46c2-b82d-73ac34d3b3b0 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e" status: 404 len: 111 microversion: 2.1 time: 0.029450 Mar 12 20:50:58.158225 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 489/1114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:58 2022] GET /compute/v2.1/servers/373aba85-cb1c-4089-a05b-d4d3af08220e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:50:58.167759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fde0fa59-daf6-4b33-aff6-576cb697d738 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.170868 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b9a2eb93-6faa-4566-b3f1-b44bc325bc15 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.171473 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b9a2eb93-6faa-4566-b3f1-b44bc325bc15 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:58.173476 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-fde0fa59-daf6-4b33-aff6-576cb697d738 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] HTTP exception thrown: Instance group b917db8b-7e74-454c-8052-ae9e69d4d044 could not be found. Mar 12 20:50:58.174102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fde0fa59-daf6-4b33-aff6-576cb697d738 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Returning 404 to user: Instance group b917db8b-7e74-454c-8052-ae9e69d4d044 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:58.174951 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fde0fa59-daf6-4b33-aff6-576cb697d738 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/b917db8b-7e74-454c-8052-ae9e69d4d044" status: 404 len: 117 microversion: 2.1 time: 0.010856 Mar 12 20:50:58.175474 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 626/1115] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 20:50:58 2022] DELETE /compute/v2.1/os-server-groups/b917db8b-7e74-454c-8052-ae9e69d4d044 => generated 117 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:50:58.177359 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b9a2eb93-6faa-4566-b3f1-b44bc325bc15 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.177854 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b9a2eb93-6faa-4566-b3f1-b44bc325bc15 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.178719 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b9a2eb93-6faa-4566-b3f1-b44bc325bc15 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.179192 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b9a2eb93-6faa-4566-b3f1-b44bc325bc15 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.182768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7a6918a-92eb-4925-983f-6e39eca2dd1b tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.188795 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f7a6918a-92eb-4925-983f-6e39eca2dd1b tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] HTTP exception thrown: Instance group dff69bbd-a75b-47ff-b6f9-4ab5a4fa81b0 could not be found. Mar 12 20:50:58.189413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7a6918a-92eb-4925-983f-6e39eca2dd1b tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Returning 404 to user: Instance group dff69bbd-a75b-47ff-b6f9-4ab5a4fa81b0 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:58.190247 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f7a6918a-92eb-4925-983f-6e39eca2dd1b tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/dff69bbd-a75b-47ff-b6f9-4ab5a4fa81b0" status: 404 len: 117 microversion: 2.1 time: 0.010968 Mar 12 20:50:58.191302 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 627/1116] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 20:50:58 2022] DELETE /compute/v2.1/os-server-groups/dff69bbd-a75b-47ff-b6f9-4ab5a4fa81b0 => generated 117 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:50:58.198750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26764386-9a5e-4b7f-aa04-9317f822ad42 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.204225 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-26764386-9a5e-4b7f-aa04-9317f822ad42 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] HTTP exception thrown: Instance group a9daf5be-22be-44d7-a1e4-4b4cfd3d1b5d could not be found. Mar 12 20:50:58.204797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26764386-9a5e-4b7f-aa04-9317f822ad42 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Returning 404 to user: Instance group a9daf5be-22be-44d7-a1e4-4b4cfd3d1b5d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:58.205603 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-26764386-9a5e-4b7f-aa04-9317f822ad42 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/a9daf5be-22be-44d7-a1e4-4b4cfd3d1b5d" status: 404 len: 117 microversion: 2.1 time: 0.010518 Mar 12 20:50:58.206196 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 628/1117] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 20:50:58 2022] DELETE /compute/v2.1/os-server-groups/a9daf5be-22be-44d7-a1e4-4b4cfd3d1b5d => generated 117 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:50:58.213748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-164caeda-5ff1-4054-a5d0-951a2b1f58ea tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.219933 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-164caeda-5ff1-4054-a5d0-951a2b1f58ea tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] HTTP exception thrown: Instance group fd09df0e-2a82-4952-b325-fe765f1095eb could not be found. Mar 12 20:50:58.220516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-164caeda-5ff1-4054-a5d0-951a2b1f58ea tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Returning 404 to user: Instance group fd09df0e-2a82-4952-b325-fe765f1095eb could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:58.221321 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-164caeda-5ff1-4054-a5d0-951a2b1f58ea tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/fd09df0e-2a82-4952-b325-fe765f1095eb" status: 404 len: 117 microversion: 2.1 time: 0.010987 Mar 12 20:50:58.222077 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 629/1118] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 20:50:58 2022] DELETE /compute/v2.1/os-server-groups/fd09df0e-2a82-4952-b325-fe765f1095eb => generated 117 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:50:58.229486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3f6ade11-3272-482f-b739-2214653adc92 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.255962 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3f6ade11-3272-482f-b739-2214653adc92 tempest-ServerGroupTestJSON-1444125511 tempest-ServerGroupTestJSON-1444125511-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/a2528881-9c10-485f-810f-f5d2952372d5" status: 204 len: 0 microversion: 2.1 time: 0.029840 Mar 12 20:50:58.256598 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 630/1119] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 20:50:58 2022] DELETE /compute/v2.1/os-server-groups/a2528881-9c10-485f-810f-f5d2952372d5 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 20:50:58.317641 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b9a2eb93-6faa-4566-b3f1-b44bc325bc15 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:58.325319 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b9a2eb93-6faa-4566-b3f1-b44bc325bc15 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.158011 Mar 12 20:50:58.325909 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 490/1120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:58 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:58.383253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75f2ad50-3c0e-498d-849d-7cd74fb7d56a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.383895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75f2ad50-3c0e-498d-849d-7cd74fb7d56a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:58.390286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75f2ad50-3c0e-498d-849d-7cd74fb7d56a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.390747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75f2ad50-3c0e-498d-849d-7cd74fb7d56a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.391522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75f2ad50-3c0e-498d-849d-7cd74fb7d56a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.391967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75f2ad50-3c0e-498d-849d-7cd74fb7d56a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.562748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-75f2ad50-3c0e-498d-849d-7cd74fb7d56a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:58.571862 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75f2ad50-3c0e-498d-849d-7cd74fb7d56a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.192446 Mar 12 20:50:58.572436 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 631/1121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:58 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:58.585520 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7b98e927-e8e6-40f5-88d3-89025dbbca8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.586528 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7b98e927-e8e6-40f5-88d3-89025dbbca8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:58.593644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9412a327-d2a1-4af3-906d-f2b18a011509 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.593853 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b98e927-e8e6-40f5-88d3-89025dbbca8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.594353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9412a327-d2a1-4af3-906d-f2b18a011509 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] [instance: 3364cfe2-8555-4de1-9fd9-29e3d2cfabab] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:58.594815 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b98e927-e8e6-40f5-88d3-89025dbbca8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.595786 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b98e927-e8e6-40f5-88d3-89025dbbca8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.596411 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b98e927-e8e6-40f5-88d3-89025dbbca8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.600616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9412a327-d2a1-4af3-906d-f2b18a011509 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.601024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9412a327-d2a1-4af3-906d-f2b18a011509 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.601870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9412a327-d2a1-4af3-906d-f2b18a011509 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.602878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9412a327-d2a1-4af3-906d-f2b18a011509 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.618383 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9412a327-d2a1-4af3-906d-f2b18a011509 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] HTTP exception thrown: Instance 3364cfe2-8555-4de1-9fd9-29e3d2cfabab could not be found. Mar 12 20:50:58.619081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9412a327-d2a1-4af3-906d-f2b18a011509 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] Returning 404 to user: Instance 3364cfe2-8555-4de1-9fd9-29e3d2cfabab could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:50:58.619993 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9412a327-d2a1-4af3-906d-f2b18a011509 tempest-ServersAdminNegativeTestJSON-1500408873 tempest-ServersAdminNegativeTestJSON-1500408873-project] 10.222.0.30 "GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab" status: 404 len: 111 microversion: 2.1 time: 0.030829 Mar 12 20:50:58.620571 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 632/1122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:58 2022] GET /compute/v2.1/servers/3364cfe2-8555-4de1-9fd9-29e3d2cfabab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:50:58.921142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f3b5d52a-bc5f-430c-bed2-f2dee1c50816 req-1b2894be-e900-4d0f-88ca-4a1049cd6387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373aba85-cb1c-4089-a05b-d4d3af08220e", "name": "network-vif-deleted", "tag": "4e48581c-4e8c-4ca7-8d63-e97ece047f5b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:50:58.929521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f3b5d52a-bc5f-430c-bed2-f2dee1c50816 req-1b2894be-e900-4d0f-88ca-4a1049cd6387 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:58.930561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f3b5d52a-bc5f-430c-bed2-f2dee1c50816 req-1b2894be-e900-4d0f-88ca-4a1049cd6387 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:58.942237 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f3b5d52a-bc5f-430c-bed2-f2dee1c50816 req-1b2894be-e900-4d0f-88ca-4a1049cd6387 service nova] Creating event network-vif-deleted:4e48581c-4e8c-4ca7-8d63-e97ece047f5b for instance 373aba85-cb1c-4089-a05b-d4d3af08220e on nch2-master-1 Mar 12 20:50:58.948155 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f3b5d52a-bc5f-430c-bed2-f2dee1c50816 req-1b2894be-e900-4d0f-88ca-4a1049cd6387 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030789 Mar 12 20:50:58.948721 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 633/1123] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:50:58.995117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa9d67d2-ef7e-42a0-8736-3c1d4530e7c1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:58.995809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aa9d67d2-ef7e-42a0-8736-3c1d4530e7c1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:59.003916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa9d67d2-ef7e-42a0-8736-3c1d4530e7c1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:59.004715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa9d67d2-ef7e-42a0-8736-3c1d4530e7c1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:59.005905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa9d67d2-ef7e-42a0-8736-3c1d4530e7c1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:59.006566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa9d67d2-ef7e-42a0-8736-3c1d4530e7c1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:59.019743 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7b98e927-e8e6-40f5-88d3-89025dbbca8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:59.038855 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7b98e927-e8e6-40f5-88d3-89025dbbca8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:59.040357 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7b98e927-e8e6-40f5-88d3-89025dbbca8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:59.041540 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7b98e927-e8e6-40f5-88d3-89025dbbca8a tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.460615 Mar 12 20:50:59.042131 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 491/1124] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:58 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:59.174708 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-63bf6277-e14d-413c-83e6-6489683ae94a tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:59.176357 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-63bf6277-e14d-413c-83e6-6489683ae94a tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:59.182961 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-63bf6277-e14d-413c-83e6-6489683ae94a tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:59.183624 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-63bf6277-e14d-413c-83e6-6489683ae94a tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:59.184636 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-63bf6277-e14d-413c-83e6-6489683ae94a tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:59.185085 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-63bf6277-e14d-413c-83e6-6489683ae94a tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:59.233476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aa9d67d2-ef7e-42a0-8736-3c1d4530e7c1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:59.241445 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aa9d67d2-ef7e-42a0-8736-3c1d4530e7c1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.250561 Mar 12 20:50:59.242659 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 634/1125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:58 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:50:59.278454 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-63bf6277-e14d-413c-83e6-6489683ae94a tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:50:59.297456 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-63bf6277-e14d-413c-83e6-6489683ae94a tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.126864 Mar 12 20:50:59.298090 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 492/1126] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:50:59 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:50:59.344896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ccf55b7-359e-46f4-8b64-d6afd709db57 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:59.345899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8ccf55b7-359e-46f4-8b64-d6afd709db57 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:59.353038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ccf55b7-359e-46f4-8b64-d6afd709db57 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:59.353714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ccf55b7-359e-46f4-8b64-d6afd709db57 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:59.354710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ccf55b7-359e-46f4-8b64-d6afd709db57 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:59.355317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ccf55b7-359e-46f4-8b64-d6afd709db57 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:59.545131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ccf55b7-359e-46f4-8b64-d6afd709db57 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:59.557940 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ccf55b7-359e-46f4-8b64-d6afd709db57 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.219084 Mar 12 20:50:59.558673 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 635/1127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:59 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:50:59.589372 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-06a6a575-e33a-454b-a191-f22bbc4550c9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:50:59.590285 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-06a6a575-e33a-454b-a191-f22bbc4550c9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:50:59.596196 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-06a6a575-e33a-454b-a191-f22bbc4550c9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:59.597162 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-06a6a575-e33a-454b-a191-f22bbc4550c9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:59.597992 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-06a6a575-e33a-454b-a191-f22bbc4550c9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:50:59.598442 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-06a6a575-e33a-454b-a191-f22bbc4550c9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:50:59.887229 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-06a6a575-e33a-454b-a191-f22bbc4550c9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:50:59.896416 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-06a6a575-e33a-454b-a191-f22bbc4550c9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.311197 Mar 12 20:50:59.897866 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 493/1128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:50:59 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:00.064060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eecfd142-31dc-4f65-a4f3-c8bf55445a63 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:00.064834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eecfd142-31dc-4f65-a4f3-c8bf55445a63 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:00.072836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eecfd142-31dc-4f65-a4f3-c8bf55445a63 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:00.073300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eecfd142-31dc-4f65-a4f3-c8bf55445a63 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:00.074215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eecfd142-31dc-4f65-a4f3-c8bf55445a63 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:00.074871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eecfd142-31dc-4f65-a4f3-c8bf55445a63 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:00.259197 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b9aea274-dfed-4263-82d8-84ac5339f703 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:00.259889 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b9aea274-dfed-4263-82d8-84ac5339f703 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:00.270701 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b9aea274-dfed-4263-82d8-84ac5339f703 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:00.272501 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b9aea274-dfed-4263-82d8-84ac5339f703 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:00.274464 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b9aea274-dfed-4263-82d8-84ac5339f703 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:00.276829 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b9aea274-dfed-4263-82d8-84ac5339f703 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:00.596702 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b9aea274-dfed-4263-82d8-84ac5339f703 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:00.598948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eecfd142-31dc-4f65-a4f3-c8bf55445a63 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:00.607966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eecfd142-31dc-4f65-a4f3-c8bf55445a63 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:00.609504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eecfd142-31dc-4f65-a4f3-c8bf55445a63 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:00.610704 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eecfd142-31dc-4f65-a4f3-c8bf55445a63 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.552904 Mar 12 20:51:00.611272 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 636/1129] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:00 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:00.616059 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b9aea274-dfed-4263-82d8-84ac5339f703 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1307 microversion: 2.1 time: 0.361420 Mar 12 20:51:00.616634 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 494/1130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:00 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1307 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:00.625571 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-57e004c2-2124-4dc1-a0e6-331ef195fb61 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:00.626218 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-57e004c2-2124-4dc1-a0e6-331ef195fb61 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:00.629327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-15259e35-eff1-4889-82db-f7bcc80011d0 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:00.630153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-15259e35-eff1-4889-82db-f7bcc80011d0 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:00.634156 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-57e004c2-2124-4dc1-a0e6-331ef195fb61 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:00.635385 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-57e004c2-2124-4dc1-a0e6-331ef195fb61 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:00.636488 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-57e004c2-2124-4dc1-a0e6-331ef195fb61 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:00.636963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15259e35-eff1-4889-82db-f7bcc80011d0 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:00.637595 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-57e004c2-2124-4dc1-a0e6-331ef195fb61 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:00.638270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15259e35-eff1-4889-82db-f7bcc80011d0 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:00.639399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15259e35-eff1-4889-82db-f7bcc80011d0 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:00.640002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15259e35-eff1-4889-82db-f7bcc80011d0 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:00.715592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-15259e35-eff1-4889-82db-f7bcc80011d0 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:00.733626 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-15259e35-eff1-4889-82db-f7bcc80011d0 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.121321 Mar 12 20:51:00.734839 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 637/1131] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:00 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:00.914745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5ede7a9-bd11-4471-9bb6-d5ed71e959ba tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:00.915791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f5ede7a9-bd11-4471-9bb6-d5ed71e959ba tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:00.922341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5ede7a9-bd11-4471-9bb6-d5ed71e959ba tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:00.923012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5ede7a9-bd11-4471-9bb6-d5ed71e959ba tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:00.923894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5ede7a9-bd11-4471-9bb6-d5ed71e959ba tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:00.924595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5ede7a9-bd11-4471-9bb6-d5ed71e959ba tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:00.956628 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-57e004c2-2124-4dc1-a0e6-331ef195fb61 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:00.985917 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-57e004c2-2124-4dc1-a0e6-331ef195fb61 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.368182 Mar 12 20:51:00.989663 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 495/1132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:00 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:01.088077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f5ede7a9-bd11-4471-9bb6-d5ed71e959ba tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:01.100183 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5ede7a9-bd11-4471-9bb6-d5ed71e959ba tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.186480 Mar 12 20:51:01.100183 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 638/1133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:00 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:01.629467 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b1a1b2bf-1c19-4802-9e5a-21e923420803 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:01.632461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16beaf41-c5e1-4155-a4bf-3f6e4a942539 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:01.633978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16beaf41-c5e1-4155-a4bf-3f6e4a942539 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:01.640116 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b1a1b2bf-1c19-4802-9e5a-21e923420803 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:01.641784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16beaf41-c5e1-4155-a4bf-3f6e4a942539 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:01.642453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16beaf41-c5e1-4155-a4bf-3f6e4a942539 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:01.644487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16beaf41-c5e1-4155-a4bf-3f6e4a942539 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:01.645005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16beaf41-c5e1-4155-a4bf-3f6e4a942539 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:01.652262 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b1a1b2bf-1c19-4802-9e5a-21e923420803 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:01.652751 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b1a1b2bf-1c19-4802-9e5a-21e923420803 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:01.654356 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b1a1b2bf-1c19-4802-9e5a-21e923420803 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:01.654970 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b1a1b2bf-1c19-4802-9e5a-21e923420803 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:01.874618 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b1a1b2bf-1c19-4802-9e5a-21e923420803 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:01.897085 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b1a1b2bf-1c19-4802-9e5a-21e923420803 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:01.899671 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b1a1b2bf-1c19-4802-9e5a-21e923420803 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:01.902009 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b1a1b2bf-1c19-4802-9e5a-21e923420803 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1644 microversion: 2.25 time: 0.276623 Mar 12 20:51:01.912821 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 496/1134] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:01 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1644 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:01.979807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16beaf41-c5e1-4155-a4bf-3f6e4a942539 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:01.988804 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16beaf41-c5e1-4155-a4bf-3f6e4a942539 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1488 microversion: 2.1 time: 0.360151 Mar 12 20:51:02.004660 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 639/1135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:01 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1488 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:02.010961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b6d8589-e57c-4965-b0c0-d19d5faaf7dc tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:02.011933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3b6d8589-e57c-4965-b0c0-d19d5faaf7dc tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:02.018334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b6d8589-e57c-4965-b0c0-d19d5faaf7dc tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.020898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b6d8589-e57c-4965-b0c0-d19d5faaf7dc tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.022278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b6d8589-e57c-4965-b0c0-d19d5faaf7dc tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.022919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b6d8589-e57c-4965-b0c0-d19d5faaf7dc tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.097828 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-55f2b2ac-9840-4b2f-9e24-aa53370a2fef tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:02.099174 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:51:02.099174 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:51:02.100380 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-55f2b2ac-9840-4b2f-9e24-aa53370a2fef tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.100834 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-55f2b2ac-9840-4b2f-9e24-aa53370a2fef tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.101638 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-55f2b2ac-9840-4b2f-9e24-aa53370a2fef tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.102104 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-55f2b2ac-9840-4b2f-9e24-aa53370a2fef tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.127439 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-55f2b2ac-9840-4b2f-9e24-aa53370a2fef tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.216704 Mar 12 20:51:02.128790 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 497/1136] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:51:01 2022] GET /compute/v2.1/os-services => generated 947 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:02.133476 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-718a2fdf-a4ad-423e-bf81-9acb26a6e562 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:02.134319 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-718a2fdf-a4ad-423e-bf81-9acb26a6e562 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:02.140375 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-718a2fdf-a4ad-423e-bf81-9acb26a6e562 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.141033 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-718a2fdf-a4ad-423e-bf81-9acb26a6e562 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.141987 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-718a2fdf-a4ad-423e-bf81-9acb26a6e562 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.142682 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-718a2fdf-a4ad-423e-bf81-9acb26a6e562 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.168773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-3b6d8589-e57c-4965-b0c0-d19d5faaf7dc tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:02.191953 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b6d8589-e57c-4965-b0c0-d19d5faaf7dc tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.185489 Mar 12 20:51:02.204689 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 640/1137] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:02 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:02.210445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72b4caa5-7b56-4a77-9e30-85e9cde6cdb6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:02.217232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72b4caa5-7b56-4a77-9e30-85e9cde6cdb6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.221336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72b4caa5-7b56-4a77-9e30-85e9cde6cdb6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.325067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-72b4caa5-7b56-4a77-9e30-85e9cde6cdb6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Going to try to stop instance {{(pid=136302) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 12 20:51:02.370557 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-718a2fdf-a4ad-423e-bf81-9acb26a6e562 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:02.386278 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-718a2fdf-a4ad-423e-bf81-9acb26a6e562 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.256169 Mar 12 20:51:02.387897 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 498/1138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:02 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:02.393120 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e6894a26-b621-4844-8c06-96aa17d639d9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:02.394649 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e6894a26-b621-4844-8c06-96aa17d639d9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:02.396284 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72b4caa5-7b56-4a77-9e30-85e9cde6cdb6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "POST /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb/action" status: 202 len: 0 microversion: 2.1 time: 0.190022 Mar 12 20:51:02.398916 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 641/1139] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:51:02 2022] POST /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:51:02.402601 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e6894a26-b621-4844-8c06-96aa17d639d9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.403403 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e6894a26-b621-4844-8c06-96aa17d639d9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.404380 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e6894a26-b621-4844-8c06-96aa17d639d9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.405102 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e6894a26-b621-4844-8c06-96aa17d639d9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.423445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c272325-a2df-4c6b-bd24-1977488dd499 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:02.427330 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:51:02.427330 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:51:02.433678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c272325-a2df-4c6b-bd24-1977488dd499 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.434092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c272325-a2df-4c6b-bd24-1977488dd499 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.435218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c272325-a2df-4c6b-bd24-1977488dd499 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.435745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c272325-a2df-4c6b-bd24-1977488dd499 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.474260 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c272325-a2df-4c6b-bd24-1977488dd499 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.072327 Mar 12 20:51:02.475420 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 642/1140] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Mar 12 20:51:02 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:02.486993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aed4b1ff-608e-4f72-a342-968515d8b2dc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:02.488820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aed4b1ff-608e-4f72-a342-968515d8b2dc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:02.500786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aed4b1ff-608e-4f72-a342-968515d8b2dc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.501496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aed4b1ff-608e-4f72-a342-968515d8b2dc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.502411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aed4b1ff-608e-4f72-a342-968515d8b2dc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.503006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aed4b1ff-608e-4f72-a342-968515d8b2dc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.657807 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e6894a26-b621-4844-8c06-96aa17d639d9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:02.668179 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e6894a26-b621-4844-8c06-96aa17d639d9 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.278826 Mar 12 20:51:02.669080 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 499/1141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:02 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:02.674281 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1407a233-fd6d-4a5f-9ece-fdeaa353b4d5 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:02.677179 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:51:02.677179 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:51:02.679309 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1407a233-fd6d-4a5f-9ece-fdeaa353b4d5 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.680198 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1407a233-fd6d-4a5f-9ece-fdeaa353b4d5 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.681482 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1407a233-fd6d-4a5f-9ece-fdeaa353b4d5 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.681980 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1407a233-fd6d-4a5f-9ece-fdeaa353b4d5 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.707631 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1407a233-fd6d-4a5f-9ece-fdeaa353b4d5 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.037271 Mar 12 20:51:02.708236 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 500/1142] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:51:02 2022] GET /compute/v2.1/os-services => generated 947 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:02.718700 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4fc73e96-f05d-4f93-abfa-2f6079d40152 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:02.720409 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:51:02.720409 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:51:02.722936 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4fc73e96-f05d-4f93-abfa-2f6079d40152 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.723395 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4fc73e96-f05d-4f93-abfa-2f6079d40152 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.724261 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4fc73e96-f05d-4f93-abfa-2f6079d40152 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.724697 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4fc73e96-f05d-4f93-abfa-2f6079d40152 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.757409 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4fc73e96-f05d-4f93-abfa-2f6079d40152 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.042150 Mar 12 20:51:02.765611 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 501/1143] 10.222.0.30 () {58 vars in 1195 bytes} [Sat Mar 12 20:51:02 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:51:02.771732 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-01552d81-6760-4cf9-a501-7899490c83ae tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:02.772985 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:51:02.772985 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:51:02.774717 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-01552d81-6760-4cf9-a501-7899490c83ae tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.775960 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-01552d81-6760-4cf9-a501-7899490c83ae tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.777129 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-01552d81-6760-4cf9-a501-7899490c83ae tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.777725 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-01552d81-6760-4cf9-a501-7899490c83ae tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.807158 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-01552d81-6760-4cf9-a501-7899490c83ae tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.040132 Mar 12 20:51:02.811040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aed4b1ff-608e-4f72-a342-968515d8b2dc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:02.814735 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 502/1144] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:51:02 2022] GET /compute/v2.1/os-services => generated 947 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:02.825480 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-de1f1d00-b2bb-431e-8d4d-94a971456b46 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:02.827781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aed4b1ff-608e-4f72-a342-968515d8b2dc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.350961 Mar 12 20:51:02.828547 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:51:02.828547 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:51:02.832017 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de1f1d00-b2bb-431e-8d4d-94a971456b46 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.832842 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de1f1d00-b2bb-431e-8d4d-94a971456b46 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.833907 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de1f1d00-b2bb-431e-8d4d-94a971456b46 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.834563 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de1f1d00-b2bb-431e-8d4d-94a971456b46 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.853338 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 643/1145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:02 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:02.871416 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-de1f1d00-b2bb-431e-8d4d-94a971456b46 tempest-ServicesAdminNegativeTestJSON-2058155736 tempest-ServicesAdminNegativeTestJSON-2058155736-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.049447 Mar 12 20:51:02.872038 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 503/1146] 10.222.0.30 () {58 vars in 1197 bytes} [Sat Mar 12 20:51:02 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:51:02.927208 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c927e1f0-d6fa-4ac5-9eb8-5d01cc5f1d3e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:02.927906 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c927e1f0-d6fa-4ac5-9eb8-5d01cc5f1d3e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:02.941863 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c927e1f0-d6fa-4ac5-9eb8-5d01cc5f1d3e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.942334 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c927e1f0-d6fa-4ac5-9eb8-5d01cc5f1d3e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:02.943133 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c927e1f0-d6fa-4ac5-9eb8-5d01cc5f1d3e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:02.943617 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c927e1f0-d6fa-4ac5-9eb8-5d01cc5f1d3e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:03.030299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-205f1fdc-bf1b-4e06-b662-c0af08652686 tempest-ServicesAdminNegativeTestJSON-1173634052 tempest-ServicesAdminNegativeTestJSON-1173634052-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:03.031852 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:51:03.031852 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:51:03.033153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-205f1fdc-bf1b-4e06-b662-c0af08652686 tempest-ServicesAdminNegativeTestJSON-1173634052 tempest-ServicesAdminNegativeTestJSON-1173634052-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1b2e76553f1347e1b3cbb28264b6ea9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737aad97e85e4fab9adf2ac0ad489244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:03.033820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-205f1fdc-bf1b-4e06-b662-c0af08652686 tempest-ServicesAdminNegativeTestJSON-1173634052 tempest-ServicesAdminNegativeTestJSON-1173634052-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:51:03.036439 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-205f1fdc-bf1b-4e06-b662-c0af08652686 tempest-ServicesAdminNegativeTestJSON-1173634052 tempest-ServicesAdminNegativeTestJSON-1173634052-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.157117 Mar 12 20:51:03.044091 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 644/1147] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:51:02 2022] GET /compute/v2.1/os-services => generated 112 bytes in 163 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:51:03.214460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90553d76-e07c-40fb-bea1-79a8ff852b64 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:03.215083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90553d76-e07c-40fb-bea1-79a8ff852b64 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:03.215352 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c927e1f0-d6fa-4ac5-9eb8-5d01cc5f1d3e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:03.224866 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c927e1f0-d6fa-4ac5-9eb8-5d01cc5f1d3e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:03.226088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90553d76-e07c-40fb-bea1-79a8ff852b64 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:03.226775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90553d76-e07c-40fb-bea1-79a8ff852b64 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:03.227568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90553d76-e07c-40fb-bea1-79a8ff852b64 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:03.228010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90553d76-e07c-40fb-bea1-79a8ff852b64 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:03.229979 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c927e1f0-d6fa-4ac5-9eb8-5d01cc5f1d3e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:03.239444 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c927e1f0-d6fa-4ac5-9eb8-5d01cc5f1d3e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1634 microversion: 2.25 time: 0.321882 Mar 12 20:51:03.240691 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 504/1148] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:02 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1634 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:03.257587 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-659fdb9e-aaf5-48dd-addc-61a92f045f16 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '.version_select at 0x7f6e36fe1f70>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:03.260606 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-659fdb9e-aaf5-48dd-addc-61a92f045f16 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:03.261590 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-659fdb9e-aaf5-48dd-addc-61a92f045f16 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:03.287313 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-659fdb9e-aaf5-48dd-addc-61a92f045f16 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3627 microversion: 2.25 time: 0.034005 Mar 12 20:51:03.292072 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 505/1149] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Mar 12 20:51:03 2022] GET /compute/v2.1/os-migrations => generated 3627 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:51:03.312318 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4020c781-891d-4bf2-872d-2db9f0e7fb42 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:03.313049 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4020c781-891d-4bf2-872d-2db9f0e7fb42 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:03.325342 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4020c781-891d-4bf2-872d-2db9f0e7fb42 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:03.326065 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4020c781-891d-4bf2-872d-2db9f0e7fb42 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:03.327161 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4020c781-891d-4bf2-872d-2db9f0e7fb42 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:03.327768 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4020c781-891d-4bf2-872d-2db9f0e7fb42 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:03.414931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-90553d76-e07c-40fb-bea1-79a8ff852b64 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:03.458984 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90553d76-e07c-40fb-bea1-79a8ff852b64 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.250901 Mar 12 20:51:03.459571 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 645/1150] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:03 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:03.474868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-334d31bd-08c0-4e26-81cb-fddfe2d2c32c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:03.475733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-334d31bd-08c0-4e26-81cb-fddfe2d2c32c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:03.487061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-334d31bd-08c0-4e26-81cb-fddfe2d2c32c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:03.487781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-334d31bd-08c0-4e26-81cb-fddfe2d2c32c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:03.490948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-334d31bd-08c0-4e26-81cb-fddfe2d2c32c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:03.491583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-334d31bd-08c0-4e26-81cb-fddfe2d2c32c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:03.668394 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-4020c781-891d-4bf2-872d-2db9f0e7fb42 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:03.689686 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4020c781-891d-4bf2-872d-2db9f0e7fb42 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 2126 microversion: 2.25 time: 0.388129 Mar 12 20:51:03.691553 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 506/1151] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:03 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 2126 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:03.701342 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7b6ad75e-358d-4191-9b49-3e9b78389074 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:03.703234 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7b6ad75e-358d-4191-9b49-3e9b78389074 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:03.715597 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b6ad75e-358d-4191-9b49-3e9b78389074 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:03.717019 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b6ad75e-358d-4191-9b49-3e9b78389074 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:03.718100 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b6ad75e-358d-4191-9b49-3e9b78389074 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:03.718869 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7b6ad75e-358d-4191-9b49-3e9b78389074 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:03.927471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-334d31bd-08c0-4e26-81cb-fddfe2d2c32c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:03.938784 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-334d31bd-08c0-4e26-81cb-fddfe2d2c32c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.466713 Mar 12 20:51:03.940212 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 646/1152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:03 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:03.950537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7340487-8a1e-48b2-8e20-2e07e3b8c65d tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:03.953003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7340487-8a1e-48b2-8e20-2e07e3b8c65d tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:03.964215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7340487-8a1e-48b2-8e20-2e07e3b8c65d tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:03.964935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7340487-8a1e-48b2-8e20-2e07e3b8c65d tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:03.966480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7340487-8a1e-48b2-8e20-2e07e3b8c65d tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:03.967145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7340487-8a1e-48b2-8e20-2e07e3b8c65d tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:03.993004 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7b6ad75e-358d-4191-9b49-3e9b78389074 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:04.001294 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7b6ad75e-358d-4191-9b49-3e9b78389074 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.308445 Mar 12 20:51:04.006936 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 507/1153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:03 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:04.011894 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0d73cf3d-2b8f-44ef-afa4-27f4838d2c9f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:04.012583 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-0d73cf3d-2b8f-44ef-afa4-27f4838d2c9f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:04.019209 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0d73cf3d-2b8f-44ef-afa4-27f4838d2c9f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:04.019812 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0d73cf3d-2b8f-44ef-afa4-27f4838d2c9f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:04.020702 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0d73cf3d-2b8f-44ef-afa4-27f4838d2c9f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:04.021245 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0d73cf3d-2b8f-44ef-afa4-27f4838d2c9f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:04.257735 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-0d73cf3d-2b8f-44ef-afa4-27f4838d2c9f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:04.278467 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0d73cf3d-2b8f-44ef-afa4-27f4838d2c9f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.270139 Mar 12 20:51:04.290262 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 508/1154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:04 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:04.484505 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-32170795-7369-4e9e-8b05-503d2af3a426 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:04.485158 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-32170795-7369-4e9e-8b05-503d2af3a426 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:04.492332 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-32170795-7369-4e9e-8b05-503d2af3a426 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:04.494067 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-32170795-7369-4e9e-8b05-503d2af3a426 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:04.495651 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-32170795-7369-4e9e-8b05-503d2af3a426 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:04.496300 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-32170795-7369-4e9e-8b05-503d2af3a426 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:04.552423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-c7340487-8a1e-48b2-8e20-2e07e3b8c65d tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:04.567863 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7340487-8a1e-48b2-8e20-2e07e3b8c65d tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 2126 microversion: 2.25 time: 0.623965 Mar 12 20:51:04.568752 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 647/1155] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:03 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 2126 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:04.661268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20f99f2b-2a03-48e1-8a77-9ac4e2907855 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:04.662506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20f99f2b-2a03-48e1-8a77-9ac4e2907855 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:04.672206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20f99f2b-2a03-48e1-8a77-9ac4e2907855 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:04.672844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20f99f2b-2a03-48e1-8a77-9ac4e2907855 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:04.674262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20f99f2b-2a03-48e1-8a77-9ac4e2907855 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:04.675827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20f99f2b-2a03-48e1-8a77-9ac4e2907855 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:04.700469 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-32170795-7369-4e9e-8b05-503d2af3a426 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:04.749903 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-32170795-7369-4e9e-8b05-503d2af3a426 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.274880 Mar 12 20:51:04.755236 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 509/1156] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:04 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:51:04.960893 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-923df27d-b996-4908-a621-b2000bd4ca18 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:04.961714 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-923df27d-b996-4908-a621-b2000bd4ca18 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:04.969071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-20f99f2b-2a03-48e1-8a77-9ac4e2907855 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lazy-loading 'services' on Instance uuid 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:04.980735 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-923df27d-b996-4908-a621-b2000bd4ca18 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:04.982540 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-923df27d-b996-4908-a621-b2000bd4ca18 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:04.985921 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-923df27d-b996-4908-a621-b2000bd4ca18 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:04.989619 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-923df27d-b996-4908-a621-b2000bd4ca18 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:05.153057 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20f99f2b-2a03-48e1-8a77-9ac4e2907855 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0/os-volume_attachments/ef287d20-f6d2-4dff-bb11-f7a93fffa821" status: 202 len: 0 microversion: 2.25 time: 0.496760 Mar 12 20:51:05.153694 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 648/1157] 10.222.0.30 () {60 vars in 1456 bytes} [Sat Mar 12 20:51:04 2022] DELETE /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0/os-volume_attachments/ef287d20-f6d2-4dff-bb11-f7a93fffa821 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:51:05.175774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e96186ec-003d-48b9-aaa0-209173101388 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:05.176644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e96186ec-003d-48b9-aaa0-209173101388 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:05.201118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e96186ec-003d-48b9-aaa0-209173101388 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:05.201670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e96186ec-003d-48b9-aaa0-209173101388 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:05.202501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e96186ec-003d-48b9-aaa0-209173101388 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:05.202948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e96186ec-003d-48b9-aaa0-209173101388 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:05.604750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e96186ec-003d-48b9-aaa0-209173101388 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:05.613525 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e96186ec-003d-48b9-aaa0-209173101388 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.455093 Mar 12 20:51:05.614137 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 649/1158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:05 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:05.619119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a50de20-5beb-40be-84c2-ce9ec1304c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:05.620296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a50de20-5beb-40be-84c2-ce9ec1304c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:05.626532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a50de20-5beb-40be-84c2-ce9ec1304c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:05.627172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a50de20-5beb-40be-84c2-ce9ec1304c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:05.628186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a50de20-5beb-40be-84c2-ce9ec1304c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:05.628796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a50de20-5beb-40be-84c2-ce9ec1304c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:05.653155 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-923df27d-b996-4908-a621-b2000bd4ca18 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:05.661345 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-923df27d-b996-4908-a621-b2000bd4ca18 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1476 microversion: 2.1 time: 0.707111 Mar 12 20:51:05.672118 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 510/1159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:04 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1476 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:05.673112 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a50de20-5beb-40be-84c2-ce9ec1304c51 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.057266 Mar 12 20:51:05.674319 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 650/1160] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Mar 12 20:51:05 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:51:05.678175 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7c1c574e-f729-4596-81b1-d6d41498c212 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:05.679023 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7c1c574e-f729-4596-81b1-d6d41498c212 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:05.685386 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7c1c574e-f729-4596-81b1-d6d41498c212 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:05.686046 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7c1c574e-f729-4596-81b1-d6d41498c212 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:05.686815 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7c1c574e-f729-4596-81b1-d6d41498c212 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:05.687418 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7c1c574e-f729-4596-81b1-d6d41498c212 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:05.776101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8f75f8c-9972-4c0f-af10-a071eec83628 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:05.776855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8f75f8c-9972-4c0f-af10-a071eec83628 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:05.788201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8f75f8c-9972-4c0f-af10-a071eec83628 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:05.789428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8f75f8c-9972-4c0f-af10-a071eec83628 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:05.791563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8f75f8c-9972-4c0f-af10-a071eec83628 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:05.792270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8f75f8c-9972-4c0f-af10-a071eec83628 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:05.899244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-c8f75f8c-9972-4c0f-af10-a071eec83628 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:05.930176 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8f75f8c-9972-4c0f-af10-a071eec83628 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.157702 Mar 12 20:51:05.931716 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 651/1161] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:05 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:05.986790 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7c1c574e-f729-4596-81b1-d6d41498c212 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:05.994787 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7c1c574e-f729-4596-81b1-d6d41498c212 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.321389 Mar 12 20:51:05.996063 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 511/1162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:05 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:06.636729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9026320a-9b1b-4053-a947-e3aeeb358c8d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:06.645737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9026320a-9b1b-4053-a947-e3aeeb358c8d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:06.681558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9026320a-9b1b-4053-a947-e3aeeb358c8d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:06.681697 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-46817cf1-412a-4934-8e4b-13a85abbcdbd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:06.682375 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-46817cf1-412a-4934-8e4b-13a85abbcdbd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:06.686957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9026320a-9b1b-4053-a947-e3aeeb358c8d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:06.693617 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-46817cf1-412a-4934-8e4b-13a85abbcdbd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:06.694352 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-46817cf1-412a-4934-8e4b-13a85abbcdbd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:06.695665 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-46817cf1-412a-4934-8e4b-13a85abbcdbd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:06.696292 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-46817cf1-412a-4934-8e4b-13a85abbcdbd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:06.698286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9026320a-9b1b-4053-a947-e3aeeb358c8d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:06.699928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9026320a-9b1b-4053-a947-e3aeeb358c8d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:06.916482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9026320a-9b1b-4053-a947-e3aeeb358c8d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:06.926497 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9026320a-9b1b-4053-a947-e3aeeb358c8d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.299409 Mar 12 20:51:06.927419 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 652/1163] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:06 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:06.934899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ebbee4ed-7f45-4b5e-8ed8-e620504daa25 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:06.936117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ebbee4ed-7f45-4b5e-8ed8-e620504daa25 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:06.945977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebbee4ed-7f45-4b5e-8ed8-e620504daa25 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:06.946698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebbee4ed-7f45-4b5e-8ed8-e620504daa25 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:06.947604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebbee4ed-7f45-4b5e-8ed8-e620504daa25 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:06.948158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebbee4ed-7f45-4b5e-8ed8-e620504daa25 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:06.982968 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ebbee4ed-7f45-4b5e-8ed8-e620504daa25 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.054204 Mar 12 20:51:06.983635 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 653/1164] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Mar 12 20:51:06 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:06.990070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-356c2293-8611-487c-984b-76f26e67cbbe tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:06.991433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-356c2293-8611-487c-984b-76f26e67cbbe tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:06.998928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-356c2293-8611-487c-984b-76f26e67cbbe tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:06.999612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-356c2293-8611-487c-984b-76f26e67cbbe tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:07.000769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-356c2293-8611-487c-984b-76f26e67cbbe tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:07.001512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-356c2293-8611-487c-984b-76f26e67cbbe tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:07.110539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-356c2293-8611-487c-984b-76f26e67cbbe tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:07.135204 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-356c2293-8611-487c-984b-76f26e67cbbe tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.150275 Mar 12 20:51:07.135800 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 654/1165] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:06 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:07.155904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20685319-021c-4fc4-b8a6-0e41307ecda6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:07.157106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20685319-021c-4fc4-b8a6-0e41307ecda6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:07.167621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20685319-021c-4fc4-b8a6-0e41307ecda6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:07.168286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20685319-021c-4fc4-b8a6-0e41307ecda6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:07.169404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20685319-021c-4fc4-b8a6-0e41307ecda6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:07.169959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20685319-021c-4fc4-b8a6-0e41307ecda6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:07.325537 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-46817cf1-412a-4934-8e4b-13a85abbcdbd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:07.341818 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-46817cf1-412a-4934-8e4b-13a85abbcdbd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1475 microversion: 2.1 time: 0.665400 Mar 12 20:51:07.347116 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 512/1166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:06 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1475 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:07.446595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-20685319-021c-4fc4-b8a6-0e41307ecda6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:07.454181 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20685319-021c-4fc4-b8a6-0e41307ecda6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.310643 Mar 12 20:51:07.459392 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 655/1167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:07 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:07.945334 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-6f81c3f1-5992-4d11-bc07-a2c31c839ef7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:07.946031 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-6f81c3f1-5992-4d11-bc07-a2c31c839ef7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:07.958917 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6f81c3f1-5992-4d11-bc07-a2c31c839ef7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:07.968539 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6f81c3f1-5992-4d11-bc07-a2c31c839ef7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:07.973352 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6f81c3f1-5992-4d11-bc07-a2c31c839ef7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:07.975910 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6f81c3f1-5992-4d11-bc07-a2c31c839ef7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:08.203797 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-6f81c3f1-5992-4d11-bc07-a2c31c839ef7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:08.221392 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-6f81c3f1-5992-4d11-bc07-a2c31c839ef7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.281168 Mar 12 20:51:08.223680 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 513/1168] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:07 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:08.254333 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e97faa36-62cc-443c-ad9a-737f7501c540 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:08.255664 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e97faa36-62cc-443c-ad9a-737f7501c540 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:08.269733 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e97faa36-62cc-443c-ad9a-737f7501c540 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:08.270411 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e97faa36-62cc-443c-ad9a-737f7501c540 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:08.271524 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e97faa36-62cc-443c-ad9a-737f7501c540 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:08.284680 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e97faa36-62cc-443c-ad9a-737f7501c540 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:08.298866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-418137838", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:08.380007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:51:08.382778 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-e97faa36-62cc-443c-ad9a-737f7501c540 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:08.401316 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e97faa36-62cc-443c-ad9a-737f7501c540 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.173861 Mar 12 20:51:08.401927 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 514/1169] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:08 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:08.487834 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-341623b0-29ca-429a-9a4c-9689cf6d4075 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Action: 'create', calling method: .version_select at 0x7f6e36fccca0>, body: {"keypair": {"name": "tempest-keypair-1407543264"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:08.508412 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-341623b0-29ca-429a-9a4c-9689cf6d4075 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Getting quotas for project f0a5497c8a2449c89a200ddd03ce5aeb. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:51:08.514588 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-341623b0-29ca-429a-9a4c-9689cf6d4075 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Getting quotas for user 38372b69c92d4456879f7fa00239f0c8 and project f0a5497c8a2449c89a200ddd03ce5aeb. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:51:08.742405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:51:08.742834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:51:08.743315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:51:08.743735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:51:08.744152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:51:08.760733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:08.761194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:08.762041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:08.762486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:08.819004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Getting quotas for project 529c8a73cc26499cbbe851532b8c601a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:51:08.825182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Getting quotas for user b5dd8062973244c8a006b740c0b21218 and project 529c8a73cc26499cbbe851532b8c601a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:51:08.845743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:51:08.848726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:51:08.852857 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-341623b0-29ca-429a-9a4c-9689cf6d4075 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Getting quotas for project f0a5497c8a2449c89a200ddd03ce5aeb. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:51:08.863995 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-341623b0-29ca-429a-9a4c-9689cf6d4075 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Getting quotas for user 38372b69c92d4456879f7fa00239f0c8 and project f0a5497c8a2449c89a200ddd03ce5aeb. Resources: {'key_pairs'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:51:08.899191 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-341623b0-29ca-429a-9a4c-9689cf6d4075 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.495499 Mar 12 20:51:08.899814 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 515/1170] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Mar 12 20:51:08 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 497 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:51:08.904442 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b536c6d8-3e95-426e-9b80-479e4ad4f7dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:08.905059 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b536c6d8-3e95-426e-9b80-479e4ad4f7dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:08.930707 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b536c6d8-3e95-426e-9b80-479e4ad4f7dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:08.933232 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b536c6d8-3e95-426e-9b80-479e4ad4f7dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:08.934994 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b536c6d8-3e95-426e-9b80-479e4ad4f7dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:08.935636 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b536c6d8-3e95-426e-9b80-479e4ad4f7dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:08.939953 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-133b9014-009e-4c2d-88cf-095b299a05a5 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.847369 Mar 12 20:51:08.942928 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 656/1171] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:51:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 20:51:08.951557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-092f9835-8da7-43a5-b8ab-89ddacc418ef req-ef5d5452-e2fc-4d65-b51b-a8ca4af42b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40005ee-4cc8-49d8-a826-236d4aad98a0", "name": "network-vif-unplugged", "status": "completed", "tag": "fee78365-562c-495b-80e2-d01504c255bf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:08.990042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-092f9835-8da7-43a5-b8ab-89ddacc418ef req-ef5d5452-e2fc-4d65-b51b-a8ca4af42b8e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:08.990527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-092f9835-8da7-43a5-b8ab-89ddacc418ef req-ef5d5452-e2fc-4d65-b51b-a8ca4af42b8e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:09.023215 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-092f9835-8da7-43a5-b8ab-89ddacc418ef req-ef5d5452-e2fc-4d65-b51b-a8ca4af42b8e service nova] Creating event network-vif-unplugged:fee78365-562c-495b-80e2-d01504c255bf for instance e40005ee-4cc8-49d8-a826-236d4aad98a0 on nch2-master-1 Mar 12 20:51:09.035853 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-092f9835-8da7-43a5-b8ab-89ddacc418ef req-ef5d5452-e2fc-4d65-b51b-a8ca4af42b8e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086330 Mar 12 20:51:09.037442 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 657/1172] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:09.050691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b08f16ae-966c-4de5-9ce0-0c76fc258e21 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:09.052879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b08f16ae-966c-4de5-9ce0-0c76fc258e21 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:09.070844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b08f16ae-966c-4de5-9ce0-0c76fc258e21 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:09.072626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b08f16ae-966c-4de5-9ce0-0c76fc258e21 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:09.074202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b08f16ae-966c-4de5-9ce0-0c76fc258e21 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:09.074971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b08f16ae-966c-4de5-9ce0-0c76fc258e21 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:09.326144 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b536c6d8-3e95-426e-9b80-479e4ad4f7dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:09.336976 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b536c6d8-3e95-426e-9b80-479e4ad4f7dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1473 microversion: 2.1 time: 0.436089 Mar 12 20:51:09.338375 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 516/1173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:08 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1473 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:09.345185 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-19f6c97c-e26d-4c8e-b4f9-96fc7adebe0d tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:09.346242 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-19f6c97c-e26d-4c8e-b4f9-96fc7adebe0d tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:09.444105 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-19f6c97c-e26d-4c8e-b4f9-96fc7adebe0d tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:09.466922 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-19f6c97c-e26d-4c8e-b4f9-96fc7adebe0d tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1213 microversion: 2.1 time: 0.115936 Mar 12 20:51:09.478021 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 517/1174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:09 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:09.482460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b08f16ae-966c-4de5-9ce0-0c76fc258e21 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:09.506518 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-73d1dd1b-983f-4cb3-b610-4a79936ccb72 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:09.508333 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-73d1dd1b-983f-4cb3-b610-4a79936ccb72 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:09.511496 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b08f16ae-966c-4de5-9ce0-0c76fc258e21 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.469900 Mar 12 20:51:09.527702 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 658/1175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:09 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:09.535914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86febc96-0afb-4947-bcb6-8cf4be5f281e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:09.537494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86febc96-0afb-4947-bcb6-8cf4be5f281e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:09.543962 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73d1dd1b-983f-4cb3-b610-4a79936ccb72 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:09.546069 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73d1dd1b-983f-4cb3-b610-4a79936ccb72 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:09.549107 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73d1dd1b-983f-4cb3-b610-4a79936ccb72 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:09.550338 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73d1dd1b-983f-4cb3-b610-4a79936ccb72 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:09.568903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86febc96-0afb-4947-bcb6-8cf4be5f281e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:09.570822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86febc96-0afb-4947-bcb6-8cf4be5f281e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:09.571971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86febc96-0afb-4947-bcb6-8cf4be5f281e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:09.572587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86febc96-0afb-4947-bcb6-8cf4be5f281e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:09.703148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-86febc96-0afb-4947-bcb6-8cf4be5f281e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:09.733224 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86febc96-0afb-4947-bcb6-8cf4be5f281e tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.203602 Mar 12 20:51:09.736054 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 659/1176] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:09 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:09.881617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1a835344-fc71-4342-8f3c-535b21aaf835 req-d94fb91e-afda-44ea-b590-8f668c2022b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7f5155-9258-4c32-894e-ef4ffcc25a28", "name": "network-vif-unplugged", "status": "completed", "tag": "5c2b07b8-3063-4abf-8d95-04a1b3c25a29"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:09.882510 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-73d1dd1b-983f-4cb3-b610-4a79936ccb72 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:09.892205 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-73d1dd1b-983f-4cb3-b610-4a79936ccb72 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.411524 Mar 12 20:51:09.893283 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 518/1177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:09 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:09.911906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1a835344-fc71-4342-8f3c-535b21aaf835 req-d94fb91e-afda-44ea-b590-8f668c2022b8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:09.914507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1a835344-fc71-4342-8f3c-535b21aaf835 req-d94fb91e-afda-44ea-b590-8f668c2022b8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:09.937511 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1a835344-fc71-4342-8f3c-535b21aaf835 req-d94fb91e-afda-44ea-b590-8f668c2022b8 service nova] Creating event network-vif-unplugged:5c2b07b8-3063-4abf-8d95-04a1b3c25a29 for instance 1f7f5155-9258-4c32-894e-ef4ffcc25a28 on nch1-master-1 Mar 12 20:51:09.947860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-1a835344-fc71-4342-8f3c-535b21aaf835 req-d94fb91e-afda-44ea-b590-8f668c2022b8 service nova] Instance 1f7f5155-9258-4c32-894e-ef4ffcc25a28 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:51:09.958128 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1a835344-fc71-4342-8f3c-535b21aaf835 req-d94fb91e-afda-44ea-b590-8f668c2022b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080626 Mar 12 20:51:09.959886 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 660/1178] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:10.355457 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3383f3b2-493c-4170-b769-47b2a0c41f2b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:10.356059 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3383f3b2-493c-4170-b769-47b2a0c41f2b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:10.365808 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3383f3b2-493c-4170-b769-47b2a0c41f2b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:10.367165 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3383f3b2-493c-4170-b769-47b2a0c41f2b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:10.368896 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3383f3b2-493c-4170-b769-47b2a0c41f2b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:10.370052 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3383f3b2-493c-4170-b769-47b2a0c41f2b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:10.492969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4da6aacc-b26b-4820-86cb-bcac0139864b tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:10.494244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4da6aacc-b26b-4820-86cb-bcac0139864b tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:10.505659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da6aacc-b26b-4820-86cb-bcac0139864b tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:10.512425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da6aacc-b26b-4820-86cb-bcac0139864b tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:10.514064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da6aacc-b26b-4820-86cb-bcac0139864b tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:10.514691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da6aacc-b26b-4820-86cb-bcac0139864b tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:10.557010 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3383f3b2-493c-4170-b769-47b2a0c41f2b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:10.565445 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3383f3b2-493c-4170-b769-47b2a0c41f2b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1473 microversion: 2.1 time: 0.213921 Mar 12 20:51:10.577250 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 519/1179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:10 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1473 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:10.579135 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e838067d-c0c8-4aa8-b33b-d132698381a3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:10.579769 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e838067d-c0c8-4aa8-b33b-d132698381a3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:10.594241 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e838067d-c0c8-4aa8-b33b-d132698381a3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:10.594726 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e838067d-c0c8-4aa8-b33b-d132698381a3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:10.595581 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e838067d-c0c8-4aa8-b33b-d132698381a3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:10.596034 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e838067d-c0c8-4aa8-b33b-d132698381a3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:10.774879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4da6aacc-b26b-4820-86cb-bcac0139864b tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:10.787018 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4da6aacc-b26b-4820-86cb-bcac0139864b tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1265 microversion: 2.1 time: 0.300116 Mar 12 20:51:10.798254 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 661/1180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:10 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:10.805650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dff25406-4957-4edc-a4ac-e491d9270484 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:10.810626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dff25406-4957-4edc-a4ac-e491d9270484 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:10.823538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dff25406-4957-4edc-a4ac-e491d9270484 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:10.825584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dff25406-4957-4edc-a4ac-e491d9270484 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:10.826627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dff25406-4957-4edc-a4ac-e491d9270484 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:10.827940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dff25406-4957-4edc-a4ac-e491d9270484 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:10.996202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-dff25406-4957-4edc-a4ac-e491d9270484 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:11.018243 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e838067d-c0c8-4aa8-b33b-d132698381a3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:11.027429 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e838067d-c0c8-4aa8-b33b-d132698381a3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.459394 Mar 12 20:51:11.033581 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 520/1181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:10 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:11.038884 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-595cc619-1e1e-4767-90a5-4657ac583a7d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:11.039815 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-595cc619-1e1e-4767-90a5-4657ac583a7d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:11.052041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dff25406-4957-4edc-a4ac-e491d9270484 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.251030 Mar 12 20:51:11.069097 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 662/1182] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:10 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:11.070641 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-595cc619-1e1e-4767-90a5-4657ac583a7d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:11.071440 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-595cc619-1e1e-4767-90a5-4657ac583a7d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:11.072506 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-595cc619-1e1e-4767-90a5-4657ac583a7d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:11.073181 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-595cc619-1e1e-4767-90a5-4657ac583a7d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:11.129677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e48e5c2a-4f3e-4a85-a066-18187ee1c793 req-2b3f7212-24af-4bd1-9cff-866510116d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e40005ee-4cc8-49d8-a826-236d4aad98a0", "tag": "fee78365-562c-495b-80e2-d01504c255bf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:11.143533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e48e5c2a-4f3e-4a85-a066-18187ee1c793 req-2b3f7212-24af-4bd1-9cff-866510116d43 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:11.147045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e48e5c2a-4f3e-4a85-a066-18187ee1c793 req-2b3f7212-24af-4bd1-9cff-866510116d43 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:11.184242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e48e5c2a-4f3e-4a85-a066-18187ee1c793 req-2b3f7212-24af-4bd1-9cff-866510116d43 service nova] Creating event network-changed:fee78365-562c-495b-80e2-d01504c255bf for instance e40005ee-4cc8-49d8-a826-236d4aad98a0 on nch2-master-1 Mar 12 20:51:11.192696 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e48e5c2a-4f3e-4a85-a066-18187ee1c793 req-2b3f7212-24af-4bd1-9cff-866510116d43 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069559 Mar 12 20:51:11.194108 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 663/1183] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:51:11.584312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d18e0070-8011-4cc2-8b55-6a52b8584555 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:11.586003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d18e0070-8011-4cc2-8b55-6a52b8584555 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:11.605432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d18e0070-8011-4cc2-8b55-6a52b8584555 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:11.606267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d18e0070-8011-4cc2-8b55-6a52b8584555 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:11.606920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d18e0070-8011-4cc2-8b55-6a52b8584555 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:11.607427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d18e0070-8011-4cc2-8b55-6a52b8584555 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:11.807065 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-595cc619-1e1e-4767-90a5-4657ac583a7d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:11.820064 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-595cc619-1e1e-4767-90a5-4657ac583a7d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.784749 Mar 12 20:51:11.827067 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 521/1184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:11 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:11.839077 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-729268085", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a51710d4-9f40-4852-b011-5741f102b40f"}], "security_groups": [{"name": "tempest-securitygroup--474782781"}], "key_name": "tempest-keypair-1407543264", "user_data": "}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:11.878758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d18e0070-8011-4cc2-8b55-6a52b8584555 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:11.888263 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d18e0070-8011-4cc2-8b55-6a52b8584555 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1473 microversion: 2.1 time: 0.309058 Mar 12 20:51:11.898354 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 664/1185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:11 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1473 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:11.913422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1bc45a93-c947-405a-a549-0a4755fb2dfb tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:11.914356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1bc45a93-c947-405a-a549-0a4755fb2dfb tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:11.921555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bc45a93-c947-405a-a549-0a4755fb2dfb tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:11.922311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bc45a93-c947-405a-a549-0a4755fb2dfb tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:11.923437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bc45a93-c947-405a-a549-0a4755fb2dfb tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:11.924503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bc45a93-c947-405a-a549-0a4755fb2dfb tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:12.008476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1bc45a93-c947-405a-a549-0a4755fb2dfb tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:12.019984 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1bc45a93-c947-405a-a549-0a4755fb2dfb tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1271 microversion: 2.1 time: 0.119961 Mar 12 20:51:12.022496 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 665/1186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:11 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:12.056327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f67e8a76-f3a2-4288-928f-df171bbc5887 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:12.057288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f67e8a76-f3a2-4288-928f-df171bbc5887 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:12.064656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f67e8a76-f3a2-4288-928f-df171bbc5887 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:12.065378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f67e8a76-f3a2-4288-928f-df171bbc5887 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:12.066440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f67e8a76-f3a2-4288-928f-df171bbc5887 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:12.067096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f67e8a76-f3a2-4288-928f-df171bbc5887 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:12.108326 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.neutron [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] validate_networks() for [('a51710d4-9f40-4852-b011-5741f102b40f', None, None, None, None, None)] {{(pid=136303) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:51:12.261353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f67e8a76-f3a2-4288-928f-df171bbc5887 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:12.276710 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f67e8a76-f3a2-4288-928f-df171bbc5887 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.231069 Mar 12 20:51:12.277715 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 666/1187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:12 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:12.282628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a028faee-7689-4504-899e-dd5f9d065ba3 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:12.283233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a028faee-7689-4504-899e-dd5f9d065ba3 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:12.297458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a028faee-7689-4504-899e-dd5f9d065ba3 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:12.298736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a028faee-7689-4504-899e-dd5f9d065ba3 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:12.302530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a028faee-7689-4504-899e-dd5f9d065ba3 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:12.302985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a028faee-7689-4504-899e-dd5f9d065ba3 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:12.401211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-a028faee-7689-4504-899e-dd5f9d065ba3 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:12.422039 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a028faee-7689-4504-899e-dd5f9d065ba3 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.142672 Mar 12 20:51:12.423823 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 667/1188] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:12 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:12.844849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d139cfae-0fd6-4c25-8f91-1a1841246141 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:12.846864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d139cfae-0fd6-4c25-8f91-1a1841246141 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:12.863548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d139cfae-0fd6-4c25-8f91-1a1841246141 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:12.864003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d139cfae-0fd6-4c25-8f91-1a1841246141 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:12.864801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d139cfae-0fd6-4c25-8f91-1a1841246141 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:12.865239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d139cfae-0fd6-4c25-8f91-1a1841246141 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:13.118732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d139cfae-0fd6-4c25-8f91-1a1841246141 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:13.160818 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d139cfae-0fd6-4c25-8f91-1a1841246141 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.316638 Mar 12 20:51:13.172079 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 668/1189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:12 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:13.185158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-926cccb4-2ee7-4dcc-86e0-bc4170b8149f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:13.185832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-926cccb4-2ee7-4dcc-86e0-bc4170b8149f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:13.201154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-926cccb4-2ee7-4dcc-86e0-bc4170b8149f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:13.201934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-926cccb4-2ee7-4dcc-86e0-bc4170b8149f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:13.202976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-926cccb4-2ee7-4dcc-86e0-bc4170b8149f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:13.203589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-926cccb4-2ee7-4dcc-86e0-bc4170b8149f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:13.258119 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:51:13.258647 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:51:13.259023 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:51:13.259432 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:51:13.261325 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:51:13.275240 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:13.276092 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:13.277170 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:13.277862 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:13.303552 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Getting quotas for project f0a5497c8a2449c89a200ddd03ce5aeb. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:51:13.310107 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Getting quotas for user 38372b69c92d4456879f7fa00239f0c8 and project f0a5497c8a2449c89a200ddd03ce5aeb. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:51:13.338324 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Going to run 1 instances... {{(pid=136303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:51:13.340803 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:51:13.398476 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7aaeb776-3457-45b6-b76e-b21127f899ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.570083 Mar 12 20:51:13.399664 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 522/1190] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:51:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 20:51:13.404958 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4229e886-44ca-4285-857d-60a2d8833d24 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:13.405941 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4229e886-44ca-4285-857d-60a2d8833d24 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:13.417325 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4229e886-44ca-4285-857d-60a2d8833d24 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:13.419305 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4229e886-44ca-4285-857d-60a2d8833d24 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:13.422853 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4229e886-44ca-4285-857d-60a2d8833d24 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:13.423247 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4229e886-44ca-4285-857d-60a2d8833d24 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:13.483911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-926cccb4-2ee7-4dcc-86e0-bc4170b8149f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:13.493937 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-926cccb4-2ee7-4dcc-86e0-bc4170b8149f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1473 microversion: 2.1 time: 0.320656 Mar 12 20:51:13.495386 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 669/1191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:13 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1473 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:13.508876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b896ff77-6bfb-4439-95d5-8b4923273578 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:13.509508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b896ff77-6bfb-4439-95d5-8b4923273578 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:13.528746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b896ff77-6bfb-4439-95d5-8b4923273578 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:13.528891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b896ff77-6bfb-4439-95d5-8b4923273578 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:13.536457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b896ff77-6bfb-4439-95d5-8b4923273578 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:13.536924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b896ff77-6bfb-4439-95d5-8b4923273578 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:13.788316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b896ff77-6bfb-4439-95d5-8b4923273578 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:13.800025 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b896ff77-6bfb-4439-95d5-8b4923273578 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.302877 Mar 12 20:51:13.803260 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 670/1192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:13 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:13.822348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-64016cee-d005-43ce-b63c-58269d25aeb7 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:13.823826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-64016cee-d005-43ce-b63c-58269d25aeb7 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:13.855759 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4229e886-44ca-4285-857d-60a2d8833d24 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:13.869231 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4229e886-44ca-4285-857d-60a2d8833d24 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1313 microversion: 2.1 time: 0.468201 Mar 12 20:51:13.875932 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 523/1193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:13 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:13.892172 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2d725152-602b-42b5-964f-0d0231925dfd tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:13.908090 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-2d725152-602b-42b5-964f-0d0231925dfd tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:13.946656 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2d725152-602b-42b5-964f-0d0231925dfd tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:13.950141 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2d725152-602b-42b5-964f-0d0231925dfd tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:13.952990 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2d725152-602b-42b5-964f-0d0231925dfd tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:13.955044 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2d725152-602b-42b5-964f-0d0231925dfd tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:14.051611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-64016cee-d005-43ce-b63c-58269d25aeb7 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:14.066780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-64016cee-d005-43ce-b63c-58269d25aeb7 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:14.068731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-64016cee-d005-43ce-b63c-58269d25aeb7 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:14.071028 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-64016cee-d005-43ce-b63c-58269d25aeb7 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1281 microversion: 2.20 time: 0.265296 Mar 12 20:51:14.075450 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 671/1194] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:13 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:14.157762 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-2d725152-602b-42b5-964f-0d0231925dfd tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:14.181294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b034f180-6577-48a1-a139-22e7ca8c6816 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:14.181944 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2d725152-602b-42b5-964f-0d0231925dfd tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.297611 Mar 12 20:51:14.182099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b034f180-6577-48a1-a139-22e7ca8c6816 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:14.183107 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 524/1195] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:13 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:14.198330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b034f180-6577-48a1-a139-22e7ca8c6816 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:14.199152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b034f180-6577-48a1-a139-22e7ca8c6816 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:14.201176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b034f180-6577-48a1-a139-22e7ca8c6816 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:14.201956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b034f180-6577-48a1-a139-22e7ca8c6816 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:14.510655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b034f180-6577-48a1-a139-22e7ca8c6816 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:14.515823 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a9d2e0e0-a1ad-4b15-ad78-a2d566a871c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:14.517250 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a9d2e0e0-a1ad-4b15-ad78-a2d566a871c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:14.519521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b034f180-6577-48a1-a139-22e7ca8c6816 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.343435 Mar 12 20:51:14.520258 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 672/1196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:14 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:14.526049 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a9d2e0e0-a1ad-4b15-ad78-a2d566a871c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:14.526700 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a9d2e0e0-a1ad-4b15-ad78-a2d566a871c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:14.527930 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a9d2e0e0-a1ad-4b15-ad78-a2d566a871c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:14.528599 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a9d2e0e0-a1ad-4b15-ad78-a2d566a871c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:14.823663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-07cac8ed-cd9f-4dfb-85a1-da9701b72f88 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:14.823829 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a9d2e0e0-a1ad-4b15-ad78-a2d566a871c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:14.824711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-07cac8ed-cd9f-4dfb-85a1-da9701b72f88 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:14.846284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07cac8ed-cd9f-4dfb-85a1-da9701b72f88 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:14.846772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07cac8ed-cd9f-4dfb-85a1-da9701b72f88 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:14.847619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07cac8ed-cd9f-4dfb-85a1-da9701b72f88 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:14.849651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07cac8ed-cd9f-4dfb-85a1-da9701b72f88 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:14.852068 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a9d2e0e0-a1ad-4b15-ad78-a2d566a871c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1470 microversion: 2.1 time: 0.341306 Mar 12 20:51:14.853837 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 525/1197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:14 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:14.878421 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-94a97871-f9ef-456b-83e3-3317f66df6fe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:14.879638 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-94a97871-f9ef-456b-83e3-3317f66df6fe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:14.909340 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-94a97871-f9ef-456b-83e3-3317f66df6fe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:14.911489 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-94a97871-f9ef-456b-83e3-3317f66df6fe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:14.913663 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-94a97871-f9ef-456b-83e3-3317f66df6fe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:14.917804 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-94a97871-f9ef-456b-83e3-3317f66df6fe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:15.085361 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-94a97871-f9ef-456b-83e3-3317f66df6fe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "POST /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28/action" status: 204 len: 0 microversion: 2.1 time: 0.218868 Mar 12 20:51:15.086064 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 526/1198] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:51:14 2022] POST /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28/action => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:51:15.104842 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-461f3b7a-a8ee-42e0-99e7-84bd1e7849ef tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:15.106001 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-461f3b7a-a8ee-42e0-99e7-84bd1e7849ef tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:15.136506 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-461f3b7a-a8ee-42e0-99e7-84bd1e7849ef tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:15.137661 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-461f3b7a-a8ee-42e0-99e7-84bd1e7849ef tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:15.139739 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-461f3b7a-a8ee-42e0-99e7-84bd1e7849ef tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:15.141846 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-461f3b7a-a8ee-42e0-99e7-84bd1e7849ef tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:15.175805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-07cac8ed-cd9f-4dfb-85a1-da9701b72f88 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:15.190984 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-07cac8ed-cd9f-4dfb-85a1-da9701b72f88 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.373213 Mar 12 20:51:15.210478 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 673/1199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:14 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:15.216162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16d0e3bf-524e-4bcd-9d99-73670c7aeeb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:15.216967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16d0e3bf-524e-4bcd-9d99-73670c7aeeb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:15.231548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16d0e3bf-524e-4bcd-9d99-73670c7aeeb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:15.232280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16d0e3bf-524e-4bcd-9d99-73670c7aeeb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:15.233429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16d0e3bf-524e-4bcd-9d99-73670c7aeeb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:15.234065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16d0e3bf-524e-4bcd-9d99-73670c7aeeb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:15.356917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16d0e3bf-524e-4bcd-9d99-73670c7aeeb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:15.369323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16d0e3bf-524e-4bcd-9d99-73670c7aeeb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:15.375720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16d0e3bf-524e-4bcd-9d99-73670c7aeeb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:15.377623 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16d0e3bf-524e-4bcd-9d99-73670c7aeeb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1351 microversion: 2.20 time: 0.165662 Mar 12 20:51:15.390784 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 674/1200] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:15 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1351 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:15.396294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c028ab5-6e95-4d56-930b-a09350a26122 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:15.396914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c028ab5-6e95-4d56-930b-a09350a26122 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:15.403367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c028ab5-6e95-4d56-930b-a09350a26122 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:15.404071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c028ab5-6e95-4d56-930b-a09350a26122 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:15.405060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c028ab5-6e95-4d56-930b-a09350a26122 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:15.405666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c028ab5-6e95-4d56-930b-a09350a26122 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:15.603618 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-461f3b7a-a8ee-42e0-99e7-84bd1e7849ef tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:15.613809 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-461f3b7a-a8ee-42e0-99e7-84bd1e7849ef tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1313 microversion: 2.1 time: 0.525367 Mar 12 20:51:15.615057 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 527/1201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:15 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:15.620544 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-f8e8e9f0-4b66-4f0b-a372-f2b8b84b139f req-33d87830-7c3b-4722-9f95-0396f4082f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef21dfbf-f42a-4e10-8444-4896ee58ec75", "tag": "85183f71-53ae-4cd8-bb46-ad3f9d2464c1"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:15.629856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8c028ab5-6e95-4d56-930b-a09350a26122 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:15.631819 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-f8e8e9f0-4b66-4f0b-a372-f2b8b84b139f req-33d87830-7c3b-4722-9f95-0396f4082f0d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:15.632522 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-f8e8e9f0-4b66-4f0b-a372-f2b8b84b139f req-33d87830-7c3b-4722-9f95-0396f4082f0d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:15.644719 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c028ab5-6e95-4d56-930b-a09350a26122 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1470 microversion: 2.1 time: 0.252249 Mar 12 20:51:15.645681 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 675/1202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:15 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1470 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:15.647464 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-f8e8e9f0-4b66-4f0b-a372-f2b8b84b139f req-33d87830-7c3b-4722-9f95-0396f4082f0d service nova] Creating event network-changed:85183f71-53ae-4cd8-bb46-ad3f9d2464c1 for instance ef21dfbf-f42a-4e10-8444-4896ee58ec75 on nch2-master-1 Mar 12 20:51:15.652506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c2839ad3-c9a0-43d3-8458-3522fe8495c7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:15.653676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c2839ad3-c9a0-43d3-8458-3522fe8495c7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:15.654738 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-f8e8e9f0-4b66-4f0b-a372-f2b8b84b139f req-33d87830-7c3b-4722-9f95-0396f4082f0d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038309 Mar 12 20:51:15.656093 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 528/1203] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:15.663855 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ebc2a887-46c0-4bcc-94d8-f7123bacb655 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:15.664627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2839ad3-c9a0-43d3-8458-3522fe8495c7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:15.665013 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ebc2a887-46c0-4bcc-94d8-f7123bacb655 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:15.665143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2839ad3-c9a0-43d3-8458-3522fe8495c7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:15.665983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2839ad3-c9a0-43d3-8458-3522fe8495c7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:15.666435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2839ad3-c9a0-43d3-8458-3522fe8495c7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:15.672493 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ebc2a887-46c0-4bcc-94d8-f7123bacb655 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:15.673270 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ebc2a887-46c0-4bcc-94d8-f7123bacb655 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:15.674378 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ebc2a887-46c0-4bcc-94d8-f7123bacb655 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:15.675040 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ebc2a887-46c0-4bcc-94d8-f7123bacb655 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:15.786566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-c2839ad3-c9a0-43d3-8458-3522fe8495c7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:15.805128 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c2839ad3-c9a0-43d3-8458-3522fe8495c7 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.157406 Mar 12 20:51:15.806112 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 676/1204] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:15 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:16.063394 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ebc2a887-46c0-4bcc-94d8-f7123bacb655 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:16.076328 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ebc2a887-46c0-4bcc-94d8-f7123bacb655 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.418717 Mar 12 20:51:16.077762 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 529/1205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:15 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:16.211560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27d8938f-57ec-4789-a934-1807bd7b926b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:16.213014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27d8938f-57ec-4789-a934-1807bd7b926b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:16.221597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27d8938f-57ec-4789-a934-1807bd7b926b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:16.222479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27d8938f-57ec-4789-a934-1807bd7b926b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:16.225005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27d8938f-57ec-4789-a934-1807bd7b926b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:16.225657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27d8938f-57ec-4789-a934-1807bd7b926b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:16.397350 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-539dffa1-fb5d-4896-93e4-8afbdf4964f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:16.398266 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-539dffa1-fb5d-4896-93e4-8afbdf4964f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:16.413872 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-539dffa1-fb5d-4896-93e4-8afbdf4964f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:16.413872 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-539dffa1-fb5d-4896-93e4-8afbdf4964f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:16.413872 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-539dffa1-fb5d-4896-93e4-8afbdf4964f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:16.413872 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-539dffa1-fb5d-4896-93e4-8afbdf4964f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:16.423440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27d8938f-57ec-4789-a934-1807bd7b926b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:16.438144 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27d8938f-57ec-4789-a934-1807bd7b926b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.233787 Mar 12 20:51:16.445835 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 677/1206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:16 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:16.526612 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-539dffa1-fb5d-4896-93e4-8afbdf4964f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:16.536457 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-539dffa1-fb5d-4896-93e4-8afbdf4964f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:16.538279 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-539dffa1-fb5d-4896-93e4-8afbdf4964f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:16.539396 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-539dffa1-fb5d-4896-93e4-8afbdf4964f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1339 microversion: 2.20 time: 0.147827 Mar 12 20:51:16.541812 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 530/1207] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:16 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1339 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:51:16.630690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f66c036e-d9c6-41e1-9389-6dd8eb28ced6 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:16.631311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f66c036e-d9c6-41e1-9389-6dd8eb28ced6 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:16.644214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f66c036e-d9c6-41e1-9389-6dd8eb28ced6 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:16.644617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f66c036e-d9c6-41e1-9389-6dd8eb28ced6 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:16.645452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f66c036e-d9c6-41e1-9389-6dd8eb28ced6 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:16.645928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f66c036e-d9c6-41e1-9389-6dd8eb28ced6 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:16.666054 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-032a012b-5ad6-4f21-8560-48074983eca4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:16.667424 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-032a012b-5ad6-4f21-8560-48074983eca4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:16.674798 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-032a012b-5ad6-4f21-8560-48074983eca4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:16.676008 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-032a012b-5ad6-4f21-8560-48074983eca4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:16.677898 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-032a012b-5ad6-4f21-8560-48074983eca4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:16.679500 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-032a012b-5ad6-4f21-8560-48074983eca4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:16.853637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f66c036e-d9c6-41e1-9389-6dd8eb28ced6 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:16.868009 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f66c036e-d9c6-41e1-9389-6dd8eb28ced6 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1313 microversion: 2.1 time: 0.241032 Mar 12 20:51:16.877360 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 678/1208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:16 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:16.877360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-111c126b-bbe3-4e3c-af54-76fd8446616d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:16.877360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-111c126b-bbe3-4e3c-af54-76fd8446616d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:16.887469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-111c126b-bbe3-4e3c-af54-76fd8446616d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:16.888199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-111c126b-bbe3-4e3c-af54-76fd8446616d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:16.889006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-111c126b-bbe3-4e3c-af54-76fd8446616d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:16.889453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-111c126b-bbe3-4e3c-af54-76fd8446616d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:16.988493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-111c126b-bbe3-4e3c-af54-76fd8446616d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:17.022053 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-111c126b-bbe3-4e3c-af54-76fd8446616d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1929 microversion: 2.75 time: 0.148146 Mar 12 20:51:17.023268 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 679/1209] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:16 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1929 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:17.098196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80c0bca9-bdf6-44ca-8168-e35db34c02ed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:17.100146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80c0bca9-bdf6-44ca-8168-e35db34c02ed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:17.120701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80c0bca9-bdf6-44ca-8168-e35db34c02ed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:17.121093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80c0bca9-bdf6-44ca-8168-e35db34c02ed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:17.122011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80c0bca9-bdf6-44ca-8168-e35db34c02ed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:17.122414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80c0bca9-bdf6-44ca-8168-e35db34c02ed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:17.194734 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-032a012b-5ad6-4f21-8560-48074983eca4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:17.212041 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-032a012b-5ad6-4f21-8560-48074983eca4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1470 microversion: 2.1 time: 0.549701 Mar 12 20:51:17.222750 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 531/1210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:16 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1470 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:17.302985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80c0bca9-bdf6-44ca-8168-e35db34c02ed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:17.312888 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80c0bca9-bdf6-44ca-8168-e35db34c02ed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.222073 Mar 12 20:51:17.313849 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 680/1211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:17 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:17.458096 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2d8d987c-c4bd-4cf1-b1d4-d0ca70b2c05f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:17.459019 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-2d8d987c-c4bd-4cf1-b1d4-d0ca70b2c05f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:17.467681 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2d8d987c-c4bd-4cf1-b1d4-d0ca70b2c05f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:17.468415 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2d8d987c-c4bd-4cf1-b1d4-d0ca70b2c05f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:17.469224 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2d8d987c-c4bd-4cf1-b1d4-d0ca70b2c05f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:17.469652 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2d8d987c-c4bd-4cf1-b1d4-d0ca70b2c05f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:17.558158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da9df668-fe86-48de-97aa-34a8cfa19ae2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:17.558787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da9df668-fe86-48de-97aa-34a8cfa19ae2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:17.567470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da9df668-fe86-48de-97aa-34a8cfa19ae2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:17.568053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da9df668-fe86-48de-97aa-34a8cfa19ae2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:17.570068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da9df668-fe86-48de-97aa-34a8cfa19ae2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:17.570997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da9df668-fe86-48de-97aa-34a8cfa19ae2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:17.779996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da9df668-fe86-48de-97aa-34a8cfa19ae2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:17.791157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da9df668-fe86-48de-97aa-34a8cfa19ae2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:17.792987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da9df668-fe86-48de-97aa-34a8cfa19ae2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:17.794654 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2d8d987c-c4bd-4cf1-b1d4-d0ca70b2c05f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:17.795212 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da9df668-fe86-48de-97aa-34a8cfa19ae2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1406 microversion: 2.20 time: 0.240219 Mar 12 20:51:17.796153 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 681/1212] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:17 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:17.804880 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2d8d987c-c4bd-4cf1-b1d4-d0ca70b2c05f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.350840 Mar 12 20:51:17.805483 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 532/1213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:17 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:17.810153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f24c2bff-eb8d-4aef-a7f2-f27e9fe270ab req-41baff8e-24e7-40aa-a02d-78f425be10ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7f5155-9258-4c32-894e-ef4ffcc25a28", "name": "network-vif-plugged", "status": "completed", "tag": "5c2b07b8-3063-4abf-8d95-04a1b3c25a29"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:17.818823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f24c2bff-eb8d-4aef-a7f2-f27e9fe270ab req-41baff8e-24e7-40aa-a02d-78f425be10ea service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:17.819685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f24c2bff-eb8d-4aef-a7f2-f27e9fe270ab req-41baff8e-24e7-40aa-a02d-78f425be10ea service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:17.838561 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f24c2bff-eb8d-4aef-a7f2-f27e9fe270ab req-41baff8e-24e7-40aa-a02d-78f425be10ea service nova] Creating event network-vif-plugged:5c2b07b8-3063-4abf-8d95-04a1b3c25a29 for instance 1f7f5155-9258-4c32-894e-ef4ffcc25a28 on nch1-master-1 Mar 12 20:51:17.844700 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f24c2bff-eb8d-4aef-a7f2-f27e9fe270ab req-41baff8e-24e7-40aa-a02d-78f425be10ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046440 Mar 12 20:51:17.845604 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 682/1214] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:17.884660 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-29995adf-be85-4477-8226-d4bfc5134ae2 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:17.885274 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-29995adf-be85-4477-8226-d4bfc5134ae2 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:17.898984 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-29995adf-be85-4477-8226-d4bfc5134ae2 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:17.898984 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-29995adf-be85-4477-8226-d4bfc5134ae2 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:17.898984 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-29995adf-be85-4477-8226-d4bfc5134ae2 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:17.898984 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-29995adf-be85-4477-8226-d4bfc5134ae2 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.045009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-899c1dd8-8214-4bf0-8643-225b512adac6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:18.045707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-899c1dd8-8214-4bf0-8643-225b512adac6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:18.053896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-899c1dd8-8214-4bf0-8643-225b512adac6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.054362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-899c1dd8-8214-4bf0-8643-225b512adac6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.055156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-899c1dd8-8214-4bf0-8643-225b512adac6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.055599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-899c1dd8-8214-4bf0-8643-225b512adac6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.132582 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-29995adf-be85-4477-8226-d4bfc5134ae2 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:18.133224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-899c1dd8-8214-4bf0-8643-225b512adac6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:18.141016 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-29995adf-be85-4477-8226-d4bfc5134ae2 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1313 microversion: 2.1 time: 0.260317 Mar 12 20:51:18.152494 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 533/1215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:17 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:18.157564 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-899c1dd8-8214-4bf0-8643-225b512adac6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1935 microversion: 2.75 time: 0.116638 Mar 12 20:51:18.160166 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 683/1216] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:18 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1935 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:18.215407 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-e6f5372a-21b6-4c14-9de6-84838d4531e1 req-64692663-05a2-4a9d-81e4-65b9ba419ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae82842-58a0-4d5e-a522-a1c83c53e101", "tag": "c40c686b-b640-42d0-a899-bda5e43f8663"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:18.229274 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-e6f5372a-21b6-4c14-9de6-84838d4531e1 req-64692663-05a2-4a9d-81e4-65b9ba419ff6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.229735 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-e6f5372a-21b6-4c14-9de6-84838d4531e1 req-64692663-05a2-4a9d-81e4-65b9ba419ff6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.232515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7c3ed60f-b218-4315-8846-03ee6a62c18e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:18.234174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7c3ed60f-b218-4315-8846-03ee6a62c18e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:18.247965 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-e6f5372a-21b6-4c14-9de6-84838d4531e1 req-64692663-05a2-4a9d-81e4-65b9ba419ff6 service nova] Creating event network-changed:c40c686b-b640-42d0-a899-bda5e43f8663 for instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 on nch2-master-1 Mar 12 20:51:18.248202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c3ed60f-b218-4315-8846-03ee6a62c18e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.254629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c3ed60f-b218-4315-8846-03ee6a62c18e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.256110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c3ed60f-b218-4315-8846-03ee6a62c18e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.258510 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-e6f5372a-21b6-4c14-9de6-84838d4531e1 req-64692663-05a2-4a9d-81e4-65b9ba419ff6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047035 Mar 12 20:51:18.259662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c3ed60f-b218-4315-8846-03ee6a62c18e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.262494 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 534/1217] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:18.331926 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-6995cf66-18dc-4e0d-88e4-5a941e0a92fe tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:18.332652 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-6995cf66-18dc-4e0d-88e4-5a941e0a92fe tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:18.352453 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6995cf66-18dc-4e0d-88e4-5a941e0a92fe tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.352923 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6995cf66-18dc-4e0d-88e4-5a941e0a92fe tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.353742 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6995cf66-18dc-4e0d-88e4-5a941e0a92fe tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.354219 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6995cf66-18dc-4e0d-88e4-5a941e0a92fe tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.499134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7c3ed60f-b218-4315-8846-03ee6a62c18e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:18.510746 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7c3ed60f-b218-4315-8846-03ee6a62c18e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1462 microversion: 2.1 time: 0.284145 Mar 12 20:51:18.511527 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 684/1218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:18 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1462 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:18.527069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d86dd68b-161d-4ad2-aee7-3c088e8aecb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:18.527965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d86dd68b-161d-4ad2-aee7-3c088e8aecb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:18.537386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d86dd68b-161d-4ad2-aee7-3c088e8aecb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.537616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d86dd68b-161d-4ad2-aee7-3c088e8aecb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.541809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d86dd68b-161d-4ad2-aee7-3c088e8aecb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.543627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d86dd68b-161d-4ad2-aee7-3c088e8aecb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.639052 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-6995cf66-18dc-4e0d-88e4-5a941e0a92fe tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:18.650319 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-6995cf66-18dc-4e0d-88e4-5a941e0a92fe tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.323576 Mar 12 20:51:18.650902 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 535/1219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:18 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:18.701812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d86dd68b-161d-4ad2-aee7-3c088e8aecb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:18.709745 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d86dd68b-161d-4ad2-aee7-3c088e8aecb5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1462 microversion: 2.1 time: 0.186927 Mar 12 20:51:18.710303 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 685/1220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:18 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1462 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:18.725636 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-69917c6a-593a-4545-81f5-6ae7d5d449f4 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Calling method '.version_select at 0x7f6e36fe1ee0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:18.728499 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-69917c6a-593a-4545-81f5-6ae7d5d449f4 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.729009 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-69917c6a-593a-4545-81f5-6ae7d5d449f4 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.741573 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-69917c6a-593a-4545-81f5-6ae7d5d449f4 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3104 microversion: 2.1 time: 0.020051 Mar 12 20:51:18.742760 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 536/1221] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 20:51:18 2022] GET /compute/v2.1/os-migrations => generated 3104 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:18.761621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3a31084a-f913-41ca-b3c0-ab8d92be8ea8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:18.771035 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3a31084a-f913-41ca-b3c0-ab8d92be8ea8 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013503 Mar 12 20:51:18.777466 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 686/1222] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:51:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:18.783507 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fc59a696-c72b-4205-aed4-96dc166949e0 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1154293330", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:18.785551 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:51:18.785551 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:51:18.802921 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fc59a696-c72b-4205-aed4-96dc166949e0 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.023222 Mar 12 20:51:18.804297 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 537/1223] 10.222.0.30 () {60 vars in 1145 bytes} [Sat Mar 12 20:51:18 2022] POST /compute/v2.1/flavors => generated 499 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:51:18.813053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4132145b-2fbb-47ad-9148-990779eff4f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:18.813794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4132145b-2fbb-47ad-9148-990779eff4f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:18.814228 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9e2bfebc-02a5-4344-9d5d-cfbb3f5431b1 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:18.821956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4132145b-2fbb-47ad-9148-990779eff4f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.822505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4132145b-2fbb-47ad-9148-990779eff4f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.822647 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9e2bfebc-02a5-4344-9d5d-cfbb3f5431b1 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012259 Mar 12 20:51:18.823636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4132145b-2fbb-47ad-9148-990779eff4f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.824169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4132145b-2fbb-47ad-9148-990779eff4f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.833655 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 538/1224] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Mar 12 20:51:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:51:18.840247 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a29d3f4a-f891-46e6-8b93-cf3ebc21b361 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:18.841046 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a29d3f4a-f891-46e6-8b93-cf3ebc21b361 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:18.849435 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a29d3f4a-f891-46e6-8b93-cf3ebc21b361 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.850154 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a29d3f4a-f891-46e6-8b93-cf3ebc21b361 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.851117 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a29d3f4a-f891-46e6-8b93-cf3ebc21b361 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:18.851889 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a29d3f4a-f891-46e6-8b93-cf3ebc21b361 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:18.995037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4132145b-2fbb-47ad-9148-990779eff4f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:19.002922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4132145b-2fbb-47ad-9148-990779eff4f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:19.004644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4132145b-2fbb-47ad-9148-990779eff4f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:19.005984 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4132145b-2fbb-47ad-9148-990779eff4f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1406 microversion: 2.20 time: 0.197045 Mar 12 20:51:19.018414 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 687/1225] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:18 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:19.023865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1670567378", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "c2272325-7bac-4d55-9284-a9385fdd6e35"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:19.081193 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a29d3f4a-f891-46e6-8b93-cf3ebc21b361 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:19.090346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:51:19.092212 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a29d3f4a-f891-46e6-8b93-cf3ebc21b361 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.256515 Mar 12 20:51:19.093638 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 539/1226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:18 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:19.159129 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-64dea0c0-1391-486e-bf7a-7ec51c255f68 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:19.160373 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-64dea0c0-1391-486e-bf7a-7ec51c255f68 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:19.171276 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-64dea0c0-1391-486e-bf7a-7ec51c255f68 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:19.172935 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-64dea0c0-1391-486e-bf7a-7ec51c255f68 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:19.172935 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-64dea0c0-1391-486e-bf7a-7ec51c255f68 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:19.173135 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-64dea0c0-1391-486e-bf7a-7ec51c255f68 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:19.331479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:51:19.331915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:51:19.332403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:51:19.332824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:51:19.333246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:51:19.343805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:19.344266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:19.345090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:19.345710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:19.367483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Getting quotas for project d8057df76c4c4652a22bb659969dbb31. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:51:19.372849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Getting quotas for user b404502bb19242c385bc7d6ca5bff2de and project d8057df76c4c4652a22bb659969dbb31. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:51:19.387720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:51:19.390918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:51:19.437642 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-64dea0c0-1391-486e-bf7a-7ec51c255f68 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:19.442267 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8620a89f-32a8-4807-ba7d-fa991423da8b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.421628 Mar 12 20:51:19.443524 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 688/1227] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:51:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:51:19.446872 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-64dea0c0-1391-486e-bf7a-7ec51c255f68 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1313 microversion: 2.1 time: 0.292145 Mar 12 20:51:19.449458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-024830de-b11a-4b07-a7aa-36b73ab6be3d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:19.450394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-024830de-b11a-4b07-a7aa-36b73ab6be3d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:19.457805 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 540/1228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:19 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:19.458386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-024830de-b11a-4b07-a7aa-36b73ab6be3d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:19.459087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-024830de-b11a-4b07-a7aa-36b73ab6be3d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:19.463612 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f9a77b25-86d7-4727-95ce-b122fde81091 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:19.464372 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f9a77b25-86d7-4727-95ce-b122fde81091 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:19.474393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-024830de-b11a-4b07-a7aa-36b73ab6be3d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:19.475246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-024830de-b11a-4b07-a7aa-36b73ab6be3d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:19.561613 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f9a77b25-86d7-4727-95ce-b122fde81091 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:19.569161 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f9a77b25-86d7-4727-95ce-b122fde81091 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1279 microversion: 2.1 time: 0.110175 Mar 12 20:51:19.579406 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 541/1229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:19 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1279 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:19.588419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-024830de-b11a-4b07-a7aa-36b73ab6be3d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:19.617410 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-024830de-b11a-4b07-a7aa-36b73ab6be3d tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1935 microversion: 2.75 time: 0.171535 Mar 12 20:51:19.618189 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 689/1230] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:19 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1935 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:19.669743 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1ca6965f-9011-4748-a8f0-f8abe5a4d09a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:19.671461 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-1ca6965f-9011-4748-a8f0-f8abe5a4d09a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:19.685125 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1ca6965f-9011-4748-a8f0-f8abe5a4d09a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:19.685866 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1ca6965f-9011-4748-a8f0-f8abe5a4d09a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:19.688053 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1ca6965f-9011-4748-a8f0-f8abe5a4d09a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:19.689327 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1ca6965f-9011-4748-a8f0-f8abe5a4d09a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:19.942943 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-1ca6965f-9011-4748-a8f0-f8abe5a4d09a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:19.954417 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1ca6965f-9011-4748-a8f0-f8abe5a4d09a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.290708 Mar 12 20:51:19.955175 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 542/1231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:19 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:20.024764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-500aa6f2-b556-4cb8-ad54-33475c16bed3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:20.025925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-500aa6f2-b556-4cb8-ad54-33475c16bed3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:20.031899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-500aa6f2-b556-4cb8-ad54-33475c16bed3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.032356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-500aa6f2-b556-4cb8-ad54-33475c16bed3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.033126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-500aa6f2-b556-4cb8-ad54-33475c16bed3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.033756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-500aa6f2-b556-4cb8-ad54-33475c16bed3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.110280 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7afc2d33-3462-4986-9705-de56f74b7e66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:20.110931 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7afc2d33-3462-4986-9705-de56f74b7e66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:20.118220 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7afc2d33-3462-4986-9705-de56f74b7e66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.119132 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7afc2d33-3462-4986-9705-de56f74b7e66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.119927 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7afc2d33-3462-4986-9705-de56f74b7e66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.120375 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7afc2d33-3462-4986-9705-de56f74b7e66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.189919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-500aa6f2-b556-4cb8-ad54-33475c16bed3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:20.198724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-500aa6f2-b556-4cb8-ad54-33475c16bed3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:20.200683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-500aa6f2-b556-4cb8-ad54-33475c16bed3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:20.201917 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-500aa6f2-b556-4cb8-ad54-33475c16bed3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1406 microversion: 2.20 time: 0.181207 Mar 12 20:51:20.202698 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 690/1232] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:20 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:20.289295 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7afc2d33-3462-4986-9705-de56f74b7e66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:20.297177 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7afc2d33-3462-4986-9705-de56f74b7e66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.191248 Mar 12 20:51:20.297759 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 543/1233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:20 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:20.465718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6a96d05f-8d8b-4cd0-b760-d5dc52a9020e tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:20.468290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6a96d05f-8d8b-4cd0-b760-d5dc52a9020e tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:20.484641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a96d05f-8d8b-4cd0-b760-d5dc52a9020e tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.485099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a96d05f-8d8b-4cd0-b760-d5dc52a9020e tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.485915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a96d05f-8d8b-4cd0-b760-d5dc52a9020e tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.486360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a96d05f-8d8b-4cd0-b760-d5dc52a9020e tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.587831 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c82230c0-38d8-4650-ad34-28a93fb8129f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:20.588979 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c82230c0-38d8-4650-ad34-28a93fb8129f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:20.595269 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c82230c0-38d8-4650-ad34-28a93fb8129f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.598149 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c82230c0-38d8-4650-ad34-28a93fb8129f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.602295 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c82230c0-38d8-4650-ad34-28a93fb8129f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.602755 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c82230c0-38d8-4650-ad34-28a93fb8129f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.641586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6a96d05f-8d8b-4cd0-b760-d5dc52a9020e tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:20.662198 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6a96d05f-8d8b-4cd0-b760-d5dc52a9020e tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1313 microversion: 2.1 time: 0.200722 Mar 12 20:51:20.663359 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 691/1234] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:20 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:20.674520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fe0d0073-4cbf-4bc1-a5bd-4cbd52f8c4d6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:20.675152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fe0d0073-4cbf-4bc1-a5bd-4cbd52f8c4d6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:20.685590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe0d0073-4cbf-4bc1-a5bd-4cbd52f8c4d6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.686066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe0d0073-4cbf-4bc1-a5bd-4cbd52f8c4d6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.687120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe0d0073-4cbf-4bc1-a5bd-4cbd52f8c4d6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.687821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe0d0073-4cbf-4bc1-a5bd-4cbd52f8c4d6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.694200 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c82230c0-38d8-4650-ad34-28a93fb8129f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:20.703725 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c82230c0-38d8-4650-ad34-28a93fb8129f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1331 microversion: 2.1 time: 0.120719 Mar 12 20:51:20.705098 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 544/1235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:20 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:20.836897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-fe0d0073-4cbf-4bc1-a5bd-4cbd52f8c4d6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] Lazy-loading 'services' on Instance uuid 954b88de-e0e8-484e-9e90-de3c0ff9f07e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:20.865690 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fe0d0073-4cbf-4bc1-a5bd-4cbd52f8c4d6 tempest-ServersAdmin275Test-1847894562 tempest-ServersAdmin275Test-1847894562-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1920 microversion: 2.75 time: 0.201161 Mar 12 20:51:20.866642 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 692/1236] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:20 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1920 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:20.899324 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-98a14795-4897-46aa-898f-f01215218fcf tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:20.899952 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-98a14795-4897-46aa-898f-f01215218fcf tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:20.916926 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-98a14795-4897-46aa-898f-f01215218fcf tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.917385 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-98a14795-4897-46aa-898f-f01215218fcf tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.918201 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-98a14795-4897-46aa-898f-f01215218fcf tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.918641 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-98a14795-4897-46aa-898f-f01215218fcf tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.952984 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-98a14795-4897-46aa-898f-f01215218fcf tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:51:20.972896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d1169d2-5fcf-4333-908d-ef043985ba12 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:20.973520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8d1169d2-5fcf-4333-908d-ef043985ba12 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:20.982605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d1169d2-5fcf-4333-908d-ef043985ba12 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.983169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d1169d2-5fcf-4333-908d-ef043985ba12 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:20.984308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d1169d2-5fcf-4333-908d-ef043985ba12 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:20.984840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d1169d2-5fcf-4333-908d-ef043985ba12 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:21.052563 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-98a14795-4897-46aa-898f-f01215218fcf tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "DELETE /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 204 len: 0 microversion: 2.75 time: 0.163164 Mar 12 20:51:21.053361 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 545/1237] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:51:20 2022] DELETE /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:51:21.071091 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1854fb00-b4d8-4b91-9a19-37cf8bf61138 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:21.076499 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-1854fb00-b4d8-4b91-9a19-37cf8bf61138 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:21.085635 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1854fb00-b4d8-4b91-9a19-37cf8bf61138 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:21.086366 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1854fb00-b4d8-4b91-9a19-37cf8bf61138 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:21.088392 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1854fb00-b4d8-4b91-9a19-37cf8bf61138 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:21.089091 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1854fb00-b4d8-4b91-9a19-37cf8bf61138 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:21.191066 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-1854fb00-b4d8-4b91-9a19-37cf8bf61138 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:21.207686 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-1854fb00-b4d8-4b91-9a19-37cf8bf61138 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:21.212387 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-1854fb00-b4d8-4b91-9a19-37cf8bf61138 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:21.233141 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1854fb00-b4d8-4b91-9a19-37cf8bf61138 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1444 microversion: 2.75 time: 0.174037 Mar 12 20:51:21.234484 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 546/1238] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:21 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1444 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:51:21.241538 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-54557b0e-2f21-493b-905a-848b88f794ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:21.242449 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-54557b0e-2f21-493b-905a-848b88f794ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:21.250074 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-54557b0e-2f21-493b-905a-848b88f794ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:21.250539 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-54557b0e-2f21-493b-905a-848b88f794ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:21.251751 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-54557b0e-2f21-493b-905a-848b88f794ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:21.252822 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-54557b0e-2f21-493b-905a-848b88f794ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:21.265816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d1169d2-5fcf-4333-908d-ef043985ba12 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:21.274074 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d1169d2-5fcf-4333-908d-ef043985ba12 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.305523 Mar 12 20:51:21.287351 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 693/1239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:20 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:21.314117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85c329ac-6e77-471b-9244-0328800c4a1e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:21.314921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85c329ac-6e77-471b-9244-0328800c4a1e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:21.321178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85c329ac-6e77-471b-9244-0328800c4a1e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:21.321641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85c329ac-6e77-471b-9244-0328800c4a1e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:21.322538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85c329ac-6e77-471b-9244-0328800c4a1e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:21.322979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85c329ac-6e77-471b-9244-0328800c4a1e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:21.709682 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-54557b0e-2f21-493b-905a-848b88f794ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:21.725434 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-54557b0e-2f21-493b-905a-848b88f794ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:21.727888 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-54557b0e-2f21-493b-905a-848b88f794ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:21.729288 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-54557b0e-2f21-493b-905a-848b88f794ba tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1406 microversion: 2.20 time: 0.493388 Mar 12 20:51:21.730318 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 547/1240] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:21 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1406 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:21.734926 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2258122d-52c3-4c03-8d5c-299f17b73ece tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:21.735657 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-2258122d-52c3-4c03-8d5c-299f17b73ece tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:21.744225 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2258122d-52c3-4c03-8d5c-299f17b73ece tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:21.744687 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2258122d-52c3-4c03-8d5c-299f17b73ece tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:21.745712 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2258122d-52c3-4c03-8d5c-299f17b73ece tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:21.746808 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2258122d-52c3-4c03-8d5c-299f17b73ece tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:21.870878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-85c329ac-6e77-471b-9244-0328800c4a1e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:21.880721 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85c329ac-6e77-471b-9244-0328800c4a1e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.570452 Mar 12 20:51:21.884678 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 694/1241] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:21 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:21.891052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7cad1a04-8427-43e3-98d0-d3bab9f3a7a4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:21.891678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7cad1a04-8427-43e3-98d0-d3bab9f3a7a4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:21.898689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cad1a04-8427-43e3-98d0-d3bab9f3a7a4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:21.899156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cad1a04-8427-43e3-98d0-d3bab9f3a7a4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:21.899939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cad1a04-8427-43e3-98d0-d3bab9f3a7a4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:21.900387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cad1a04-8427-43e3-98d0-d3bab9f3a7a4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:21.939290 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2258122d-52c3-4c03-8d5c-299f17b73ece tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:21.957721 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2258122d-52c3-4c03-8d5c-299f17b73ece tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1313 microversion: 2.1 time: 0.226091 Mar 12 20:51:21.969476 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 548/1242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:21 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:22.228687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7cad1a04-8427-43e3-98d0-d3bab9f3a7a4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:22.238036 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7cad1a04-8427-43e3-98d0-d3bab9f3a7a4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1379 microversion: 2.1 time: 0.350772 Mar 12 20:51:22.243093 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 695/1243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:21 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1379 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:22.254422 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7ad1a8bc-8fbc-486e-8f98-acfb651dc886 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:22.255160 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7ad1a8bc-8fbc-486e-8f98-acfb651dc886 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:22.269065 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7ad1a8bc-8fbc-486e-8f98-acfb651dc886 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:22.271981 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7ad1a8bc-8fbc-486e-8f98-acfb651dc886 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:22.272813 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7ad1a8bc-8fbc-486e-8f98-acfb651dc886 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:22.274655 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7ad1a8bc-8fbc-486e-8f98-acfb651dc886 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:22.292029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ecd7306e-e9af-4a9e-9a58-c1e704c3e352 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:22.293287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ecd7306e-e9af-4a9e-9a58-c1e704c3e352 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:22.305551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecd7306e-e9af-4a9e-9a58-c1e704c3e352 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:22.306671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecd7306e-e9af-4a9e-9a58-c1e704c3e352 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:22.307775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecd7306e-e9af-4a9e-9a58-c1e704c3e352 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:22.308452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecd7306e-e9af-4a9e-9a58-c1e704c3e352 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:22.412869 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7ad1a8bc-8fbc-486e-8f98-acfb651dc886 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:22.425706 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7ad1a8bc-8fbc-486e-8f98-acfb651dc886 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:22.427287 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7ad1a8bc-8fbc-486e-8f98-acfb651dc886 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d1c4c4b875345debd5168821369b310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f2b47fc8614e54ac931e5e91f0dfd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:22.433892 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7ad1a8bc-8fbc-486e-8f98-acfb651dc886 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 200 len: 1444 microversion: 2.75 time: 0.185189 Mar 12 20:51:22.434816 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 549/1244] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:22 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 1444 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:22.477128 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b721865a-0365-4d41-92e6-130cfa0440fc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:22.477857 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b721865a-0365-4d41-92e6-130cfa0440fc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:22.484753 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b721865a-0365-4d41-92e6-130cfa0440fc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:22.485209 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b721865a-0365-4d41-92e6-130cfa0440fc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:22.487149 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b721865a-0365-4d41-92e6-130cfa0440fc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:22.487778 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b721865a-0365-4d41-92e6-130cfa0440fc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:22.532418 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b721865a-0365-4d41-92e6-130cfa0440fc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:51:22.659333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ecd7306e-e9af-4a9e-9a58-c1e704c3e352 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:22.668864 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b721865a-0365-4d41-92e6-130cfa0440fc tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 204 len: 0 microversion: 2.1 time: 0.195059 Mar 12 20:51:22.674012 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 550/1245] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:51:22 2022] DELETE /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:51:22.689373 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ecd7306e-e9af-4a9e-9a58-c1e704c3e352 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.401582 Mar 12 20:51:22.697236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 696/1246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:22 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:22.698432 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7810f139-5d1b-47dd-a49e-c8c0a9ca21be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:22.699236 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7810f139-5d1b-47dd-a49e-c8c0a9ca21be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:22.727490 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7810f139-5d1b-47dd-a49e-c8c0a9ca21be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:22.727867 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7810f139-5d1b-47dd-a49e-c8c0a9ca21be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:22.728675 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7810f139-5d1b-47dd-a49e-c8c0a9ca21be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:22.731096 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7810f139-5d1b-47dd-a49e-c8c0a9ca21be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:22.750972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e62da82e-bf14-4408-8ac3-9549c2bf8ed6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:22.753333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e62da82e-bf14-4408-8ac3-9549c2bf8ed6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:22.771006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e62da82e-bf14-4408-8ac3-9549c2bf8ed6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:22.772128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e62da82e-bf14-4408-8ac3-9549c2bf8ed6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:22.773456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e62da82e-bf14-4408-8ac3-9549c2bf8ed6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:22.774391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e62da82e-bf14-4408-8ac3-9549c2bf8ed6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:23.107463 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7810f139-5d1b-47dd-a49e-c8c0a9ca21be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:23.120613 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7810f139-5d1b-47dd-a49e-c8c0a9ca21be tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1712 microversion: 2.1 time: 0.440893 Mar 12 20:51:23.121201 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 551/1247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:22 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1712 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:23.141691 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-831088a2-9010-407e-9cff-3a6f9b65d46a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:23.144674 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-831088a2-9010-407e-9cff-3a6f9b65d46a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:23.160607 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-831088a2-9010-407e-9cff-3a6f9b65d46a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:23.161283 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-831088a2-9010-407e-9cff-3a6f9b65d46a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:23.165545 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-831088a2-9010-407e-9cff-3a6f9b65d46a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:23.166066 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-831088a2-9010-407e-9cff-3a6f9b65d46a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:23.216905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e62da82e-bf14-4408-8ac3-9549c2bf8ed6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:23.237367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e62da82e-bf14-4408-8ac3-9549c2bf8ed6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:23.238948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e62da82e-bf14-4408-8ac3-9549c2bf8ed6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:23.240791 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e62da82e-bf14-4408-8ac3-9549c2bf8ed6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1406 microversion: 2.20 time: 0.496222 Mar 12 20:51:23.256225 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 697/1248] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:22 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1406 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:51:23.263383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59f1337d-2879-4ca8-bcc6-7f6e10f4907f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:23.264367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59f1337d-2879-4ca8-bcc6-7f6e10f4907f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:23.271430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59f1337d-2879-4ca8-bcc6-7f6e10f4907f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:23.272307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59f1337d-2879-4ca8-bcc6-7f6e10f4907f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:23.273633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59f1337d-2879-4ca8-bcc6-7f6e10f4907f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:23.288908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59f1337d-2879-4ca8-bcc6-7f6e10f4907f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:23.602589 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-831088a2-9010-407e-9cff-3a6f9b65d46a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:23.610923 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-831088a2-9010-407e-9cff-3a6f9b65d46a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.479859 Mar 12 20:51:23.612585 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 552/1249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:23 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:23.617667 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-acd13d1d-3380-4d98-82dd-be5d91ff9e8b req-0ea8d13a-06e9-480c-8092-10fded3ae409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef21dfbf-f42a-4e10-8444-4896ee58ec75", "name": "network-vif-plugged", "status": "completed", "tag": "85183f71-53ae-4cd8-bb46-ad3f9d2464c1"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:23.626432 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-acd13d1d-3380-4d98-82dd-be5d91ff9e8b req-0ea8d13a-06e9-480c-8092-10fded3ae409 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:23.627289 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-acd13d1d-3380-4d98-82dd-be5d91ff9e8b req-0ea8d13a-06e9-480c-8092-10fded3ae409 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:23.632972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-59f1337d-2879-4ca8-bcc6-7f6e10f4907f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:23.640986 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-acd13d1d-3380-4d98-82dd-be5d91ff9e8b req-0ea8d13a-06e9-480c-8092-10fded3ae409 service nova] Creating event network-vif-plugged:85183f71-53ae-4cd8-bb46-ad3f9d2464c1 for instance ef21dfbf-f42a-4e10-8444-4896ee58ec75 on nch2-master-1 Mar 12 20:51:23.642150 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59f1337d-2879-4ca8-bcc6-7f6e10f4907f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1313 microversion: 2.1 time: 0.383815 Mar 12 20:51:23.642773 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 698/1250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:23 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:23.650581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8b324eb-73cb-4430-93b2-032e485e8aea tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:23.652316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8b324eb-73cb-4430-93b2-032e485e8aea tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:23.659565 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-acd13d1d-3380-4d98-82dd-be5d91ff9e8b req-0ea8d13a-06e9-480c-8092-10fded3ae409 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041236 Mar 12 20:51:23.661723 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 553/1251] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:23.671374 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2987dd75-7647-4f2c-9b35-9fd5d86c5820 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:23.672795 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-2987dd75-7647-4f2c-9b35-9fd5d86c5820 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] [instance: 954b88de-e0e8-484e-9e90-de3c0ff9f07e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:23.684073 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2987dd75-7647-4f2c-9b35-9fd5d86c5820 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:23.684584 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2987dd75-7647-4f2c-9b35-9fd5d86c5820 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:23.693137 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2987dd75-7647-4f2c-9b35-9fd5d86c5820 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:23.698580 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2987dd75-7647-4f2c-9b35-9fd5d86c5820 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:23.703326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8b324eb-73cb-4430-93b2-032e485e8aea tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:23.710936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8b324eb-73cb-4430-93b2-032e485e8aea tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:23.712414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8b324eb-73cb-4430-93b2-032e485e8aea tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:23.713605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8b324eb-73cb-4430-93b2-032e485e8aea tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:23.755240 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-2987dd75-7647-4f2c-9b35-9fd5d86c5820 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] HTTP exception thrown: Instance 954b88de-e0e8-484e-9e90-de3c0ff9f07e could not be found. Mar 12 20:51:23.756822 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2987dd75-7647-4f2c-9b35-9fd5d86c5820 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] Returning 404 to user: Instance 954b88de-e0e8-484e-9e90-de3c0ff9f07e could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:51:23.757664 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2987dd75-7647-4f2c-9b35-9fd5d86c5820 tempest-ServersAdmin275Test-636865322 tempest-ServersAdmin275Test-636865322-project] 10.222.0.30 "GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e" status: 404 len: 111 microversion: 2.75 time: 0.092110 Mar 12 20:51:23.758476 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 554/1252] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:23 2022] GET /compute/v2.1/servers/954b88de-e0e8-484e-9e90-de3c0ff9f07e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:51:23.779616 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2ac9dd86-0622-4284-8ced-3437a12602f7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:23.780358 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-2ac9dd86-0622-4284-8ced-3437a12602f7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:23.811325 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2ac9dd86-0622-4284-8ced-3437a12602f7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:23.812892 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2ac9dd86-0622-4284-8ced-3437a12602f7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:23.814220 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2ac9dd86-0622-4284-8ced-3437a12602f7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:23.815096 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2ac9dd86-0622-4284-8ced-3437a12602f7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:24.168790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a8b324eb-73cb-4430-93b2-032e485e8aea tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:24.183654 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8b324eb-73cb-4430-93b2-032e485e8aea tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1379 microversion: 2.1 time: 0.536325 Mar 12 20:51:24.188084 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 699/1253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:23 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1379 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:24.196744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8db969d5-40b0-4ce6-aa5d-396865608463 req-a75f638e-bccf-4ec3-b8a3-b9118f21fc02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e67993b-4604-4f37-9543-3dc09be802e5", "tag": "3abbe775-9508-422a-826d-d481a507a318"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:24.208150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8db969d5-40b0-4ce6-aa5d-396865608463 req-a75f638e-bccf-4ec3-b8a3-b9118f21fc02 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:24.208934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8db969d5-40b0-4ce6-aa5d-396865608463 req-a75f638e-bccf-4ec3-b8a3-b9118f21fc02 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:24.225103 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8db969d5-40b0-4ce6-aa5d-396865608463 req-a75f638e-bccf-4ec3-b8a3-b9118f21fc02 service nova] Creating event network-changed:3abbe775-9508-422a-826d-d481a507a318 for instance 8e67993b-4604-4f37-9543-3dc09be802e5 on nch1-master-1 Mar 12 20:51:24.231293 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8db969d5-40b0-4ce6-aa5d-396865608463 req-a75f638e-bccf-4ec3-b8a3-b9118f21fc02 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041213 Mar 12 20:51:24.232860 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 700/1254] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:24.240787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b7c0f77-b7fc-471e-a3e5-f3bf5dd0ba0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:24.241792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b7c0f77-b7fc-471e-a3e5-f3bf5dd0ba0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:24.250660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b7c0f77-b7fc-471e-a3e5-f3bf5dd0ba0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:24.251376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b7c0f77-b7fc-471e-a3e5-f3bf5dd0ba0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:24.254559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b7c0f77-b7fc-471e-a3e5-f3bf5dd0ba0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:24.255376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b7c0f77-b7fc-471e-a3e5-f3bf5dd0ba0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:24.291103 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2ac9dd86-0622-4284-8ced-3437a12602f7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:24.299513 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2ac9dd86-0622-4284-8ced-3437a12602f7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.532442 Mar 12 20:51:24.300328 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 555/1255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:23 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:24.305117 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-562394a5-4feb-4c16-b627-985aa93cade5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:24.306083 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-562394a5-4feb-4c16-b627-985aa93cade5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:24.312440 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-562394a5-4feb-4c16-b627-985aa93cade5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:24.313147 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-562394a5-4feb-4c16-b627-985aa93cade5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:24.314129 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-562394a5-4feb-4c16-b627-985aa93cade5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:24.315306 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-562394a5-4feb-4c16-b627-985aa93cade5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:24.647695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b7c0f77-b7fc-471e-a3e5-f3bf5dd0ba0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:24.664051 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b7c0f77-b7fc-471e-a3e5-f3bf5dd0ba0b tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1712 microversion: 2.1 time: 0.427599 Mar 12 20:51:24.666625 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 701/1256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:24 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1712 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:24.676810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca08f32c-96b3-48ee-9416-dde7630ba28e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:24.681667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ca08f32c-96b3-48ee-9416-dde7630ba28e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:24.694561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca08f32c-96b3-48ee-9416-dde7630ba28e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:24.695134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca08f32c-96b3-48ee-9416-dde7630ba28e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:24.696029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca08f32c-96b3-48ee-9416-dde7630ba28e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:24.697579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca08f32c-96b3-48ee-9416-dde7630ba28e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:24.827825 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-562394a5-4feb-4c16-b627-985aa93cade5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:24.838505 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-562394a5-4feb-4c16-b627-985aa93cade5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:24.840949 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-562394a5-4feb-4c16-b627-985aa93cade5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:24.842474 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-562394a5-4feb-4c16-b627-985aa93cade5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1406 microversion: 2.20 time: 0.541005 Mar 12 20:51:24.843392 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 556/1257] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:24 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1406 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:24.848805 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ca6ec26b-6466-4acf-930f-bde57b11ca73 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:24.849829 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ca6ec26b-6466-4acf-930f-bde57b11ca73 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:24.859597 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ca6ec26b-6466-4acf-930f-bde57b11ca73 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:24.860396 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ca6ec26b-6466-4acf-930f-bde57b11ca73 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:24.862025 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ca6ec26b-6466-4acf-930f-bde57b11ca73 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:24.864939 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ca6ec26b-6466-4acf-930f-bde57b11ca73 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:25.011806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca08f32c-96b3-48ee-9416-dde7630ba28e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:25.024134 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca08f32c-96b3-48ee-9416-dde7630ba28e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.351333 Mar 12 20:51:25.025575 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 702/1258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:24 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:25.204523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5956c2b3-500b-4dfc-88d7-ccb8b6b99950 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:25.205350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5956c2b3-500b-4dfc-88d7-ccb8b6b99950 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:25.217129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5956c2b3-500b-4dfc-88d7-ccb8b6b99950 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:25.217583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5956c2b3-500b-4dfc-88d7-ccb8b6b99950 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:25.218411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5956c2b3-500b-4dfc-88d7-ccb8b6b99950 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:25.218851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5956c2b3-500b-4dfc-88d7-ccb8b6b99950 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:25.350609 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ca6ec26b-6466-4acf-930f-bde57b11ca73 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:25.363882 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ca6ec26b-6466-4acf-930f-bde57b11ca73 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1313 microversion: 2.1 time: 0.518413 Mar 12 20:51:25.365575 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 557/1259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:24 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1313 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:25.383320 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8b57a30e-f779-4ada-b128-639687f6e5e7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:25.386626 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8b57a30e-f779-4ada-b128-639687f6e5e7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:25.410460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8b57a30e-f779-4ada-b128-639687f6e5e7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:25.410923 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8b57a30e-f779-4ada-b128-639687f6e5e7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:25.411720 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8b57a30e-f779-4ada-b128-639687f6e5e7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:25.412164 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8b57a30e-f779-4ada-b128-639687f6e5e7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:25.527809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5956c2b3-500b-4dfc-88d7-ccb8b6b99950 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:25.535396 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5956c2b3-500b-4dfc-88d7-ccb8b6b99950 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1379 microversion: 2.1 time: 0.334777 Mar 12 20:51:25.541243 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 703/1260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:25 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1379 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:25.678059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ab220874-46d9-4584-8b35-32de74d84c2f req-c788f973-5053-4b15-ac42-35cadbc02022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae82842-58a0-4d5e-a522-a1c83c53e101", "name": "network-vif-plugged", "status": "completed", "tag": "c40c686b-b640-42d0-a899-bda5e43f8663"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:25.692364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ab220874-46d9-4584-8b35-32de74d84c2f req-c788f973-5053-4b15-ac42-35cadbc02022 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:25.693217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ab220874-46d9-4584-8b35-32de74d84c2f req-c788f973-5053-4b15-ac42-35cadbc02022 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:25.707472 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ab220874-46d9-4584-8b35-32de74d84c2f req-c788f973-5053-4b15-ac42-35cadbc02022 service nova] Creating event network-vif-plugged:c40c686b-b640-42d0-a899-bda5e43f8663 for instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 on nch2-master-1 Mar 12 20:51:25.712686 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ab220874-46d9-4584-8b35-32de74d84c2f req-c788f973-5053-4b15-ac42-35cadbc02022 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039756 Mar 12 20:51:25.713878 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 704/1261] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:51:25.720555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-42340d8f-9a47-4a76-bb8b-5653bb2f25f5 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:25.722061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-42340d8f-9a47-4a76-bb8b-5653bb2f25f5 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:25.734735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42340d8f-9a47-4a76-bb8b-5653bb2f25f5 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:25.735485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42340d8f-9a47-4a76-bb8b-5653bb2f25f5 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:25.737036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42340d8f-9a47-4a76-bb8b-5653bb2f25f5 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:25.738557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42340d8f-9a47-4a76-bb8b-5653bb2f25f5 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:25.994858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-42340d8f-9a47-4a76-bb8b-5653bb2f25f5 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:26.014438 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8b57a30e-f779-4ada-b128-639687f6e5e7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:26.022994 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8b57a30e-f779-4ada-b128-639687f6e5e7 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1549 microversion: 2.1 time: 0.656162 Mar 12 20:51:26.023575 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 558/1262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:25 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1549 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:26.034866 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-de7df3ff-a0ec-4c66-85c2-fbcf584c7f0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:26.035488 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-de7df3ff-a0ec-4c66-85c2-fbcf584c7f0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:26.040996 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-42340d8f-9a47-4a76-bb8b-5653bb2f25f5 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1712 microversion: 2.1 time: 0.324917 Mar 12 20:51:26.042138 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 705/1263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:25 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1712 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:26.052369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a4d22ac8-1b1f-4039-9671-c00e96c5bcac tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:26.054052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a4d22ac8-1b1f-4039-9671-c00e96c5bcac tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:26.064663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4d22ac8-1b1f-4039-9671-c00e96c5bcac tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:26.065493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4d22ac8-1b1f-4039-9671-c00e96c5bcac tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:26.066556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4d22ac8-1b1f-4039-9671-c00e96c5bcac tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:26.067523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4d22ac8-1b1f-4039-9671-c00e96c5bcac tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:26.067645 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de7df3ff-a0ec-4c66-85c2-fbcf584c7f0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:26.068102 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de7df3ff-a0ec-4c66-85c2-fbcf584c7f0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:26.068906 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de7df3ff-a0ec-4c66-85c2-fbcf584c7f0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:26.069611 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de7df3ff-a0ec-4c66-85c2-fbcf584c7f0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:26.260654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a4d22ac8-1b1f-4039-9671-c00e96c5bcac tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:26.272619 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a4d22ac8-1b1f-4039-9671-c00e96c5bcac tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.227238 Mar 12 20:51:26.274236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 706/1264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:26 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:26.386044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8b01f96-2cff-49a3-8c50-dd62113953fd tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:26.387575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8b01f96-2cff-49a3-8c50-dd62113953fd tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:26.399111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8b01f96-2cff-49a3-8c50-dd62113953fd tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:26.399980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8b01f96-2cff-49a3-8c50-dd62113953fd tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:26.401002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8b01f96-2cff-49a3-8c50-dd62113953fd tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:26.401689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8b01f96-2cff-49a3-8c50-dd62113953fd tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:26.640009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c8b01f96-2cff-49a3-8c50-dd62113953fd tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:26.668876 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8b01f96-2cff-49a3-8c50-dd62113953fd tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1463 microversion: 2.1 time: 0.289834 Mar 12 20:51:26.683609 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 707/1265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:26 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1463 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:26.698034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9228a8eb-dcc0-4d50-8a51-4540f8d155d0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:26.699036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9228a8eb-dcc0-4d50-8a51-4540f8d155d0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:26.713327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9228a8eb-dcc0-4d50-8a51-4540f8d155d0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:26.713963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9228a8eb-dcc0-4d50-8a51-4540f8d155d0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:26.715120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9228a8eb-dcc0-4d50-8a51-4540f8d155d0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:26.715687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9228a8eb-dcc0-4d50-8a51-4540f8d155d0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:26.746355 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-de7df3ff-a0ec-4c66-85c2-fbcf584c7f0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:26.756001 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-de7df3ff-a0ec-4c66-85c2-fbcf584c7f0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:26.761646 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-de7df3ff-a0ec-4c66-85c2-fbcf584c7f0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:26.765923 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-de7df3ff-a0ec-4c66-85c2-fbcf584c7f0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1406 microversion: 2.20 time: 0.740765 Mar 12 20:51:26.790226 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 559/1266] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:26 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1406 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:26.961330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9228a8eb-dcc0-4d50-8a51-4540f8d155d0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:26.977380 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9228a8eb-dcc0-4d50-8a51-4540f8d155d0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1379 microversion: 2.1 time: 0.291626 Mar 12 20:51:26.978056 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 708/1267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:26 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1379 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:27.044925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5de138ec-c876-4c11-833c-32f490c1aef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:27.045455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5de138ec-c876-4c11-833c-32f490c1aef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:27.055712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5de138ec-c876-4c11-833c-32f490c1aef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.056181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5de138ec-c876-4c11-833c-32f490c1aef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.056973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5de138ec-c876-4c11-833c-32f490c1aef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.057415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5de138ec-c876-4c11-833c-32f490c1aef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.070734 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-29e0f78a-3616-475c-bd43-d73c922da7c4 tempest-TenantUsagesTestJSON-337390802 tempest-TenantUsagesTestJSON-337390802-project-admin] Calling method '.version_select at 0x7f6e36fe0700>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:27.084878 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-29e0f78a-3616-475c-bd43-d73c922da7c4 tempest-TenantUsagesTestJSON-337390802 tempest-TenantUsagesTestJSON-337390802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.085885 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-29e0f78a-3616-475c-bd43-d73c922da7c4 tempest-TenantUsagesTestJSON-337390802 tempest-TenantUsagesTestJSON-337390802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.112592 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-29e0f78a-3616-475c-bd43-d73c922da7c4 tempest-TenantUsagesTestJSON-337390802 tempest-TenantUsagesTestJSON-337390802-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.113542 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-29e0f78a-3616-475c-bd43-d73c922da7c4 tempest-TenantUsagesTestJSON-337390802 tempest-TenantUsagesTestJSON-337390802-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.138131 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-29e0f78a-3616-475c-bd43-d73c922da7c4 tempest-TenantUsagesTestJSON-337390802 tempest-TenantUsagesTestJSON-337390802-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/529c8a73cc26499cbbe851532b8c601a?start=2022-03-11T20%3A51%3A26.681044&end=2022-03-13T20%3A51%3A26.681044" status: 200 len: 694 microversion: 2.1 time: 0.344613 Mar 12 20:51:27.149434 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 560/1268] 10.222.0.30 () {58 vars in 1411 bytes} [Sat Mar 12 20:51:26 2022] GET /compute/v2.1/os-simple-tenant-usage/529c8a73cc26499cbbe851532b8c601a?start=2022-03-11T20%3A51%3A26.681044&end=2022-03-13T20%3A51%3A26.681044 => generated 694 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:27.156096 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-01330abb-6a1e-43ca-8385-c1892ba17b0f tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:27.157287 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-01330abb-6a1e-43ca-8385-c1892ba17b0f tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:27.166382 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-01330abb-6a1e-43ca-8385-c1892ba17b0f tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.167230 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-01330abb-6a1e-43ca-8385-c1892ba17b0f tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.169336 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-01330abb-6a1e-43ca-8385-c1892ba17b0f tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.170156 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-01330abb-6a1e-43ca-8385-c1892ba17b0f tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.270073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5de138ec-c876-4c11-833c-32f490c1aef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:27.285437 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-01330abb-6a1e-43ca-8385-c1892ba17b0f tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df10426ae3e14b428a1a7dc944867ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8c425aaac144c2aa98af4365bf84a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:27.291420 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5de138ec-c876-4c11-833c-32f490c1aef1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1539 microversion: 2.1 time: 0.245721 Mar 12 20:51:27.292445 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 709/1269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:27 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1539 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:27.294875 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-01330abb-6a1e-43ca-8385-c1892ba17b0f tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 200 len: 1644 microversion: 2.1 time: 0.144072 Mar 12 20:51:27.295457 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 561/1270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:27 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 1644 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:27.305369 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4f6d8412-ad6f-40db-a1ec-d08a081b706c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:27.306022 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4f6d8412-ad6f-40db-a1ec-d08a081b706c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:27.316210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37f978a2-7953-450d-bbca-f671dbe28962 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '.version_select at 0x7f6e36fa4310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:27.323389 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4f6d8412-ad6f-40db-a1ec-d08a081b706c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.323860 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4f6d8412-ad6f-40db-a1ec-d08a081b706c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.324758 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4f6d8412-ad6f-40db-a1ec-d08a081b706c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.325206 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4f6d8412-ad6f-40db-a1ec-d08a081b706c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.341140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37f978a2-7953-450d-bbca-f671dbe28962 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.341842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37f978a2-7953-450d-bbca-f671dbe28962 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.393443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37f978a2-7953-450d-bbca-f671dbe28962 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.393969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37f978a2-7953-450d-bbca-f671dbe28962 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.466482 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-37f978a2-7953-450d-bbca-f671dbe28962 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/529c8a73cc26499cbbe851532b8c601a?start=2022-03-11T20%3A51%3A26.681044&end=2022-03-13T20%3A51%3A26.681044" status: 200 len: 642 microversion: 2.1 time: 0.165462 Mar 12 20:51:27.467377 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 710/1271] 10.222.0.30 () {58 vars in 1411 bytes} [Sat Mar 12 20:51:27 2022] GET /compute/v2.1/os-simple-tenant-usage/529c8a73cc26499cbbe851532b8c601a?start=2022-03-11T20%3A51%3A26.681044&end=2022-03-13T20%3A51%3A26.681044 => generated 642 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:27.478855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-41f14f56-0aa3-4cfc-8665-d84b0e8c974d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '.version_select at 0x7f6e370b9ee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:27.482197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41f14f56-0aa3-4cfc-8665-d84b0e8c974d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.485157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41f14f56-0aa3-4cfc-8665-d84b0e8c974d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.519180 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-41f14f56-0aa3-4cfc-8665-d84b0e8c974d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3104 microversion: 2.1 time: 0.050479 Mar 12 20:51:27.520804 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 711/1272] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 20:51:27 2022] GET /compute/v2.1/os-migrations => generated 3104 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:27.525415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6d6507d2-d544-4e70-b1c4-1ff0364a4b27 tempest-TenantUsagesTestJSON-337390802 tempest-TenantUsagesTestJSON-337390802-project-admin] Calling method '.version_select at 0x7f6e36f00d30>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:27.543942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d6507d2-d544-4e70-b1c4-1ff0364a4b27 tempest-TenantUsagesTestJSON-337390802 tempest-TenantUsagesTestJSON-337390802-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.547180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d6507d2-d544-4e70-b1c4-1ff0364a4b27 tempest-TenantUsagesTestJSON-337390802 tempest-TenantUsagesTestJSON-337390802-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.587040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d6507d2-d544-4e70-b1c4-1ff0364a4b27 tempest-TenantUsagesTestJSON-337390802 tempest-TenantUsagesTestJSON-337390802-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.589020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d6507d2-d544-4e70-b1c4-1ff0364a4b27 tempest-TenantUsagesTestJSON-337390802 tempest-TenantUsagesTestJSON-337390802-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.706557 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6d6507d2-d544-4e70-b1c4-1ff0364a4b27 tempest-TenantUsagesTestJSON-337390802 tempest-TenantUsagesTestJSON-337390802-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-11T20%3A51%3A26.681044&end=2022-03-13T20%3A51%3A26.681044&detailed=1" status: 200 len: 11735 microversion: 2.1 time: 0.179276 Mar 12 20:51:27.709829 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 712/1273] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Mar 12 20:51:27 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-11T20%3A51%3A26.681044&end=2022-03-13T20%3A51%3A26.681044&detailed=1 => generated 11735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:51:27.725651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ba9fea3-4a5d-41d2-a51f-73b8260a7866 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:27.726895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ba9fea3-4a5d-41d2-a51f-73b8260a7866 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:27.737366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ba9fea3-4a5d-41d2-a51f-73b8260a7866 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.738132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ba9fea3-4a5d-41d2-a51f-73b8260a7866 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.747020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ba9fea3-4a5d-41d2-a51f-73b8260a7866 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.747830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ba9fea3-4a5d-41d2-a51f-73b8260a7866 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.893142 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4f6d8412-ad6f-40db-a1ec-d08a081b706c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:27.909412 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4f6d8412-ad6f-40db-a1ec-d08a081b706c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.605999 Mar 12 20:51:27.910371 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 562/1274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:27 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:27.923126 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-c96f71f5-6688-4267-a936-d92b63c334f1 req-4b544610-cdee-44e9-9ce3-aa39ead42bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa543f4a-cb64-4ec9-9863-2f1fb751ef01", "name": "network-vif-deleted", "tag": "b56cfd9b-9a8c-494a-8ad8-518a7d6a9a02"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:27.949701 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-c96f71f5-6688-4267-a936-d92b63c334f1 req-4b544610-cdee-44e9-9ce3-aa39ead42bec service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.957833 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-c96f71f5-6688-4267-a936-d92b63c334f1 req-4b544610-cdee-44e9-9ce3-aa39ead42bec service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:27.982446 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ba9fea3-4a5d-41d2-a51f-73b8260a7866 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1690 microversion: 2.1 time: 0.271293 Mar 12 20:51:27.983352 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 713/1275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:27 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1690 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:27.989061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94fba08f-4583-4f94-9ce5-cfec05458e54 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:27.989061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94fba08f-4583-4f94-9ce5-cfec05458e54 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:27.993512 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-c96f71f5-6688-4267-a936-d92b63c334f1 req-4b544610-cdee-44e9-9ce3-aa39ead42bec service nova] Creating event network-vif-deleted:b56cfd9b-9a8c-494a-8ad8-518a7d6a9a02 for instance aa543f4a-cb64-4ec9-9863-2f1fb751ef01 on nch2-master-1 Mar 12 20:51:27.999490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94fba08f-4583-4f94-9ce5-cfec05458e54 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:27.999961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94fba08f-4583-4f94-9ce5-cfec05458e54 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.000765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94fba08f-4583-4f94-9ce5-cfec05458e54 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.001359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94fba08f-4583-4f94-9ce5-cfec05458e54 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.006966 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-c96f71f5-6688-4267-a936-d92b63c334f1 req-4b544610-cdee-44e9-9ce3-aa39ead42bec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094995 Mar 12 20:51:28.010850 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 563/1276] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:28.021285 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-899c67d1-0455-499e-9d58-209c314a512a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:28.024619 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-899c67d1-0455-499e-9d58-209c314a512a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:28.040729 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-899c67d1-0455-499e-9d58-209c314a512a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.042569 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-899c67d1-0455-499e-9d58-209c314a512a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.045197 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-899c67d1-0455-499e-9d58-209c314a512a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.045735 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-899c67d1-0455-499e-9d58-209c314a512a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.052673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94fba08f-4583-4f94-9ce5-cfec05458e54 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:51:28.166069 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94fba08f-4583-4f94-9ce5-cfec05458e54 tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 204 len: 0 microversion: 2.1 time: 0.181460 Mar 12 20:51:28.168599 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 714/1277] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:51:27 2022] DELETE /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:51:28.184107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8e5513a9-13cc-4ecf-9410-e5f35c1baf96 req-827588ac-e532-4fee-b0a9-965a29d3b7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa543f4a-cb64-4ec9-9863-2f1fb751ef01", "name": "network-vif-unplugged", "status": "completed", "tag": "b56cfd9b-9a8c-494a-8ad8-518a7d6a9a02"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:28.206535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8e5513a9-13cc-4ecf-9410-e5f35c1baf96 req-827588ac-e532-4fee-b0a9-965a29d3b7fc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.207830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8e5513a9-13cc-4ecf-9410-e5f35c1baf96 req-827588ac-e532-4fee-b0a9-965a29d3b7fc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.222693 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8e5513a9-13cc-4ecf-9410-e5f35c1baf96 req-827588ac-e532-4fee-b0a9-965a29d3b7fc service nova] Creating event network-vif-unplugged:b56cfd9b-9a8c-494a-8ad8-518a7d6a9a02 for instance aa543f4a-cb64-4ec9-9863-2f1fb751ef01 on nch2-master-1 Mar 12 20:51:28.228794 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8e5513a9-13cc-4ecf-9410-e5f35c1baf96 req-827588ac-e532-4fee-b0a9-965a29d3b7fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058330 Mar 12 20:51:28.234916 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 715/1278] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:28.247871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86a096e2-80ea-4b85-b105-82638b506b1b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:28.248982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86a096e2-80ea-4b85-b105-82638b506b1b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:28.270216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86a096e2-80ea-4b85-b105-82638b506b1b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.271294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86a096e2-80ea-4b85-b105-82638b506b1b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.272698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86a096e2-80ea-4b85-b105-82638b506b1b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.273600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86a096e2-80ea-4b85-b105-82638b506b1b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.356518 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-899c67d1-0455-499e-9d58-209c314a512a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:28.365517 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-899c67d1-0455-499e-9d58-209c314a512a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:28.367258 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-899c67d1-0455-499e-9d58-209c314a512a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:28.373284 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-899c67d1-0455-499e-9d58-209c314a512a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1598 microversion: 2.20 time: 0.360968 Mar 12 20:51:28.373920 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 564/1279] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:28 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1598 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:28.385118 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4b4bd504-106d-486d-a721-19c5eeec1e45 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:28.386097 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4b4bd504-106d-486d-a721-19c5eeec1e45 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:28.404218 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4b4bd504-106d-486d-a721-19c5eeec1e45 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.404678 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4b4bd504-106d-486d-a721-19c5eeec1e45 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.405484 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4b4bd504-106d-486d-a721-19c5eeec1e45 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.405960 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4b4bd504-106d-486d-a721-19c5eeec1e45 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.680031 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4b4bd504-106d-486d-a721-19c5eeec1e45 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1690 microversion: 2.1 time: 0.304930 Mar 12 20:51:28.680987 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 565/1280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:28 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1690 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:28.690982 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ec693874-a662-430e-9a46-8a2dfe72eb1a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:28.695275 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ec693874-a662-430e-9a46-8a2dfe72eb1a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:28.706183 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ec693874-a662-430e-9a46-8a2dfe72eb1a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.706865 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ec693874-a662-430e-9a46-8a2dfe72eb1a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.708524 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ec693874-a662-430e-9a46-8a2dfe72eb1a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.709301 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ec693874-a662-430e-9a46-8a2dfe72eb1a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.788819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86a096e2-80ea-4b85-b105-82638b506b1b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:28.812362 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86a096e2-80ea-4b85-b105-82638b506b1b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1379 microversion: 2.1 time: 0.575867 Mar 12 20:51:28.822093 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 716/1281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:28 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1379 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:28.822093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d13f5486-a66e-472c-9edc-2646de0c9745 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:28.822093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d13f5486-a66e-472c-9edc-2646de0c9745 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:28.830319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d13f5486-a66e-472c-9edc-2646de0c9745 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.830803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d13f5486-a66e-472c-9edc-2646de0c9745 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.831628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d13f5486-a66e-472c-9edc-2646de0c9745 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.832076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d13f5486-a66e-472c-9edc-2646de0c9745 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.854508 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d13f5486-a66e-472c-9edc-2646de0c9745 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] HTTP exception thrown: Instance aa543f4a-cb64-4ec9-9863-2f1fb751ef01 could not be found. Mar 12 20:51:28.854894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d13f5486-a66e-472c-9edc-2646de0c9745 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Returning 404 to user: Instance aa543f4a-cb64-4ec9-9863-2f1fb751ef01 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:51:28.856240 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d13f5486-a66e-472c-9edc-2646de0c9745 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 404 len: 111 microversion: 2.1 time: 0.042305 Mar 12 20:51:28.859986 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 717/1282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:28 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:51:28.863581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a76cd014-ddea-4374-ad81-a31f23887d25 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:28.864284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a76cd014-ddea-4374-ad81-a31f23887d25 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:28.878019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a76cd014-ddea-4374-ad81-a31f23887d25 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.878779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a76cd014-ddea-4374-ad81-a31f23887d25 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:28.879797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a76cd014-ddea-4374-ad81-a31f23887d25 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:28.880255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a76cd014-ddea-4374-ad81-a31f23887d25 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:29.009429 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a76cd014-ddea-4374-ad81-a31f23887d25 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.151324 Mar 12 20:51:29.016863 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 718/1283] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Mar 12 20:51:28 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:51:29.022707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c64b91f0-5464-403c-9e8f-987071432941 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:29.023427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c64b91f0-5464-403c-9e8f-987071432941 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:29.044615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c64b91f0-5464-403c-9e8f-987071432941 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:29.045351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c64b91f0-5464-403c-9e8f-987071432941 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:29.049312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c64b91f0-5464-403c-9e8f-987071432941 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:29.049844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c64b91f0-5464-403c-9e8f-987071432941 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:29.067244 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ec693874-a662-430e-9a46-8a2dfe72eb1a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:29.078217 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ec693874-a662-430e-9a46-8a2dfe72eb1a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1469 microversion: 2.1 time: 0.395465 Mar 12 20:51:29.078934 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 566/1284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:28 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1469 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:29.102323 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0a7f6b4b-434f-43ef-9ede-c3a8ca143488 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:29.105103 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-0a7f6b4b-434f-43ef-9ede-c3a8ca143488 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:29.135461 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0a7f6b4b-434f-43ef-9ede-c3a8ca143488 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:29.137638 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0a7f6b4b-434f-43ef-9ede-c3a8ca143488 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:29.145221 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0a7f6b4b-434f-43ef-9ede-c3a8ca143488 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:29.145940 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0a7f6b4b-434f-43ef-9ede-c3a8ca143488 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:29.177052 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-0a7f6b4b-434f-43ef-9ede-c3a8ca143488 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] HTTP exception thrown: Instance 7cc87869-0e83-41a4-8949-ae7612a38be2 could not be found. Mar 12 20:51:29.178896 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0a7f6b4b-434f-43ef-9ede-c3a8ca143488 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Returning 404 to user: Instance 7cc87869-0e83-41a4-8949-ae7612a38be2 could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:51:29.180367 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0a7f6b4b-434f-43ef-9ede-c3a8ca143488 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 404 len: 111 microversion: 2.1 time: 0.088889 Mar 12 20:51:29.184144 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 567/1285] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:51:29 2022] DELETE /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:51:29.190189 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-edb992f7-f64f-4251-88f0-a3a9b9b482c2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:29.196471 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-edb992f7-f64f-4251-88f0-a3a9b9b482c2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:29.210915 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-edb992f7-f64f-4251-88f0-a3a9b9b482c2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:29.211622 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-edb992f7-f64f-4251-88f0-a3a9b9b482c2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:29.213899 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-edb992f7-f64f-4251-88f0-a3a9b9b482c2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:29.216391 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-edb992f7-f64f-4251-88f0-a3a9b9b482c2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:29.224799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-c64b91f0-5464-403c-9e8f-987071432941 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lazy-loading 'services' on Instance uuid e40005ee-4cc8-49d8-a826-236d4aad98a0 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:51:29.353079 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c64b91f0-5464-403c-9e8f-987071432941 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0/os-volume_attachments/ff97fd5d-587f-4513-8af9-0e14cbb1f919" status: 202 len: 0 microversion: 2.1 time: 0.333510 Mar 12 20:51:29.354630 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 719/1286] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 20:51:29 2022] DELETE /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0/os-volume_attachments/ff97fd5d-587f-4513-8af9-0e14cbb1f919 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:51:29.378108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c81ececa-0573-4d9d-952a-186c3357471e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:29.379462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c81ececa-0573-4d9d-952a-186c3357471e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:29.389924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c81ececa-0573-4d9d-952a-186c3357471e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:29.390742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c81ececa-0573-4d9d-952a-186c3357471e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:29.392214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c81ececa-0573-4d9d-952a-186c3357471e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:29.393598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c81ececa-0573-4d9d-952a-186c3357471e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:29.420885 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c81ececa-0573-4d9d-952a-186c3357471e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] HTTP exception thrown: Instance 7cc87869-0e83-41a4-8949-ae7612a38be2 could not be found. Mar 12 20:51:29.422292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c81ececa-0573-4d9d-952a-186c3357471e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Returning 404 to user: Instance 7cc87869-0e83-41a4-8949-ae7612a38be2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:51:29.445293 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c81ececa-0573-4d9d-952a-186c3357471e tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 404 len: 111 microversion: 2.1 time: 0.088306 Mar 12 20:51:29.446156 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 720/1287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:29 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:51:29.454378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-796c15d2-63db-4e6a-844e-04019d57b48a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:29.461260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-796c15d2-63db-4e6a-844e-04019d57b48a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:29.474154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-796c15d2-63db-4e6a-844e-04019d57b48a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:29.474608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-796c15d2-63db-4e6a-844e-04019d57b48a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:29.481061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-796c15d2-63db-4e6a-844e-04019d57b48a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:29.481541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-796c15d2-63db-4e6a-844e-04019d57b48a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:29.535705 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-796c15d2-63db-4e6a-844e-04019d57b48a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088405 Mar 12 20:51:29.537650 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 721/1288] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 20:51:29 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:29.543545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7e1f5b6-8647-44dc-ad04-6c68c543fc66 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '.version_select at 0x7f6e36ea8550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:29.572954 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7e1f5b6-8647-44dc-ad04-6c68c543fc66 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383205792" status: 202 len: 0 microversion: 2.1 time: 0.032580 Mar 12 20:51:29.575134 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 722/1289] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Mar 12 20:51:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383205792 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:51:29.600732 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-edb992f7-f64f-4251-88f0-a3a9b9b482c2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:29.622505 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-edb992f7-f64f-4251-88f0-a3a9b9b482c2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.437097 Mar 12 20:51:29.623411 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 568/1290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:29 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:29.830961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc3158cf-3928-4085-950c-ae7bbd8f7528 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:29.831641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc3158cf-3928-4085-950c-ae7bbd8f7528 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:29.841954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc3158cf-3928-4085-950c-ae7bbd8f7528 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:29.846843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc3158cf-3928-4085-950c-ae7bbd8f7528 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:29.849192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc3158cf-3928-4085-950c-ae7bbd8f7528 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:29.849728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc3158cf-3928-4085-950c-ae7bbd8f7528 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:30.096950 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4c3c998f-29db-4b91-84ef-77b494e6bf5f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:30.097712 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4c3c998f-29db-4b91-84ef-77b494e6bf5f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:30.106976 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4c3c998f-29db-4b91-84ef-77b494e6bf5f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:30.110002 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4c3c998f-29db-4b91-84ef-77b494e6bf5f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:30.110932 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4c3c998f-29db-4b91-84ef-77b494e6bf5f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:30.117094 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4c3c998f-29db-4b91-84ef-77b494e6bf5f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:30.713364 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4c3c998f-29db-4b91-84ef-77b494e6bf5f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dd8062973244c8a006b740c0b21218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529c8a73cc26499cbbe851532b8c601a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:30.726052 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4c3c998f-29db-4b91-84ef-77b494e6bf5f tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 200 len: 1469 microversion: 2.1 time: 0.633079 Mar 12 20:51:30.726637 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 569/1291] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:30 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 1469 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:30.743419 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-bca4d7e5-1d9a-4738-abf8-6b35b6c7ab2b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:30.745664 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-bca4d7e5-1d9a-4738-abf8-6b35b6c7ab2b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:30.761017 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bca4d7e5-1d9a-4738-abf8-6b35b6c7ab2b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:30.763839 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bca4d7e5-1d9a-4738-abf8-6b35b6c7ab2b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:30.765213 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bca4d7e5-1d9a-4738-abf8-6b35b6c7ab2b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:30.768815 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-bca4d7e5-1d9a-4738-abf8-6b35b6c7ab2b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:30.791644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dc3158cf-3928-4085-950c-ae7bbd8f7528 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:30.804947 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc3158cf-3928-4085-950c-ae7bbd8f7528 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1379 microversion: 2.1 time: 0.977083 Mar 12 20:51:30.806257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 723/1292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:29 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1379 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:30.813481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d66b087-b911-422e-bbf1-56ecce639913 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:30.815205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8d66b087-b911-422e-bbf1-56ecce639913 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:30.824197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d66b087-b911-422e-bbf1-56ecce639913 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:30.824985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d66b087-b911-422e-bbf1-56ecce639913 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:30.826011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d66b087-b911-422e-bbf1-56ecce639913 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:30.826765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d66b087-b911-422e-bbf1-56ecce639913 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:30.835994 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-bca4d7e5-1d9a-4738-abf8-6b35b6c7ab2b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108034 Mar 12 20:51:30.837094 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 570/1293] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 20:51:30 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:51:31.063078 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-a4ee71d1-680a-46a2-86d7-bd703a582f0c req-6fdebc5a-8d51-4622-9aa2-6437de5827cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef21dfbf-f42a-4e10-8444-4896ee58ec75", "name": "network-vif-deleted", "tag": "85183f71-53ae-4cd8-bb46-ad3f9d2464c1"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:31.080878 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-a4ee71d1-680a-46a2-86d7-bd703a582f0c req-6fdebc5a-8d51-4622-9aa2-6437de5827cf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:31.082626 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-a4ee71d1-680a-46a2-86d7-bd703a582f0c req-6fdebc5a-8d51-4622-9aa2-6437de5827cf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:31.112826 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-a4ee71d1-680a-46a2-86d7-bd703a582f0c req-6fdebc5a-8d51-4622-9aa2-6437de5827cf service nova] Creating event network-vif-deleted:85183f71-53ae-4cd8-bb46-ad3f9d2464c1 for instance ef21dfbf-f42a-4e10-8444-4896ee58ec75 on nch2-master-1 Mar 12 20:51:31.140734 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-a4ee71d1-680a-46a2-86d7-bd703a582f0c req-6fdebc5a-8d51-4622-9aa2-6437de5827cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080828 Mar 12 20:51:31.143237 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 571/1294] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:51:31.457102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d66b087-b911-422e-bbf1-56ecce639913 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:31.466537 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d66b087-b911-422e-bbf1-56ecce639913 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 0.659074 Mar 12 20:51:31.467117 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 724/1295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:30 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:31.745330 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-cc3f5827-20cd-4e33-9aab-eec0d668955a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:31.746230 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-cc3f5827-20cd-4e33-9aab-eec0d668955a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] [instance: ef21dfbf-f42a-4e10-8444-4896ee58ec75] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:31.770435 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cc3f5827-20cd-4e33-9aab-eec0d668955a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:31.772788 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cc3f5827-20cd-4e33-9aab-eec0d668955a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:31.776852 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cc3f5827-20cd-4e33-9aab-eec0d668955a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:31.777395 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cc3f5827-20cd-4e33-9aab-eec0d668955a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:31.815466 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-cc3f5827-20cd-4e33-9aab-eec0d668955a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] HTTP exception thrown: Instance ef21dfbf-f42a-4e10-8444-4896ee58ec75 could not be found. Mar 12 20:51:31.822931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be170dc2-593f-4885-9dc3-28448f641b48 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:31.823554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-be170dc2-593f-4885-9dc3-28448f641b48 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:31.827609 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-cc3f5827-20cd-4e33-9aab-eec0d668955a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] Returning 404 to user: Instance ef21dfbf-f42a-4e10-8444-4896ee58ec75 could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:51:31.828540 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-cc3f5827-20cd-4e33-9aab-eec0d668955a tempest-TenantUsagesTestJSON-1017908163 tempest-TenantUsagesTestJSON-1017908163-project] 10.222.0.30 "GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75" status: 404 len: 111 microversion: 2.1 time: 0.088637 Mar 12 20:51:31.829117 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 572/1296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:31 2022] GET /compute/v2.1/servers/ef21dfbf-f42a-4e10-8444-4896ee58ec75 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:51:31.853241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be170dc2-593f-4885-9dc3-28448f641b48 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:31.853718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be170dc2-593f-4885-9dc3-28448f641b48 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:31.873315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be170dc2-593f-4885-9dc3-28448f641b48 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:31.873315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be170dc2-593f-4885-9dc3-28448f641b48 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:32.219310 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-22bdf27e-9988-42b8-b7b3-c93e9e6c43bd req-8191e96b-1120-4cd8-a2be-40829a522068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae82842-58a0-4d5e-a522-a1c83c53e101", "tag": "c40c686b-b640-42d0-a899-bda5e43f8663"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:32.236809 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-22bdf27e-9988-42b8-b7b3-c93e9e6c43bd req-8191e96b-1120-4cd8-a2be-40829a522068 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:32.241751 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-22bdf27e-9988-42b8-b7b3-c93e9e6c43bd req-8191e96b-1120-4cd8-a2be-40829a522068 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:32.302702 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-22bdf27e-9988-42b8-b7b3-c93e9e6c43bd req-8191e96b-1120-4cd8-a2be-40829a522068 service nova] Creating event network-changed:c40c686b-b640-42d0-a899-bda5e43f8663 for instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 on nch2-master-1 Mar 12 20:51:32.324887 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-22bdf27e-9988-42b8-b7b3-c93e9e6c43bd req-8191e96b-1120-4cd8-a2be-40829a522068 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105997 Mar 12 20:51:32.327244 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 573/1297] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:51:32.350648 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-06767d8e-5628-4229-a3e8-a887e5d42b6c tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:32.358660 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:51:32.358660 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:51:32.412623 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-06767d8e-5628-4229-a3e8-a887e5d42b6c tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/817529204" status: 202 len: 0 microversion: 2.1 time: 0.081205 Mar 12 20:51:32.413654 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 574/1298] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:51:32 2022] DELETE /compute/v2.1/flavors/817529204 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:51:32.424262 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-4f5cb4ea-a9aa-4253-a82e-4d28fd100852 req-980e75b3-1eaf-41d4-be71-0e8a7c0ddb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e67993b-4604-4f37-9543-3dc09be802e5", "name": "network-vif-plugged", "status": "completed", "tag": "3abbe775-9508-422a-826d-d481a507a318"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:32.456966 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-4f5cb4ea-a9aa-4253-a82e-4d28fd100852 req-980e75b3-1eaf-41d4-be71-0e8a7c0ddb62 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:32.458809 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-4f5cb4ea-a9aa-4253-a82e-4d28fd100852 req-980e75b3-1eaf-41d4-be71-0e8a7c0ddb62 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:32.487086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be170dc2-593f-4885-9dc3-28448f641b48 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:32.502033 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-4f5cb4ea-a9aa-4253-a82e-4d28fd100852 req-980e75b3-1eaf-41d4-be71-0e8a7c0ddb62 service nova] Creating event network-vif-plugged:3abbe775-9508-422a-826d-d481a507a318 for instance 8e67993b-4604-4f37-9543-3dc09be802e5 on nch1-master-1 Mar 12 20:51:32.511754 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be170dc2-593f-4885-9dc3-28448f641b48 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1379 microversion: 2.1 time: 0.692816 Mar 12 20:51:32.512834 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 725/1299] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:31 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1379 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:32.515321 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-4f5cb4ea-a9aa-4253-a82e-4d28fd100852 req-980e75b3-1eaf-41d4-be71-0e8a7c0ddb62 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099069 Mar 12 20:51:32.517395 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 575/1300] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:32.535321 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-dc73a627-ea48-48c8-86d2-ce7142be7aee tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:32.537079 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-dc73a627-ea48-48c8-86d2-ce7142be7aee tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:32.557487 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dc73a627-ea48-48c8-86d2-ce7142be7aee tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:32.559359 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dc73a627-ea48-48c8-86d2-ce7142be7aee tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:32.561818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6853a6a1-ffab-4c77-a03d-6e3fea2c47c9 tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:32.562276 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dc73a627-ea48-48c8-86d2-ce7142be7aee tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:32.562890 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dc73a627-ea48-48c8-86d2-ce7142be7aee tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:32.651418 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6853a6a1-ffab-4c77-a03d-6e3fea2c47c9 tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5891 microversion: 2.1 time: 0.121218 Mar 12 20:51:32.666700 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 726/1301] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:51:32 2022] GET /compute/v2.1/flavors/detail => generated 5891 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:32.698925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f69e828-94d0-4a6c-bcd8-239f2bd29de6 tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:32.705977 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:51:32.705977 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:51:32.746293 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f69e828-94d0-4a6c-bcd8-239f2bd29de6 tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/377171495" status: 202 len: 0 microversion: 2.1 time: 0.058034 Mar 12 20:51:32.747502 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 727/1302] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:51:32 2022] DELETE /compute/v2.1/flavors/377171495 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:51:32.755324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-08739728-9f25-4463-9406-0463595264c0 tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:32.828076 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-08739728-9f25-4463-9406-0463595264c0 tempest-ServersWithSpecificFlavorTestJSON-4762180 tempest-ServersWithSpecificFlavorTestJSON-4762180-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.073350 Mar 12 20:51:32.842732 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 728/1303] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:51:32 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:32.869554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c8fc1db-16b1-424f-b4ce-6a6453c91d1a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:32.870310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c8fc1db-16b1-424f-b4ce-6a6453c91d1a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:32.899350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c8fc1db-16b1-424f-b4ce-6a6453c91d1a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:32.899993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c8fc1db-16b1-424f-b4ce-6a6453c91d1a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:32.912896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c8fc1db-16b1-424f-b4ce-6a6453c91d1a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:32.913460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c8fc1db-16b1-424f-b4ce-6a6453c91d1a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:32.940096 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-0c8fc1db-16b1-424f-b4ce-6a6453c91d1a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] HTTP exception thrown: Instance aa543f4a-cb64-4ec9-9863-2f1fb751ef01 could not be found. Mar 12 20:51:32.951575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c8fc1db-16b1-424f-b4ce-6a6453c91d1a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Returning 404 to user: Instance aa543f4a-cb64-4ec9-9863-2f1fb751ef01 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:51:32.952836 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c8fc1db-16b1-424f-b4ce-6a6453c91d1a tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 404 len: 111 microversion: 2.1 time: 0.098881 Mar 12 20:51:32.953425 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 729/1304] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:51:32 2022] DELETE /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:51:32.962408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c0e31ba2-2c70-4275-a7b5-ab5d807b4d88 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:32.963282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c0e31ba2-2c70-4275-a7b5-ab5d807b4d88 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: aa543f4a-cb64-4ec9-9863-2f1fb751ef01] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:32.988406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0e31ba2-2c70-4275-a7b5-ab5d807b4d88 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:32.990684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0e31ba2-2c70-4275-a7b5-ab5d807b4d88 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:32.995822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0e31ba2-2c70-4275-a7b5-ab5d807b4d88 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:32.999376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0e31ba2-2c70-4275-a7b5-ab5d807b4d88 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:33.050951 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c0e31ba2-2c70-4275-a7b5-ab5d807b4d88 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] HTTP exception thrown: Instance aa543f4a-cb64-4ec9-9863-2f1fb751ef01 could not be found. Mar 12 20:51:33.052443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c0e31ba2-2c70-4275-a7b5-ab5d807b4d88 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Returning 404 to user: Instance aa543f4a-cb64-4ec9-9863-2f1fb751ef01 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:51:33.056478 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c0e31ba2-2c70-4275-a7b5-ab5d807b4d88 tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01" status: 404 len: 111 microversion: 2.1 time: 0.098396 Mar 12 20:51:33.060554 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 730/1305] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:32 2022] GET /compute/v2.1/servers/aa543f4a-cb64-4ec9-9863-2f1fb751ef01 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:51:33.072010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9550af28-c7bd-4f6c-9e07-3c6fd896dfcf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:33.072402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9550af28-c7bd-4f6c-9e07-3c6fd896dfcf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:33.087931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9550af28-c7bd-4f6c-9e07-3c6fd896dfcf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:33.088985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9550af28-c7bd-4f6c-9e07-3c6fd896dfcf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:33.092267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9550af28-c7bd-4f6c-9e07-3c6fd896dfcf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:33.093054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9550af28-c7bd-4f6c-9e07-3c6fd896dfcf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:33.125599 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9550af28-c7bd-4f6c-9e07-3c6fd896dfcf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] HTTP exception thrown: Instance 7cc87869-0e83-41a4-8949-ae7612a38be2 could not be found. Mar 12 20:51:33.131704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9550af28-c7bd-4f6c-9e07-3c6fd896dfcf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Returning 404 to user: Instance 7cc87869-0e83-41a4-8949-ae7612a38be2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:51:33.132882 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9550af28-c7bd-4f6c-9e07-3c6fd896dfcf tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 404 len: 111 microversion: 2.1 time: 0.071153 Mar 12 20:51:33.137457 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 731/1306] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:51:33 2022] DELETE /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:51:33.149696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2706159f-c6aa-4c3b-83f1-237cc39a03ee tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:33.150576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2706159f-c6aa-4c3b-83f1-237cc39a03ee tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] [instance: 7cc87869-0e83-41a4-8949-ae7612a38be2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:33.163673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2706159f-c6aa-4c3b-83f1-237cc39a03ee tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:33.164925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2706159f-c6aa-4c3b-83f1-237cc39a03ee tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:33.165303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2706159f-c6aa-4c3b-83f1-237cc39a03ee tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:33.167358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2706159f-c6aa-4c3b-83f1-237cc39a03ee tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:33.216022 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-2706159f-c6aa-4c3b-83f1-237cc39a03ee tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] HTTP exception thrown: Instance 7cc87869-0e83-41a4-8949-ae7612a38be2 could not be found. Mar 12 20:51:33.220394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2706159f-c6aa-4c3b-83f1-237cc39a03ee tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] Returning 404 to user: Instance 7cc87869-0e83-41a4-8949-ae7612a38be2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:51:33.222792 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2706159f-c6aa-4c3b-83f1-237cc39a03ee tempest-ServersWithSpecificFlavorTestJSON-600565882 tempest-ServersWithSpecificFlavorTestJSON-600565882-project] 10.222.0.30 "GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2" status: 404 len: 111 microversion: 2.1 time: 0.084094 Mar 12 20:51:33.225598 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 732/1307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:33 2022] GET /compute/v2.1/servers/7cc87869-0e83-41a4-8949-ae7612a38be2 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:51:33.530201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-97fe0c0c-618b-4e75-b38d-2ca829f6a825 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:33.531819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-97fe0c0c-618b-4e75-b38d-2ca829f6a825 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:33.546252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97fe0c0c-618b-4e75-b38d-2ca829f6a825 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:33.547051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97fe0c0c-618b-4e75-b38d-2ca829f6a825 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:33.548302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97fe0c0c-618b-4e75-b38d-2ca829f6a825 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:33.549607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97fe0c0c-618b-4e75-b38d-2ca829f6a825 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:33.862736 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-dc73a627-ea48-48c8-86d2-ce7142be7aee tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:33.870481 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-dc73a627-ea48-48c8-86d2-ce7142be7aee tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1498 microversion: 2.1 time: 1.351677 Mar 12 20:51:33.881596 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 576/1308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:32 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1498 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:34.124232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-97fe0c0c-618b-4e75-b38d-2ca829f6a825 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:34.136799 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-97fe0c0c-618b-4e75-b38d-2ca829f6a825 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1379 microversion: 2.1 time: 0.608277 Mar 12 20:51:34.146300 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 733/1309] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:33 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1379 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:34.894569 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9e434f07-8427-4d44-aa9c-bb0399d4a207 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:34.899282 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9e434f07-8427-4d44-aa9c-bb0399d4a207 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:34.948856 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9e434f07-8427-4d44-aa9c-bb0399d4a207 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:34.949618 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9e434f07-8427-4d44-aa9c-bb0399d4a207 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:34.956533 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9e434f07-8427-4d44-aa9c-bb0399d4a207 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:34.957257 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9e434f07-8427-4d44-aa9c-bb0399d4a207 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:35.157925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc16cf00-bb1d-4acf-a313-ca656698e900 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:35.158794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc16cf00-bb1d-4acf-a313-ca656698e900 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:35.193254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc16cf00-bb1d-4acf-a313-ca656698e900 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:35.194764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc16cf00-bb1d-4acf-a313-ca656698e900 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:35.195824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc16cf00-bb1d-4acf-a313-ca656698e900 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:35.196596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc16cf00-bb1d-4acf-a313-ca656698e900 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:35.461447 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9e434f07-8427-4d44-aa9c-bb0399d4a207 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:35.475586 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9e434f07-8427-4d44-aa9c-bb0399d4a207 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 200 len: 1475 microversion: 2.1 time: 0.590817 Mar 12 20:51:35.478028 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 577/1310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:34 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 1475 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:35.510404 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f587aed3-61d4-4520-8650-ee9b8cf6491d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1472345574"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:35.511891 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f587aed3-61d4-4520-8650-ee9b8cf6491d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:35.527861 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f587aed3-61d4-4520-8650-ee9b8cf6491d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:35.528706 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f587aed3-61d4-4520-8650-ee9b8cf6491d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:35.529692 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f587aed3-61d4-4520-8650-ee9b8cf6491d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:35.530329 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f587aed3-61d4-4520-8650-ee9b8cf6491d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:35.702615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dc16cf00-bb1d-4acf-a313-ca656698e900 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:35.716875 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc16cf00-bb1d-4acf-a313-ca656698e900 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1529 microversion: 2.1 time: 0.565839 Mar 12 20:51:35.719522 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 734/1311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:35 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1529 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:35.736149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1b62dd91-4e09-40b8-a179-047f980e2a73 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:35.736991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1b62dd91-4e09-40b8-a179-047f980e2a73 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:35.747341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b62dd91-4e09-40b8-a179-047f980e2a73 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:35.748773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b62dd91-4e09-40b8-a179-047f980e2a73 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:35.752235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b62dd91-4e09-40b8-a179-047f980e2a73 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:35.759554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b62dd91-4e09-40b8-a179-047f980e2a73 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:36.051815 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f587aed3-61d4-4520-8650-ee9b8cf6491d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "POST /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb/action" status: 202 len: 0 microversion: 2.1 time: 0.539081 Mar 12 20:51:36.055687 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 578/1312] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:51:35 2022] POST /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 12 20:51:36.088464 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5d622d2f-ebc8-4437-ba20-c3068b85a55e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f0f040>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:36.138201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1b62dd91-4e09-40b8-a179-047f980e2a73 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:36.148784 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1b62dd91-4e09-40b8-a179-047f980e2a73 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1529 microversion: 2.1 time: 0.417603 Mar 12 20:51:36.153783 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 735/1313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:35 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1529 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:36.169445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-22f02cfd-855e-497f-8ee6-9d1cce6b4886 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:36.170286 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:51:36.170286 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:51:36.170719 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5d622d2f-ebc8-4437-ba20-c3068b85a55e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.098002 Mar 12 20:51:36.171428 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 579/1314] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:36 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:36.203050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-22f02cfd-855e-497f-8ee6-9d1cce6b4886 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/c2272325-7bac-4d55-9284-a9385fdd6e35" status: 202 len: 0 microversion: 2.1 time: 0.036989 Mar 12 20:51:36.209627 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 736/1315] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:51:36 2022] DELETE /compute/v2.1/flavors/c2272325-7bac-4d55-9284-a9385fdd6e35 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 20:51:36.214629 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-43f5c9b1-d6b7-4fd0-860c-7b77f25d643a tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:36.252187 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-43f5c9b1-d6b7-4fd0-860c-7b77f25d643a tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041208 Mar 12 20:51:36.275072 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 580/1316] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:51:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:36.294052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:36.295874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:36.305194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:36.305582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:36.306422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:36.308353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:36.348595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:36.355731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Old instance type tempest-test_resize_flavor_-1154293330, new instance type m1.heat {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 20:51:36.364043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:51:36.364720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:51:36.365372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:51:36.366005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:51:36.368022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:51:36.506914 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e01d114e-9557-4774-ae52-332b2a836fae tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "POST /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5/action" status: 202 len: 0 microversion: 2.1 time: 0.218234 Mar 12 20:51:36.519924 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-893f3e3e-cfe0-43a6-82e0-5b83888f2171 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:36.520957 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-893f3e3e-cfe0-43a6-82e0-5b83888f2171 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:36.525350 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 737/1317] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:51:36 2022] POST /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:51:36.529856 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-893f3e3e-cfe0-43a6-82e0-5b83888f2171 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:36.538791 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-893f3e3e-cfe0-43a6-82e0-5b83888f2171 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:36.541944 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-893f3e3e-cfe0-43a6-82e0-5b83888f2171 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:36.542768 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-893f3e3e-cfe0-43a6-82e0-5b83888f2171 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:36.923725 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-893f3e3e-cfe0-43a6-82e0-5b83888f2171 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:36.931842 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-893f3e3e-cfe0-43a6-82e0-5b83888f2171 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1538 microversion: 2.1 time: 0.415759 Mar 12 20:51:36.936767 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 581/1318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:36 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1538 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:37.184383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a61ad9ad-8b24-4bfd-9459-ac0bb20a0c15 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36ebc820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:37.269687 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a61ad9ad-8b24-4bfd-9459-ac0bb20a0c15 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.089153 Mar 12 20:51:37.274112 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 738/1319] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:37 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:37.954957 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d619fe35-dce1-4e7c-8a9f-75b4aa7d87a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:37.955577 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d619fe35-dce1-4e7c-8a9f-75b4aa7d87a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:37.968369 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d619fe35-dce1-4e7c-8a9f-75b4aa7d87a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:37.968894 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d619fe35-dce1-4e7c-8a9f-75b4aa7d87a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:37.969734 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d619fe35-dce1-4e7c-8a9f-75b4aa7d87a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:37.970807 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d619fe35-dce1-4e7c-8a9f-75b4aa7d87a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:38.285035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abd86399-6f61-4f4d-b341-937494d1ebe4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e370a61f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:38.390619 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-abd86399-6f61-4f4d-b341-937494d1ebe4 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.111443 Mar 12 20:51:38.392314 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 739/1320] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:38 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:39.123938 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d619fe35-dce1-4e7c-8a9f-75b4aa7d87a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:39.159052 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d619fe35-dce1-4e7c-8a9f-75b4aa7d87a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1538 microversion: 2.1 time: 1.204803 Mar 12 20:51:39.161526 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 582/1321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:37 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1538 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:39.408286 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3f319e42-3e34-44d9-adf4-0fbd7bb79ddf tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f221f0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:39.480021 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3f319e42-3e34-44d9-adf4-0fbd7bb79ddf tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.076174 Mar 12 20:51:39.480603 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 583/1322] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:39 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:39.510172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-042a012c-7c48-445d-8e2b-0b0987899ec4 tempest-FloatingIPDetailsNegativeTestJSON-327982474 tempest-FloatingIPDetailsNegativeTestJSON-327982474-project] Calling method '.version_select at 0x7f6e36f460d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:39.674458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-042a012c-7c48-445d-8e2b-0b0987899ec4 tempest-FloatingIPDetailsNegativeTestJSON-327982474 tempest-FloatingIPDetailsNegativeTestJSON-327982474-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 805ba309-aa9f-4169-ac3c-ed37ea6760bf could not be found", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:51:39.675164 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-042a012c-7c48-445d-8e2b-0b0987899ec4 tempest-FloatingIPDetailsNegativeTestJSON-327982474 tempest-FloatingIPDetailsNegativeTestJSON-327982474-project] HTTP exception thrown: Floating IP not found for ID 805ba309-aa9f-4169-ac3c-ed37ea6760bf Mar 12 20:51:39.675801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-042a012c-7c48-445d-8e2b-0b0987899ec4 tempest-FloatingIPDetailsNegativeTestJSON-327982474 tempest-FloatingIPDetailsNegativeTestJSON-327982474-project] Returning 404 to user: Floating IP not found for ID 805ba309-aa9f-4169-ac3c-ed37ea6760bf {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:51:39.676709 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-042a012c-7c48-445d-8e2b-0b0987899ec4 tempest-FloatingIPDetailsNegativeTestJSON-327982474 tempest-FloatingIPDetailsNegativeTestJSON-327982474-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/805ba309-aa9f-4169-ac3c-ed37ea6760bf" status: 404 len: 111 microversion: 2.1 time: 0.307326 Mar 12 20:51:39.678202 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 740/1323] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Mar 12 20:51:39 2022] GET /compute/v2.1/os-floating-ips/805ba309-aa9f-4169-ac3c-ed37ea6760bf => generated 111 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:51:40.179180 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b97a5fda-6304-410a-beaf-f75b32198949 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:40.180539 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b97a5fda-6304-410a-beaf-f75b32198949 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:40.200253 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b97a5fda-6304-410a-beaf-f75b32198949 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:40.209712 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b97a5fda-6304-410a-beaf-f75b32198949 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:40.210621 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b97a5fda-6304-410a-beaf-f75b32198949 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:40.211076 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b97a5fda-6304-410a-beaf-f75b32198949 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:40.497669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3a1bb1b-ef6b-4ff8-9f3c-36b15792b4c9 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f460d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:40.587560 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3a1bb1b-ef6b-4ff8-9f3c-36b15792b4c9 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.092458 Mar 12 20:51:40.592402 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 741/1324] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:40 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:40.737666 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-b97a5fda-6304-410a-beaf-f75b32198949 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:40.745198 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b97a5fda-6304-410a-beaf-f75b32198949 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1538 microversion: 2.1 time: 0.570708 Mar 12 20:51:40.745842 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 584/1325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:40 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1538 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:41.618979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-68fdb88c-6bec-47f5-ba09-4c78cea57e83 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f2e700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:41.761042 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-68fdb88c-6bec-47f5-ba09-4c78cea57e83 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.156045 Mar 12 20:51:41.764154 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7fcc54d0-b7f9-4c1f-8cb5-18bcf9bfa2fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:41.765377 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7fcc54d0-b7f9-4c1f-8cb5-18bcf9bfa2fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:41.769072 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 742/1326] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:41 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:41.784517 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7fcc54d0-b7f9-4c1f-8cb5-18bcf9bfa2fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:41.784624 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7fcc54d0-b7f9-4c1f-8cb5-18bcf9bfa2fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:41.786989 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7fcc54d0-b7f9-4c1f-8cb5-18bcf9bfa2fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:41.788927 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7fcc54d0-b7f9-4c1f-8cb5-18bcf9bfa2fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:42.778114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71a3c64d-4a72-43a2-b86b-f041ee8ff1e2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e370a6790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:42.933609 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71a3c64d-4a72-43a2-b86b-f041ee8ff1e2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.162312 Mar 12 20:51:42.934885 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 743/1327] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:42 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:43.953406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ef9e6635-b241-4c95-93d7-b011432540fe tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e3716f430>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:44.043276 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7fcc54d0-b7f9-4c1f-8cb5-18bcf9bfa2fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:44.073386 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ef9e6635-b241-4c95-93d7-b011432540fe tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.124570 Mar 12 20:51:44.086674 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 744/1328] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:43 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:44.094426 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7fcc54d0-b7f9-4c1f-8cb5-18bcf9bfa2fa tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1538 microversion: 2.1 time: 2.332625 Mar 12 20:51:44.096718 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 585/1329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:41 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1538 bytes in 2339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:45.092082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-03364281-961a-4ad1-9089-cc1eac24c9a9 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e37093b80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:45.128876 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f8ecb25b-386e-4d37-86c1-d65a013d3037 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:45.128876 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f8ecb25b-386e-4d37-86c1-d65a013d3037 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:45.153146 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f8ecb25b-386e-4d37-86c1-d65a013d3037 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:45.153605 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f8ecb25b-386e-4d37-86c1-d65a013d3037 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:45.154474 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f8ecb25b-386e-4d37-86c1-d65a013d3037 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:45.154917 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f8ecb25b-386e-4d37-86c1-d65a013d3037 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:45.222839 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-03364281-961a-4ad1-9089-cc1eac24c9a9 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.137775 Mar 12 20:51:45.228665 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 745/1330] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:45 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:46.030407 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f8ecb25b-386e-4d37-86c1-d65a013d3037 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:46.048405 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f8ecb25b-386e-4d37-86c1-d65a013d3037 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1543 microversion: 2.1 time: 0.924834 Mar 12 20:51:46.049218 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 586/1331] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:45 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1543 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:46.241027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-084e27a1-4bf6-43b7-9f4d-1c7d40dcb491 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e3716f040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:46.359500 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-084e27a1-4bf6-43b7-9f4d-1c7d40dcb491 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.124762 Mar 12 20:51:46.360961 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 746/1332] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:46 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:46.517623 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-9bcc6dca-a6e3-4051-a26c-8890200715b8 req-1d9b7583-bfd8-452b-ae73-f584290ebe1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7052bc-c2a6-4c11-85b5-e31c7f79adfb", "name": "network-vif-plugged", "status": "completed", "tag": "72ad719c-17da-4caf-89cd-ae46166479db"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:46.544142 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-9bcc6dca-a6e3-4051-a26c-8890200715b8 req-1d9b7583-bfd8-452b-ae73-f584290ebe1f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:46.545840 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-9bcc6dca-a6e3-4051-a26c-8890200715b8 req-1d9b7583-bfd8-452b-ae73-f584290ebe1f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:46.577008 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-9bcc6dca-a6e3-4051-a26c-8890200715b8 req-1d9b7583-bfd8-452b-ae73-f584290ebe1f service nova] Creating event network-vif-plugged:72ad719c-17da-4caf-89cd-ae46166479db for instance 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb on nch1-master-1 Mar 12 20:51:46.594719 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-9bcc6dca-a6e3-4051-a26c-8890200715b8 req-1d9b7583-bfd8-452b-ae73-f584290ebe1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082149 Mar 12 20:51:46.599248 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 587/1333] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:47.068530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cc5d6c5d-e828-468d-b7cd-bc7cd83124ad tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:47.069686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc5d6c5d-e828-468d-b7cd-bc7cd83124ad tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:47.090614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc5d6c5d-e828-468d-b7cd-bc7cd83124ad tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:47.091421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc5d6c5d-e828-468d-b7cd-bc7cd83124ad tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:47.092436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc5d6c5d-e828-468d-b7cd-bc7cd83124ad tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:47.093295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc5d6c5d-e828-468d-b7cd-bc7cd83124ad tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:47.374664 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4270c993-50a2-481e-ba97-8240e17d05e7 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f22160>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:47.473510 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4270c993-50a2-481e-ba97-8240e17d05e7 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.104330 Mar 12 20:51:47.474655 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 588/1334] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:47 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:47.884512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cc5d6c5d-e828-468d-b7cd-bc7cd83124ad tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:47.897637 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cc5d6c5d-e828-468d-b7cd-bc7cd83124ad tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1543 microversion: 2.1 time: 0.835023 Mar 12 20:51:47.901829 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 747/1335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:47 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1543 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:48.487671 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d9b23bdf-7a2a-49a3-afea-3b4924f7105f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f62b80>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:48.603616 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d9b23bdf-7a2a-49a3-afea-3b4924f7105f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.120535 Mar 12 20:51:48.604809 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 589/1336] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:48 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:48.653368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-919889212", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1c06f7bd-57f3-494e-b107-2b7e9aae71ae"}], "block_device_mapping_v2": [{"uuid": "9916cd82-3d9b-466f-a769-cf81bdc743fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:48.802494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] validate_networks() for [('1c06f7bd-57f3-494e-b107-2b7e9aae71ae', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:51:48.929407 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-688cb3bf-0d3f-4343-9457-06efa890c94e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:48.930183 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-688cb3bf-0d3f-4343-9457-06efa890c94e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:48.942140 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-688cb3bf-0d3f-4343-9457-06efa890c94e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:48.942602 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-688cb3bf-0d3f-4343-9457-06efa890c94e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:48.943395 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-688cb3bf-0d3f-4343-9457-06efa890c94e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:48.944087 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-688cb3bf-0d3f-4343-9457-06efa890c94e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:49.627030 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-688cb3bf-0d3f-4343-9457-06efa890c94e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:49.652974 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-688cb3bf-0d3f-4343-9457-06efa890c94e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1543 microversion: 2.1 time: 0.730768 Mar 12 20:51:49.667549 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 590/1337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:48 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1543 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:49.682281 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b0c2a7d2-a7f3-47b7-85cd-5bcc8de14ebd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f22670>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:49.851603 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b0c2a7d2-a7f3-47b7-85cd-5bcc8de14ebd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.182677 Mar 12 20:51:49.852302 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 591/1338] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:49 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:50.680373 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9689cf0d-bfaf-4383-81b8-d52a4717183d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:50.681480 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9689cf0d-bfaf-4383-81b8-d52a4717183d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:50.704984 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9689cf0d-bfaf-4383-81b8-d52a4717183d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:50.705837 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9689cf0d-bfaf-4383-81b8-d52a4717183d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:50.707221 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9689cf0d-bfaf-4383-81b8-d52a4717183d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:50.707848 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9689cf0d-bfaf-4383-81b8-d52a4717183d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:51.262621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:51:51.263130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:51:51.263535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:51:51.263963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:51:51.264386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:51:51.281107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:51.281614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:51.283519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:51.283985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:51.319465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Getting quotas for project 7417ea19a899461e99596d0df881a336. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:51:51.326624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Getting quotas for user 9c3556ea8eba477e92c2f6f765a30c1f and project 7417ea19a899461e99596d0df881a336. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:51:51.412135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:51:51.414507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9916cd82-3d9b-466f-a769-cf81bdc743fd',volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:51:51.606457 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9689cf0d-bfaf-4383-81b8-d52a4717183d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:51.624788 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9689cf0d-bfaf-4383-81b8-d52a4717183d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1543 microversion: 2.1 time: 0.957507 Mar 12 20:51:51.626005 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 592/1339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:50 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1543 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:51.631238 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c73beef0-b699-443c-8efb-ef6aeae8174a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f4ab80>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:51.698751 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c73beef0-b699-443c-8efb-ef6aeae8174a tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.071414 Mar 12 20:51:51.700223 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 593/1340] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:51 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:51.712863 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2145214889", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4b8a32df-ad87-496b-8291-8d1bc2a20fb0"}], "block_device_mapping_v2": [{"uuid": "50aafd1b-9074-4f5a-9416-a6b5a7b804d6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:51.717610 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aea4ac93-3e5c-426e-b4af-1359e6f1d601 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.068403 Mar 12 20:51:51.723845 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 748/1341] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3071 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 20:51:51.729706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9df45c80-a1f6-494e-840a-d7e496a3a6f6 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:51.731834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9df45c80-a1f6-494e-840a-d7e496a3a6f6 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:51.901195 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.neutron [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] validate_networks() for [('4b8a32df-ad87-496b-8291-8d1bc2a20fb0', None, None, None, None, None)] {{(pid=136303) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:51:52.381093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9df45c80-a1f6-494e-840a-d7e496a3a6f6 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:52.406417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9df45c80-a1f6-494e-840a-d7e496a3a6f6 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:52.411488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9df45c80-a1f6-494e-840a-d7e496a3a6f6 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:52.413669 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9df45c80-a1f6-494e-840a-d7e496a3a6f6 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1103 microversion: 2.25 time: 0.688365 Mar 12 20:51:52.417649 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 749/1342] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:51 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1103 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:52.641954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-daa3bfa7-7448-4dba-8330-c5b58984fb5f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:52.643088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-daa3bfa7-7448-4dba-8330-c5b58984fb5f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:52.653615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daa3bfa7-7448-4dba-8330-c5b58984fb5f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:52.654337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daa3bfa7-7448-4dba-8330-c5b58984fb5f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:52.655299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daa3bfa7-7448-4dba-8330-c5b58984fb5f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:52.655905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daa3bfa7-7448-4dba-8330-c5b58984fb5f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:52.695822 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:51:52.698860 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:51:52.701120 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:51:52.703381 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:51:52.711902 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:51:52.726562 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:52.727501 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:52.728842 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:52.730279 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:52.799557 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Getting quotas for project c248ec2e2f0c457291cd412812c08e5a. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:51:52.805267 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Getting quotas for user a7854cfb82544a70aee1a7d421bfce55 and project c248ec2e2f0c457291cd412812c08e5a. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:51:52.888012 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Going to run 1 instances... {{(pid=136303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:51:52.890176 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50aafd1b-9074-4f5a-9416-a6b5a7b804d6',volume_size=None,volume_type=None)] {{(pid=136303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:51:53.147783 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-be8b2b37-9988-45e6-a693-7da1b1f48edf tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.443098 Mar 12 20:51:53.157564 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 594/1343] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:51:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:51:53.191544 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f3d85a2a-0e7b-465e-bcf5-ba09168da066 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f45280>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:53.240622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-daa3bfa7-7448-4dba-8330-c5b58984fb5f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:53.276108 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f3d85a2a-0e7b-465e-bcf5-ba09168da066 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.116918 Mar 12 20:51:53.276694 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 595/1344] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:53 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:53.281801 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-daa3bfa7-7448-4dba-8330-c5b58984fb5f tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1543 microversion: 2.1 time: 0.635495 Mar 12 20:51:53.291598 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 750/1345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:52 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1543 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:53.293227 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9000a212-2a67-49a0-a94a-4fdb484335f5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:53.295513 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9000a212-2a67-49a0-a94a-4fdb484335f5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:53.439763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9dabb179-37c0-49cb-a35f-2a71b9dafe65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:53.441659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9dabb179-37c0-49cb-a35f-2a71b9dafe65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:53.467007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9dabb179-37c0-49cb-a35f-2a71b9dafe65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:53.471877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9dabb179-37c0-49cb-a35f-2a71b9dafe65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:53.474795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9dabb179-37c0-49cb-a35f-2a71b9dafe65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:53.481741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9dabb179-37c0-49cb-a35f-2a71b9dafe65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:53.670806 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9000a212-2a67-49a0-a94a-4fdb484335f5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:53.688121 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9000a212-2a67-49a0-a94a-4fdb484335f5 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1053 microversion: 2.1 time: 0.405679 Mar 12 20:51:53.690885 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 596/1346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:53 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1053 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:53.987661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9dabb179-37c0-49cb-a35f-2a71b9dafe65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:53.998496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9dabb179-37c0-49cb-a35f-2a71b9dafe65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:54.008935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9dabb179-37c0-49cb-a35f-2a71b9dafe65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:54.015158 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9dabb179-37c0-49cb-a35f-2a71b9dafe65 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1240 microversion: 2.25 time: 0.579746 Mar 12 20:51:54.017749 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 751/1347] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:53 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1240 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:51:54.293613 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-874a69b3-ef08-42ae-9f90-1619da598aae tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36fe19d0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:54.351497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-afe33d25-1276-4cb6-a380-ca3cb0719c1e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:54.358459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-afe33d25-1276-4cb6-a380-ca3cb0719c1e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:54.389683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afe33d25-1276-4cb6-a380-ca3cb0719c1e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:54.396899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afe33d25-1276-4cb6-a380-ca3cb0719c1e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:54.397872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afe33d25-1276-4cb6-a380-ca3cb0719c1e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:54.398332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afe33d25-1276-4cb6-a380-ca3cb0719c1e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:54.480159 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-874a69b3-ef08-42ae-9f90-1619da598aae tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.190693 Mar 12 20:51:54.489247 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 597/1348] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:54 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:54.707511 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-27934026-dba3-4829-8cd5-1d8524e0c6d2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:54.708105 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-27934026-dba3-4829-8cd5-1d8524e0c6d2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:54.731232 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-27934026-dba3-4829-8cd5-1d8524e0c6d2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:54.731830 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-27934026-dba3-4829-8cd5-1d8524e0c6d2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:54.732669 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-27934026-dba3-4829-8cd5-1d8524e0c6d2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:54.733125 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-27934026-dba3-4829-8cd5-1d8524e0c6d2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:55.092644 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-27934026-dba3-4829-8cd5-1d8524e0c6d2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:55.104470 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-27934026-dba3-4829-8cd5-1d8524e0c6d2 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1151 microversion: 2.1 time: 0.401859 Mar 12 20:51:55.106186 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 598/1349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:54 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1151 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:51:55.117693 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-22d7dbc3-6a29-4b05-8772-61f46a99bc0e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:55.124610 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-22d7dbc3-6a29-4b05-8772-61f46a99bc0e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:55.160304 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-22d7dbc3-6a29-4b05-8772-61f46a99bc0e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:55.166952 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-22d7dbc3-6a29-4b05-8772-61f46a99bc0e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:55.171199 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-22d7dbc3-6a29-4b05-8772-61f46a99bc0e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:55.173857 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-22d7dbc3-6a29-4b05-8772-61f46a99bc0e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:55.560838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-afe33d25-1276-4cb6-a380-ca3cb0719c1e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:55.569656 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-afe33d25-1276-4cb6-a380-ca3cb0719c1e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1543 microversion: 2.1 time: 1.264580 Mar 12 20:51:55.575506 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 752/1350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:54 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1543 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:56.018737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1514763407", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:56.135564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:51:56.203460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-22d7dbc3-6a29-4b05-8772-61f46a99bc0e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:56.211992 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-22d7dbc3-6a29-4b05-8772-61f46a99bc0e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:56.213533 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-22d7dbc3-6a29-4b05-8772-61f46a99bc0e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:56.214705 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-22d7dbc3-6a29-4b05-8772-61f46a99bc0e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1292 microversion: 2.25 time: 1.106792 Mar 12 20:51:56.215280 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 599/1351] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:55 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1292 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:56.239190 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ebd58454-d4e3-411c-bc33-7b2ed345b7da tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f0f9d0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:56.386024 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ebd58454-d4e3-411c-bc33-7b2ed345b7da tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.153842 Mar 12 20:51:56.386967 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 600/1352] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:56 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:56.391634 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-67bd9de9-6277-4f92-9c37-ab9f5dd25f9f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:56.392258 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-67bd9de9-6277-4f92-9c37-ab9f5dd25f9f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:56.419755 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67bd9de9-6277-4f92-9c37-ab9f5dd25f9f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:56.420224 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67bd9de9-6277-4f92-9c37-ab9f5dd25f9f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:56.421037 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67bd9de9-6277-4f92-9c37-ab9f5dd25f9f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:56.421490 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67bd9de9-6277-4f92-9c37-ab9f5dd25f9f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:56.708155 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-67bd9de9-6277-4f92-9c37-ab9f5dd25f9f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:56.721138 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-67bd9de9-6277-4f92-9c37-ab9f5dd25f9f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1169 microversion: 2.1 time: 0.332919 Mar 12 20:51:56.721870 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 601/1353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:56 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1169 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:56.743209 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7d8bf5cd-53aa-4893-939a-f0f6a0a60d2d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:56.747121 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7d8bf5cd-53aa-4893-939a-f0f6a0a60d2d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:56.771028 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7d8bf5cd-53aa-4893-939a-f0f6a0a60d2d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:56.772972 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7d8bf5cd-53aa-4893-939a-f0f6a0a60d2d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:56.775105 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7d8bf5cd-53aa-4893-939a-f0f6a0a60d2d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:56.778518 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7d8bf5cd-53aa-4893-939a-f0f6a0a60d2d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:57.569827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:51:57.575485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:51:57.576001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:51:57.576432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:51:57.576862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:51:57.627055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:57.627526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:57.628360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:57.628808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:57.728500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Getting quotas for project 23a488240d854791982d9752ec577a28. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:51:57.771338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Getting quotas for user 1954449180ce475a88dec4df6de6523d and project 23a488240d854791982d9752ec577a28. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:51:57.834777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:51:57.841395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:51:57.971271 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ba43da1-2c7e-4dce-9aab-ccdb5ad16100 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.391319 Mar 12 20:51:57.976569 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 753/1354] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:51:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:51:57.985058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e1d3cd33-b1fc-46cb-b0be-1e35e647f30e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:57.990230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e1d3cd33-b1fc-46cb-b0be-1e35e647f30e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:58.044017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1d3cd33-b1fc-46cb-b0be-1e35e647f30e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:58.046421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1d3cd33-b1fc-46cb-b0be-1e35e647f30e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:58.051437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1d3cd33-b1fc-46cb-b0be-1e35e647f30e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:58.052418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1d3cd33-b1fc-46cb-b0be-1e35e647f30e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:58.085893 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7d8bf5cd-53aa-4893-939a-f0f6a0a60d2d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:58.100734 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7d8bf5cd-53aa-4893-939a-f0f6a0a60d2d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1543 microversion: 2.1 time: 1.372747 Mar 12 20:51:58.105134 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 602/1355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:56 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1543 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:58.117872 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b977888f-ceed-4a63-962e-239cd5e9c263 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f2aca0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:58.205872 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b977888f-ceed-4a63-962e-239cd5e9c263 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.099376 Mar 12 20:51:58.206621 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 603/1356] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:58 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:58.223021 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-30ed6c33-9d34-42b0-bbdf-3d88407a3fdb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:58.230825 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-30ed6c33-9d34-42b0-bbdf-3d88407a3fdb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:58.250259 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-30ed6c33-9d34-42b0-bbdf-3d88407a3fdb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:58.254449 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-30ed6c33-9d34-42b0-bbdf-3d88407a3fdb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:58.256204 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-30ed6c33-9d34-42b0-bbdf-3d88407a3fdb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:58.261609 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-30ed6c33-9d34-42b0-bbdf-3d88407a3fdb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:58.751116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e1d3cd33-b1fc-46cb-b0be-1e35e647f30e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:58.762193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e1d3cd33-b1fc-46cb-b0be-1e35e647f30e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:58.765984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e1d3cd33-b1fc-46cb-b0be-1e35e647f30e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:58.771228 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e1d3cd33-b1fc-46cb-b0be-1e35e647f30e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1280 microversion: 2.25 time: 0.793903 Mar 12 20:51:58.785091 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 754/1357] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:57 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1280 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:51:58.797110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b30278eb-0e7c-4fe1-857b-5e4688437971 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:58.801343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b30278eb-0e7c-4fe1-857b-5e4688437971 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:58.896949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b30278eb-0e7c-4fe1-857b-5e4688437971 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:58.912443 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b30278eb-0e7c-4fe1-857b-5e4688437971 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1217 microversion: 2.1 time: 0.125854 Mar 12 20:51:58.916837 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 755/1358] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:58 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:59.129395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b772fa41-5160-4497-8aee-8b6ae81db2af tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:59.130157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b772fa41-5160-4497-8aee-8b6ae81db2af tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:59.145156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b772fa41-5160-4497-8aee-8b6ae81db2af tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:59.149199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b772fa41-5160-4497-8aee-8b6ae81db2af tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:59.156723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b772fa41-5160-4497-8aee-8b6ae81db2af tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:59.160576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b772fa41-5160-4497-8aee-8b6ae81db2af tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:59.445727 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-30ed6c33-9d34-42b0-bbdf-3d88407a3fdb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:59.461235 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-30ed6c33-9d34-42b0-bbdf-3d88407a3fdb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1199 microversion: 2.1 time: 1.253328 Mar 12 20:51:59.461849 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 604/1359] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:58 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1199 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:59.481470 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d965d804-8941-4fae-85e8-eb0bd853042c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f2a280>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:59.593213 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d965d804-8941-4fae-85e8-eb0bd853042c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.130281 Mar 12 20:51:59.594566 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 605/1360] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:51:59 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:59.611988 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c5ed89a5-22ff-4dee-bf56-befe6aa05c04 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:59.618615 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c5ed89a5-22ff-4dee-bf56-befe6aa05c04 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:59.634667 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c5ed89a5-22ff-4dee-bf56-befe6aa05c04 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:59.635162 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c5ed89a5-22ff-4dee-bf56-befe6aa05c04 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:59.637323 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c5ed89a5-22ff-4dee-bf56-befe6aa05c04 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:59.637755 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c5ed89a5-22ff-4dee-bf56-befe6aa05c04 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:59.664989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b772fa41-5160-4497-8aee-8b6ae81db2af tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:51:59.686231 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b772fa41-5160-4497-8aee-8b6ae81db2af tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1543 microversion: 2.1 time: 0.562212 Mar 12 20:51:59.701557 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c5ed89a5-22ff-4dee-bf56-befe6aa05c04 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/ips" status: 200 len: 152 microversion: 2.20 time: 0.105395 Mar 12 20:51:59.707089 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 606/1361] 10.222.0.30 () {60 vars in 1288 bytes} [Sat Mar 12 20:51:59 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/ips => generated 152 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:51:59.716066 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 756/1362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:59 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1543 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:51:59.732597 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-7b35ba84-3469-43b9-88ce-ed4e1a35acc9 req-5943ae41-9014-4892-be27-a133a7d4d763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5531e5-b13c-4c68-98af-74a7ccfd7bcf", "tag": "0e6f8026-1053-415c-a2ed-d86d3cb58b07"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:51:59.746575 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-7b35ba84-3469-43b9-88ce-ed4e1a35acc9 req-5943ae41-9014-4892-be27-a133a7d4d763 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:59.747273 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-7b35ba84-3469-43b9-88ce-ed4e1a35acc9 req-5943ae41-9014-4892-be27-a133a7d4d763 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:59.762420 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-7b35ba84-3469-43b9-88ce-ed4e1a35acc9 req-5943ae41-9014-4892-be27-a133a7d4d763 service nova] Creating event network-changed:0e6f8026-1053-415c-a2ed-d86d3cb58b07 for instance ed5531e5-b13c-4c68-98af-74a7ccfd7bcf on nch2-master-1 Mar 12 20:51:59.768502 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-7b35ba84-3469-43b9-88ce-ed4e1a35acc9 req-5943ae41-9014-4892-be27-a133a7d4d763 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060622 Mar 12 20:51:59.769670 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 607/1363] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:51:59.795846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2343dbaa-746a-4fda-b0bc-35b1a5df7fbb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:59.797228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2343dbaa-746a-4fda-b0bc-35b1a5df7fbb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:59.833528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2343dbaa-746a-4fda-b0bc-35b1a5df7fbb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:59.834445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2343dbaa-746a-4fda-b0bc-35b1a5df7fbb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:59.835542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2343dbaa-746a-4fda-b0bc-35b1a5df7fbb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:59.837596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2343dbaa-746a-4fda-b0bc-35b1a5df7fbb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:59.933494 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7033aebe-a95a-40ca-a57b-29066b3f8400 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:51:59.934606 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7033aebe-a95a-40ca-a57b-29066b3f8400 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:51:59.956952 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7033aebe-a95a-40ca-a57b-29066b3f8400 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:59.957898 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7033aebe-a95a-40ca-a57b-29066b3f8400 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:51:59.961085 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7033aebe-a95a-40ca-a57b-29066b3f8400 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:51:59.963798 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7033aebe-a95a-40ca-a57b-29066b3f8400 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:00.709245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2343dbaa-746a-4fda-b0bc-35b1a5df7fbb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:00.730438 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7033aebe-a95a-40ca-a57b-29066b3f8400 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:00.738803 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7033aebe-a95a-40ca-a57b-29066b3f8400 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1277 microversion: 2.1 time: 0.809533 Mar 12 20:52:00.743254 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 608/1364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:51:59 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1277 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:52:00.753875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2343dbaa-746a-4fda-b0bc-35b1a5df7fbb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:00.755409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2343dbaa-746a-4fda-b0bc-35b1a5df7fbb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:00.758699 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2343dbaa-746a-4fda-b0bc-35b1a5df7fbb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1280 microversion: 2.25 time: 0.967451 Mar 12 20:52:00.762576 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 757/1365] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:51:59 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1280 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:00.775497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ac84dae-6b87-43a5-bf2f-c34566f0af35 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e3708ae50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:00.777228 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a0936056-74a2-4aee-9144-082a4f25c322 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:00.779361 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a0936056-74a2-4aee-9144-082a4f25c322 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:00.810997 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a0936056-74a2-4aee-9144-082a4f25c322 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:00.819322 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a0936056-74a2-4aee-9144-082a4f25c322 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:00.823561 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a0936056-74a2-4aee-9144-082a4f25c322 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:00.826425 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a0936056-74a2-4aee-9144-082a4f25c322 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:00.845486 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ac84dae-6b87-43a5-bf2f-c34566f0af35 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.081244 Mar 12 20:52:00.850720 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 758/1366] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:00 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:00.864183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-24e5e058-208d-4ea6-930d-6ab1f3d848f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:00.866760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-24e5e058-208d-4ea6-930d-6ab1f3d848f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:00.885895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24e5e058-208d-4ea6-930d-6ab1f3d848f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:00.889346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24e5e058-208d-4ea6-930d-6ab1f3d848f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:00.893111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24e5e058-208d-4ea6-930d-6ab1f3d848f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:00.895949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24e5e058-208d-4ea6-930d-6ab1f3d848f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:01.398973 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a0936056-74a2-4aee-9144-082a4f25c322 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:01.412876 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a0936056-74a2-4aee-9144-082a4f25c322 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1199 microversion: 2.1 time: 0.665845 Mar 12 20:52:01.414786 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 609/1367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:00 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1199 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:01.687155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-24e5e058-208d-4ea6-930d-6ab1f3d848f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:01.693165 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-24e5e058-208d-4ea6-930d-6ab1f3d848f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1543 microversion: 2.1 time: 0.839707 Mar 12 20:52:01.694076 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 759/1368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:00 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1543 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:01.772695 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5688abd5-ac16-46fd-9765-969eb9883f9c tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:01.774658 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5688abd5-ac16-46fd-9765-969eb9883f9c tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:01.786178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c2e82b66-9b23-4958-86f1-843e83225315 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:01.786832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c2e82b66-9b23-4958-86f1-843e83225315 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:01.794059 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5688abd5-ac16-46fd-9765-969eb9883f9c tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:01.794551 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5688abd5-ac16-46fd-9765-969eb9883f9c tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:01.798468 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5688abd5-ac16-46fd-9765-969eb9883f9c tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:01.798698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2e82b66-9b23-4958-86f1-843e83225315 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:01.798983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2e82b66-9b23-4958-86f1-843e83225315 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:01.799122 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5688abd5-ac16-46fd-9765-969eb9883f9c tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:01.799799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2e82b66-9b23-4958-86f1-843e83225315 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:01.805135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2e82b66-9b23-4958-86f1-843e83225315 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:01.936523 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5688abd5-ac16-46fd-9765-969eb9883f9c tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:01.960291 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5688abd5-ac16-46fd-9765-969eb9883f9c tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1275 microversion: 2.1 time: 0.204099 Mar 12 20:52:01.961453 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 610/1369] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:01 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:01.966387 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4de4642a-9527-4f10-a900-3eb0b3ad5775 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f73820>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:02.023406 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4de4642a-9527-4f10-a900-3eb0b3ad5775 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.054264 Mar 12 20:52:02.023406 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 611/1370] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:01 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:02.281232 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-b4aa6de8-f300-4623-8c7d-6a52b6c69ac1 req-1522ef61-67cc-46cb-951a-c06eb09f5543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce767e86-64a8-47b9-bae8-145d5819b6d9", "tag": "bd88fe22-49b2-448f-9a9c-b38f6c74e1ba"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:02.315346 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-b4aa6de8-f300-4623-8c7d-6a52b6c69ac1 req-1522ef61-67cc-46cb-951a-c06eb09f5543 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:02.320718 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-b4aa6de8-f300-4623-8c7d-6a52b6c69ac1 req-1522ef61-67cc-46cb-951a-c06eb09f5543 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:02.352800 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-b4aa6de8-f300-4623-8c7d-6a52b6c69ac1 req-1522ef61-67cc-46cb-951a-c06eb09f5543 service nova] Creating event network-changed:bd88fe22-49b2-448f-9a9c-b38f6c74e1ba for instance ce767e86-64a8-47b9-bae8-145d5819b6d9 on nch2-master-1 Mar 12 20:52:02.362307 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-b4aa6de8-f300-4623-8c7d-6a52b6c69ac1 req-1522ef61-67cc-46cb-951a-c06eb09f5543 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088898 Mar 12 20:52:02.364008 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 612/1371] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:02.443517 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-724d831a-8461-483d-907f-672997f107eb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:02.445440 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-724d831a-8461-483d-907f-672997f107eb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:02.465707 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-724d831a-8461-483d-907f-672997f107eb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:02.467658 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-724d831a-8461-483d-907f-672997f107eb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:02.468665 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-724d831a-8461-483d-907f-672997f107eb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:02.470375 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-724d831a-8461-483d-907f-672997f107eb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:02.747170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c2e82b66-9b23-4958-86f1-843e83225315 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:02.762059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c2e82b66-9b23-4958-86f1-843e83225315 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:02.764650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c2e82b66-9b23-4958-86f1-843e83225315 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:02.771780 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c2e82b66-9b23-4958-86f1-843e83225315 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1280 microversion: 2.25 time: 0.990015 Mar 12 20:52:02.778873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 760/1372] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:01 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1280 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:02.796959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-309cecb7-202e-4048-94be-568fb0f4b5d8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:02.803413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-309cecb7-202e-4048-94be-568fb0f4b5d8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:02.833880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-309cecb7-202e-4048-94be-568fb0f4b5d8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:02.838868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-309cecb7-202e-4048-94be-568fb0f4b5d8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:02.839790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-309cecb7-202e-4048-94be-568fb0f4b5d8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:02.840254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-309cecb7-202e-4048-94be-568fb0f4b5d8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:02.913144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-309cecb7-202e-4048-94be-568fb0f4b5d8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lazy-loading 'flavor' on Instance uuid 5ae82842-58a0-4d5e-a522-a1c83c53e101 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:52:03.309575 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-724d831a-8461-483d-907f-672997f107eb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:03.357075 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-724d831a-8461-483d-907f-672997f107eb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1199 microversion: 2.1 time: 0.900911 Mar 12 20:52:03.359146 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 613/1373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:02 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1199 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:03.384260 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d6d3e2e2-815d-43b4-aa19-f6ffeb588489 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:03.389523 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d6d3e2e2-815d-43b4-aa19-f6ffeb588489 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:03.412465 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d6d3e2e2-815d-43b4-aa19-f6ffeb588489 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:03.414391 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d6d3e2e2-815d-43b4-aa19-f6ffeb588489 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:03.417217 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d6d3e2e2-815d-43b4-aa19-f6ffeb588489 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:03.418864 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d6d3e2e2-815d-43b4-aa19-f6ffeb588489 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:03.507962 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-309cecb7-202e-4048-94be-568fb0f4b5d8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "POST /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/action" status: 202 len: 0 microversion: 2.20 time: 0.717044 Mar 12 20:52:03.509886 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 761/1374] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 20:52:02 2022] POST /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/action => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:52:03.523127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-65adb512-a93b-4214-ba8f-c73d782f9bf7 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e370d9670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:03.623261 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-65adb512-a93b-4214-ba8f-c73d782f9bf7 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.108945 Mar 12 20:52:03.624152 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 762/1375] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:03 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:03.634147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7907c0c-7054-4c2b-8b6d-95b23830cd11 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:03.635736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e7907c0c-7054-4c2b-8b6d-95b23830cd11 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:03.660707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7907c0c-7054-4c2b-8b6d-95b23830cd11 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:03.661680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7907c0c-7054-4c2b-8b6d-95b23830cd11 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:03.662849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7907c0c-7054-4c2b-8b6d-95b23830cd11 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:03.663775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7907c0c-7054-4c2b-8b6d-95b23830cd11 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:04.080332 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d6d3e2e2-815d-43b4-aa19-f6ffeb588489 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:04.090407 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d6d3e2e2-815d-43b4-aa19-f6ffeb588489 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1543 microversion: 2.1 time: 0.725599 Mar 12 20:52:04.092797 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 614/1376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:03 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1543 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:04.098349 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-615ecabf-6472-4af5-9f5f-d850b08cafc5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:04.099562 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-615ecabf-6472-4af5-9f5f-d850b08cafc5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:04.106831 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-615ecabf-6472-4af5-9f5f-d850b08cafc5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:04.107610 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-615ecabf-6472-4af5-9f5f-d850b08cafc5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:04.109523 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-615ecabf-6472-4af5-9f5f-d850b08cafc5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:04.111490 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-615ecabf-6472-4af5-9f5f-d850b08cafc5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:04.376363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e7907c0c-7054-4c2b-8b6d-95b23830cd11 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:04.395093 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e7907c0c-7054-4c2b-8b6d-95b23830cd11 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1317 microversion: 2.1 time: 0.767801 Mar 12 20:52:04.395932 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 763/1377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:03 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1317 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:04.400684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a5d152e6-7833-466a-a06e-f533cb965510 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:04.401514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a5d152e6-7833-466a-a06e-f533cb965510 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:04.414824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5d152e6-7833-466a-a06e-f533cb965510 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:04.415478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5d152e6-7833-466a-a06e-f533cb965510 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:04.416447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5d152e6-7833-466a-a06e-f533cb965510 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:04.417086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5d152e6-7833-466a-a06e-f533cb965510 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:04.470775 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-615ecabf-6472-4af5-9f5f-d850b08cafc5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:04.494021 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-615ecabf-6472-4af5-9f5f-d850b08cafc5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:04.498090 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-615ecabf-6472-4af5-9f5f-d850b08cafc5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:04.511635 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-615ecabf-6472-4af5-9f5f-d850b08cafc5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1723 microversion: 2.20 time: 0.417109 Mar 12 20:52:04.514995 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 615/1378] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:04 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:04.528119 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-73e3f911-b7c9-4557-8e21-448cc5b5ed34 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:04.529972 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-73e3f911-b7c9-4557-8e21-448cc5b5ed34 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:04.547125 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73e3f911-b7c9-4557-8e21-448cc5b5ed34 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:04.553239 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73e3f911-b7c9-4557-8e21-448cc5b5ed34 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:04.554489 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73e3f911-b7c9-4557-8e21-448cc5b5ed34 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:04.555312 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73e3f911-b7c9-4557-8e21-448cc5b5ed34 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:05.007874 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-73e3f911-b7c9-4557-8e21-448cc5b5ed34 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:05.019480 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-73e3f911-b7c9-4557-8e21-448cc5b5ed34 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1199 microversion: 2.1 time: 0.503008 Mar 12 20:52:05.021514 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 616/1379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:04 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1199 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:05.048033 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ca93c71a-d5cd-438e-9c98-a8213a3fd417 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f451f0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:05.134745 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ca93c71a-d5cd-438e-9c98-a8213a3fd417 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.111850 Mar 12 20:52:05.135264 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 617/1380] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:05 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:05.145265 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-3682744c-dbb0-475d-b48a-0cb3c2071418 req-3e620c23-d439-4500-a736-1a28c124b7cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a01d27-42ab-4258-be66-a86606d977d6", "tag": "fb9ee1ae-e3ac-4632-96cb-7591d2fde26d"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:05.166786 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-3682744c-dbb0-475d-b48a-0cb3c2071418 req-3e620c23-d439-4500-a736-1a28c124b7cd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:05.167272 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-3682744c-dbb0-475d-b48a-0cb3c2071418 req-3e620c23-d439-4500-a736-1a28c124b7cd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:05.258605 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-3682744c-dbb0-475d-b48a-0cb3c2071418 req-3e620c23-d439-4500-a736-1a28c124b7cd service nova] Creating event network-changed:fb9ee1ae-e3ac-4632-96cb-7591d2fde26d for instance b1a01d27-42ab-4258-be66-a86606d977d6 on nch2-master-1 Mar 12 20:52:05.287578 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-3682744c-dbb0-475d-b48a-0cb3c2071418 req-3e620c23-d439-4500-a736-1a28c124b7cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150874 Mar 12 20:52:05.289739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a5d152e6-7833-466a-a06e-f533cb965510 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:05.293302 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 618/1381] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:05.301931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a5d152e6-7833-466a-a06e-f533cb965510 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:05.303656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a5d152e6-7833-466a-a06e-f533cb965510 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:05.304828 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a5d152e6-7833-466a-a06e-f533cb965510 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1280 microversion: 2.25 time: 0.907791 Mar 12 20:52:05.305464 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 764/1382] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:04 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1280 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:05.308309 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-de112dd3-21f8-42d0-9198-46382ff63662 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:05.309225 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-de112dd3-21f8-42d0-9198-46382ff63662 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:05.318692 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de112dd3-21f8-42d0-9198-46382ff63662 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:05.319196 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de112dd3-21f8-42d0-9198-46382ff63662 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:05.319958 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de112dd3-21f8-42d0-9198-46382ff63662 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:05.320634 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-de112dd3-21f8-42d0-9198-46382ff63662 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:05.412098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-372b42f3-aaea-4586-9515-efb2945b1ecf tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:05.412727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-372b42f3-aaea-4586-9515-efb2945b1ecf tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:05.423350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-372b42f3-aaea-4586-9515-efb2945b1ecf tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:05.430717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-372b42f3-aaea-4586-9515-efb2945b1ecf tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:05.436558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-372b42f3-aaea-4586-9515-efb2945b1ecf tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:05.441212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-372b42f3-aaea-4586-9515-efb2945b1ecf tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:05.583072 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-de112dd3-21f8-42d0-9198-46382ff63662 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:05.592526 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-de112dd3-21f8-42d0-9198-46382ff63662 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1543 microversion: 2.1 time: 0.297767 Mar 12 20:52:05.593173 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 619/1383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:05 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1543 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:05.611461 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-39641fc2-cc6d-40c4-8011-538d1e2e6375 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:05.613669 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-39641fc2-cc6d-40c4-8011-538d1e2e6375 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:05.627188 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-39641fc2-cc6d-40c4-8011-538d1e2e6375 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:05.627656 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-39641fc2-cc6d-40c4-8011-538d1e2e6375 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:05.636595 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-39641fc2-cc6d-40c4-8011-538d1e2e6375 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:05.637107 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-39641fc2-cc6d-40c4-8011-538d1e2e6375 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:05.917325 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-39641fc2-cc6d-40c4-8011-538d1e2e6375 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:05.936816 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-39641fc2-cc6d-40c4-8011-538d1e2e6375 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:05.940555 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-39641fc2-cc6d-40c4-8011-538d1e2e6375 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:05.946203 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-39641fc2-cc6d-40c4-8011-538d1e2e6375 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1723 microversion: 2.20 time: 0.351875 Mar 12 20:52:05.947130 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 620/1384] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:05 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:06.040609 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0b7e0f05-2d17-4944-8dbb-d9cb3bcb69bb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:06.040609 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-0b7e0f05-2d17-4944-8dbb-d9cb3bcb69bb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:06.048838 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0b7e0f05-2d17-4944-8dbb-d9cb3bcb69bb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:06.050111 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0b7e0f05-2d17-4944-8dbb-d9cb3bcb69bb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:06.050943 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0b7e0f05-2d17-4944-8dbb-d9cb3bcb69bb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:06.051392 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0b7e0f05-2d17-4944-8dbb-d9cb3bcb69bb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:06.386654 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-0b7e0f05-2d17-4944-8dbb-d9cb3bcb69bb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:06.404291 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0b7e0f05-2d17-4944-8dbb-d9cb3bcb69bb tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1199 microversion: 2.1 time: 0.371589 Mar 12 20:52:06.405032 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 621/1385] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:06 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1199 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:52:06.416099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-372b42f3-aaea-4586-9515-efb2945b1ecf tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:06.425009 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-372b42f3-aaea-4586-9515-efb2945b1ecf tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1317 microversion: 2.1 time: 1.016783 Mar 12 20:52:06.428602 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 765/1386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:05 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1317 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:52:06.438330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c99ed611-bf9b-47e3-ad3f-de6bbad44689 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:06.439367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c99ed611-bf9b-47e3-ad3f-de6bbad44689 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:06.446489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c99ed611-bf9b-47e3-ad3f-de6bbad44689 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:06.447320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c99ed611-bf9b-47e3-ad3f-de6bbad44689 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:06.448354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c99ed611-bf9b-47e3-ad3f-de6bbad44689 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:06.449024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c99ed611-bf9b-47e3-ad3f-de6bbad44689 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:06.450806 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-374c2c93-5bfa-4a33-bf32-4614c01c9bcd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f220d0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:06.549025 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-374c2c93-5bfa-4a33-bf32-4614c01c9bcd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.127411 Mar 12 20:52:06.551682 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 622/1387] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:06 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:06.612955 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-97b1f1ad-ad70-47a1-931b-7f396a4b80f5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:06.613725 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-97b1f1ad-ad70-47a1-931b-7f396a4b80f5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:06.620808 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-97b1f1ad-ad70-47a1-931b-7f396a4b80f5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:06.627907 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-97b1f1ad-ad70-47a1-931b-7f396a4b80f5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:06.629231 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-97b1f1ad-ad70-47a1-931b-7f396a4b80f5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:06.629830 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-97b1f1ad-ad70-47a1-931b-7f396a4b80f5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:07.032397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c99ed611-bf9b-47e3-ad3f-de6bbad44689 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:07.050605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c99ed611-bf9b-47e3-ad3f-de6bbad44689 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:07.052825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c99ed611-bf9b-47e3-ad3f-de6bbad44689 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:07.054884 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c99ed611-bf9b-47e3-ad3f-de6bbad44689 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1280 microversion: 2.25 time: 0.624779 Mar 12 20:52:07.071841 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 766/1388] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:06 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1280 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:07.081280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa06b84f-6fab-40fd-955c-5206a5e80db0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:07.082357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aa06b84f-6fab-40fd-955c-5206a5e80db0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:07.093719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa06b84f-6fab-40fd-955c-5206a5e80db0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:07.095926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa06b84f-6fab-40fd-955c-5206a5e80db0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:07.098980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa06b84f-6fab-40fd-955c-5206a5e80db0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:07.104548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa06b84f-6fab-40fd-955c-5206a5e80db0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:07.113186 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-97b1f1ad-ad70-47a1-931b-7f396a4b80f5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:07.129225 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-97b1f1ad-ad70-47a1-931b-7f396a4b80f5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1543 microversion: 2.1 time: 0.512609 Mar 12 20:52:07.130270 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 623/1389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:06 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1543 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:52:07.572117 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1783932864", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:07.649612 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.neutron [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] validate_networks() for None {{(pid=136303) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:52:07.961545 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:52:07.961698 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:52:07.962120 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:52:07.962541 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:52:07.962966 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:52:07.976841 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:07.977560 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:07.978741 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:07.979354 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:08.001239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aa06b84f-6fab-40fd-955c-5206a5e80db0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:08.019039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aa06b84f-6fab-40fd-955c-5206a5e80db0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:08.020757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aa06b84f-6fab-40fd-955c-5206a5e80db0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:08.022171 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aa06b84f-6fab-40fd-955c-5206a5e80db0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1723 microversion: 2.20 time: 0.948384 Mar 12 20:52:08.027044 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 767/1390] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:07 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1723 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:08.029070 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Getting quotas for project fdb3e4f8854b4ae9b4bba6d166d6a514. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:52:08.046525 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Getting quotas for user 95f8d44de34e49b9b99622fb76159ab9 and project fdb3e4f8854b4ae9b4bba6d166d6a514. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:52:08.049440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27b87ef1-4f70-4f5e-82da-cee9d5f24892 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:08.050700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27b87ef1-4f70-4f5e-82da-cee9d5f24892 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:08.073157 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Going to run 1 instances... {{(pid=136303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:52:08.075465 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:52:08.079203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27b87ef1-4f70-4f5e-82da-cee9d5f24892 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:08.082625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27b87ef1-4f70-4f5e-82da-cee9d5f24892 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:08.085665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27b87ef1-4f70-4f5e-82da-cee9d5f24892 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:08.090470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27b87ef1-4f70-4f5e-82da-cee9d5f24892 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:08.166878 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e17e683c-dd75-4f5a-a129-cce6fb3504e3 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757830 Mar 12 20:52:08.173145 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 624/1391] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:52:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:52:08.186226 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-db19fe8a-429c-4386-b56a-4836403228c0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:08.187283 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-db19fe8a-429c-4386-b56a-4836403228c0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:08.200545 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-db19fe8a-429c-4386-b56a-4836403228c0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:08.202860 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-db19fe8a-429c-4386-b56a-4836403228c0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:08.203887 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-db19fe8a-429c-4386-b56a-4836403228c0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:08.204341 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-db19fe8a-429c-4386-b56a-4836403228c0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:08.531618 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-db19fe8a-429c-4386-b56a-4836403228c0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:08.541470 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-db19fe8a-429c-4386-b56a-4836403228c0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1317 microversion: 2.1 time: 0.366309 Mar 12 20:52:08.542370 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 625/1392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:08 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:08.548909 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-98183e31-3297-4852-a047-7fa7673b4bee tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36f0f310>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:08.683292 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-98183e31-3297-4852-a047-7fa7673b4bee tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.138542 Mar 12 20:52:08.685963 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 626/1393] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:08 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:08.727693 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-0bd03dbe-0298-441c-90d3-04fb9bb2c4a1 req-d66d5afa-7fb7-41c0-ac9c-b90b824a2356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e67993b-4604-4f37-9543-3dc09be802e5", "name": "network-vif-unplugged", "status": "completed", "tag": "3abbe775-9508-422a-826d-d481a507a318"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:08.744831 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-0bd03dbe-0298-441c-90d3-04fb9bb2c4a1 req-d66d5afa-7fb7-41c0-ac9c-b90b824a2356 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:08.748138 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-0bd03dbe-0298-441c-90d3-04fb9bb2c4a1 req-d66d5afa-7fb7-41c0-ac9c-b90b824a2356 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:08.786961 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-0bd03dbe-0298-441c-90d3-04fb9bb2c4a1 req-d66d5afa-7fb7-41c0-ac9c-b90b824a2356 service nova] Creating event network-vif-unplugged:3abbe775-9508-422a-826d-d481a507a318 for instance 8e67993b-4604-4f37-9543-3dc09be802e5 on nch2-master-1 Mar 12 20:52:08.803172 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [req-0bd03dbe-0298-441c-90d3-04fb9bb2c4a1 req-d66d5afa-7fb7-41c0-ac9c-b90b824a2356 service nova] Instance 8e67993b-4604-4f37-9543-3dc09be802e5 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:52:08.841101 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-0bd03dbe-0298-441c-90d3-04fb9bb2c4a1 req-d66d5afa-7fb7-41c0-ac9c-b90b824a2356 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150252 Mar 12 20:52:08.844982 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 627/1394] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:08.859140 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3fd0fe83-481b-438e-9aa6-c971264beb31 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:08.864104 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3fd0fe83-481b-438e-9aa6-c971264beb31 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:08.883743 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3fd0fe83-481b-438e-9aa6-c971264beb31 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:08.885313 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3fd0fe83-481b-438e-9aa6-c971264beb31 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:08.887512 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3fd0fe83-481b-438e-9aa6-c971264beb31 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:08.887978 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3fd0fe83-481b-438e-9aa6-c971264beb31 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:09.322486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27b87ef1-4f70-4f5e-82da-cee9d5f24892 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:09.331765 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27b87ef1-4f70-4f5e-82da-cee9d5f24892 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1199 microversion: 2.1 time: 1.302344 Mar 12 20:52:09.334063 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 768/1395] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:08 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1199 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:09.340162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ed27fe0-3f8c-45da-81c3-ec5285ac9997 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:09.342658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ed27fe0-3f8c-45da-81c3-ec5285ac9997 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:09.359442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ed27fe0-3f8c-45da-81c3-ec5285ac9997 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:09.363616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ed27fe0-3f8c-45da-81c3-ec5285ac9997 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:09.364691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ed27fe0-3f8c-45da-81c3-ec5285ac9997 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:09.366143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ed27fe0-3f8c-45da-81c3-ec5285ac9997 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:09.491897 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3fd0fe83-481b-438e-9aa6-c971264beb31 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:09.506906 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3fd0fe83-481b-438e-9aa6-c971264beb31 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:09.508669 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-3fd0fe83-481b-438e-9aa6-c971264beb31 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:09.509937 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3fd0fe83-481b-438e-9aa6-c971264beb31 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1280 microversion: 2.25 time: 0.662609 Mar 12 20:52:09.510737 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 628/1396] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:08 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1280 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:09.517036 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-58a093f5-6f5d-4810-ab0c-70743073bf29 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:09.518418 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-58a093f5-6f5d-4810-ab0c-70743073bf29 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:09.530519 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-58a093f5-6f5d-4810-ab0c-70743073bf29 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:09.531097 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-58a093f5-6f5d-4810-ab0c-70743073bf29 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:09.532330 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-58a093f5-6f5d-4810-ab0c-70743073bf29 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:09.532812 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-58a093f5-6f5d-4810-ab0c-70743073bf29 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:10.038988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6ed27fe0-3f8c-45da-81c3-ec5285ac9997 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:10.058504 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ed27fe0-3f8c-45da-81c3-ec5285ac9997 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1542 microversion: 2.1 time: 0.721883 Mar 12 20:52:10.072689 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 769/1397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:09 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1542 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:10.077966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f7043fb-d793-4347-9891-8901a52f56e0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:10.079492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f7043fb-d793-4347-9891-8901a52f56e0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:10.086918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f7043fb-d793-4347-9891-8901a52f56e0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:10.087643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f7043fb-d793-4347-9891-8901a52f56e0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:10.088607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f7043fb-d793-4347-9891-8901a52f56e0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:10.089044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f7043fb-d793-4347-9891-8901a52f56e0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:10.148609 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-58a093f5-6f5d-4810-ab0c-70743073bf29 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:10.166249 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-58a093f5-6f5d-4810-ab0c-70743073bf29 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 200 len: 1272 microversion: 2.1 time: 0.649636 Mar 12 20:52:10.167157 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 629/1398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:09 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 1272 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:10.174038 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-7bfe3f80-694c-4a29-9c2a-d0785af86c52 req-294c89aa-524b-4961-9fb4-831d257b3a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5531e5-b13c-4c68-98af-74a7ccfd7bcf", "name": "network-vif-plugged", "status": "completed", "tag": "0e6f8026-1053-415c-a2ed-d86d3cb58b07"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:10.206252 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-7bfe3f80-694c-4a29-9c2a-d0785af86c52 req-294c89aa-524b-4961-9fb4-831d257b3a09 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:10.208697 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-7bfe3f80-694c-4a29-9c2a-d0785af86c52 req-294c89aa-524b-4961-9fb4-831d257b3a09 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:10.235113 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-7bfe3f80-694c-4a29-9c2a-d0785af86c52 req-294c89aa-524b-4961-9fb4-831d257b3a09 service nova] Creating event network-vif-plugged:0e6f8026-1053-415c-a2ed-d86d3cb58b07 for instance ed5531e5-b13c-4c68-98af-74a7ccfd7bcf on nch2-master-1 Mar 12 20:52:10.245095 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-7bfe3f80-694c-4a29-9c2a-d0785af86c52 req-294c89aa-524b-4961-9fb4-831d257b3a09 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076491 Mar 12 20:52:10.263064 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 630/1399] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:10.281537 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-10ed855a-44fc-4039-80ee-825463fdf596 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:10.293759 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-10ed855a-44fc-4039-80ee-825463fdf596 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:10.311519 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10ed855a-44fc-4039-80ee-825463fdf596 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:10.311991 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10ed855a-44fc-4039-80ee-825463fdf596 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:10.319633 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10ed855a-44fc-4039-80ee-825463fdf596 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:10.320418 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-10ed855a-44fc-4039-80ee-825463fdf596 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:10.867142 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-10ed855a-44fc-4039-80ee-825463fdf596 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:10.891801 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-10ed855a-44fc-4039-80ee-825463fdf596 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1317 microversion: 2.1 time: 0.622522 Mar 12 20:52:10.893658 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 631/1400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:10 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:10.907448 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-305f1b31-f6ca-4379-8598-d3f501a909d7 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e370c5790>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:11.001115 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-305f1b31-f6ca-4379-8598-d3f501a909d7 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1412 microversion: 2.1 time: 0.105394 Mar 12 20:52:11.002175 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 632/1401] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:10 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:11.014727 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d9f2c988-7d37-434e-b6a3-defe24e7770d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:11.015945 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d9f2c988-7d37-434e-b6a3-defe24e7770d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:11.033739 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d9f2c988-7d37-434e-b6a3-defe24e7770d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:11.034827 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d9f2c988-7d37-434e-b6a3-defe24e7770d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:11.036017 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d9f2c988-7d37-434e-b6a3-defe24e7770d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:11.036633 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d9f2c988-7d37-434e-b6a3-defe24e7770d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:11.211213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f7043fb-d793-4347-9891-8901a52f56e0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:11.238214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f7043fb-d793-4347-9891-8901a52f56e0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:11.248703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f7043fb-d793-4347-9891-8901a52f56e0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:11.264148 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f7043fb-d793-4347-9891-8901a52f56e0 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1723 microversion: 2.20 time: 1.189961 Mar 12 20:52:11.265090 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 770/1402] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:10 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1723 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:11.288496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-756051b7-f381-40d1-a675-619146937c8c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:11.298829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-756051b7-f381-40d1-a675-619146937c8c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:11.319809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-756051b7-f381-40d1-a675-619146937c8c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:11.324633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-756051b7-f381-40d1-a675-619146937c8c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:11.335250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-756051b7-f381-40d1-a675-619146937c8c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:11.337616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-756051b7-f381-40d1-a675-619146937c8c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:11.684495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-756051b7-f381-40d1-a675-619146937c8c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:11.698540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-756051b7-f381-40d1-a675-619146937c8c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:11.709869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-756051b7-f381-40d1-a675-619146937c8c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:11.712422 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-756051b7-f381-40d1-a675-619146937c8c tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1280 microversion: 2.25 time: 0.440124 Mar 12 20:52:11.713320 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 771/1403] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:11 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1280 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:11.719827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-02c4a446-8881-4bca-8876-46cfc58c2a21 req-458a8970-8c2e-4c3c-8816-16fa071479a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e67993b-4604-4f37-9543-3dc09be802e5", "tag": "3abbe775-9508-422a-826d-d481a507a318"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:11.730364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-02c4a446-8881-4bca-8876-46cfc58c2a21 req-458a8970-8c2e-4c3c-8816-16fa071479a3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:11.731109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-02c4a446-8881-4bca-8876-46cfc58c2a21 req-458a8970-8c2e-4c3c-8816-16fa071479a3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:11.746442 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-02c4a446-8881-4bca-8876-46cfc58c2a21 req-458a8970-8c2e-4c3c-8816-16fa071479a3 service nova] Creating event network-changed:3abbe775-9508-422a-826d-d481a507a318 for instance 8e67993b-4604-4f37-9543-3dc09be802e5 on nch2-master-1 Mar 12 20:52:11.754239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-02c4a446-8881-4bca-8876-46cfc58c2a21 req-458a8970-8c2e-4c3c-8816-16fa071479a3 service nova] Instance 8e67993b-4604-4f37-9543-3dc09be802e5 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:52:11.774073 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-02c4a446-8881-4bca-8876-46cfc58c2a21 req-458a8970-8c2e-4c3c-8816-16fa071479a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057907 Mar 12 20:52:11.776272 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 772/1404] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:11.783881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14dffde8-eb02-408f-936a-fc28e53fe23d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:11.785675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14dffde8-eb02-408f-936a-fc28e53fe23d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:11.793496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14dffde8-eb02-408f-936a-fc28e53fe23d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:11.793983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14dffde8-eb02-408f-936a-fc28e53fe23d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:11.795754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14dffde8-eb02-408f-936a-fc28e53fe23d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:11.796570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14dffde8-eb02-408f-936a-fc28e53fe23d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:11.836714 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d9f2c988-7d37-434e-b6a3-defe24e7770d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:11.846148 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d9f2c988-7d37-434e-b6a3-defe24e7770d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1199 microversion: 2.1 time: 0.842626 Mar 12 20:52:11.850335 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 633/1405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:11 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1199 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:11.855514 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ef60832a-7419-4ec0-b8d8-b892498f54bd tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:11.856294 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ef60832a-7419-4ec0-b8d8-b892498f54bd tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:11.864831 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef60832a-7419-4ec0-b8d8-b892498f54bd tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:11.866164 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef60832a-7419-4ec0-b8d8-b892498f54bd tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:11.867004 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef60832a-7419-4ec0-b8d8-b892498f54bd tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:11.867455 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ef60832a-7419-4ec0-b8d8-b892498f54bd tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:12.365553 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ef60832a-7419-4ec0-b8d8-b892498f54bd tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:12.384350 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ef60832a-7419-4ec0-b8d8-b892498f54bd tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 200 len: 1320 microversion: 2.1 time: 0.528800 Mar 12 20:52:12.385875 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 634/1406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:11 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 1320 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:12.394059 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-eb7d1b38-ccb2-4384-a8f7-5bbd6991f692 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:12.395113 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-eb7d1b38-ccb2-4384-a8f7-5bbd6991f692 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:12.405457 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-eb7d1b38-ccb2-4384-a8f7-5bbd6991f692 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:12.406366 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-eb7d1b38-ccb2-4384-a8f7-5bbd6991f692 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:12.407536 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-eb7d1b38-ccb2-4384-a8f7-5bbd6991f692 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:12.408162 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-eb7d1b38-ccb2-4384-a8f7-5bbd6991f692 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:12.459893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14dffde8-eb02-408f-936a-fc28e53fe23d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:12.486201 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14dffde8-eb02-408f-936a-fc28e53fe23d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1474 microversion: 2.1 time: 0.707202 Mar 12 20:52:12.496682 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 773/1407] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:11 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1474 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:12.509156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c60b18ae-c290-45ce-bcf7-b7efb8db4cca tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e3725e040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:12.603493 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c60b18ae-c290-45ce-bcf7-b7efb8db4cca tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1421 microversion: 2.1 time: 0.105266 Mar 12 20:52:12.604676 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 774/1408] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:12 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1421 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:12.622915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a9440c7f-8583-4439-8abc-82d395b6be42 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:12.623559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a9440c7f-8583-4439-8abc-82d395b6be42 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:12.655459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9440c7f-8583-4439-8abc-82d395b6be42 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:12.656018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9440c7f-8583-4439-8abc-82d395b6be42 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:12.657664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9440c7f-8583-4439-8abc-82d395b6be42 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:12.658298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9440c7f-8583-4439-8abc-82d395b6be42 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:12.938706 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-eb7d1b38-ccb2-4384-a8f7-5bbd6991f692 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:12.954723 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-eb7d1b38-ccb2-4384-a8f7-5bbd6991f692 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1317 microversion: 2.1 time: 0.563174 Mar 12 20:52:12.955633 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 635/1409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:12 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:12.967674 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-da413bda-e77d-4a73-b63b-fce1a0c9d98d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36eca3a0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:13.032555 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-da413bda-e77d-4a73-b63b-fce1a0c9d98d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 200 len: 1421 microversion: 2.1 time: 0.074743 Mar 12 20:52:13.033661 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 636/1410] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:12 2022] GET /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 1421 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:13.038595 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4d5ebde5-bad1-4492-8171-3b008086e98b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:13.039414 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4d5ebde5-bad1-4492-8171-3b008086e98b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:13.047595 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4d5ebde5-bad1-4492-8171-3b008086e98b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:13.048079 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4d5ebde5-bad1-4492-8171-3b008086e98b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:13.048951 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4d5ebde5-bad1-4492-8171-3b008086e98b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:13.049403 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4d5ebde5-bad1-4492-8171-3b008086e98b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:13.269133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a9440c7f-8583-4439-8abc-82d395b6be42 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:13.285861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a9440c7f-8583-4439-8abc-82d395b6be42 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:13.289126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a9440c7f-8583-4439-8abc-82d395b6be42 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:13.293879 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a9440c7f-8583-4439-8abc-82d395b6be42 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1723 microversion: 2.20 time: 0.685138 Mar 12 20:52:13.297996 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 775/1411] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:12 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1723 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:13.311430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7fd3b690-798c-4eb3-9e02-1c58153c33b3 req-5a96b709-8462-4b5d-99f4-7d6a03784ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce767e86-64a8-47b9-bae8-145d5819b6d9", "name": "network-vif-plugged", "status": "completed", "tag": "bd88fe22-49b2-448f-9a9c-b38f6c74e1ba"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:13.335116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7fd3b690-798c-4eb3-9e02-1c58153c33b3 req-5a96b709-8462-4b5d-99f4-7d6a03784ced service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:13.336291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7fd3b690-798c-4eb3-9e02-1c58153c33b3 req-5a96b709-8462-4b5d-99f4-7d6a03784ced service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:13.395056 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7fd3b690-798c-4eb3-9e02-1c58153c33b3 req-5a96b709-8462-4b5d-99f4-7d6a03784ced service nova] Creating event network-vif-plugged:bd88fe22-49b2-448f-9a9c-b38f6c74e1ba for instance ce767e86-64a8-47b9-bae8-145d5819b6d9 on nch2-master-1 Mar 12 20:52:13.402298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7fd3b690-798c-4eb3-9e02-1c58153c33b3 req-5a96b709-8462-4b5d-99f4-7d6a03784ced service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102364 Mar 12 20:52:13.403888 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 776/1412] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:13.410291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75de1512-1f76-4c98-9c9e-93228f1d4f75 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:13.411337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75de1512-1f76-4c98-9c9e-93228f1d4f75 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:13.418089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75de1512-1f76-4c98-9c9e-93228f1d4f75 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:13.418962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75de1512-1f76-4c98-9c9e-93228f1d4f75 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:13.420124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75de1512-1f76-4c98-9c9e-93228f1d4f75 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:13.420899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75de1512-1f76-4c98-9c9e-93228f1d4f75 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:13.613340 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4d5ebde5-bad1-4492-8171-3b008086e98b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:13.628584 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4d5ebde5-bad1-4492-8171-3b008086e98b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:13.630849 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4d5ebde5-bad1-4492-8171-3b008086e98b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:13.633924 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4d5ebde5-bad1-4492-8171-3b008086e98b tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1476 microversion: 2.25 time: 0.599213 Mar 12 20:52:13.634746 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 637/1413] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:13 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1476 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:13.664832 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-eb6d25ad-f063-493b-ae8a-b8ed8240b7d2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36ef30d0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:14.018412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-75de1512-1f76-4c98-9c9e-93228f1d4f75 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:14.028366 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75de1512-1f76-4c98-9c9e-93228f1d4f75 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1199 microversion: 2.1 time: 0.622989 Mar 12 20:52:14.030460 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 777/1414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:13 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1199 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:14.042177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1381c042-04fe-4ec9-a29e-eb53e34072c9 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:14.044205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1381c042-04fe-4ec9-a29e-eb53e34072c9 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:14.061527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1381c042-04fe-4ec9-a29e-eb53e34072c9 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:14.064870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1381c042-04fe-4ec9-a29e-eb53e34072c9 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:14.073425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1381c042-04fe-4ec9-a29e-eb53e34072c9 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:14.074227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1381c042-04fe-4ec9-a29e-eb53e34072c9 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:14.489504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1381c042-04fe-4ec9-a29e-eb53e34072c9 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:14.499938 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1381c042-04fe-4ec9-a29e-eb53e34072c9 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 200 len: 1320 microversion: 2.1 time: 0.468414 Mar 12 20:52:14.500551 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 778/1415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:14 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:14.509817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-29a4581b-ac35-46b9-a867-34cc73f904c4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:14.514503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-29a4581b-ac35-46b9-a867-34cc73f904c4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:14.527714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29a4581b-ac35-46b9-a867-34cc73f904c4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:14.530043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29a4581b-ac35-46b9-a867-34cc73f904c4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:14.536101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29a4581b-ac35-46b9-a867-34cc73f904c4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:14.537464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29a4581b-ac35-46b9-a867-34cc73f904c4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:14.854069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-29a4581b-ac35-46b9-a867-34cc73f904c4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:14.854548 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-eb6d25ad-f063-493b-ae8a-b8ed8240b7d2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 204 len: 0 microversion: 2.1 time: 1.218101 Mar 12 20:52:14.856318 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 638/1416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:13 2022] DELETE /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 0 bytes in 1221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:52:14.862621 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8fdf73be-63a1-4d50-bf28-56e322331840 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:14.864970 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8fdf73be-63a1-4d50-bf28-56e322331840 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:14.865964 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-29a4581b-ac35-46b9-a867-34cc73f904c4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1471 microversion: 2.1 time: 0.362041 Mar 12 20:52:14.866564 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 779/1417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:14 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1471 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:14.876180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2bba9c64-5383-49f7-8b07-053047060c58 req-08efefe6-c1e9-45a9-8927-5dbbbc6e6993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d342f2eb-8870-4132-be47-59361a46149f", "tag": "ad184f30-9c5b-4778-b03b-c7497cbb2350"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:14.880036 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8fdf73be-63a1-4d50-bf28-56e322331840 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:14.881210 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8fdf73be-63a1-4d50-bf28-56e322331840 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:14.883733 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8fdf73be-63a1-4d50-bf28-56e322331840 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:14.884470 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8fdf73be-63a1-4d50-bf28-56e322331840 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:14.893531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2bba9c64-5383-49f7-8b07-053047060c58 req-08efefe6-c1e9-45a9-8927-5dbbbc6e6993 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:14.896290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2bba9c64-5383-49f7-8b07-053047060c58 req-08efefe6-c1e9-45a9-8927-5dbbbc6e6993 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:14.923743 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2bba9c64-5383-49f7-8b07-053047060c58 req-08efefe6-c1e9-45a9-8927-5dbbbc6e6993 service nova] Creating event network-changed:ad184f30-9c5b-4778-b03b-c7497cbb2350 for instance d342f2eb-8870-4132-be47-59361a46149f on nch1-master-1 Mar 12 20:52:14.932820 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2bba9c64-5383-49f7-8b07-053047060c58 req-08efefe6-c1e9-45a9-8927-5dbbbc6e6993 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065022 Mar 12 20:52:14.937422 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 780/1418] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:14.949107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f17b4c65-658c-4052-a58b-88e29d41237f tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:14.952234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f17b4c65-658c-4052-a58b-88e29d41237f tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:14.968099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f17b4c65-658c-4052-a58b-88e29d41237f tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:14.968667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f17b4c65-658c-4052-a58b-88e29d41237f tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:14.972566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f17b4c65-658c-4052-a58b-88e29d41237f tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:14.973257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f17b4c65-658c-4052-a58b-88e29d41237f tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:15.380602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f17b4c65-658c-4052-a58b-88e29d41237f tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:15.390428 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f17b4c65-658c-4052-a58b-88e29d41237f tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1317 microversion: 2.1 time: 0.448367 Mar 12 20:52:15.403023 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 781/1419] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:14 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:15.409143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-898dbe9d-ce30-4d3c-9d3e-813f38ff8a58 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:15.410049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-898dbe9d-ce30-4d3c-9d3e-813f38ff8a58 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:15.419065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-898dbe9d-ce30-4d3c-9d3e-813f38ff8a58 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:15.419776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-898dbe9d-ce30-4d3c-9d3e-813f38ff8a58 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:15.421170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-898dbe9d-ce30-4d3c-9d3e-813f38ff8a58 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:15.421953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-898dbe9d-ce30-4d3c-9d3e-813f38ff8a58 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:15.487091 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-8fdf73be-63a1-4d50-bf28-56e322331840 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid ed5531e5-b13c-4c68-98af-74a7ccfd7bcf {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:52:15.528290 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8fdf73be-63a1-4d50-bf28-56e322331840 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1968 microversion: 2.25 time: 0.670353 Mar 12 20:52:15.538914 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 639/1420] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:14 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1968 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:15.555129 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9828f948-cb5a-4db9-ab31-1dae7c6bbd4d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:15.556253 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9828f948-cb5a-4db9-ab31-1dae7c6bbd4d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:15.569635 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9828f948-cb5a-4db9-ab31-1dae7c6bbd4d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:15.579038 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9828f948-cb5a-4db9-ab31-1dae7c6bbd4d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:15.582832 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9828f948-cb5a-4db9-ab31-1dae7c6bbd4d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:15.583582 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9828f948-cb5a-4db9-ab31-1dae7c6bbd4d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:15.649270 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9828f948-cb5a-4db9-ab31-1dae7c6bbd4d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:52:15.754214 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9828f948-cb5a-4db9-ab31-1dae7c6bbd4d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 204 len: 0 microversion: 2.1 time: 0.213334 Mar 12 20:52:15.764765 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 640/1421] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:52:15 2022] DELETE /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:52:15.771508 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:15.773801 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:15.807437 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:15.808364 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:15.813346 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:15.814528 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:15.866040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-898dbe9d-ce30-4d3c-9d3e-813f38ff8a58 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:15.878791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-898dbe9d-ce30-4d3c-9d3e-813f38ff8a58 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:15.888215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-898dbe9d-ce30-4d3c-9d3e-813f38ff8a58 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:15.898067 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-898dbe9d-ce30-4d3c-9d3e-813f38ff8a58 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1744 microversion: 2.20 time: 0.487068 Mar 12 20:52:15.909978 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 782/1422] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:15 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1744 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:15.930039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c259967-a027-4579-8b12-0d495498308f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:15.932713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c259967-a027-4579-8b12-0d495498308f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:15.950606 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:15.952223 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:15.953001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c259967-a027-4579-8b12-0d495498308f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:15.956380 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:15.957145 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:15.959816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c259967-a027-4579-8b12-0d495498308f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:15.961260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c259967-a027-4579-8b12-0d495498308f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:15.961893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c259967-a027-4579-8b12-0d495498308f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:16.028109 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Getting quotas for project d8057df76c4c4652a22bb659969dbb31. Resources: {'ram', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:52:16.035420 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Getting quotas for user b404502bb19242c385bc7d6ca5bff2de and project d8057df76c4c4652a22bb659969dbb31. Resources: {'ram', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:52:16.227596 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-b4b52887-404e-41d1-9d8c-99b0e5d22028 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "POST /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5/action" status: 202 len: 0 microversion: 2.1 time: 0.458290 Mar 12 20:52:16.233610 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 641/1423] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:52:15 2022] POST /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:52:16.265542 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a698401c-1a35-450d-a9dd-9e4a6c73a4c0 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:16.269400 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a698401c-1a35-450d-a9dd-9e4a6c73a4c0 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:16.298831 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a698401c-1a35-450d-a9dd-9e4a6c73a4c0 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:16.299572 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a698401c-1a35-450d-a9dd-9e4a6c73a4c0 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:16.301743 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a698401c-1a35-450d-a9dd-9e4a6c73a4c0 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:16.302415 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a698401c-1a35-450d-a9dd-9e4a6c73a4c0 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:16.476877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8c259967-a027-4579-8b12-0d495498308f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:16.485349 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c259967-a027-4579-8b12-0d495498308f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1382 microversion: 2.1 time: 0.569434 Mar 12 20:52:16.490610 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 783/1424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:15 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1382 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:16.505059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f12fcd4a-531d-47c0-849e-092ba5d29f09 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:16.505980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f12fcd4a-531d-47c0-849e-092ba5d29f09 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:16.527027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f12fcd4a-531d-47c0-849e-092ba5d29f09 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:16.527493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f12fcd4a-531d-47c0-849e-092ba5d29f09 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:16.528304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f12fcd4a-531d-47c0-849e-092ba5d29f09 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:16.528806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f12fcd4a-531d-47c0-849e-092ba5d29f09 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:16.971231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-f12fcd4a-531d-47c0-849e-092ba5d29f09 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid ed5531e5-b13c-4c68-98af-74a7ccfd7bcf {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:52:17.014400 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f12fcd4a-531d-47c0-849e-092ba5d29f09 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1968 microversion: 2.25 time: 0.522424 Mar 12 20:52:17.020344 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 784/1425] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:16 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1968 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:17.079026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fc7728fd-d86d-4aa6-b163-a2d9f1986fe5 req-fe3d9a36-623f-4fa3-824b-ebbab63683e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a01d27-42ab-4258-be66-a86606d977d6", "name": "network-vif-plugged", "status": "completed", "tag": "fb9ee1ae-e3ac-4632-96cb-7591d2fde26d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:17.117961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fc7728fd-d86d-4aa6-b163-a2d9f1986fe5 req-fe3d9a36-623f-4fa3-824b-ebbab63683e6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:17.121370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fc7728fd-d86d-4aa6-b163-a2d9f1986fe5 req-fe3d9a36-623f-4fa3-824b-ebbab63683e6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:17.183625 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fc7728fd-d86d-4aa6-b163-a2d9f1986fe5 req-fe3d9a36-623f-4fa3-824b-ebbab63683e6 service nova] Creating event network-vif-plugged:fb9ee1ae-e3ac-4632-96cb-7591d2fde26d for instance b1a01d27-42ab-4258-be66-a86606d977d6 on nch2-master-1 Mar 12 20:52:17.203040 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fc7728fd-d86d-4aa6-b163-a2d9f1986fe5 req-fe3d9a36-623f-4fa3-824b-ebbab63683e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169169 Mar 12 20:52:17.208901 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 785/1426] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:17.227327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1229788852", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "f9820f27-69e7-43b5-9215-94ce6d672d9b"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:17.343447 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a698401c-1a35-450d-a9dd-9e4a6c73a4c0 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:17.356311 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a698401c-1a35-450d-a9dd-9e4a6c73a4c0 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 200 len: 1320 microversion: 2.1 time: 1.116035 Mar 12 20:52:17.367040 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 642/1427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:16 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 1320 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:17.382612 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c64a165c-da6b-498e-a187-2cfa7fa72ffe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:17.386661 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c64a165c-da6b-498e-a187-2cfa7fa72ffe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:17.436500 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c64a165c-da6b-498e-a187-2cfa7fa72ffe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:17.437417 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c64a165c-da6b-498e-a187-2cfa7fa72ffe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:17.450140 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c64a165c-da6b-498e-a187-2cfa7fa72ffe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:17.450650 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c64a165c-da6b-498e-a187-2cfa7fa72ffe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:17.471113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] validate_networks() for [('f9820f27-69e7-43b5-9215-94ce6d672d9b', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:52:18.009321 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c64a165c-da6b-498e-a187-2cfa7fa72ffe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:18.026686 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c64a165c-da6b-498e-a187-2cfa7fa72ffe tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1470 microversion: 2.1 time: 0.649541 Mar 12 20:52:18.034182 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 643/1428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:17 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1470 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:18.043585 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c9d11649-e6b5-4061-841b-19bb5830db98 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:18.046706 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c9d11649-e6b5-4061-841b-19bb5830db98 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:18.062397 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c9d11649-e6b5-4061-841b-19bb5830db98 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:18.063155 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c9d11649-e6b5-4061-841b-19bb5830db98 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:18.064126 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c9d11649-e6b5-4061-841b-19bb5830db98 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:18.068513 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c9d11649-e6b5-4061-841b-19bb5830db98 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:19.022774 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c9d11649-e6b5-4061-841b-19bb5830db98 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:19.030371 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c9d11649-e6b5-4061-841b-19bb5830db98 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1317 microversion: 2.1 time: 0.994666 Mar 12 20:52:19.030886 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 644/1429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:18 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1317 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:19.067712 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2c0240a2-f77d-4b6f-94be-215d64f9caba tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:19.068618 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-2c0240a2-f77d-4b6f-94be-215d64f9caba tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:19.088608 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2c0240a2-f77d-4b6f-94be-215d64f9caba tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:19.089046 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2c0240a2-f77d-4b6f-94be-215d64f9caba tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:19.105077 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2c0240a2-f77d-4b6f-94be-215d64f9caba tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:19.106043 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2c0240a2-f77d-4b6f-94be-215d64f9caba tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:19.419877 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2c0240a2-f77d-4b6f-94be-215d64f9caba tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1533 microversion: 2.1 time: 0.369591 Mar 12 20:52:19.425133 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 645/1430] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:19 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1533 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:19.437284 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ae018bdc-95df-4132-91c3-b77129534d13 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:19.438837 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ae018bdc-95df-4132-91c3-b77129534d13 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:19.456403 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ae018bdc-95df-4132-91c3-b77129534d13 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:19.457108 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ae018bdc-95df-4132-91c3-b77129534d13 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:19.458226 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ae018bdc-95df-4132-91c3-b77129534d13 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:19.458780 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ae018bdc-95df-4132-91c3-b77129534d13 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:19.715253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:52:19.715763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:52:19.716159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:52:19.717008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:52:19.717444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:52:19.742871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:19.743438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:19.751485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:19.751955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:19.802219 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ae018bdc-95df-4132-91c3-b77129534d13 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:19.821136 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ae018bdc-95df-4132-91c3-b77129534d13 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:19.831518 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ae018bdc-95df-4132-91c3-b77129534d13 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:19.837615 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ae018bdc-95df-4132-91c3-b77129534d13 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1739 microversion: 2.20 time: 0.409006 Mar 12 20:52:19.839862 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 646/1431] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:19 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1739 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:19.840372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Getting quotas for project c0c046eb0b9248d3bde469b35342ff50. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:52:19.849735 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-89dddae1-80ad-4235-ba98-f93e63025f0f tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:19.852072 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:52:19.852072 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:52:19.855543 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-89dddae1-80ad-4235-ba98-f93e63025f0f tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:19.857499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Getting quotas for user 1b433353e06247bfbd0897c84912256f and project c0c046eb0b9248d3bde469b35342ff50. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:52:19.858431 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-89dddae1-80ad-4235-ba98-f93e63025f0f tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:19.865524 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-89dddae1-80ad-4235-ba98-f93e63025f0f tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:19.866311 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-89dddae1-80ad-4235-ba98-f93e63025f0f tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:19.916325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:52:19.923805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:52:19.935830 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-89dddae1-80ad-4235-ba98-f93e63025f0f tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.093151 Mar 12 20:52:19.938104 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 647/1432] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Mar 12 20:52:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:52:19.950932 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-05cb012f-fc95-4d4b-8b6b-3388c7ce0ff5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:19.951562 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-05cb012f-fc95-4d4b-8b6b-3388c7ce0ff5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:19.976221 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-05cb012f-fc95-4d4b-8b6b-3388c7ce0ff5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:19.976746 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-05cb012f-fc95-4d4b-8b6b-3388c7ce0ff5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:19.981427 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-05cb012f-fc95-4d4b-8b6b-3388c7ce0ff5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:19.982786 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-05cb012f-fc95-4d4b-8b6b-3388c7ce0ff5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:20.094666 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f3cac450-ee15-4de6-9b3a-4bff8ffdefad tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.878619 Mar 12 20:52:20.106978 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 786/1433] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:52:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:52:20.125867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-283191cc-4914-4cab-97a7-23105ea2d758 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:20.134077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-283191cc-4914-4cab-97a7-23105ea2d758 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:20.169272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-283191cc-4914-4cab-97a7-23105ea2d758 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:20.169746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-283191cc-4914-4cab-97a7-23105ea2d758 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:20.179357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-283191cc-4914-4cab-97a7-23105ea2d758 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:20.180404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-283191cc-4914-4cab-97a7-23105ea2d758 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:20.534778 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-05cb012f-fc95-4d4b-8b6b-3388c7ce0ff5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:20.545690 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-05cb012f-fc95-4d4b-8b6b-3388c7ce0ff5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 200 len: 1320 microversion: 2.1 time: 0.606475 Mar 12 20:52:20.560806 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 648/1434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:19 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 1320 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:20.583660 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d49ff123-aa1b-48a5-8248-9630fa5f0b0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:20.585661 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d49ff123-aa1b-48a5-8248-9630fa5f0b0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:20.615847 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d49ff123-aa1b-48a5-8248-9630fa5f0b0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:20.621076 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d49ff123-aa1b-48a5-8248-9630fa5f0b0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:20.624479 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d49ff123-aa1b-48a5-8248-9630fa5f0b0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:20.625500 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d49ff123-aa1b-48a5-8248-9630fa5f0b0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:20.896073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-283191cc-4914-4cab-97a7-23105ea2d758 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:20.904485 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-283191cc-4914-4cab-97a7-23105ea2d758 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1470 microversion: 2.1 time: 0.792732 Mar 12 20:52:20.907691 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 787/1435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:20 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1470 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:20.923086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ea787f2f-130b-43a9-aa12-bc01e7cb4e46 req-e963ab46-d91b-4fc2-9d61-222ace9708c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7052bc-c2a6-4c11-85b5-e31c7f79adfb", "name": "network-vif-unplugged", "status": "completed", "tag": "72ad719c-17da-4caf-89cd-ae46166479db"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:20.957977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ea787f2f-130b-43a9-aa12-bc01e7cb4e46 req-e963ab46-d91b-4fc2-9d61-222ace9708c9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:20.970514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ea787f2f-130b-43a9-aa12-bc01e7cb4e46 req-e963ab46-d91b-4fc2-9d61-222ace9708c9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:21.015263 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ea787f2f-130b-43a9-aa12-bc01e7cb4e46 req-e963ab46-d91b-4fc2-9d61-222ace9708c9 service nova] Creating event network-vif-unplugged:72ad719c-17da-4caf-89cd-ae46166479db for instance 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb on nch1-master-1 Mar 12 20:52:21.030581 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ea787f2f-130b-43a9-aa12-bc01e7cb4e46 req-e963ab46-d91b-4fc2-9d61-222ace9708c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118441 Mar 12 20:52:21.031832 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 788/1436] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:21.088250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:21.091921 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d49ff123-aa1b-48a5-8248-9630fa5f0b0f tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1533 microversion: 2.1 time: 0.527998 Mar 12 20:52:21.092980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:21.124336 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 649/1437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:20 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1533 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:21.132923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:21.138721 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7893681b-845f-4d95-922a-cd2cee844ba6 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:21.145645 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7893681b-845f-4d95-922a-cd2cee844ba6 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:21.148609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:21.152004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:21.152509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:21.171784 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7893681b-845f-4d95-922a-cd2cee844ba6 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:21.172554 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7893681b-845f-4d95-922a-cd2cee844ba6 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:21.174485 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7893681b-845f-4d95-922a-cd2cee844ba6 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:21.178550 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7893681b-845f-4d95-922a-cd2cee844ba6 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:21.304007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'flavor' on Instance uuid ed5531e5-b13c-4c68-98af-74a7ccfd7bcf {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:52:21.375619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Going to try to live migrate instance to nch1-master-1 {{(pid=136302) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 12 20:52:21.665278 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7893681b-845f-4d95-922a-cd2cee844ba6 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:21.691928 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7893681b-845f-4d95-922a-cd2cee844ba6 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1466 microversion: 2.1 time: 0.566412 Mar 12 20:52:21.697371 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 650/1438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:21 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1466 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:21.720747 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8bc5c37e-c625-4619-acb9-7b53ae647b92 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:21.721489 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8bc5c37e-c625-4619-acb9-7b53ae647b92 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:21.743821 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8bc5c37e-c625-4619-acb9-7b53ae647b92 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:21.749286 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8bc5c37e-c625-4619-acb9-7b53ae647b92 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:21.768775 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8bc5c37e-c625-4619-acb9-7b53ae647b92 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:21.769722 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8bc5c37e-c625-4619-acb9-7b53ae647b92 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:21.961872 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8bc5c37e-c625-4619-acb9-7b53ae647b92 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:21.982939 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8bc5c37e-c625-4619-acb9-7b53ae647b92 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 200 len: 1204 microversion: 2.1 time: 0.282442 Mar 12 20:52:21.988821 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 651/1439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:21 2022] GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 1204 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:22.000872 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-fb809440-7eb7-466d-9539-12a7cce93afa req-4567fb46-cffd-470c-9617-495d40bf444d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7052bc-c2a6-4c11-85b5-e31c7f79adfb", "name": "network-vif-deleted", "tag": "72ad719c-17da-4caf-89cd-ae46166479db"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:22.028296 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-fb809440-7eb7-466d-9539-12a7cce93afa req-4567fb46-cffd-470c-9617-495d40bf444d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:22.029085 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-fb809440-7eb7-466d-9539-12a7cce93afa req-4567fb46-cffd-470c-9617-495d40bf444d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:22.041650 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-fb809440-7eb7-466d-9539-12a7cce93afa req-4567fb46-cffd-470c-9617-495d40bf444d service nova] Creating event network-vif-deleted:72ad719c-17da-4caf-89cd-ae46166479db for instance 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb on nch1-master-1 Mar 12 20:52:22.049937 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-fb809440-7eb7-466d-9539-12a7cce93afa req-4567fb46-cffd-470c-9617-495d40bf444d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059642 Mar 12 20:52:22.051409 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 652/1440] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:22.077511 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0395a9aa-dbfd-4e25-9f18-16b8110c0c9c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:22.083044 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-0395a9aa-dbfd-4e25-9f18-16b8110c0c9c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:22.103338 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0395a9aa-dbfd-4e25-9f18-16b8110c0c9c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:22.104208 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0395a9aa-dbfd-4e25-9f18-16b8110c0c9c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:22.105185 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0395a9aa-dbfd-4e25-9f18-16b8110c0c9c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:22.106175 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0395a9aa-dbfd-4e25-9f18-16b8110c0c9c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:22.432165 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-0395a9aa-dbfd-4e25-9f18-16b8110c0c9c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:22.445075 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-0395a9aa-dbfd-4e25-9f18-16b8110c0c9c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:22.446704 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-0395a9aa-dbfd-4e25-9f18-16b8110c0c9c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:22.447915 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0395a9aa-dbfd-4e25-9f18-16b8110c0c9c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1739 microversion: 2.20 time: 0.392430 Mar 12 20:52:22.449105 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 653/1441] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:22 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:22.466237 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-67dddb4b-6d0a-4ba6-b3ee-d77991d1e28d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:22.470094 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:52:22.470094 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:52:22.472595 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67dddb4b-6d0a-4ba6-b3ee-d77991d1e28d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:22.475554 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67dddb4b-6d0a-4ba6-b3ee-d77991d1e28d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:22.478274 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67dddb4b-6d0a-4ba6-b3ee-d77991d1e28d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:22.481928 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-67dddb4b-6d0a-4ba6-b3ee-d77991d1e28d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:22.565136 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-67dddb4b-6d0a-4ba6-b3ee-d77991d1e28d tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.111195 Mar 12 20:52:22.573683 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 654/1442] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Mar 12 20:52:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:22.586171 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-59eac99a-a54e-4e31-b8e0-2e64fb169b93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:22.587813 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-59eac99a-a54e-4e31-b8e0-2e64fb169b93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:22.609660 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-59eac99a-a54e-4e31-b8e0-2e64fb169b93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:22.610837 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-59eac99a-a54e-4e31-b8e0-2e64fb169b93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:22.614032 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-59eac99a-a54e-4e31-b8e0-2e64fb169b93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:22.615597 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-59eac99a-a54e-4e31-b8e0-2e64fb169b93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:23.048407 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-59eac99a-a54e-4e31-b8e0-2e64fb169b93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:23.080220 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-59eac99a-a54e-4e31-b8e0-2e64fb169b93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 200 len: 1320 microversion: 2.1 time: 0.482705 Mar 12 20:52:23.081180 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 655/1443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:22 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 1320 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:23.088885 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-06ca25fe-e605-4520-b582-c6b0b96a58a0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-724682576", "metadata": {"image_type": "test"}}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:23.095206 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-06ca25fe-e605-4520-b582-c6b0b96a58a0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:23.117571 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-06ca25fe-e605-4520-b582-c6b0b96a58a0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:23.118356 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-06ca25fe-e605-4520-b582-c6b0b96a58a0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:23.119332 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-06ca25fe-e605-4520-b582-c6b0b96a58a0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:23.119940 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-06ca25fe-e605-4520-b582-c6b0b96a58a0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:23.191165 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-06ca25fe-e605-4520-b582-c6b0b96a58a0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Getting quotas for project 23a488240d854791982d9752ec577a28. Resources: dict_keys(['metadata_items']) {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:52:23.206970 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-06ca25fe-e605-4520-b582-c6b0b96a58a0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Getting quotas for user 1954449180ce475a88dec4df6de6523d and project 23a488240d854791982d9752ec577a28. Resources: dict_keys(['metadata_items']) {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:52:23.712404 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-06ca25fe-e605-4520-b582-c6b0b96a58a0 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6/action" status: 202 len: 0 microversion: 2.1 time: 0.629702 Mar 12 20:52:23.714915 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 656/1444] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:52:23 2022] POST /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 12 20:52:23.731106 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-05ecc2bf-3c8f-4a73-8f50-1c5db342109b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:23.732374 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-05ecc2bf-3c8f-4a73-8f50-1c5db342109b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:23.749701 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-05ecc2bf-3c8f-4a73-8f50-1c5db342109b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:23.751014 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-05ecc2bf-3c8f-4a73-8f50-1c5db342109b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:23.753902 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-05ecc2bf-3c8f-4a73-8f50-1c5db342109b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:23.754899 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-05ecc2bf-3c8f-4a73-8f50-1c5db342109b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:24.086439 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-05ecc2bf-3c8f-4a73-8f50-1c5db342109b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:24.095661 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-05ecc2bf-3c8f-4a73-8f50-1c5db342109b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1536 microversion: 2.1 time: 0.376041 Mar 12 20:52:24.096262 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 657/1445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:23 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1536 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:24.102436 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-45a83ff3-96ed-43bb-9aa4-627bcc23818e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:24.103628 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-45a83ff3-96ed-43bb-9aa4-627bcc23818e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:24.132907 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-45a83ff3-96ed-43bb-9aa4-627bcc23818e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:24.133509 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-45a83ff3-96ed-43bb-9aa4-627bcc23818e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:24.134874 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-45a83ff3-96ed-43bb-9aa4-627bcc23818e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:24.141394 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-45a83ff3-96ed-43bb-9aa4-627bcc23818e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:24.197998 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-45a83ff3-96ed-43bb-9aa4-627bcc23818e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lazy-loading 'flavor' on Instance uuid ce767e86-64a8-47b9-bae8-145d5819b6d9 {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:52:24.229967 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-45a83ff3-96ed-43bb-9aa4-627bcc23818e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Going to try to live migrate instance to nch1-master-1 {{(pid=136303) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 12 20:52:24.886415 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da2a68a0-ce6c-4dbe-b565-68727c91f4e4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf/action" status: 202 len: 0 microversion: 2.25 time: 3.839418 Mar 12 20:52:24.888100 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 789/1446] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 20:52:21 2022] POST /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf/action => generated 0 bytes in 3842 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:52:24.910396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7c11b9a2-d8c9-4c7d-be70-c3aef1ab45d3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:24.917320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7c11b9a2-d8c9-4c7d-be70-c3aef1ab45d3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:24.959326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c11b9a2-d8c9-4c7d-be70-c3aef1ab45d3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:24.970842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c11b9a2-d8c9-4c7d-be70-c3aef1ab45d3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:24.978888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c11b9a2-d8c9-4c7d-be70-c3aef1ab45d3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:24.981131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c11b9a2-d8c9-4c7d-be70-c3aef1ab45d3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:25.241520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7c11b9a2-d8c9-4c7d-be70-c3aef1ab45d3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:25.254016 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7c11b9a2-d8c9-4c7d-be70-c3aef1ab45d3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 200 len: 1266 microversion: 2.1 time: 0.360637 Mar 12 20:52:25.255328 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 790/1447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:24 2022] GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 1266 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:25.279085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-69dc02b1-670d-4742-9065-2cbd24ac4a8f req-bb4c2e86-315f-4d8a-9fdd-4e1e85c5a243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e67993b-4604-4f37-9543-3dc09be802e5", "name": "network-vif-plugged", "status": "completed", "tag": "3abbe775-9508-422a-826d-d481a507a318"}, {"server_uuid": "5ae82842-58a0-4d5e-a522-a1c83c53e101", "name": "network-vif-plugged", "status": "completed", "tag": "c40c686b-b640-42d0-a899-bda5e43f8663"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:25.293093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-69dc02b1-670d-4742-9065-2cbd24ac4a8f req-bb4c2e86-315f-4d8a-9fdd-4e1e85c5a243 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:25.293880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-69dc02b1-670d-4742-9065-2cbd24ac4a8f req-bb4c2e86-315f-4d8a-9fdd-4e1e85c5a243 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:25.355014 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-69dc02b1-670d-4742-9065-2cbd24ac4a8f req-bb4c2e86-315f-4d8a-9fdd-4e1e85c5a243 service nova] Creating event network-vif-plugged:3abbe775-9508-422a-826d-d481a507a318 for instance 8e67993b-4604-4f37-9543-3dc09be802e5 on nch1-master-1 Mar 12 20:52:25.355545 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-69dc02b1-670d-4742-9065-2cbd24ac4a8f req-bb4c2e86-315f-4d8a-9fdd-4e1e85c5a243 service nova] Creating event network-vif-plugged:c40c686b-b640-42d0-a899-bda5e43f8663 for instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 on nch2-master-1 Mar 12 20:52:25.422833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-69dc02b1-670d-4742-9065-2cbd24ac4a8f req-bb4c2e86-315f-4d8a-9fdd-4e1e85c5a243 service nova] Instance 8e67993b-4604-4f37-9543-3dc09be802e5 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:52:25.469731 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-69dc02b1-670d-4742-9065-2cbd24ac4a8f req-bb4c2e86-315f-4d8a-9fdd-4e1e85c5a243 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.212883 Mar 12 20:52:25.472024 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 791/1448] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:25.504202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-834afbb0-5b09-4299-8fc2-a25a2d3d1e3d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:25.505534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-834afbb0-5b09-4299-8fc2-a25a2d3d1e3d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:25.551973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-834afbb0-5b09-4299-8fc2-a25a2d3d1e3d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:25.553363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-834afbb0-5b09-4299-8fc2-a25a2d3d1e3d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:25.555769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-834afbb0-5b09-4299-8fc2-a25a2d3d1e3d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:25.557166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-834afbb0-5b09-4299-8fc2-a25a2d3d1e3d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:26.456758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-834afbb0-5b09-4299-8fc2-a25a2d3d1e3d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:26.470851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-834afbb0-5b09-4299-8fc2-a25a2d3d1e3d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:26.473503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-834afbb0-5b09-4299-8fc2-a25a2d3d1e3d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:26.476090 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-834afbb0-5b09-4299-8fc2-a25a2d3d1e3d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1739 microversion: 2.20 time: 0.990816 Mar 12 20:52:26.490664 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 792/1449] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:25 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1739 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:26.495622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fa884d4d-050d-47b8-a1d7-e97c32e67957 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e37799550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:27.344031 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-45a83ff3-96ed-43bb-9aa4-627bcc23818e tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9/action" status: 202 len: 0 microversion: 2.1 time: 3.245710 Mar 12 20:52:27.344627 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 658/1450] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:52:24 2022] POST /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9/action => generated 0 bytes in 3248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:52:27.353120 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-c1b42ea5-a4b3-4b16-b149-fe912dbe54da req-c56f7b1f-2f64-4178-a4c1-5d556354e094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e67993b-4604-4f37-9543-3dc09be802e5", "name": "network-vif-unplugged", "status": "completed", "tag": "3abbe775-9508-422a-826d-d481a507a318"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:27.388230 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-c1b42ea5-a4b3-4b16-b149-fe912dbe54da req-c56f7b1f-2f64-4178-a4c1-5d556354e094 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:27.388692 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-c1b42ea5-a4b3-4b16-b149-fe912dbe54da req-c56f7b1f-2f64-4178-a4c1-5d556354e094 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:27.429478 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-c1b42ea5-a4b3-4b16-b149-fe912dbe54da req-c56f7b1f-2f64-4178-a4c1-5d556354e094 service nova] Creating event network-vif-unplugged:3abbe775-9508-422a-826d-d481a507a318 for instance 8e67993b-4604-4f37-9543-3dc09be802e5 on nch1-master-1 Mar 12 20:52:27.466843 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [req-c1b42ea5-a4b3-4b16-b149-fe912dbe54da req-c56f7b1f-2f64-4178-a4c1-5d556354e094 service nova] Instance 8e67993b-4604-4f37-9543-3dc09be802e5 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:52:27.490202 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-c1b42ea5-a4b3-4b16-b149-fe912dbe54da req-c56f7b1f-2f64-4178-a4c1-5d556354e094 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138187 Mar 12 20:52:27.493245 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 659/1451] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:27.504883 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d66b39da-6af0-4b32-abc6-bfde188ee412 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:27.506035 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d66b39da-6af0-4b32-abc6-bfde188ee412 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:27.518706 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d66b39da-6af0-4b32-abc6-bfde188ee412 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:27.522680 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d66b39da-6af0-4b32-abc6-bfde188ee412 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:27.523997 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d66b39da-6af0-4b32-abc6-bfde188ee412 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:27.524686 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d66b39da-6af0-4b32-abc6-bfde188ee412 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:27.768642 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d66b39da-6af0-4b32-abc6-bfde188ee412 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:27.778990 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d66b39da-6af0-4b32-abc6-bfde188ee412 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 200 len: 1320 microversion: 2.1 time: 0.282612 Mar 12 20:52:27.780719 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 660/1452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:27 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 1320 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:27.795600 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-23297377-feb2-4220-89e3-72b850cadab3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:27.798257 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-23297377-feb2-4220-89e3-72b850cadab3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:27.825467 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-23297377-feb2-4220-89e3-72b850cadab3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:27.828329 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-23297377-feb2-4220-89e3-72b850cadab3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:27.829488 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-23297377-feb2-4220-89e3-72b850cadab3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:27.831904 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-23297377-feb2-4220-89e3-72b850cadab3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:28.184838 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-23297377-feb2-4220-89e3-72b850cadab3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:28.203648 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-23297377-feb2-4220-89e3-72b850cadab3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:28.205635 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-23297377-feb2-4220-89e3-72b850cadab3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:28.211642 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-23297377-feb2-4220-89e3-72b850cadab3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1486 microversion: 2.25 time: 0.428808 Mar 12 20:52:28.212876 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 661/1453] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:27 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1486 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:28.217734 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a04105fe-6d89-4c1d-bac2-54b9ee2cd01a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:28.218715 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a04105fe-6d89-4c1d-bac2-54b9ee2cd01a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:28.225743 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a04105fe-6d89-4c1d-bac2-54b9ee2cd01a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:28.226568 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a04105fe-6d89-4c1d-bac2-54b9ee2cd01a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:28.227588 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a04105fe-6d89-4c1d-bac2-54b9ee2cd01a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:28.228271 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a04105fe-6d89-4c1d-bac2-54b9ee2cd01a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:28.465469 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a04105fe-6d89-4c1d-bac2-54b9ee2cd01a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:28.476050 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a04105fe-6d89-4c1d-bac2-54b9ee2cd01a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1536 microversion: 2.1 time: 0.261510 Mar 12 20:52:28.488328 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 662/1454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:28 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1536 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:28.496883 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-35b73fa4-e2e0-43fa-8f8c-72bf2bbe10ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:28.510128 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-35b73fa4-e2e0-43fa-8f8c-72bf2bbe10ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:28.534059 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-35b73fa4-e2e0-43fa-8f8c-72bf2bbe10ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:28.538156 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-35b73fa4-e2e0-43fa-8f8c-72bf2bbe10ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:28.542059 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-35b73fa4-e2e0-43fa-8f8c-72bf2bbe10ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:28.542533 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-35b73fa4-e2e0-43fa-8f8c-72bf2bbe10ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:29.090402 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-35b73fa4-e2e0-43fa-8f8c-72bf2bbe10ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:29.108670 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-35b73fa4-e2e0-43fa-8f8c-72bf2bbe10ce tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 200 len: 1308 microversion: 2.1 time: 0.614683 Mar 12 20:52:29.111901 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 663/1455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:28 2022] GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 1308 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:29.124023 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-079dac01-984d-4f62-a42f-032a85e8773d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:29.125026 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-079dac01-984d-4f62-a42f-032a85e8773d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:29.137829 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-079dac01-984d-4f62-a42f-032a85e8773d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:29.141994 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-079dac01-984d-4f62-a42f-032a85e8773d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:29.142840 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-079dac01-984d-4f62-a42f-032a85e8773d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:29.144706 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-079dac01-984d-4f62-a42f-032a85e8773d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:29.517024 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-079dac01-984d-4f62-a42f-032a85e8773d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:29.530119 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-079dac01-984d-4f62-a42f-032a85e8773d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.414170 Mar 12 20:52:29.532398 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 664/1456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:29 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:29.549881 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-fb23988b-98db-4e69-ace8-40c322d9d60b req-5c230c7a-8420-43a4-aa08-833cf879ee10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d342f2eb-8870-4132-be47-59361a46149f", "name": "network-vif-plugged", "status": "completed", "tag": "ad184f30-9c5b-4778-b03b-c7497cbb2350"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:29.571729 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-fb23988b-98db-4e69-ace8-40c322d9d60b req-5c230c7a-8420-43a4-aa08-833cf879ee10 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:29.572462 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-fb23988b-98db-4e69-ace8-40c322d9d60b req-5c230c7a-8420-43a4-aa08-833cf879ee10 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:29.585123 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-fb23988b-98db-4e69-ace8-40c322d9d60b req-5c230c7a-8420-43a4-aa08-833cf879ee10 service nova] Creating event network-vif-plugged:ad184f30-9c5b-4778-b03b-c7497cbb2350 for instance d342f2eb-8870-4132-be47-59361a46149f on nch1-master-1 Mar 12 20:52:29.591991 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-fb23988b-98db-4e69-ace8-40c322d9d60b req-5c230c7a-8420-43a4-aa08-833cf879ee10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057583 Mar 12 20:52:29.593893 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 665/1457] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:29.613310 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-cedbc4e4-8024-48e0-bcf5-ad05b2678022 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:29.614863 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-cedbc4e4-8024-48e0-bcf5-ad05b2678022 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:29.648014 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cedbc4e4-8024-48e0-bcf5-ad05b2678022 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:29.648389 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cedbc4e4-8024-48e0-bcf5-ad05b2678022 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:29.649373 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cedbc4e4-8024-48e0-bcf5-ad05b2678022 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:29.649643 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cedbc4e4-8024-48e0-bcf5-ad05b2678022 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:29.965804 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-cedbc4e4-8024-48e0-bcf5-ad05b2678022 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:29.979421 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-cedbc4e4-8024-48e0-bcf5-ad05b2678022 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:29.980960 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-cedbc4e4-8024-48e0-bcf5-ad05b2678022 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:29.992749 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-cedbc4e4-8024-48e0-bcf5-ad05b2678022 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1739 microversion: 2.20 time: 0.387250 Mar 12 20:52:30.007578 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 666/1458] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:29 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1739 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:30.017729 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-39edfffe-26e8-4d5a-8ae7-f14216f2d354 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:30.018613 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-39edfffe-26e8-4d5a-8ae7-f14216f2d354 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:30.029496 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-39edfffe-26e8-4d5a-8ae7-f14216f2d354 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:30.030037 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-39edfffe-26e8-4d5a-8ae7-f14216f2d354 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:30.031537 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-39edfffe-26e8-4d5a-8ae7-f14216f2d354 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:30.033123 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-39edfffe-26e8-4d5a-8ae7-f14216f2d354 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:30.333493 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-39edfffe-26e8-4d5a-8ae7-f14216f2d354 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:30.340831 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-39edfffe-26e8-4d5a-8ae7-f14216f2d354 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 200 len: 1320 microversion: 2.1 time: 0.342496 Mar 12 20:52:30.341615 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 667/1459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:29 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 1320 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:30.356911 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4b6119a2-5b95-40b7-be83-da7bad0f953e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:30.357536 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4b6119a2-5b95-40b7-be83-da7bad0f953e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:30.365791 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4b6119a2-5b95-40b7-be83-da7bad0f953e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:30.365791 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4b6119a2-5b95-40b7-be83-da7bad0f953e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:30.366283 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4b6119a2-5b95-40b7-be83-da7bad0f953e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:30.367038 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4b6119a2-5b95-40b7-be83-da7bad0f953e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:30.592980 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4b6119a2-5b95-40b7-be83-da7bad0f953e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:30.613252 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4b6119a2-5b95-40b7-be83-da7bad0f953e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:30.616003 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4b6119a2-5b95-40b7-be83-da7bad0f953e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:30.617489 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4b6119a2-5b95-40b7-be83-da7bad0f953e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1486 microversion: 2.25 time: 0.265060 Mar 12 20:52:30.618625 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 668/1460] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:30 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1486 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:30.638166 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a362f441-2e34-49fa-916f-f2945e562cc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:30.639164 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a362f441-2e34-49fa-916f-f2945e562cc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:30.646718 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a362f441-2e34-49fa-916f-f2945e562cc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:30.652350 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a362f441-2e34-49fa-916f-f2945e562cc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:30.653697 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a362f441-2e34-49fa-916f-f2945e562cc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:30.654418 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a362f441-2e34-49fa-916f-f2945e562cc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:30.916243 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-a362f441-2e34-49fa-916f-f2945e562cc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:30.927025 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a362f441-2e34-49fa-916f-f2945e562cc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1536 microversion: 2.1 time: 0.307074 Mar 12 20:52:30.943570 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 669/1461] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:30 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1536 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:30.948688 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-77392fdc-4bdf-4a68-ade7-57f58138e05d req-8e9537fb-fd24-45df-a986-c2813d7523ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e67993b-4604-4f37-9543-3dc09be802e5", "tag": "3abbe775-9508-422a-826d-d481a507a318"}, {"name": "network-changed", "server_uuid": "174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e", "tag": "1326e734-666a-431b-bab6-8338bafdbcba"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:30.975903 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-77392fdc-4bdf-4a68-ade7-57f58138e05d req-8e9537fb-fd24-45df-a986-c2813d7523ae service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:30.976515 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-77392fdc-4bdf-4a68-ade7-57f58138e05d req-8e9537fb-fd24-45df-a986-c2813d7523ae service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:31.000600 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-77392fdc-4bdf-4a68-ade7-57f58138e05d req-8e9537fb-fd24-45df-a986-c2813d7523ae service nova] Creating event network-changed:3abbe775-9508-422a-826d-d481a507a318 for instance 8e67993b-4604-4f37-9543-3dc09be802e5 on nch1-master-1 Mar 12 20:52:31.001302 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-77392fdc-4bdf-4a68-ade7-57f58138e05d req-8e9537fb-fd24-45df-a986-c2813d7523ae service nova] Creating event network-changed:1326e734-666a-431b-bab6-8338bafdbcba for instance 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e on nch2-master-1 Mar 12 20:52:31.010233 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [req-77392fdc-4bdf-4a68-ade7-57f58138e05d req-8e9537fb-fd24-45df-a986-c2813d7523ae service nova] Instance 8e67993b-4604-4f37-9543-3dc09be802e5 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136303) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:52:31.028041 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-77392fdc-4bdf-4a68-ade7-57f58138e05d req-8e9537fb-fd24-45df-a986-c2813d7523ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.082953 Mar 12 20:52:31.036437 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 670/1462] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:31.045454 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f96092a7-c56f-4d0a-891e-daa0f8dc856d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:31.054026 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f96092a7-c56f-4d0a-891e-daa0f8dc856d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:31.066589 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f96092a7-c56f-4d0a-891e-daa0f8dc856d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:31.067292 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f96092a7-c56f-4d0a-891e-daa0f8dc856d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:31.068529 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f96092a7-c56f-4d0a-891e-daa0f8dc856d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:31.069144 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f96092a7-c56f-4d0a-891e-daa0f8dc856d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:31.358785 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f96092a7-c56f-4d0a-891e-daa0f8dc856d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:31.401814 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f96092a7-c56f-4d0a-891e-daa0f8dc856d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 200 len: 1308 microversion: 2.1 time: 0.363657 Mar 12 20:52:31.403159 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 671/1463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:31 2022] GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:31.410204 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d5681f84-d266-4534-86e8-3683ac3258ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:31.411079 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d5681f84-d266-4534-86e8-3683ac3258ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:31.420334 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d5681f84-d266-4534-86e8-3683ac3258ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:31.421452 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d5681f84-d266-4534-86e8-3683ac3258ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:31.422616 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d5681f84-d266-4534-86e8-3683ac3258ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:31.423507 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d5681f84-d266-4534-86e8-3683ac3258ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:31.756750 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d5681f84-d266-4534-86e8-3683ac3258ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:31.764552 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d5681f84-d266-4534-86e8-3683ac3258ca tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.359915 Mar 12 20:52:31.791828 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 672/1464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:31 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:31.791828 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c9c5e427-2794-468a-93c9-ea1b9e8f6894 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:31.791828 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c9c5e427-2794-468a-93c9-ea1b9e8f6894 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:31.817258 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c9c5e427-2794-468a-93c9-ea1b9e8f6894 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:31.818020 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c9c5e427-2794-468a-93c9-ea1b9e8f6894 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:31.818823 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c9c5e427-2794-468a-93c9-ea1b9e8f6894 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:31.819266 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c9c5e427-2794-468a-93c9-ea1b9e8f6894 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:32.528168 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c9c5e427-2794-468a-93c9-ea1b9e8f6894 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:32.549436 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c9c5e427-2794-468a-93c9-ea1b9e8f6894 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:32.551007 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c9c5e427-2794-468a-93c9-ea1b9e8f6894 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:32.552213 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c9c5e427-2794-468a-93c9-ea1b9e8f6894 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1739 microversion: 2.20 time: 0.769059 Mar 12 20:52:32.552787 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 673/1465] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:31 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1739 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:32.571215 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d7081a78-7605-4146-b248-b491e86c5275 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:32.572069 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d7081a78-7605-4146-b248-b491e86c5275 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:32.584752 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d7081a78-7605-4146-b248-b491e86c5275 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:32.585947 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d7081a78-7605-4146-b248-b491e86c5275 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:32.597409 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d7081a78-7605-4146-b248-b491e86c5275 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:32.598332 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d7081a78-7605-4146-b248-b491e86c5275 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:33.567401 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d7081a78-7605-4146-b248-b491e86c5275 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:33.576531 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d7081a78-7605-4146-b248-b491e86c5275 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 200 len: 1470 microversion: 2.1 time: 1.019906 Mar 12 20:52:33.580167 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 674/1466] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:32 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 1470 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:33.591193 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-c8196240-9b11-46fc-a5ff-602dda8ef7de req-fde40840-5afe-4e66-b559-c95677e32afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a01d27-42ab-4258-be66-a86606d977d6", "name": "network-vif-plugged", "status": "completed", "tag": "fb9ee1ae-e3ac-4632-96cb-7591d2fde26d"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:33.614970 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-c8196240-9b11-46fc-a5ff-602dda8ef7de req-fde40840-5afe-4e66-b559-c95677e32afc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:33.617341 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-c8196240-9b11-46fc-a5ff-602dda8ef7de req-fde40840-5afe-4e66-b559-c95677e32afc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:33.660262 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-c8196240-9b11-46fc-a5ff-602dda8ef7de req-fde40840-5afe-4e66-b559-c95677e32afc service nova] Creating event network-vif-plugged:fb9ee1ae-e3ac-4632-96cb-7591d2fde26d for instance b1a01d27-42ab-4258-be66-a86606d977d6 on nch2-master-1 Mar 12 20:52:33.686482 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-c8196240-9b11-46fc-a5ff-602dda8ef7de req-fde40840-5afe-4e66-b559-c95677e32afc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095414 Mar 12 20:52:33.688221 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 675/1467] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:33.710965 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-dfe229e7-2dc7-469c-99c2-6e6f5962b8ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:33.714720 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-dfe229e7-2dc7-469c-99c2-6e6f5962b8ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:33.742305 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dfe229e7-2dc7-469c-99c2-6e6f5962b8ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:33.743893 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dfe229e7-2dc7-469c-99c2-6e6f5962b8ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:33.750422 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dfe229e7-2dc7-469c-99c2-6e6f5962b8ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:33.752121 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dfe229e7-2dc7-469c-99c2-6e6f5962b8ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:34.181606 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-dfe229e7-2dc7-469c-99c2-6e6f5962b8ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:34.202600 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-dfe229e7-2dc7-469c-99c2-6e6f5962b8ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:34.218548 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-dfe229e7-2dc7-469c-99c2-6e6f5962b8ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:34.220131 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-dfe229e7-2dc7-469c-99c2-6e6f5962b8ab tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1486 microversion: 2.25 time: 0.528489 Mar 12 20:52:34.221751 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 676/1468] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:33 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1486 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:34.237927 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-00fe7d3b-b3c0-419a-bfaa-e1af1eca93e3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:34.241415 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-00fe7d3b-b3c0-419a-bfaa-e1af1eca93e3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:34.249373 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-00fe7d3b-b3c0-419a-bfaa-e1af1eca93e3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:34.251472 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-00fe7d3b-b3c0-419a-bfaa-e1af1eca93e3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:34.252470 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-00fe7d3b-b3c0-419a-bfaa-e1af1eca93e3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:34.253338 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-00fe7d3b-b3c0-419a-bfaa-e1af1eca93e3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:34.584490 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-00fe7d3b-b3c0-419a-bfaa-e1af1eca93e3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:34.594747 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-00fe7d3b-b3c0-419a-bfaa-e1af1eca93e3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1529 microversion: 2.1 time: 0.371779 Mar 12 20:52:34.600178 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 677/1469] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:34 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1529 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:34.612483 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0b2a7f14-eea1-4f5e-9cc5-52c76916eb86 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:34.618110 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-0b2a7f14-eea1-4f5e-9cc5-52c76916eb86 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:34.630426 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0b2a7f14-eea1-4f5e-9cc5-52c76916eb86 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:34.634111 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0b2a7f14-eea1-4f5e-9cc5-52c76916eb86 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:34.635137 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0b2a7f14-eea1-4f5e-9cc5-52c76916eb86 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:34.635748 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0b2a7f14-eea1-4f5e-9cc5-52c76916eb86 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:34.961505 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-0b2a7f14-eea1-4f5e-9cc5-52c76916eb86 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:34.971328 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0b2a7f14-eea1-4f5e-9cc5-52c76916eb86 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 200 len: 1308 microversion: 2.1 time: 0.368580 Mar 12 20:52:34.971328 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 678/1470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:34 2022] GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:34.977153 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-fcce36f0-5f3f-4ab9-b170-db8bafa918f1 req-d7bb329d-f343-46f7-a122-f9f88504145f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5531e5-b13c-4c68-98af-74a7ccfd7bcf", "name": "network-vif-unplugged", "status": "completed", "tag": "0e6f8026-1053-415c-a2ed-d86d3cb58b07"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:34.988578 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-fcce36f0-5f3f-4ab9-b170-db8bafa918f1 req-d7bb329d-f343-46f7-a122-f9f88504145f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:34.989176 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-fcce36f0-5f3f-4ab9-b170-db8bafa918f1 req-d7bb329d-f343-46f7-a122-f9f88504145f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:35.004583 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-fcce36f0-5f3f-4ab9-b170-db8bafa918f1 req-d7bb329d-f343-46f7-a122-f9f88504145f service nova] Creating event network-vif-unplugged:0e6f8026-1053-415c-a2ed-d86d3cb58b07 for instance ed5531e5-b13c-4c68-98af-74a7ccfd7bcf on nch2-master-1 Mar 12 20:52:35.013404 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-fcce36f0-5f3f-4ab9-b170-db8bafa918f1 req-d7bb329d-f343-46f7-a122-f9f88504145f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039862 Mar 12 20:52:35.018876 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 679/1471] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:35.029450 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4e2c74a4-ed0e-4114-9bff-dadf3e302d82 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:35.030953 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4e2c74a4-ed0e-4114-9bff-dadf3e302d82 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:35.037761 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4e2c74a4-ed0e-4114-9bff-dadf3e302d82 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:35.038451 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4e2c74a4-ed0e-4114-9bff-dadf3e302d82 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:35.039635 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4e2c74a4-ed0e-4114-9bff-dadf3e302d82 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:35.040161 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4e2c74a4-ed0e-4114-9bff-dadf3e302d82 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:35.301701 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4e2c74a4-ed0e-4114-9bff-dadf3e302d82 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:35.310150 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4e2c74a4-ed0e-4114-9bff-dadf3e302d82 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.289914 Mar 12 20:52:35.323579 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 680/1472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:35 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:35.329396 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f8f89105-0907-4a1a-b851-2b0a3ec07d5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:35.330124 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f8f89105-0907-4a1a-b851-2b0a3ec07d5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:35.336305 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f8f89105-0907-4a1a-b851-2b0a3ec07d5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:35.336853 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f8f89105-0907-4a1a-b851-2b0a3ec07d5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:35.337714 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f8f89105-0907-4a1a-b851-2b0a3ec07d5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:35.338256 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f8f89105-0907-4a1a-b851-2b0a3ec07d5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:35.594677 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f8f89105-0907-4a1a-b851-2b0a3ec07d5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:35.605169 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f8f89105-0907-4a1a-b851-2b0a3ec07d5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:35.605415 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f8f89105-0907-4a1a-b851-2b0a3ec07d5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:35.609392 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f8f89105-0907-4a1a-b851-2b0a3ec07d5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1739 microversion: 2.20 time: 0.282737 Mar 12 20:52:35.609588 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 681/1473] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:35 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:35.711348 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d644ca81-52a0-4a14-9c61-8f9f77d5a9f6 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:35.711883 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d644ca81-52a0-4a14-9c61-8f9f77d5a9f6 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:35.722744 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d644ca81-52a0-4a14-9c61-8f9f77d5a9f6 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:35.723575 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d644ca81-52a0-4a14-9c61-8f9f77d5a9f6 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:35.724606 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d644ca81-52a0-4a14-9c61-8f9f77d5a9f6 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:35.725292 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d644ca81-52a0-4a14-9c61-8f9f77d5a9f6 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:35.765896 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d644ca81-52a0-4a14-9c61-8f9f77d5a9f6 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] [instance: d342f2eb-8870-4132-be47-59361a46149f] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:52:35.907204 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d644ca81-52a0-4a14-9c61-8f9f77d5a9f6 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 204 len: 0 microversion: 2.1 time: 0.296184 Mar 12 20:52:35.908048 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 682/1474] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:52:35 2022] DELETE /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:52:35.926928 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-79e994f7-ea2d-4981-8a4f-5525a3d9e552 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:35.928763 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-79e994f7-ea2d-4981-8a4f-5525a3d9e552 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:35.944249 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-79e994f7-ea2d-4981-8a4f-5525a3d9e552 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:35.945136 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-79e994f7-ea2d-4981-8a4f-5525a3d9e552 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:35.946173 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-79e994f7-ea2d-4981-8a4f-5525a3d9e552 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:35.946619 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-79e994f7-ea2d-4981-8a4f-5525a3d9e552 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:36.211942 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-79e994f7-ea2d-4981-8a4f-5525a3d9e552 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:36.229098 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-79e994f7-ea2d-4981-8a4f-5525a3d9e552 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1529 microversion: 2.1 time: 0.320054 Mar 12 20:52:36.230091 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 683/1475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:35 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1529 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:36.241558 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-04d23c53-056e-481a-a1eb-a010ecd1f08f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:36.243884 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-04d23c53-056e-481a-a1eb-a010ecd1f08f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:36.249342 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-04d23c53-056e-481a-a1eb-a010ecd1f08f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:36.249649 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-04d23c53-056e-481a-a1eb-a010ecd1f08f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:36.250588 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-04d23c53-056e-481a-a1eb-a010ecd1f08f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:36.251283 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-04d23c53-056e-481a-a1eb-a010ecd1f08f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:36.438132 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-04d23c53-056e-481a-a1eb-a010ecd1f08f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:36.454143 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-04d23c53-056e-481a-a1eb-a010ecd1f08f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:36.455613 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-04d23c53-056e-481a-a1eb-a010ecd1f08f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:36.456815 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-04d23c53-056e-481a-a1eb-a010ecd1f08f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1486 microversion: 2.25 time: 0.220767 Mar 12 20:52:36.468612 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 684/1476] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:36 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1486 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:36.475500 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-60710787-8584-4436-a895-06e6561258bc tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:36.475980 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-60710787-8584-4436-a895-06e6561258bc tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:36.482560 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-60710787-8584-4436-a895-06e6561258bc tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:36.483044 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-60710787-8584-4436-a895-06e6561258bc tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:36.484439 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-60710787-8584-4436-a895-06e6561258bc tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:36.485197 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-60710787-8584-4436-a895-06e6561258bc tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:36.719930 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-60710787-8584-4436-a895-06e6561258bc tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:36.730736 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-60710787-8584-4436-a895-06e6561258bc tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 200 len: 1476 microversion: 2.1 time: 0.260668 Mar 12 20:52:36.743488 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 685/1477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:36 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:36.752165 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e3354091-34e8-404d-995d-26949e5f1b74 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:36.752792 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e3354091-34e8-404d-995d-26949e5f1b74 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:36.760030 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e3354091-34e8-404d-995d-26949e5f1b74 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:36.760494 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e3354091-34e8-404d-995d-26949e5f1b74 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:36.761531 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e3354091-34e8-404d-995d-26949e5f1b74 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:36.762167 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e3354091-34e8-404d-995d-26949e5f1b74 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:36.988323 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e3354091-34e8-404d-995d-26949e5f1b74 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:37.001268 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e3354091-34e8-404d-995d-26949e5f1b74 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 200 len: 1308 microversion: 2.1 time: 0.256211 Mar 12 20:52:37.002490 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 686/1478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:36 2022] GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:37.009116 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2e636803-26b9-493c-bb90-bd13dcce9cce tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:37.010761 ncdv-master-1 devstack@n-api.service[136303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:52:37.010761 ncdv-master-1 devstack@n-api.service[136303]: warnings.warn(msg) Mar 12 20:52:37.017528 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-2e636803-26b9-493c-bb90-bd13dcce9cce tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] HTTP exception thrown: Flavor c2272325-7bac-4d55-9284-a9385fdd6e35 could not be found. Mar 12 20:52:37.018466 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2e636803-26b9-493c-bb90-bd13dcce9cce tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Returning 404 to user: Flavor c2272325-7bac-4d55-9284-a9385fdd6e35 could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:52:37.025790 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2e636803-26b9-493c-bb90-bd13dcce9cce tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/c2272325-7bac-4d55-9284-a9385fdd6e35" status: 404 len: 109 microversion: 2.1 time: 0.021548 Mar 12 20:52:37.026944 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 687/1479] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:52:37 2022] DELETE /compute/v2.1/flavors/c2272325-7bac-4d55-9284-a9385fdd6e35 => generated 109 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:52:37.051070 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8ba4cbfe-b5f6-4715-9e70-8a896f7f5f37 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:37.058822 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8ba4cbfe-b5f6-4715-9e70-8a896f7f5f37 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:37.069799 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8ba4cbfe-b5f6-4715-9e70-8a896f7f5f37 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:37.070428 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8ba4cbfe-b5f6-4715-9e70-8a896f7f5f37 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:37.071327 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8ba4cbfe-b5f6-4715-9e70-8a896f7f5f37 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:37.071865 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8ba4cbfe-b5f6-4715-9e70-8a896f7f5f37 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:37.283755 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8ba4cbfe-b5f6-4715-9e70-8a896f7f5f37 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:37.291685 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8ba4cbfe-b5f6-4715-9e70-8a896f7f5f37 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.263296 Mar 12 20:52:37.302899 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 688/1480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:37 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:37.308890 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-53fc01a4-40c0-4295-a92e-5f1fa4b4a563 req-4937ffd7-16f7-499e-b07c-a865190beef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e67993b-4604-4f37-9543-3dc09be802e5", "name": "network-vif-plugged", "status": "completed", "tag": "3abbe775-9508-422a-826d-d481a507a318"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:37.318258 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-53fc01a4-40c0-4295-a92e-5f1fa4b4a563 req-4937ffd7-16f7-499e-b07c-a865190beef6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:37.318704 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-53fc01a4-40c0-4295-a92e-5f1fa4b4a563 req-4937ffd7-16f7-499e-b07c-a865190beef6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:37.339672 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-53fc01a4-40c0-4295-a92e-5f1fa4b4a563 req-4937ffd7-16f7-499e-b07c-a865190beef6 service nova] Creating event network-vif-plugged:3abbe775-9508-422a-826d-d481a507a318 for instance 8e67993b-4604-4f37-9543-3dc09be802e5 on nch1-master-1 Mar 12 20:52:37.347884 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-53fc01a4-40c0-4295-a92e-5f1fa4b4a563 req-4937ffd7-16f7-499e-b07c-a865190beef6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043667 Mar 12 20:52:37.349676 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 689/1481] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:37.355772 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5f2e114d-2c03-4b1c-a080-47fd4fde6070 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:37.356473 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5f2e114d-2c03-4b1c-a080-47fd4fde6070 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:37.363585 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5f2e114d-2c03-4b1c-a080-47fd4fde6070 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:37.363834 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5f2e114d-2c03-4b1c-a080-47fd4fde6070 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:37.365689 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5f2e114d-2c03-4b1c-a080-47fd4fde6070 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:37.365689 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5f2e114d-2c03-4b1c-a080-47fd4fde6070 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:37.583916 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5f2e114d-2c03-4b1c-a080-47fd4fde6070 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:37.599436 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5f2e114d-2c03-4b1c-a080-47fd4fde6070 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:37.600256 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5f2e114d-2c03-4b1c-a080-47fd4fde6070 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:37.601429 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5f2e114d-2c03-4b1c-a080-47fd4fde6070 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1739 microversion: 2.20 time: 0.250166 Mar 12 20:52:37.602026 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 690/1482] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:37 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:37.612128 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-a4eb83af-94af-4258-875d-4ce0e102ad5a req-7551ffb6-5852-43c1-8d11-085c77efc171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5531e5-b13c-4c68-98af-74a7ccfd7bcf", "tag": "0e6f8026-1053-415c-a2ed-d86d3cb58b07"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:37.626228 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-a4eb83af-94af-4258-875d-4ce0e102ad5a req-7551ffb6-5852-43c1-8d11-085c77efc171 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:37.626689 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-a4eb83af-94af-4258-875d-4ce0e102ad5a req-7551ffb6-5852-43c1-8d11-085c77efc171 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:37.638243 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-a4eb83af-94af-4258-875d-4ce0e102ad5a req-7551ffb6-5852-43c1-8d11-085c77efc171 service nova] Creating event network-changed:0e6f8026-1053-415c-a2ed-d86d3cb58b07 for instance ed5531e5-b13c-4c68-98af-74a7ccfd7bcf on nch2-master-1 Mar 12 20:52:37.642877 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-a4eb83af-94af-4258-875d-4ce0e102ad5a req-7551ffb6-5852-43c1-8d11-085c77efc171 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039741 Mar 12 20:52:37.643754 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 691/1483] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:37.649191 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1755248010", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:37.715352 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fa884d4d-050d-47b8-a1d7-e97c32e67957 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445" status: 200 len: 1423 microversion: 2.1 time: 11.223111 Mar 12 20:52:37.723180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 793/1484] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:26 2022] GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445 => generated 1423 bytes in 11232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:37.729033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2e4ed11d-2c29-48d5-9364-780d485739b7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:37.729667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2e4ed11d-2c29-48d5-9364-780d485739b7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:37.737019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e4ed11d-2c29-48d5-9364-780d485739b7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:37.737482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e4ed11d-2c29-48d5-9364-780d485739b7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:37.738386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e4ed11d-2c29-48d5-9364-780d485739b7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:37.739021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e4ed11d-2c29-48d5-9364-780d485739b7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:37.784816 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.neutron [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] validate_networks() for None {{(pid=136303) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:52:38.079075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2e4ed11d-2c29-48d5-9364-780d485739b7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:38.087439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2e4ed11d-2c29-48d5-9364-780d485739b7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:38.088916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2e4ed11d-2c29-48d5-9364-780d485739b7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:38.090134 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2e4ed11d-2c29-48d5-9364-780d485739b7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1486 microversion: 2.25 time: 0.365875 Mar 12 20:52:38.099993 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 794/1485] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:37 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1486 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:38.105051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a293216c-6f15-4694-ba55-3d76a986d854 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:38.105667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a293216c-6f15-4694-ba55-3d76a986d854 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:38.124990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a293216c-6f15-4694-ba55-3d76a986d854 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:38.125455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a293216c-6f15-4694-ba55-3d76a986d854 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:38.126296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a293216c-6f15-4694-ba55-3d76a986d854 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:38.126751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a293216c-6f15-4694-ba55-3d76a986d854 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:38.312267 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:52:38.312699 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:52:38.313179 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:52:38.313829 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:52:38.314406 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:52:38.340864 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:38.341396 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:38.346638 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:38.349097 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:38.423398 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Getting quotas for project d8057df76c4c4652a22bb659969dbb31. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:52:38.431127 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Getting quotas for user b404502bb19242c385bc7d6ca5bff2de and project d8057df76c4c4652a22bb659969dbb31. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:52:38.446380 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Going to run 1 instances... {{(pid=136303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:52:38.449697 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:52:38.537489 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-3e63d23c-2cce-4f4e-8f96-689ae07ad6fd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892341 Mar 12 20:52:38.545169 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 692/1486] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:52:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:52:38.556747 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-73be7c32-3454-4b0d-ad39-6289108d274d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:38.557372 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-73be7c32-3454-4b0d-ad39-6289108d274d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:38.565847 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73be7c32-3454-4b0d-ad39-6289108d274d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:38.566311 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73be7c32-3454-4b0d-ad39-6289108d274d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:38.567789 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73be7c32-3454-4b0d-ad39-6289108d274d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:38.569005 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-73be7c32-3454-4b0d-ad39-6289108d274d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:38.698805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a293216c-6f15-4694-ba55-3d76a986d854 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:38.711856 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a293216c-6f15-4694-ba55-3d76a986d854 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 200 len: 1476 microversion: 2.1 time: 0.610431 Mar 12 20:52:38.727867 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 795/1487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:38 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 1476 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:38.739990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-29dab4c5-2e0b-4f17-9c7e-6416d33abbef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:38.746561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-29dab4c5-2e0b-4f17-9c7e-6416d33abbef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:38.779688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29dab4c5-2e0b-4f17-9c7e-6416d33abbef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:38.783174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29dab4c5-2e0b-4f17-9c7e-6416d33abbef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:38.784191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29dab4c5-2e0b-4f17-9c7e-6416d33abbef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:38.786447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29dab4c5-2e0b-4f17-9c7e-6416d33abbef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:39.213412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-29dab4c5-2e0b-4f17-9c7e-6416d33abbef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:39.225006 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-29dab4c5-2e0b-4f17-9c7e-6416d33abbef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.495147 Mar 12 20:52:39.228977 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 796/1488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:38 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:39.240421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-edc610ef-caa9-49f7-9d7a-faef0d5e46c1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:39.242224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-edc610ef-caa9-49f7-9d7a-faef0d5e46c1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:39.355978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-edc610ef-caa9-49f7-9d7a-faef0d5e46c1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:39.365297 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-edc610ef-caa9-49f7-9d7a-faef0d5e46c1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1213 microversion: 2.1 time: 0.134317 Mar 12 20:52:39.369926 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 797/1489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:39 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1213 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:39.381463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-baca6a3c-8176-45b6-b00c-a313423e236c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:39.382337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-baca6a3c-8176-45b6-b00c-a313423e236c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:39.397065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-baca6a3c-8176-45b6-b00c-a313423e236c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:39.398517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-baca6a3c-8176-45b6-b00c-a313423e236c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:39.399352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-baca6a3c-8176-45b6-b00c-a313423e236c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:39.401532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-baca6a3c-8176-45b6-b00c-a313423e236c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:39.797356 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-73be7c32-3454-4b0d-ad39-6289108d274d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:39.806078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-baca6a3c-8176-45b6-b00c-a313423e236c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:39.810694 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-73be7c32-3454-4b0d-ad39-6289108d274d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 200 len: 1308 microversion: 2.1 time: 1.262935 Mar 12 20:52:39.822210 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 693/1490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:38 2022] GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 1308 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:39.824188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-baca6a3c-8176-45b6-b00c-a313423e236c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:39.825722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-baca6a3c-8176-45b6-b00c-a313423e236c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:39.835925 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-dd3c2c66-ae1f-4c05-b484-d555d1668055 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e36f310d0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:39.844328 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-baca6a3c-8176-45b6-b00c-a313423e236c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1721 microversion: 2.20 time: 0.472953 Mar 12 20:52:39.844939 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 798/1491] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:39 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1721 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:39.867421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-55dbe067-18c6-492c-b377-42c3b176bc42 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:39.868038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-55dbe067-18c6-492c-b377-42c3b176bc42 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:39.891343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55dbe067-18c6-492c-b377-42c3b176bc42 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:39.898190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55dbe067-18c6-492c-b377-42c3b176bc42 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:39.899046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55dbe067-18c6-492c-b377-42c3b176bc42 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:39.899507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55dbe067-18c6-492c-b377-42c3b176bc42 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:40.304200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-55dbe067-18c6-492c-b377-42c3b176bc42 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:40.313103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-55dbe067-18c6-492c-b377-42c3b176bc42 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:40.315384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-55dbe067-18c6-492c-b377-42c3b176bc42 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:40.317029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-55dbe067-18c6-492c-b377-42c3b176bc42 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1486 microversion: 2.25 time: 0.471159 Mar 12 20:52:40.318446 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 799/1492] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:39 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1486 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:40.323923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b5239e15-ac0c-435b-963b-1015b8aaeec8 req-24d7d4c0-7601-427a-b760-2c0ef6592b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e", "name": "network-vif-plugged", "status": "completed", "tag": "1326e734-666a-431b-bab6-8338bafdbcba"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:40.346466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b5239e15-ac0c-435b-963b-1015b8aaeec8 req-24d7d4c0-7601-427a-b760-2c0ef6592b2a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:40.346946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b5239e15-ac0c-435b-963b-1015b8aaeec8 req-24d7d4c0-7601-427a-b760-2c0ef6592b2a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:40.385017 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b5239e15-ac0c-435b-963b-1015b8aaeec8 req-24d7d4c0-7601-427a-b760-2c0ef6592b2a service nova] Creating event network-vif-plugged:1326e734-666a-431b-bab6-8338bafdbcba for instance 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e on nch2-master-1 Mar 12 20:52:40.398834 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b5239e15-ac0c-435b-963b-1015b8aaeec8 req-24d7d4c0-7601-427a-b760-2c0ef6592b2a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078893 Mar 12 20:52:40.404186 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 800/1493] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:40.424699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb54ab11-c326-44f7-883a-218b71046af4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:40.426722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb54ab11-c326-44f7-883a-218b71046af4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:40.452020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb54ab11-c326-44f7-883a-218b71046af4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:40.455069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb54ab11-c326-44f7-883a-218b71046af4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:40.465663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb54ab11-c326-44f7-883a-218b71046af4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:40.466684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb54ab11-c326-44f7-883a-218b71046af4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:40.599773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb54ab11-c326-44f7-883a-218b71046af4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:40.604126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb54ab11-c326-44f7-883a-218b71046af4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:40.605002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-bb54ab11-c326-44f7-883a-218b71046af4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lazy-loading 'fault' on Instance uuid d342f2eb-8870-4132-be47-59361a46149f {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:52:40.769664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bb54ab11-c326-44f7-883a-218b71046af4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:40.787150 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb54ab11-c326-44f7-883a-218b71046af4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 200 len: 1310 microversion: 2.1 time: 0.379207 Mar 12 20:52:40.804152 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 801/1494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:40 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 1310 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:40.885264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5923650a-5326-4186-b895-8ab14a661fe5 req-8055d3cb-7da6-4312-856b-823e2156beb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d342f2eb-8870-4132-be47-59361a46149f", "name": "network-vif-deleted", "tag": "ad184f30-9c5b-4778-b03b-c7497cbb2350"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:40.955313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5923650a-5326-4186-b895-8ab14a661fe5 req-8055d3cb-7da6-4312-856b-823e2156beb6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:40.955690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5923650a-5326-4186-b895-8ab14a661fe5 req-8055d3cb-7da6-4312-856b-823e2156beb6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:40.981359 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5923650a-5326-4186-b895-8ab14a661fe5 req-8055d3cb-7da6-4312-856b-823e2156beb6 service nova] Creating event network-vif-deleted:ad184f30-9c5b-4778-b03b-c7497cbb2350 for instance d342f2eb-8870-4132-be47-59361a46149f on nch1-master-1 Mar 12 20:52:41.046964 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5923650a-5326-4186-b895-8ab14a661fe5 req-8055d3cb-7da6-4312-856b-823e2156beb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238954 Mar 12 20:52:41.047884 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 802/1495] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:41.054549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-556e91f9-16b3-4aed-a45f-4279fbe6dfe6 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:41.063332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-556e91f9-16b3-4aed-a45f-4279fbe6dfe6 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:41.074762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-556e91f9-16b3-4aed-a45f-4279fbe6dfe6 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:41.086806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-556e91f9-16b3-4aed-a45f-4279fbe6dfe6 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:41.089807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-556e91f9-16b3-4aed-a45f-4279fbe6dfe6 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:41.093200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-556e91f9-16b3-4aed-a45f-4279fbe6dfe6 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:41.456345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-556e91f9-16b3-4aed-a45f-4279fbe6dfe6 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:41.466041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-556e91f9-16b3-4aed-a45f-4279fbe6dfe6 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.416788 Mar 12 20:52:41.480599 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 803/1496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:41 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:41.489342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26c353e0-98b5-4934-93ef-e8ad14350cc0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:41.490712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-26c353e0-98b5-4934-93ef-e8ad14350cc0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:41.526794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26c353e0-98b5-4934-93ef-e8ad14350cc0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:41.530172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26c353e0-98b5-4934-93ef-e8ad14350cc0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:41.531878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26c353e0-98b5-4934-93ef-e8ad14350cc0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:41.536526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26c353e0-98b5-4934-93ef-e8ad14350cc0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:41.732840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-26c353e0-98b5-4934-93ef-e8ad14350cc0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:41.748681 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-26c353e0-98b5-4934-93ef-e8ad14350cc0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1271 microversion: 2.1 time: 0.262985 Mar 12 20:52:41.756995 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 804/1497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:41 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1271 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:41.772309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b92816e1-7590-448a-8327-0abdcce92a64 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:41.776051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b92816e1-7590-448a-8327-0abdcce92a64 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:41.798029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b92816e1-7590-448a-8327-0abdcce92a64 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:41.799127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b92816e1-7590-448a-8327-0abdcce92a64 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:41.800142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b92816e1-7590-448a-8327-0abdcce92a64 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:41.800795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b92816e1-7590-448a-8327-0abdcce92a64 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:42.250772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b92816e1-7590-448a-8327-0abdcce92a64 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:42.261960 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b92816e1-7590-448a-8327-0abdcce92a64 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 200 len: 1308 microversion: 2.1 time: 0.503479 Mar 12 20:52:42.268063 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 805/1498] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:41 2022] GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:42.279541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1fa96e1-c6ac-45c6-a761-f0550c741790 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:42.280168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1fa96e1-c6ac-45c6-a761-f0550c741790 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:42.296989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1fa96e1-c6ac-45c6-a761-f0550c741790 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:42.299227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1fa96e1-c6ac-45c6-a761-f0550c741790 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:42.304244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1fa96e1-c6ac-45c6-a761-f0550c741790 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:42.304973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1fa96e1-c6ac-45c6-a761-f0550c741790 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:42.383094 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-dd3c2c66-ae1f-4c05-b484-d555d1668055 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445" status: 200 len: 1423 microversion: 2.1 time: 2.559351 Mar 12 20:52:42.384246 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 694/1499] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:39 2022] GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445 => generated 1423 bytes in 2561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:42.401748 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-238d624f-6b32-4b7e-b207-0a6b37991149 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:42.407497 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-238d624f-6b32-4b7e-b207-0a6b37991149 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:42.431281 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-238d624f-6b32-4b7e-b207-0a6b37991149 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:42.441108 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-238d624f-6b32-4b7e-b207-0a6b37991149 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:42.442368 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-238d624f-6b32-4b7e-b207-0a6b37991149 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:42.443665 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-238d624f-6b32-4b7e-b207-0a6b37991149 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:42.940782 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-238d624f-6b32-4b7e-b207-0a6b37991149 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:42.958528 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-238d624f-6b32-4b7e-b207-0a6b37991149 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:42.964091 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-238d624f-6b32-4b7e-b207-0a6b37991149 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:42.969223 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-238d624f-6b32-4b7e-b207-0a6b37991149 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1486 microversion: 2.25 time: 0.582286 Mar 12 20:52:42.972951 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 695/1500] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:42 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1486 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:42.988916 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-043e2f7c-45bc-4a22-8845-a022486b79b2 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:42.991137 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-043e2f7c-45bc-4a22-8845-a022486b79b2 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:43.013043 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-043e2f7c-45bc-4a22-8845-a022486b79b2 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:43.020312 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-043e2f7c-45bc-4a22-8845-a022486b79b2 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:43.023023 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-043e2f7c-45bc-4a22-8845-a022486b79b2 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:43.028999 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-043e2f7c-45bc-4a22-8845-a022486b79b2 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:43.080787 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-043e2f7c-45bc-4a22-8845-a022486b79b2 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] HTTP exception thrown: Instance d342f2eb-8870-4132-be47-59361a46149f could not be found. Mar 12 20:52:43.084501 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-043e2f7c-45bc-4a22-8845-a022486b79b2 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Returning 404 to user: Instance d342f2eb-8870-4132-be47-59361a46149f could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:52:43.087525 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-043e2f7c-45bc-4a22-8845-a022486b79b2 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 404 len: 111 microversion: 2.1 time: 0.110716 Mar 12 20:52:43.132136 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 696/1501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:42 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:52:43.231468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1fa96e1-c6ac-45c6-a761-f0550c741790 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:43.249793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1fa96e1-c6ac-45c6-a761-f0550c741790 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:43.257865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1fa96e1-c6ac-45c6-a761-f0550c741790 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:43.262246 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1fa96e1-c6ac-45c6-a761-f0550c741790 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1721 microversion: 2.20 time: 0.992388 Mar 12 20:52:43.273716 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-71521642", "imageRef": "3ff3e0a3-abf6-4dd2-8fa1-6b4fffebd2fc", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2e51969d-9efd-4751-b99e-371cc3caf724"}]}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:43.293507 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 806/1502] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:42 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1721 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:43.309166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6c9d4d29-aac5-4243-b49d-f583c238cd3a req-be9d16ad-b51b-4184-a1a3-22b2275ca346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae82842-58a0-4d5e-a522-a1c83c53e101", "name": "network-vif-unplugged", "status": "completed", "tag": "c40c686b-b640-42d0-a899-bda5e43f8663"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:43.334945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6c9d4d29-aac5-4243-b49d-f583c238cd3a req-be9d16ad-b51b-4184-a1a3-22b2275ca346 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:43.336498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6c9d4d29-aac5-4243-b49d-f583c238cd3a req-be9d16ad-b51b-4184-a1a3-22b2275ca346 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:43.370801 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6c9d4d29-aac5-4243-b49d-f583c238cd3a req-be9d16ad-b51b-4184-a1a3-22b2275ca346 service nova] Creating event network-vif-unplugged:c40c686b-b640-42d0-a899-bda5e43f8663 for instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 on nch2-master-1 Mar 12 20:52:43.400198 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.neutron [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] validate_networks() for [('2e51969d-9efd-4751-b99e-371cc3caf724', None, None, None, None, None)] {{(pid=136303) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:52:43.410085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6c9d4d29-aac5-4243-b49d-f583c238cd3a req-be9d16ad-b51b-4184-a1a3-22b2275ca346 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109565 Mar 12 20:52:43.411586 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 807/1503] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:43.423113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7511cef1-eec0-4a99-9740-8dcdd6192136 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:43.425051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7511cef1-eec0-4a99-9740-8dcdd6192136 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:43.434319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7511cef1-eec0-4a99-9740-8dcdd6192136 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:43.435523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7511cef1-eec0-4a99-9740-8dcdd6192136 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:43.437559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7511cef1-eec0-4a99-9740-8dcdd6192136 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:43.438934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7511cef1-eec0-4a99-9740-8dcdd6192136 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:43.751183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7511cef1-eec0-4a99-9740-8dcdd6192136 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:43.763602 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7511cef1-eec0-4a99-9740-8dcdd6192136 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.348881 Mar 12 20:52:43.764650 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 808/1504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:43 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:43.782257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7bbff15-1c8b-40d9-9eb5-6c0e46f3e0e8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:43.783667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a7bbff15-1c8b-40d9-9eb5-6c0e46f3e0e8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:43.797356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7bbff15-1c8b-40d9-9eb5-6c0e46f3e0e8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:43.798346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7bbff15-1c8b-40d9-9eb5-6c0e46f3e0e8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:43.799649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7bbff15-1c8b-40d9-9eb5-6c0e46f3e0e8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:43.800344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7bbff15-1c8b-40d9-9eb5-6c0e46f3e0e8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:44.096201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a7bbff15-1c8b-40d9-9eb5-6c0e46f3e0e8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:44.112067 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7bbff15-1c8b-40d9-9eb5-6c0e46f3e0e8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1313 microversion: 2.1 time: 0.329408 Mar 12 20:52:44.113223 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 809/1505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:43 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:44.126005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-30076940", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:44.204052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:52:45.025265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:52:45.025265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:52:45.025265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:52:45.025265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:52:45.025265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:52:45.028117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:45.028117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:45.028117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:45.028117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:45.028562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Getting quotas for project fdb3e4f8854b4ae9b4bba6d166d6a514. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:52:45.028562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Getting quotas for user 95f8d44de34e49b9b99622fb76159ab9 and project fdb3e4f8854b4ae9b4bba6d166d6a514. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:52:45.028562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:52:45.028828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:52:45.052276 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f44b0d9b-e8bd-4b35-8527-9f217e475788 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.932430 Mar 12 20:52:45.059516 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 810/1506] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:52:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:52:45.063751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5f7e0db2-b8c7-45c0-a850-b5a8cb12082e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:45.064381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5f7e0db2-b8c7-45c0-a850-b5a8cb12082e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:45.075277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f7e0db2-b8c7-45c0-a850-b5a8cb12082e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:45.077395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f7e0db2-b8c7-45c0-a850-b5a8cb12082e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:45.079659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f7e0db2-b8c7-45c0-a850-b5a8cb12082e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:45.080460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f7e0db2-b8c7-45c0-a850-b5a8cb12082e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:45.334595 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:52:45.335059 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:52:45.336460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:52:45.336460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:52:45.336460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:52:45.351004 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:45.351462 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:45.352272 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:45.352733 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:45.388570 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Getting quotas for project 6df0c010b1c1422d815a79929d733305. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:52:45.407070 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Getting quotas for user ff84008edbbb475ab7c31f57d2455b02 and project 6df0c010b1c1422d815a79929d733305. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:52:45.444135 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Going to run 1 instances... {{(pid=136303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:52:45.447182 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ff3e0a3-abf6-4dd2-8fa1-6b4fffebd2fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:52:45.529263 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-856ec32e-2ec0-4907-830f-57433c3819a0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.394594 Mar 12 20:52:45.532012 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 697/1507] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:52:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:52:45.544704 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fa019f55-cb68-4306-ab31-8f57bafb33ef tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e3701bca0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:45.635737 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fa019f55-cb68-4306-ab31-8f57bafb33ef tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445" status: 200 len: 1423 microversion: 2.1 time: 0.099105 Mar 12 20:52:45.638434 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 698/1508] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:45 2022] GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:45.646524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f7e0db2-b8c7-45c0-a850-b5a8cb12082e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:45.652794 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f437dcbb-a906-4b08-9020-d56e296f24bb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:45.654915 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f437dcbb-a906-4b08-9020-d56e296f24bb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:45.659060 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5f7e0db2-b8c7-45c0-a850-b5a8cb12082e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 200 len: 1489 microversion: 2.1 time: 0.600436 Mar 12 20:52:45.663824 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 811/1509] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:45 2022] GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 1489 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:45.677387 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f437dcbb-a906-4b08-9020-d56e296f24bb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:45.677965 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f437dcbb-a906-4b08-9020-d56e296f24bb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:45.680857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09eb02d3-f551-4c43-8c73-f5367c588142 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:45.681951 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f437dcbb-a906-4b08-9020-d56e296f24bb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:45.682700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-09eb02d3-f551-4c43-8c73-f5367c588142 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:45.686684 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f437dcbb-a906-4b08-9020-d56e296f24bb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:45.705314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09eb02d3-f551-4c43-8c73-f5367c588142 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:45.707288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09eb02d3-f551-4c43-8c73-f5367c588142 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:45.711592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09eb02d3-f551-4c43-8c73-f5367c588142 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:45.713245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09eb02d3-f551-4c43-8c73-f5367c588142 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:46.263286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09eb02d3-f551-4c43-8c73-f5367c588142 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:46.290192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09eb02d3-f551-4c43-8c73-f5367c588142 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:46.295702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09eb02d3-f551-4c43-8c73-f5367c588142 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:46.302101 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09eb02d3-f551-4c43-8c73-f5367c588142 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1664 microversion: 2.20 time: 0.635060 Mar 12 20:52:46.325527 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 812/1510] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:45 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1664 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:46.348522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16f13113-1d69-41e6-b7b6-b730778a9bb4 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:46.350571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16f13113-1d69-41e6-b7b6-b730778a9bb4 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:46.362510 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f437dcbb-a906-4b08-9020-d56e296f24bb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:46.371420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16f13113-1d69-41e6-b7b6-b730778a9bb4 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:46.373430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16f13113-1d69-41e6-b7b6-b730778a9bb4 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:46.375953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16f13113-1d69-41e6-b7b6-b730778a9bb4 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:46.376694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16f13113-1d69-41e6-b7b6-b730778a9bb4 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:46.387287 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f437dcbb-a906-4b08-9020-d56e296f24bb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:46.392070 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f437dcbb-a906-4b08-9020-d56e296f24bb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:46.398343 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f437dcbb-a906-4b08-9020-d56e296f24bb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1476 microversion: 2.25 time: 0.757208 Mar 12 20:52:46.399648 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 699/1511] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:45 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1476 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:46.413212 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5e911333-f2ba-4313-a60b-28189cb4181a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:46.417272 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5e911333-f2ba-4313-a60b-28189cb4181a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:46.434582 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5e911333-f2ba-4313-a60b-28189cb4181a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:46.436260 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5e911333-f2ba-4313-a60b-28189cb4181a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:46.438423 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5e911333-f2ba-4313-a60b-28189cb4181a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:46.440982 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5e911333-f2ba-4313-a60b-28189cb4181a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:46.612850 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5e911333-f2ba-4313-a60b-28189cb4181a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:46.625244 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5e911333-f2ba-4313-a60b-28189cb4181a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1270 microversion: 2.1 time: 0.222015 Mar 12 20:52:46.628241 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 700/1512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:46 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:46.639380 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-69161139-0abd-40ef-865c-25cc0b9c593e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:46.647116 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-69161139-0abd-40ef-865c-25cc0b9c593e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:46.660932 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-69161139-0abd-40ef-865c-25cc0b9c593e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:46.664557 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-69161139-0abd-40ef-865c-25cc0b9c593e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:46.667537 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-69161139-0abd-40ef-865c-25cc0b9c593e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:46.668225 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-69161139-0abd-40ef-865c-25cc0b9c593e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:46.781104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16f13113-1d69-41e6-b7b6-b730778a9bb4 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:46.791633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16f13113-1d69-41e6-b7b6-b730778a9bb4 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.464423 Mar 12 20:52:46.799027 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 813/1513] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:46 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:46.812183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-76550420-86c5-4514-8a7d-dd7d00b30431 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:46.814125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-76550420-86c5-4514-8a7d-dd7d00b30431 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:46.833616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76550420-86c5-4514-8a7d-dd7d00b30431 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:46.834793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76550420-86c5-4514-8a7d-dd7d00b30431 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:46.836445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76550420-86c5-4514-8a7d-dd7d00b30431 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:46.838627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76550420-86c5-4514-8a7d-dd7d00b30431 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:46.991694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-76550420-86c5-4514-8a7d-dd7d00b30431 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:47.004967 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-76550420-86c5-4514-8a7d-dd7d00b30431 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1224 microversion: 2.1 time: 0.203782 Mar 12 20:52:47.009827 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 814/1514] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:46 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1224 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:47.023714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94000276-f79c-413a-8dfe-f32dd3ae4cd1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:47.024678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94000276-f79c-413a-8dfe-f32dd3ae4cd1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:47.041640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94000276-f79c-413a-8dfe-f32dd3ae4cd1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:47.042677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94000276-f79c-413a-8dfe-f32dd3ae4cd1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:47.046612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94000276-f79c-413a-8dfe-f32dd3ae4cd1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:47.047814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94000276-f79c-413a-8dfe-f32dd3ae4cd1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:47.138572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-94000276-f79c-413a-8dfe-f32dd3ae4cd1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lazy-loading 'flavor' on Instance uuid 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:52:47.317356 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94000276-f79c-413a-8dfe-f32dd3ae4cd1 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "POST /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.305880 Mar 12 20:52:47.326416 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 815/1515] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:52:47 2022] POST /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:52:47.355772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d0a0ca68-1a0f-4f86-a930-db43f1dee128 req-414d99eb-9f88-4b6f-8704-084a011fbebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cda4959-0935-4359-bc30-ae11abe0563e", "tag": "349eb111-c3f6-4006-b907-369238df3d63"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:47.382275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d0a0ca68-1a0f-4f86-a930-db43f1dee128 req-414d99eb-9f88-4b6f-8704-084a011fbebe service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:47.394441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d0a0ca68-1a0f-4f86-a930-db43f1dee128 req-414d99eb-9f88-4b6f-8704-084a011fbebe service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:47.432528 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d0a0ca68-1a0f-4f86-a930-db43f1dee128 req-414d99eb-9f88-4b6f-8704-084a011fbebe service nova] Creating event network-changed:349eb111-c3f6-4006-b907-369238df3d63 for instance 3cda4959-0935-4359-bc30-ae11abe0563e on nch1-master-1 Mar 12 20:52:47.436314 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-69161139-0abd-40ef-865c-25cc0b9c593e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:47.444883 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d0a0ca68-1a0f-4f86-a930-db43f1dee128 req-414d99eb-9f88-4b6f-8704-084a011fbebe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116041 Mar 12 20:52:47.446396 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 816/1516] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:47.449543 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-69161139-0abd-40ef-865c-25cc0b9c593e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1313 microversion: 2.1 time: 0.819864 Mar 12 20:52:47.455143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9a5bb51-654a-49db-959d-3817948b22f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c01ce6d-3ce1-40f2-b374-ddff1153114b"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:47.456559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9a5bb51-654a-49db-959d-3817948b22f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:47.463892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9a5bb51-654a-49db-959d-3817948b22f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:47.464084 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 701/1517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:46 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1313 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:47.464687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9a5bb51-654a-49db-959d-3817948b22f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:47.466939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9a5bb51-654a-49db-959d-3817948b22f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:47.469320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9a5bb51-654a-49db-959d-3817948b22f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:47.476542 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e1c370e3-c15c-42fb-b90f-2f17cd7addbe tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '.version_select at 0x7f6e3701bca0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:47.480509 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e1c370e3-c15c-42fb-b90f-2f17cd7addbe tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:47.487822 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e1c370e3-c15c-42fb-b90f-2f17cd7addbe tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:47.522367 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e1c370e3-c15c-42fb-b90f-2f17cd7addbe tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 4891 microversion: 2.25 time: 0.056827 Mar 12 20:52:47.523786 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 702/1518] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Mar 12 20:52:47 2022] GET /compute/v2.1/os-migrations => generated 4891 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:47.532467 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4b67e8a7-ebe9-48bf-a48f-c08033954dbb tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e36e768b0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:47.630002 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4b67e8a7-ebe9-48bf-a48f-c08033954dbb tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445" status: 200 len: 1423 microversion: 2.1 time: 0.101366 Mar 12 20:52:47.633365 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 703/1519] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:47 2022] GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445 => generated 1423 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:47.643117 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-76a60a41-c88f-451a-8004-007342689c66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:47.647920 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-76a60a41-c88f-451a-8004-007342689c66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:47.667612 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-76a60a41-c88f-451a-8004-007342689c66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:47.668173 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-76a60a41-c88f-451a-8004-007342689c66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:47.669828 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-76a60a41-c88f-451a-8004-007342689c66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:47.678335 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-76a60a41-c88f-451a-8004-007342689c66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:48.066174 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9a5bb51-654a-49db-959d-3817948b22f2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "POST /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.616744 Mar 12 20:52:48.071123 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 817/1520] 10.222.0.30 () {62 vars in 1363 bytes} [Sat Mar 12 20:52:47 2022] POST /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/os-volume_attachments => generated 188 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:52:48.093981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ffa49242-6a02-47e1-9935-b2d346e2a4f4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:48.095772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ffa49242-6a02-47e1-9935-b2d346e2a4f4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:48.113597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffa49242-6a02-47e1-9935-b2d346e2a4f4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:48.115703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffa49242-6a02-47e1-9935-b2d346e2a4f4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:48.117703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffa49242-6a02-47e1-9935-b2d346e2a4f4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:48.118831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffa49242-6a02-47e1-9935-b2d346e2a4f4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:48.547522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-ffa49242-6a02-47e1-9935-b2d346e2a4f4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] Lazy-loading 'services' on Instance uuid ed5531e5-b13c-4c68-98af-74a7ccfd7bcf {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:52:48.596623 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ffa49242-6a02-47e1-9935-b2d346e2a4f4 tempest-LiveAutoBlockMigrationV225Test-1672002157 tempest-LiveAutoBlockMigrationV225Test-1672002157-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1968 microversion: 2.25 time: 0.517007 Mar 12 20:52:48.598931 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 818/1521] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:48 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1968 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:48.606422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d589016a-a8db-4965-a725-91be7ef17ee7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:48.607264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d589016a-a8db-4965-a725-91be7ef17ee7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:48.642555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d589016a-a8db-4965-a725-91be7ef17ee7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:48.644030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d589016a-a8db-4965-a725-91be7ef17ee7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:48.645135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d589016a-a8db-4965-a725-91be7ef17ee7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:48.645899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d589016a-a8db-4965-a725-91be7ef17ee7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:48.784198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d589016a-a8db-4965-a725-91be7ef17ee7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:48.802044 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d589016a-a8db-4965-a725-91be7ef17ee7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1276 microversion: 2.1 time: 0.201167 Mar 12 20:52:48.803628 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 819/1522] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:48 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:48.809909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa5a6032-16e8-4f26-b3a2-80e5e3a67371 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:48.811114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aa5a6032-16e8-4f26-b3a2-80e5e3a67371 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:48.822343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa5a6032-16e8-4f26-b3a2-80e5e3a67371 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:48.823387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa5a6032-16e8-4f26-b3a2-80e5e3a67371 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:48.825281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa5a6032-16e8-4f26-b3a2-80e5e3a67371 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:48.826028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa5a6032-16e8-4f26-b3a2-80e5e3a67371 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:49.027993 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-76a60a41-c88f-451a-8004-007342689c66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:49.041157 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-76a60a41-c88f-451a-8004-007342689c66 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 200 len: 1497 microversion: 2.1 time: 1.406456 Mar 12 20:52:49.049201 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 704/1523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:47 2022] GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 1497 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:49.064447 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c2848b44-69d5-451a-a878-88ecb7de6e5e tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:49.065696 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c2848b44-69d5-451a-a878-88ecb7de6e5e tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:49.080745 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c2848b44-69d5-451a-a878-88ecb7de6e5e tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:49.087238 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c2848b44-69d5-451a-a878-88ecb7de6e5e tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:49.090188 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c2848b44-69d5-451a-a878-88ecb7de6e5e tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:49.094359 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c2848b44-69d5-451a-a878-88ecb7de6e5e tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:49.098613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aa5a6032-16e8-4f26-b3a2-80e5e3a67371 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:49.118406 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aa5a6032-16e8-4f26-b3a2-80e5e3a67371 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.312858 Mar 12 20:52:49.132671 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 820/1524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:48 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:49.147097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dbf7b736-0d57-48cf-bfe2-aa5d2af78468 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:49.149023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dbf7b736-0d57-48cf-bfe2-aa5d2af78468 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:49.160047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbf7b736-0d57-48cf-bfe2-aa5d2af78468 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:49.160720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbf7b736-0d57-48cf-bfe2-aa5d2af78468 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:49.161877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbf7b736-0d57-48cf-bfe2-aa5d2af78468 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:49.162436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbf7b736-0d57-48cf-bfe2-aa5d2af78468 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:49.332821 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c2848b44-69d5-451a-a878-88ecb7de6e5e tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:49.344111 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c2848b44-69d5-451a-a878-88ecb7de6e5e tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1278 microversion: 2.1 time: 0.292739 Mar 12 20:52:49.360756 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dbf7b736-0d57-48cf-bfe2-aa5d2af78468 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "POST /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/action" status: 202 len: 0 microversion: 2.20 time: 0.219220 Mar 12 20:52:49.360756 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 821/1525] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 20:52:49 2022] POST /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:52:49.361465 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 705/1526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:49 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1278 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:49.364182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d375fbf1-f632-4073-b7fb-afe4f8dc51a7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:49.364868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d375fbf1-f632-4073-b7fb-afe4f8dc51a7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:49.369230 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:49.375776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d375fbf1-f632-4073-b7fb-afe4f8dc51a7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:49.376705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d375fbf1-f632-4073-b7fb-afe4f8dc51a7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:49.378851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d375fbf1-f632-4073-b7fb-afe4f8dc51a7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:49.379326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d375fbf1-f632-4073-b7fb-afe4f8dc51a7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:49.380404 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:49.402579 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:49.403415 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:49.404796 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:49.405393 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:49.479266 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:52:49.685334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d375fbf1-f632-4073-b7fb-afe4f8dc51a7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:49.697301 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d375fbf1-f632-4073-b7fb-afe4f8dc51a7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1313 microversion: 2.1 time: 0.338777 Mar 12 20:52:49.705647 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 822/1527] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:49 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:49.713494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5f3448a-1385-4b8e-a52f-5070dea64d0c tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e36d5be50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:49.720173 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-a7fbe52d-e51d-4a3d-b931-ce79e4cb25d8 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 204 len: 0 microversion: 2.25 time: 0.357053 Mar 12 20:52:49.721343 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 706/1528] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:52:49 2022] DELETE /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:52:49.735551 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e65d34ab-a0a2-4dd1-8b92-9e1df01ecf6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:49.737403 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e65d34ab-a0a2-4dd1-8b92-9e1df01ecf6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:49.750020 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e65d34ab-a0a2-4dd1-8b92-9e1df01ecf6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:49.751942 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e65d34ab-a0a2-4dd1-8b92-9e1df01ecf6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:49.753075 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e65d34ab-a0a2-4dd1-8b92-9e1df01ecf6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:49.753860 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e65d34ab-a0a2-4dd1-8b92-9e1df01ecf6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:50.675445 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e65d34ab-a0a2-4dd1-8b92-9e1df01ecf6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:50.697027 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e65d34ab-a0a2-4dd1-8b92-9e1df01ecf6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:50.699350 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-e65d34ab-a0a2-4dd1-8b92-9e1df01ecf6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:50.700686 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e65d34ab-a0a2-4dd1-8b92-9e1df01ecf6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1750 microversion: 2.20 time: 0.977938 Mar 12 20:52:50.701605 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 707/1529] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:49 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1750 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:50.708756 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-21d44f73-e394-462e-9a35-3636f2d83b90 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:50.709670 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-21d44f73-e394-462e-9a35-3636f2d83b90 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:50.720224 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21d44f73-e394-462e-9a35-3636f2d83b90 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:50.721138 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21d44f73-e394-462e-9a35-3636f2d83b90 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:50.722372 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21d44f73-e394-462e-9a35-3636f2d83b90 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:50.724392 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21d44f73-e394-462e-9a35-3636f2d83b90 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:51.624237 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-21d44f73-e394-462e-9a35-3636f2d83b90 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:51.648665 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-21d44f73-e394-462e-9a35-3636f2d83b90 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:51.656433 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-21d44f73-e394-462e-9a35-3636f2d83b90 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:51.676218 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-21d44f73-e394-462e-9a35-3636f2d83b90 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 200 len: 1482 microversion: 2.25 time: 0.972175 Mar 12 20:52:51.698770 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 708/1530] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:50 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 1482 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:51.718738 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-dfdcb2f8-e67b-4a7a-a097-c9fa26226c3d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:51.719470 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-dfdcb2f8-e67b-4a7a-a097-c9fa26226c3d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:51.731506 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dfdcb2f8-e67b-4a7a-a097-c9fa26226c3d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:51.731966 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dfdcb2f8-e67b-4a7a-a097-c9fa26226c3d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:51.736936 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dfdcb2f8-e67b-4a7a-a097-c9fa26226c3d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:51.737423 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-dfdcb2f8-e67b-4a7a-a097-c9fa26226c3d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:52.790975 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-dfdcb2f8-e67b-4a7a-a097-c9fa26226c3d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:52.843357 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-dfdcb2f8-e67b-4a7a-a097-c9fa26226c3d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1318 microversion: 2.1 time: 1.137407 Mar 12 20:52:52.864058 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 709/1531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:51 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1318 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:52.869517 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-47d6f172-5bad-424f-b157-e3ca8e8090bc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:52.870099 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-47d6f172-5bad-424f-b157-e3ca8e8090bc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:52.894316 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-47d6f172-5bad-424f-b157-e3ca8e8090bc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:52.896217 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-47d6f172-5bad-424f-b157-e3ca8e8090bc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:52.897835 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-47d6f172-5bad-424f-b157-e3ca8e8090bc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:52.898681 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-47d6f172-5bad-424f-b157-e3ca8e8090bc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:54.075737 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-47d6f172-5bad-424f-b157-e3ca8e8090bc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:54.092614 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-47d6f172-5bad-424f-b157-e3ca8e8090bc tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 200 len: 1480 microversion: 2.1 time: 1.220401 Mar 12 20:52:54.093490 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 710/1532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:52 2022] GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 1480 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:54.098998 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-00cc5c2a-39ec-4a88-a073-e6e1c9b4a017 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:54.102417 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-00cc5c2a-39ec-4a88-a073-e6e1c9b4a017 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:54.118847 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-00cc5c2a-39ec-4a88-a073-e6e1c9b4a017 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:54.119898 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-00cc5c2a-39ec-4a88-a073-e6e1c9b4a017 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:54.121073 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-00cc5c2a-39ec-4a88-a073-e6e1c9b4a017 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:54.123092 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-00cc5c2a-39ec-4a88-a073-e6e1c9b4a017 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:55.351657 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-00cc5c2a-39ec-4a88-a073-e6e1c9b4a017 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:55.390383 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-00cc5c2a-39ec-4a88-a073-e6e1c9b4a017 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 1.275068 Mar 12 20:52:55.428849 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 711/1533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:54 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:55.451753 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d4e82c95-e401-48d6-85e5-11f25c7ac5eb tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:55.454621 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d4e82c95-e401-48d6-85e5-11f25c7ac5eb tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:55.474497 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d4e82c95-e401-48d6-85e5-11f25c7ac5eb tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:55.475482 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d4e82c95-e401-48d6-85e5-11f25c7ac5eb tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:55.476667 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d4e82c95-e401-48d6-85e5-11f25c7ac5eb tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:55.477440 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d4e82c95-e401-48d6-85e5-11f25c7ac5eb tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:56.615604 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-d4e82c95-e401-48d6-85e5-11f25c7ac5eb tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:56.629232 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d4e82c95-e401-48d6-85e5-11f25c7ac5eb tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1320 microversion: 2.1 time: 1.198721 Mar 12 20:52:56.631551 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 712/1534] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:55 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1320 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:56.648974 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8dedbb8c-01c8-401c-a8ac-074d05b5dbe7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:56.649616 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8dedbb8c-01c8-401c-a8ac-074d05b5dbe7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:56.671550 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8dedbb8c-01c8-401c-a8ac-074d05b5dbe7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:56.672060 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8dedbb8c-01c8-401c-a8ac-074d05b5dbe7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:56.674017 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8dedbb8c-01c8-401c-a8ac-074d05b5dbe7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:56.675765 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8dedbb8c-01c8-401c-a8ac-074d05b5dbe7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:56.834299 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c5f3448a-1385-4b8e-a52f-5070dea64d0c tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445" status: 200 len: 1432 microversion: 2.1 time: 7.125085 Mar 12 20:52:56.836649 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 823/1535] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:49 2022] GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445 => generated 1432 bytes in 7130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:56.849086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1bb925cd-223d-4696-be67-1efd48b2a3f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:56.850346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1bb925cd-223d-4696-be67-1efd48b2a3f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:56.859572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bb925cd-223d-4696-be67-1efd48b2a3f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:56.863243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bb925cd-223d-4696-be67-1efd48b2a3f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:56.864682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bb925cd-223d-4696-be67-1efd48b2a3f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:56.865789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bb925cd-223d-4696-be67-1efd48b2a3f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:57.390192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1bb925cd-223d-4696-be67-1efd48b2a3f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:57.402410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1bb925cd-223d-4696-be67-1efd48b2a3f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:57.405675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1bb925cd-223d-4696-be67-1efd48b2a3f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:57.407394 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1bb925cd-223d-4696-be67-1efd48b2a3f3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1750 microversion: 2.20 time: 0.567430 Mar 12 20:52:57.408215 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 824/1536] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:56 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1750 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:57.419063 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8dedbb8c-01c8-401c-a8ac-074d05b5dbe7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:57.422322 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8dedbb8c-01c8-401c-a8ac-074d05b5dbe7 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1313 microversion: 2.1 time: 0.787555 Mar 12 20:52:57.422916 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 713/1537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:56 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1313 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:57.425362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e3c77a97-82f2-4e48-8d80-a5b4cf4d357e req-8a0879eb-3d6a-472d-8614-e117995a3473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5531e5-b13c-4c68-98af-74a7ccfd7bcf", "name": "network-vif-deleted", "tag": "0e6f8026-1053-415c-a2ed-d86d3cb58b07"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:57.434676 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9927cc0b-0a1e-4799-af23-c174f5d77cc0 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:57.435290 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9927cc0b-0a1e-4799-af23-c174f5d77cc0 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: ed5531e5-b13c-4c68-98af-74a7ccfd7bcf] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:57.443314 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9927cc0b-0a1e-4799-af23-c174f5d77cc0 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:57.443695 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9927cc0b-0a1e-4799-af23-c174f5d77cc0 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:57.445974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e3c77a97-82f2-4e48-8d80-a5b4cf4d357e req-8a0879eb-3d6a-472d-8614-e117995a3473 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:57.446482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e3c77a97-82f2-4e48-8d80-a5b4cf4d357e req-8a0879eb-3d6a-472d-8614-e117995a3473 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:57.453238 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9927cc0b-0a1e-4799-af23-c174f5d77cc0 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:57.455911 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9927cc0b-0a1e-4799-af23-c174f5d77cc0 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:57.469322 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e3c77a97-82f2-4e48-8d80-a5b4cf4d357e req-8a0879eb-3d6a-472d-8614-e117995a3473 service nova] Creating event network-vif-deleted:0e6f8026-1053-415c-a2ed-d86d3cb58b07 for instance ed5531e5-b13c-4c68-98af-74a7ccfd7bcf on nch1-master-1 Mar 12 20:52:57.475021 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e3c77a97-82f2-4e48-8d80-a5b4cf4d357e req-8a0879eb-3d6a-472d-8614-e117995a3473 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054009 Mar 12 20:52:57.476175 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 825/1538] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:57.486661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72fc7cdc-f749-4145-80e1-a63925374f93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:57.487789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-72fc7cdc-f749-4145-80e1-a63925374f93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:57.493213 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-9927cc0b-0a1e-4799-af23-c174f5d77cc0 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] HTTP exception thrown: Instance ed5531e5-b13c-4c68-98af-74a7ccfd7bcf could not be found. Mar 12 20:52:57.494354 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9927cc0b-0a1e-4799-af23-c174f5d77cc0 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Returning 404 to user: Instance ed5531e5-b13c-4c68-98af-74a7ccfd7bcf could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:52:57.495752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72fc7cdc-f749-4145-80e1-a63925374f93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:57.496782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72fc7cdc-f749-4145-80e1-a63925374f93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:57.497151 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9927cc0b-0a1e-4799-af23-c174f5d77cc0 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf" status: 404 len: 111 microversion: 2.25 time: 0.072259 Mar 12 20:52:57.498225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72fc7cdc-f749-4145-80e1-a63925374f93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:57.499643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72fc7cdc-f749-4145-80e1-a63925374f93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:57.500096 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 714/1539] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:57 2022] GET /compute/v2.1/servers/ed5531e5-b13c-4c68-98af-74a7ccfd7bcf => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:52:57.507897 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-296d93ef-be84-4fb4-bc54-3dcbe83adb17 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-469749412"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:57.515752 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-296d93ef-be84-4fb4-bc54-3dcbe83adb17 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:57.536379 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-296d93ef-be84-4fb4-bc54-3dcbe83adb17 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:57.537076 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-296d93ef-be84-4fb4-bc54-3dcbe83adb17 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:57.538145 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-296d93ef-be84-4fb4-bc54-3dcbe83adb17 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:57.538808 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-296d93ef-be84-4fb4-bc54-3dcbe83adb17 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:57.849727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-72fc7cdc-f749-4145-80e1-a63925374f93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:57.870527 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72fc7cdc-f749-4145-80e1-a63925374f93 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1318 microversion: 2.1 time: 0.391297 Mar 12 20:52:57.871563 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 826/1540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:57 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:57.887810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-539d7d7f-841c-4f6e-8cd7-57bd56103cd6 req-6474aa3f-700c-49e2-b7f3-2302797636ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce767e86-64a8-47b9-bae8-145d5819b6d9", "name": "network-vif-unplugged", "status": "completed", "tag": "bd88fe22-49b2-448f-9a9c-b38f6c74e1ba"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:57.900560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-539d7d7f-841c-4f6e-8cd7-57bd56103cd6 req-6474aa3f-700c-49e2-b7f3-2302797636ad service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:57.901024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-539d7d7f-841c-4f6e-8cd7-57bd56103cd6 req-6474aa3f-700c-49e2-b7f3-2302797636ad service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:57.936886 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-539d7d7f-841c-4f6e-8cd7-57bd56103cd6 req-6474aa3f-700c-49e2-b7f3-2302797636ad service nova] Creating event network-vif-unplugged:bd88fe22-49b2-448f-9a9c-b38f6c74e1ba for instance ce767e86-64a8-47b9-bae8-145d5819b6d9 on nch2-master-1 Mar 12 20:52:57.957939 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-539d7d7f-841c-4f6e-8cd7-57bd56103cd6 req-6474aa3f-700c-49e2-b7f3-2302797636ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080767 Mar 12 20:52:57.959117 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 827/1541] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:57.974447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c89ff514-1143-47db-b36a-5d08b2867c35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:57.975229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c89ff514-1143-47db-b36a-5d08b2867c35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:57.994206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c89ff514-1143-47db-b36a-5d08b2867c35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:57.995383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c89ff514-1143-47db-b36a-5d08b2867c35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:57.997441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c89ff514-1143-47db-b36a-5d08b2867c35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:57.998773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c89ff514-1143-47db-b36a-5d08b2867c35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:58.229276 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-296d93ef-be84-4fb4-bc54-3dcbe83adb17 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "POST /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e/action" status: 202 len: 0 microversion: 2.1 time: 0.727180 Mar 12 20:52:58.240667 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 715/1542] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:52:57 2022] POST /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 12 20:52:58.250054 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2aa31ab4-1144-46f3-b7cf-809e2d8a2e7f tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e36ea81f0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:58.343829 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2aa31ab4-1144-46f3-b7cf-809e2d8a2e7f tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445" status: 200 len: 1432 microversion: 2.1 time: 0.100831 Mar 12 20:52:58.345052 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 716/1543] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:58 2022] GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445 => generated 1432 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:58.356637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c89ff514-1143-47db-b36a-5d08b2867c35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:58.360810 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-d6f43c0d-8a48-474e-b33b-c4cc9777d6ea req-1bce204f-7685-4ce3-b79c-a0dfc40703d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda4959-0935-4359-bc30-ae11abe0563e", "name": "network-vif-plugged", "status": "completed", "tag": "349eb111-c3f6-4006-b907-369238df3d63"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:52:58.366763 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c89ff514-1143-47db-b36a-5d08b2867c35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.405635 Mar 12 20:52:58.377360 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 828/1544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:57 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:58.377360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-82a97ffc-5e47-47ac-bd72-0c0addfd231d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:58.377360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-82a97ffc-5e47-47ac-bd72-0c0addfd231d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:58.386942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82a97ffc-5e47-47ac-bd72-0c0addfd231d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:58.388396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82a97ffc-5e47-47ac-bd72-0c0addfd231d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:58.389274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82a97ffc-5e47-47ac-bd72-0c0addfd231d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:58.389819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82a97ffc-5e47-47ac-bd72-0c0addfd231d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:58.414561 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-d6f43c0d-8a48-474e-b33b-c4cc9777d6ea req-1bce204f-7685-4ce3-b79c-a0dfc40703d2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:58.416867 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-d6f43c0d-8a48-474e-b33b-c4cc9777d6ea req-1bce204f-7685-4ce3-b79c-a0dfc40703d2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:58.452185 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-d6f43c0d-8a48-474e-b33b-c4cc9777d6ea req-1bce204f-7685-4ce3-b79c-a0dfc40703d2 service nova] Creating event network-vif-plugged:349eb111-c3f6-4006-b907-369238df3d63 for instance 3cda4959-0935-4359-bc30-ae11abe0563e on nch1-master-1 Mar 12 20:52:58.479722 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-d6f43c0d-8a48-474e-b33b-c4cc9777d6ea req-1bce204f-7685-4ce3-b79c-a0dfc40703d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119932 Mar 12 20:52:58.486816 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 717/1545] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:58.521800 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f428abfe-976a-41b8-9d91-ba06fa973ffd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36e64af0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:58.616561 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f428abfe-976a-41b8-9d91-ba06fa973ffd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31" status: 200 len: 1437 microversion: 2.1 time: 0.116456 Mar 12 20:52:58.618337 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 718/1546] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:58 2022] GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31 => generated 1437 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:58.637014 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-59b0fbb3-480e-4e1e-aa9b-c0216a451e8d tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:58.638209 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-59b0fbb3-480e-4e1e-aa9b-c0216a451e8d tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:58.654497 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-59b0fbb3-480e-4e1e-aa9b-c0216a451e8d tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:58.656327 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-59b0fbb3-480e-4e1e-aa9b-c0216a451e8d tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:58.657233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-82a97ffc-5e47-47ac-bd72-0c0addfd231d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:58.657803 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-59b0fbb3-480e-4e1e-aa9b-c0216a451e8d tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:58.658412 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-59b0fbb3-480e-4e1e-aa9b-c0216a451e8d tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:58.677566 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-82a97ffc-5e47-47ac-bd72-0c0addfd231d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1320 microversion: 2.1 time: 0.307534 Mar 12 20:52:58.678338 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 829/1547] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:58 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1320 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:58.683872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-68c84b84-3c42-4e77-9fc8-56eb2352ae3e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:58.687230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-68c84b84-3c42-4e77-9fc8-56eb2352ae3e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:58.701611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c84b84-3c42-4e77-9fc8-56eb2352ae3e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:58.703041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c84b84-3c42-4e77-9fc8-56eb2352ae3e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:58.704903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c84b84-3c42-4e77-9fc8-56eb2352ae3e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:58.706694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c84b84-3c42-4e77-9fc8-56eb2352ae3e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:59.137298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-68c84b84-3c42-4e77-9fc8-56eb2352ae3e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:59.153458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-68c84b84-3c42-4e77-9fc8-56eb2352ae3e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:59.157610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-68c84b84-3c42-4e77-9fc8-56eb2352ae3e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:59.159742 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-68c84b84-3c42-4e77-9fc8-56eb2352ae3e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1752 microversion: 2.20 time: 0.479846 Mar 12 20:52:59.161934 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 830/1548] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:58 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1752 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:52:59.169635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23ab6e0a-9b7b-46be-b50b-10d7a26697b0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:59.170554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-23ab6e0a-9b7b-46be-b50b-10d7a26697b0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:59.172086 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-59b0fbb3-480e-4e1e-aa9b-c0216a451e8d tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:59.181818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23ab6e0a-9b7b-46be-b50b-10d7a26697b0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:59.183034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23ab6e0a-9b7b-46be-b50b-10d7a26697b0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:59.184143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23ab6e0a-9b7b-46be-b50b-10d7a26697b0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:59.184738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23ab6e0a-9b7b-46be-b50b-10d7a26697b0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:59.190982 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-59b0fbb3-480e-4e1e-aa9b-c0216a451e8d tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1466 microversion: 2.1 time: 0.569928 Mar 12 20:52:59.191795 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 719/1549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:58 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1466 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:59.203818 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-314c71ca-df58-422a-a513-89630c8ef0cd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:59.204321 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-314c71ca-df58-422a-a513-89630c8ef0cd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:59.210932 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-314c71ca-df58-422a-a513-89630c8ef0cd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:59.211451 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-314c71ca-df58-422a-a513-89630c8ef0cd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:59.212176 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-314c71ca-df58-422a-a513-89630c8ef0cd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:59.212611 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-314c71ca-df58-422a-a513-89630c8ef0cd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:59.274383 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-314c71ca-df58-422a-a513-89630c8ef0cd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:52:59.455419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-23ab6e0a-9b7b-46be-b50b-10d7a26697b0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:59.464559 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-314c71ca-df58-422a-a513-89630c8ef0cd tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 204 len: 0 microversion: 2.25 time: 0.270510 Mar 12 20:52:59.469563 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 720/1550] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:52:59 2022] DELETE /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:52:59.473182 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-23ab6e0a-9b7b-46be-b50b-10d7a26697b0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1313 microversion: 2.1 time: 0.308799 Mar 12 20:52:59.474459 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 831/1551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:59 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:59.481422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a33720a5-b39d-4b65-9953-92f88b1e9128 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e440344c0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:59.489591 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-683495d7-b748-4a8e-8111-ad8a1f2576de tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:59.491060 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-683495d7-b748-4a8e-8111-ad8a1f2576de tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:59.502422 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-683495d7-b748-4a8e-8111-ad8a1f2576de tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:59.503211 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-683495d7-b748-4a8e-8111-ad8a1f2576de tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:59.504347 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-683495d7-b748-4a8e-8111-ad8a1f2576de tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:59.504882 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-683495d7-b748-4a8e-8111-ad8a1f2576de tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:59.577075 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a33720a5-b39d-4b65-9953-92f88b1e9128 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/539171db-0bd3-4f16-95fd-a7cd5530137d" status: 200 len: 784 microversion: 2.1 time: 0.097430 Mar 12 20:52:59.581953 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 832/1552] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:59 2022] GET /compute/v2.1/images/539171db-0bd3-4f16-95fd-a7cd5530137d => generated 784 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:59.603563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-65bef2cb-c4e2-4875-a587-67458ac01b65 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:59.607859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-65bef2cb-c4e2-4875-a587-67458ac01b65 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:59.630222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65bef2cb-c4e2-4875-a587-67458ac01b65 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:59.634431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65bef2cb-c4e2-4875-a587-67458ac01b65 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:59.638314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65bef2cb-c4e2-4875-a587-67458ac01b65 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:59.639390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65bef2cb-c4e2-4875-a587-67458ac01b65 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:59.842684 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-683495d7-b748-4a8e-8111-ad8a1f2576de tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:59.864999 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-683495d7-b748-4a8e-8111-ad8a1f2576de tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1318 microversion: 2.1 time: 0.385830 Mar 12 20:52:59.876671 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 721/1553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:59 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:59.882064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-65bef2cb-c4e2-4875-a587-67458ac01b65 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:52:59.888943 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-444c9212-87d6-44b5-b1bb-112b9815fb84 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:59.889974 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-444c9212-87d6-44b5-b1bb-112b9815fb84 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:52:59.896377 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-65bef2cb-c4e2-4875-a587-67458ac01b65 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.312181 Mar 12 20:52:59.898071 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 833/1554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:59 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:52:59.903580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7fbbd08-feac-49c2-9ef5-2748a600f7eb tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:59.909761 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-444c9212-87d6-44b5-b1bb-112b9815fb84 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:59.910984 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-444c9212-87d6-44b5-b1bb-112b9815fb84 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:59.913798 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-444c9212-87d6-44b5-b1bb-112b9815fb84 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:52:59.915426 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-444c9212-87d6-44b5-b1bb-112b9815fb84 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:52:59.917739 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e7fbbd08-feac-49c2-9ef5-2748a600f7eb tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017954 Mar 12 20:52:59.918640 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 834/1555] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:52:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:52:59.925310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-834a2934-b749-4238-9ab9-44f936cfb932 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e376cf5e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:52:59.995270 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-834a2934-b749-4238-9ab9-44f936cfb932 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31" status: 200 len: 1437 microversion: 2.1 time: 0.075548 Mar 12 20:52:59.996565 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 835/1556] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:52:59 2022] GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31 => generated 1437 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:00.002773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-15f53aef-17c4-46d9-b0dd-db253d0e3938 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:00.004222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-15f53aef-17c4-46d9-b0dd-db253d0e3938 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:00.015533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15f53aef-17c4-46d9-b0dd-db253d0e3938 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:00.016099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15f53aef-17c4-46d9-b0dd-db253d0e3938 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:00.017394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15f53aef-17c4-46d9-b0dd-db253d0e3938 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:00.018063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15f53aef-17c4-46d9-b0dd-db253d0e3938 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:00.117207 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-444c9212-87d6-44b5-b1bb-112b9815fb84 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:00.134154 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-444c9212-87d6-44b5-b1bb-112b9815fb84 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:00.140048 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-444c9212-87d6-44b5-b1bb-112b9815fb84 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:00.141816 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-444c9212-87d6-44b5-b1bb-112b9815fb84 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1562 microversion: 2.25 time: 0.263640 Mar 12 20:53:00.154790 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 722/1557] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:52:59 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1562 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:00.160369 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9f2a5af0-9ebb-44f8-bca7-ac8afb429472 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e36e03f70>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:00.291960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-15f53aef-17c4-46d9-b0dd-db253d0e3938 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:00.307659 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-15f53aef-17c4-46d9-b0dd-db253d0e3938 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1320 microversion: 2.1 time: 0.308776 Mar 12 20:53:00.321878 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 836/1558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:52:59 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:00.331354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-aea6d901-e996-426a-8e3b-380fab61498d req-d0b643eb-9846-49a5-8fc3-1c3eaed5b158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a", "tag": "cb64dcca-1e41-4ca4-abda-36635e0a71ae"}, {"name": "network-changed", "server_uuid": "bbbdbaf3-600b-4097-a346-6bab89a60ea4", "tag": "6dcedac0-bc0f-44f2-8a09-02474166334f"}, {"name": "network-changed", "server_uuid": "ce767e86-64a8-47b9-bae8-145d5819b6d9", "tag": "bd88fe22-49b2-448f-9a9c-b38f6c74e1ba"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:00.347081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aea6d901-e996-426a-8e3b-380fab61498d req-d0b643eb-9846-49a5-8fc3-1c3eaed5b158 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:00.347566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aea6d901-e996-426a-8e3b-380fab61498d req-d0b643eb-9846-49a5-8fc3-1c3eaed5b158 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:00.368334 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-aea6d901-e996-426a-8e3b-380fab61498d req-d0b643eb-9846-49a5-8fc3-1c3eaed5b158 service nova] Creating event network-changed:cb64dcca-1e41-4ca4-abda-36635e0a71ae for instance 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a on nch2-master-1 Mar 12 20:53:00.368942 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-aea6d901-e996-426a-8e3b-380fab61498d req-d0b643eb-9846-49a5-8fc3-1c3eaed5b158 service nova] Creating event network-changed:6dcedac0-bc0f-44f2-8a09-02474166334f for instance bbbdbaf3-600b-4097-a346-6bab89a60ea4 on nch2-master-1 Mar 12 20:53:00.369457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-aea6d901-e996-426a-8e3b-380fab61498d req-d0b643eb-9846-49a5-8fc3-1c3eaed5b158 service nova] Creating event network-changed:bd88fe22-49b2-448f-9a9c-b38f6c74e1ba for instance ce767e86-64a8-47b9-bae8-145d5819b6d9 on nch2-master-1 Mar 12 20:53:00.381867 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-aea6d901-e996-426a-8e3b-380fab61498d req-d0b643eb-9846-49a5-8fc3-1c3eaed5b158 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.057362 Mar 12 20:53:00.388272 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 837/1559] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:00.398393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1d48d16-78ae-4608-8af3-b180b1536e71 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:00.400331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1d48d16-78ae-4608-8af3-b180b1536e71 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:00.422777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1d48d16-78ae-4608-8af3-b180b1536e71 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:00.423356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1d48d16-78ae-4608-8af3-b180b1536e71 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:00.424221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1d48d16-78ae-4608-8af3-b180b1536e71 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:00.428136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1d48d16-78ae-4608-8af3-b180b1536e71 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:00.642088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1d48d16-78ae-4608-8af3-b180b1536e71 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:00.655617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1d48d16-78ae-4608-8af3-b180b1536e71 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:00.657631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1d48d16-78ae-4608-8af3-b180b1536e71 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:00.659840 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1d48d16-78ae-4608-8af3-b180b1536e71 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1752 microversion: 2.20 time: 0.270440 Mar 12 20:53:00.662205 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 838/1560] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:00 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1752 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:00.667765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e8c55997-2db6-42d7-885a-b790e8448e50 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:00.668698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e8c55997-2db6-42d7-885a-b790e8448e50 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:00.676467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8c55997-2db6-42d7-885a-b790e8448e50 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:00.677195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8c55997-2db6-42d7-885a-b790e8448e50 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:00.678023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8c55997-2db6-42d7-885a-b790e8448e50 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:00.678645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8c55997-2db6-42d7-885a-b790e8448e50 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:00.847734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8c55997-2db6-42d7-885a-b790e8448e50 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:00.857437 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e8c55997-2db6-42d7-885a-b790e8448e50 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1313 microversion: 2.1 time: 0.193882 Mar 12 20:53:00.859680 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 839/1561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:00 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:00.887486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a9634e6b-82ef-431a-b52b-d2d4e3b90e3f tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:00.901521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a9634e6b-82ef-431a-b52b-d2d4e3b90e3f tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:00.911251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9634e6b-82ef-431a-b52b-d2d4e3b90e3f tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:00.911907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9634e6b-82ef-431a-b52b-d2d4e3b90e3f tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:00.912821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9634e6b-82ef-431a-b52b-d2d4e3b90e3f tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:00.913872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9634e6b-82ef-431a-b52b-d2d4e3b90e3f tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:00.993151 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9f2a5af0-9ebb-44f8-bca7-ac8afb429472 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "DELETE /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445" status: 204 len: 0 microversion: 2.1 time: 0.836736 Mar 12 20:53:00.994045 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 723/1562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:00 2022] DELETE /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:01.010940 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-399247e9-f9e3-432c-9525-0b997224377a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:01.011969 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-399247e9-f9e3-432c-9525-0b997224377a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:01.029606 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-399247e9-f9e3-432c-9525-0b997224377a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.030561 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-399247e9-f9e3-432c-9525-0b997224377a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:01.031580 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-399247e9-f9e3-432c-9525-0b997224377a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.032236 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-399247e9-f9e3-432c-9525-0b997224377a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:01.157465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a9634e6b-82ef-431a-b52b-d2d4e3b90e3f tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:01.174858 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a9634e6b-82ef-431a-b52b-d2d4e3b90e3f tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1318 microversion: 2.1 time: 0.292038 Mar 12 20:53:01.175697 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 840/1563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:00 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:01.188375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5a9c14b-eb2a-45ce-87c7-0ca091f204b1 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e36d5b8b0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:01.220310 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e5a9c14b-eb2a-45ce-87c7-0ca091f204b1 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] HTTP exception thrown: Image not found. Mar 12 20:53:01.220925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5a9c14b-eb2a-45ce-87c7-0ca091f204b1 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:01.222365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e5a9c14b-eb2a-45ce-87c7-0ca091f204b1 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445" status: 404 len: 62 microversion: 2.1 time: 0.044982 Mar 12 20:53:01.222365 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 841/1564] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:01 2022] GET /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:53:01.229982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-10108784-06ea-428a-b48e-1f1fae920a5e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e37688b80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:01.272320 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-399247e9-f9e3-432c-9525-0b997224377a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:01.284136 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-399247e9-f9e3-432c-9525-0b997224377a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.288668 Mar 12 20:53:01.284728 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 724/1565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:00 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:01.305861 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-41b6b930-9229-423e-ae3d-2c9a6b4e4dee tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:01.306703 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-41b6b930-9229-423e-ae3d-2c9a6b4e4dee tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:01.313545 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-41b6b930-9229-423e-ae3d-2c9a6b4e4dee tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.313989 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-41b6b930-9229-423e-ae3d-2c9a6b4e4dee tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:01.314267 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-10108784-06ea-428a-b48e-1f1fae920a5e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31" status: 200 len: 1437 microversion: 2.1 time: 0.090610 Mar 12 20:53:01.314817 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-41b6b930-9229-423e-ae3d-2c9a6b4e4dee tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.314978 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 842/1566] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:01 2022] GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31 => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:01.315560 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-41b6b930-9229-423e-ae3d-2c9a6b4e4dee tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:01.320010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b5678e80-3fc4-4124-b61f-ffa368714a3a tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1313186333"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:01.322474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b5678e80-3fc4-4124-b61f-ffa368714a3a tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:01.337811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5678e80-3fc4-4124-b61f-ffa368714a3a tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.338288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5678e80-3fc4-4124-b61f-ffa368714a3a tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:01.339094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5678e80-3fc4-4124-b61f-ffa368714a3a tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.339532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5678e80-3fc4-4124-b61f-ffa368714a3a tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:01.539639 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-41b6b930-9229-423e-ae3d-2c9a6b4e4dee tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:01.575763 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-41b6b930-9229-423e-ae3d-2c9a6b4e4dee tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:01.580043 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-41b6b930-9229-423e-ae3d-2c9a6b4e4dee tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:01.581456 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-41b6b930-9229-423e-ae3d-2c9a6b4e4dee tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1562 microversion: 2.25 time: 0.295684 Mar 12 20:53:01.582041 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 725/1567] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:01 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1562 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:01.599963 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-874f633e-2133-469a-a409-d737cd0ea7c0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:01.600836 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-874f633e-2133-469a-a409-d737cd0ea7c0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:01.619284 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-874f633e-2133-469a-a409-d737cd0ea7c0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.619756 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-874f633e-2133-469a-a409-d737cd0ea7c0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:01.646469 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-874f633e-2133-469a-a409-d737cd0ea7c0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.648067 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-874f633e-2133-469a-a409-d737cd0ea7c0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:01.784633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b5678e80-3fc4-4124-b61f-ffa368714a3a tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "POST /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6/action" status: 202 len: 0 microversion: 2.1 time: 0.466892 Mar 12 20:53:01.786949 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 843/1568] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:53:01 2022] POST /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 12 20:53:01.798123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-59f51211-f962-41e2-8a68-7fe9c03cd3e8 req-33088a56-3e47-4526-8670-8a3bd2ea21d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a01d27-42ab-4258-be66-a86606d977d6", "name": "network-vif-unplugged", "status": "completed", "tag": "fb9ee1ae-e3ac-4632-96cb-7591d2fde26d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:01.816256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-59f51211-f962-41e2-8a68-7fe9c03cd3e8 req-33088a56-3e47-4526-8670-8a3bd2ea21d0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.817215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-59f51211-f962-41e2-8a68-7fe9c03cd3e8 req-33088a56-3e47-4526-8670-8a3bd2ea21d0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:01.839105 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-59f51211-f962-41e2-8a68-7fe9c03cd3e8 req-33088a56-3e47-4526-8670-8a3bd2ea21d0 service nova] Creating event network-vif-unplugged:fb9ee1ae-e3ac-4632-96cb-7591d2fde26d for instance b1a01d27-42ab-4258-be66-a86606d977d6 on nch2-master-1 Mar 12 20:53:01.843675 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-874f633e-2133-469a-a409-d737cd0ea7c0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:01.844246 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-59f51211-f962-41e2-8a68-7fe9c03cd3e8 req-33088a56-3e47-4526-8670-8a3bd2ea21d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055010 Mar 12 20:53:01.845157 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 844/1569] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:01.853562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dac8bc9a-c0f2-46d2-a095-e83cda3b5e0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:01.856601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dac8bc9a-c0f2-46d2-a095-e83cda3b5e0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:01.865477 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-874f633e-2133-469a-a409-d737cd0ea7c0 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1320 microversion: 2.1 time: 0.276898 Mar 12 20:53:01.866322 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 726/1570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:01 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:01.869401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dac8bc9a-c0f2-46d2-a095-e83cda3b5e0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.870137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dac8bc9a-c0f2-46d2-a095-e83cda3b5e0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:01.871284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dac8bc9a-c0f2-46d2-a095-e83cda3b5e0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.872262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dac8bc9a-c0f2-46d2-a095-e83cda3b5e0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:01.881871 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-426078f6-937c-4324-b96f-d10a8fd21de8 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e36f31c10>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:01.938702 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-426078f6-937c-4324-b96f-d10a8fd21de8 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755" status: 200 len: 1429 microversion: 2.1 time: 0.070352 Mar 12 20:53:01.940239 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 727/1571] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:01 2022] GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755 => generated 1429 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:01.950889 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-ab4bf870-011b-4be5-baa8-3da05e276326 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:01.953206 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-ab4bf870-011b-4be5-baa8-3da05e276326 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:01.965119 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ab4bf870-011b-4be5-baa8-3da05e276326 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.965679 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ab4bf870-011b-4be5-baa8-3da05e276326 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:01.966852 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ab4bf870-011b-4be5-baa8-3da05e276326 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:01.967389 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-ab4bf870-011b-4be5-baa8-3da05e276326 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:02.062064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dac8bc9a-c0f2-46d2-a095-e83cda3b5e0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:02.075290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dac8bc9a-c0f2-46d2-a095-e83cda3b5e0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:02.077085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dac8bc9a-c0f2-46d2-a095-e83cda3b5e0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:02.089819 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dac8bc9a-c0f2-46d2-a095-e83cda3b5e0c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1752 microversion: 2.20 time: 0.239973 Mar 12 20:53:02.102382 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 845/1572] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:01 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1752 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:02.153299 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-ab4bf870-011b-4be5-baa8-3da05e276326 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:02.162113 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-ab4bf870-011b-4be5-baa8-3da05e276326 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1313 microversion: 2.1 time: 0.220266 Mar 12 20:53:02.162791 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 728/1573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:01 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:02.192395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7087f639-0fba-4e46-b7a5-3c8b25ff588d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:02.193275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7087f639-0fba-4e46-b7a5-3c8b25ff588d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:02.199911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7087f639-0fba-4e46-b7a5-3c8b25ff588d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:02.200671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7087f639-0fba-4e46-b7a5-3c8b25ff588d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:02.201414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7087f639-0fba-4e46-b7a5-3c8b25ff588d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:02.201920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7087f639-0fba-4e46-b7a5-3c8b25ff588d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:02.303240 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8c59bc1f-0a2c-424c-acfe-d3b51af52fed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:02.304959 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8c59bc1f-0a2c-424c-acfe-d3b51af52fed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:02.313254 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8c59bc1f-0a2c-424c-acfe-d3b51af52fed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:02.318331 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8c59bc1f-0a2c-424c-acfe-d3b51af52fed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:02.322482 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8c59bc1f-0a2c-424c-acfe-d3b51af52fed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:02.323030 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8c59bc1f-0a2c-424c-acfe-d3b51af52fed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:02.375788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7087f639-0fba-4e46-b7a5-3c8b25ff588d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:02.395042 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7087f639-0fba-4e46-b7a5-3c8b25ff588d tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1318 microversion: 2.1 time: 0.206412 Mar 12 20:53:02.396522 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 846/1574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:02 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:02.419478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ff3d4bbc-4145-4027-a7dc-665369fce5a2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e3769bdc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:02.486117 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ff3d4bbc-4145-4027-a7dc-665369fce5a2 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31" status: 200 len: 1437 microversion: 2.1 time: 0.088199 Mar 12 20:53:02.486731 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 847/1575] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:02 2022] GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31 => generated 1437 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:02.517825 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8c59bc1f-0a2c-424c-acfe-d3b51af52fed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:02.526012 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8c59bc1f-0a2c-424c-acfe-d3b51af52fed tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.226662 Mar 12 20:53:02.526693 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 729/1576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:02 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:02.600688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5f59c211-bd0c-430a-8fcc-898870057219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:02.601902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5f59c211-bd0c-430a-8fcc-898870057219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:02.609672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f59c211-bd0c-430a-8fcc-898870057219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:02.610279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f59c211-bd0c-430a-8fcc-898870057219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:02.611212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f59c211-bd0c-430a-8fcc-898870057219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:02.611771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f59c211-bd0c-430a-8fcc-898870057219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:02.772716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f59c211-bd0c-430a-8fcc-898870057219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:02.783466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f59c211-bd0c-430a-8fcc-898870057219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:02.785260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f59c211-bd0c-430a-8fcc-898870057219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:02.786596 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5f59c211-bd0c-430a-8fcc-898870057219 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1562 microversion: 2.25 time: 0.190667 Mar 12 20:53:02.787239 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 848/1577] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:02 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1562 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:02.885877 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-369b5ea4-0a62-45eb-82e6-7f5f2f59ec23 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:02.886612 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-369b5ea4-0a62-45eb-82e6-7f5f2f59ec23 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:02.895070 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-369b5ea4-0a62-45eb-82e6-7f5f2f59ec23 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:02.895610 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-369b5ea4-0a62-45eb-82e6-7f5f2f59ec23 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:02.896408 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-369b5ea4-0a62-45eb-82e6-7f5f2f59ec23 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:02.896855 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-369b5ea4-0a62-45eb-82e6-7f5f2f59ec23 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:02.966639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3f120588-42c8-4b99-96bd-915828549136 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e3769b0d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:03.019387 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3f120588-42c8-4b99-96bd-915828549136 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755" status: 200 len: 1429 microversion: 2.1 time: 0.070421 Mar 12 20:53:03.019923 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 849/1578] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:02 2022] GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755 => generated 1429 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:53:03.068574 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-369b5ea4-0a62-45eb-82e6-7f5f2f59ec23 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:03.078812 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-369b5ea4-0a62-45eb-82e6-7f5f2f59ec23 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1320 microversion: 2.1 time: 0.197886 Mar 12 20:53:03.088986 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 730/1579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:02 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1320 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:03.112319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-793e425b-6689-4ab6-9bc2-16c3610a2007 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:03.113154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-793e425b-6689-4ab6-9bc2-16c3610a2007 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:03.120937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-793e425b-6689-4ab6-9bc2-16c3610a2007 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:03.121449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-793e425b-6689-4ab6-9bc2-16c3610a2007 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:03.122557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-793e425b-6689-4ab6-9bc2-16c3610a2007 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:03.123142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-793e425b-6689-4ab6-9bc2-16c3610a2007 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:03.184205 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-21d91070-3ca5-46cd-a31f-4dd8755be79e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:03.185475 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-21d91070-3ca5-46cd-a31f-4dd8755be79e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:03.200909 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21d91070-3ca5-46cd-a31f-4dd8755be79e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:03.202661 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21d91070-3ca5-46cd-a31f-4dd8755be79e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:03.204783 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21d91070-3ca5-46cd-a31f-4dd8755be79e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:03.206888 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-21d91070-3ca5-46cd-a31f-4dd8755be79e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:03.300580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-793e425b-6689-4ab6-9bc2-16c3610a2007 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:03.310147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-793e425b-6689-4ab6-9bc2-16c3610a2007 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:03.312401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-793e425b-6689-4ab6-9bc2-16c3610a2007 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:03.313407 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-793e425b-6689-4ab6-9bc2-16c3610a2007 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1752 microversion: 2.20 time: 0.206743 Mar 12 20:53:03.314451 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 850/1580] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:03 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1752 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:03.413629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bbce8db2-9482-4f67-b620-7061b517eb9a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:03.414355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bbce8db2-9482-4f67-b620-7061b517eb9a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:03.421540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbce8db2-9482-4f67-b620-7061b517eb9a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:03.422040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbce8db2-9482-4f67-b620-7061b517eb9a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:03.423347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbce8db2-9482-4f67-b620-7061b517eb9a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:03.423795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbce8db2-9482-4f67-b620-7061b517eb9a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:03.512573 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-21d91070-3ca5-46cd-a31f-4dd8755be79e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:03.525045 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-21d91070-3ca5-46cd-a31f-4dd8755be79e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1313 microversion: 2.1 time: 0.346833 Mar 12 20:53:03.525642 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 731/1581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:03 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:03.534046 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0d4fcd61-837d-41c4-9eef-ad5c7d2f2314 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e37004f70>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:03.585249 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0d4fcd61-837d-41c4-9eef-ad5c7d2f2314 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31" status: 200 len: 1437 microversion: 2.1 time: 0.057880 Mar 12 20:53:03.586186 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 732/1582] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:03 2022] GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31 => generated 1437 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:03.591743 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-84e02368-cab8-495f-bda1-9f0442811b36 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:03.592369 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-84e02368-cab8-495f-bda1-9f0442811b36 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:03.599357 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-84e02368-cab8-495f-bda1-9f0442811b36 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:03.599901 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-84e02368-cab8-495f-bda1-9f0442811b36 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:03.600796 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-84e02368-cab8-495f-bda1-9f0442811b36 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:03.601132 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-84e02368-cab8-495f-bda1-9f0442811b36 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:03.616611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bbce8db2-9482-4f67-b620-7061b517eb9a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:03.627706 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bbce8db2-9482-4f67-b620-7061b517eb9a tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1318 microversion: 2.1 time: 0.218804 Mar 12 20:53:03.638200 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 851/1583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:03 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:03.805460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e8766982-b813-4769-a794-83fdb1368b05 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:03.806112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e8766982-b813-4769-a794-83fdb1368b05 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:03.812675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8766982-b813-4769-a794-83fdb1368b05 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:03.813122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8766982-b813-4769-a794-83fdb1368b05 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:03.813941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8766982-b813-4769-a794-83fdb1368b05 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:03.814621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8766982-b813-4769-a794-83fdb1368b05 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:03.956355 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-84e02368-cab8-495f-bda1-9f0442811b36 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:03.968326 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-84e02368-cab8-495f-bda1-9f0442811b36 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.380025 Mar 12 20:53:03.969942 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 733/1584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:03 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:03.975699 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-36771011-b0f3-4966-b2a8-3cf928f38c36 req-07b44636-6593-4a59-949c-873af69e59f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e", "name": "network-vif-plugged", "status": "completed", "tag": "1326e734-666a-431b-bab6-8338bafdbcba"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:03.986666 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-36771011-b0f3-4966-b2a8-3cf928f38c36 req-07b44636-6593-4a59-949c-873af69e59f5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:03.987409 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-36771011-b0f3-4966-b2a8-3cf928f38c36 req-07b44636-6593-4a59-949c-873af69e59f5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:03.994209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8766982-b813-4769-a794-83fdb1368b05 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:04.006081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8766982-b813-4769-a794-83fdb1368b05 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:04.009427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8766982-b813-4769-a794-83fdb1368b05 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:04.011282 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e8766982-b813-4769-a794-83fdb1368b05 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1562 microversion: 2.25 time: 0.209652 Mar 12 20:53:04.012546 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-36771011-b0f3-4966-b2a8-3cf928f38c36 req-07b44636-6593-4a59-949c-873af69e59f5 service nova] Creating event network-vif-plugged:1326e734-666a-431b-bab6-8338bafdbcba for instance 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e on nch2-master-1 Mar 12 20:53:04.013394 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 852/1585] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:03 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1562 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:53:04.018827 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-36771011-b0f3-4966-b2a8-3cf928f38c36 req-07b44636-6593-4a59-949c-873af69e59f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046778 Mar 12 20:53:04.019623 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 734/1586] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:04.034240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d78f9ef-d7f6-4d9f-9f59-2d71ee466a93 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e37322940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:04.089431 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d78f9ef-d7f6-4d9f-9f59-2d71ee466a93 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755" status: 200 len: 1429 microversion: 2.1 time: 0.060598 Mar 12 20:53:04.090719 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 853/1587] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:04 2022] GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755 => generated 1429 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:04.102880 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-aab3dc7a-8a63-4012-becb-976f1fbbde3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:04.103738 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-aab3dc7a-8a63-4012-becb-976f1fbbde3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:04.111606 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aab3dc7a-8a63-4012-becb-976f1fbbde3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:04.112405 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aab3dc7a-8a63-4012-becb-976f1fbbde3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:04.113514 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aab3dc7a-8a63-4012-becb-976f1fbbde3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:04.114259 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-aab3dc7a-8a63-4012-becb-976f1fbbde3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:04.337579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca7f04f3-9304-44a9-8628-08054ed2bf9b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:04.339284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ca7f04f3-9304-44a9-8628-08054ed2bf9b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:04.348580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca7f04f3-9304-44a9-8628-08054ed2bf9b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:04.349385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca7f04f3-9304-44a9-8628-08054ed2bf9b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:04.350432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca7f04f3-9304-44a9-8628-08054ed2bf9b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:04.350884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca7f04f3-9304-44a9-8628-08054ed2bf9b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:04.500974 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-aab3dc7a-8a63-4012-becb-976f1fbbde3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:04.508948 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-aab3dc7a-8a63-4012-becb-976f1fbbde3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1320 microversion: 2.1 time: 0.410761 Mar 12 20:53:04.527055 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 735/1588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:04 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1320 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:04.532708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca7f04f3-9304-44a9-8628-08054ed2bf9b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:04.546396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca7f04f3-9304-44a9-8628-08054ed2bf9b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:04.550101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca7f04f3-9304-44a9-8628-08054ed2bf9b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:04.551691 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-0fc53c78-9ef9-4c3f-ad77-a979deecabd3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:04.552528 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-0fc53c78-9ef9-4c3f-ad77-a979deecabd3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:04.554098 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca7f04f3-9304-44a9-8628-08054ed2bf9b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1752 microversion: 2.20 time: 0.223857 Mar 12 20:53:04.556735 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 854/1589] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:04 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1752 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:04.562460 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0fc53c78-9ef9-4c3f-ad77-a979deecabd3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:04.563215 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0fc53c78-9ef9-4c3f-ad77-a979deecabd3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:04.564173 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0fc53c78-9ef9-4c3f-ad77-a979deecabd3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:04.564771 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-0fc53c78-9ef9-4c3f-ad77-a979deecabd3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:04.602844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-626251e8-dc8b-4398-8139-85f12364abb0 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e3751be50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:04.680722 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-626251e8-dc8b-4398-8139-85f12364abb0 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31" status: 200 len: 1437 microversion: 2.1 time: 0.084374 Mar 12 20:53:04.681467 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 855/1590] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:04 2022] GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31 => generated 1437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:53:04.692028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b03b8d2-0ab8-4f8a-89c4-e18278f90ece tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:04.698534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b03b8d2-0ab8-4f8a-89c4-e18278f90ece tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:04.707009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b03b8d2-0ab8-4f8a-89c4-e18278f90ece tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:04.707794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b03b8d2-0ab8-4f8a-89c4-e18278f90ece tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:04.709731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b03b8d2-0ab8-4f8a-89c4-e18278f90ece tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:04.710467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b03b8d2-0ab8-4f8a-89c4-e18278f90ece tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:04.921580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b03b8d2-0ab8-4f8a-89c4-e18278f90ece tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:04.932147 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b03b8d2-0ab8-4f8a-89c4-e18278f90ece tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1318 microversion: 2.1 time: 0.249464 Mar 12 20:53:04.932974 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 856/1591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:04 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:04.991067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-608851d1-df7f-42df-af8e-2c0c9028806a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:04.991966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-608851d1-df7f-42df-af8e-2c0c9028806a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:04.999435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-608851d1-df7f-42df-af8e-2c0c9028806a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:05.000248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-608851d1-df7f-42df-af8e-2c0c9028806a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:05.001273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-608851d1-df7f-42df-af8e-2c0c9028806a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:05.001712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-608851d1-df7f-42df-af8e-2c0c9028806a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:05.216133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-608851d1-df7f-42df-af8e-2c0c9028806a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:05.227718 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-608851d1-df7f-42df-af8e-2c0c9028806a tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.240587 Mar 12 20:53:05.240993 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 857/1592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:04 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:53:05.249597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52061b08-d13d-4409-8cf3-7f4db5e9c773 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:05.250281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-52061b08-d13d-4409-8cf3-7f4db5e9c773 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:05.258788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52061b08-d13d-4409-8cf3-7f4db5e9c773 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:05.259045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52061b08-d13d-4409-8cf3-7f4db5e9c773 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:05.260257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52061b08-d13d-4409-8cf3-7f4db5e9c773 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:05.260504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52061b08-d13d-4409-8cf3-7f4db5e9c773 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:05.339765 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-0fc53c78-9ef9-4c3f-ad77-a979deecabd3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:05.349194 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-0fc53c78-9ef9-4c3f-ad77-a979deecabd3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1313 microversion: 2.1 time: 0.806721 Mar 12 20:53:05.349870 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 736/1593] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:04 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1313 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:05.354733 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e0e693cd-8b8f-4556-9cb5-819ed8bb9e8d tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e36e76040>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:05.406824 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e0e693cd-8b8f-4556-9cb5-819ed8bb9e8d tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755" status: 200 len: 1429 microversion: 2.1 time: 0.055671 Mar 12 20:53:05.407928 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 737/1594] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:05 2022] GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755 => generated 1429 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:05.454345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-52061b08-d13d-4409-8cf3-7f4db5e9c773 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:05.463106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-52061b08-d13d-4409-8cf3-7f4db5e9c773 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:05.464755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-52061b08-d13d-4409-8cf3-7f4db5e9c773 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:05.466033 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-52061b08-d13d-4409-8cf3-7f4db5e9c773 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1562 microversion: 2.25 time: 0.223871 Mar 12 20:53:05.473366 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 858/1595] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:05 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:05.534711 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-756b8c8b-e856-472f-ad04-5473276284ca tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:05.536224 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-756b8c8b-e856-472f-ad04-5473276284ca tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:05.543315 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-756b8c8b-e856-472f-ad04-5473276284ca tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:05.544327 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-756b8c8b-e856-472f-ad04-5473276284ca tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:05.545378 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-756b8c8b-e856-472f-ad04-5473276284ca tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:05.546259 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-756b8c8b-e856-472f-ad04-5473276284ca tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:05.578203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e0468ef6-8329-4c36-ac1a-b22b7bd30524 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:05.579691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e0468ef6-8329-4c36-ac1a-b22b7bd30524 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:05.591804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0468ef6-8329-4c36-ac1a-b22b7bd30524 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:05.595726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0468ef6-8329-4c36-ac1a-b22b7bd30524 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:05.596806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0468ef6-8329-4c36-ac1a-b22b7bd30524 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:05.597662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0468ef6-8329-4c36-ac1a-b22b7bd30524 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:05.868834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e0468ef6-8329-4c36-ac1a-b22b7bd30524 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:05.881281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e0468ef6-8329-4c36-ac1a-b22b7bd30524 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:05.882912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e0468ef6-8329-4c36-ac1a-b22b7bd30524 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:05.884159 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e0468ef6-8329-4c36-ac1a-b22b7bd30524 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1752 microversion: 2.20 time: 0.311931 Mar 12 20:53:05.884726 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 859/1596] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:05 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1752 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:53:05.899092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2eb2ca85-44fc-470e-aa91-feed6de50e5b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e373b25e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:06.010050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2eb2ca85-44fc-470e-aa91-feed6de50e5b tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31" status: 200 len: 1437 microversion: 2.1 time: 0.122806 Mar 12 20:53:06.010966 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 860/1597] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:05 2022] GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31 => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:06.024844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-82280b63-59c5-4a54-a7c0-ee7233135fb1 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:06.028654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-82280b63-59c5-4a54-a7c0-ee7233135fb1 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:06.046139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82280b63-59c5-4a54-a7c0-ee7233135fb1 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:06.053429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82280b63-59c5-4a54-a7c0-ee7233135fb1 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:06.058249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82280b63-59c5-4a54-a7c0-ee7233135fb1 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:06.058871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82280b63-59c5-4a54-a7c0-ee7233135fb1 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:06.144682 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-756b8c8b-e856-472f-ad04-5473276284ca tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:06.162361 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-756b8c8b-e856-472f-ad04-5473276284ca tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1320 microversion: 2.1 time: 0.632025 Mar 12 20:53:06.163885 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 738/1598] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:05 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1320 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:06.263889 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4a4d80e1-ab8b-4135-a0ff-d50578d5a4ea tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:06.268256 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4a4d80e1-ab8b-4135-a0ff-d50578d5a4ea tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:06.289734 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4a4d80e1-ab8b-4135-a0ff-d50578d5a4ea tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:06.290848 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4a4d80e1-ab8b-4135-a0ff-d50578d5a4ea tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:06.292921 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4a4d80e1-ab8b-4135-a0ff-d50578d5a4ea tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:06.294328 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4a4d80e1-ab8b-4135-a0ff-d50578d5a4ea tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:06.371644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-82280b63-59c5-4a54-a7c0-ee7233135fb1 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:06.383460 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-82280b63-59c5-4a54-a7c0-ee7233135fb1 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1318 microversion: 2.1 time: 0.370956 Mar 12 20:53:06.399844 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 861/1599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:06 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:06.406748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5228e39a-84e0-4601-9b0a-a4e76bdfb3dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:06.407560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5228e39a-84e0-4601-9b0a-a4e76bdfb3dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:06.417022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5228e39a-84e0-4601-9b0a-a4e76bdfb3dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:06.417597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5228e39a-84e0-4601-9b0a-a4e76bdfb3dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:06.418459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5228e39a-84e0-4601-9b0a-a4e76bdfb3dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:06.418901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5228e39a-84e0-4601-9b0a-a4e76bdfb3dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:06.609721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5228e39a-84e0-4601-9b0a-a4e76bdfb3dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:06.624350 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5228e39a-84e0-4601-9b0a-a4e76bdfb3dc tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1313 microversion: 2.1 time: 0.222465 Mar 12 20:53:06.626103 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 862/1600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:06 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:06.631349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2f425ed-ba15-417a-a433-669684a2dc26 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e37515a60>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:06.668045 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-4a4d80e1-ab8b-4135-a0ff-d50578d5a4ea tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:06.679906 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4a4d80e1-ab8b-4135-a0ff-d50578d5a4ea tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1392 microversion: 2.1 time: 0.427372 Mar 12 20:53:06.690601 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 739/1601] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:06 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1392 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:06.694577 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-fa06a4e7-99c6-474e-9635-9780041d80d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:06.695202 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-fa06a4e7-99c6-474e-9635-9780041d80d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:06.701466 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa06a4e7-99c6-474e-9635-9780041d80d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:06.702545 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa06a4e7-99c6-474e-9635-9780041d80d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:06.703296 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa06a4e7-99c6-474e-9635-9780041d80d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:06.705215 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-fa06a4e7-99c6-474e-9635-9780041d80d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:06.711135 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2f425ed-ba15-417a-a433-669684a2dc26 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755" status: 200 len: 1429 microversion: 2.1 time: 0.080860 Mar 12 20:53:06.711135 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 863/1602] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:06 2022] GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755 => generated 1429 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:06.902394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-206da43c-a6f0-485b-8650-4ca2f7ddb1e4 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:06.903293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-206da43c-a6f0-485b-8650-4ca2f7ddb1e4 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:06.917635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206da43c-a6f0-485b-8650-4ca2f7ddb1e4 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:06.918929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206da43c-a6f0-485b-8650-4ca2f7ddb1e4 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:06.923020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206da43c-a6f0-485b-8650-4ca2f7ddb1e4 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:06.923823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206da43c-a6f0-485b-8650-4ca2f7ddb1e4 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:07.253715 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fa06a4e7-99c6-474e-9635-9780041d80d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:07.269718 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fa06a4e7-99c6-474e-9635-9780041d80d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:07.271380 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-fa06a4e7-99c6-474e-9635-9780041d80d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:07.272858 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-fa06a4e7-99c6-474e-9635-9780041d80d3 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 200 len: 1562 microversion: 2.25 time: 0.586312 Mar 12 20:53:07.273590 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 740/1603] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:06 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 1562 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:07.284165 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-37c575dd-5ceb-4e84-b83e-1d3919d8727c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36e035e0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:07.460662 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-37c575dd-5ceb-4e84-b83e-1d3919d8727c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31" status: 200 len: 1437 microversion: 2.1 time: 0.185720 Mar 12 20:53:07.461482 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 741/1604] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:07 2022] GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31 => generated 1437 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:07.474762 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-11142778-1a44-452b-b8c3-a6ca3ca776be tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:07.479655 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-11142778-1a44-452b-b8c3-a6ca3ca776be tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:07.491902 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-11142778-1a44-452b-b8c3-a6ca3ca776be tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:07.497187 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-11142778-1a44-452b-b8c3-a6ca3ca776be tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:07.498280 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-11142778-1a44-452b-b8c3-a6ca3ca776be tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:07.499349 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-11142778-1a44-452b-b8c3-a6ca3ca776be tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:07.581192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-206da43c-a6f0-485b-8650-4ca2f7ddb1e4 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:07.592555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-206da43c-a6f0-485b-8650-4ca2f7ddb1e4 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:07.595830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-206da43c-a6f0-485b-8650-4ca2f7ddb1e4 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:07.599699 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-206da43c-a6f0-485b-8650-4ca2f7ddb1e4 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1808 microversion: 2.20 time: 0.701786 Mar 12 20:53:07.601484 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 864/1605] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:06 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1808 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:07.615667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7775ded0-2528-461f-8061-ef3cbe3dba9e req-6f7ecdd8-2ade-41b7-ac3b-39f987902b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a", "name": "network-vif-plugged", "status": "completed", "tag": "cb64dcca-1e41-4ca4-abda-36635e0a71ae"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:07.634820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7775ded0-2528-461f-8061-ef3cbe3dba9e req-6f7ecdd8-2ade-41b7-ac3b-39f987902b4a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:07.635327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7775ded0-2528-461f-8061-ef3cbe3dba9e req-6f7ecdd8-2ade-41b7-ac3b-39f987902b4a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:07.661407 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7775ded0-2528-461f-8061-ef3cbe3dba9e req-6f7ecdd8-2ade-41b7-ac3b-39f987902b4a service nova] Creating event network-vif-plugged:cb64dcca-1e41-4ca4-abda-36635e0a71ae for instance 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a on nch2-master-1 Mar 12 20:53:07.670583 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7775ded0-2528-461f-8061-ef3cbe3dba9e req-6f7ecdd8-2ade-41b7-ac3b-39f987902b4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066556 Mar 12 20:53:07.671214 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 865/1606] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:07.699232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51de4558-863d-47f0-9f93-6622b21cff44 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:07.699962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51de4558-863d-47f0-9f93-6622b21cff44 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:07.717252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51de4558-863d-47f0-9f93-6622b21cff44 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:07.717758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51de4558-863d-47f0-9f93-6622b21cff44 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:07.718706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51de4558-863d-47f0-9f93-6622b21cff44 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:07.723192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51de4558-863d-47f0-9f93-6622b21cff44 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:08.347630 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-11142778-1a44-452b-b8c3-a6ca3ca776be tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:08.357166 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-11142778-1a44-452b-b8c3-a6ca3ca776be tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1320 microversion: 2.1 time: 0.894518 Mar 12 20:53:08.373404 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 742/1607] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:07 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1320 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:08.382585 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-6c6977de-c1aa-4da8-a204-1d5cb585adce tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:08.391372 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-6c6977de-c1aa-4da8-a204-1d5cb585adce tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:08.423813 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6c6977de-c1aa-4da8-a204-1d5cb585adce tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:08.424780 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6c6977de-c1aa-4da8-a204-1d5cb585adce tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:08.427884 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6c6977de-c1aa-4da8-a204-1d5cb585adce tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:08.444382 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-6c6977de-c1aa-4da8-a204-1d5cb585adce tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:08.540179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51de4558-863d-47f0-9f93-6622b21cff44 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:08.565564 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51de4558-863d-47f0-9f93-6622b21cff44 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1318 microversion: 2.1 time: 0.893105 Mar 12 20:53:08.569895 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 866/1608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:07 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1318 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:08.587370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d978c3e7-39df-49f0-b9c2-ad17a6075b35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:08.588918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d978c3e7-39df-49f0-b9c2-ad17a6075b35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:08.595961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d978c3e7-39df-49f0-b9c2-ad17a6075b35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:08.596724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d978c3e7-39df-49f0-b9c2-ad17a6075b35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:08.597792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d978c3e7-39df-49f0-b9c2-ad17a6075b35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:08.598435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d978c3e7-39df-49f0-b9c2-ad17a6075b35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:08.934146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d978c3e7-39df-49f0-b9c2-ad17a6075b35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:08.945410 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d978c3e7-39df-49f0-b9c2-ad17a6075b35 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1382 microversion: 2.1 time: 0.363980 Mar 12 20:53:08.957215 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 867/1609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:08 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1382 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:08.962560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec79df72-2e94-4fb6-818f-b92c2aecff06 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e3751b310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:09.409945 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-6c6977de-c1aa-4da8-a204-1d5cb585adce tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:09.420424 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-6c6977de-c1aa-4da8-a204-1d5cb585adce tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1313 microversion: 2.1 time: 1.054916 Mar 12 20:53:09.424915 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 743/1610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:08 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1313 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:09.450278 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-1aa15cfe-9d75-4a5d-8303-dfdc0d3d5d03 req-bf569379-5d8d-4b2a-9598-f82bda7f62aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b3b4cce-d19a-479c-adcf-03afc06cf8e0", "name": "network-vif-deleted", "tag": "70b96b8e-4df3-42a1-a05b-4818b836f46f"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:09.462104 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-1aa15cfe-9d75-4a5d-8303-dfdc0d3d5d03 req-bf569379-5d8d-4b2a-9598-f82bda7f62aa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:09.462586 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-1aa15cfe-9d75-4a5d-8303-dfdc0d3d5d03 req-bf569379-5d8d-4b2a-9598-f82bda7f62aa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:09.488261 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-1aa15cfe-9d75-4a5d-8303-dfdc0d3d5d03 req-bf569379-5d8d-4b2a-9598-f82bda7f62aa service nova] Creating event network-vif-deleted:70b96b8e-4df3-42a1-a05b-4818b836f46f for instance 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 on nch1-master-1 Mar 12 20:53:09.509821 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-1aa15cfe-9d75-4a5d-8303-dfdc0d3d5d03 req-bf569379-5d8d-4b2a-9598-f82bda7f62aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074682 Mar 12 20:53:09.517995 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 744/1611] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:09.529715 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-05d7f054-a46d-46cd-a988-bd5b7e8f8c9e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:09.530732 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-05d7f054-a46d-46cd-a988-bd5b7e8f8c9e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 2b3b4cce-d19a-479c-adcf-03afc06cf8e0] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:09.544477 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-05d7f054-a46d-46cd-a988-bd5b7e8f8c9e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:09.549357 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-05d7f054-a46d-46cd-a988-bd5b7e8f8c9e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:09.550448 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-05d7f054-a46d-46cd-a988-bd5b7e8f8c9e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:09.551080 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-05d7f054-a46d-46cd-a988-bd5b7e8f8c9e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:09.588515 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.wsgi [None req-05d7f054-a46d-46cd-a988-bd5b7e8f8c9e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] HTTP exception thrown: Instance 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 could not be found. Mar 12 20:53:09.589425 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-05d7f054-a46d-46cd-a988-bd5b7e8f8c9e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Returning 404 to user: Instance 2b3b4cce-d19a-479c-adcf-03afc06cf8e0 could not be found. {{(pid=136303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:09.590476 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-05d7f054-a46d-46cd-a988-bd5b7e8f8c9e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0" status: 404 len: 111 microversion: 2.25 time: 0.071017 Mar 12 20:53:09.592241 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 745/1612] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:09 2022] GET /compute/v2.1/servers/2b3b4cce-d19a-479c-adcf-03afc06cf8e0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:53:09.601416 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-97540dd6-bf90-410e-99cf-d29899c24dd7 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36e004c0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:17.915785 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-97540dd6-bf90-410e-99cf-d29899c24dd7 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31" status: 200 len: 1446 microversion: 2.1 time: 8.321776 Mar 12 20:53:17.917294 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec79df72-2e94-4fb6-818f-b92c2aecff06 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755" status: 200 len: 1429 microversion: 2.1 time: 8.955636 Mar 12 20:53:17.918520 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 868/1613] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:08 2022] GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755 => generated 1429 bytes in 8960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:17.924859 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 746/1614] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:09 2022] GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31 => generated 1446 bytes in 8332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:17.942282 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d7132f7d-0a51-4d54-86a3-f9703ef92032 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '.version_select at 0x7f6e36ea85e0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:17.951099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-13b41d29-cf04-422d-9a1a-2d3bf5fbd612 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:17.954992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-13b41d29-cf04-422d-9a1a-2d3bf5fbd612 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:17.958572 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d7132f7d-0a51-4d54-86a3-f9703ef92032 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:17.959337 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d7132f7d-0a51-4d54-86a3-f9703ef92032 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:17.968336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13b41d29-cf04-422d-9a1a-2d3bf5fbd612 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:17.968805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13b41d29-cf04-422d-9a1a-2d3bf5fbd612 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:17.969628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13b41d29-cf04-422d-9a1a-2d3bf5fbd612 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:17.970499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13b41d29-cf04-422d-9a1a-2d3bf5fbd612 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:17.979747 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d7132f7d-0a51-4d54-86a3-f9703ef92032 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3499 microversion: 2.1 time: 0.051910 Mar 12 20:53:17.980763 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 747/1615] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 20:53:17 2022] GET /compute/v2.1/os-migrations => generated 3499 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:17.986381 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-9f27c2d6-a137-4ecf-b999-f79e0820b84d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:17.987005 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-9f27c2d6-a137-4ecf-b999-f79e0820b84d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:17.994258 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f27c2d6-a137-4ecf-b999-f79e0820b84d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:17.994725 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f27c2d6-a137-4ecf-b999-f79e0820b84d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:17.995652 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f27c2d6-a137-4ecf-b999-f79e0820b84d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:18.002505 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-9f27c2d6-a137-4ecf-b999-f79e0820b84d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:18.188353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-13b41d29-cf04-422d-9a1a-2d3bf5fbd612 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:18.204589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-13b41d29-cf04-422d-9a1a-2d3bf5fbd612 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:18.206154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-13b41d29-cf04-422d-9a1a-2d3bf5fbd612 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:18.207522 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-13b41d29-cf04-422d-9a1a-2d3bf5fbd612 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1808 microversion: 2.20 time: 0.281599 Mar 12 20:53:18.208665 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 869/1616] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:17 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:18.213817 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-9f27c2d6-a137-4ecf-b999-f79e0820b84d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:18.221723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4cad2b5b-2124-4134-b56e-037e67fbb3f4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:18.222377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4cad2b5b-2124-4134-b56e-037e67fbb3f4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:18.230322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cad2b5b-2124-4134-b56e-037e67fbb3f4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:18.234520 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-9f27c2d6-a137-4ecf-b999-f79e0820b84d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1320 microversion: 2.1 time: 0.248747 Mar 12 20:53:18.234520 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 748/1617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:17 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1320 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:18.238960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cad2b5b-2124-4134-b56e-037e67fbb3f4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:18.240609 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7e63bc0c-a0ec-4914-b184-6eed391fadc7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:18.241129 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7e63bc0c-a0ec-4914-b184-6eed391fadc7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:18.241256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cad2b5b-2124-4134-b56e-037e67fbb3f4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:18.242303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cad2b5b-2124-4134-b56e-037e67fbb3f4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:18.249848 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7e63bc0c-a0ec-4914-b184-6eed391fadc7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:18.253423 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7e63bc0c-a0ec-4914-b184-6eed391fadc7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:18.254557 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7e63bc0c-a0ec-4914-b184-6eed391fadc7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:18.255214 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7e63bc0c-a0ec-4914-b184-6eed391fadc7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:18.348568 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7e63bc0c-a0ec-4914-b184-6eed391fadc7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:53:18.527747 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7e63bc0c-a0ec-4914-b184-6eed391fadc7 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 204 len: 0 microversion: 2.25 time: 0.292503 Mar 12 20:53:18.528995 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 749/1618] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:53:18 2022] DELETE /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:53:18.554532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4cad2b5b-2124-4134-b56e-037e67fbb3f4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:18.555532 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-7d2e82a0-28f7-4c2a-8d1d-09c27c99bdf0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:18.561454 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-7d2e82a0-28f7-4c2a-8d1d-09c27c99bdf0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:18.568934 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4cad2b5b-2124-4134-b56e-037e67fbb3f4 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1468 microversion: 2.1 time: 0.359043 Mar 12 20:53:18.572567 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7d2e82a0-28f7-4c2a-8d1d-09c27c99bdf0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:18.578663 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7d2e82a0-28f7-4c2a-8d1d-09c27c99bdf0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:18.579811 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7d2e82a0-28f7-4c2a-8d1d-09c27c99bdf0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:18.580462 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-7d2e82a0-28f7-4c2a-8d1d-09c27c99bdf0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:18.580806 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 870/1619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:18 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1468 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:18.590734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-aaa467db-70fc-4967-8fa5-20c769e316e3 req-3c769719-47ec-4e97-9bb1-d03c82424f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae82842-58a0-4d5e-a522-a1c83c53e101", "tag": "c40c686b-b640-42d0-a899-bda5e43f8663"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:18.607960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aaa467db-70fc-4967-8fa5-20c769e316e3 req-3c769719-47ec-4e97-9bb1-d03c82424f24 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:18.609350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aaa467db-70fc-4967-8fa5-20c769e316e3 req-3c769719-47ec-4e97-9bb1-d03c82424f24 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:18.638305 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-aaa467db-70fc-4967-8fa5-20c769e316e3 req-3c769719-47ec-4e97-9bb1-d03c82424f24 service nova] Creating event network-changed:c40c686b-b640-42d0-a899-bda5e43f8663 for instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 on nch1-master-1 Mar 12 20:53:18.646100 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-aaa467db-70fc-4967-8fa5-20c769e316e3 req-3c769719-47ec-4e97-9bb1-d03c82424f24 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061299 Mar 12 20:53:18.647238 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 871/1620] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:18.668085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-63489fc3-fcc7-401b-b9ae-f1b6b7c9dc40 req-ed7424ff-a292-4df3-a7a6-4f62095b8c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbbdbaf3-600b-4097-a346-6bab89a60ea4", "name": "network-vif-plugged", "status": "completed", "tag": "6dcedac0-bc0f-44f2-8a09-02474166334f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:18.682468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-63489fc3-fcc7-401b-b9ae-f1b6b7c9dc40 req-ed7424ff-a292-4df3-a7a6-4f62095b8c73 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:18.683282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-63489fc3-fcc7-401b-b9ae-f1b6b7c9dc40 req-ed7424ff-a292-4df3-a7a6-4f62095b8c73 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:18.697163 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-63489fc3-fcc7-401b-b9ae-f1b6b7c9dc40 req-ed7424ff-a292-4df3-a7a6-4f62095b8c73 service nova] Creating event network-vif-plugged:6dcedac0-bc0f-44f2-8a09-02474166334f for instance bbbdbaf3-600b-4097-a346-6bab89a60ea4 on nch2-master-1 Mar 12 20:53:18.709647 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-63489fc3-fcc7-401b-b9ae-f1b6b7c9dc40 req-ed7424ff-a292-4df3-a7a6-4f62095b8c73 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057851 Mar 12 20:53:18.710936 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 872/1621] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:18.718701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72b45719-ec79-410b-a641-4c24272e782f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e36ed2ee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:18.909882 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-7d2e82a0-28f7-4c2a-8d1d-09c27c99bdf0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:18.927128 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-7d2e82a0-28f7-4c2a-8d1d-09c27c99bdf0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1462 microversion: 2.1 time: 0.395325 Mar 12 20:53:18.930362 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 750/1622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:18 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1462 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:18.939933 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-d6b5fc00-ef80-4154-b8fa-522cea7498f7 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:18.942273 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-d6b5fc00-ef80-4154-b8fa-522cea7498f7 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:19.016969 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d6b5fc00-ef80-4154-b8fa-522cea7498f7 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:19.021845 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d6b5fc00-ef80-4154-b8fa-522cea7498f7 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:19.024779 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d6b5fc00-ef80-4154-b8fa-522cea7498f7 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:19.028997 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-d6b5fc00-ef80-4154-b8fa-522cea7498f7 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:19.371509 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-d6b5fc00-ef80-4154-b8fa-522cea7498f7 tempest-LiveMigrationTest-201003027 tempest-LiveMigrationTest-201003027-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1533 microversion: 2.1 time: 0.438889 Mar 12 20:53:19.373242 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 751/1623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:18 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1533 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:19.380902 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2993745f-fe3b-4e68-8554-a348b125aad1 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:19.381822 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-2993745f-fe3b-4e68-8554-a348b125aad1 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:19.398979 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2993745f-fe3b-4e68-8554-a348b125aad1 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:19.401022 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2993745f-fe3b-4e68-8554-a348b125aad1 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:19.402064 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2993745f-fe3b-4e68-8554-a348b125aad1 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:19.402777 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2993745f-fe3b-4e68-8554-a348b125aad1 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:19.671952 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2993745f-fe3b-4e68-8554-a348b125aad1 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:19.692146 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2993745f-fe3b-4e68-8554-a348b125aad1 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:19.695478 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2993745f-fe3b-4e68-8554-a348b125aad1 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:19.697423 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2993745f-fe3b-4e68-8554-a348b125aad1 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1547 microversion: 2.25 time: 0.322241 Mar 12 20:53:19.698454 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 752/1624] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:19 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1547 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:19.705066 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-4255d31b-a00a-4d48-abb7-c3215782ed39 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:19.706599 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-4255d31b-a00a-4d48-abb7-c3215782ed39 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:19.720699 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4255d31b-a00a-4d48-abb7-c3215782ed39 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:19.721873 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4255d31b-a00a-4d48-abb7-c3215782ed39 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:19.724399 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4255d31b-a00a-4d48-abb7-c3215782ed39 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:19.725032 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-4255d31b-a00a-4d48-abb7-c3215782ed39 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:19.883923 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-4255d31b-a00a-4d48-abb7-c3215782ed39 tempest-DeleteServersAdminTestJSON-652169063 tempest-DeleteServersAdminTestJSON-652169063-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a/action" status: 202 len: 0 microversion: 2.1 time: 0.182998 Mar 12 20:53:19.885376 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 753/1625] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:53:19 2022] POST /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:53:19.892259 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c10353c2-72e3-4024-9310-ebdad2866fb4 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e36e1d700>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:20.608349 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72b45719-ec79-410b-a641-4c24272e782f tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31" status: 200 len: 1446 microversion: 2.1 time: 1.895872 Mar 12 20:53:20.611924 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 873/1626] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:18 2022] GET /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31 => generated 1446 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:20.624215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce1ae3c6-5e43-46ce-9735-df969ef76abf tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:20.625762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce1ae3c6-5e43-46ce-9735-df969ef76abf tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:20.630959 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c10353c2-72e3-4024-9310-ebdad2866fb4 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755" status: 200 len: 1438 microversion: 2.1 time: 0.744302 Mar 12 20:53:20.635426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce1ae3c6-5e43-46ce-9735-df969ef76abf tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:20.637816 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 754/1627] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:19 2022] GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755 => generated 1438 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:20.638306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce1ae3c6-5e43-46ce-9735-df969ef76abf tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:20.639738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce1ae3c6-5e43-46ce-9735-df969ef76abf tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:20.640209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce1ae3c6-5e43-46ce-9735-df969ef76abf tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:20.645560 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2a98560e-999c-45ca-9311-6442f87d1e40 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:20.646409 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-2a98560e-999c-45ca-9311-6442f87d1e40 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:20.653882 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2a98560e-999c-45ca-9311-6442f87d1e40 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:20.654605 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2a98560e-999c-45ca-9311-6442f87d1e40 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:20.655678 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2a98560e-999c-45ca-9311-6442f87d1e40 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:20.656286 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2a98560e-999c-45ca-9311-6442f87d1e40 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:20.806966 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce1ae3c6-5e43-46ce-9735-df969ef76abf tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1613 microversion: 2.1 time: 0.193497 Mar 12 20:53:20.808127 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 874/1628] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:20 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1613 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:20.811950 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2a98560e-999c-45ca-9311-6442f87d1e40 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:20.814527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e8f033f-1026-4465-9bb9-4964dfcc1a3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:20.815637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e8f033f-1026-4465-9bb9-4964dfcc1a3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:20.823615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e8f033f-1026-4465-9bb9-4964dfcc1a3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:20.824422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e8f033f-1026-4465-9bb9-4964dfcc1a3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:20.825427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e8f033f-1026-4465-9bb9-4964dfcc1a3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:20.826086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e8f033f-1026-4465-9bb9-4964dfcc1a3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:20.836354 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2a98560e-999c-45ca-9311-6442f87d1e40 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:20.838025 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2a98560e-999c-45ca-9311-6442f87d1e40 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:20.840489 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2a98560e-999c-45ca-9311-6442f87d1e40 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1808 microversion: 2.20 time: 0.199937 Mar 12 20:53:20.853200 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 755/1629] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:20 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:20.853200 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:20.853200 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:20.869882 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:20.870271 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:20.871073 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:20.871519 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:20.925410 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:53:21.041613 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-e841a731-5de0-4f8d-8e76-9e8dcb62e94b tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 204 len: 0 microversion: 2.1 time: 0.196548 Mar 12 20:53:21.042569 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 756/1630] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:20 2022] DELETE /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:21.048722 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-8d84d2ca-f832-4c72-9e7b-6393e328d216 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:21.049562 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-8d84d2ca-f832-4c72-9e7b-6393e328d216 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:21.053868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8e8f033f-1026-4465-9bb9-4964dfcc1a3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:21.055748 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8d84d2ca-f832-4c72-9e7b-6393e328d216 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:21.056190 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8d84d2ca-f832-4c72-9e7b-6393e328d216 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:21.057294 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8d84d2ca-f832-4c72-9e7b-6393e328d216 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:21.057437 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8d84d2ca-f832-4c72-9e7b-6393e328d216 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:21.062139 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8e8f033f-1026-4465-9bb9-4964dfcc1a3b tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1506 microversion: 2.1 time: 0.252772 Mar 12 20:53:21.062725 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 875/1631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:20 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:21.067910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abf491a8-4bff-4c98-951e-21c0bd18c81d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e375e6ca0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:21.112623 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8d84d2ca-f832-4c72-9e7b-6393e328d216 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:21.113093 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-8d84d2ca-f832-4c72-9e7b-6393e328d216 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:21.113554 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.objects.instance [None req-8d84d2ca-f832-4c72-9e7b-6393e328d216 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lazy-loading 'fault' on Instance uuid 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a {{(pid=136303) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:53:21.316959 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-8d84d2ca-f832-4c72-9e7b-6393e328d216 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:21.326499 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-8d84d2ca-f832-4c72-9e7b-6393e328d216 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1451 microversion: 2.1 time: 0.282469 Mar 12 20:53:21.328320 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 757/1632] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:21 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1451 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:21.344779 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-17b3953c-cc0a-44a5-b658-c69f91d2c76b tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e36e00af0>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:22.152028 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-abf491a8-4bff-4c98-951e-21c0bd18c81d tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31" status: 204 len: 0 microversion: 2.1 time: 1.087952 Mar 12 20:53:22.158399 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 876/1633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:21 2022] DELETE /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31 => generated 0 bytes in 1090 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:22.164842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b3aa0bbe-e0ac-437c-b627-6573cdfbe06e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:22.165755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b3aa0bbe-e0ac-437c-b627-6573cdfbe06e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:22.173786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3aa0bbe-e0ac-437c-b627-6573cdfbe06e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.174565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3aa0bbe-e0ac-437c-b627-6573cdfbe06e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.175690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3aa0bbe-e0ac-437c-b627-6573cdfbe06e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.176355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3aa0bbe-e0ac-437c-b627-6573cdfbe06e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.198538 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-17b3953c-cc0a-44a5-b658-c69f91d2c76b tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755" status: 200 len: 1438 microversion: 2.1 time: 0.870182 Mar 12 20:53:22.207082 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 758/1634] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:21 2022] GET /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755 => generated 1438 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:22.212184 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [req-99ec8afa-d290-45b2-8a1f-79212f582ef0 req-11aa44de-65df-41c6-b3f1-e718facb0c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a01d27-42ab-4258-be66-a86606d977d6", "name": "network-vif-plugged", "status": "completed", "tag": "fb9ee1ae-e3ac-4632-96cb-7591d2fde26d"}]} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:22.229468 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-99ec8afa-d290-45b2-8a1f-79212f582ef0 req-11aa44de-65df-41c6-b3f1-e718facb0c43 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.232212 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [req-99ec8afa-d290-45b2-8a1f-79212f582ef0 req-11aa44de-65df-41c6-b3f1-e718facb0c43 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.255763 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.compute.server_external_events [req-99ec8afa-d290-45b2-8a1f-79212f582ef0 req-11aa44de-65df-41c6-b3f1-e718facb0c43 service nova] Creating event network-vif-plugged:fb9ee1ae-e3ac-4632-96cb-7591d2fde26d for instance b1a01d27-42ab-4258-be66-a86606d977d6 on nch2-master-1 Mar 12 20:53:22.267002 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [req-99ec8afa-d290-45b2-8a1f-79212f582ef0 req-11aa44de-65df-41c6-b3f1-e718facb0c43 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058329 Mar 12 20:53:22.268245 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 759/1635] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:22.273821 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-168c9fd3-28fe-49fe-9b9d-e5251eefe7b0 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:22.274739 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-168c9fd3-28fe-49fe-9b9d-e5251eefe7b0 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:22.282815 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-168c9fd3-28fe-49fe-9b9d-e5251eefe7b0 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.284762 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-168c9fd3-28fe-49fe-9b9d-e5251eefe7b0 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.285948 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-168c9fd3-28fe-49fe-9b9d-e5251eefe7b0 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.286565 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-168c9fd3-28fe-49fe-9b9d-e5251eefe7b0 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.320120 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-168c9fd3-28fe-49fe-9b9d-e5251eefe7b0 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4909aae0562140f1abbf15fa479a68fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7513b5c3eaeb4fabb701947798f27daa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:22.321012 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-168c9fd3-28fe-49fe-9b9d-e5251eefe7b0 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] flavor_id is None. Assuming migration. {{(pid=136303) resize /opt/stack/nova/nova/compute/api.py:4140}} Mar 12 20:53:22.321646 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-168c9fd3-28fe-49fe-9b9d-e5251eefe7b0 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136303) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 20:53:22.437289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b3aa0bbe-e0ac-437c-b627-6573cdfbe06e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:22.446209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b3aa0bbe-e0ac-437c-b627-6573cdfbe06e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:22.447997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b3aa0bbe-e0ac-437c-b627-6573cdfbe06e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:22.449263 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b3aa0bbe-e0ac-437c-b627-6573cdfbe06e tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1547 microversion: 2.25 time: 0.288568 Mar 12 20:53:22.449860 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 877/1636] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:22 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1547 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:22.454401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7feae41-11d3-49b6-a64b-923421979678 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:22.455229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a7feae41-11d3-49b6-a64b-923421979678 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:22.468442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7feae41-11d3-49b6-a64b-923421979678 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.469032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7feae41-11d3-49b6-a64b-923421979678 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.470748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7feae41-11d3-49b6-a64b-923421979678 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.471442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7feae41-11d3-49b6-a64b-923421979678 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.485632 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-168c9fd3-28fe-49fe-9b9d-e5251eefe7b0 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e/action" status: 202 len: 0 microversion: 2.1 time: 0.215910 Mar 12 20:53:22.486706 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 760/1637] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:53:22 2022] POST /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:53:22.496223 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-90813b0c-0f14-44a1-a81d-ed42eb4d3ff6 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:22.496974 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-90813b0c-0f14-44a1-a81d-ed42eb4d3ff6 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:22.506678 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-90813b0c-0f14-44a1-a81d-ed42eb4d3ff6 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.507423 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-90813b0c-0f14-44a1-a81d-ed42eb4d3ff6 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.508528 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-90813b0c-0f14-44a1-a81d-ed42eb4d3ff6 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.509127 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-90813b0c-0f14-44a1-a81d-ed42eb4d3ff6 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.558457 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-90813b0c-0f14-44a1-a81d-ed42eb4d3ff6 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:53:22.718607 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-90813b0c-0f14-44a1-a81d-ed42eb4d3ff6 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 204 len: 0 microversion: 2.1 time: 0.229645 Mar 12 20:53:22.720569 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 761/1638] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:22 2022] DELETE /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:22.726668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a7feae41-11d3-49b6-a64b-923421979678 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:22.729021 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-2d10ba86-baad-4842-ad2c-2c26775d8a5a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:22.730525 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-2d10ba86-baad-4842-ad2c-2c26775d8a5a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:22.737501 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7feae41-11d3-49b6-a64b-923421979678 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1388 microversion: 2.1 time: 0.285506 Mar 12 20:53:22.738145 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 878/1639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:22 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1388 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:22.739282 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2d10ba86-baad-4842-ad2c-2c26775d8a5a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.739953 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2d10ba86-baad-4842-ad2c-2c26775d8a5a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.741177 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2d10ba86-baad-4842-ad2c-2c26775d8a5a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.741681 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-2d10ba86-baad-4842-ad2c-2c26775d8a5a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.746993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4cd2b01a-bf5b-4f94-949c-bf2b67fcc2f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:22.746993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4cd2b01a-bf5b-4f94-949c-bf2b67fcc2f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:22.751155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cd2b01a-bf5b-4f94-949c-bf2b67fcc2f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.751681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cd2b01a-bf5b-4f94-949c-bf2b67fcc2f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.754553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cd2b01a-bf5b-4f94-949c-bf2b67fcc2f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:22.755256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cd2b01a-bf5b-4f94-949c-bf2b67fcc2f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:22.796947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4cd2b01a-bf5b-4f94-949c-bf2b67fcc2f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:53:22.976624 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4cd2b01a-bf5b-4f94-949c-bf2b67fcc2f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 204 len: 0 microversion: 2.1 time: 0.237075 Mar 12 20:53:22.980455 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 879/1640] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:22 2022] DELETE /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:22.986710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b172423-2040-4ab2-ac9e-aa2b403a9756 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:22.989801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b172423-2040-4ab2-ac9e-aa2b403a9756 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:23.029619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b172423-2040-4ab2-ac9e-aa2b403a9756 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:23.030711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b172423-2040-4ab2-ac9e-aa2b403a9756 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:23.031513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b172423-2040-4ab2-ac9e-aa2b403a9756 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:23.031983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b172423-2040-4ab2-ac9e-aa2b403a9756 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:23.300720 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2d10ba86-baad-4842-ad2c-2c26775d8a5a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:23.301364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b172423-2040-4ab2-ac9e-aa2b403a9756 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:23.309386 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b172423-2040-4ab2-ac9e-aa2b403a9756 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1466 microversion: 2.1 time: 0.327626 Mar 12 20:53:23.321797 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 880/1641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:22 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1466 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:23.321797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35443d63-ee14-4517-9486-a5eee7afc8a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:23.321797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-35443d63-ee14-4517-9486-a5eee7afc8a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:23.325011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35443d63-ee14-4517-9486-a5eee7afc8a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:23.325502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35443d63-ee14-4517-9486-a5eee7afc8a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:23.326300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35443d63-ee14-4517-9486-a5eee7afc8a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:23.327287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35443d63-ee14-4517-9486-a5eee7afc8a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:23.338524 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2d10ba86-baad-4842-ad2c-2c26775d8a5a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:23.340214 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-2d10ba86-baad-4842-ad2c-2c26775d8a5a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:23.341446 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-2d10ba86-baad-4842-ad2c-2c26775d8a5a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1808 microversion: 2.20 time: 0.619571 Mar 12 20:53:23.352821 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 762/1642] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:22 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1808 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:23.359806 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f249d259-1fb8-42a9-a300-7fbdae29663d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30c3b759-aaca-47e9-b4c6-dec2f4918184"}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:23.360753 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f249d259-1fb8-42a9-a300-7fbdae29663d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:23.369933 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f249d259-1fb8-42a9-a300-7fbdae29663d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:23.370388 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f249d259-1fb8-42a9-a300-7fbdae29663d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:23.381763 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f249d259-1fb8-42a9-a300-7fbdae29663d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:23.382690 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f249d259-1fb8-42a9-a300-7fbdae29663d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:23.526261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-35443d63-ee14-4517-9486-a5eee7afc8a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:23.547578 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-35443d63-ee14-4517-9486-a5eee7afc8a0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1471 microversion: 2.1 time: 0.236073 Mar 12 20:53:23.550468 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 881/1643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:23 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:23.558568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6c0e08a0-a39c-41b3-b862-9d62bfb8aa96 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:23.559453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6c0e08a0-a39c-41b3-b862-9d62bfb8aa96 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:23.565700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c0e08a0-a39c-41b3-b862-9d62bfb8aa96 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:23.566372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c0e08a0-a39c-41b3-b862-9d62bfb8aa96 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:23.567346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c0e08a0-a39c-41b3-b862-9d62bfb8aa96 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:23.568273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c0e08a0-a39c-41b3-b862-9d62bfb8aa96 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:23.611514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c0e08a0-a39c-41b3-b862-9d62bfb8aa96 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:23.611975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c0e08a0-a39c-41b3-b862-9d62bfb8aa96 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:23.612446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-6c0e08a0-a39c-41b3-b862-9d62bfb8aa96 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lazy-loading 'fault' on Instance uuid 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:53:23.727553 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f249d259-1fb8-42a9-a300-7fbdae29663d tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "POST /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.373107 Mar 12 20:53:23.728495 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 763/1644] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 20:53:23 2022] POST /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:23.760075 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1849550433", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "f9820f27-69e7-43b5-9215-94ce6d672d9b"}]}} {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:23.859786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6c0e08a0-a39c-41b3-b862-9d62bfb8aa96 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:23.867159 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6c0e08a0-a39c-41b3-b862-9d62bfb8aa96 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1457 microversion: 2.1 time: 0.315596 Mar 12 20:53:23.867932 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 882/1645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:23 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1457 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:23.882070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ea51e7c-837e-44c1-8aed-7819e5612e1b tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e37322700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:23.928123 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.network.neutron [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] validate_networks() for [('f9820f27-69e7-43b5-9215-94ce6d672d9b', None, None, None, None, None)] {{(pid=136303) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:53:24.998022 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ea51e7c-837e-44c1-8aed-7819e5612e1b tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "DELETE /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755" status: 204 len: 0 microversion: 2.1 time: 1.120653 Mar 12 20:53:24.998022 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 883/1646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:23 2022] DELETE /compute/v2.1/images/cb4b67ba-8e36-459d-943d-19e9b5369755 => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:24.998022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b7b434e2-5fa9-4254-942f-d2e4c77ed87d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:25.000352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b7b434e2-5fa9-4254-942f-d2e4c77ed87d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:25.016752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7b434e2-5fa9-4254-942f-d2e4c77ed87d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:25.022498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7b434e2-5fa9-4254-942f-d2e4c77ed87d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:25.023743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7b434e2-5fa9-4254-942f-d2e4c77ed87d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:25.024355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7b434e2-5fa9-4254-942f-d2e4c77ed87d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:25.051757 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Flavor limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:53:25.052871 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Image limits 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:53:25.053531 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Flavor pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:53:25.054279 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Image pref 0:0:0 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:53:25.054868 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.virt.hardware [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136303) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:53:25.068468 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:25.069170 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:25.071162 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:25.074401 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:25.121494 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Getting quotas for project c0c046eb0b9248d3bde469b35342ff50. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:53:25.131777 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.quota [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Getting quotas for user 1b433353e06247bfbd0897c84912256f and project c0c046eb0b9248d3bde469b35342ff50. Resources: {'ram', 'instances', 'cores'} {{(pid=136303) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:53:25.175013 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Going to run 1 instances... {{(pid=136303) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:53:25.178174 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136303) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:53:25.268517 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-cf65df0d-3f98-4471-b0b6-dfa1816fa665 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.537847 Mar 12 20:53:25.269841 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 764/1647] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:53:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:53:25.281382 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-c72f5c3b-5f4d-412b-9cc5-8afb0c2249bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:25.282457 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-c72f5c3b-5f4d-412b-9cc5-8afb0c2249bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:25.294302 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c72f5c3b-5f4d-412b-9cc5-8afb0c2249bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:25.296089 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c72f5c3b-5f4d-412b-9cc5-8afb0c2249bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:25.297084 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c72f5c3b-5f4d-412b-9cc5-8afb0c2249bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:25.297744 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-c72f5c3b-5f4d-412b-9cc5-8afb0c2249bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:25.412230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b7b434e2-5fa9-4254-942f-d2e4c77ed87d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:25.423075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b7b434e2-5fa9-4254-942f-d2e4c77ed87d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:25.428996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b7b434e2-5fa9-4254-942f-d2e4c77ed87d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:25.432498 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b7b434e2-5fa9-4254-942f-d2e4c77ed87d tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1547 microversion: 2.25 time: 0.437366 Mar 12 20:53:25.433938 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 884/1648] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:24 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1547 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:25.441168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-91279da8-c90d-4660-8ce6-7ea1a573dee8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:25.442343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-91279da8-c90d-4660-8ce6-7ea1a573dee8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:25.450523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91279da8-c90d-4660-8ce6-7ea1a573dee8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:25.452033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91279da8-c90d-4660-8ce6-7ea1a573dee8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:25.453663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91279da8-c90d-4660-8ce6-7ea1a573dee8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:25.454308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91279da8-c90d-4660-8ce6-7ea1a573dee8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:25.895062 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-c72f5c3b-5f4d-412b-9cc5-8afb0c2249bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:25.904340 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-c72f5c3b-5f4d-412b-9cc5-8afb0c2249bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1388 microversion: 2.1 time: 0.631839 Mar 12 20:53:25.907168 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 765/1649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:25 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1388 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:25.912517 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-5df87ce2-2966-4441-bc73-08e7e1a2fa5c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:25.913743 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-5df87ce2-2966-4441-bc73-08e7e1a2fa5c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:25.914719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-91279da8-c90d-4660-8ce6-7ea1a573dee8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:25.933145 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5df87ce2-2966-4441-bc73-08e7e1a2fa5c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:25.933871 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5df87ce2-2966-4441-bc73-08e7e1a2fa5c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:25.937280 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5df87ce2-2966-4441-bc73-08e7e1a2fa5c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:25.938547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-91279da8-c90d-4660-8ce6-7ea1a573dee8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:25.939526 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-5df87ce2-2966-4441-bc73-08e7e1a2fa5c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:25.947121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-91279da8-c90d-4660-8ce6-7ea1a573dee8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:25.953248 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-91279da8-c90d-4660-8ce6-7ea1a573dee8 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1808 microversion: 2.20 time: 0.517960 Mar 12 20:53:25.976275 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 885/1650] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:25 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1808 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:25.984468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec24e463-1f45-4d7a-85bf-2349d86639a7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:25.985994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec24e463-1f45-4d7a-85bf-2349d86639a7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:25.997018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec24e463-1f45-4d7a-85bf-2349d86639a7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:25.999139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec24e463-1f45-4d7a-85bf-2349d86639a7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:26.001172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec24e463-1f45-4d7a-85bf-2349d86639a7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:26.002485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec24e463-1f45-4d7a-85bf-2349d86639a7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:26.046964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec24e463-1f45-4d7a-85bf-2349d86639a7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:26.047503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec24e463-1f45-4d7a-85bf-2349d86639a7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:26.048210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-ec24e463-1f45-4d7a-85bf-2349d86639a7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lazy-loading 'fault' on Instance uuid 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:53:26.131997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ec24e463-1f45-4d7a-85bf-2349d86639a7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95f8d44de34e49b9b99622fb76159ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb3e4f8854b4ae9b4bba6d166d6a514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:26.144182 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec24e463-1f45-4d7a-85bf-2349d86639a7 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 200 len: 1415 microversion: 2.1 time: 0.172800 Mar 12 20:53:26.145083 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 886/1651] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:25 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 1415 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:26.155664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7a5df0a-f0e1-4a0c-8012-194da29aa6f1 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '.version_select at 0x7f6e372e5790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:26.220353 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e7a5df0a-f0e1-4a0c-8012-194da29aa6f1 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] HTTP exception thrown: Image not found. Mar 12 20:53:26.221989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7a5df0a-f0e1-4a0c-8012-194da29aa6f1 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:26.222847 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e7a5df0a-f0e1-4a0c-8012-194da29aa6f1 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "DELETE /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445" status: 404 len: 62 microversion: 2.1 time: 0.076838 Mar 12 20:53:26.223451 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 887/1652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:26 2022] DELETE /compute/v2.1/images/4644a10a-cb08-4c67-9e99-cb5eefd4f445 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:53:26.235000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-04d5c70f-6aaf-4e5b-8dc0-9276405af126 req-fc596cb6-dbb8-45c6-a5b7-e3d8ebefd784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e", "name": "network-vif-unplugged", "status": "completed", "tag": "1326e734-666a-431b-bab6-8338bafdbcba"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:26.284807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-04d5c70f-6aaf-4e5b-8dc0-9276405af126 req-fc596cb6-dbb8-45c6-a5b7-e3d8ebefd784 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:26.285507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-04d5c70f-6aaf-4e5b-8dc0-9276405af126 req-fc596cb6-dbb8-45c6-a5b7-e3d8ebefd784 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:26.330138 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-04d5c70f-6aaf-4e5b-8dc0-9276405af126 req-fc596cb6-dbb8-45c6-a5b7-e3d8ebefd784 service nova] Creating event network-vif-unplugged:1326e734-666a-431b-bab6-8338bafdbcba for instance 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e on nch2-master-1 Mar 12 20:53:26.372534 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-04d5c70f-6aaf-4e5b-8dc0-9276405af126 req-fc596cb6-dbb8-45c6-a5b7-e3d8ebefd784 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135616 Mar 12 20:53:26.378238 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 888/1653] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:26.388176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-89f00c7b-2f91-4f8d-a8a3-9a531b059ec6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:26.401854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89f00c7b-2f91-4f8d-a8a3-9a531b059ec6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:26.423204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89f00c7b-2f91-4f8d-a8a3-9a531b059ec6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:26.430625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89f00c7b-2f91-4f8d-a8a3-9a531b059ec6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:26.432100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89f00c7b-2f91-4f8d-a8a3-9a531b059ec6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:26.440661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89f00c7b-2f91-4f8d-a8a3-9a531b059ec6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:26.453921 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-5df87ce2-2966-4441-bc73-08e7e1a2fa5c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:26.468161 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-5df87ce2-2966-4441-bc73-08e7e1a2fa5c tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1471 microversion: 2.1 time: 0.559347 Mar 12 20:53:26.470156 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 766/1654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:25 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1471 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:26.480163 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-1ca8a877-9324-4cc9-b323-6c4291690ebe tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:26.480973 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-1ca8a877-9324-4cc9-b323-6c4291690ebe tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:26.504503 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1ca8a877-9324-4cc9-b323-6c4291690ebe tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:26.504966 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1ca8a877-9324-4cc9-b323-6c4291690ebe tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:26.507829 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1ca8a877-9324-4cc9-b323-6c4291690ebe tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:26.508362 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-1ca8a877-9324-4cc9-b323-6c4291690ebe tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:26.571969 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-1ca8a877-9324-4cc9-b323-6c4291690ebe tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Going to try to terminate instance {{(pid=136303) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:53:26.687938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-89f00c7b-2f91-4f8d-a8a3-9a531b059ec6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:26.699810 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-89f00c7b-2f91-4f8d-a8a3-9a531b059ec6 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 200 len: 1204 microversion: 2.1 time: 0.318986 Mar 12 20:53:26.701508 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 889/1655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:26 2022] GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 1204 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:26.709519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ef6a87b8-3c0a-4932-9216-2cd518c5ee1e req-26a16a72-33ce-4241-81ad-0b42b4538bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a", "name": "network-vif-deleted", "tag": "cb64dcca-1e41-4ca4-abda-36635e0a71ae"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:26.725066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ef6a87b8-3c0a-4932-9216-2cd518c5ee1e req-26a16a72-33ce-4241-81ad-0b42b4538bcb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:26.726664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ef6a87b8-3c0a-4932-9216-2cd518c5ee1e req-26a16a72-33ce-4241-81ad-0b42b4538bcb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:26.749662 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ef6a87b8-3c0a-4932-9216-2cd518c5ee1e req-26a16a72-33ce-4241-81ad-0b42b4538bcb service nova] Creating event network-vif-deleted:cb64dcca-1e41-4ca4-abda-36635e0a71ae for instance 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a on nch2-master-1 Mar 12 20:53:26.755894 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ef6a87b8-3c0a-4932-9216-2cd518c5ee1e req-26a16a72-33ce-4241-81ad-0b42b4538bcb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052203 Mar 12 20:53:26.760819 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 890/1656] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:26.769997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34228068-448c-4229-82f9-fdc129757804 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:26.771416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34228068-448c-4229-82f9-fdc129757804 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:26.780554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34228068-448c-4229-82f9-fdc129757804 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:26.781499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34228068-448c-4229-82f9-fdc129757804 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:26.782569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34228068-448c-4229-82f9-fdc129757804 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:26.783472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34228068-448c-4229-82f9-fdc129757804 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:26.814923 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-1ca8a877-9324-4cc9-b323-6c4291690ebe tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 204 len: 0 microversion: 2.1 time: 0.333269 Mar 12 20:53:26.827965 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 767/1657] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:26 2022] DELETE /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:26.835413 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-f7a4eb83-bb28-4b99-b2b7-f25b735ebc64 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:26.836335 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-f7a4eb83-bb28-4b99-b2b7-f25b735ebc64 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:26.844668 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f7a4eb83-bb28-4b99-b2b7-f25b735ebc64 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:26.846622 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f7a4eb83-bb28-4b99-b2b7-f25b735ebc64 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:26.848752 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f7a4eb83-bb28-4b99-b2b7-f25b735ebc64 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:26.850689 ncdv-master-1 devstack@n-api.service[136303]: DEBUG oslo_concurrency.lockutils [None req-f7a4eb83-bb28-4b99-b2b7-f25b735ebc64 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:27.170213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34228068-448c-4229-82f9-fdc129757804 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:27.185353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34228068-448c-4229-82f9-fdc129757804 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:27.192136 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.policy [None req-f7a4eb83-bb28-4b99-b2b7-f25b735ebc64 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136303) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:27.194283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34228068-448c-4229-82f9-fdc129757804 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:27.199054 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34228068-448c-4229-82f9-fdc129757804 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1547 microversion: 2.25 time: 0.435551 Mar 12 20:53:27.200031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 891/1658] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:26 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1547 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:27.204692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35fc90b8-972f-42e0-a4af-1bedebcf1bad tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:27.205303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-35fc90b8-972f-42e0-a4af-1bedebcf1bad tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:27.224937 ncdv-master-1 devstack@n-api.service[136303]: INFO nova.api.openstack.requestlog [None req-f7a4eb83-bb28-4b99-b2b7-f25b735ebc64 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1472 microversion: 2.1 time: 0.396197 Mar 12 20:53:27.244425 ncdv-master-1 devstack@n-api.service[136303]: [pid: 136303|app: 0|req: 768/1659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:26 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1472 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:27.262418 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.api.openstack.wsgi [None req-752ff4b2-f176-4b45-acc4-f053eb0ff56a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:27.264828 ncdv-master-1 devstack@n-api.service[136303]: DEBUG nova.compute.api [None req-752ff4b2-f176-4b45-acc4-f053eb0ff56a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136303) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:27.289750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35fc90b8-972f-42e0-a4af-1bedebcf1bad tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:27.290301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35fc90b8-972f-42e0-a4af-1bedebcf1bad tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:27.290820 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 20:53:27.291124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35fc90b8-972f-42e0-a4af-1bedebcf1bad tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:27.292150 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 20:53:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 20:53:27.298408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35fc90b8-972f-42e0-a4af-1bedebcf1bad tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:27.301477 ncdv-master-1 devstack@n-api.service[136303]: Traceback (most recent call last): Mar 12 20:53:27.301659 ncdv-master-1 devstack@n-api.service[136303]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Mar 12 20:53:27.301659 ncdv-master-1 devstack@n-api.service[136303]: timer() Mar 12 20:53:27.301659 ncdv-master-1 devstack@n-api.service[136303]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Mar 12 20:53:27.301659 ncdv-master-1 devstack@n-api.service[136303]: cb(*args, **kw) Mar 12 20:53:27.301659 ncdv-master-1 devstack@n-api.service[136303]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Mar 12 20:53:27.301659 ncdv-master-1 devstack@n-api.service[136303]: waiter.switch() Mar 12 20:53:27.301659 ncdv-master-1 devstack@n-api.service[136303]: greenlet.error: cannot switch to a different thread Mar 12 20:53:27.580476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-35fc90b8-972f-42e0-a4af-1bedebcf1bad tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:27.609803 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-35fc90b8-972f-42e0-a4af-1bedebcf1bad tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1388 microversion: 2.1 time: 0.408132 Mar 12 20:53:27.610745 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 892/1660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:27 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1388 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:27.624867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f508a0f-ec0d-4283-9b52-26f648e2e7ee tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:27.629459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f508a0f-ec0d-4283-9b52-26f648e2e7ee tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:27.638652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f508a0f-ec0d-4283-9b52-26f648e2e7ee tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:27.640118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f508a0f-ec0d-4283-9b52-26f648e2e7ee tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:27.641616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f508a0f-ec0d-4283-9b52-26f648e2e7ee tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:27.643067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f508a0f-ec0d-4283-9b52-26f648e2e7ee tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:27.684137 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-1f508a0f-ec0d-4283-9b52-26f648e2e7ee tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] HTTP exception thrown: Instance 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a could not be found. Mar 12 20:53:27.689098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f508a0f-ec0d-4283-9b52-26f648e2e7ee tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Returning 404 to user: Instance 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:27.690569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f508a0f-ec0d-4283-9b52-26f648e2e7ee tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 404 len: 111 microversion: 2.1 time: 0.078296 Mar 12 20:53:27.694975 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 893/1661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:27 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:27.707541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b8ed15c9-a75e-46cd-a834-2d63f1299a52 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:27.714877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b8ed15c9-a75e-46cd-a834-2d63f1299a52 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:27.740731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8ed15c9-a75e-46cd-a834-2d63f1299a52 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:27.741573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8ed15c9-a75e-46cd-a834-2d63f1299a52 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:27.743787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8ed15c9-a75e-46cd-a834-2d63f1299a52 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:27.754102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8ed15c9-a75e-46cd-a834-2d63f1299a52 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.002725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b8ed15c9-a75e-46cd-a834-2d63f1299a52 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:28.012313 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b8ed15c9-a75e-46cd-a834-2d63f1299a52 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1471 microversion: 2.1 time: 0.316051 Mar 12 20:53:28.022519 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 894/1662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:27 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:28.032957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4d74609f-4190-445e-94ea-ecad34996ba5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:28.033469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4d74609f-4190-445e-94ea-ecad34996ba5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:28.041633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d74609f-4190-445e-94ea-ecad34996ba5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.042142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d74609f-4190-445e-94ea-ecad34996ba5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.042934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d74609f-4190-445e-94ea-ecad34996ba5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.043378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d74609f-4190-445e-94ea-ecad34996ba5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.063550 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-4d74609f-4190-445e-94ea-ecad34996ba5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] HTTP exception thrown: Instance 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a could not be found. Mar 12 20:53:28.064185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4d74609f-4190-445e-94ea-ecad34996ba5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Returning 404 to user: Instance 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:28.065512 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4d74609f-4190-445e-94ea-ecad34996ba5 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 404 len: 111 microversion: 2.1 time: 0.048473 Mar 12 20:53:28.070807 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 895/1663] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:28 2022] DELETE /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:28.078816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-66f8f6c9-63b2-414c-b0e1-8760f516f374 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:28.079225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-66f8f6c9-63b2-414c-b0e1-8760f516f374 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:28.086840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f8f6c9-63b2-414c-b0e1-8760f516f374 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.088111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f8f6c9-63b2-414c-b0e1-8760f516f374 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.088710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f8f6c9-63b2-414c-b0e1-8760f516f374 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.089302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f8f6c9-63b2-414c-b0e1-8760f516f374 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.230789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-66f8f6c9-63b2-414c-b0e1-8760f516f374 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:28.240049 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-66f8f6c9-63b2-414c-b0e1-8760f516f374 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 200 len: 1266 microversion: 2.1 time: 0.167550 Mar 12 20:53:28.241362 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 896/1664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:28 2022] GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:28.246736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b9f181e0-9273-443f-95fa-144b988e1b9b tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:28.247382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b9f181e0-9273-443f-95fa-144b988e1b9b tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:28.254930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9f181e0-9273-443f-95fa-144b988e1b9b tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.255328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9f181e0-9273-443f-95fa-144b988e1b9b tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.256413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9f181e0-9273-443f-95fa-144b988e1b9b tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.256911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9f181e0-9273-443f-95fa-144b988e1b9b tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.275344 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b9f181e0-9273-443f-95fa-144b988e1b9b tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] HTTP exception thrown: Instance 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a could not be found. Mar 12 20:53:28.276096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b9f181e0-9273-443f-95fa-144b988e1b9b tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Returning 404 to user: Instance 0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:28.276992 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b9f181e0-9273-443f-95fa-144b988e1b9b tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a" status: 404 len: 111 microversion: 2.1 time: 0.034514 Mar 12 20:53:28.277839 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 897/1665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:28 2022] GET /compute/v2.1/servers/0dbb64eb-9e98-4f53-8854-b5a5a3cccd4a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:28.285915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b8224f0c-10cf-40f2-a580-bf0e7167b326 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:28.286556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b8224f0c-10cf-40f2-a580-bf0e7167b326 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:28.307234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8224f0c-10cf-40f2-a580-bf0e7167b326 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.310388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8224f0c-10cf-40f2-a580-bf0e7167b326 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.312674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8224f0c-10cf-40f2-a580-bf0e7167b326 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.314805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8224f0c-10cf-40f2-a580-bf0e7167b326 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.571062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b8224f0c-10cf-40f2-a580-bf0e7167b326 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:28.582546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b8224f0c-10cf-40f2-a580-bf0e7167b326 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:28.585307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b8224f0c-10cf-40f2-a580-bf0e7167b326 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:28.587404 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b8224f0c-10cf-40f2-a580-bf0e7167b326 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1547 microversion: 2.25 time: 0.305464 Mar 12 20:53:28.601299 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 898/1666] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:28 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1547 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:28.606833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-064be00e-8785-4920-b0b2-6812f497aeea tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:28.608388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-064be00e-8785-4920-b0b2-6812f497aeea tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:28.616907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-064be00e-8785-4920-b0b2-6812f497aeea tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.617877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-064be00e-8785-4920-b0b2-6812f497aeea tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.618697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-064be00e-8785-4920-b0b2-6812f497aeea tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.619177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-064be00e-8785-4920-b0b2-6812f497aeea tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.841068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-064be00e-8785-4920-b0b2-6812f497aeea tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:28.850304 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-064be00e-8785-4920-b0b2-6812f497aeea tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1472 microversion: 2.1 time: 0.247710 Mar 12 20:53:28.850866 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 899/1667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:28 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:28.855638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-111ac214-f7f3-425d-8d8b-0a9ad3398081 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:28.858660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-111ac214-f7f3-425d-8d8b-0a9ad3398081 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:28.866653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-111ac214-f7f3-425d-8d8b-0a9ad3398081 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.867410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-111ac214-f7f3-425d-8d8b-0a9ad3398081 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.868577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-111ac214-f7f3-425d-8d8b-0a9ad3398081 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.869127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-111ac214-f7f3-425d-8d8b-0a9ad3398081 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.885660 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-111ac214-f7f3-425d-8d8b-0a9ad3398081 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] HTTP exception thrown: Instance d342f2eb-8870-4132-be47-59361a46149f could not be found. Mar 12 20:53:28.885871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-111ac214-f7f3-425d-8d8b-0a9ad3398081 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Returning 404 to user: Instance d342f2eb-8870-4132-be47-59361a46149f could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:28.891413 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-111ac214-f7f3-425d-8d8b-0a9ad3398081 tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 404 len: 111 microversion: 2.1 time: 0.034983 Mar 12 20:53:28.892782 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 900/1668] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:28 2022] DELETE /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:28.904444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5e453f0b-ceea-4740-9a8e-23760ea3a267 req-a5b74664-3aa1-4b71-9fc9-ca405b235e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a01d27-42ab-4258-be66-a86606d977d6", "name": "network-vif-unplugged", "status": "completed", "tag": "fb9ee1ae-e3ac-4632-96cb-7591d2fde26d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:28.914478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5e453f0b-ceea-4740-9a8e-23760ea3a267 req-a5b74664-3aa1-4b71-9fc9-ca405b235e13 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.914936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5e453f0b-ceea-4740-9a8e-23760ea3a267 req-a5b74664-3aa1-4b71-9fc9-ca405b235e13 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.927305 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5e453f0b-ceea-4740-9a8e-23760ea3a267 req-a5b74664-3aa1-4b71-9fc9-ca405b235e13 service nova] Creating event network-vif-unplugged:fb9ee1ae-e3ac-4632-96cb-7591d2fde26d for instance b1a01d27-42ab-4258-be66-a86606d977d6 on nch2-master-1 Mar 12 20:53:28.933669 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5e453f0b-ceea-4740-9a8e-23760ea3a267 req-a5b74664-3aa1-4b71-9fc9-ca405b235e13 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039468 Mar 12 20:53:28.937973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 901/1669] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:28.945228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f426130-f261-43bb-925b-810f3979518a tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:28.946481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f426130-f261-43bb-925b-810f3979518a tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:28.953595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f426130-f261-43bb-925b-810f3979518a tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.954273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f426130-f261-43bb-925b-810f3979518a tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:28.955197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f426130-f261-43bb-925b-810f3979518a tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:28.955698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f426130-f261-43bb-925b-810f3979518a tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:29.000991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f426130-f261-43bb-925b-810f3979518a tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061215 Mar 12 20:53:29.001952 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 902/1670] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 20:53:28 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:29.007664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fbf63b90-6037-4517-9019-e5f36df00a98 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:29.008666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fbf63b90-6037-4517-9019-e5f36df00a98 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:29.016385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbf63b90-6037-4517-9019-e5f36df00a98 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:29.016803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbf63b90-6037-4517-9019-e5f36df00a98 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:29.017884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbf63b90-6037-4517-9019-e5f36df00a98 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:29.018415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbf63b90-6037-4517-9019-e5f36df00a98 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:29.170505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fbf63b90-6037-4517-9019-e5f36df00a98 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:29.179869 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fbf63b90-6037-4517-9019-e5f36df00a98 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1388 microversion: 2.1 time: 0.176877 Mar 12 20:53:29.180539 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 903/1671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:29 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1388 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:29.186902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fe7ccbf8-a9f0-42e5-8907-dd99889b1f77 req-db761dc1-9464-4c23-beb6-d44b2945f030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e", "name": "network-vif-deleted", "tag": "1326e734-666a-431b-bab6-8338bafdbcba"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:29.195966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fe7ccbf8-a9f0-42e5-8907-dd99889b1f77 req-db761dc1-9464-4c23-beb6-d44b2945f030 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:29.196420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fe7ccbf8-a9f0-42e5-8907-dd99889b1f77 req-db761dc1-9464-4c23-beb6-d44b2945f030 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:29.210970 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fe7ccbf8-a9f0-42e5-8907-dd99889b1f77 req-db761dc1-9464-4c23-beb6-d44b2945f030 service nova] Creating event network-vif-deleted:1326e734-666a-431b-bab6-8338bafdbcba for instance 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e on nch2-master-1 Mar 12 20:53:29.216972 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fe7ccbf8-a9f0-42e5-8907-dd99889b1f77 req-db761dc1-9464-4c23-beb6-d44b2945f030 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034881 Mar 12 20:53:29.218357 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 904/1672] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:29.224409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b74e314f-94c6-41bf-96cb-b93eac6e5eaa tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:29.225259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b74e314f-94c6-41bf-96cb-b93eac6e5eaa tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] [instance: d342f2eb-8870-4132-be47-59361a46149f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:29.232646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b74e314f-94c6-41bf-96cb-b93eac6e5eaa tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:29.233533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b74e314f-94c6-41bf-96cb-b93eac6e5eaa tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:29.234102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b74e314f-94c6-41bf-96cb-b93eac6e5eaa tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:29.234573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b74e314f-94c6-41bf-96cb-b93eac6e5eaa tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:29.251660 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b74e314f-94c6-41bf-96cb-b93eac6e5eaa tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] HTTP exception thrown: Instance d342f2eb-8870-4132-be47-59361a46149f could not be found. Mar 12 20:53:29.252418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b74e314f-94c6-41bf-96cb-b93eac6e5eaa tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] Returning 404 to user: Instance d342f2eb-8870-4132-be47-59361a46149f could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:29.253699 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b74e314f-94c6-41bf-96cb-b93eac6e5eaa tempest-DeleteServersAdminTestJSON-1225811069 tempest-DeleteServersAdminTestJSON-1225811069-project] 10.222.0.30 "GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f" status: 404 len: 111 microversion: 2.1 time: 0.033796 Mar 12 20:53:29.254644 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 905/1673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:29 2022] GET /compute/v2.1/servers/d342f2eb-8870-4132-be47-59361a46149f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:29.261256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-684a4899-6dac-4535-9599-e5b00d75c223 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:29.261256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-684a4899-6dac-4535-9599-e5b00d75c223 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:29.268008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-684a4899-6dac-4535-9599-e5b00d75c223 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:29.268514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-684a4899-6dac-4535-9599-e5b00d75c223 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:29.269417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-684a4899-6dac-4535-9599-e5b00d75c223 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:29.269977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-684a4899-6dac-4535-9599-e5b00d75c223 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:29.369138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-684a4899-6dac-4535-9599-e5b00d75c223 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lazy-loading 'services' on Instance uuid bbbdbaf3-600b-4097-a346-6bab89a60ea4 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:53:29.457615 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-684a4899-6dac-4535-9599-e5b00d75c223 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4/os-volume_attachments/30c3b759-aaca-47e9-b4c6-dec2f4918184" status: 202 len: 0 microversion: 2.1 time: 0.201648 Mar 12 20:53:29.458457 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 906/1674] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 20:53:29 2022] DELETE /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4/os-volume_attachments/30c3b759-aaca-47e9-b4c6-dec2f4918184 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:53:29.480693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d3f5e56f-0e89-4314-b79c-5d31671e0cd6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:29.481579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d3f5e56f-0e89-4314-b79c-5d31671e0cd6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:29.515889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3f5e56f-0e89-4314-b79c-5d31671e0cd6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:29.516859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3f5e56f-0e89-4314-b79c-5d31671e0cd6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:29.519171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3f5e56f-0e89-4314-b79c-5d31671e0cd6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:29.519635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3f5e56f-0e89-4314-b79c-5d31671e0cd6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:29.721094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d3f5e56f-0e89-4314-b79c-5d31671e0cd6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:29.731503 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d3f5e56f-0e89-4314-b79c-5d31671e0cd6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1471 microversion: 2.1 time: 0.271302 Mar 12 20:53:29.732568 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 907/1675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:29 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:29.746965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-529366ea-57bc-4aa3-b958-1aaf83f6d3f3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:29.747664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-529366ea-57bc-4aa3-b958-1aaf83f6d3f3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:29.754813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-529366ea-57bc-4aa3-b958-1aaf83f6d3f3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:29.755264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-529366ea-57bc-4aa3-b958-1aaf83f6d3f3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:29.756174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-529366ea-57bc-4aa3-b958-1aaf83f6d3f3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:29.756602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-529366ea-57bc-4aa3-b958-1aaf83f6d3f3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:29.979080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-529366ea-57bc-4aa3-b958-1aaf83f6d3f3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:29.990737 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-529366ea-57bc-4aa3-b958-1aaf83f6d3f3 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 200 len: 1308 microversion: 2.1 time: 0.257520 Mar 12 20:53:30.002424 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 908/1676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:29 2022] GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:30.008337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94a56964-fa97-4c91-92d1-b18e63232d11 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:30.009256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94a56964-fa97-4c91-92d1-b18e63232d11 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:30.017559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94a56964-fa97-4c91-92d1-b18e63232d11 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:30.018350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94a56964-fa97-4c91-92d1-b18e63232d11 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:30.019701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94a56964-fa97-4c91-92d1-b18e63232d11 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:30.020598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94a56964-fa97-4c91-92d1-b18e63232d11 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:30.231526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-94a56964-fa97-4c91-92d1-b18e63232d11 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:30.247187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-94a56964-fa97-4c91-92d1-b18e63232d11 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:30.254169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-94a56964-fa97-4c91-92d1-b18e63232d11 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:30.258620 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94a56964-fa97-4c91-92d1-b18e63232d11 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1547 microversion: 2.25 time: 0.254441 Mar 12 20:53:30.259722 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 909/1677] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:30 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1547 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:30.279368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85b46765-0bf1-4ca0-9774-f3f676d28eac tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:30.283172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85b46765-0bf1-4ca0-9774-f3f676d28eac tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:30.314212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85b46765-0bf1-4ca0-9774-f3f676d28eac tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:30.314769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85b46765-0bf1-4ca0-9774-f3f676d28eac tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:30.318722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85b46765-0bf1-4ca0-9774-f3f676d28eac tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:30.319614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85b46765-0bf1-4ca0-9774-f3f676d28eac tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:30.381805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85b46765-0bf1-4ca0-9774-f3f676d28eac tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:30.382457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85b46765-0bf1-4ca0-9774-f3f676d28eac tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:30.382941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-85b46765-0bf1-4ca0-9774-f3f676d28eac tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lazy-loading 'fault' on Instance uuid b1a01d27-42ab-4258-be66-a86606d977d6 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:53:30.449455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-85b46765-0bf1-4ca0-9774-f3f676d28eac tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1954449180ce475a88dec4df6de6523d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a488240d854791982d9752ec577a28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:30.463021 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85b46765-0bf1-4ca0-9774-f3f676d28eac tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 200 len: 1307 microversion: 2.1 time: 0.201486 Mar 12 20:53:30.473910 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 910/1678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:30 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 1307 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:30.476428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8841cb8e-0d7b-4c8c-a2bf-97e86e5758bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:30.477062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8841cb8e-0d7b-4c8c-a2bf-97e86e5758bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:30.494577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8841cb8e-0d7b-4c8c-a2bf-97e86e5758bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:30.495025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8841cb8e-0d7b-4c8c-a2bf-97e86e5758bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:30.496098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8841cb8e-0d7b-4c8c-a2bf-97e86e5758bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:30.496537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8841cb8e-0d7b-4c8c-a2bf-97e86e5758bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:30.711357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8841cb8e-0d7b-4c8c-a2bf-97e86e5758bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:30.721679 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8841cb8e-0d7b-4c8c-a2bf-97e86e5758bc tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1388 microversion: 2.1 time: 0.254188 Mar 12 20:53:30.722473 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 911/1679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:30 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1388 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:30.742472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9d8bde4-7633-45bd-967b-346912888db3 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:30.748116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9d8bde4-7633-45bd-967b-346912888db3 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:30.756643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9d8bde4-7633-45bd-967b-346912888db3 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:30.757178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9d8bde4-7633-45bd-967b-346912888db3 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:30.758365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9d8bde4-7633-45bd-967b-346912888db3 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:30.758941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9d8bde4-7633-45bd-967b-346912888db3 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:30.801380 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9d8bde4-7633-45bd-967b-346912888db3 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077429 Mar 12 20:53:30.807056 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 912/1680] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 20:53:30 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:53:30.807231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27a2a9cd-8b61-45ed-9642-63552b8faeac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:30.807826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27a2a9cd-8b61-45ed-9642-63552b8faeac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:30.817128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27a2a9cd-8b61-45ed-9642-63552b8faeac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:30.818751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27a2a9cd-8b61-45ed-9642-63552b8faeac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:30.820536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27a2a9cd-8b61-45ed-9642-63552b8faeac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:30.821554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27a2a9cd-8b61-45ed-9642-63552b8faeac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.022019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27a2a9cd-8b61-45ed-9642-63552b8faeac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:31.031170 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27a2a9cd-8b61-45ed-9642-63552b8faeac tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1471 microversion: 2.1 time: 0.228027 Mar 12 20:53:31.031808 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 913/1681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:30 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1471 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:31.037214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ee07bcf-82dd-4396-a3aa-fe1767b3e869 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:31.038172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ee07bcf-82dd-4396-a3aa-fe1767b3e869 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:31.045104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee07bcf-82dd-4396-a3aa-fe1767b3e869 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.046447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee07bcf-82dd-4396-a3aa-fe1767b3e869 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.047041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee07bcf-82dd-4396-a3aa-fe1767b3e869 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.047576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee07bcf-82dd-4396-a3aa-fe1767b3e869 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.082213 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ee07bcf-82dd-4396-a3aa-fe1767b3e869 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048995 Mar 12 20:53:31.082798 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 914/1682] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 20:53:31 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:53:31.088064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3d3256a3-7491-4d15-9f24-b87cd76be536 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:31.088616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3d3256a3-7491-4d15-9f24-b87cd76be536 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:31.096472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d3256a3-7491-4d15-9f24-b87cd76be536 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.097129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d3256a3-7491-4d15-9f24-b87cd76be536 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.097747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d3256a3-7491-4d15-9f24-b87cd76be536 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.098300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d3256a3-7491-4d15-9f24-b87cd76be536 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.269818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3d3256a3-7491-4d15-9f24-b87cd76be536 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:31.280312 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3d3256a3-7491-4d15-9f24-b87cd76be536 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 200 len: 1308 microversion: 2.1 time: 0.195740 Mar 12 20:53:31.281029 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 915/1683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:31 2022] GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:31.287747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c91ee53-1ef0-4046-a572-aa9ae5957ac4 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:31.288365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c91ee53-1ef0-4046-a572-aa9ae5957ac4 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:31.295992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c91ee53-1ef0-4046-a572-aa9ae5957ac4 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.296171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c91ee53-1ef0-4046-a572-aa9ae5957ac4 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.297076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c91ee53-1ef0-4046-a572-aa9ae5957ac4 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.297704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c91ee53-1ef0-4046-a572-aa9ae5957ac4 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.326213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c91ee53-1ef0-4046-a572-aa9ae5957ac4 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:53:31.422634 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c91ee53-1ef0-4046-a572-aa9ae5957ac4 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 204 len: 0 microversion: 2.1 time: 0.139283 Mar 12 20:53:31.423299 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 916/1684] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:31 2022] DELETE /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:31.431236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-54a5cda0-5487-4f0e-8350-61180aa671cb req-7cd5cc6a-883c-4de7-a382-cc9e8ab03bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a01d27-42ab-4258-be66-a86606d977d6", "name": "network-vif-deleted", "tag": "fb9ee1ae-e3ac-4632-96cb-7591d2fde26d"}, {"name": "network-changed", "server_uuid": "cfbf9d5b-db02-4e9a-9525-90c905f05276", "tag": "d92a997c-44f0-4bfb-8217-99e7b17b1497"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:31.440014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-54a5cda0-5487-4f0e-8350-61180aa671cb req-7cd5cc6a-883c-4de7-a382-cc9e8ab03bc1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.440467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-54a5cda0-5487-4f0e-8350-61180aa671cb req-7cd5cc6a-883c-4de7-a382-cc9e8ab03bc1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.455048 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-54a5cda0-5487-4f0e-8350-61180aa671cb req-7cd5cc6a-883c-4de7-a382-cc9e8ab03bc1 service nova] Creating event network-vif-deleted:fb9ee1ae-e3ac-4632-96cb-7591d2fde26d for instance b1a01d27-42ab-4258-be66-a86606d977d6 on nch2-master-1 Mar 12 20:53:31.455617 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-54a5cda0-5487-4f0e-8350-61180aa671cb req-7cd5cc6a-883c-4de7-a382-cc9e8ab03bc1 service nova] Creating event network-changed:d92a997c-44f0-4bfb-8217-99e7b17b1497 for instance cfbf9d5b-db02-4e9a-9525-90c905f05276 on nch2-master-1 Mar 12 20:53:31.462040 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-54a5cda0-5487-4f0e-8350-61180aa671cb req-7cd5cc6a-883c-4de7-a382-cc9e8ab03bc1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037353 Mar 12 20:53:31.462614 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 917/1685] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:31.469243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-693b6780-a756-4713-be00-03256b56f8fb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:31.469971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-693b6780-a756-4713-be00-03256b56f8fb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:31.477109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-693b6780-a756-4713-be00-03256b56f8fb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.477570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-693b6780-a756-4713-be00-03256b56f8fb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.478430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-693b6780-a756-4713-be00-03256b56f8fb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.478844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-693b6780-a756-4713-be00-03256b56f8fb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.639978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-693b6780-a756-4713-be00-03256b56f8fb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:31.651359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-693b6780-a756-4713-be00-03256b56f8fb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:31.653077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-693b6780-a756-4713-be00-03256b56f8fb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:31.654442 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-693b6780-a756-4713-be00-03256b56f8fb tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1547 microversion: 2.25 time: 0.190587 Mar 12 20:53:31.666574 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 918/1686] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:31 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1547 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:31.666574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-18284446-8b8c-4e80-aa52-dd0671c83edd tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:31.666574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-18284446-8b8c-4e80-aa52-dd0671c83edd tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:31.666977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18284446-8b8c-4e80-aa52-dd0671c83edd tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.667367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18284446-8b8c-4e80-aa52-dd0671c83edd tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.668400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18284446-8b8c-4e80-aa52-dd0671c83edd tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.668676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18284446-8b8c-4e80-aa52-dd0671c83edd tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.831412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-18284446-8b8c-4e80-aa52-dd0671c83edd tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:31.839645 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-18284446-8b8c-4e80-aa52-dd0671c83edd tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1512 microversion: 2.1 time: 0.182865 Mar 12 20:53:31.840232 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 919/1687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:31 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:31.854409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d0254b19-417f-4518-853d-a326e2cdeaf4 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:31.855043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d0254b19-417f-4518-853d-a326e2cdeaf4 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] [instance: b1a01d27-42ab-4258-be66-a86606d977d6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:31.863565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0254b19-417f-4518-853d-a326e2cdeaf4 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.864028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0254b19-417f-4518-853d-a326e2cdeaf4 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.864818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0254b19-417f-4518-853d-a326e2cdeaf4 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.865260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0254b19-417f-4518-853d-a326e2cdeaf4 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.879797 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d0254b19-417f-4518-853d-a326e2cdeaf4 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] HTTP exception thrown: Instance b1a01d27-42ab-4258-be66-a86606d977d6 could not be found. Mar 12 20:53:31.880549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d0254b19-417f-4518-853d-a326e2cdeaf4 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] Returning 404 to user: Instance b1a01d27-42ab-4258-be66-a86606d977d6 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:31.881394 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d0254b19-417f-4518-853d-a326e2cdeaf4 tempest-ImagesOneServerTestJSON-1692379994 tempest-ImagesOneServerTestJSON-1692379994-project] 10.222.0.30 "GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6" status: 404 len: 111 microversion: 2.1 time: 0.030863 Mar 12 20:53:31.885306 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 920/1688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:31 2022] GET /compute/v2.1/servers/b1a01d27-42ab-4258-be66-a86606d977d6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:31.889628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1459aed-a751-466f-9b22-73cd053f8c02 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:31.890359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f1459aed-a751-466f-9b22-73cd053f8c02 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:31.897740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1459aed-a751-466f-9b22-73cd053f8c02 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.898187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1459aed-a751-466f-9b22-73cd053f8c02 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:31.898974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1459aed-a751-466f-9b22-73cd053f8c02 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:31.899420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1459aed-a751-466f-9b22-73cd053f8c02 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:32.075919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f1459aed-a751-466f-9b22-73cd053f8c02 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:32.089370 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1459aed-a751-466f-9b22-73cd053f8c02 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1388 microversion: 2.1 time: 0.205743 Mar 12 20:53:32.090728 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 921/1689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:31 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1388 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:32.446635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5bb191cb-0913-4b35-9898-e30007fe9477 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:32.447292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5bb191cb-0913-4b35-9898-e30007fe9477 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:32.460482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bb191cb-0913-4b35-9898-e30007fe9477 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:32.461103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bb191cb-0913-4b35-9898-e30007fe9477 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:32.462569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bb191cb-0913-4b35-9898-e30007fe9477 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:32.463251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bb191cb-0913-4b35-9898-e30007fe9477 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:32.702593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5bb191cb-0913-4b35-9898-e30007fe9477 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:32.714171 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5bb191cb-0913-4b35-9898-e30007fe9477 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1471 microversion: 2.1 time: 0.621137 Mar 12 20:53:32.714814 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 922/1690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:32 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1471 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:32.720246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c998566-27d0-41ae-b58b-df1cb758cb5c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:32.720856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c998566-27d0-41ae-b58b-df1cb758cb5c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:32.732211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c998566-27d0-41ae-b58b-df1cb758cb5c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:32.734239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c998566-27d0-41ae-b58b-df1cb758cb5c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:32.735316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c998566-27d0-41ae-b58b-df1cb758cb5c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:32.735776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c998566-27d0-41ae-b58b-df1cb758cb5c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:33.314744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c998566-27d0-41ae-b58b-df1cb758cb5c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:33.350221 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c998566-27d0-41ae-b58b-df1cb758cb5c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 200 len: 1308 microversion: 2.1 time: 0.612131 Mar 12 20:53:33.358874 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 923/1691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:32 2022] GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 1308 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:33.371506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c78355b-35b3-4827-a75b-3178066e0c58 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:33.372626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c78355b-35b3-4827-a75b-3178066e0c58 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:33.380521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c78355b-35b3-4827-a75b-3178066e0c58 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:33.381707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c78355b-35b3-4827-a75b-3178066e0c58 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:33.382978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c78355b-35b3-4827-a75b-3178066e0c58 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:33.383618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c78355b-35b3-4827-a75b-3178066e0c58 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:33.466379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c78355b-35b3-4827-a75b-3178066e0c58 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:33.495675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c78355b-35b3-4827-a75b-3178066e0c58 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:33.509169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c78355b-35b3-4827-a75b-3178066e0c58 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:33.517124 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c78355b-35b3-4827-a75b-3178066e0c58 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 200 len: 1505 microversion: 2.25 time: 0.152641 Mar 12 20:53:33.521177 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 924/1692] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:33 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:33.536749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b10e7fe7-0ed7-4226-8e2d-bf26e881f624 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:33.543741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b10e7fe7-0ed7-4226-8e2d-bf26e881f624 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:33.561644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b10e7fe7-0ed7-4226-8e2d-bf26e881f624 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:33.566467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b10e7fe7-0ed7-4226-8e2d-bf26e881f624 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:33.569617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b10e7fe7-0ed7-4226-8e2d-bf26e881f624 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:33.571568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b10e7fe7-0ed7-4226-8e2d-bf26e881f624 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:33.870029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b10e7fe7-0ed7-4226-8e2d-bf26e881f624 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff84008edbbb475ab7c31f57d2455b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df0c010b1c1422d815a79929d733305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:33.880849 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b10e7fe7-0ed7-4226-8e2d-bf26e881f624 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 200 len: 1512 microversion: 2.1 time: 0.358067 Mar 12 20:53:33.882064 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 925/1693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:33 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:34.147762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5364ec0-7131-4d34-984a-04ccf2f8f5c3 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Action: 'create', calling method: .version_select at 0x7f6e3725a310>, body: {"keypair": {"name": "tempest-keypair-451033980", "type": "ssh", "user_id": "d3aebef34dc7406dbf8702c809751cc8"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:34.162460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e5364ec0-7131-4d34-984a-04ccf2f8f5c3 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Getting quotas for project 33fe94288c9b4f9780a5870fbf35f06b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:53:34.167615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e5364ec0-7131-4d34-984a-04ccf2f8f5c3 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Getting quotas for user 60b7f52d37c74383bc44d14664152666 and project 33fe94288c9b4f9780a5870fbf35f06b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:53:34.564256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e5364ec0-7131-4d34-984a-04ccf2f8f5c3 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Getting quotas for project 33fe94288c9b4f9780a5870fbf35f06b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:53:34.571029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e5364ec0-7131-4d34-984a-04ccf2f8f5c3 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Getting quotas for user 60b7f52d37c74383bc44d14664152666 and project 33fe94288c9b4f9780a5870fbf35f06b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:53:34.586576 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e5364ec0-7131-4d34-984a-04ccf2f8f5c3 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.10 time: 0.702206 Mar 12 20:53:34.587262 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 926/1694] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Mar 12 20:53:33 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 704 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:53:34.591909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-584bc9e7-271d-4b77-b85e-94a70df85195 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:34.593275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-584bc9e7-271d-4b77-b85e-94a70df85195 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:34.600442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-584bc9e7-271d-4b77-b85e-94a70df85195 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:34.601128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-584bc9e7-271d-4b77-b85e-94a70df85195 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:34.602162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-584bc9e7-271d-4b77-b85e-94a70df85195 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:34.602521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-584bc9e7-271d-4b77-b85e-94a70df85195 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:34.669745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-584bc9e7-271d-4b77-b85e-94a70df85195 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:34.679176 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-584bc9e7-271d-4b77-b85e-94a70df85195 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 200 len: 1184 microversion: 2.1 time: 0.090882 Mar 12 20:53:34.679784 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 927/1695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:34 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 1184 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:34.684249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-23881121-9368-4006-ad9f-5f0adddad868 req-ea2801ce-6c3a-4c96-aa90-cae08fda16f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9c242e-54fc-4196-9994-8f4ee1f315bb", "name": "network-vif-deleted", "tag": "82ff1918-4a6e-4bbf-8c05-c4ed1a053981"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:34.703272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-23881121-9368-4006-ad9f-5f0adddad868 req-ea2801ce-6c3a-4c96-aa90-cae08fda16f2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:34.706389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-23881121-9368-4006-ad9f-5f0adddad868 req-ea2801ce-6c3a-4c96-aa90-cae08fda16f2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:34.725656 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-23881121-9368-4006-ad9f-5f0adddad868 req-ea2801ce-6c3a-4c96-aa90-cae08fda16f2 service nova] Creating event network-vif-deleted:82ff1918-4a6e-4bbf-8c05-c4ed1a053981 for instance 4f9c242e-54fc-4196-9994-8f4ee1f315bb on nch1-master-1 Mar 12 20:53:34.732307 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-23881121-9368-4006-ad9f-5f0adddad868 req-ea2801ce-6c3a-4c96-aa90-cae08fda16f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050620 Mar 12 20:53:34.733248 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 928/1696] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:34.739086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-624aa2eb-1e3c-4006-bd87-e821745c52a1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:34.739811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-624aa2eb-1e3c-4006-bd87-e821745c52a1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:34.746956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-624aa2eb-1e3c-4006-bd87-e821745c52a1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:34.747825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-624aa2eb-1e3c-4006-bd87-e821745c52a1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:34.749175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-624aa2eb-1e3c-4006-bd87-e821745c52a1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:34.749625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-624aa2eb-1e3c-4006-bd87-e821745c52a1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:34.937977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-624aa2eb-1e3c-4006-bd87-e821745c52a1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:34.948281 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-624aa2eb-1e3c-4006-bd87-e821745c52a1 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1476 microversion: 2.1 time: 0.214122 Mar 12 20:53:34.948859 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 929/1697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:34 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1476 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:35.018228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e608b3e2-feee-46ca-a488-5ce8f7b70c77 tempest-AbsoluteLimitsTestJSON-709621762 tempest-AbsoluteLimitsTestJSON-709621762-project] Calling method '.version_select at 0x7f6e3775de50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:35.029676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e608b3e2-feee-46ca-a488-5ce8f7b70c77 tempest-AbsoluteLimitsTestJSON-709621762 tempest-AbsoluteLimitsTestJSON-709621762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:35.030572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e608b3e2-feee-46ca-a488-5ce8f7b70c77 tempest-AbsoluteLimitsTestJSON-709621762 tempest-AbsoluteLimitsTestJSON-709621762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:35.031391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e608b3e2-feee-46ca-a488-5ce8f7b70c77 tempest-AbsoluteLimitsTestJSON-709621762 tempest-AbsoluteLimitsTestJSON-709621762-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:35.031871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e608b3e2-feee-46ca-a488-5ce8f7b70c77 tempest-AbsoluteLimitsTestJSON-709621762 tempest-AbsoluteLimitsTestJSON-709621762-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:35.056403 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e608b3e2-feee-46ca-a488-5ce8f7b70c77 tempest-AbsoluteLimitsTestJSON-709621762 tempest-AbsoluteLimitsTestJSON-709621762-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.106090 Mar 12 20:53:35.057101 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 930/1698] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Mar 12 20:53:34 2022] GET /compute/v2.1/limits => generated 511 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:35.071924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8eec8cdf-7a09-4778-8996-ef739665ba72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:35.072547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8eec8cdf-7a09-4778-8996-ef739665ba72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:35.082079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8eec8cdf-7a09-4778-8996-ef739665ba72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:35.082937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8eec8cdf-7a09-4778-8996-ef739665ba72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:35.084326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8eec8cdf-7a09-4778-8996-ef739665ba72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:35.085212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8eec8cdf-7a09-4778-8996-ef739665ba72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:35.271930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8eec8cdf-7a09-4778-8996-ef739665ba72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:35.279776 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8eec8cdf-7a09-4778-8996-ef739665ba72 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 200 len: 1308 microversion: 2.1 time: 0.213007 Mar 12 20:53:35.280414 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 931/1699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:35 2022] GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:35.450147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5c17161-9a2c-4114-ac82-f8c7ce4fb92f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:35.450770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e5c17161-9a2c-4114-ac82-f8c7ce4fb92f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 4f9c242e-54fc-4196-9994-8f4ee1f315bb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:35.456647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5c17161-9a2c-4114-ac82-f8c7ce4fb92f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:35.457111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5c17161-9a2c-4114-ac82-f8c7ce4fb92f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:35.457915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5c17161-9a2c-4114-ac82-f8c7ce4fb92f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:35.458363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5c17161-9a2c-4114-ac82-f8c7ce4fb92f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:35.474821 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e5c17161-9a2c-4114-ac82-f8c7ce4fb92f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] HTTP exception thrown: Instance 4f9c242e-54fc-4196-9994-8f4ee1f315bb could not be found. Mar 12 20:53:35.475497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5c17161-9a2c-4114-ac82-f8c7ce4fb92f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Returning 404 to user: Instance 4f9c242e-54fc-4196-9994-8f4ee1f315bb could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:35.476416 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e5c17161-9a2c-4114-ac82-f8c7ce4fb92f tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb" status: 404 len: 111 microversion: 2.25 time: 0.195099 Mar 12 20:53:35.477054 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 932/1700] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:35 2022] GET /compute/v2.1/servers/4f9c242e-54fc-4196-9994-8f4ee1f315bb => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:53:35.481643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7e4dd836-9542-4780-be95-4bd41b5513ef tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Action: 'create', calling method: .version_select at 0x7f6e3775de50>, body: {"keypair": {"name": "tempest-keypair-1925663567", "type": "ssh", "user_id": "d3aebef34dc7406dbf8702c809751cc8"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:35.495456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7e4dd836-9542-4780-be95-4bd41b5513ef tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Getting quotas for project 33fe94288c9b4f9780a5870fbf35f06b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:53:35.500372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7e4dd836-9542-4780-be95-4bd41b5513ef tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Getting quotas for user 60b7f52d37c74383bc44d14664152666 and project 33fe94288c9b4f9780a5870fbf35f06b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:53:35.675566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7e4dd836-9542-4780-be95-4bd41b5513ef tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Getting quotas for project 33fe94288c9b4f9780a5870fbf35f06b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:53:35.680319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7e4dd836-9542-4780-be95-4bd41b5513ef tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Getting quotas for user 60b7f52d37c74383bc44d14664152666 and project 33fe94288c9b4f9780a5870fbf35f06b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:53:35.694504 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7e4dd836-9542-4780-be95-4bd41b5513ef tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.10 time: 0.216416 Mar 12 20:53:35.695104 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 933/1701] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Mar 12 20:53:35 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:53:35.699798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8dcd3c75-c2c5-4ec6-ad90-54a12e14fe70 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:35.700456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8dcd3c75-c2c5-4ec6-ad90-54a12e14fe70 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:35.706529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dcd3c75-c2c5-4ec6-ad90-54a12e14fe70 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:35.706986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dcd3c75-c2c5-4ec6-ad90-54a12e14fe70 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:35.707770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dcd3c75-c2c5-4ec6-ad90-54a12e14fe70 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:35.708308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dcd3c75-c2c5-4ec6-ad90-54a12e14fe70 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:35.723012 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8dcd3c75-c2c5-4ec6-ad90-54a12e14fe70 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] HTTP exception thrown: Instance bbbdbaf3-600b-4097-a346-6bab89a60ea4 could not be found. Mar 12 20:53:35.723658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8dcd3c75-c2c5-4ec6-ad90-54a12e14fe70 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Returning 404 to user: Instance bbbdbaf3-600b-4097-a346-6bab89a60ea4 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:35.724443 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8dcd3c75-c2c5-4ec6-ad90-54a12e14fe70 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 404 len: 111 microversion: 2.1 time: 0.028455 Mar 12 20:53:35.725370 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 934/1702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:35 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:35.791418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c15a4505-7e1b-4bbe-b4f5-f6eee3c6def0 req-b5d3ac94-b389-4e9a-a20a-c6042e84051e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf9d5b-db02-4e9a-9525-90c905f05276", "name": "network-vif-plugged", "status": "completed", "tag": "d92a997c-44f0-4bfb-8217-99e7b17b1497"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:35.800352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c15a4505-7e1b-4bbe-b4f5-f6eee3c6def0 req-b5d3ac94-b389-4e9a-a20a-c6042e84051e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:35.800802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c15a4505-7e1b-4bbe-b4f5-f6eee3c6def0 req-b5d3ac94-b389-4e9a-a20a-c6042e84051e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:35.812687 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c15a4505-7e1b-4bbe-b4f5-f6eee3c6def0 req-b5d3ac94-b389-4e9a-a20a-c6042e84051e service nova] Creating event network-vif-plugged:d92a997c-44f0-4bfb-8217-99e7b17b1497 for instance cfbf9d5b-db02-4e9a-9525-90c905f05276 on nch2-master-1 Mar 12 20:53:35.818633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c15a4505-7e1b-4bbe-b4f5-f6eee3c6def0 req-b5d3ac94-b389-4e9a-a20a-c6042e84051e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092537 Mar 12 20:53:35.819223 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 935/1703] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:35.827716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37d6ec9c-ebe3-4605-872b-f6dc4ed10dc2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:35.828571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-37d6ec9c-ebe3-4605-872b-f6dc4ed10dc2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:35.835429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37d6ec9c-ebe3-4605-872b-f6dc4ed10dc2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:35.835886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37d6ec9c-ebe3-4605-872b-f6dc4ed10dc2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:35.836664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37d6ec9c-ebe3-4605-872b-f6dc4ed10dc2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:35.837281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37d6ec9c-ebe3-4605-872b-f6dc4ed10dc2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:35.872453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-37d6ec9c-ebe3-4605-872b-f6dc4ed10dc2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:53:35.972924 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-37d6ec9c-ebe3-4605-872b-f6dc4ed10dc2 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 204 len: 0 microversion: 2.25 time: 0.149292 Mar 12 20:53:35.974235 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 936/1704] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:53:35 2022] DELETE /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:53:36.217651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-308d83aa-d43e-4438-af4d-d3a1a0ad4fd1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:36.218412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-308d83aa-d43e-4438-af4d-d3a1a0ad4fd1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ce767e86-64a8-47b9-bae8-145d5819b6d9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:36.229470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-308d83aa-d43e-4438-af4d-d3a1a0ad4fd1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:36.230990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-308d83aa-d43e-4438-af4d-d3a1a0ad4fd1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:36.234954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-308d83aa-d43e-4438-af4d-d3a1a0ad4fd1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:36.236112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-308d83aa-d43e-4438-af4d-d3a1a0ad4fd1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:36.254228 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-308d83aa-d43e-4438-af4d-d3a1a0ad4fd1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] HTTP exception thrown: Instance ce767e86-64a8-47b9-bae8-145d5819b6d9 could not be found. Mar 12 20:53:36.255182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-308d83aa-d43e-4438-af4d-d3a1a0ad4fd1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Returning 404 to user: Instance ce767e86-64a8-47b9-bae8-145d5819b6d9 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:36.256120 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-308d83aa-d43e-4438-af4d-d3a1a0ad4fd1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9" status: 404 len: 111 microversion: 2.1 time: 0.279824 Mar 12 20:53:36.256719 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 937/1705] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:35 2022] GET /compute/v2.1/servers/ce767e86-64a8-47b9-bae8-145d5819b6d9 => generated 111 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:36.261421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4d51631b-4a9a-461f-b352-17c622d3273f tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Calling method '.version_select at 0x7f6e3734f550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:36.269110 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4d51631b-4a9a-461f-b352-17c622d3273f tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-451033980?user_id=d3aebef34dc7406dbf8702c809751cc8" status: 200 len: 705 microversion: 2.10 time: 0.011254 Mar 12 20:53:36.274985 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 938/1706] 10.222.0.30 () {60 vars in 1336 bytes} [Sat Mar 12 20:53:36 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-451033980?user_id=d3aebef34dc7406dbf8702c809751cc8 => generated 705 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:53:36.283027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-062e5003-7fb8-49ae-be15-5fff13ace7b6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:36.283655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-062e5003-7fb8-49ae-be15-5fff13ace7b6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:36.292479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-062e5003-7fb8-49ae-be15-5fff13ace7b6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:36.293149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-062e5003-7fb8-49ae-be15-5fff13ace7b6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:36.294053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-062e5003-7fb8-49ae-be15-5fff13ace7b6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:36.294870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-062e5003-7fb8-49ae-be15-5fff13ace7b6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:36.484204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-062e5003-7fb8-49ae-be15-5fff13ace7b6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:36.494890 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-062e5003-7fb8-49ae-be15-5fff13ace7b6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1476 microversion: 2.1 time: 0.218807 Mar 12 20:53:36.495869 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 939/1707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:36 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1476 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:36.500842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-877ed7be-2824-4779-a122-4028dfa47180 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:36.501536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-877ed7be-2824-4779-a122-4028dfa47180 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:36.508320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-877ed7be-2824-4779-a122-4028dfa47180 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:36.509327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-877ed7be-2824-4779-a122-4028dfa47180 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:36.510380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-877ed7be-2824-4779-a122-4028dfa47180 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:36.511796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-877ed7be-2824-4779-a122-4028dfa47180 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:36.720250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-877ed7be-2824-4779-a122-4028dfa47180 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:36.730752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-877ed7be-2824-4779-a122-4028dfa47180 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:36.732301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-877ed7be-2824-4779-a122-4028dfa47180 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c3556ea8eba477e92c2f6f765a30c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7417ea19a899461e99596d0df881a336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:36.733513 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-877ed7be-2824-4779-a122-4028dfa47180 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 200 len: 1563 microversion: 2.25 time: 0.236652 Mar 12 20:53:36.743093 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 940/1708] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:36 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 1563 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:36.749828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c6e55cc7-e142-48f3-abde-8709ce6088cb tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Action: 'create', calling method: .version_select at 0x7f6e3725ad30>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-699965256", "type": "ssh"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:36.767753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c6e55cc7-e142-48f3-abde-8709ce6088cb tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Getting quotas for project 33fe94288c9b4f9780a5870fbf35f06b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:53:36.774422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c6e55cc7-e142-48f3-abde-8709ce6088cb tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Getting quotas for user 60b7f52d37c74383bc44d14664152666 and project 33fe94288c9b4f9780a5870fbf35f06b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:53:37.212645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c6e55cc7-e142-48f3-abde-8709ce6088cb tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Getting quotas for project 33fe94288c9b4f9780a5870fbf35f06b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:53:37.218846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c6e55cc7-e142-48f3-abde-8709ce6088cb tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Getting quotas for user 60b7f52d37c74383bc44d14664152666 and project 33fe94288c9b4f9780a5870fbf35f06b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:53:37.234972 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c6e55cc7-e142-48f3-abde-8709ce6088cb tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.10 time: 0.490724 Mar 12 20:53:37.236094 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 941/1709] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Mar 12 20:53:36 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 492 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:53:37.245177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b227899f-b327-4ec1-9c0e-50081e5dcd57 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:37.246389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b227899f-b327-4ec1-9c0e-50081e5dcd57 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:37.252128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b227899f-b327-4ec1-9c0e-50081e5dcd57 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:37.252565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b227899f-b327-4ec1-9c0e-50081e5dcd57 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:37.253363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b227899f-b327-4ec1-9c0e-50081e5dcd57 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:37.253787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b227899f-b327-4ec1-9c0e-50081e5dcd57 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:37.431558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b227899f-b327-4ec1-9c0e-50081e5dcd57 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:37.439849 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b227899f-b327-4ec1-9c0e-50081e5dcd57 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 200 len: 1488 microversion: 2.1 time: 0.198566 Mar 12 20:53:37.451311 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 942/1710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:37 2022] GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 1488 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:37.451311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-40d0f626-a5a3-4c78-b8a4-c0a71d7c612f req-d5ef3ab5-f072-4e03-b8c7-7512ed79508c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbbdbaf3-600b-4097-a346-6bab89a60ea4", "name": "network-vif-deleted", "tag": "6dcedac0-bc0f-44f2-8a09-02474166334f"}, {"server_uuid": "ce767e86-64a8-47b9-bae8-145d5819b6d9", "name": "network-vif-deleted", "tag": "bd88fe22-49b2-448f-9a9c-b38f6c74e1ba"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:37.462772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-40d0f626-a5a3-4c78-b8a4-c0a71d7c612f req-d5ef3ab5-f072-4e03-b8c7-7512ed79508c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:37.463071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-40d0f626-a5a3-4c78-b8a4-c0a71d7c612f req-d5ef3ab5-f072-4e03-b8c7-7512ed79508c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:37.485189 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-40d0f626-a5a3-4c78-b8a4-c0a71d7c612f req-d5ef3ab5-f072-4e03-b8c7-7512ed79508c service nova] Creating event network-vif-deleted:6dcedac0-bc0f-44f2-8a09-02474166334f for instance bbbdbaf3-600b-4097-a346-6bab89a60ea4 on nch2-master-1 Mar 12 20:53:37.486046 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-40d0f626-a5a3-4c78-b8a4-c0a71d7c612f req-d5ef3ab5-f072-4e03-b8c7-7512ed79508c service nova] Creating event network-vif-deleted:bd88fe22-49b2-448f-9a9c-b38f6c74e1ba for instance ce767e86-64a8-47b9-bae8-145d5819b6d9 on nch1-master-1 Mar 12 20:53:37.495421 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-40d0f626-a5a3-4c78-b8a4-c0a71d7c612f req-d5ef3ab5-f072-4e03-b8c7-7512ed79508c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053460 Mar 12 20:53:37.497284 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 943/1711] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:37.503210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d07aea0f-f29e-4bce-ae15-3dc1b0c05387 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Calling method '.version_select at 0x7f6e37205c10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:37.508235 ncdv-master-1 devstack@n-api.service[136302]: WARNING oslo_db.sqlalchemy.utils [None req-d07aea0f-f29e-4bce-ae15-3dc1b0c05387 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Mar 12 20:53:37.524146 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d07aea0f-f29e-4bce-ae15-3dc1b0c05387 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs?user_id=d3aebef34dc7406dbf8702c809751cc8" status: 200 len: 1113 microversion: 2.10 time: 0.025185 Mar 12 20:53:37.524757 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 944/1712] 10.222.0.30 () {60 vars in 1258 bytes} [Sat Mar 12 20:53:37 2022] GET /compute/v2.1/os-keypairs?user_id=d3aebef34dc7406dbf8702c809751cc8 => generated 1113 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:37.531935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad3398b4-f97d-47f5-be9e-ab0a64d489f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1215312939"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:37.533083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad3398b4-f97d-47f5-be9e-ab0a64d489f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:37.540251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad3398b4-f97d-47f5-be9e-ab0a64d489f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:37.540704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad3398b4-f97d-47f5-be9e-ab0a64d489f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:37.541715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad3398b4-f97d-47f5-be9e-ab0a64d489f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:37.542186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad3398b4-f97d-47f5-be9e-ab0a64d489f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:37.841996 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad3398b4-f97d-47f5-be9e-ab0a64d489f5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "POST /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276/action" status: 202 len: 0 microversion: 2.1 time: 0.315642 Mar 12 20:53:37.842984 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 945/1713] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:53:37 2022] POST /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 12 20:53:37.848231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-991c341f-7703-48ab-b618-b011aea6093f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:37.848830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-991c341f-7703-48ab-b618-b011aea6093f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:37.855043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-991c341f-7703-48ab-b618-b011aea6093f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:37.855508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-991c341f-7703-48ab-b618-b011aea6093f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:37.856306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-991c341f-7703-48ab-b618-b011aea6093f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:37.856752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-991c341f-7703-48ab-b618-b011aea6093f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:37.887529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-991c341f-7703-48ab-b618-b011aea6093f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:53:37.998124 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-991c341f-7703-48ab-b618-b011aea6093f tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 204 len: 0 microversion: 2.1 time: 0.153465 Mar 12 20:53:37.999699 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 946/1714] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:37 2022] DELETE /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:38.004940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c6e3d30e-7597-4a7c-b5c1-be4e65ea26c3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:38.005651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c6e3d30e-7597-4a7c-b5c1-be4e65ea26c3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:38.011767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6e3d30e-7597-4a7c-b5c1-be4e65ea26c3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:38.012452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6e3d30e-7597-4a7c-b5c1-be4e65ea26c3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:38.013249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6e3d30e-7597-4a7c-b5c1-be4e65ea26c3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:38.013694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6e3d30e-7597-4a7c-b5c1-be4e65ea26c3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:38.162829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c6e3d30e-7597-4a7c-b5c1-be4e65ea26c3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:38.170712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c6e3d30e-7597-4a7c-b5c1-be4e65ea26c3 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1476 microversion: 2.1 time: 0.169451 Mar 12 20:53:38.171284 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 947/1715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:37 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1476 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:38.175527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fc2d2bd5-f7a0-437a-a4e5-09ba91724ded tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Calling method '.version_select at 0x7f6e372e51f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:38.193250 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fc2d2bd5-f7a0-437a-a4e5-09ba91724ded tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-699965256" status: 204 len: 0 microversion: 2.10 time: 0.020648 Mar 12 20:53:38.193986 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 948/1716] 10.222.0.30 () {60 vars in 1321 bytes} [Sat Mar 12 20:53:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-699965256 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:53:38.198923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b2539799-fefb-4c0a-a6da-a6f4eae16486 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:38.199424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b2539799-fefb-4c0a-a6da-a6f4eae16486 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:38.205283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2539799-fefb-4c0a-a6da-a6f4eae16486 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:38.205745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2539799-fefb-4c0a-a6da-a6f4eae16486 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:38.206550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2539799-fefb-4c0a-a6da-a6f4eae16486 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:38.206995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2539799-fefb-4c0a-a6da-a6f4eae16486 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:38.219912 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b2539799-fefb-4c0a-a6da-a6f4eae16486 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] HTTP exception thrown: Instance bbbdbaf3-600b-4097-a346-6bab89a60ea4 could not be found. Mar 12 20:53:38.220495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b2539799-fefb-4c0a-a6da-a6f4eae16486 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Returning 404 to user: Instance bbbdbaf3-600b-4097-a346-6bab89a60ea4 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:38.221308 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b2539799-fefb-4c0a-a6da-a6f4eae16486 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 404 len: 111 microversion: 2.1 time: 0.026431 Mar 12 20:53:38.221851 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 949/1717] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:38 2022] DELETE /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:38.226198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9622640e-c292-4bc8-ba78-5f85a55c1548 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:38.226805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9622640e-c292-4bc8-ba78-5f85a55c1548 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] [instance: 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:38.232095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9622640e-c292-4bc8-ba78-5f85a55c1548 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:38.232547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9622640e-c292-4bc8-ba78-5f85a55c1548 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:38.233845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9622640e-c292-4bc8-ba78-5f85a55c1548 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:38.234296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9622640e-c292-4bc8-ba78-5f85a55c1548 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:38.250540 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9622640e-c292-4bc8-ba78-5f85a55c1548 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] HTTP exception thrown: Instance 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c could not be found. Mar 12 20:53:38.251076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9622640e-c292-4bc8-ba78-5f85a55c1548 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] Returning 404 to user: Instance 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:38.251907 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9622640e-c292-4bc8-ba78-5f85a55c1548 tempest-LiveAutoBlockMigrationV225Test-1105998631 tempest-LiveAutoBlockMigrationV225Test-1105998631-project] 10.222.0.30 "GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c" status: 404 len: 111 microversion: 2.25 time: 0.029182 Mar 12 20:53:38.252466 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 950/1718] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:53:38 2022] GET /compute/v2.1/servers/1eb8e841-3f4c-4bb0-b6cd-6feab78be43c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:53:38.256918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-64582f06-9f81-4cd3-aff9-04d39a943111 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e373345e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:38.303511 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-64582f06-9f81-4cd3-aff9-04d39a943111 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/a293d228-fe38-4991-a0d8-63f2220bdfc8" status: 200 len: 1412 microversion: 2.1 time: 0.049916 Mar 12 20:53:38.304465 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 951/1719] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:38 2022] GET /compute/v2.1/images/a293d228-fe38-4991-a0d8-63f2220bdfc8 => generated 1412 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:38.494455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e043aa4f-f3d2-4b73-b896-aba793e9d4da tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'create', calling method: .version_select at 0x7f6e37322040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1332847920", "description": "tempest-description-1276360250"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:38.799595 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e043aa4f-f3d2-4b73-b896-aba793e9d4da tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.486913 Mar 12 20:53:38.800574 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 952/1720] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:53:38 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:38.806238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aed905e4-1e0f-4949-92bf-859fcc8f2e83 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:38.807081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aed905e4-1e0f-4949-92bf-859fcc8f2e83 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:38.815726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aed905e4-1e0f-4949-92bf-859fcc8f2e83 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:38.816190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aed905e4-1e0f-4949-92bf-859fcc8f2e83 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:38.817170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aed905e4-1e0f-4949-92bf-859fcc8f2e83 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:38.817902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aed905e4-1e0f-4949-92bf-859fcc8f2e83 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:39.042834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aed905e4-1e0f-4949-92bf-859fcc8f2e83 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:39.051007 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aed905e4-1e0f-4949-92bf-859fcc8f2e83 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 200 len: 1499 microversion: 2.1 time: 0.249167 Mar 12 20:53:39.051500 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 953/1721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:38 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 1499 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:39.065406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3200aae1-5eb9-409d-be09-a12a8d448264 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Calling method '.version_select at 0x7f6e372e5550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:39.091476 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3200aae1-5eb9-409d-be09-a12a8d448264 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925663567?user_id=d3aebef34dc7406dbf8702c809751cc8" status: 204 len: 0 microversion: 2.10 time: 0.038639 Mar 12 20:53:39.093346 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 954/1722] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Mar 12 20:53:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925663567?user_id=d3aebef34dc7406dbf8702c809751cc8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:53:39.102168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5152a159-18c9-4e15-bd96-8bdb37370a83 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:39.103199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5152a159-18c9-4e15-bd96-8bdb37370a83 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] [instance: bbbdbaf3-600b-4097-a346-6bab89a60ea4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:39.109411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5152a159-18c9-4e15-bd96-8bdb37370a83 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:39.109892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5152a159-18c9-4e15-bd96-8bdb37370a83 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:39.110671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5152a159-18c9-4e15-bd96-8bdb37370a83 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:39.111114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5152a159-18c9-4e15-bd96-8bdb37370a83 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:39.125222 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-5152a159-18c9-4e15-bd96-8bdb37370a83 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] HTTP exception thrown: Instance bbbdbaf3-600b-4097-a346-6bab89a60ea4 could not be found. Mar 12 20:53:39.126102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5152a159-18c9-4e15-bd96-8bdb37370a83 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] Returning 404 to user: Instance bbbdbaf3-600b-4097-a346-6bab89a60ea4 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:39.127190 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5152a159-18c9-4e15-bd96-8bdb37370a83 tempest-AttachSCSIVolumeTestJSON-1797125887 tempest-AttachSCSIVolumeTestJSON-1797125887-project] 10.222.0.30 "GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4" status: 404 len: 111 microversion: 2.1 time: 0.032063 Mar 12 20:53:39.127926 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 955/1723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:39 2022] GET /compute/v2.1/servers/bbbdbaf3-600b-4097-a346-6bab89a60ea4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:39.132578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5b335477-f9be-4b5f-94c8-ceec163084d9 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e3775d1f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:39.184675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5b335477-f9be-4b5f-94c8-ceec163084d9 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/a293d228-fe38-4991-a0d8-63f2220bdfc8" status: 200 len: 1412 microversion: 2.1 time: 0.055336 Mar 12 20:53:39.192493 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 956/1724] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:39 2022] GET /compute/v2.1/images/a293d228-fe38-4991-a0d8-63f2220bdfc8 => generated 1412 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:39.201976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4503682b-f5ad-41f3-a1f2-63ceb852bb5f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'create', calling method: .version_select at 0x7f6e37249550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1639582551", "description": "tempest-description-2033029202"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:39.517753 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4503682b-f5ad-41f3-a1f2-63ceb852bb5f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.319207 Mar 12 20:53:39.519878 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 957/1725] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:53:39 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:39.530488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-07872855-9854-4daf-89f2-facf916a25a4 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] Calling method '.version_select at 0x7f6e37205a60>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:39.563911 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-07872855-9854-4daf-89f2-facf916a25a4 tempest-KeyPairsV210TestJSON-1764511319 tempest-KeyPairsV210TestJSON-1764511319-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-451033980?user_id=d3aebef34dc7406dbf8702c809751cc8" status: 204 len: 0 microversion: 2.10 time: 0.040924 Mar 12 20:53:39.565570 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 958/1726] 10.222.0.30 () {60 vars in 1339 bytes} [Sat Mar 12 20:53:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-451033980?user_id=d3aebef34dc7406dbf8702c809751cc8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:53:39.579710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b553ad9d-3427-4cab-9e4d-05cf225d041a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:39.582352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b553ad9d-3427-4cab-9e4d-05cf225d041a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:39.592336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b553ad9d-3427-4cab-9e4d-05cf225d041a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:39.594229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b553ad9d-3427-4cab-9e4d-05cf225d041a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:39.595038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b553ad9d-3427-4cab-9e4d-05cf225d041a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:39.595486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b553ad9d-3427-4cab-9e4d-05cf225d041a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:39.941037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b553ad9d-3427-4cab-9e4d-05cf225d041a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:39.953172 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b553ad9d-3427-4cab-9e4d-05cf225d041a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1476 microversion: 2.1 time: 0.386090 Mar 12 20:53:39.954335 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 959/1727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:39 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1476 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:39.961923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c799d66c-38eb-4930-85d1-75e35addf50c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e373345e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:40.155546 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c799d66c-38eb-4930-85d1-75e35addf50c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/images/a293d228-fe38-4991-a0d8-63f2220bdfc8" status: 204 len: 0 microversion: 2.1 time: 0.198151 Mar 12 20:53:40.160304 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 960/1728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:39 2022] DELETE /compute/v2.1/images/a293d228-fe38-4991-a0d8-63f2220bdfc8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:40.161622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bbe60140-191f-45bf-9089-34339f8f3941 req-718248cd-d3de-45b6-8a97-dddae3e3cd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb8e841-3f4c-4bb0-b6cd-6feab78be43c", "name": "network-vif-deleted", "tag": "31853141-b24e-4296-ac44-006fdaa259f8"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:40.177951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bbe60140-191f-45bf-9089-34339f8f3941 req-718248cd-d3de-45b6-8a97-dddae3e3cd9a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:40.178196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bbe60140-191f-45bf-9089-34339f8f3941 req-718248cd-d3de-45b6-8a97-dddae3e3cd9a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:40.191859 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bbe60140-191f-45bf-9089-34339f8f3941 req-718248cd-d3de-45b6-8a97-dddae3e3cd9a service nova] Creating event network-vif-deleted:31853141-b24e-4296-ac44-006fdaa259f8 for instance 1eb8e841-3f4c-4bb0-b6cd-6feab78be43c on nch1-master-1 Mar 12 20:53:40.196964 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bbe60140-191f-45bf-9089-34339f8f3941 req-718248cd-d3de-45b6-8a97-dddae3e3cd9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039237 Mar 12 20:53:40.198109 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 961/1729] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:40.205753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-992992433", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "99d8e1be-c782-4fb8-b174-ff83703e7c7e"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:40.280845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] validate_networks() for [('99d8e1be-c782-4fb8-b174-ff83703e7c7e', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:53:41.271877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:53:41.273097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:53:41.273592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:53:41.274045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:53:41.274467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:53:41.288389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:41.288850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:41.289669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:41.290150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:41.312252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Getting quotas for project 83c8d35436d54ee4887f69c41ec160f8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:53:41.318097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Getting quotas for user 7b362003f1aa4db6a6c1e57e90c69ef2 and project 83c8d35436d54ee4887f69c41ec160f8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:53:41.338014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:53:41.348185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:53:41.442501 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7b91308-25a8-4221-9fa9-70d2e9756ccb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.243126 Mar 12 20:53:41.448416 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 962/1730] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:53:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:53:41.456322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-afbbc0f1-0a62-45b2-baee-7c7df7b5ff97 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:41.458078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-afbbc0f1-0a62-45b2-baee-7c7df7b5ff97 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: e40005ee-4cc8-49d8-a826-236d4aad98a0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:41.466232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afbbc0f1-0a62-45b2-baee-7c7df7b5ff97 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:41.466684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afbbc0f1-0a62-45b2-baee-7c7df7b5ff97 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:41.468220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afbbc0f1-0a62-45b2-baee-7c7df7b5ff97 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:41.468911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afbbc0f1-0a62-45b2-baee-7c7df7b5ff97 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:41.494636 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-afbbc0f1-0a62-45b2-baee-7c7df7b5ff97 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] HTTP exception thrown: Instance e40005ee-4cc8-49d8-a826-236d4aad98a0 could not be found. Mar 12 20:53:41.495254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-afbbc0f1-0a62-45b2-baee-7c7df7b5ff97 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Returning 404 to user: Instance e40005ee-4cc8-49d8-a826-236d4aad98a0 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:41.496110 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-afbbc0f1-0a62-45b2-baee-7c7df7b5ff97 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0" status: 404 len: 111 microversion: 2.1 time: 0.046642 Mar 12 20:53:41.496703 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 963/1731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:41 2022] GET /compute/v2.1/servers/e40005ee-4cc8-49d8-a826-236d4aad98a0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:41.501426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39055d0b-0143-43ee-af43-8a2502290215 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e48e5c280>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:41.551287 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-39055d0b-0143-43ee-af43-8a2502290215 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] HTTP exception thrown: Image not found. Mar 12 20:53:41.551662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39055d0b-0143-43ee-af43-8a2502290215 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:41.552509 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39055d0b-0143-43ee-af43-8a2502290215 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/images/a293d228-fe38-4991-a0d8-63f2220bdfc8" status: 404 len: 62 microversion: 2.1 time: 0.054903 Mar 12 20:53:41.557613 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 964/1732] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:53:41 2022] GET /compute/v2.1/images/a293d228-fe38-4991-a0d8-63f2220bdfc8 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:53:41.563449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fed4903a-a7a8-4abf-abcd-e4c6c081565d req-154a7491-87c0-4efb-a463-60c565162089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae82842-58a0-4d5e-a522-a1c83c53e101", "name": "network-vif-plugged", "status": "completed", "tag": "c40c686b-b640-42d0-a899-bda5e43f8663"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:41.584303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fed4903a-a7a8-4abf-abcd-e4c6c081565d req-154a7491-87c0-4efb-a463-60c565162089 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:41.585065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fed4903a-a7a8-4abf-abcd-e4c6c081565d req-154a7491-87c0-4efb-a463-60c565162089 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:41.620498 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fed4903a-a7a8-4abf-abcd-e4c6c081565d req-154a7491-87c0-4efb-a463-60c565162089 service nova] Creating event network-vif-plugged:c40c686b-b640-42d0-a899-bda5e43f8663 for instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 on nch1-master-1 Mar 12 20:53:41.636865 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fed4903a-a7a8-4abf-abcd-e4c6c081565d req-154a7491-87c0-4efb-a463-60c565162089 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074489 Mar 12 20:53:41.640393 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 965/1733] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:41.671735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9cbe9962-3253-4bfe-8982-699bf27479c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:41.672885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9cbe9962-3253-4bfe-8982-699bf27479c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:41.689515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cbe9962-3253-4bfe-8982-699bf27479c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:41.691407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cbe9962-3253-4bfe-8982-699bf27479c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:41.692263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cbe9962-3253-4bfe-8982-699bf27479c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:41.692980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cbe9962-3253-4bfe-8982-699bf27479c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:42.401939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9cbe9962-3253-4bfe-8982-699bf27479c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:42.411925 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9cbe9962-3253-4bfe-8982-699bf27479c8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1476 microversion: 2.1 time: 0.765682 Mar 12 20:53:42.412594 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 966/1734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:41 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1476 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:42.427983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0f9da11-7631-4215-b6b9-a410e5c5a5e6 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:42.428617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b0f9da11-7631-4215-b6b9-a410e5c5a5e6 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:42.448630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0f9da11-7631-4215-b6b9-a410e5c5a5e6 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:42.448985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0f9da11-7631-4215-b6b9-a410e5c5a5e6 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:42.449849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0f9da11-7631-4215-b6b9-a410e5c5a5e6 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:42.450813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0f9da11-7631-4215-b6b9-a410e5c5a5e6 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:42.589817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b0f9da11-7631-4215-b6b9-a410e5c5a5e6 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:42.597732 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0f9da11-7631-4215-b6b9-a410e5c5a5e6 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a" status: 200 len: 1211 microversion: 2.1 time: 0.184058 Mar 12 20:53:42.601981 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 967/1735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:42 2022] GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a => generated 1211 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:42.613737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27212512-ca84-48d0-8b16-90e76130b3d1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:42.614575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27212512-ca84-48d0-8b16-90e76130b3d1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:42.624585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27212512-ca84-48d0-8b16-90e76130b3d1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:42.631453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27212512-ca84-48d0-8b16-90e76130b3d1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:42.632563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27212512-ca84-48d0-8b16-90e76130b3d1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:42.633202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27212512-ca84-48d0-8b16-90e76130b3d1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:42.680703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27212512-ca84-48d0-8b16-90e76130b3d1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:53:42.830170 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27212512-ca84-48d0-8b16-90e76130b3d1 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 204 len: 0 microversion: 2.1 time: 0.226883 Mar 12 20:53:42.834071 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 968/1736] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:42 2022] DELETE /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:42.850629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-53c03e85-6612-449c-a7af-c7fcd61619bd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:42.851374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-53c03e85-6612-449c-a7af-c7fcd61619bd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:42.866084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53c03e85-6612-449c-a7af-c7fcd61619bd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:42.866562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53c03e85-6612-449c-a7af-c7fcd61619bd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:42.867532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53c03e85-6612-449c-a7af-c7fcd61619bd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:42.867994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53c03e85-6612-449c-a7af-c7fcd61619bd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:43.052395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-53c03e85-6612-449c-a7af-c7fcd61619bd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:43.067301 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-53c03e85-6612-449c-a7af-c7fcd61619bd tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 200 len: 1488 microversion: 2.1 time: 0.225906 Mar 12 20:53:43.068778 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 969/1737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:42 2022] GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 1488 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:43.454942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9a216550-01c4-4b31-a1a7-c4e38523de31 req-4ddcaf93-5d94-4265-a966-9c61e9981659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40005ee-4cc8-49d8-a826-236d4aad98a0", "name": "network-vif-deleted", "tag": "fee78365-562c-495b-80e2-d01504c255bf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:43.475299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9a216550-01c4-4b31-a1a7-c4e38523de31 req-4ddcaf93-5d94-4265-a966-9c61e9981659 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:43.475965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9a216550-01c4-4b31-a1a7-c4e38523de31 req-4ddcaf93-5d94-4265-a966-9c61e9981659 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:43.508269 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9a216550-01c4-4b31-a1a7-c4e38523de31 req-4ddcaf93-5d94-4265-a966-9c61e9981659 service nova] Creating event network-vif-deleted:fee78365-562c-495b-80e2-d01504c255bf for instance e40005ee-4cc8-49d8-a826-236d4aad98a0 on nch1-master-1 Mar 12 20:53:43.516086 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9a216550-01c4-4b31-a1a7-c4e38523de31 req-4ddcaf93-5d94-4265-a966-9c61e9981659 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.444152 Mar 12 20:53:43.520445 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 970/1738] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:43.526923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f6b2222d-63a8-456f-956d-8b1e254fe0ef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:43.527625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f6b2222d-63a8-456f-956d-8b1e254fe0ef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:43.536095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6b2222d-63a8-456f-956d-8b1e254fe0ef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:43.536797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6b2222d-63a8-456f-956d-8b1e254fe0ef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:43.537895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6b2222d-63a8-456f-956d-8b1e254fe0ef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:43.538867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6b2222d-63a8-456f-956d-8b1e254fe0ef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:43.778148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f6b2222d-63a8-456f-956d-8b1e254fe0ef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:43.787921 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f6b2222d-63a8-456f-956d-8b1e254fe0ef tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1485 microversion: 2.1 time: 0.266156 Mar 12 20:53:43.788693 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 971/1739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:43 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1485 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:43.793791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd79f610-e408-4ffb-9816-e1f62756be34 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:43.794345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd79f610-e408-4ffb-9816-e1f62756be34 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:43.800573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd79f610-e408-4ffb-9816-e1f62756be34 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:43.801153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd79f610-e408-4ffb-9816-e1f62756be34 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:43.802114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd79f610-e408-4ffb-9816-e1f62756be34 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:43.802721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd79f610-e408-4ffb-9816-e1f62756be34 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:43.835295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd79f610-e408-4ffb-9816-e1f62756be34 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:53:43.966192 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd79f610-e408-4ffb-9816-e1f62756be34 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 204 len: 0 microversion: 2.1 time: 0.175883 Mar 12 20:53:43.967112 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 972/1740] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:43 2022] DELETE /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:43.984628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d2b0148-0a97-48ba-869a-0b47453c18f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:43.986354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2d2b0148-0a97-48ba-869a-0b47453c18f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:44.001687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d2b0148-0a97-48ba-869a-0b47453c18f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.002262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d2b0148-0a97-48ba-869a-0b47453c18f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.004662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d2b0148-0a97-48ba-869a-0b47453c18f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.006862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d2b0148-0a97-48ba-869a-0b47453c18f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.296496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2d2b0148-0a97-48ba-869a-0b47453c18f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:44.305949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d2b0148-0a97-48ba-869a-0b47453c18f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1476 microversion: 2.1 time: 0.334336 Mar 12 20:53:44.316218 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 973/1741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:43 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1476 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:44.322960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-11f8f753-499e-4aa1-abb6-7bfb40df21df tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:44.322960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-11f8f753-499e-4aa1-abb6-7bfb40df21df tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:44.329274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11f8f753-499e-4aa1-abb6-7bfb40df21df tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.329473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11f8f753-499e-4aa1-abb6-7bfb40df21df tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.330244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11f8f753-499e-4aa1-abb6-7bfb40df21df tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.330719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11f8f753-499e-4aa1-abb6-7bfb40df21df tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.413661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-11f8f753-499e-4aa1-abb6-7bfb40df21df tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:44.426474 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-11f8f753-499e-4aa1-abb6-7bfb40df21df tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a" status: 200 len: 1273 microversion: 2.1 time: 0.109030 Mar 12 20:53:44.427090 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 974/1742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:44 2022] GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:44.569225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9154aa03-d9fc-4674-999a-dad7d8a0c928 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Action: 'update', calling method: .version_select at 0x7f6e372e5a60>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:44.571494 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:53:44.571494 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:53:44.573068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9154aa03-d9fc-4674-999a-dad7d8a0c928 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.573710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9154aa03-d9fc-4674-999a-dad7d8a0c928 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.582925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9154aa03-d9fc-4674-999a-dad7d8a0c928 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.583674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9154aa03-d9fc-4674-999a-dad7d8a0c928 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.593057 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9154aa03-d9fc-4674-999a-dad7d8a0c928 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] HTTP exception thrown: Service c1c926b3-2622-47ea-bdc7-d53034403cd9 could not be found. Mar 12 20:53:44.593984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9154aa03-d9fc-4674-999a-dad7d8a0c928 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Returning 404 to user: Service c1c926b3-2622-47ea-bdc7-d53034403cd9 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:44.595689 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9154aa03-d9fc-4674-999a-dad7d8a0c928 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/c1c926b3-2622-47ea-bdc7-d53034403cd9" status: 404 len: 110 microversion: 2.53 time: 0.167680 Mar 12 20:53:44.597005 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 975/1743] 10.222.0.30 () {62 vars in 1308 bytes} [Sat Mar 12 20:53:44 2022] PUT /compute/v2.1/os-services/c1c926b3-2622-47ea-bdc7-d53034403cd9 => generated 110 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:53:44.605724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-371a2590-9b7b-467f-b92e-6560afc3e693 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e3725a820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:44.632336 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-371a2590-9b7b-467f-b92e-6560afc3e693 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] HTTP exception thrown: Image not found. Mar 12 20:53:44.632942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-371a2590-9b7b-467f-b92e-6560afc3e693 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:44.633818 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-371a2590-9b7b-467f-b92e-6560afc3e693 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/images/a293d228-fe38-4991-a0d8-63f2220bdfc8" status: 404 len: 62 microversion: 2.1 time: 0.035417 Mar 12 20:53:44.634391 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 976/1744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:44 2022] DELETE /compute/v2.1/images/a293d228-fe38-4991-a0d8-63f2220bdfc8 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:53:44.642585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7f50f50f-77dd-4e06-9b1e-520eed2e5e72 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Action: 'update', calling method: .version_select at 0x7f6e372e5160>, body: {"status": "disabled"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:44.645552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f50f50f-77dd-4e06-9b1e-520eed2e5e72 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.646071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f50f50f-77dd-4e06-9b1e-520eed2e5e72 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.652294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f50f50f-77dd-4e06-9b1e-520eed2e5e72 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.652753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f50f50f-77dd-4e06-9b1e-520eed2e5e72 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.658673 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-7f50f50f-77dd-4e06-9b1e-520eed2e5e72 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] HTTP exception thrown: Service c1c926b3-2622-47ea-bdc7-d53034403cd9 could not be found. Mar 12 20:53:44.670073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7f50f50f-77dd-4e06-9b1e-520eed2e5e72 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Returning 404 to user: Service c1c926b3-2622-47ea-bdc7-d53034403cd9 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:44.672235 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7f50f50f-77dd-4e06-9b1e-520eed2e5e72 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/c1c926b3-2622-47ea-bdc7-d53034403cd9" status: 404 len: 110 microversion: 2.53 time: 0.036016 Mar 12 20:53:44.673039 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 977/1745] 10.222.0.30 () {62 vars in 1308 bytes} [Sat Mar 12 20:53:44 2022] PUT /compute/v2.1/os-services/c1c926b3-2622-47ea-bdc7-d53034403cd9 => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:53:44.682041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-631a8716-8dca-4c09-895a-27c69c169a0e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:44.682716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-631a8716-8dca-4c09-895a-27c69c169a0e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:44.694042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-631a8716-8dca-4c09-895a-27c69c169a0e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.696279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-631a8716-8dca-4c09-895a-27c69c169a0e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.697291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-631a8716-8dca-4c09-895a-27c69c169a0e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.697975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-631a8716-8dca-4c09-895a-27c69c169a0e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.733990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-631a8716-8dca-4c09-895a-27c69c169a0e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:53:44.798071 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.api [None req-631a8716-8dca-4c09-895a-27c69c169a0e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Instance is already in deleting state, ignoring this request Mar 12 20:53:44.799202 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-631a8716-8dca-4c09-895a-27c69c169a0e tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 204 len: 0 microversion: 2.1 time: 0.124031 Mar 12 20:53:44.800138 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 978/1746] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:44 2022] DELETE /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:44.811530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7ed3e843-0432-4d2a-ada1-62bb8bfbb1fc tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Action: 'update', calling method: .version_select at 0x7f6e37334ee0>, body: {"status": "enabled"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:44.814045 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:53:44.814045 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:53:44.815564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ed3e843-0432-4d2a-ada1-62bb8bfbb1fc tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.816388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ed3e843-0432-4d2a-ada1-62bb8bfbb1fc tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.823377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ed3e843-0432-4d2a-ada1-62bb8bfbb1fc tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.823836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ed3e843-0432-4d2a-ada1-62bb8bfbb1fc tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.829932 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-7ed3e843-0432-4d2a-ada1-62bb8bfbb1fc tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] HTTP exception thrown: Service c1c926b3-2622-47ea-bdc7-d53034403cd9 could not be found. Mar 12 20:53:44.831151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7ed3e843-0432-4d2a-ada1-62bb8bfbb1fc tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Returning 404 to user: Service c1c926b3-2622-47ea-bdc7-d53034403cd9 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:44.831308 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7ed3e843-0432-4d2a-ada1-62bb8bfbb1fc tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/c1c926b3-2622-47ea-bdc7-d53034403cd9" status: 404 len: 110 microversion: 2.53 time: 0.029855 Mar 12 20:53:44.835818 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 979/1747] 10.222.0.30 () {62 vars in 1308 bytes} [Sat Mar 12 20:53:44 2022] PUT /compute/v2.1/os-services/c1c926b3-2622-47ea-bdc7-d53034403cd9 => generated 110 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:53:44.837284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43f443f3-da1c-43ef-b319-9fd5f4c3027d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:44.837928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-43f443f3-da1c-43ef-b319-9fd5f4c3027d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:44.845684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43f443f3-da1c-43ef-b319-9fd5f4c3027d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.846164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43f443f3-da1c-43ef-b319-9fd5f4c3027d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.846986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43f443f3-da1c-43ef-b319-9fd5f4c3027d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:44.847433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43f443f3-da1c-43ef-b319-9fd5f4c3027d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:44.986022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-43f443f3-da1c-43ef-b319-9fd5f4c3027d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:44.994470 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-43f443f3-da1c-43ef-b319-9fd5f4c3027d tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 200 len: 1485 microversion: 2.1 time: 0.160856 Mar 12 20:53:44.994919 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 980/1748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:44 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 1485 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:45.000647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ef7f0f79-f58f-4205-bb3f-4519f5de4859 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:45.002015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ef7f0f79-f58f-4205-bb3f-4519f5de4859 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:45.008377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef7f0f79-f58f-4205-bb3f-4519f5de4859 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.009055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef7f0f79-f58f-4205-bb3f-4519f5de4859 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.009869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef7f0f79-f58f-4205-bb3f-4519f5de4859 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.010307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef7f0f79-f58f-4205-bb3f-4519f5de4859 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.162342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ef7f0f79-f58f-4205-bb3f-4519f5de4859 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:45.171814 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ef7f0f79-f58f-4205-bb3f-4519f5de4859 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 200 len: 1494 microversion: 2.1 time: 0.175018 Mar 12 20:53:45.181468 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 981/1749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:44 2022] GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 1494 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:45.185523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a757d886-b442-42bd-b24b-3ede630db7e4 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:45.188211 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:53:45.188211 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:53:45.189669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a757d886-b442-42bd-b24b-3ede630db7e4 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.190180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a757d886-b442-42bd-b24b-3ede630db7e4 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.191009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a757d886-b442-42bd-b24b-3ede630db7e4 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.191458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a757d886-b442-42bd-b24b-3ede630db7e4 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.228781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a757d886-b442-42bd-b24b-3ede630db7e4 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.055105 Mar 12 20:53:45.229960 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 982/1750] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Mar 12 20:53:45 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:45.243418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8b45355-617b-426f-965b-2fc4bb71872d tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:45.244605 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:53:45.244605 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:53:45.245836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8b45355-617b-426f-965b-2fc4bb71872d tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.246295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8b45355-617b-426f-965b-2fc4bb71872d tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.247143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8b45355-617b-426f-965b-2fc4bb71872d tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.247576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8b45355-617b-426f-965b-2fc4bb71872d tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.276270 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8b45355-617b-426f-965b-2fc4bb71872d tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.036712 Mar 12 20:53:45.277822 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 983/1751] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Mar 12 20:53:45 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:45.295577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cda3263f-6563-4642-b379-feaf45da64de tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:45.296915 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:53:45.296915 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:53:45.299306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cda3263f-6563-4642-b379-feaf45da64de tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.299969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cda3263f-6563-4642-b379-feaf45da64de tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.300869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cda3263f-6563-4642-b379-feaf45da64de tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.301382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cda3263f-6563-4642-b379-feaf45da64de tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.333503 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cda3263f-6563-4642-b379-feaf45da64de tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.048152 Mar 12 20:53:45.339863 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 984/1752] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Mar 12 20:53:45 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:53:45.339863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-237ec428-2620-4ca4-90f8-77fd74042f68 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:45.340805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-237ec428-2620-4ca4-90f8-77fd74042f68 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:45.347133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-237ec428-2620-4ca4-90f8-77fd74042f68 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.347678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-237ec428-2620-4ca4-90f8-77fd74042f68 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.348646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-237ec428-2620-4ca4-90f8-77fd74042f68 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.349164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-237ec428-2620-4ca4-90f8-77fd74042f68 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.586333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-237ec428-2620-4ca4-90f8-77fd74042f68 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:45.606292 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-237ec428-2620-4ca4-90f8-77fd74042f68 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1476 microversion: 2.1 time: 0.266965 Mar 12 20:53:45.609432 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 985/1753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:45 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:45.624596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e9f8c015-c6f4-4ec1-90ce-ff24360eb654 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:45.628703 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:53:45.628703 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:53:45.646330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9f8c015-c6f4-4ec1-90ce-ff24360eb654 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.646807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9f8c015-c6f4-4ec1-90ce-ff24360eb654 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.647669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9f8c015-c6f4-4ec1-90ce-ff24360eb654 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.648303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9f8c015-c6f4-4ec1-90ce-ff24360eb654 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.683879 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e9f8c015-c6f4-4ec1-90ce-ff24360eb654 tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.072793 Mar 12 20:53:45.692427 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 986/1754] 10.222.0.30 () {60 vars in 1236 bytes} [Sat Mar 12 20:53:45 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:45.700014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5ea7fdb-4e36-4fd5-9d27-a26faa5f3c86 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:45.700854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c5ea7fdb-4e36-4fd5-9d27-a26faa5f3c86 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:45.715246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5ea7fdb-4e36-4fd5-9d27-a26faa5f3c86 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.715740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5ea7fdb-4e36-4fd5-9d27-a26faa5f3c86 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.717091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5ea7fdb-4e36-4fd5-9d27-a26faa5f3c86 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.717540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5ea7fdb-4e36-4fd5-9d27-a26faa5f3c86 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.821095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c5ea7fdb-4e36-4fd5-9d27-a26faa5f3c86 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:45.832671 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c5ea7fdb-4e36-4fd5-9d27-a26faa5f3c86 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a" status: 200 len: 1273 microversion: 2.1 time: 0.138602 Mar 12 20:53:45.840324 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 987/1755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:45 2022] GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:45.847544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-40035004-cad1-4c6d-a304-c89f754e87eb req-e58ef180-bfa1-4c7c-b7ea-7a930e6c6326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab950cd9-846a-49c5-964c-7f8f96d7bed2", "name": "network-vif-deleted", "tag": "8139ec0e-8f41-45a1-a748-a770dd994696"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:45.863152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-40035004-cad1-4c6d-a304-c89f754e87eb req-e58ef180-bfa1-4c7c-b7ea-7a930e6c6326 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.863543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-40035004-cad1-4c6d-a304-c89f754e87eb req-e58ef180-bfa1-4c7c-b7ea-7a930e6c6326 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.883547 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-40035004-cad1-4c6d-a304-c89f754e87eb req-e58ef180-bfa1-4c7c-b7ea-7a930e6c6326 service nova] Creating event network-vif-deleted:8139ec0e-8f41-45a1-a748-a770dd994696 for instance ab950cd9-846a-49c5-964c-7f8f96d7bed2 on nch1-master-1 Mar 12 20:53:45.888690 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-40035004-cad1-4c6d-a304-c89f754e87eb req-e58ef180-bfa1-4c7c-b7ea-7a930e6c6326 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047015 Mar 12 20:53:45.889529 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 988/1756] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:45.895536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ceebc924-a4bc-4f68-8d31-a7f15aec50ae tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:45.896796 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:53:45.896796 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:53:45.898037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ceebc924-a4bc-4f68-8d31-a7f15aec50ae tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.899133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ceebc924-a4bc-4f68-8d31-a7f15aec50ae tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.899973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ceebc924-a4bc-4f68-8d31-a7f15aec50ae tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.900409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ceebc924-a4bc-4f68-8d31-a7f15aec50ae tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.928247 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ceebc924-a4bc-4f68-8d31-a7f15aec50ae tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.037519 Mar 12 20:53:45.929131 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 989/1757] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Mar 12 20:53:45 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:53:45.945211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35cd7639-7e37-48ab-9093-28edbaddaa8d tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:45.946678 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:53:45.946678 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:53:45.948551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35cd7639-7e37-48ab-9093-28edbaddaa8d tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.949325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35cd7639-7e37-48ab-9093-28edbaddaa8d tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.950323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35cd7639-7e37-48ab-9093-28edbaddaa8d tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:45.950893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35cd7639-7e37-48ab-9093-28edbaddaa8d tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:45.980512 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-35cd7639-7e37-48ab-9093-28edbaddaa8d tempest-ServicesAdminNegativeV253TestJSON-818799409 tempest-ServicesAdminNegativeV253TestJSON-818799409-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.041312 Mar 12 20:53:45.988790 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 990/1758] 10.222.0.30 () {60 vars in 1238 bytes} [Sat Mar 12 20:53:45 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:46.253149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ed7760cf-7df1-4313-9115-c073f2753600 tempest-ServicesAdminNegativeV253TestJSON-1451656556 tempest-ServicesAdminNegativeV253TestJSON-1451656556-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:46.254754 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:53:46.254754 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:53:46.256029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ed7760cf-7df1-4313-9115-c073f2753600 tempest-ServicesAdminNegativeV253TestJSON-1451656556 tempest-ServicesAdminNegativeV253TestJSON-1451656556-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ad09931a62b74413b07f45618dc24969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32027b16d92148bca62b9d34a8902516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:46.257455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ed7760cf-7df1-4313-9115-c073f2753600 tempest-ServicesAdminNegativeV253TestJSON-1451656556 tempest-ServicesAdminNegativeV253TestJSON-1451656556-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:46.268452 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ed7760cf-7df1-4313-9115-c073f2753600 tempest-ServicesAdminNegativeV253TestJSON-1451656556 tempest-ServicesAdminNegativeV253TestJSON-1451656556-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.277575 Mar 12 20:53:46.271665 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 991/1759] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Mar 12 20:53:45 2022] GET /compute/v2.1/os-services => generated 112 bytes in 282 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:53:46.296352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d45494ce-9680-454e-ab2f-d6fe7fa368f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:46.296861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d45494ce-9680-454e-ab2f-d6fe7fa368f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: ab950cd9-846a-49c5-964c-7f8f96d7bed2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:46.350190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d45494ce-9680-454e-ab2f-d6fe7fa368f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:46.351892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d45494ce-9680-454e-ab2f-d6fe7fa368f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:46.352709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d45494ce-9680-454e-ab2f-d6fe7fa368f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:46.355196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d45494ce-9680-454e-ab2f-d6fe7fa368f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:46.412645 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d45494ce-9680-454e-ab2f-d6fe7fa368f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] HTTP exception thrown: Instance ab950cd9-846a-49c5-964c-7f8f96d7bed2 could not be found. Mar 12 20:53:46.413693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d45494ce-9680-454e-ab2f-d6fe7fa368f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Returning 404 to user: Instance ab950cd9-846a-49c5-964c-7f8f96d7bed2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:46.416233 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d45494ce-9680-454e-ab2f-d6fe7fa368f8 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2" status: 404 len: 111 microversion: 2.1 time: 0.138705 Mar 12 20:53:46.418953 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 992/1760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:46 2022] GET /compute/v2.1/servers/ab950cd9-846a-49c5-964c-7f8f96d7bed2 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:46.439669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33870098-36e0-4b1a-8ea7-a7e7bb1cd265 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:46.444296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-33870098-36e0-4b1a-8ea7-a7e7bb1cd265 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:46.466333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33870098-36e0-4b1a-8ea7-a7e7bb1cd265 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:46.471171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33870098-36e0-4b1a-8ea7-a7e7bb1cd265 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:46.473665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33870098-36e0-4b1a-8ea7-a7e7bb1cd265 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:46.475348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33870098-36e0-4b1a-8ea7-a7e7bb1cd265 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:46.670999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-33870098-36e0-4b1a-8ea7-a7e7bb1cd265 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b433353e06247bfbd0897c84912256f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c046eb0b9248d3bde469b35342ff50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:46.682228 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-33870098-36e0-4b1a-8ea7-a7e7bb1cd265 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 200 len: 1452 microversion: 2.1 time: 0.262042 Mar 12 20:53:46.694707 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 993/1761] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:46 2022] GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 1452 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:46.706806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e92bafac-f7e5-462e-9c3e-1d1fff85bf38 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:46.714686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e92bafac-f7e5-462e-9c3e-1d1fff85bf38 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:46.725465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e92bafac-f7e5-462e-9c3e-1d1fff85bf38 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:46.726212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e92bafac-f7e5-462e-9c3e-1d1fff85bf38 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:46.727200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e92bafac-f7e5-462e-9c3e-1d1fff85bf38 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:46.727640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e92bafac-f7e5-462e-9c3e-1d1fff85bf38 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:46.781451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e92bafac-f7e5-462e-9c3e-1d1fff85bf38 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:53:46.940461 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e92bafac-f7e5-462e-9c3e-1d1fff85bf38 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "DELETE /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 204 len: 0 microversion: 2.1 time: 0.243853 Mar 12 20:53:46.944788 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 994/1762] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:46 2022] DELETE /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:53:46.951521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c12f49b9-6147-4dfc-9a64-68dcc2334d7c req-599de2b5-a073-44c8-a16f-0e9535830b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda4959-0935-4359-bc30-ae11abe0563e", "name": "network-vif-unplugged", "status": "completed", "tag": "349eb111-c3f6-4006-b907-369238df3d63"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:46.962303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c12f49b9-6147-4dfc-9a64-68dcc2334d7c req-599de2b5-a073-44c8-a16f-0e9535830b10 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:46.963827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c12f49b9-6147-4dfc-9a64-68dcc2334d7c req-599de2b5-a073-44c8-a16f-0e9535830b10 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:46.980731 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c12f49b9-6147-4dfc-9a64-68dcc2334d7c req-599de2b5-a073-44c8-a16f-0e9535830b10 service nova] Creating event network-vif-unplugged:349eb111-c3f6-4006-b907-369238df3d63 for instance 3cda4959-0935-4359-bc30-ae11abe0563e on nch2-master-1 Mar 12 20:53:46.990123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-c12f49b9-6147-4dfc-9a64-68dcc2334d7c req-599de2b5-a073-44c8-a16f-0e9535830b10 service nova] Instance 3cda4959-0935-4359-bc30-ae11abe0563e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:53:47.009241 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c12f49b9-6147-4dfc-9a64-68dcc2334d7c req-599de2b5-a073-44c8-a16f-0e9535830b10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062425 Mar 12 20:53:47.015784 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 995/1763] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:47.023577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14fa347e-4568-4acf-ae49-42556d8a07c9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:47.024342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14fa347e-4568-4acf-ae49-42556d8a07c9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:47.033063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14fa347e-4568-4acf-ae49-42556d8a07c9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:47.033647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14fa347e-4568-4acf-ae49-42556d8a07c9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:47.034592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14fa347e-4568-4acf-ae49-42556d8a07c9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:47.035049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14fa347e-4568-4acf-ae49-42556d8a07c9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:47.577262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14fa347e-4568-4acf-ae49-42556d8a07c9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:47.587780 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14fa347e-4568-4acf-ae49-42556d8a07c9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1475 microversion: 2.1 time: 0.569265 Mar 12 20:53:47.598258 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 996/1764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:47 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1475 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:47.930373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2bf1c83b-88b3-4313-95d0-b1e378c69c0a req-acf20369-50b8-4985-977a-495e26c1a160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf9d5b-db02-4e9a-9525-90c905f05276", "name": "network-vif-deleted", "tag": "d92a997c-44f0-4bfb-8217-99e7b17b1497"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:47.948091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2bf1c83b-88b3-4313-95d0-b1e378c69c0a req-acf20369-50b8-4985-977a-495e26c1a160 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:47.949239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2bf1c83b-88b3-4313-95d0-b1e378c69c0a req-acf20369-50b8-4985-977a-495e26c1a160 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:47.968722 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2bf1c83b-88b3-4313-95d0-b1e378c69c0a req-acf20369-50b8-4985-977a-495e26c1a160 service nova] Creating event network-vif-deleted:d92a997c-44f0-4bfb-8217-99e7b17b1497 for instance cfbf9d5b-db02-4e9a-9525-90c905f05276 on nch2-master-1 Mar 12 20:53:47.978661 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2bf1c83b-88b3-4313-95d0-b1e378c69c0a req-acf20369-50b8-4985-977a-495e26c1a160 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.387814 Mar 12 20:53:47.980422 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 997/1765] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:47.991556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ff86092-6eaa-477e-9976-e06e5214be6f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:47.992691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ff86092-6eaa-477e-9976-e06e5214be6f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:48.003540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ff86092-6eaa-477e-9976-e06e5214be6f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:48.004482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ff86092-6eaa-477e-9976-e06e5214be6f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:48.006846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ff86092-6eaa-477e-9976-e06e5214be6f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:48.011102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ff86092-6eaa-477e-9976-e06e5214be6f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:48.508648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6ff86092-6eaa-477e-9976-e06e5214be6f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:48.528891 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ff86092-6eaa-477e-9976-e06e5214be6f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a" status: 200 len: 1315 microversion: 2.1 time: 0.543427 Mar 12 20:53:48.532806 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 998/1766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:47 2022] GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:48.538436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-36ee8e2a-3979-4a5d-b229-8e0e3a94cda0 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:48.539048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-36ee8e2a-3979-4a5d-b229-8e0e3a94cda0 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:48.547072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36ee8e2a-3979-4a5d-b229-8e0e3a94cda0 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:48.548040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36ee8e2a-3979-4a5d-b229-8e0e3a94cda0 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:48.548843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36ee8e2a-3979-4a5d-b229-8e0e3a94cda0 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:48.549476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36ee8e2a-3979-4a5d-b229-8e0e3a94cda0 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:48.986583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-36ee8e2a-3979-4a5d-b229-8e0e3a94cda0 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7854cfb82544a70aee1a7d421bfce55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c248ec2e2f0c457291cd412812c08e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:49.007032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-36ee8e2a-3979-4a5d-b229-8e0e3a94cda0 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 200 len: 1500 microversion: 2.1 time: 0.472561 Mar 12 20:53:49.008526 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 999/1767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:48 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 1500 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:49.038274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d29fe2a-9d9e-43cb-a0f9-c5d00a2157c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:49.040152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0d29fe2a-9d9e-43cb-a0f9-c5d00a2157c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: cfbf9d5b-db02-4e9a-9525-90c905f05276] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:49.064903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d29fe2a-9d9e-43cb-a0f9-c5d00a2157c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:49.065579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d29fe2a-9d9e-43cb-a0f9-c5d00a2157c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:49.067144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d29fe2a-9d9e-43cb-a0f9-c5d00a2157c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:49.072742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d29fe2a-9d9e-43cb-a0f9-c5d00a2157c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:49.095493 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-0d29fe2a-9d9e-43cb-a0f9-c5d00a2157c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] HTTP exception thrown: Instance cfbf9d5b-db02-4e9a-9525-90c905f05276 could not be found. Mar 12 20:53:49.096482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d29fe2a-9d9e-43cb-a0f9-c5d00a2157c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Returning 404 to user: Instance cfbf9d5b-db02-4e9a-9525-90c905f05276 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:49.098353 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d29fe2a-9d9e-43cb-a0f9-c5d00a2157c5 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276" status: 404 len: 111 microversion: 2.1 time: 0.088372 Mar 12 20:53:49.099618 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1000/1768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:49 2022] GET /compute/v2.1/servers/cfbf9d5b-db02-4e9a-9525-90c905f05276 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:49.105811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0fc23326-c14b-47ce-804a-43f9bb96b2a2 req-0d74fcf9-a9b3-4436-b474-49125cee1b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25b8295-eac5-4598-9776-94fad81bc42a", "tag": "8fbb98dd-c64e-4f04-b014-2c1dbc456627"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:49.116338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0fc23326-c14b-47ce-804a-43f9bb96b2a2 req-0d74fcf9-a9b3-4436-b474-49125cee1b18 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:49.119185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0fc23326-c14b-47ce-804a-43f9bb96b2a2 req-0d74fcf9-a9b3-4436-b474-49125cee1b18 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:49.139094 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0fc23326-c14b-47ce-804a-43f9bb96b2a2 req-0d74fcf9-a9b3-4436-b474-49125cee1b18 service nova] Creating event network-changed:8fbb98dd-c64e-4f04-b014-2c1dbc456627 for instance c25b8295-eac5-4598-9776-94fad81bc42a on nch2-master-1 Mar 12 20:53:49.144796 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0fc23326-c14b-47ce-804a-43f9bb96b2a2 req-0d74fcf9-a9b3-4436-b474-49125cee1b18 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043675 Mar 12 20:53:49.145890 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1001/1769] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:49.160705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39a43089-a4df-4f7f-b743-7e70984e108e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:49.165425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39a43089-a4df-4f7f-b743-7e70984e108e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:49.177882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39a43089-a4df-4f7f-b743-7e70984e108e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:49.178715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39a43089-a4df-4f7f-b743-7e70984e108e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:49.179905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39a43089-a4df-4f7f-b743-7e70984e108e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:49.180358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39a43089-a4df-4f7f-b743-7e70984e108e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:49.799938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39a43089-a4df-4f7f-b743-7e70984e108e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:49.813870 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39a43089-a4df-4f7f-b743-7e70984e108e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1475 microversion: 2.1 time: 0.666521 Mar 12 20:53:49.815313 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1002/1770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:49 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1475 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:49.820430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d77ae2d6-fb5d-407b-8666-c5c85941491c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e48e46430>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:49.852234 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d77ae2d6-fb5d-407b-8666-c5c85941491c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] HTTP exception thrown: Image not found. Mar 12 20:53:49.852848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d77ae2d6-fb5d-407b-8666-c5c85941491c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:49.853868 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d77ae2d6-fb5d-407b-8666-c5c85941491c tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31" status: 404 len: 62 microversion: 2.1 time: 0.037550 Mar 12 20:53:49.857999 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1003/1771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:49 2022] DELETE /compute/v2.1/images/956e0dfa-f4b4-4a52-97bc-b480f3dc4b31 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:53:49.862743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b783b09f-6b1a-4ef0-bd85-3a15e88ccb78 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:49.867179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b783b09f-6b1a-4ef0-bd85-3a15e88ccb78 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:49.905144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b783b09f-6b1a-4ef0-bd85-3a15e88ccb78 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:49.906451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b783b09f-6b1a-4ef0-bd85-3a15e88ccb78 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:49.909276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b783b09f-6b1a-4ef0-bd85-3a15e88ccb78 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:49.911010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b783b09f-6b1a-4ef0-bd85-3a15e88ccb78 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:50.280037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b783b09f-6b1a-4ef0-bd85-3a15e88ccb78 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:50.287648 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b783b09f-6b1a-4ef0-bd85-3a15e88ccb78 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a" status: 200 len: 1315 microversion: 2.1 time: 0.431849 Mar 12 20:53:50.288167 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1004/1772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:49 2022] GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:50.551432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1455865643", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "ced82347-19c9-4e6e-a10c-b09a4672cc11"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:50.617069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] validate_networks() for [('ced82347-19c9-4e6e-a10c-b09a4672cc11', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:53:51.185139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:53:51.185612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:53:51.186150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:53:51.186585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:53:51.186990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:53:51.202356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:51.210730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:51.211679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:51.216543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:51.272710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Getting quotas for project b1245d37d56c46f0b1bc0525fe98289f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:53:51.292256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Getting quotas for user e04cb45776b9475cb0364b96a8bd1e4b and project b1245d37d56c46f0b1bc0525fe98289f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:53:51.331480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:53:51.339880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:53:51.520026 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8db8fd83-428f-457f-9921-7a2d14dbd4a0 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230700 Mar 12 20:53:51.525439 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1005/1773] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:53:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:53:51.533970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6e32c9d5-78b5-4dd0-b07c-097812eb4bff tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:51.535997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6e32c9d5-78b5-4dd0-b07c-097812eb4bff tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:51.546977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e32c9d5-78b5-4dd0-b07c-097812eb4bff tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:51.547439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e32c9d5-78b5-4dd0-b07c-097812eb4bff tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:51.548241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e32c9d5-78b5-4dd0-b07c-097812eb4bff tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:51.548688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e32c9d5-78b5-4dd0-b07c-097812eb4bff tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:51.584061 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-6e32c9d5-78b5-4dd0-b07c-097812eb4bff tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] HTTP exception thrown: Instance 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e could not be found. Mar 12 20:53:51.584684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6e32c9d5-78b5-4dd0-b07c-097812eb4bff tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Returning 404 to user: Instance 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:51.585537 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6e32c9d5-78b5-4dd0-b07c-097812eb4bff tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 404 len: 111 microversion: 2.1 time: 0.063877 Mar 12 20:53:51.586493 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1006/1774] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:51 2022] DELETE /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:51.599385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ccd52386-9ad3-40e2-956d-1907d6777743 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:51.600269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ccd52386-9ad3-40e2-956d-1907d6777743 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] [instance: 609a3dcb-697d-4955-8b1f-23f2ba14cda4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:51.609323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccd52386-9ad3-40e2-956d-1907d6777743 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:51.610750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccd52386-9ad3-40e2-956d-1907d6777743 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:51.611307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccd52386-9ad3-40e2-956d-1907d6777743 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:51.611831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccd52386-9ad3-40e2-956d-1907d6777743 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:51.648556 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ccd52386-9ad3-40e2-956d-1907d6777743 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] HTTP exception thrown: Instance 609a3dcb-697d-4955-8b1f-23f2ba14cda4 could not be found. Mar 12 20:53:51.649414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ccd52386-9ad3-40e2-956d-1907d6777743 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] Returning 404 to user: Instance 609a3dcb-697d-4955-8b1f-23f2ba14cda4 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:51.652106 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ccd52386-9ad3-40e2-956d-1907d6777743 tempest-LiveMigrationTest-1243457813 tempest-LiveMigrationTest-1243457813-project] 10.222.0.30 "GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4" status: 404 len: 111 microversion: 2.1 time: 0.063794 Mar 12 20:53:51.653180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1007/1775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:51 2022] GET /compute/v2.1/servers/609a3dcb-697d-4955-8b1f-23f2ba14cda4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:51.672288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-77a9fa53-e429-4dfd-95d6-4afb771dfb03 req-bd8b45da-dc0a-4767-a816-426cf6a9dbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cda4959-0935-4359-bc30-ae11abe0563e", "tag": "349eb111-c3f6-4006-b907-369238df3d63"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:51.702477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-77a9fa53-e429-4dfd-95d6-4afb771dfb03 req-bd8b45da-dc0a-4767-a816-426cf6a9dbe8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:51.703010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-77a9fa53-e429-4dfd-95d6-4afb771dfb03 req-bd8b45da-dc0a-4767-a816-426cf6a9dbe8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:51.724041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-77a9fa53-e429-4dfd-95d6-4afb771dfb03 req-bd8b45da-dc0a-4767-a816-426cf6a9dbe8 service nova] Creating event network-changed:349eb111-c3f6-4006-b907-369238df3d63 for instance 3cda4959-0935-4359-bc30-ae11abe0563e on nch2-master-1 Mar 12 20:53:51.731599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-77a9fa53-e429-4dfd-95d6-4afb771dfb03 req-bd8b45da-dc0a-4767-a816-426cf6a9dbe8 service nova] Instance 3cda4959-0935-4359-bc30-ae11abe0563e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:53:51.744432 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-77a9fa53-e429-4dfd-95d6-4afb771dfb03 req-bd8b45da-dc0a-4767-a816-426cf6a9dbe8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088467 Mar 12 20:53:51.745439 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1008/1776] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:51.773160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a20dbff1-8ff6-4143-878f-b0c5322d3b0e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:51.774266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a20dbff1-8ff6-4143-878f-b0c5322d3b0e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:51.782572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a20dbff1-8ff6-4143-878f-b0c5322d3b0e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:51.783065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a20dbff1-8ff6-4143-878f-b0c5322d3b0e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:51.784143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a20dbff1-8ff6-4143-878f-b0c5322d3b0e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:51.784585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a20dbff1-8ff6-4143-878f-b0c5322d3b0e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:52.780605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a20dbff1-8ff6-4143-878f-b0c5322d3b0e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:52.790163 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a20dbff1-8ff6-4143-878f-b0c5322d3b0e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1473 microversion: 2.1 time: 1.042509 Mar 12 20:53:52.800886 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1009/1777] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:51 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1473 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:52.808105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4e644b7-accb-4045-8c04-2664a71f2765 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:52.809603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b4e644b7-accb-4045-8c04-2664a71f2765 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:52.816881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4e644b7-accb-4045-8c04-2664a71f2765 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:52.817875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4e644b7-accb-4045-8c04-2664a71f2765 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:52.818939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4e644b7-accb-4045-8c04-2664a71f2765 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:52.819546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4e644b7-accb-4045-8c04-2664a71f2765 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:53.556681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b4e644b7-accb-4045-8c04-2664a71f2765 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:53.566965 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b4e644b7-accb-4045-8c04-2664a71f2765 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a" status: 200 len: 1315 microversion: 2.1 time: 0.764060 Mar 12 20:53:53.567947 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1010/1778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:52 2022] GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:53.579637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bd1b491e-0dc0-459b-bf04-11f8fb1999e6 req-5aea1faf-519a-4a6f-a154-b07ff1f7d332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609a3dcb-697d-4955-8b1f-23f2ba14cda4", "name": "network-vif-deleted", "tag": "d4cfae29-d4f0-4e0c-a36c-dbcc83815e9b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:53.588386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bd1b491e-0dc0-459b-bf04-11f8fb1999e6 req-5aea1faf-519a-4a6f-a154-b07ff1f7d332 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:53.589112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bd1b491e-0dc0-459b-bf04-11f8fb1999e6 req-5aea1faf-519a-4a6f-a154-b07ff1f7d332 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:53.603510 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bd1b491e-0dc0-459b-bf04-11f8fb1999e6 req-5aea1faf-519a-4a6f-a154-b07ff1f7d332 service nova] Creating event network-vif-deleted:d4cfae29-d4f0-4e0c-a36c-dbcc83815e9b for instance 609a3dcb-697d-4955-8b1f-23f2ba14cda4 on nch1-master-1 Mar 12 20:53:53.610208 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bd1b491e-0dc0-459b-bf04-11f8fb1999e6 req-5aea1faf-519a-4a6f-a154-b07ff1f7d332 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039096 Mar 12 20:53:53.611137 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1011/1779] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:53.617155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-08a41589-a8cf-497a-891b-fa3e897dffb2 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:53.618199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-08a41589-a8cf-497a-891b-fa3e897dffb2 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:53.625881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08a41589-a8cf-497a-891b-fa3e897dffb2 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:53.626531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08a41589-a8cf-497a-891b-fa3e897dffb2 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:53.627894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08a41589-a8cf-497a-891b-fa3e897dffb2 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:53.628508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08a41589-a8cf-497a-891b-fa3e897dffb2 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:53.893742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-08a41589-a8cf-497a-891b-fa3e897dffb2 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04cb45776b9475cb0364b96a8bd1e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1245d37d56c46f0b1bc0525fe98289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:53.911598 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-08a41589-a8cf-497a-891b-fa3e897dffb2 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf" status: 200 len: 1276 microversion: 2.1 time: 0.296183 Mar 12 20:53:53.912498 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1012/1780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:53 2022] GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf => generated 1276 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:53.930885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc0e4240-7aeb-404d-984f-5b728697e6df tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:53.931729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc0e4240-7aeb-404d-984f-5b728697e6df tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:53.940590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc0e4240-7aeb-404d-984f-5b728697e6df tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:53.941006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc0e4240-7aeb-404d-984f-5b728697e6df tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:53.944767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc0e4240-7aeb-404d-984f-5b728697e6df tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:53.945390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc0e4240-7aeb-404d-984f-5b728697e6df tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:53.967592 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bc0e4240-7aeb-404d-984f-5b728697e6df tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] HTTP exception thrown: Instance 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e could not be found. Mar 12 20:53:53.968562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc0e4240-7aeb-404d-984f-5b728697e6df tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Returning 404 to user: Instance 174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:53.969059 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc0e4240-7aeb-404d-984f-5b728697e6df tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e" status: 404 len: 111 microversion: 2.1 time: 0.043499 Mar 12 20:53:53.969623 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1013/1781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:53 2022] GET /compute/v2.1/servers/174cec0d-f6f9-4cf6-adbb-8cab0dd74c0e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:53.974444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-692529d7-a1ed-411a-9c9f-36ab77b7df5d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:53.975643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-692529d7-a1ed-411a-9c9f-36ab77b7df5d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:53.987989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-692529d7-a1ed-411a-9c9f-36ab77b7df5d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:53.990132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-692529d7-a1ed-411a-9c9f-36ab77b7df5d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:53.991810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-692529d7-a1ed-411a-9c9f-36ab77b7df5d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:53.992464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-692529d7-a1ed-411a-9c9f-36ab77b7df5d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:54.555494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-692529d7-a1ed-411a-9c9f-36ab77b7df5d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:54.566684 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-692529d7-a1ed-411a-9c9f-36ab77b7df5d tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1470 microversion: 2.1 time: 0.595356 Mar 12 20:53:54.568169 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1014/1782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:53 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1470 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:54.579346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4d588ad1-5165-4aa0-a5a7-e7bbaf44c43b req-e70179e5-e78f-4b2d-9787-361103130cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25b8295-eac5-4598-9776-94fad81bc42a", "name": "network-vif-plugged", "status": "completed", "tag": "8fbb98dd-c64e-4f04-b014-2c1dbc456627"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:54.603619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4d588ad1-5165-4aa0-a5a7-e7bbaf44c43b req-e70179e5-e78f-4b2d-9787-361103130cd3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:54.604414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4d588ad1-5165-4aa0-a5a7-e7bbaf44c43b req-e70179e5-e78f-4b2d-9787-361103130cd3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:54.630573 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4d588ad1-5165-4aa0-a5a7-e7bbaf44c43b req-e70179e5-e78f-4b2d-9787-361103130cd3 service nova] Creating event network-vif-plugged:8fbb98dd-c64e-4f04-b014-2c1dbc456627 for instance c25b8295-eac5-4598-9776-94fad81bc42a on nch2-master-1 Mar 12 20:53:54.641423 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4d588ad1-5165-4aa0-a5a7-e7bbaf44c43b req-e70179e5-e78f-4b2d-9787-361103130cd3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071844 Mar 12 20:53:54.650709 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1015/1783] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:54.666098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f74edc1a-853f-43f8-b449-243884e1dd18 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e372e5a60>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:54.715419 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f74edc1a-853f-43f8-b449-243884e1dd18 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] HTTP exception thrown: Image not found. Mar 12 20:53:54.716229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f74edc1a-853f-43f8-b449-243884e1dd18 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:54.717298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f74edc1a-853f-43f8-b449-243884e1dd18 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500" status: 404 len: 62 microversion: 2.1 time: 0.063999 Mar 12 20:53:54.721259 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1016/1784] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:54 2022] DELETE /compute/v2.1/images/1e2afc60-3dfa-4354-8ee7-42b972506500 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:53:54.726688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e902ab93-54ef-411c-861d-1526ee5ac44b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:54.727557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e902ab93-54ef-411c-861d-1526ee5ac44b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:54.740178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e902ab93-54ef-411c-861d-1526ee5ac44b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:54.740663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e902ab93-54ef-411c-861d-1526ee5ac44b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:54.741436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e902ab93-54ef-411c-861d-1526ee5ac44b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:54.742129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e902ab93-54ef-411c-861d-1526ee5ac44b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:54.962730 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e902ab93-54ef-411c-861d-1526ee5ac44b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "POST /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e/action" status: 202 len: 0 microversion: 2.1 time: 0.239884 Mar 12 20:53:54.968642 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1017/1785] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:53:54 2022] POST /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:53:54.975073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-539533f2-651a-4f89-81f2-89a015ff2027 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:54.975792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-539533f2-651a-4f89-81f2-89a015ff2027 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:54.989463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-539533f2-651a-4f89-81f2-89a015ff2027 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:54.989973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-539533f2-651a-4f89-81f2-89a015ff2027 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:54.991000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-539533f2-651a-4f89-81f2-89a015ff2027 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:54.991612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-539533f2-651a-4f89-81f2-89a015ff2027 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:55.652523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-539533f2-651a-4f89-81f2-89a015ff2027 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:55.669172 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-539533f2-651a-4f89-81f2-89a015ff2027 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a" status: 200 len: 1315 microversion: 2.1 time: 0.698824 Mar 12 20:53:55.669697 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1018/1786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:54 2022] GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:55.697879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a8eb361-7c5f-435d-aa04-70b17ccbcb15 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:55.698627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a8eb361-7c5f-435d-aa04-70b17ccbcb15 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:55.707282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a8eb361-7c5f-435d-aa04-70b17ccbcb15 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:55.708877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a8eb361-7c5f-435d-aa04-70b17ccbcb15 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:55.710380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a8eb361-7c5f-435d-aa04-70b17ccbcb15 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:55.711175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a8eb361-7c5f-435d-aa04-70b17ccbcb15 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:55.735419 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9a8eb361-7c5f-435d-aa04-70b17ccbcb15 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] HTTP exception thrown: Instance 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb could not be found. Mar 12 20:53:55.737094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a8eb361-7c5f-435d-aa04-70b17ccbcb15 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Returning 404 to user: Instance 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:55.738045 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a8eb361-7c5f-435d-aa04-70b17ccbcb15 tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 404 len: 111 microversion: 2.1 time: 0.055299 Mar 12 20:53:55.739733 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1019/1787] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:55 2022] DELETE /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:55.749960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-76b224e2-4997-44b6-b464-6dfe5559398d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:55.751277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-76b224e2-4997-44b6-b464-6dfe5559398d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:55.758609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76b224e2-4997-44b6-b464-6dfe5559398d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:55.759770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76b224e2-4997-44b6-b464-6dfe5559398d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:55.761294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76b224e2-4997-44b6-b464-6dfe5559398d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:55.762017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76b224e2-4997-44b6-b464-6dfe5559398d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:56.278186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-76b224e2-4997-44b6-b464-6dfe5559398d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04cb45776b9475cb0364b96a8bd1e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1245d37d56c46f0b1bc0525fe98289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:56.287874 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-76b224e2-4997-44b6-b464-6dfe5559398d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf" status: 200 len: 1318 microversion: 2.1 time: 0.546421 Mar 12 20:53:56.292148 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1020/1788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:55 2022] GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:56.303587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-192e5986-c655-4514-ab9b-7d238d56ab32 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:56.304387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-192e5986-c655-4514-ab9b-7d238d56ab32 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:56.313286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-192e5986-c655-4514-ab9b-7d238d56ab32 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:56.313903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-192e5986-c655-4514-ab9b-7d238d56ab32 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:56.314807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-192e5986-c655-4514-ab9b-7d238d56ab32 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:56.315516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-192e5986-c655-4514-ab9b-7d238d56ab32 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:56.769288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-192e5986-c655-4514-ab9b-7d238d56ab32 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:56.782017 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-192e5986-c655-4514-ab9b-7d238d56ab32 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1469 microversion: 2.1 time: 0.488448 Mar 12 20:53:56.785290 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1021/1789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:56 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1469 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:56.797578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16e1146c-1138-45c0-b0fb-bb5758423ded tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:56.798269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16e1146c-1138-45c0-b0fb-bb5758423ded tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:56.819075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16e1146c-1138-45c0-b0fb-bb5758423ded tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:56.819555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16e1146c-1138-45c0-b0fb-bb5758423ded tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:56.821585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16e1146c-1138-45c0-b0fb-bb5758423ded tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:56.822097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16e1146c-1138-45c0-b0fb-bb5758423ded tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:56.870836 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-16e1146c-1138-45c0-b0fb-bb5758423ded tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] HTTP exception thrown: Instance 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb could not be found. Mar 12 20:53:56.871859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16e1146c-1138-45c0-b0fb-bb5758423ded tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Returning 404 to user: Instance 6c7052bc-c2a6-4c11-85b5-e31c7f79adfb could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:56.873615 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16e1146c-1138-45c0-b0fb-bb5758423ded tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb" status: 404 len: 111 microversion: 2.1 time: 0.087589 Mar 12 20:53:56.876358 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1022/1790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:56 2022] GET /compute/v2.1/servers/6c7052bc-c2a6-4c11-85b5-e31c7f79adfb => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:56.888998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2a739aba-149d-4d4a-b2ab-3ac309ee1c26 req-4168a914-cf83-4dc9-9158-1f395f2689b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f620d961-9ec1-46e4-967f-a10a457951cf", "tag": "d5becd29-74d4-4c20-a4e3-03cb1c69dbb1"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:56.906412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2a739aba-149d-4d4a-b2ab-3ac309ee1c26 req-4168a914-cf83-4dc9-9158-1f395f2689b0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:56.908116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2a739aba-149d-4d4a-b2ab-3ac309ee1c26 req-4168a914-cf83-4dc9-9158-1f395f2689b0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:56.928798 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2a739aba-149d-4d4a-b2ab-3ac309ee1c26 req-4168a914-cf83-4dc9-9158-1f395f2689b0 service nova] Creating event network-changed:d5becd29-74d4-4c20-a4e3-03cb1c69dbb1 for instance f620d961-9ec1-46e4-967f-a10a457951cf on nch1-master-1 Mar 12 20:53:56.937355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2a739aba-149d-4d4a-b2ab-3ac309ee1c26 req-4168a914-cf83-4dc9-9158-1f395f2689b0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058089 Mar 12 20:53:56.939840 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1023/1791] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:56.950603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-442180e0-9eb6-498b-a0e3-8044aa9c5871 req-76cdeb70-7e55-496f-bcc0-a15d370843c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda4959-0935-4359-bc30-ae11abe0563e", "name": "network-vif-plugged", "status": "completed", "tag": "349eb111-c3f6-4006-b907-369238df3d63"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:56.961121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-442180e0-9eb6-498b-a0e3-8044aa9c5871 req-76cdeb70-7e55-496f-bcc0-a15d370843c9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:56.961931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-442180e0-9eb6-498b-a0e3-8044aa9c5871 req-76cdeb70-7e55-496f-bcc0-a15d370843c9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:56.977298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-442180e0-9eb6-498b-a0e3-8044aa9c5871 req-76cdeb70-7e55-496f-bcc0-a15d370843c9 service nova] Creating event network-vif-plugged:349eb111-c3f6-4006-b907-369238df3d63 for instance 3cda4959-0935-4359-bc30-ae11abe0563e on nch2-master-1 Mar 12 20:53:56.988903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-442180e0-9eb6-498b-a0e3-8044aa9c5871 req-76cdeb70-7e55-496f-bcc0-a15d370843c9 service nova] Instance 3cda4959-0935-4359-bc30-ae11abe0563e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:53:57.001976 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-442180e0-9eb6-498b-a0e3-8044aa9c5871 req-76cdeb70-7e55-496f-bcc0-a15d370843c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059851 Mar 12 20:53:57.003385 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1024/1792] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:57.010453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cb87aca7-049a-462d-9dc9-101ccddd6b04 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:57.011380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cb87aca7-049a-462d-9dc9-101ccddd6b04 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:57.019806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb87aca7-049a-462d-9dc9-101ccddd6b04 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:57.020463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb87aca7-049a-462d-9dc9-101ccddd6b04 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:57.021483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb87aca7-049a-462d-9dc9-101ccddd6b04 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:57.022628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb87aca7-049a-462d-9dc9-101ccddd6b04 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:57.296252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cb87aca7-049a-462d-9dc9-101ccddd6b04 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:57.306136 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cb87aca7-049a-462d-9dc9-101ccddd6b04 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a" status: 200 len: 1503 microversion: 2.1 time: 0.301146 Mar 12 20:53:57.316969 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1025/1793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:57 2022] GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:57.318536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4297e4c-71ec-4150-853f-60d646bd2bfe tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '.version_select at 0x7f6e48e08e50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:57.350189 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b4297e4c-71ec-4150-853f-60d646bd2bfe tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] HTTP exception thrown: Image not found. Mar 12 20:53:57.352059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4297e4c-71ec-4150-853f-60d646bd2bfe tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:57.353236 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b4297e4c-71ec-4150-853f-60d646bd2bfe tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484" status: 404 len: 62 microversion: 2.1 time: 0.042619 Mar 12 20:53:57.354196 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1026/1794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:57 2022] DELETE /compute/v2.1/images/2b83c693-b186-4596-ad5e-5c35ddded484 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:53:57.626392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-513397f1-a368-4d6f-96aa-4a8f6fd18568 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:57.636219 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-513397f1-a368-4d6f-96aa-4a8f6fd18568 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.280800 Mar 12 20:53:57.637147 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1027/1795] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:53:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:53:57.645005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d3576a18-480a-490f-ad7b-82a3b7f24612 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:57.646132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d3576a18-480a-490f-ad7b-82a3b7f24612 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:57.654177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3576a18-480a-490f-ad7b-82a3b7f24612 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:57.654640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3576a18-480a-490f-ad7b-82a3b7f24612 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:57.655450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3576a18-480a-490f-ad7b-82a3b7f24612 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:57.655880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3576a18-480a-490f-ad7b-82a3b7f24612 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:57.997394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d3576a18-480a-490f-ad7b-82a3b7f24612 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04cb45776b9475cb0364b96a8bd1e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1245d37d56c46f0b1bc0525fe98289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:58.005475 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d3576a18-480a-490f-ad7b-82a3b7f24612 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf" status: 200 len: 1318 microversion: 2.1 time: 0.367165 Mar 12 20:53:58.015532 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1028/1796] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:57 2022] GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:58.015532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1c02ac35-ee94-4ee3-a679-b7affd9a4e01 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1332847920"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:53:58.015532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1c02ac35-ee94-4ee3-a679-b7affd9a4e01 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:58.019844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c02ac35-ee94-4ee3-a679-b7affd9a4e01 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:58.020376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c02ac35-ee94-4ee3-a679-b7affd9a4e01 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:58.021231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c02ac35-ee94-4ee3-a679-b7affd9a4e01 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:58.022377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c02ac35-ee94-4ee3-a679-b7affd9a4e01 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:58.301095 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.network.security_group_api [None req-1c02ac35-ee94-4ee3-a679-b7affd9a4e01 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Adding security group b3716991-0e82-44fa-873e-c50052162046 to port 8fbb98dd-c64e-4f04-b014-2c1dbc456627 Mar 12 20:53:59.211245 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1c02ac35-ee94-4ee3-a679-b7affd9a4e01 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a/action" status: 202 len: 0 microversion: 2.1 time: 1.203360 Mar 12 20:53:59.211873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1029/1797] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:53:58 2022] POST /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a/action => generated 0 bytes in 1204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:53:59.218573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f12bffeb-d09b-41a2-8942-94e6f0f815aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:59.219093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f12bffeb-d09b-41a2-8942-94e6f0f815aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:59.237581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f12bffeb-d09b-41a2-8942-94e6f0f815aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:59.238071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f12bffeb-d09b-41a2-8942-94e6f0f815aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:59.238867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f12bffeb-d09b-41a2-8942-94e6f0f815aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:59.242542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f12bffeb-d09b-41a2-8942-94e6f0f815aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:59.269122 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f12bffeb-d09b-41a2-8942-94e6f0f815aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] HTTP exception thrown: Instance 378f100b-bc86-4e26-8462-2b6ab20b1e04 could not be found. Mar 12 20:53:59.269740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f12bffeb-d09b-41a2-8942-94e6f0f815aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Returning 404 to user: Instance 378f100b-bc86-4e26-8462-2b6ab20b1e04 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:53:59.270622 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f12bffeb-d09b-41a2-8942-94e6f0f815aa tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "DELETE /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 404 len: 111 microversion: 2.1 time: 0.057824 Mar 12 20:53:59.271324 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1030/1798] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:53:59 2022] DELETE /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:53:59.286248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5ac6bfb-8a1b-4aeb-b29d-937f4db20027 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:59.349749 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c5ac6bfb-8a1b-4aeb-b29d-937f4db20027 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.077475 Mar 12 20:53:59.351047 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1031/1799] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 20:53:59 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:59.366617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7a046bf1-4ae9-4b23-9c9a-a4ead138f9ef tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:59.367529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7a046bf1-4ae9-4b23-9c9a-a4ead138f9ef tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:59.375178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a046bf1-4ae9-4b23-9c9a-a4ead138f9ef tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:59.375866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a046bf1-4ae9-4b23-9c9a-a4ead138f9ef tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:59.376819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a046bf1-4ae9-4b23-9c9a-a4ead138f9ef tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:59.377413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a046bf1-4ae9-4b23-9c9a-a4ead138f9ef tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:59.799217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7a046bf1-4ae9-4b23-9c9a-a4ead138f9ef tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:53:59.807592 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7a046bf1-4ae9-4b23-9c9a-a4ead138f9ef tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1469 microversion: 2.1 time: 0.445293 Mar 12 20:53:59.814099 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1032/1800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:59 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1469 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:53:59.822283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-812cb43e-0327-4663-aa92-a853bfdeb57d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:53:59.824459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-812cb43e-0327-4663-aa92-a853bfdeb57d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:53:59.833530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-812cb43e-0327-4663-aa92-a853bfdeb57d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:59.853580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-812cb43e-0327-4663-aa92-a853bfdeb57d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:53:59.855888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-812cb43e-0327-4663-aa92-a853bfdeb57d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:53:59.856500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-812cb43e-0327-4663-aa92-a853bfdeb57d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:00.230383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-812cb43e-0327-4663-aa92-a853bfdeb57d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04cb45776b9475cb0364b96a8bd1e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1245d37d56c46f0b1bc0525fe98289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:00.264069 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-812cb43e-0327-4663-aa92-a853bfdeb57d tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf" status: 200 len: 1318 microversion: 2.1 time: 0.443672 Mar 12 20:54:00.266940 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1033/1801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:53:59 2022] GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:00.277045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-222e4775-0732-466f-81fc-d8ab5136c07c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1639582551"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:00.277846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-222e4775-0732-466f-81fc-d8ab5136c07c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:00.287582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-222e4775-0732-466f-81fc-d8ab5136c07c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:00.288244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-222e4775-0732-466f-81fc-d8ab5136c07c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:00.293980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-222e4775-0732-466f-81fc-d8ab5136c07c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:00.296078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-222e4775-0732-466f-81fc-d8ab5136c07c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:00.735273 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.network.security_group_api [None req-222e4775-0732-466f-81fc-d8ab5136c07c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Adding security group 8a20781e-800f-4674-9ecb-973f41cc9b49 to port 8fbb98dd-c64e-4f04-b014-2c1dbc456627 Mar 12 20:54:01.325814 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-222e4775-0732-466f-81fc-d8ab5136c07c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a/action" status: 202 len: 0 microversion: 2.1 time: 1.056973 Mar 12 20:54:01.332271 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1034/1802] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:54:00 2022] POST /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a/action => generated 0 bytes in 1059 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:01.338072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-97931620-99b9-4802-97da-1f995f44483f req-edeb9ded-a98b-4ecf-8503-ec561ddb1893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25b8295-eac5-4598-9776-94fad81bc42a", "tag": "8fbb98dd-c64e-4f04-b014-2c1dbc456627"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:01.362421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-97931620-99b9-4802-97da-1f995f44483f req-edeb9ded-a98b-4ecf-8503-ec561ddb1893 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:01.363589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-97931620-99b9-4802-97da-1f995f44483f req-edeb9ded-a98b-4ecf-8503-ec561ddb1893 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:01.377204 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-97931620-99b9-4802-97da-1f995f44483f req-edeb9ded-a98b-4ecf-8503-ec561ddb1893 service nova] Creating event network-changed:8fbb98dd-c64e-4f04-b014-2c1dbc456627 for instance c25b8295-eac5-4598-9776-94fad81bc42a on nch2-master-1 Mar 12 20:54:01.387774 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-97931620-99b9-4802-97da-1f995f44483f req-edeb9ded-a98b-4ecf-8503-ec561ddb1893 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059455 Mar 12 20:54:01.388575 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1035/1803] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:01.398881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f08592a-d020-4538-a7be-5e3a9f9640eb tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:01.399846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4f08592a-d020-4538-a7be-5e3a9f9640eb tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] [instance: 378f100b-bc86-4e26-8462-2b6ab20b1e04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:01.417396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f08592a-d020-4538-a7be-5e3a9f9640eb tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:01.418557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f08592a-d020-4538-a7be-5e3a9f9640eb tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:01.419485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f08592a-d020-4538-a7be-5e3a9f9640eb tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:01.420721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f08592a-d020-4538-a7be-5e3a9f9640eb tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:01.447302 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-4f08592a-d020-4538-a7be-5e3a9f9640eb tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] HTTP exception thrown: Instance 378f100b-bc86-4e26-8462-2b6ab20b1e04 could not be found. Mar 12 20:54:01.448268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f08592a-d020-4538-a7be-5e3a9f9640eb tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] Returning 404 to user: Instance 378f100b-bc86-4e26-8462-2b6ab20b1e04 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:01.449369 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4f08592a-d020-4538-a7be-5e3a9f9640eb tempest-ImagesTestJSON-372446698 tempest-ImagesTestJSON-372446698-project] 10.222.0.30 "GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04" status: 404 len: 111 microversion: 2.1 time: 0.055225 Mar 12 20:54:01.454243 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1036/1804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:01 2022] GET /compute/v2.1/servers/378f100b-bc86-4e26-8462-2b6ab20b1e04 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:01.461029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-df97c31c-e266-44c5-9277-79ebc52bf7e0 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:01.472695 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-df97c31c-e266-44c5-9277-79ebc52bf7e0 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015376 Mar 12 20:54:01.480570 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1037/1805] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:54:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:01.486790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-566806fe-a690-450a-8786-0c8a09e33951 req-1917ec3a-8c13-4864-b4cd-59420df8e820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda4959-0935-4359-bc30-ae11abe0563e", "name": "network-vif-unplugged", "status": "completed", "tag": "349eb111-c3f6-4006-b907-369238df3d63"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:01.497270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-566806fe-a690-450a-8786-0c8a09e33951 req-1917ec3a-8c13-4864-b4cd-59420df8e820 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:01.498116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-566806fe-a690-450a-8786-0c8a09e33951 req-1917ec3a-8c13-4864-b4cd-59420df8e820 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:01.514120 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-566806fe-a690-450a-8786-0c8a09e33951 req-1917ec3a-8c13-4864-b4cd-59420df8e820 service nova] Creating event network-vif-unplugged:349eb111-c3f6-4006-b907-369238df3d63 for instance 3cda4959-0935-4359-bc30-ae11abe0563e on nch1-master-1 Mar 12 20:54:01.522380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-566806fe-a690-450a-8786-0c8a09e33951 req-1917ec3a-8c13-4864-b4cd-59420df8e820 service nova] Instance 3cda4959-0935-4359-bc30-ae11abe0563e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:54:01.537112 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-566806fe-a690-450a-8786-0c8a09e33951 req-1917ec3a-8c13-4864-b4cd-59420df8e820 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054815 Mar 12 20:54:01.538888 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1038/1806] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:01.788918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1ca18054-0bbf-4a35-bf18-61683458a6be tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Action: 'update', calling method: .version_select at 0x7f6e3727c430>, body: {"quota_set": {"ram": "5120"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:01.893554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ca18054-0bbf-4a35-bf18-61683458a6be tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:01.894882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ca18054-0bbf-4a35-bf18-61683458a6be tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:01.896090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ca18054-0bbf-4a35-bf18-61683458a6be tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:01.897238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ca18054-0bbf-4a35-bf18-61683458a6be tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:01.977460 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1ca18054-0bbf-4a35-bf18-61683458a6be tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/47a85074c85e481c83eaa0ead91ac037" status: 200 len: 148 microversion: 2.57 time: 0.432856 Mar 12 20:54:01.983320 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1039/1807] 10.222.0.30 () {62 vars in 1302 bytes} [Sat Mar 12 20:54:01 2022] PUT /compute/v2.1/os-quota-sets/47a85074c85e481c83eaa0ead91ac037 => generated 148 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:54:01.996508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ff2e8ce-c0f5-416d-b1b1-f4a01d6fdfb0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:01.997304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ff2e8ce-c0f5-416d-b1b1-f4a01d6fdfb0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:02.016076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ff2e8ce-c0f5-416d-b1b1-f4a01d6fdfb0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:02.016565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ff2e8ce-c0f5-416d-b1b1-f4a01d6fdfb0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:02.017464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ff2e8ce-c0f5-416d-b1b1-f4a01d6fdfb0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:02.017963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ff2e8ce-c0f5-416d-b1b1-f4a01d6fdfb0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:02.325608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6ff2e8ce-c0f5-416d-b1b1-f4a01d6fdfb0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:02.336737 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ff2e8ce-c0f5-416d-b1b1-f4a01d6fdfb0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1469 microversion: 2.1 time: 0.350823 Mar 12 20:54:02.339501 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1040/1808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:01 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1469 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:02.418551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1573552675", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "34a96fe2-32a3-4bf3-8c1e-f56f90cdec96"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:02.488285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] validate_networks() for [('34a96fe2-32a3-4bf3-8c1e-f56f90cdec96', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:54:03.008081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:54:03.008672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:54:03.008984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:54:03.009395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:54:03.010074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:54:03.020346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:03.024173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:03.024173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:03.024173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:03.041750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Getting quotas for project bea8388cb0554c74b7db0bedfb0ca482. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:54:03.047341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Getting quotas for user 3d139f357097469880d0cc2631ee8459 and project bea8388cb0554c74b7db0bedfb0ca482. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:54:03.060555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:54:03.062943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:54:03.138375 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7244c4b-8cd9-4cc8-bc21-845af1471251 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793601 Mar 12 20:54:03.139236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1041/1809] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:54:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:54:03.144326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1357406c-c46b-4492-9bf3-e80f8f5f23be tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:03.145219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1357406c-c46b-4492-9bf3-e80f8f5f23be tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:03.152699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1357406c-c46b-4492-9bf3-e80f8f5f23be tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:03.153161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1357406c-c46b-4492-9bf3-e80f8f5f23be tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:03.154005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1357406c-c46b-4492-9bf3-e80f8f5f23be tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:03.155174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1357406c-c46b-4492-9bf3-e80f8f5f23be tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:03.399123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1357406c-c46b-4492-9bf3-e80f8f5f23be tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04cb45776b9475cb0364b96a8bd1e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1245d37d56c46f0b1bc0525fe98289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:03.418815 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1357406c-c46b-4492-9bf3-e80f8f5f23be tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf" status: 200 len: 1318 microversion: 2.1 time: 0.278139 Mar 12 20:54:03.419471 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1042/1810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:03 2022] GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:03.426910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6c9ad475-e732-4592-b9f0-a7a4c90ca18e tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:03.427732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6c9ad475-e732-4592-b9f0-a7a4c90ca18e tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:03.435830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c9ad475-e732-4592-b9f0-a7a4c90ca18e tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:03.436562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c9ad475-e732-4592-b9f0-a7a4c90ca18e tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:03.438376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c9ad475-e732-4592-b9f0-a7a4c90ca18e tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:03.438828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c9ad475-e732-4592-b9f0-a7a4c90ca18e tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:03.657706 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6c9ad475-e732-4592-b9f0-a7a4c90ca18e tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.236211 Mar 12 20:54:03.658355 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1043/1811] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Mar 12 20:54:03 2022] GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a/os-security-groups => generated 1159 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:03.663394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30a43604-db99-4baf-825d-dfbcb8f5f538 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:03.683036 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30a43604-db99-4baf-825d-dfbcb8f5f538 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020526 Mar 12 20:54:03.685016 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1044/1812] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:54:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:03.695144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-13220ddd-b7bb-4b86-a25b-863c036ee15f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Calling method '.version_select at 0x7f6e372e5a60>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:04.088503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13220ddd-b7bb-4b86-a25b-863c036ee15f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:04.089244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13220ddd-b7bb-4b86-a25b-863c036ee15f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:04.090742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13220ddd-b7bb-4b86-a25b-863c036ee15f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:04.091413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13220ddd-b7bb-4b86-a25b-863c036ee15f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:04.113709 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-13220ddd-b7bb-4b86-a25b-863c036ee15f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/47a85074c85e481c83eaa0ead91ac037/detail" status: 200 len: 463 microversion: 2.57 time: 0.426822 Mar 12 20:54:04.114370 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1045/1813] 10.222.0.30 () {60 vars in 1303 bytes} [Sat Mar 12 20:54:03 2022] GET /compute/v2.1/os-quota-sets/47a85074c85e481c83eaa0ead91ac037/detail => generated 463 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:54:04.118860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3267d891-7aa4-4a14-af19-5ddcf354af63 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:04.119466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3267d891-7aa4-4a14-af19-5ddcf354af63 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:04.132001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3267d891-7aa4-4a14-af19-5ddcf354af63 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:04.132764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3267d891-7aa4-4a14-af19-5ddcf354af63 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:04.135126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3267d891-7aa4-4a14-af19-5ddcf354af63 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:04.135516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3267d891-7aa4-4a14-af19-5ddcf354af63 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:04.206393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3267d891-7aa4-4a14-af19-5ddcf354af63 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:04.217981 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3267d891-7aa4-4a14-af19-5ddcf354af63 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b" status: 200 len: 1276 microversion: 2.1 time: 0.102461 Mar 12 20:54:04.218743 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1046/1814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:04 2022] GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:04.225899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cff30679-087b-47fb-8ed1-d1f2a59e415b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:04.227012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cff30679-087b-47fb-8ed1-d1f2a59e415b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:04.234203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cff30679-087b-47fb-8ed1-d1f2a59e415b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:04.235367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cff30679-087b-47fb-8ed1-d1f2a59e415b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:04.236163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cff30679-087b-47fb-8ed1-d1f2a59e415b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:04.236688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cff30679-087b-47fb-8ed1-d1f2a59e415b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:04.383974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cff30679-087b-47fb-8ed1-d1f2a59e415b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:04.392159 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cff30679-087b-47fb-8ed1-d1f2a59e415b tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1469 microversion: 2.1 time: 0.171387 Mar 12 20:54:04.392942 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1047/1815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:04 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:04.397328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-64beeee0-f38e-46d7-a68e-cffcab856321 req-981119c5-2277-4e63-baca-4667f0d830a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25b8295-eac5-4598-9776-94fad81bc42a", "tag": "8fbb98dd-c64e-4f04-b014-2c1dbc456627"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:04.412882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-64beeee0-f38e-46d7-a68e-cffcab856321 req-981119c5-2277-4e63-baca-4667f0d830a5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:04.413337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-64beeee0-f38e-46d7-a68e-cffcab856321 req-981119c5-2277-4e63-baca-4667f0d830a5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:04.428641 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-64beeee0-f38e-46d7-a68e-cffcab856321 req-981119c5-2277-4e63-baca-4667f0d830a5 service nova] Creating event network-changed:8fbb98dd-c64e-4f04-b014-2c1dbc456627 for instance c25b8295-eac5-4598-9776-94fad81bc42a on nch2-master-1 Mar 12 20:54:04.433871 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-64beeee0-f38e-46d7-a68e-cffcab856321 req-981119c5-2277-4e63-baca-4667f0d830a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039843 Mar 12 20:54:04.434810 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1048/1816] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:04.439942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-48f21ec5-2b47-4755-ba9b-87050ead3309 req-7c7dee8f-6f73-4cb1-a788-939db852a0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cda4959-0935-4359-bc30-ae11abe0563e", "tag": "349eb111-c3f6-4006-b907-369238df3d63"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:04.452602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-48f21ec5-2b47-4755-ba9b-87050ead3309 req-7c7dee8f-6f73-4cb1-a788-939db852a0c3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:04.453055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-48f21ec5-2b47-4755-ba9b-87050ead3309 req-7c7dee8f-6f73-4cb1-a788-939db852a0c3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:04.489438 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-48f21ec5-2b47-4755-ba9b-87050ead3309 req-7c7dee8f-6f73-4cb1-a788-939db852a0c3 service nova] Creating event network-changed:349eb111-c3f6-4006-b907-369238df3d63 for instance 3cda4959-0935-4359-bc30-ae11abe0563e on nch1-master-1 Mar 12 20:54:04.505694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-48f21ec5-2b47-4755-ba9b-87050ead3309 req-7c7dee8f-6f73-4cb1-a788-939db852a0c3 service nova] Instance 3cda4959-0935-4359-bc30-ae11abe0563e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 20:54:04.533394 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-48f21ec5-2b47-4755-ba9b-87050ead3309 req-7c7dee8f-6f73-4cb1-a788-939db852a0c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094981 Mar 12 20:54:04.536141 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1049/1817] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:04.547366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c4710fdb-ed48-4636-938e-e531d1bdd48d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'create', calling method: .version_select at 0x7f6e372e5160>, body: {"security_group": {"name": " tempest-securitygroup -505629534 ", "description": "tempest-description-2118917930"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:04.906832 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c4710fdb-ed48-4636-938e-e531d1bdd48d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.368993 Mar 12 20:54:04.908592 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1050/1818] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:54:04 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:04.925595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ff0b062-925d-442a-bff2-683829dbe665 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:04.964679 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ff0b062-925d-442a-bff2-683829dbe665 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.053410 Mar 12 20:54:04.977124 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1051/1819] 10.222.0.30 () {58 vars in 1164 bytes} [Sat Mar 12 20:54:04 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:05.144006 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-49edab09-f2bf-433e-a781-5427b2f0900f tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] 10.222.0.30 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.165281 Mar 12 20:54:05.144877 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1052/1820] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Mar 12 20:54:04 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 12 20:54:05.151720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8717c1d7-1200-4e39-b805-a617bcc7cc9f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Action: 'update', calling method: .version_select at 0x7f6e48daf940>, body: {"quota_set": {"ram": "2048"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:05.219946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8717c1d7-1200-4e39-b805-a617bcc7cc9f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:05.221028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8717c1d7-1200-4e39-b805-a617bcc7cc9f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:05.221960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8717c1d7-1200-4e39-b805-a617bcc7cc9f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:05.222471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8717c1d7-1200-4e39-b805-a617bcc7cc9f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:05.258106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8717c1d7-1200-4e39-b805-a617bcc7cc9f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:05.258618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8717c1d7-1200-4e39-b805-a617bcc7cc9f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:05.259502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8717c1d7-1200-4e39-b805-a617bcc7cc9f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:05.260010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8717c1d7-1200-4e39-b805-a617bcc7cc9f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:05.321219 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8717c1d7-1200-4e39-b805-a617bcc7cc9f tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/47a85074c85e481c83eaa0ead91ac037?user_id=e632ba2057cf4d04b3eb03a480c2ba3c" status: 200 len: 148 microversion: 2.57 time: 0.175131 Mar 12 20:54:05.322062 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1053/1821] 10.222.0.30 () {62 vars in 1383 bytes} [Sat Mar 12 20:54:05 2022] PUT /compute/v2.1/os-quota-sets/47a85074c85e481c83eaa0ead91ac037?user_id=e632ba2057cf4d04b3eb03a480c2ba3c => generated 148 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:54:05.327687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-32f0f174-3c15-49ec-9f9c-5c12fc97b3c7 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:05.328515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-32f0f174-3c15-49ec-9f9c-5c12fc97b3c7 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:05.335124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32f0f174-3c15-49ec-9f9c-5c12fc97b3c7 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:05.335673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32f0f174-3c15-49ec-9f9c-5c12fc97b3c7 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:05.336532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32f0f174-3c15-49ec-9f9c-5c12fc97b3c7 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:05.337050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32f0f174-3c15-49ec-9f9c-5c12fc97b3c7 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:05.482046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-32f0f174-3c15-49ec-9f9c-5c12fc97b3c7 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04cb45776b9475cb0364b96a8bd1e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1245d37d56c46f0b1bc0525fe98289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:05.490336 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-32f0f174-3c15-49ec-9f9c-5c12fc97b3c7 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf" status: 200 len: 1318 microversion: 2.1 time: 0.167042 Mar 12 20:54:05.490928 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1054/1822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:05 2022] GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:05.495527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6da9b1ad-27d3-4ffa-904f-ccb0df5bfe24 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48daf3a0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:05.544008 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6da9b1ad-27d3-4ffa-904f-ccb0df5bfe24 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/9c4d8665-ebfd-40d1-ad59-64d4cc26f82a" status: 200 len: 223 microversion: 2.1 time: 0.051933 Mar 12 20:54:05.552164 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1055/1823] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 20:54:05 2022] GET /compute/v2.1/os-security-groups/9c4d8665-ebfd-40d1-ad59-64d4cc26f82a => generated 223 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:05.557151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ba6c863-bce8-481f-a597-d7439e57ef24 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:05.570025 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ba6c863-bce8-481f-a597-d7439e57ef24 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016520 Mar 12 20:54:05.570715 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1056/1824] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:54:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:05.575638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-201a9c48-7e77-44d8-81f7-982420fe9e4b req-a78464f6-06d8-43b6-aefb-dbd27e108a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f620d961-9ec1-46e4-967f-a10a457951cf", "name": "network-vif-plugged", "status": "completed", "tag": "d5becd29-74d4-4c20-a4e3-03cb1c69dbb1"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:05.585087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-201a9c48-7e77-44d8-81f7-982420fe9e4b req-a78464f6-06d8-43b6-aefb-dbd27e108a5a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:05.585646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-201a9c48-7e77-44d8-81f7-982420fe9e4b req-a78464f6-06d8-43b6-aefb-dbd27e108a5a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:05.596412 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-201a9c48-7e77-44d8-81f7-982420fe9e4b req-a78464f6-06d8-43b6-aefb-dbd27e108a5a service nova] Creating event network-vif-plugged:d5becd29-74d4-4c20-a4e3-03cb1c69dbb1 for instance f620d961-9ec1-46e4-967f-a10a457951cf on nch1-master-1 Mar 12 20:54:05.601574 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-201a9c48-7e77-44d8-81f7-982420fe9e4b req-a78464f6-06d8-43b6-aefb-dbd27e108a5a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029645 Mar 12 20:54:05.602342 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1057/1825] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:05.608881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b96a836d-cb8d-435d-aff7-2f9d643afad0 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] Calling method '.version_select at 0x7f6e48e19940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:05.631548 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b96a836d-cb8d-435d-aff7-2f9d643afad0 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] HTTP exception thrown: Image not found. Mar 12 20:54:05.632155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b96a836d-cb8d-435d-aff7-2f9d643afad0 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:05.633062 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b96a836d-cb8d-435d-aff7-2f9d643afad0 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] 10.222.0.30 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.029260 Mar 12 20:54:05.633881 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1058/1826] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Mar 12 20:54:05 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:54:05.638663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-95d5f3bc-298d-4add-ab5d-5352b030269b tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:05.639406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-95d5f3bc-298d-4add-ab5d-5352b030269b tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:05.648501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95d5f3bc-298d-4add-ab5d-5352b030269b tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:05.648951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95d5f3bc-298d-4add-ab5d-5352b030269b tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:05.649755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95d5f3bc-298d-4add-ab5d-5352b030269b tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:05.650220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95d5f3bc-298d-4add-ab5d-5352b030269b tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:05.728751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-95d5f3bc-298d-4add-ab5d-5352b030269b tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:05.737275 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-95d5f3bc-298d-4add-ab5d-5352b030269b tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b" status: 200 len: 1282 microversion: 2.1 time: 0.102170 Mar 12 20:54:05.741850 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1059/1827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:05 2022] GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b => generated 1282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:05.746117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d02da3f2-bde9-4fcc-a521-ddd66556d5fd tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] Calling method '.version_select at 0x7f6e48dafb80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:05.827163 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d02da3f2-bde9-4fcc-a521-ddd66556d5fd tempest-QuotasAdminTestV257-1909883473 tempest-QuotasAdminTestV257-1909883473-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/47a85074c85e481c83eaa0ead91ac037?user_id=e632ba2057cf4d04b3eb03a480c2ba3c" status: 200 len: 190 microversion: 2.57 time: 0.087863 Mar 12 20:54:05.833203 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1060/1828] 10.222.0.30 () {60 vars in 1363 bytes} [Sat Mar 12 20:54:05 2022] GET /compute/v2.1/os-quota-sets/47a85074c85e481c83eaa0ead91ac037?user_id=e632ba2057cf4d04b3eb03a480c2ba3c => generated 190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:54:05.838300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f8d1b226-e529-41ec-8aed-a0c90174b918 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:05.839075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f8d1b226-e529-41ec-8aed-a0c90174b918 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:05.847235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8d1b226-e529-41ec-8aed-a0c90174b918 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:05.847777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8d1b226-e529-41ec-8aed-a0c90174b918 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:05.848930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8d1b226-e529-41ec-8aed-a0c90174b918 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:05.849577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8d1b226-e529-41ec-8aed-a0c90174b918 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:06.003787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f8d1b226-e529-41ec-8aed-a0c90174b918 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:06.011670 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f8d1b226-e529-41ec-8aed-a0c90174b918 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1462 microversion: 2.1 time: 0.182588 Mar 12 20:54:06.012385 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1061/1829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:05 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1462 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:06.019190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b6f39ce4-551f-43f4-9ea0-b2969376b045 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48e1bb80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:06.223830 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b6f39ce4-551f-43f4-9ea0-b2969376b045 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/9c4d8665-ebfd-40d1-ad59-64d4cc26f82a" status: 202 len: 0 microversion: 2.1 time: 0.210232 Mar 12 20:54:06.225579 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1062/1830] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:54:06 2022] DELETE /compute/v2.1/os-security-groups/9c4d8665-ebfd-40d1-ad59-64d4cc26f82a => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:06.244859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-48ee546f-f657-4510-b566-bc907c33a08d tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:06.283149 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-48ee546f-f657-4510-b566-bc907c33a08d tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.054817 Mar 12 20:54:06.284338 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1063/1831] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Mar 12 20:54:06 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:06.289690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d58d023b-98c3-4d78-b730-adee812113e4 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] Calling method '.version_select at 0x7f6e48e1b430>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:06.315363 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d58d023b-98c3-4d78-b730-adee812113e4 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] HTTP exception thrown: Image not found. Mar 12 20:54:06.316236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d58d023b-98c3-4d78-b730-adee812113e4 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:06.317084 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d58d023b-98c3-4d78-b730-adee812113e4 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] 10.222.0.30 "DELETE /compute/v2.1/images/3334288f-9846-4cc0-93a4-0c0734fc7d2j" status: 404 len: 62 microversion: 2.1 time: 0.031191 Mar 12 20:54:06.317927 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1064/1832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:06 2022] DELETE /compute/v2.1/images/3334288f-9846-4cc0-93a4-0c0734fc7d2j => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:54:06.322831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad1172fe-c030-4be4-bee8-dd57cf241576 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:06.323842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad1172fe-c030-4be4-bee8-dd57cf241576 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:06.332230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad1172fe-c030-4be4-bee8-dd57cf241576 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:06.332934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad1172fe-c030-4be4-bee8-dd57cf241576 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:06.334046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad1172fe-c030-4be4-bee8-dd57cf241576 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:06.334829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad1172fe-c030-4be4-bee8-dd57cf241576 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:06.516934 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad1172fe-c030-4be4-bee8-dd57cf241576 tempest-MigrationsAdminTest-2117447746 tempest-MigrationsAdminTest-2117447746-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1613 microversion: 2.1 time: 0.197626 Mar 12 20:54:06.518075 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1065/1833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:06 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1613 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:06.523718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6027198-2ca6-4a01-98f2-cda4733c3164 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48e15ee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:06.550578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-d6027198-2ca6-4a01-98f2-cda4733c3164 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9c4d8665-ebfd-40d1-ad59-64d4cc26f82a does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:54:06.551419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-d6027198-2ca6-4a01-98f2-cda4733c3164 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Neutron security group 9c4d8665-ebfd-40d1-ad59-64d4cc26f82a not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:54:06.552132 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d6027198-2ca6-4a01-98f2-cda4733c3164 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Security group 9c4d8665-ebfd-40d1-ad59-64d4cc26f82a does not exist Mar 12 20:54:06.552132 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-03af5471-f731-4c0d-b65a-8f815f795e84'] Mar 12 20:54:06.553050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6027198-2ca6-4a01-98f2-cda4733c3164 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Security group 9c4d8665-ebfd-40d1-ad59-64d4cc26f82a does not exist Mar 12 20:54:06.553050 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-03af5471-f731-4c0d-b65a-8f815f795e84'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:06.554149 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d6027198-2ca6-4a01-98f2-cda4733c3164 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/9c4d8665-ebfd-40d1-ad59-64d4cc26f82a" status: 404 len: 194 microversion: 2.1 time: 0.034844 Mar 12 20:54:06.554860 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1066/1834] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 20:54:06 2022] GET /compute/v2.1/os-security-groups/9c4d8665-ebfd-40d1-ad59-64d4cc26f82a => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:06.561749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4527bf57-7dc7-4ce0-9d63-3fb66e769a74 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:06.575482 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4527bf57-7dc7-4ce0-9d63-3fb66e769a74 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.018498 Mar 12 20:54:06.577170 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1067/1835] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Mar 12 20:54:06 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:06.582606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-53bd5e4d-91c1-4197-b99c-6d0617a6c900 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] Calling method '.version_select at 0x7f6e48daf790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:06.604454 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-53bd5e4d-91c1-4197-b99c-6d0617a6c900 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] HTTP exception thrown: Image not found. Mar 12 20:54:06.605098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-53bd5e4d-91c1-4197-b99c-6d0617a6c900 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:06.606127 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-53bd5e4d-91c1-4197-b99c-6d0617a6c900 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] 10.222.0.30 "DELETE /compute/v2.1/images/20c14731-a3c8-4473-8a31-3aaa2ff337201" status: 404 len: 62 microversion: 2.1 time: 0.027421 Mar 12 20:54:06.606779 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1068/1836] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:54:06 2022] DELETE /compute/v2.1/images/20c14731-a3c8-4473-8a31-3aaa2ff337201 => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:54:06.614670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1413c3b5-51f7-431c-a27d-ade0f49c5434 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:06.615585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1413c3b5-51f7-431c-a27d-ade0f49c5434 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:06.629946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1413c3b5-51f7-431c-a27d-ade0f49c5434 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:06.630284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1413c3b5-51f7-431c-a27d-ade0f49c5434 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:06.631088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1413c3b5-51f7-431c-a27d-ade0f49c5434 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:06.631538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1413c3b5-51f7-431c-a27d-ade0f49c5434 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:06.833232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1413c3b5-51f7-431c-a27d-ade0f49c5434 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04cb45776b9475cb0364b96a8bd1e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1245d37d56c46f0b1bc0525fe98289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:06.841285 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1413c3b5-51f7-431c-a27d-ade0f49c5434 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf" status: 200 len: 1318 microversion: 2.1 time: 0.233061 Mar 12 20:54:06.842140 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1069/1837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:06 2022] GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:06.846987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ce8a9f7-6f80-455a-94cd-27386626a5b4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:06.847698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ce8a9f7-6f80-455a-94cd-27386626a5b4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:06.854383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ce8a9f7-6f80-455a-94cd-27386626a5b4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:06.855086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ce8a9f7-6f80-455a-94cd-27386626a5b4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:06.856040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ce8a9f7-6f80-455a-94cd-27386626a5b4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:06.856625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ce8a9f7-6f80-455a-94cd-27386626a5b4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:06.888361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ce8a9f7-6f80-455a-94cd-27386626a5b4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:54:06.995112 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ce8a9f7-6f80-455a-94cd-27386626a5b4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 204 len: 0 microversion: 2.1 time: 0.151493 Mar 12 20:54:06.996788 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1070/1838] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:54:06 2022] DELETE /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:54:07.003998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c10c4dd6-c65a-48e9-a44a-cb680ee00ec7 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'create', calling method: .version_select at 0x7f6e48df7940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1875926971", "description": "tempest-description-1968012989"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:07.268608 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c10c4dd6-c65a-48e9-a44a-cb680ee00ec7 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.264893 Mar 12 20:54:07.270457 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1071/1839] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:54:06 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:07.275115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-620cd680-7c7c-47d3-be62-c41c395da344 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:07.293303 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-620cd680-7c7c-47d3-be62-c41c395da344 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021590 Mar 12 20:54:07.297089 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1072/1840] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:54:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:07.312020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56f66c02-6a1c-44b0-b96d-a4b84e1d510a tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] Calling method '.version_select at 0x7f6e48e19ca0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:07.344323 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-56f66c02-6a1c-44b0-b96d-a4b84e1d510a tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] HTTP exception thrown: Image not found. Mar 12 20:54:07.344865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56f66c02-6a1c-44b0-b96d-a4b84e1d510a tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:07.345828 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56f66c02-6a1c-44b0-b96d-a4b84e1d510a tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] 10.222.0.30 "DELETE /compute/v2.1/images/tempest-invalid-686974858" status: 404 len: 62 microversion: 2.1 time: 0.047539 Mar 12 20:54:07.346646 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1073/1841] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Mar 12 20:54:07 2022] DELETE /compute/v2.1/images/tempest-invalid-686974858 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:54:07.356163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b7bf0f9-6242-4858-b434-fc8b7e89e9c4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:07.357867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b7bf0f9-6242-4858-b434-fc8b7e89e9c4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:07.364431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b7bf0f9-6242-4858-b434-fc8b7e89e9c4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:07.365135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b7bf0f9-6242-4858-b434-fc8b7e89e9c4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:07.366264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b7bf0f9-6242-4858-b434-fc8b7e89e9c4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:07.367525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b7bf0f9-6242-4858-b434-fc8b7e89e9c4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:07.551061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8b7bf0f9-6242-4858-b434-fc8b7e89e9c4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:07.559078 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b7bf0f9-6242-4858-b434-fc8b7e89e9c4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b" status: 200 len: 1324 microversion: 2.1 time: 0.211249 Mar 12 20:54:07.559889 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1074/1842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:07 2022] GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b => generated 1324 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:07.564593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f25c457-1cf3-4aad-9b34-5252c0d23ed8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:07.565335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f25c457-1cf3-4aad-9b34-5252c0d23ed8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:07.571594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f25c457-1cf3-4aad-9b34-5252c0d23ed8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:07.572281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f25c457-1cf3-4aad-9b34-5252c0d23ed8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:07.573208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f25c457-1cf3-4aad-9b34-5252c0d23ed8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:07.573827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f25c457-1cf3-4aad-9b34-5252c0d23ed8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:07.740408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9f25c457-1cf3-4aad-9b34-5252c0d23ed8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:07.748038 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f25c457-1cf3-4aad-9b34-5252c0d23ed8 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1468 microversion: 2.1 time: 0.186813 Mar 12 20:54:07.748704 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1075/1843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:07 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1468 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:07.762933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c7ebb479-f06d-4319-8b21-e0347faeb0b3 req-2754c9a2-8fe6-46e5-865c-a71e582e0fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1757801-9401-43bb-9739-88275226163b", "tag": "fd63e40c-0216-442b-b910-13f01aad794f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:07.771773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c7ebb479-f06d-4319-8b21-e0347faeb0b3 req-2754c9a2-8fe6-46e5-865c-a71e582e0fe3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:07.772300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c7ebb479-f06d-4319-8b21-e0347faeb0b3 req-2754c9a2-8fe6-46e5-865c-a71e582e0fe3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:07.785094 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c7ebb479-f06d-4319-8b21-e0347faeb0b3 req-2754c9a2-8fe6-46e5-865c-a71e582e0fe3 service nova] Creating event network-changed:fd63e40c-0216-442b-b910-13f01aad794f for instance a1757801-9401-43bb-9739-88275226163b on nch2-master-1 Mar 12 20:54:07.790557 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c7ebb479-f06d-4319-8b21-e0347faeb0b3 req-2754c9a2-8fe6-46e5-865c-a71e582e0fe3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031269 Mar 12 20:54:07.791494 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1076/1844] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:07.797063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-103a3597-ec94-4e6b-96f3-e70515310dbd tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'create', calling method: .version_select at 0x7f6e48e151f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-759484200", "description": "tempest-description-1235673134"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:07.980749 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-103a3597-ec94-4e6b-96f3-e70515310dbd tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.188000 Mar 12 20:54:07.983220 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1077/1845] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:54:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:07.991094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-729598ea-a0a0-4938-b221-9e9afbbf5760 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:08.028840 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-729598ea-a0a0-4938-b221-9e9afbbf5760 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.044265 Mar 12 20:54:08.030155 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1078/1846] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Mar 12 20:54:07 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:08.035268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6e333b7-e82f-46e8-b68d-609330d634f0 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] Calling method '.version_select at 0x7f6e48e199d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:08.056223 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d6e333b7-e82f-46e8-b68d-609330d634f0 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] HTTP exception thrown: Image not found. Mar 12 20:54:08.056837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6e333b7-e82f-46e8-b68d-609330d634f0 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:08.057666 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d6e333b7-e82f-46e8-b68d-609330d634f0 tempest-ImagesDeleteNegativeTestJSON-353292836 tempest-ImagesDeleteNegativeTestJSON-353292836-project] 10.222.0.30 "DELETE /compute/v2.1/images/095e59ce-dcad-4865-b28f-b12402213044" status: 404 len: 62 microversion: 2.1 time: 0.026005 Mar 12 20:54:08.058406 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1079/1847] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:08 2022] DELETE /compute/v2.1/images/095e59ce-dcad-4865-b28f-b12402213044 => generated 62 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:54:08.062744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-db43cd4a-84d0-40dc-8335-2176919b210a req-1a81bbe3-7fcc-4568-8280-4a61413508d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda4959-0935-4359-bc30-ae11abe0563e", "name": "network-vif-plugged", "status": "completed", "tag": "349eb111-c3f6-4006-b907-369238df3d63"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:08.071947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-db43cd4a-84d0-40dc-8335-2176919b210a req-1a81bbe3-7fcc-4568-8280-4a61413508d8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:08.072485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-db43cd4a-84d0-40dc-8335-2176919b210a req-1a81bbe3-7fcc-4568-8280-4a61413508d8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:08.083971 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-db43cd4a-84d0-40dc-8335-2176919b210a req-1a81bbe3-7fcc-4568-8280-4a61413508d8 service nova] Creating event network-vif-plugged:349eb111-c3f6-4006-b907-369238df3d63 for instance 3cda4959-0935-4359-bc30-ae11abe0563e on nch1-master-1 Mar 12 20:54:08.088883 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-db43cd4a-84d0-40dc-8335-2176919b210a req-1a81bbe3-7fcc-4568-8280-4a61413508d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029539 Mar 12 20:54:08.089565 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1080/1848] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:08.095481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3cd2f1f4-5693-4ca1-9814-b6a37fdd34ca tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:08.096183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3cd2f1f4-5693-4ca1-9814-b6a37fdd34ca tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:08.102737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cd2f1f4-5693-4ca1-9814-b6a37fdd34ca tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:08.103197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cd2f1f4-5693-4ca1-9814-b6a37fdd34ca tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:08.104074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cd2f1f4-5693-4ca1-9814-b6a37fdd34ca tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:08.104517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cd2f1f4-5693-4ca1-9814-b6a37fdd34ca tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:08.284463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3cd2f1f4-5693-4ca1-9814-b6a37fdd34ca tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04cb45776b9475cb0364b96a8bd1e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1245d37d56c46f0b1bc0525fe98289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:08.293518 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3cd2f1f4-5693-4ca1-9814-b6a37fdd34ca tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf" status: 200 len: 1508 microversion: 2.1 time: 0.202447 Mar 12 20:54:08.294142 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1081/1849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:08 2022] GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf => generated 1508 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:08.315907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d878a97-825e-4fd2-8819-dce1d4697748 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'create', calling method: .version_select at 0x7f6e48dd9790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1067251388", "description": "tempest-description-542414632"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:08.590339 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d878a97-825e-4fd2-8819-dce1d4697748 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.280451 Mar 12 20:54:08.591173 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1082/1850] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:54:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:08.596886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2bf23f9c-2fc8-436d-ad0e-3fc8a380b35f tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:08.616702 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2bf23f9c-2fc8-436d-ad0e-3fc8a380b35f tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023534 Mar 12 20:54:08.617330 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1083/1851] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:54:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:08.622825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26c41d68-f91f-49d4-900f-eb15398c2f2d tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:08.623617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-26c41d68-f91f-49d4-900f-eb15398c2f2d tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:08.631643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26c41d68-f91f-49d4-900f-eb15398c2f2d tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:08.632579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26c41d68-f91f-49d4-900f-eb15398c2f2d tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:08.635706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26c41d68-f91f-49d4-900f-eb15398c2f2d tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:08.636810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26c41d68-f91f-49d4-900f-eb15398c2f2d tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:08.896150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-26c41d68-f91f-49d4-900f-eb15398c2f2d tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:08.905845 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-26c41d68-f91f-49d4-900f-eb15398c2f2d tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b" status: 200 len: 1324 microversion: 2.1 time: 0.287185 Mar 12 20:54:08.907331 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1084/1852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:08 2022] GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:08.914822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd6e1701-0957-45dc-9e6a-536abdc8cb3a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48dd9310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:09.194353 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd6e1701-0957-45dc-9e6a-536abdc8cb3a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1835 microversion: 2.1 time: 0.285184 Mar 12 20:54:09.194947 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1085/1853] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:54:08 2022] GET /compute/v2.1/os-security-groups => generated 1835 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:09.200392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6427920a-b5c1-486b-a08c-ada9db2af098 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:09.223541 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6427920a-b5c1-486b-a08c-ada9db2af098 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.027535 Mar 12 20:54:09.224534 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1086/1854] 10.222.0.30 () {58 vars in 1143 bytes} [Sat Mar 12 20:54:09 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:09.239548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49a84246-bff6-4cfb-825d-5831be816fdd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:09.240408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-49a84246-bff6-4cfb-825d-5831be816fdd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:09.247185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49a84246-bff6-4cfb-825d-5831be816fdd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:09.248543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49a84246-bff6-4cfb-825d-5831be816fdd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:09.250096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49a84246-bff6-4cfb-825d-5831be816fdd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:09.251194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49a84246-bff6-4cfb-825d-5831be816fdd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:09.465498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-49a84246-bff6-4cfb-825d-5831be816fdd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:09.479382 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-49a84246-bff6-4cfb-825d-5831be816fdd tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 200 len: 1468 microversion: 2.1 time: 0.253563 Mar 12 20:54:09.482837 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1087/1855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:09 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 1468 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:09.487672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4bdeb074-7fca-4382-90d2-041df5118c9b tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48d873a0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:09.830812 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4bdeb074-7fca-4382-90d2-041df5118c9b tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a3cc8b3f-054c-478e-80aa-8a0614e48a98" status: 202 len: 0 microversion: 2.1 time: 0.346844 Mar 12 20:54:09.836215 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1088/1856] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:54:09 2022] DELETE /compute/v2.1/os-security-groups/a3cc8b3f-054c-478e-80aa-8a0614e48a98 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:09.850102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ecc90b17-8588-4055-bd19-81f8d50799a0 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:09.897089 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ecc90b17-8588-4055-bd19-81f8d50799a0 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.056887 Mar 12 20:54:09.897762 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1089/1857] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:54:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:09.911571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bb9bfe6c-7578-4793-a78b-4a1d7afa4dd1 req-d826328e-8cc0-4f88-a1d6-9c2886b5b3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cda4959-0935-4359-bc30-ae11abe0563e", "name": "network-vif-deleted", "tag": "349eb111-c3f6-4006-b907-369238df3d63"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:09.927300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bb9bfe6c-7578-4793-a78b-4a1d7afa4dd1 req-d826328e-8cc0-4f88-a1d6-9c2886b5b3a8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:09.929610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bb9bfe6c-7578-4793-a78b-4a1d7afa4dd1 req-d826328e-8cc0-4f88-a1d6-9c2886b5b3a8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:09.953967 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bb9bfe6c-7578-4793-a78b-4a1d7afa4dd1 req-d826328e-8cc0-4f88-a1d6-9c2886b5b3a8 service nova] Creating event network-vif-deleted:349eb111-c3f6-4006-b907-369238df3d63 for instance 3cda4959-0935-4359-bc30-ae11abe0563e on nch1-master-1 Mar 12 20:54:09.961324 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bb9bfe6c-7578-4793-a78b-4a1d7afa4dd1 req-d826328e-8cc0-4f88-a1d6-9c2886b5b3a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060986 Mar 12 20:54:09.973274 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1090/1858] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:09.979527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a5d7f8f4-6d4c-4d2d-afd4-dbb202d7c6e1 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48e15c10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:10.008280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-a5d7f8f4-6d4c-4d2d-afd4-dbb202d7c6e1 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a3cc8b3f-054c-478e-80aa-8a0614e48a98 does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:54:10.012442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-a5d7f8f4-6d4c-4d2d-afd4-dbb202d7c6e1 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Neutron security group a3cc8b3f-054c-478e-80aa-8a0614e48a98 not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:54:10.012442 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a5d7f8f4-6d4c-4d2d-afd4-dbb202d7c6e1 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Security group a3cc8b3f-054c-478e-80aa-8a0614e48a98 does not exist Mar 12 20:54:10.012442 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-559558c8-5051-4366-b3b1-cce375dd0f41'] Mar 12 20:54:10.012442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a5d7f8f4-6d4c-4d2d-afd4-dbb202d7c6e1 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Security group a3cc8b3f-054c-478e-80aa-8a0614e48a98 does not exist Mar 12 20:54:10.012442 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-559558c8-5051-4366-b3b1-cce375dd0f41'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:10.012442 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a5d7f8f4-6d4c-4d2d-afd4-dbb202d7c6e1 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/a3cc8b3f-054c-478e-80aa-8a0614e48a98" status: 404 len: 194 microversion: 2.1 time: 0.036175 Mar 12 20:54:10.012442 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1091/1859] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 20:54:09 2022] GET /compute/v2.1/os-security-groups/a3cc8b3f-054c-478e-80aa-8a0614e48a98 => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:10.019013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a71de697-991c-4d79-86d8-110c1bf486cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc52bc9e-4229-4fc2-83e4-87c98cd08513"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:10.020445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a71de697-991c-4d79-86d8-110c1bf486cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:10.027856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a71de697-991c-4d79-86d8-110c1bf486cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:10.028622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a71de697-991c-4d79-86d8-110c1bf486cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:10.030362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a71de697-991c-4d79-86d8-110c1bf486cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:10.031026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a71de697-991c-4d79-86d8-110c1bf486cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:10.337618 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a71de697-991c-4d79-86d8-110c1bf486cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "POST /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324450 Mar 12 20:54:10.338603 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1092/1860] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 20:54:10 2022] POST /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:10.357325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-08533fb6-a75f-456d-aa70-b139a2d0712c tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:10.381610 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-08533fb6-a75f-456d-aa70-b139a2d0712c tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.041665 Mar 12 20:54:10.383257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1093/1861] 10.222.0.30 () {58 vars in 1147 bytes} [Sat Mar 12 20:54:10 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:10.397069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-614879b3-c663-48b7-bb20-48d362c9a15c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:10.398083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-614879b3-c663-48b7-bb20-48d362c9a15c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:10.405721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-614879b3-c663-48b7-bb20-48d362c9a15c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:10.406219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-614879b3-c663-48b7-bb20-48d362c9a15c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:10.407001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-614879b3-c663-48b7-bb20-48d362c9a15c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:10.407625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-614879b3-c663-48b7-bb20-48d362c9a15c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:10.584215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-614879b3-c663-48b7-bb20-48d362c9a15c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:10.593475 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-614879b3-c663-48b7-bb20-48d362c9a15c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b" status: 200 len: 1324 microversion: 2.1 time: 0.200226 Mar 12 20:54:10.594429 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1094/1862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:10 2022] GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:10.599344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c41644e7-69a8-430b-8813-9495bf927b52 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48d87670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:10.832961 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c41644e7-69a8-430b-8813-9495bf927b52 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/53757a32-4ce4-402a-ad4f-76b8d53502fd" status: 202 len: 0 microversion: 2.1 time: 0.237436 Mar 12 20:54:10.833957 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1095/1863] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:54:10 2022] DELETE /compute/v2.1/os-security-groups/53757a32-4ce4-402a-ad4f-76b8d53502fd => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:10.840627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b8e0e2b0-553f-478d-b20a-fa9306028b9d tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:10.855328 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b8e0e2b0-553f-478d-b20a-fa9306028b9d tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020114 Mar 12 20:54:10.856379 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1096/1864] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Mar 12 20:54:10 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:10.872560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8beb6b54-e691-4045-8755-e3bb585442e5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:10.874298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8beb6b54-e691-4045-8755-e3bb585442e5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 3cda4959-0935-4359-bc30-ae11abe0563e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:10.879894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8beb6b54-e691-4045-8755-e3bb585442e5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:10.880348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8beb6b54-e691-4045-8755-e3bb585442e5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:10.881123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8beb6b54-e691-4045-8755-e3bb585442e5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:10.881555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8beb6b54-e691-4045-8755-e3bb585442e5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:10.895852 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8beb6b54-e691-4045-8755-e3bb585442e5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] HTTP exception thrown: Instance 3cda4959-0935-4359-bc30-ae11abe0563e could not be found. Mar 12 20:54:10.896766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8beb6b54-e691-4045-8755-e3bb585442e5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Returning 404 to user: Instance 3cda4959-0935-4359-bc30-ae11abe0563e could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:10.897633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8beb6b54-e691-4045-8755-e3bb585442e5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e" status: 404 len: 111 microversion: 2.1 time: 0.029032 Mar 12 20:54:10.898397 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1097/1865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:10 2022] GET /compute/v2.1/servers/3cda4959-0935-4359-bc30-ae11abe0563e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:11.029761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-26053306", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:11.094557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:54:11.340617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:54:11.342998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:54:11.343551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:54:11.343986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:54:11.344404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:54:11.355210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:11.355664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:11.356461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:11.357075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:11.378560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Getting quotas for project 6d586d56dadc40a890a1d00bff31302b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:54:11.384727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Getting quotas for user 2e206de428e5474c965249c0093581bb and project 6d586d56dadc40a890a1d00bff31302b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:54:11.402361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:54:11.405592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:54:11.455568 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f40ff20d-4086-496c-a443-0180e187baaa tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556000 Mar 12 20:54:11.456494 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1098/1866] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:54:11.466180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb90c81e-24bc-4b09-9132-80a6e908839f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48d9c280>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:11.490307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-fb90c81e-24bc-4b09-9132-80a6e908839f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 53757a32-4ce4-402a-ad4f-76b8d53502fd does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:54:11.491104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-fb90c81e-24bc-4b09-9132-80a6e908839f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Neutron security group 53757a32-4ce4-402a-ad4f-76b8d53502fd not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:54:11.491641 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-fb90c81e-24bc-4b09-9132-80a6e908839f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Security group 53757a32-4ce4-402a-ad4f-76b8d53502fd does not exist Mar 12 20:54:11.491641 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-5dfd2c99-53b0-44bb-a99a-48773c268560'] Mar 12 20:54:11.492667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb90c81e-24bc-4b09-9132-80a6e908839f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Security group 53757a32-4ce4-402a-ad4f-76b8d53502fd does not exist Mar 12 20:54:11.492667 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-5dfd2c99-53b0-44bb-a99a-48773c268560'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:11.493611 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb90c81e-24bc-4b09-9132-80a6e908839f tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/53757a32-4ce4-402a-ad4f-76b8d53502fd" status: 404 len: 194 microversion: 2.1 time: 0.036119 Mar 12 20:54:11.494194 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1099/1867] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 20:54:11 2022] GET /compute/v2.1/os-security-groups/53757a32-4ce4-402a-ad4f-76b8d53502fd => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:11.505269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-78571965-7cd0-44de-a882-78cdf9347748 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:11.519299 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-78571965-7cd0-44de-a882-78cdf9347748 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019698 Mar 12 20:54:11.521054 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1100/1868] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:54:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:11.526318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49273c2f-8710-4e84-aa94-4ac7c2cb105e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:11.527024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-49273c2f-8710-4e84-aa94-4ac7c2cb105e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:11.533873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49273c2f-8710-4e84-aa94-4ac7c2cb105e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:11.534404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49273c2f-8710-4e84-aa94-4ac7c2cb105e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:11.535262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49273c2f-8710-4e84-aa94-4ac7c2cb105e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:11.536081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49273c2f-8710-4e84-aa94-4ac7c2cb105e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:11.561808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-49273c2f-8710-4e84-aa94-4ac7c2cb105e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:54:11.665030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-49273c2f-8710-4e84-aa94-4ac7c2cb105e tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 204 len: 0 microversion: 2.1 time: 0.142303 Mar 12 20:54:11.666484 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1101/1869] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:54:11 2022] DELETE /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:54:11.675574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-183c8627-bb3d-4ebe-8691-8789d1f7b8da tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:11.676289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-183c8627-bb3d-4ebe-8691-8789d1f7b8da tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:11.737614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-183c8627-bb3d-4ebe-8691-8789d1f7b8da tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e206de428e5474c965249c0093581bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d586d56dadc40a890a1d00bff31302b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:11.746537 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-183c8627-bb3d-4ebe-8691-8789d1f7b8da tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e" status: 200 len: 1214 microversion: 2.1 time: 0.074630 Mar 12 20:54:11.756211 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1102/1870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:11 2022] GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:11.756211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-edea6a80-26cb-4804-a0d7-25ce6933a7e3 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48d990d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:11.981342 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-edea6a80-26cb-4804-a0d7-25ce6933a7e3 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/1dce0245-049d-4a48-bd74-e2f4cfb13794" status: 202 len: 0 microversion: 2.1 time: 0.232491 Mar 12 20:54:11.982203 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1103/1871] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:54:11 2022] DELETE /compute/v2.1/os-security-groups/1dce0245-049d-4a48-bd74-e2f4cfb13794 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:11.990804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-700fc8fc-c539-4b6c-9ded-7efb0c15d41c tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:12.031135 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-700fc8fc-c539-4b6c-9ded-7efb0c15d41c tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.047656 Mar 12 20:54:12.032133 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1104/1872] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:54:11 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:12.039870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cf7adcf6-4047-4c2b-959f-ce44c3417407 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:12.040863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cf7adcf6-4047-4c2b-959f-ce44c3417407 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:12.048905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf7adcf6-4047-4c2b-959f-ce44c3417407 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:12.049439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf7adcf6-4047-4c2b-959f-ce44c3417407 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:12.050315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf7adcf6-4047-4c2b-959f-ce44c3417407 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:12.050758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf7adcf6-4047-4c2b-959f-ce44c3417407 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:12.202777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cf7adcf6-4047-4c2b-959f-ce44c3417407 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:12.212491 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cf7adcf6-4047-4c2b-959f-ce44c3417407 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b" status: 200 len: 1324 microversion: 2.1 time: 0.179173 Mar 12 20:54:12.213068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1105/1873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:12 2022] GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b => generated 1324 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:12.218210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a58e294c-816f-476a-95aa-435420e40a05 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:12.218818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a58e294c-816f-476a-95aa-435420e40a05 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:12.228906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a58e294c-816f-476a-95aa-435420e40a05 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:12.229520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a58e294c-816f-476a-95aa-435420e40a05 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:12.230351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a58e294c-816f-476a-95aa-435420e40a05 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:12.230787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a58e294c-816f-476a-95aa-435420e40a05 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:12.391670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a58e294c-816f-476a-95aa-435420e40a05 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:12.402335 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a58e294c-816f-476a-95aa-435420e40a05 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1535 microversion: 2.1 time: 0.187791 Mar 12 20:54:12.403860 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1106/1874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:12 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1535 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:12.416474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b0b49f7-12b0-4e3b-bb57-148130cb865a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48d9cd30>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:12.442368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-4b0b49f7-12b0-4e3b-bb57-148130cb865a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1dce0245-049d-4a48-bd74-e2f4cfb13794 does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:54:12.443258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-4b0b49f7-12b0-4e3b-bb57-148130cb865a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Neutron security group 1dce0245-049d-4a48-bd74-e2f4cfb13794 not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:54:12.443798 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-4b0b49f7-12b0-4e3b-bb57-148130cb865a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Security group 1dce0245-049d-4a48-bd74-e2f4cfb13794 does not exist Mar 12 20:54:12.443798 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-97b89d00-406e-4ca1-83b0-cef9105c4ff5'] Mar 12 20:54:12.444395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b0b49f7-12b0-4e3b-bb57-148130cb865a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Security group 1dce0245-049d-4a48-bd74-e2f4cfb13794 does not exist Mar 12 20:54:12.444395 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-97b89d00-406e-4ca1-83b0-cef9105c4ff5'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:12.445237 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b0b49f7-12b0-4e3b-bb57-148130cb865a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/1dce0245-049d-4a48-bd74-e2f4cfb13794" status: 404 len: 194 microversion: 2.1 time: 0.039668 Mar 12 20:54:12.445821 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1107/1875] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 20:54:12 2022] GET /compute/v2.1/os-security-groups/1dce0245-049d-4a48-bd74-e2f4cfb13794 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:12.450231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d95a66c7-73bd-4e74-8113-7e0cf9604d79 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:12.469434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d95a66c7-73bd-4e74-8113-7e0cf9604d79 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022561 Mar 12 20:54:12.470388 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1108/1876] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:54:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:12.474810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-db98bb0c-3f22-4b78-b2a4-e1320cdfdde5 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48e15c10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:12.671245 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-db98bb0c-3f22-4b78-b2a4-e1320cdfdde5 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.199441 Mar 12 20:54:12.672924 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1109/1877] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:54:12 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:12.678453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0fe73b98-1091-4e5a-90db-d2b901a4e386 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:12.691435 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0fe73b98-1091-4e5a-90db-d2b901a4e386 tempest-FlavorsV2TestJSON-462583942 tempest-FlavorsV2TestJSON-462583942-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016509 Mar 12 20:54:12.693486 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1110/1878] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:54:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:12.698288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5758bf9-5b9c-45e2-8cb8-c31775d2fac0 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'create', calling method: .version_select at 0x7f6e48d87dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-272538647", "description": "tempest-description-1084271658"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:12.918452 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5758bf9-5b9c-45e2-8cb8-c31775d2fac0 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.223500 Mar 12 20:54:12.919024 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1111/1879] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:54:12 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:12.924797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a43bbda2-0112-48f7-9a7c-9a6653f992e1 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:12.927726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a43bbda2-0112-48f7-9a7c-9a6653f992e1 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:12.937688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a43bbda2-0112-48f7-9a7c-9a6653f992e1 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:12.938172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a43bbda2-0112-48f7-9a7c-9a6653f992e1 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:12.939296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a43bbda2-0112-48f7-9a7c-9a6653f992e1 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:12.940090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a43bbda2-0112-48f7-9a7c-9a6653f992e1 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:13.040386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a43bbda2-0112-48f7-9a7c-9a6653f992e1 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e206de428e5474c965249c0093581bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d586d56dadc40a890a1d00bff31302b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:13.052586 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a43bbda2-0112-48f7-9a7c-9a6653f992e1 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e" status: 200 len: 1284 microversion: 2.1 time: 0.131677 Mar 12 20:54:13.053179 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1112/1880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:12 2022] GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e => generated 1284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:13.058225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c6a41b54-970d-41a3-8549-eb754c48fd1c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'create', calling method: .version_select at 0x7f6e48d99670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1892052874", "description": "tempest-description-153123400"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:13.269525 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c6a41b54-970d-41a3-8549-eb754c48fd1c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.214371 Mar 12 20:54:13.270316 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1113/1881] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:54:13 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:13.275533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35126873-76a2-49eb-a0bc-f0b8f44716f9 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:13.276353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-35126873-76a2-49eb-a0bc-f0b8f44716f9 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:13.287307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35126873-76a2-49eb-a0bc-f0b8f44716f9 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:13.287769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35126873-76a2-49eb-a0bc-f0b8f44716f9 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:13.293619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35126873-76a2-49eb-a0bc-f0b8f44716f9 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:13.294891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35126873-76a2-49eb-a0bc-f0b8f44716f9 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:13.932274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-35126873-76a2-49eb-a0bc-f0b8f44716f9 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:13.941744 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-35126873-76a2-49eb-a0bc-f0b8f44716f9 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b" status: 200 len: 1324 microversion: 2.1 time: 0.670354 Mar 12 20:54:13.942341 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1114/1882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:13 2022] GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b => generated 1324 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:13.949862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-57756435-e42e-4db5-8e78-787384ad89f5 req-00ef041b-815c-4299-a3cd-49632d8dac20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1757801-9401-43bb-9739-88275226163b", "name": "network-vif-plugged", "status": "completed", "tag": "fd63e40c-0216-442b-b910-13f01aad794f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:13.959691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-57756435-e42e-4db5-8e78-787384ad89f5 req-00ef041b-815c-4299-a3cd-49632d8dac20 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:13.960368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-57756435-e42e-4db5-8e78-787384ad89f5 req-00ef041b-815c-4299-a3cd-49632d8dac20 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:13.974528 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-57756435-e42e-4db5-8e78-787384ad89f5 req-00ef041b-815c-4299-a3cd-49632d8dac20 service nova] Creating event network-vif-plugged:fd63e40c-0216-442b-b910-13f01aad794f for instance a1757801-9401-43bb-9739-88275226163b on nch2-master-1 Mar 12 20:54:13.983909 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-57756435-e42e-4db5-8e78-787384ad89f5 req-00ef041b-815c-4299-a3cd-49632d8dac20 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039593 Mar 12 20:54:13.984519 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1115/1883] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:13.992899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96c14639-b944-493a-ab45-d45440b03c7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:13.993618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96c14639-b944-493a-ab45-d45440b03c7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:14.004811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96c14639-b944-493a-ab45-d45440b03c7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:14.005540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96c14639-b944-493a-ab45-d45440b03c7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:14.006599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96c14639-b944-493a-ab45-d45440b03c7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:14.007253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96c14639-b944-493a-ab45-d45440b03c7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:14.284900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96c14639-b944-493a-ab45-d45440b03c7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:14.294101 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96c14639-b944-493a-ab45-d45440b03c7a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 200 len: 1535 microversion: 2.1 time: 0.307619 Mar 12 20:54:14.294719 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1116/1884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:13 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 1535 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:14.299877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1208163683", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "99d8e1be-c782-4fb8-b174-ff83703e7c7e"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:14.360809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] validate_networks() for [('99d8e1be-c782-4fb8-b174-ff83703e7c7e', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:54:15.054144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:54:15.054881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:54:15.055137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:54:15.055803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:54:15.056334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:54:15.072291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:15.072905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:15.073740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:15.074211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:15.098272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Getting quotas for project 83c8d35436d54ee4887f69c41ec160f8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:54:15.104345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Getting quotas for user 7b362003f1aa4db6a6c1e57e90c69ef2 and project 83c8d35436d54ee4887f69c41ec160f8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:54:15.131635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:54:15.134350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:54:15.233292 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86a368a6-4ecc-4c4a-8784-dd87545e7a32 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.936350 Mar 12 20:54:15.238083 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1117/1885] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:54:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:54:15.595559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-402b26a1-c405-4831-857b-3bb8ce63e073 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "011b8fac-fe31-40c9-95c2-6da9fc6a02fc"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:15.597124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-402b26a1-c405-4831-857b-3bb8ce63e073 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:15.610198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-402b26a1-c405-4831-857b-3bb8ce63e073 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:15.615028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-402b26a1-c405-4831-857b-3bb8ce63e073 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:15.616442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-402b26a1-c405-4831-857b-3bb8ce63e073 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:15.617128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-402b26a1-c405-4831-857b-3bb8ce63e073 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:15.754049 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-402b26a1-c405-4831-857b-3bb8ce63e073 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] HTTP exception thrown: Volume 011b8fac-fe31-40c9-95c2-6da9fc6a02fc could not be found. Mar 12 20:54:15.754728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-402b26a1-c405-4831-857b-3bb8ce63e073 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] Returning 400 to user: Volume 011b8fac-fe31-40c9-95c2-6da9fc6a02fc could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:15.755576 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-402b26a1-c405-4831-857b-3bb8ce63e073 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf/os-volume_attachments/fc52bc9e-4229-4fc2-83e4-87c98cd08513" status: 400 len: 107 microversion: 2.1 time: 0.516196 Mar 12 20:54:15.756254 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1118/1886] 10.222.0.30 () {60 vars in 1432 bytes} [Sat Mar 12 20:54:15 2022] PUT /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf/os-volume_attachments/fc52bc9e-4229-4fc2-83e4-87c98cd08513 => generated 107 bytes in 517 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:54:15.977723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1710045580", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:16.034459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:54:16.327490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:54:16.328085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:54:16.328597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:54:16.329277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:54:16.329967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:54:16.341001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:16.342151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:16.343720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:16.344561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:16.373170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Getting quotas for project 3f2df40602ee43d4a6ecbf8147e170d0. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:54:16.378649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Getting quotas for user 2f02e3887cad43d1a9e95f876aff1a5f and project 3f2df40602ee43d4a6ecbf8147e170d0. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:54:16.391596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:54:16.394013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:54:16.439958 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea1b0ea8-95e6-4267-ba98-d6020a2b499e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681257 Mar 12 20:54:16.440730 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1119/1887] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:54:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:54:16.446016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9001fc12-cbb9-4f32-aea9-0357b404d105 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:16.447077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9001fc12-cbb9-4f32-aea9-0357b404d105 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:16.464748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9001fc12-cbb9-4f32-aea9-0357b404d105 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:16.467706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9001fc12-cbb9-4f32-aea9-0357b404d105 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:16.473205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9001fc12-cbb9-4f32-aea9-0357b404d105 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:16.473897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9001fc12-cbb9-4f32-aea9-0357b404d105 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:16.674468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9001fc12-cbb9-4f32-aea9-0357b404d105 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e206de428e5474c965249c0093581bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d586d56dadc40a890a1d00bff31302b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:16.683689 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9001fc12-cbb9-4f32-aea9-0357b404d105 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e" status: 200 len: 1314 microversion: 2.1 time: 0.241546 Mar 12 20:54:16.684606 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1120/1888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:16 2022] GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:16.689844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fc01f437-fefa-49ad-924f-258143941108 req-bacd257b-5b0d-4871-ba8c-7d58dc5f2f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e67993b-4604-4f37-9543-3dc09be802e5", "name": "network-vif-deleted", "tag": "3abbe775-9508-422a-826d-d481a507a318"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:16.698557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fc01f437-fefa-49ad-924f-258143941108 req-bacd257b-5b0d-4871-ba8c-7d58dc5f2f6d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:16.699136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fc01f437-fefa-49ad-924f-258143941108 req-bacd257b-5b0d-4871-ba8c-7d58dc5f2f6d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:16.712981 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fc01f437-fefa-49ad-924f-258143941108 req-bacd257b-5b0d-4871-ba8c-7d58dc5f2f6d service nova] Creating event network-vif-deleted:3abbe775-9508-422a-826d-d481a507a318 for instance 8e67993b-4604-4f37-9543-3dc09be802e5 on nch1-master-1 Mar 12 20:54:16.717151 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fc01f437-fefa-49ad-924f-258143941108 req-bacd257b-5b0d-4871-ba8c-7d58dc5f2f6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030698 Mar 12 20:54:16.717865 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1121/1889] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:16.724904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-08aa52a5-d41f-4ef1-a6bf-b76f0c4c9790 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:16.726126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-08aa52a5-d41f-4ef1-a6bf-b76f0c4c9790 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:16.734479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08aa52a5-d41f-4ef1-a6bf-b76f0c4c9790 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:16.735162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08aa52a5-d41f-4ef1-a6bf-b76f0c4c9790 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:16.736133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08aa52a5-d41f-4ef1-a6bf-b76f0c4c9790 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:16.736746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08aa52a5-d41f-4ef1-a6bf-b76f0c4c9790 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:16.988883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-08aa52a5-d41f-4ef1-a6bf-b76f0c4c9790 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:17.000188 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-08aa52a5-d41f-4ef1-a6bf-b76f0c4c9790 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b" status: 200 len: 1520 microversion: 2.1 time: 0.280082 Mar 12 20:54:17.014254 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1122/1890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:16 2022] GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:17.019844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-38e1ee7a-c764-4d6f-ba2a-df0db472d119 req-ce6834ee-f0bd-4447-a706-faa387b08e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38ff9d8c-f4bd-442a-93c8-a913aefe358e", "tag": "8d01be63-72d4-4bdb-8e39-c0dba8e470f4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:17.030445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-38e1ee7a-c764-4d6f-ba2a-df0db472d119 req-ce6834ee-f0bd-4447-a706-faa387b08e2d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:17.031625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-38e1ee7a-c764-4d6f-ba2a-df0db472d119 req-ce6834ee-f0bd-4447-a706-faa387b08e2d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:17.044504 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-38e1ee7a-c764-4d6f-ba2a-df0db472d119 req-ce6834ee-f0bd-4447-a706-faa387b08e2d service nova] Creating event network-changed:8d01be63-72d4-4bdb-8e39-c0dba8e470f4 for instance 38ff9d8c-f4bd-442a-93c8-a913aefe358e on nch1-master-1 Mar 12 20:54:17.050671 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-38e1ee7a-c764-4d6f-ba2a-df0db472d119 req-ce6834ee-f0bd-4447-a706-faa387b08e2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034288 Mar 12 20:54:17.052147 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1123/1891] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:17.074409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec63e6ce-c40c-44f1-a7c8-7f3f059fad1d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:17.077052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec63e6ce-c40c-44f1-a7c8-7f3f059fad1d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:17.090165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec63e6ce-c40c-44f1-a7c8-7f3f059fad1d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:17.090723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec63e6ce-c40c-44f1-a7c8-7f3f059fad1d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:17.092187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec63e6ce-c40c-44f1-a7c8-7f3f059fad1d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:17.092877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec63e6ce-c40c-44f1-a7c8-7f3f059fad1d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:17.172370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ec63e6ce-c40c-44f1-a7c8-7f3f059fad1d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:17.179988 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec63e6ce-c40c-44f1-a7c8-7f3f059fad1d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5" status: 200 len: 1274 microversion: 2.1 time: 0.126197 Mar 12 20:54:17.180925 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1124/1892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:17 2022] GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5 => generated 1274 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:17.186348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8690f95-d631-4780-988d-d9a18acf90f4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:17.187155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8690f95-d631-4780-988d-d9a18acf90f4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 8e67993b-4604-4f37-9543-3dc09be802e5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:17.197469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8690f95-d631-4780-988d-d9a18acf90f4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:17.198071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8690f95-d631-4780-988d-d9a18acf90f4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:17.198977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8690f95-d631-4780-988d-d9a18acf90f4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:17.199486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8690f95-d631-4780-988d-d9a18acf90f4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:17.216068 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c8690f95-d631-4780-988d-d9a18acf90f4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] HTTP exception thrown: Instance 8e67993b-4604-4f37-9543-3dc09be802e5 could not be found. Mar 12 20:54:17.216791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8690f95-d631-4780-988d-d9a18acf90f4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Returning 404 to user: Instance 8e67993b-4604-4f37-9543-3dc09be802e5 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:17.217738 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8690f95-d631-4780-988d-d9a18acf90f4 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5" status: 404 len: 111 microversion: 2.1 time: 0.035590 Mar 12 20:54:17.218386 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1125/1893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:17 2022] GET /compute/v2.1/servers/8e67993b-4604-4f37-9543-3dc09be802e5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:17.227946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3e71f587-bc7e-4ff4-a00e-2d76f97ef509 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:17.228723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3e71f587-bc7e-4ff4-a00e-2d76f97ef509 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:17.239819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e71f587-bc7e-4ff4-a00e-2d76f97ef509 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:17.240326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e71f587-bc7e-4ff4-a00e-2d76f97ef509 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:17.241225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e71f587-bc7e-4ff4-a00e-2d76f97ef509 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:17.241667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e71f587-bc7e-4ff4-a00e-2d76f97ef509 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:17.338325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-3e71f587-bc7e-4ff4-a00e-2d76f97ef509 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lazy-loading 'services' on Instance uuid f620d961-9ec1-46e4-967f-a10a457951cf {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:54:17.424905 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3e71f587-bc7e-4ff4-a00e-2d76f97ef509 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf/os-volume_attachments/fc52bc9e-4229-4fc2-83e4-87c98cd08513" status: 202 len: 0 microversion: 2.1 time: 0.205183 Mar 12 20:54:17.425666 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1126/1894] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 20:54:17 2022] DELETE /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf/os-volume_attachments/fc52bc9e-4229-4fc2-83e4-87c98cd08513 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:17.433225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1717401511", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:17.503521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:54:17.725472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:54:17.725986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:54:17.726494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:54:17.726904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:54:17.727324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:54:17.741654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:17.742133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:17.742932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:17.743367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:17.764452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Getting quotas for project 3f2df40602ee43d4a6ecbf8147e170d0. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:54:17.770045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Getting quotas for user 2f02e3887cad43d1a9e95f876aff1a5f and project 3f2df40602ee43d4a6ecbf8147e170d0. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:54:17.783594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:54:17.786402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 454e487a-2c6b-4bb7-8957-03e591b61651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:54:17.875024 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-05b48b8b-fd7b-4b03-9560-6477ea610df6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.447619 Mar 12 20:54:17.876036 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1127/1895] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:54:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:54:17.886867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7ad9d674-ede9-40f0-a965-3f618e6e7fb8 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Action: 'create', calling method: .version_select at 0x7f6e48d4ba60>, body: {"pool": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:20.082282 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7ad9d674-ede9-40f0-a965-3f618e6e7fb8 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.198665 Mar 12 20:54:20.083005 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1128/1896] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Mar 12 20:54:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:20.188968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-914666768", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "7c321848-4ca1-49a4-9c10-c7b92ae09b50"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:20.244970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] validate_networks() for [('7c321848-4ca1-49a4-9c10-c7b92ae09b50', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:54:21.106731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:54:21.107483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:54:21.107736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:54:21.108154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:54:21.108573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:54:21.117541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:21.118029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:21.118836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:21.119277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:21.146906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Getting quotas for project bfa8b1575cea45b4945cd3984f6dbf64. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:54:21.152443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Getting quotas for user a0970c359e4146d9bc4b031060ec97ca and project bfa8b1575cea45b4945cd3984f6dbf64. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:54:21.176516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:54:21.179287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:54:21.233515 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8e794a92-b150-4db3-955e-f6b20a2f2f32 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.149173 Mar 12 20:54:21.235388 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1129/1897] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:54:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:54:21.246454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0b8d5c48-8570-4b24-aeae-9450a5cbe6f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:21.246454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0b8d5c48-8570-4b24-aeae-9450a5cbe6f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:21.254490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b8d5c48-8570-4b24-aeae-9450a5cbe6f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:21.255194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b8d5c48-8570-4b24-aeae-9450a5cbe6f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:21.256446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b8d5c48-8570-4b24-aeae-9450a5cbe6f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:21.257511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b8d5c48-8570-4b24-aeae-9450a5cbe6f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:21.308084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0b8d5c48-8570-4b24-aeae-9450a5cbe6f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:54:21.444819 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0b8d5c48-8570-4b24-aeae-9450a5cbe6f0 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 204 len: 0 microversion: 2.1 time: 0.207909 Mar 12 20:54:21.447512 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1130/1898] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:54:21 2022] DELETE /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:54:21.458427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dffc4588-8c75-4d50-b0b7-9e2499fe2ac4 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:21.459738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dffc4588-8c75-4d50-b0b7-9e2499fe2ac4 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:21.467136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dffc4588-8c75-4d50-b0b7-9e2499fe2ac4 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:21.468396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dffc4588-8c75-4d50-b0b7-9e2499fe2ac4 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:21.470094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dffc4588-8c75-4d50-b0b7-9e2499fe2ac4 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:21.471373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dffc4588-8c75-4d50-b0b7-9e2499fe2ac4 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:21.516428 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dffc4588-8c75-4d50-b0b7-9e2499fe2ac4 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065030 Mar 12 20:54:21.517787 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1131/1899] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 20:54:21 2022] GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:54:21.529548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f322dda-9834-4817-ac3b-0a6ea8bbc030 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:21.530394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f322dda-9834-4817-ac3b-0a6ea8bbc030 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:21.538975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f322dda-9834-4817-ac3b-0a6ea8bbc030 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:21.539652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f322dda-9834-4817-ac3b-0a6ea8bbc030 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:21.540637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f322dda-9834-4817-ac3b-0a6ea8bbc030 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:21.541687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f322dda-9834-4817-ac3b-0a6ea8bbc030 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:21.772635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9f322dda-9834-4817-ac3b-0a6ea8bbc030 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e206de428e5474c965249c0093581bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d586d56dadc40a890a1d00bff31302b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:21.783237 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f322dda-9834-4817-ac3b-0a6ea8bbc030 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e" status: 200 len: 1314 microversion: 2.1 time: 0.259274 Mar 12 20:54:21.784096 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1132/1900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:21 2022] GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:21.789361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94dda7c5-7e57-46ef-94d1-a08123443f09 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:21.790244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94dda7c5-7e57-46ef-94d1-a08123443f09 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 454e487a-2c6b-4bb7-8957-03e591b61651] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:21.798136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94dda7c5-7e57-46ef-94d1-a08123443f09 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:21.798859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94dda7c5-7e57-46ef-94d1-a08123443f09 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:21.800059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94dda7c5-7e57-46ef-94d1-a08123443f09 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:21.800819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94dda7c5-7e57-46ef-94d1-a08123443f09 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:22.003587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-94dda7c5-7e57-46ef-94d1-a08123443f09 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:22.011355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94dda7c5-7e57-46ef-94d1-a08123443f09 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651" status: 200 len: 1314 microversion: 2.1 time: 0.226255 Mar 12 20:54:22.011939 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1133/1901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:21 2022] GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:22.017052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b9b074ae-51b9-4eb4-adcc-3140e4665db4 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:22.017695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b9b074ae-51b9-4eb4-adcc-3140e4665db4 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:22.031939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9b074ae-51b9-4eb4-adcc-3140e4665db4 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:22.032472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9b074ae-51b9-4eb4-adcc-3140e4665db4 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:22.033610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9b074ae-51b9-4eb4-adcc-3140e4665db4 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:22.034204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9b074ae-51b9-4eb4-adcc-3140e4665db4 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:22.188287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b9b074ae-51b9-4eb4-adcc-3140e4665db4 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:22.196545 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b9b074ae-51b9-4eb4-adcc-3140e4665db4 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5" status: 200 len: 1316 microversion: 2.1 time: 0.183537 Mar 12 20:54:22.197126 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1134/1902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:22 2022] GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5 => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:22.202193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-43009823-0c2a-4cc7-8199-6b19da5ac48b req-25c90bd7-a34f-41e5-a131-63ea00848eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9c4738-03fa-4cbc-a9a2-0648450befb5", "tag": "cdb1e534-85b7-4963-aa13-4a5219d8ce83"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:22.209991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-43009823-0c2a-4cc7-8199-6b19da5ac48b req-25c90bd7-a34f-41e5-a131-63ea00848eea service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:22.210443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-43009823-0c2a-4cc7-8199-6b19da5ac48b req-25c90bd7-a34f-41e5-a131-63ea00848eea service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:22.222448 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-43009823-0c2a-4cc7-8199-6b19da5ac48b req-25c90bd7-a34f-41e5-a131-63ea00848eea service nova] Creating event network-changed:cdb1e534-85b7-4963-aa13-4a5219d8ce83 for instance da9c4738-03fa-4cbc-a9a2-0648450befb5 on nch2-master-1 Mar 12 20:54:22.227220 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-43009823-0c2a-4cc7-8199-6b19da5ac48b req-25c90bd7-a34f-41e5-a131-63ea00848eea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029025 Mar 12 20:54:22.227915 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1135/1903] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:22.233437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1267071078", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "34a96fe2-32a3-4bf3-8c1e-f56f90cdec96"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:22.285616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] validate_networks() for [('34a96fe2-32a3-4bf3-8c1e-f56f90cdec96', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:54:22.805376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:54:22.805866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:54:22.806417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:54:22.806840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:54:22.807259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:54:22.821543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:22.822157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:22.823234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:22.824486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:22.843800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Getting quotas for project bea8388cb0554c74b7db0bedfb0ca482. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:54:22.849223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Getting quotas for user 3d139f357097469880d0cc2631ee8459 and project bea8388cb0554c74b7db0bedfb0ca482. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:54:22.862461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:54:22.865501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:54:22.911298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e678a3bf-0228-425c-8737-07a4d5b3ed2e tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682060 Mar 12 20:54:22.912273 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1136/1904] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:54:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:54:22.920918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b3528422-f363-4a41-911b-6158490581f6 req-e586796f-3a42-4c2e-9ea3-f4dda6986047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb11b2e1-92f9-4b42-8158-fd559447adc2", "tag": "4f8f4364-9747-4729-b9eb-834dd3e8a86a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:22.930026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b3528422-f363-4a41-911b-6158490581f6 req-e586796f-3a42-4c2e-9ea3-f4dda6986047 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:22.930475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b3528422-f363-4a41-911b-6158490581f6 req-e586796f-3a42-4c2e-9ea3-f4dda6986047 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:22.941826 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b3528422-f363-4a41-911b-6158490581f6 req-e586796f-3a42-4c2e-9ea3-f4dda6986047 service nova] Creating event network-changed:4f8f4364-9747-4729-b9eb-834dd3e8a86a for instance eb11b2e1-92f9-4b42-8158-fd559447adc2 on nch1-master-1 Mar 12 20:54:22.946987 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b3528422-f363-4a41-911b-6158490581f6 req-e586796f-3a42-4c2e-9ea3-f4dda6986047 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033604 Mar 12 20:54:22.947585 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1137/1905] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:22.952664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-efe88cef-9f9e-4ec0-98f4-27595b034282 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:22.953343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-efe88cef-9f9e-4ec0-98f4-27595b034282 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:22.959574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efe88cef-9f9e-4ec0-98f4-27595b034282 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:22.960028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efe88cef-9f9e-4ec0-98f4-27595b034282 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:22.960791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efe88cef-9f9e-4ec0-98f4-27595b034282 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:22.961232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efe88cef-9f9e-4ec0-98f4-27595b034282 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:23.040000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-efe88cef-9f9e-4ec0-98f4-27595b034282 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:23.049080 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-efe88cef-9f9e-4ec0-98f4-27595b034282 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1282 microversion: 2.1 time: 0.100214 Mar 12 20:54:23.049857 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1138/1906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:22 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1282 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:23.058764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d318fb5c-e217-4d0c-ad4b-64a7942ee2f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:23.059385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d318fb5c-e217-4d0c-ad4b-64a7942ee2f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:23.066707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d318fb5c-e217-4d0c-ad4b-64a7942ee2f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:23.067161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d318fb5c-e217-4d0c-ad4b-64a7942ee2f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:23.068215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d318fb5c-e217-4d0c-ad4b-64a7942ee2f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:23.068642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d318fb5c-e217-4d0c-ad4b-64a7942ee2f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:23.336368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d318fb5c-e217-4d0c-ad4b-64a7942ee2f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:23.346942 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d318fb5c-e217-4d0c-ad4b-64a7942ee2f9 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1468 microversion: 2.1 time: 0.295504 Mar 12 20:54:23.349292 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1139/1907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:23 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1468 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:23.363064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-aff7f8ea-6ed9-4682-9578-a3dca2f57f01 req-0b432b46-77ac-4f33-b6c9-468a64e73e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ff9d8c-f4bd-442a-93c8-a913aefe358e", "name": "network-vif-plugged", "status": "completed", "tag": "8d01be63-72d4-4bdb-8e39-c0dba8e470f4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:23.381559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aff7f8ea-6ed9-4682-9578-a3dca2f57f01 req-0b432b46-77ac-4f33-b6c9-468a64e73e66 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:23.382232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aff7f8ea-6ed9-4682-9578-a3dca2f57f01 req-0b432b46-77ac-4f33-b6c9-468a64e73e66 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:23.419307 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-aff7f8ea-6ed9-4682-9578-a3dca2f57f01 req-0b432b46-77ac-4f33-b6c9-468a64e73e66 service nova] Creating event network-vif-plugged:8d01be63-72d4-4bdb-8e39-c0dba8e470f4 for instance 38ff9d8c-f4bd-442a-93c8-a913aefe358e on nch1-master-1 Mar 12 20:54:23.428308 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-aff7f8ea-6ed9-4682-9578-a3dca2f57f01 req-0b432b46-77ac-4f33-b6c9-468a64e73e66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077445 Mar 12 20:54:23.431176 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1140/1908] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:23.444958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a576b5b8-b690-4a40-82c3-363b391d0d2d tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:23.447043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a576b5b8-b690-4a40-82c3-363b391d0d2d tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:23.459676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a576b5b8-b690-4a40-82c3-363b391d0d2d tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:23.461596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a576b5b8-b690-4a40-82c3-363b391d0d2d tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:23.464396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a576b5b8-b690-4a40-82c3-363b391d0d2d tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:23.465447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a576b5b8-b690-4a40-82c3-363b391d0d2d tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:23.808564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a576b5b8-b690-4a40-82c3-363b391d0d2d tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e206de428e5474c965249c0093581bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d586d56dadc40a890a1d00bff31302b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:23.816332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a576b5b8-b690-4a40-82c3-363b391d0d2d tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e" status: 200 len: 1314 microversion: 2.1 time: 0.382129 Mar 12 20:54:23.820311 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1141/1909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:23 2022] GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:23.825227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-775ec1bf-8527-4235-b04a-d970cca70833 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:23.828487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-775ec1bf-8527-4235-b04a-d970cca70833 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:23.837668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-775ec1bf-8527-4235-b04a-d970cca70833 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:23.844431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-775ec1bf-8527-4235-b04a-d970cca70833 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:23.845427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-775ec1bf-8527-4235-b04a-d970cca70833 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:23.847753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-775ec1bf-8527-4235-b04a-d970cca70833 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:23.943766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-775ec1bf-8527-4235-b04a-d970cca70833 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:23.952408 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-775ec1bf-8527-4235-b04a-d970cca70833 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182" status: 200 len: 1276 microversion: 2.1 time: 0.131022 Mar 12 20:54:23.953617 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1142/1910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:23 2022] GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182 => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:23.958311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-38730c78-6404-4de4-a4ff-d89f5eee06e5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:23.959109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-38730c78-6404-4de4-a4ff-d89f5eee06e5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 454e487a-2c6b-4bb7-8957-03e591b61651] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:23.965317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38730c78-6404-4de4-a4ff-d89f5eee06e5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:23.966470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38730c78-6404-4de4-a4ff-d89f5eee06e5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:23.967479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38730c78-6404-4de4-a4ff-d89f5eee06e5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:23.967907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38730c78-6404-4de4-a4ff-d89f5eee06e5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:24.249943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-38730c78-6404-4de4-a4ff-d89f5eee06e5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:24.263820 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-38730c78-6404-4de4-a4ff-d89f5eee06e5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651" status: 200 len: 1314 microversion: 2.1 time: 0.305981 Mar 12 20:54:24.267974 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1143/1911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:23 2022] GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:24.285895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1c7c70a-bb71-41e7-ae50-596cfc3bc772 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0e450d0f-5dac-431a-b92e-5d59fbc5e32a"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:24.290953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f1c7c70a-bb71-41e7-ae50-596cfc3bc772 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:24.303360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1c7c70a-bb71-41e7-ae50-596cfc3bc772 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:24.304065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1c7c70a-bb71-41e7-ae50-596cfc3bc772 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:24.305021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1c7c70a-bb71-41e7-ae50-596cfc3bc772 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:24.305636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1c7c70a-bb71-41e7-ae50-596cfc3bc772 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:24.402722 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f1c7c70a-bb71-41e7-ae50-596cfc3bc772 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] HTTP exception thrown: Volume 258cba4c-44c9-427e-91d3-68454c994700 could not be found. Mar 12 20:54:24.404137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1c7c70a-bb71-41e7-ae50-596cfc3bc772 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] Returning 404 to user: Volume 258cba4c-44c9-427e-91d3-68454c994700 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:24.405540 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1c7c70a-bb71-41e7-ae50-596cfc3bc772 tempest-VolumesAdminNegativeTest-234195279 tempest-VolumesAdminNegativeTest-234195279-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf/os-volume_attachments/258cba4c-44c9-427e-91d3-68454c994700" status: 404 len: 109 microversion: 2.1 time: 0.136104 Mar 12 20:54:24.406317 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1144/1912] 10.222.0.30 () {60 vars in 1432 bytes} [Sat Mar 12 20:54:24 2022] PUT /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf/os-volume_attachments/258cba4c-44c9-427e-91d3-68454c994700 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:24.416665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-08152cf0-0b31-49f0-9a95-c0fdb1563f8a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:24.417866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-08152cf0-0b31-49f0-9a95-c0fdb1563f8a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:24.434705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08152cf0-0b31-49f0-9a95-c0fdb1563f8a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:24.436593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08152cf0-0b31-49f0-9a95-c0fdb1563f8a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:24.437650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08152cf0-0b31-49f0-9a95-c0fdb1563f8a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:24.438364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08152cf0-0b31-49f0-9a95-c0fdb1563f8a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:24.772214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-08152cf0-0b31-49f0-9a95-c0fdb1563f8a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:24.781188 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-08152cf0-0b31-49f0-9a95-c0fdb1563f8a tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5" status: 200 len: 1316 microversion: 2.1 time: 0.373477 Mar 12 20:54:24.782246 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1145/1913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:24 2022] GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5 => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:24.795381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ba914434-a952-4eea-b07d-258a934d039a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:24.796934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ba914434-a952-4eea-b07d-258a934d039a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:24.805406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba914434-a952-4eea-b07d-258a934d039a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:24.808025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba914434-a952-4eea-b07d-258a934d039a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:24.809062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba914434-a952-4eea-b07d-258a934d039a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:24.809634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba914434-a952-4eea-b07d-258a934d039a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:25.051776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ba914434-a952-4eea-b07d-258a934d039a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:25.060582 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ba914434-a952-4eea-b07d-258a934d039a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1324 microversion: 2.1 time: 0.277707 Mar 12 20:54:25.071020 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1146/1914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:24 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1324 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:25.077830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1fca9d0b-6e2b-4da6-a86e-99edb01a5142 req-874b19f5-571c-46aa-8e66-ca9a4eec607c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454e487a-2c6b-4bb7-8957-03e591b61651", "tag": "dacd774b-2b1a-4299-bb3b-af1495dfda3b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:25.085905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1fca9d0b-6e2b-4da6-a86e-99edb01a5142 req-874b19f5-571c-46aa-8e66-ca9a4eec607c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:25.095848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1fca9d0b-6e2b-4da6-a86e-99edb01a5142 req-874b19f5-571c-46aa-8e66-ca9a4eec607c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:25.121486 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1fca9d0b-6e2b-4da6-a86e-99edb01a5142 req-874b19f5-571c-46aa-8e66-ca9a4eec607c service nova] Creating event network-changed:dacd774b-2b1a-4299-bb3b-af1495dfda3b for instance 454e487a-2c6b-4bb7-8957-03e591b61651 on nch2-master-1 Mar 12 20:54:25.132762 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1fca9d0b-6e2b-4da6-a86e-99edb01a5142 req-874b19f5-571c-46aa-8e66-ca9a4eec607c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059960 Mar 12 20:54:25.133585 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1147/1915] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:25.143649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eeeacdb3-ba5f-41ef-8932-ba5e73a25936 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:25.150668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eeeacdb3-ba5f-41ef-8932-ba5e73a25936 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:25.160983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeeacdb3-ba5f-41ef-8932-ba5e73a25936 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:25.161440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeeacdb3-ba5f-41ef-8932-ba5e73a25936 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:25.164417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeeacdb3-ba5f-41ef-8932-ba5e73a25936 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:25.168464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeeacdb3-ba5f-41ef-8932-ba5e73a25936 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:25.248138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeeacdb3-ba5f-41ef-8932-ba5e73a25936 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:25.248589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeeacdb3-ba5f-41ef-8932-ba5e73a25936 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:25.259227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-eeeacdb3-ba5f-41ef-8932-ba5e73a25936 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lazy-loading 'fault' on Instance uuid 1f7f5155-9258-4c32-894e-ef4ffcc25a28 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:54:25.387733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eeeacdb3-ba5f-41ef-8932-ba5e73a25936 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:25.404837 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eeeacdb3-ba5f-41ef-8932-ba5e73a25936 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 200 len: 1302 microversion: 2.1 time: 0.269849 Mar 12 20:54:25.406604 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1148/1916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:25 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 1302 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:25.411549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-15ca6f21-1d06-4631-baaf-4bd21f9ab682 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:25.412456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-15ca6f21-1d06-4631-baaf-4bd21f9ab682 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:25.419090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15ca6f21-1d06-4631-baaf-4bd21f9ab682 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:25.419714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15ca6f21-1d06-4631-baaf-4bd21f9ab682 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:25.420621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15ca6f21-1d06-4631-baaf-4bd21f9ab682 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:25.421163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15ca6f21-1d06-4631-baaf-4bd21f9ab682 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:25.762348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-15ca6f21-1d06-4631-baaf-4bd21f9ab682 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e206de428e5474c965249c0093581bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d586d56dadc40a890a1d00bff31302b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:25.773637 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-15ca6f21-1d06-4631-baaf-4bd21f9ab682 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e" status: 200 len: 1464 microversion: 2.1 time: 0.365716 Mar 12 20:54:25.785482 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1149/1917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:25 2022] GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e => generated 1464 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:25.790406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-047652b5-1108-4ebd-8a03-f7c92a5a8abb tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:25.791328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-047652b5-1108-4ebd-8a03-f7c92a5a8abb tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:25.799974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-047652b5-1108-4ebd-8a03-f7c92a5a8abb tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:25.800505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-047652b5-1108-4ebd-8a03-f7c92a5a8abb tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:25.801763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-047652b5-1108-4ebd-8a03-f7c92a5a8abb tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:25.816153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-047652b5-1108-4ebd-8a03-f7c92a5a8abb tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:25.972755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-047652b5-1108-4ebd-8a03-f7c92a5a8abb tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:25.981786 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-047652b5-1108-4ebd-8a03-f7c92a5a8abb tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182" status: 200 len: 1324 microversion: 2.1 time: 0.199434 Mar 12 20:54:25.983284 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1150/1918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:25 2022] GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182 => generated 1324 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:25.988466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f63d70bd-9aac-4125-90fd-6866c8697411 req-c932b010-f522-4d9e-9bc8-82f723b593bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9194940b-98b0-48a5-a60e-465ff599b850", "tag": "f12db82e-2096-4b5f-932a-29a10f30a068"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:25.997418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f63d70bd-9aac-4125-90fd-6866c8697411 req-c932b010-f522-4d9e-9bc8-82f723b593bc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:25.998705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f63d70bd-9aac-4125-90fd-6866c8697411 req-c932b010-f522-4d9e-9bc8-82f723b593bc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:26.013681 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f63d70bd-9aac-4125-90fd-6866c8697411 req-c932b010-f522-4d9e-9bc8-82f723b593bc service nova] Creating event network-changed:f12db82e-2096-4b5f-932a-29a10f30a068 for instance 9194940b-98b0-48a5-a60e-465ff599b850 on nch1-master-1 Mar 12 20:54:26.020042 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f63d70bd-9aac-4125-90fd-6866c8697411 req-c932b010-f522-4d9e-9bc8-82f723b593bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034944 Mar 12 20:54:26.020866 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1151/1919] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:26.027709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-540f7830-5e29-4f72-b1d1-3a7c58b72a80 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:26.028959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-540f7830-5e29-4f72-b1d1-3a7c58b72a80 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 454e487a-2c6b-4bb7-8957-03e591b61651] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:26.035606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-540f7830-5e29-4f72-b1d1-3a7c58b72a80 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:26.036279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-540f7830-5e29-4f72-b1d1-3a7c58b72a80 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:26.037274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-540f7830-5e29-4f72-b1d1-3a7c58b72a80 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:26.038040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-540f7830-5e29-4f72-b1d1-3a7c58b72a80 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:26.317173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-540f7830-5e29-4f72-b1d1-3a7c58b72a80 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:26.334460 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-540f7830-5e29-4f72-b1d1-3a7c58b72a80 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651" status: 200 len: 1314 microversion: 2.1 time: 0.312197 Mar 12 20:54:26.335240 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1152/1920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:26 2022] GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:26.340053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5e59ca78-8cec-4769-bb94-1b59baccf060 req-6d5faccd-5fbb-4e77-91f0-2f13d4a5771e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9c4738-03fa-4cbc-a9a2-0648450befb5", "name": "network-vif-plugged", "status": "completed", "tag": "cdb1e534-85b7-4963-aa13-4a5219d8ce83"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:26.348631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5e59ca78-8cec-4769-bb94-1b59baccf060 req-6d5faccd-5fbb-4e77-91f0-2f13d4a5771e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:26.349076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5e59ca78-8cec-4769-bb94-1b59baccf060 req-6d5faccd-5fbb-4e77-91f0-2f13d4a5771e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:26.360572 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5e59ca78-8cec-4769-bb94-1b59baccf060 req-6d5faccd-5fbb-4e77-91f0-2f13d4a5771e service nova] Creating event network-vif-plugged:cdb1e534-85b7-4963-aa13-4a5219d8ce83 for instance da9c4738-03fa-4cbc-a9a2-0648450befb5 on nch2-master-1 Mar 12 20:54:26.366259 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5e59ca78-8cec-4769-bb94-1b59baccf060 req-6d5faccd-5fbb-4e77-91f0-2f13d4a5771e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029594 Mar 12 20:54:26.367022 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1153/1921] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:26.374678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bcd7ab09-ba9d-4f0e-8e10-9d9299f0eab5 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:26.375469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bcd7ab09-ba9d-4f0e-8e10-9d9299f0eab5 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:26.381854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcd7ab09-ba9d-4f0e-8e10-9d9299f0eab5 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:26.382304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcd7ab09-ba9d-4f0e-8e10-9d9299f0eab5 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:26.383076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcd7ab09-ba9d-4f0e-8e10-9d9299f0eab5 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:26.383511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcd7ab09-ba9d-4f0e-8e10-9d9299f0eab5 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:26.421483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bcd7ab09-ba9d-4f0e-8e10-9d9299f0eab5 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:54:26.548189 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bcd7ab09-ba9d-4f0e-8e10-9d9299f0eab5 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e" status: 204 len: 0 microversion: 2.1 time: 0.177115 Mar 12 20:54:26.548944 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1154/1922] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:54:26 2022] DELETE /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:54:26.554397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc8eee48-b9f4-451c-bbe2-ff507b88d339 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:26.555503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc8eee48-b9f4-451c-bbe2-ff507b88d339 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:26.566042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc8eee48-b9f4-451c-bbe2-ff507b88d339 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:26.566836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc8eee48-b9f4-451c-bbe2-ff507b88d339 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:26.568542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc8eee48-b9f4-451c-bbe2-ff507b88d339 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:26.569296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc8eee48-b9f4-451c-bbe2-ff507b88d339 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.119994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc8eee48-b9f4-451c-bbe2-ff507b88d339 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:27.127805 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc8eee48-b9f4-451c-bbe2-ff507b88d339 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5" status: 200 len: 1316 microversion: 2.1 time: 0.577490 Mar 12 20:54:27.131439 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1155/1923] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:26 2022] GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5 => generated 1316 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:27.133981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f836dfa7-97ec-49dd-ad28-b8169112e877 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:27.134734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f836dfa7-97ec-49dd-ad28-b8169112e877 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:27.142754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f836dfa7-97ec-49dd-ad28-b8169112e877 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.143633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f836dfa7-97ec-49dd-ad28-b8169112e877 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.144520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f836dfa7-97ec-49dd-ad28-b8169112e877 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.145054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f836dfa7-97ec-49dd-ad28-b8169112e877 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.281756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f836dfa7-97ec-49dd-ad28-b8169112e877 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:27.289760 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f836dfa7-97ec-49dd-ad28-b8169112e877 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1324 microversion: 2.1 time: 0.159876 Mar 12 20:54:27.290327 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1156/1924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:27 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1324 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:27.295158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8f8a17a-5b8c-4abc-9635-bb1b6257cdc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:27.295772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8f8a17a-5b8c-4abc-9635-bb1b6257cdc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 1f7f5155-9258-4c32-894e-ef4ffcc25a28] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:27.301418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8f8a17a-5b8c-4abc-9635-bb1b6257cdc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.302147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8f8a17a-5b8c-4abc-9635-bb1b6257cdc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.303004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8f8a17a-5b8c-4abc-9635-bb1b6257cdc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.303486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8f8a17a-5b8c-4abc-9635-bb1b6257cdc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.317292 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a8f8a17a-5b8c-4abc-9635-bb1b6257cdc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] HTTP exception thrown: Instance 1f7f5155-9258-4c32-894e-ef4ffcc25a28 could not be found. Mar 12 20:54:27.318186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8f8a17a-5b8c-4abc-9635-bb1b6257cdc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Returning 404 to user: Instance 1f7f5155-9258-4c32-894e-ef4ffcc25a28 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:27.319027 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8f8a17a-5b8c-4abc-9635-bb1b6257cdc6 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28" status: 404 len: 111 microversion: 2.1 time: 0.027636 Mar 12 20:54:27.321974 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1157/1925] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:27 2022] GET /compute/v2.1/servers/1f7f5155-9258-4c32-894e-ef4ffcc25a28 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:27.328682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cedabdab-7aaa-4d35-bd76-3ea926d65096 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:27.329495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cedabdab-7aaa-4d35-bd76-3ea926d65096 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:27.335812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cedabdab-7aaa-4d35-bd76-3ea926d65096 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.336271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cedabdab-7aaa-4d35-bd76-3ea926d65096 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.337865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cedabdab-7aaa-4d35-bd76-3ea926d65096 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.337990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cedabdab-7aaa-4d35-bd76-3ea926d65096 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.479940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cedabdab-7aaa-4d35-bd76-3ea926d65096 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e206de428e5474c965249c0093581bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d586d56dadc40a890a1d00bff31302b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:27.487309 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cedabdab-7aaa-4d35-bd76-3ea926d65096 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e" status: 200 len: 1470 microversion: 2.1 time: 0.162983 Mar 12 20:54:27.487872 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1158/1926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:27 2022] GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:27.492171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-785b1eec-acb8-460a-90f4-9905f390f6cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:27.492663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-785b1eec-acb8-460a-90f4-9905f390f6cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:27.497952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-785b1eec-acb8-460a-90f4-9905f390f6cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.498400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-785b1eec-acb8-460a-90f4-9905f390f6cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.499152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-785b1eec-acb8-460a-90f4-9905f390f6cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.499585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-785b1eec-acb8-460a-90f4-9905f390f6cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.525078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-785b1eec-acb8-460a-90f4-9905f390f6cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:54:27.599417 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-785b1eec-acb8-460a-90f4-9905f390f6cf tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf" status: 204 len: 0 microversion: 2.1 time: 0.110351 Mar 12 20:54:27.602932 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1159/1927] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:54:27 2022] DELETE /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:54:27.605399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e319a3fd-8cbc-4271-9ad5-80ce9c1e52e5 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:27.606138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e319a3fd-8cbc-4271-9ad5-80ce9c1e52e5 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:27.612061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e319a3fd-8cbc-4271-9ad5-80ce9c1e52e5 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.612519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e319a3fd-8cbc-4271-9ad5-80ce9c1e52e5 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.613291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e319a3fd-8cbc-4271-9ad5-80ce9c1e52e5 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.613734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e319a3fd-8cbc-4271-9ad5-80ce9c1e52e5 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.742957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e319a3fd-8cbc-4271-9ad5-80ce9c1e52e5 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:27.750896 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e319a3fd-8cbc-4271-9ad5-80ce9c1e52e5 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182" status: 200 len: 1324 microversion: 2.1 time: 0.149811 Mar 12 20:54:27.751469 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1160/1928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:27 2022] GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182 => generated 1324 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:27.755830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-61e57a7a-af54-4e64-9d51-be49cf3e7771 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:27.756433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-61e57a7a-af54-4e64-9d51-be49cf3e7771 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:27.761894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61e57a7a-af54-4e64-9d51-be49cf3e7771 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.762352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61e57a7a-af54-4e64-9d51-be49cf3e7771 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.763730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61e57a7a-af54-4e64-9d51-be49cf3e7771 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.764178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61e57a7a-af54-4e64-9d51-be49cf3e7771 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.895936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-61e57a7a-af54-4e64-9d51-be49cf3e7771 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:27.904175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-61e57a7a-af54-4e64-9d51-be49cf3e7771 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:27.905679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-61e57a7a-af54-4e64-9d51-be49cf3e7771 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:27.906853 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-61e57a7a-af54-4e64-9d51-be49cf3e7771 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1795 microversion: 2.20 time: 0.154479 Mar 12 20:54:27.907418 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1161/1929] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:54:27 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1795 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:54:27.911670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-13f5185d-4ced-4ad9-a6c6-f2f4671c54a9 req-07e4d1bc-55b2-4d70-b8c1-a5d3ae15c48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7f5155-9258-4c32-894e-ef4ffcc25a28", "name": "network-vif-deleted", "tag": "5c2b07b8-3063-4abf-8d95-04a1b3c25a29"}, {"name": "network-changed", "server_uuid": "993ea61d-e3db-46d0-a7c8-830cef8ad182", "tag": "1f65e31a-18ac-4f20-88b6-ab21f98f3482"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:27.919880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-13f5185d-4ced-4ad9-a6c6-f2f4671c54a9 req-07e4d1bc-55b2-4d70-b8c1-a5d3ae15c48a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.920325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-13f5185d-4ced-4ad9-a6c6-f2f4671c54a9 req-07e4d1bc-55b2-4d70-b8c1-a5d3ae15c48a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.932313 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-13f5185d-4ced-4ad9-a6c6-f2f4671c54a9 req-07e4d1bc-55b2-4d70-b8c1-a5d3ae15c48a service nova] Creating event network-vif-deleted:5c2b07b8-3063-4abf-8d95-04a1b3c25a29 for instance 1f7f5155-9258-4c32-894e-ef4ffcc25a28 on nch1-master-1 Mar 12 20:54:27.932887 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-13f5185d-4ced-4ad9-a6c6-f2f4671c54a9 req-07e4d1bc-55b2-4d70-b8c1-a5d3ae15c48a service nova] Creating event network-changed:1f65e31a-18ac-4f20-88b6-ab21f98f3482 for instance 993ea61d-e3db-46d0-a7c8-830cef8ad182 on nch2-master-1 Mar 12 20:54:27.941134 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-13f5185d-4ced-4ad9-a6c6-f2f4671c54a9 req-07e4d1bc-55b2-4d70-b8c1-a5d3ae15c48a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.032634 Mar 12 20:54:27.941717 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1162/1930] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:27.946891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-79a049cb-312a-4857-88ba-69fba337ad3a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:27.947487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-79a049cb-312a-4857-88ba-69fba337ad3a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:27.954085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79a049cb-312a-4857-88ba-69fba337ad3a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.954544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79a049cb-312a-4857-88ba-69fba337ad3a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.955318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79a049cb-312a-4857-88ba-69fba337ad3a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:27.955762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79a049cb-312a-4857-88ba-69fba337ad3a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:27.979341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-79a049cb-312a-4857-88ba-69fba337ad3a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:54:28.061901 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-79a049cb-312a-4857-88ba-69fba337ad3a tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 204 len: 0 microversion: 2.1 time: 0.118690 Mar 12 20:54:28.062508 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1163/1931] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:54:27 2022] DELETE /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:54:28.068278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bfd4bcb0-690c-4d54-b627-ad504429e6c8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:28.068981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bfd4bcb0-690c-4d54-b627-ad504429e6c8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 454e487a-2c6b-4bb7-8957-03e591b61651] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:28.074970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfd4bcb0-690c-4d54-b627-ad504429e6c8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:28.075465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfd4bcb0-690c-4d54-b627-ad504429e6c8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:28.076296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfd4bcb0-690c-4d54-b627-ad504429e6c8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:28.076752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfd4bcb0-690c-4d54-b627-ad504429e6c8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:28.209566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bfd4bcb0-690c-4d54-b627-ad504429e6c8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:28.216900 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bfd4bcb0-690c-4d54-b627-ad504429e6c8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651" status: 200 len: 1314 microversion: 2.1 time: 0.153135 Mar 12 20:54:28.217466 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1164/1932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:28 2022] GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:28.221814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90a3ae2c-7339-491f-8da4-881b3d7fcd92 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:28.222429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90a3ae2c-7339-491f-8da4-881b3d7fcd92 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:28.228658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90a3ae2c-7339-491f-8da4-881b3d7fcd92 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:28.229114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90a3ae2c-7339-491f-8da4-881b3d7fcd92 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:28.229908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90a3ae2c-7339-491f-8da4-881b3d7fcd92 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:28.230347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90a3ae2c-7339-491f-8da4-881b3d7fcd92 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:28.467901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90a3ae2c-7339-491f-8da4-881b3d7fcd92 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04cb45776b9475cb0364b96a8bd1e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1245d37d56c46f0b1bc0525fe98289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:28.476593 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90a3ae2c-7339-491f-8da4-881b3d7fcd92 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf" status: 200 len: 1514 microversion: 2.1 time: 0.258091 Mar 12 20:54:28.486839 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1165/1933] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:28 2022] GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf => generated 1514 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:28.493046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4d4a17d1-5470-46a0-8294-9c696cf8d2c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:28.493677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4d4a17d1-5470-46a0-8294-9c696cf8d2c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:28.500278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d4a17d1-5470-46a0-8294-9c696cf8d2c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:28.500759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d4a17d1-5470-46a0-8294-9c696cf8d2c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:28.501546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d4a17d1-5470-46a0-8294-9c696cf8d2c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:28.502027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d4a17d1-5470-46a0-8294-9c696cf8d2c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:28.725116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4d4a17d1-5470-46a0-8294-9c696cf8d2c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:28.733175 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4d4a17d1-5470-46a0-8294-9c696cf8d2c2 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1468 microversion: 2.1 time: 0.243912 Mar 12 20:54:28.736727 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1166/1934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:28 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1468 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:28.739922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c4a6b3e-7850-42da-a661-db670416bc17 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:28.740573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c4a6b3e-7850-42da-a661-db670416bc17 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:28.747297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c4a6b3e-7850-42da-a661-db670416bc17 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:28.747794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c4a6b3e-7850-42da-a661-db670416bc17 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:28.748853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c4a6b3e-7850-42da-a661-db670416bc17 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:28.749027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c4a6b3e-7850-42da-a661-db670416bc17 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:28.982513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4c4a6b3e-7850-42da-a661-db670416bc17 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:28.990293 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4c4a6b3e-7850-42da-a661-db670416bc17 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5" status: 200 len: 1505 microversion: 2.1 time: 0.255004 Mar 12 20:54:28.990867 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1167/1935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:28 2022] GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5 => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:28.995338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-58be3ba1-e8e8-4ac5-bd94-23bdb7837d81 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:28.995943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-58be3ba1-e8e8-4ac5-bd94-23bdb7837d81 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:29.009176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58be3ba1-e8e8-4ac5-bd94-23bdb7837d81 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:29.009632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58be3ba1-e8e8-4ac5-bd94-23bdb7837d81 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:29.010448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58be3ba1-e8e8-4ac5-bd94-23bdb7837d81 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:29.010885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58be3ba1-e8e8-4ac5-bd94-23bdb7837d81 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:29.151404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-58be3ba1-e8e8-4ac5-bd94-23bdb7837d81 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:29.158693 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-58be3ba1-e8e8-4ac5-bd94-23bdb7837d81 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1324 microversion: 2.1 time: 0.166895 Mar 12 20:54:29.159254 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1168/1936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:28 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1324 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:29.163598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-36be011a-314b-4869-b179-e17e08ae82de req-b6e93765-8b55-4efb-966d-2b2c7ab6be28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454e487a-2c6b-4bb7-8957-03e591b61651", "name": "network-vif-plugged", "status": "completed", "tag": "dacd774b-2b1a-4299-bb3b-af1495dfda3b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:29.171345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-36be011a-314b-4869-b179-e17e08ae82de req-b6e93765-8b55-4efb-966d-2b2c7ab6be28 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:29.171834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-36be011a-314b-4869-b179-e17e08ae82de req-b6e93765-8b55-4efb-966d-2b2c7ab6be28 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:29.182773 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-36be011a-314b-4869-b179-e17e08ae82de req-b6e93765-8b55-4efb-966d-2b2c7ab6be28 service nova] Creating event network-vif-plugged:dacd774b-2b1a-4299-bb3b-af1495dfda3b for instance 454e487a-2c6b-4bb7-8957-03e591b61651 on nch2-master-1 Mar 12 20:54:29.188077 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-36be011a-314b-4869-b179-e17e08ae82de req-b6e93765-8b55-4efb-966d-2b2c7ab6be28 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027740 Mar 12 20:54:29.188841 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1169/1937] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:29.193993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3be4fb7e-50de-4e86-8655-5aea85a7bd8f tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:29.194633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3be4fb7e-50de-4e86-8655-5aea85a7bd8f tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:29.201572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3be4fb7e-50de-4e86-8655-5aea85a7bd8f tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:29.202052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3be4fb7e-50de-4e86-8655-5aea85a7bd8f tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:29.202829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3be4fb7e-50de-4e86-8655-5aea85a7bd8f tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:29.203278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3be4fb7e-50de-4e86-8655-5aea85a7bd8f tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:29.235128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3be4fb7e-50de-4e86-8655-5aea85a7bd8f tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:29.235845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3be4fb7e-50de-4e86-8655-5aea85a7bd8f tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:29.236301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-3be4fb7e-50de-4e86-8655-5aea85a7bd8f tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lazy-loading 'fault' on Instance uuid 38ff9d8c-f4bd-442a-93c8-a913aefe358e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:54:29.278066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3be4fb7e-50de-4e86-8655-5aea85a7bd8f tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e206de428e5474c965249c0093581bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d586d56dadc40a890a1d00bff31302b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:29.285659 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3be4fb7e-50de-4e86-8655-5aea85a7bd8f tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e" status: 200 len: 1304 microversion: 2.1 time: 0.095865 Mar 12 20:54:29.286533 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1170/1938] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:29 2022] GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:29.291060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1267190-4c85-415b-98a2-395ffa03a7ac tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:29.291643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1267190-4c85-415b-98a2-395ffa03a7ac tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:29.298042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1267190-4c85-415b-98a2-395ffa03a7ac tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:29.298604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1267190-4c85-415b-98a2-395ffa03a7ac tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:29.299499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1267190-4c85-415b-98a2-395ffa03a7ac tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:29.300350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1267190-4c85-415b-98a2-395ffa03a7ac tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:29.458112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1267190-4c85-415b-98a2-395ffa03a7ac tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:29.465457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1267190-4c85-415b-98a2-395ffa03a7ac tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182" status: 200 len: 1324 microversion: 2.1 time: 0.178144 Mar 12 20:54:29.474867 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1171/1939] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:29 2022] GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182 => generated 1324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:29.480056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f8eae5ab-304d-4b14-867c-c81774cdafdf req-e5b0b921-456d-46f9-b4f8-0d40ef9544ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ff9d8c-f4bd-442a-93c8-a913aefe358e", "name": "network-vif-deleted", "tag": "8d01be63-72d4-4bdb-8e39-c0dba8e470f4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:29.489238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f8eae5ab-304d-4b14-867c-c81774cdafdf req-e5b0b921-456d-46f9-b4f8-0d40ef9544ee service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:29.489899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f8eae5ab-304d-4b14-867c-c81774cdafdf req-e5b0b921-456d-46f9-b4f8-0d40ef9544ee service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:29.502009 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f8eae5ab-304d-4b14-867c-c81774cdafdf req-e5b0b921-456d-46f9-b4f8-0d40ef9544ee service nova] Creating event network-vif-deleted:8d01be63-72d4-4bdb-8e39-c0dba8e470f4 for instance 38ff9d8c-f4bd-442a-93c8-a913aefe358e on nch1-master-1 Mar 12 20:54:29.506949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f8eae5ab-304d-4b14-867c-c81774cdafdf req-e5b0b921-456d-46f9-b4f8-0d40ef9544ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030653 Mar 12 20:54:29.507689 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1172/1940] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:29.513528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6c0ed206-dc5a-481a-b877-f22d9c229332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-272538647"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:29.514212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6c0ed206-dc5a-481a-b877-f22d9c229332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:29.520497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c0ed206-dc5a-481a-b877-f22d9c229332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:29.520947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c0ed206-dc5a-481a-b877-f22d9c229332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:29.521911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c0ed206-dc5a-481a-b877-f22d9c229332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:29.522347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c0ed206-dc5a-481a-b877-f22d9c229332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:29.784495 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.network.security_group_api [None req-6c0ed206-dc5a-481a-b877-f22d9c229332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Adding security group 8f925d6f-e6d1-401d-b6a3-81bd6e554c85 to port cdb1e534-85b7-4963-aa13-4a5219d8ce83 Mar 12 20:54:30.346844 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6c0ed206-dc5a-481a-b877-f22d9c229332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5/action" status: 202 len: 0 microversion: 2.1 time: 0.837767 Mar 12 20:54:30.351519 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1173/1941] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:54:29 2022] POST /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5/action => generated 0 bytes in 843 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:30.357699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c8cbc0d-bf0d-4230-abad-7c856164fb86 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:30.358686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c8cbc0d-bf0d-4230-abad-7c856164fb86 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 454e487a-2c6b-4bb7-8957-03e591b61651] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:30.373024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c8cbc0d-bf0d-4230-abad-7c856164fb86 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:30.377034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c8cbc0d-bf0d-4230-abad-7c856164fb86 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:30.380681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c8cbc0d-bf0d-4230-abad-7c856164fb86 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:30.382417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c8cbc0d-bf0d-4230-abad-7c856164fb86 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:30.567993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c8cbc0d-bf0d-4230-abad-7c856164fb86 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:30.576568 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c8cbc0d-bf0d-4230-abad-7c856164fb86 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651" status: 200 len: 1314 microversion: 2.1 time: 0.223362 Mar 12 20:54:30.577477 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1174/1942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:30 2022] GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:30.582687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09e4cc99-45dc-4c89-8029-d570eed4c543 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:30.583677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-09e4cc99-45dc-4c89-8029-d570eed4c543 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:30.589675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e4cc99-45dc-4c89-8029-d570eed4c543 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:30.590390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e4cc99-45dc-4c89-8029-d570eed4c543 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:30.591880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e4cc99-45dc-4c89-8029-d570eed4c543 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:30.592463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e4cc99-45dc-4c89-8029-d570eed4c543 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:30.627877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e4cc99-45dc-4c89-8029-d570eed4c543 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:30.628342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e4cc99-45dc-4c89-8029-d570eed4c543 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:30.628794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-09e4cc99-45dc-4c89-8029-d570eed4c543 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lazy-loading 'fault' on Instance uuid f620d961-9ec1-46e4-967f-a10a457951cf {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:54:30.670048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09e4cc99-45dc-4c89-8029-d570eed4c543 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e04cb45776b9475cb0364b96a8bd1e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1245d37d56c46f0b1bc0525fe98289f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:30.678801 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09e4cc99-45dc-4c89-8029-d570eed4c543 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf" status: 200 len: 1308 microversion: 2.1 time: 0.099868 Mar 12 20:54:30.688816 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1175/1943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:30 2022] GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:30.688816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-62a7c4f8-533b-4191-b8e9-b19ba5f388b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:30.688816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-62a7c4f8-533b-4191-b8e9-b19ba5f388b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:30.691864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62a7c4f8-533b-4191-b8e9-b19ba5f388b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:30.692326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62a7c4f8-533b-4191-b8e9-b19ba5f388b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:30.693374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62a7c4f8-533b-4191-b8e9-b19ba5f388b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:30.693841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62a7c4f8-533b-4191-b8e9-b19ba5f388b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:30.743481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62a7c4f8-533b-4191-b8e9-b19ba5f388b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:30.744870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62a7c4f8-533b-4191-b8e9-b19ba5f388b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:30.745513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-62a7c4f8-533b-4191-b8e9-b19ba5f388b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lazy-loading 'fault' on Instance uuid 2eb40313-ddf5-44a6-8898-8c76ab6e1e29 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:54:30.837609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-62a7c4f8-533b-4191-b8e9-b19ba5f388b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b404502bb19242c385bc7d6ca5bff2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8057df76c4c4652a22bb659969dbb31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:30.849901 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-62a7c4f8-533b-4191-b8e9-b19ba5f388b5 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 200 len: 1302 microversion: 2.1 time: 0.168123 Mar 12 20:54:30.855029 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1176/1944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:30 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 1302 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:30.871685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-edb4a6f2-0080-4734-90e4-bf637c0decda tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:30.872383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-edb4a6f2-0080-4734-90e4-bf637c0decda tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:30.884201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-edb4a6f2-0080-4734-90e4-bf637c0decda tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:30.884668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-edb4a6f2-0080-4734-90e4-bf637c0decda tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:30.885472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-edb4a6f2-0080-4734-90e4-bf637c0decda tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:30.885946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-edb4a6f2-0080-4734-90e4-bf637c0decda tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.050493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-edb4a6f2-0080-4734-90e4-bf637c0decda tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:31.058811 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-edb4a6f2-0080-4734-90e4-bf637c0decda tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1324 microversion: 2.1 time: 0.202104 Mar 12 20:54:31.059398 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1177/1945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:30 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1324 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:31.068307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d2b1e16-788c-49ef-8e6e-98f7dbe89884 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:31.070216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0d2b1e16-788c-49ef-8e6e-98f7dbe89884 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:31.077003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d2b1e16-788c-49ef-8e6e-98f7dbe89884 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.077485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d2b1e16-788c-49ef-8e6e-98f7dbe89884 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.078324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d2b1e16-788c-49ef-8e6e-98f7dbe89884 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.078760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d2b1e16-788c-49ef-8e6e-98f7dbe89884 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.092451 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-0d2b1e16-788c-49ef-8e6e-98f7dbe89884 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] HTTP exception thrown: Instance 38ff9d8c-f4bd-442a-93c8-a913aefe358e could not be found. Mar 12 20:54:31.093071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d2b1e16-788c-49ef-8e6e-98f7dbe89884 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Returning 404 to user: Instance 38ff9d8c-f4bd-442a-93c8-a913aefe358e could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:31.093926 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d2b1e16-788c-49ef-8e6e-98f7dbe89884 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e" status: 404 len: 111 microversion: 2.1 time: 0.033556 Mar 12 20:54:31.094476 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1178/1946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:31 2022] GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:31.099312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c354e60-9002-4480-bd03-603d6388cbc8 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48d11310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:31.197034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-8c354e60-9002-4480-bd03-603d6388cbc8 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8f925d6f-e6d1-401d-b6a3-81bd6e554c85 in use.", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:54:31.197745 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8c354e60-9002-4480-bd03-603d6388cbc8 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Security Group 8f925d6f-e6d1-401d-b6a3-81bd6e554c85 in use. Mar 12 20:54:31.197745 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-ba7ee84a-85c0-4127-90b7-f6d8479b4202'] Mar 12 20:54:31.198380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c354e60-9002-4480-bd03-603d6388cbc8 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 400 to user: Security Group 8f925d6f-e6d1-401d-b6a3-81bd6e554c85 in use. Mar 12 20:54:31.198380 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-ba7ee84a-85c0-4127-90b7-f6d8479b4202'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:31.199251 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c354e60-9002-4480-bd03-603d6388cbc8 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/8f925d6f-e6d1-401d-b6a3-81bd6e554c85" status: 400 len: 185 microversion: 2.1 time: 0.103776 Mar 12 20:54:31.199817 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1179/1947] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:54:31 2022] DELETE /compute/v2.1/os-security-groups/8f925d6f-e6d1-401d-b6a3-81bd6e554c85 => generated 185 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:54:31.205105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3a2827d8-66df-43cb-9395-229bceb42d53 req-12fd8296-4646-4397-9ed2-3fdc6165832e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb40313-ddf5-44a6-8898-8c76ab6e1e29", "name": "network-vif-deleted", "tag": "9350a43c-e942-483b-b81d-2affe8e464d3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:31.213996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3a2827d8-66df-43cb-9395-229bceb42d53 req-12fd8296-4646-4397-9ed2-3fdc6165832e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.215817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3a2827d8-66df-43cb-9395-229bceb42d53 req-12fd8296-4646-4397-9ed2-3fdc6165832e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.228386 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3a2827d8-66df-43cb-9395-229bceb42d53 req-12fd8296-4646-4397-9ed2-3fdc6165832e service nova] Creating event network-vif-deleted:9350a43c-e942-483b-b81d-2affe8e464d3 for instance 2eb40313-ddf5-44a6-8898-8c76ab6e1e29 on nch2-master-1 Mar 12 20:54:31.233754 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3a2827d8-66df-43cb-9395-229bceb42d53 req-12fd8296-4646-4397-9ed2-3fdc6165832e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032446 Mar 12 20:54:31.234376 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1180/1948] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:31.239418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e709baa7-1fad-41db-b464-3296503dd028 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:31.240118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e709baa7-1fad-41db-b464-3296503dd028 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:31.246272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e709baa7-1fad-41db-b464-3296503dd028 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.246736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e709baa7-1fad-41db-b464-3296503dd028 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.247559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e709baa7-1fad-41db-b464-3296503dd028 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.248008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e709baa7-1fad-41db-b464-3296503dd028 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.385398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e709baa7-1fad-41db-b464-3296503dd028 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:31.393413 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e709baa7-1fad-41db-b464-3296503dd028 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182" status: 200 len: 1324 microversion: 2.1 time: 0.157934 Mar 12 20:54:31.394016 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1181/1949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:31 2022] GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182 => generated 1324 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:31.398622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-79bab1e6-3ee5-4a37-b003-5d0522c704b8 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-54836200", "metadata": {"image_type": "test"}}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:31.399701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-79bab1e6-3ee5-4a37-b003-5d0522c704b8 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:31.405567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79bab1e6-3ee5-4a37-b003-5d0522c704b8 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.406069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79bab1e6-3ee5-4a37-b003-5d0522c704b8 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.406847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79bab1e6-3ee5-4a37-b003-5d0522c704b8 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.407296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79bab1e6-3ee5-4a37-b003-5d0522c704b8 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.420649 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-79bab1e6-3ee5-4a37-b003-5d0522c704b8 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] HTTP exception thrown: Instance 38ff9d8c-f4bd-442a-93c8-a913aefe358e could not be found. Mar 12 20:54:31.421284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-79bab1e6-3ee5-4a37-b003-5d0522c704b8 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Returning 404 to user: Instance 38ff9d8c-f4bd-442a-93c8-a913aefe358e could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:31.422156 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-79bab1e6-3ee5-4a37-b003-5d0522c704b8 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "POST /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e/action" status: 404 len: 111 microversion: 2.1 time: 0.027195 Mar 12 20:54:31.428161 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1182/1950] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Mar 12 20:54:31 2022] POST /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:31.428161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e2830eba-b0cf-48a9-9eaa-21c1245d3fc8 req-5de72364-36d8-459e-95f3-54b789088469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb11b2e1-92f9-4b42-8158-fd559447adc2", "name": "network-vif-plugged", "status": "completed", "tag": "4f8f4364-9747-4729-b9eb-834dd3e8a86a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:31.439027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e2830eba-b0cf-48a9-9eaa-21c1245d3fc8 req-5de72364-36d8-459e-95f3-54b789088469 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.439479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e2830eba-b0cf-48a9-9eaa-21c1245d3fc8 req-5de72364-36d8-459e-95f3-54b789088469 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.452246 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e2830eba-b0cf-48a9-9eaa-21c1245d3fc8 req-5de72364-36d8-459e-95f3-54b789088469 service nova] Creating event network-vif-plugged:4f8f4364-9747-4729-b9eb-834dd3e8a86a for instance eb11b2e1-92f9-4b42-8158-fd559447adc2 on nch1-master-1 Mar 12 20:54:31.457445 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e2830eba-b0cf-48a9-9eaa-21c1245d3fc8 req-5de72364-36d8-459e-95f3-54b789088469 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033619 Mar 12 20:54:31.458257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1183/1951] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:31.463177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da4d7dd4-a16d-4020-8526-fb4167496332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:31.464262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da4d7dd4-a16d-4020-8526-fb4167496332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:31.472247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da4d7dd4-a16d-4020-8526-fb4167496332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.472703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da4d7dd4-a16d-4020-8526-fb4167496332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.473558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da4d7dd4-a16d-4020-8526-fb4167496332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.474175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da4d7dd4-a16d-4020-8526-fb4167496332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.557584 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da4d7dd4-a16d-4020-8526-fb4167496332 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5/action" status: 202 len: 0 microversion: 2.1 time: 0.098160 Mar 12 20:54:31.558948 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1184/1952] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:54:31 2022] POST /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:31.565269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-adc9132c-090a-45b1-9e18-cb262a7e4e40 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-925346964", "metadata": {"image_type": "test"}}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:31.566772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-adc9132c-090a-45b1-9e18-cb262a7e4e40 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Failed to fetch instance by id tempest-invalid-79574571 {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 12 20:54:31.567297 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-adc9132c-090a-45b1-9e18-cb262a7e4e40 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] HTTP exception thrown: Instance tempest-invalid-79574571 could not be found. Mar 12 20:54:31.568182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-adc9132c-090a-45b1-9e18-cb262a7e4e40 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Returning 404 to user: Instance tempest-invalid-79574571 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:31.568923 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-adc9132c-090a-45b1-9e18-cb262a7e4e40 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "POST /compute/v2.1/servers/tempest-invalid-79574571/action" status: 404 len: 99 microversion: 2.1 time: 0.008792 Mar 12 20:54:31.570027 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1185/1953] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Mar 12 20:54:31 2022] POST /compute/v2.1/servers/tempest-invalid-79574571/action => generated 99 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:54:31.577363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-cf378957-a34b-4a9c-8bf5-7d92c0342e20 req-cca39b93-9b6f-4f95-a320-379fc44ba633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f620d961-9ec1-46e4-967f-a10a457951cf", "name": "network-vif-deleted", "tag": "d5becd29-74d4-4c20-a4e3-03cb1c69dbb1"}, {"name": "network-changed", "server_uuid": "da9c4738-03fa-4cbc-a9a2-0648450befb5", "tag": "cdb1e534-85b7-4963-aa13-4a5219d8ce83"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:31.588301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cf378957-a34b-4a9c-8bf5-7d92c0342e20 req-cca39b93-9b6f-4f95-a320-379fc44ba633 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.588764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cf378957-a34b-4a9c-8bf5-7d92c0342e20 req-cca39b93-9b6f-4f95-a320-379fc44ba633 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.604521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-cf378957-a34b-4a9c-8bf5-7d92c0342e20 req-cca39b93-9b6f-4f95-a320-379fc44ba633 service nova] Creating event network-vif-deleted:d5becd29-74d4-4c20-a4e3-03cb1c69dbb1 for instance f620d961-9ec1-46e4-967f-a10a457951cf on nch1-master-1 Mar 12 20:54:31.605106 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-cf378957-a34b-4a9c-8bf5-7d92c0342e20 req-cca39b93-9b6f-4f95-a320-379fc44ba633 service nova] Creating event network-changed:cdb1e534-85b7-4963-aa13-4a5219d8ce83 for instance da9c4738-03fa-4cbc-a9a2-0648450befb5 on nch2-master-1 Mar 12 20:54:31.617556 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-cf378957-a34b-4a9c-8bf5-7d92c0342e20 req-cca39b93-9b6f-4f95-a320-379fc44ba633 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046084 Mar 12 20:54:31.618581 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1186/1954] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:31.624598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b5bcab4b-ba0b-4cf1-92c6-b381808c3b03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:31.625303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b5bcab4b-ba0b-4cf1-92c6-b381808c3b03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:31.631799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5bcab4b-ba0b-4cf1-92c6-b381808c3b03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.632229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5bcab4b-ba0b-4cf1-92c6-b381808c3b03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.633008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5bcab4b-ba0b-4cf1-92c6-b381808c3b03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.633453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5bcab4b-ba0b-4cf1-92c6-b381808c3b03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.782913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b5bcab4b-ba0b-4cf1-92c6-b381808c3b03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:31.790362 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b5bcab4b-ba0b-4cf1-92c6-b381808c3b03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5" status: 200 len: 1575 microversion: 2.1 time: 0.170372 Mar 12 20:54:31.790927 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1187/1955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:31 2022] GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:31.795974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-def231a6-03ac-44ca-8012-b698fe1d7627 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2143632970"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:31.796986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-def231a6-03ac-44ca-8012-b698fe1d7627 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 12 20:54:31.797489 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-def231a6-03ac-44ca-8012-b698fe1d7627 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Mar 12 20:54:31.798071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-def231a6-03ac-44ca-8012-b698fe1d7627 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:31.798830 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-def231a6-03ac-44ca-8012-b698fe1d7627 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.007023 Mar 12 20:54:31.799481 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1188/1956] 10.222.0.30 () {60 vars in 1274 bytes} [Sat Mar 12 20:54:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:31.805085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dad9024d-223f-4657-8b11-be577d8bb98d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:31.805680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dad9024d-223f-4657-8b11-be577d8bb98d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 454e487a-2c6b-4bb7-8957-03e591b61651] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:31.812932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dad9024d-223f-4657-8b11-be577d8bb98d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.813381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dad9024d-223f-4657-8b11-be577d8bb98d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.814193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dad9024d-223f-4657-8b11-be577d8bb98d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.814632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dad9024d-223f-4657-8b11-be577d8bb98d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.949044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dad9024d-223f-4657-8b11-be577d8bb98d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:31.956761 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dad9024d-223f-4657-8b11-be577d8bb98d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651" status: 200 len: 1463 microversion: 2.1 time: 0.156539 Mar 12 20:54:31.957333 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1189/1957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:31 2022] GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651 => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:31.961930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26ffdb6a-988a-4dbe-bdb7-221a548b1517 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:31.962553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-26ffdb6a-988a-4dbe-bdb7-221a548b1517 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] [instance: f620d961-9ec1-46e4-967f-a10a457951cf] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:31.968331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26ffdb6a-988a-4dbe-bdb7-221a548b1517 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.968792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26ffdb6a-988a-4dbe-bdb7-221a548b1517 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.969572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26ffdb6a-988a-4dbe-bdb7-221a548b1517 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:31.970039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26ffdb6a-988a-4dbe-bdb7-221a548b1517 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:31.983775 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-26ffdb6a-988a-4dbe-bdb7-221a548b1517 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] HTTP exception thrown: Instance f620d961-9ec1-46e4-967f-a10a457951cf could not be found. Mar 12 20:54:31.984400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26ffdb6a-988a-4dbe-bdb7-221a548b1517 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] Returning 404 to user: Instance f620d961-9ec1-46e4-967f-a10a457951cf could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:31.985229 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-26ffdb6a-988a-4dbe-bdb7-221a548b1517 tempest-VolumesAdminNegativeTest-1400197357 tempest-VolumesAdminNegativeTest-1400197357-project] 10.222.0.30 "GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf" status: 404 len: 111 microversion: 2.1 time: 0.026963 Mar 12 20:54:31.985812 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1190/1958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:31 2022] GET /compute/v2.1/servers/f620d961-9ec1-46e4-967f-a10a457951cf => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:31.990315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6eb5cb7a-2e24-48c7-8481-5741f362f7db tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2045536495"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:31.991714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6eb5cb7a-2e24-48c7-8481-5741f362f7db tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 12 20:54:31.991979 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-6eb5cb7a-2e24-48c7-8481-5741f362f7db tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Mar 12 20:54:31.992548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6eb5cb7a-2e24-48c7-8481-5741f362f7db tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:31.993332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6eb5cb7a-2e24-48c7-8481-5741f362f7db tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.006662 Mar 12 20:54:31.993885 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1191/1959] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Mar 12 20:54:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:32.001606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ff0dc8bb-3632-4096-bd27-ac5e85459459 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:32.002248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ff0dc8bb-3632-4096-bd27-ac5e85459459 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] [instance: 2eb40313-ddf5-44a6-8898-8c76ab6e1e29] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:32.008886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff0dc8bb-3632-4096-bd27-ac5e85459459 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:32.009347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff0dc8bb-3632-4096-bd27-ac5e85459459 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:32.010235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff0dc8bb-3632-4096-bd27-ac5e85459459 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:32.010677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff0dc8bb-3632-4096-bd27-ac5e85459459 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:32.024197 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ff0dc8bb-3632-4096-bd27-ac5e85459459 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] HTTP exception thrown: Instance 2eb40313-ddf5-44a6-8898-8c76ab6e1e29 could not be found. Mar 12 20:54:32.024805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ff0dc8bb-3632-4096-bd27-ac5e85459459 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] Returning 404 to user: Instance 2eb40313-ddf5-44a6-8898-8c76ab6e1e29 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:32.025705 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ff0dc8bb-3632-4096-bd27-ac5e85459459 tempest-MigrationsAdminTest-1075041610 tempest-MigrationsAdminTest-1075041610-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29" status: 404 len: 111 microversion: 2.1 time: 0.030926 Mar 12 20:54:32.026292 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1192/1960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:31 2022] GET /compute/v2.1/servers/2eb40313-ddf5-44a6-8898-8c76ab6e1e29 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:32.030997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7266bbb-b9d5-4de7-826e-6a060f51173a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:32.031449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a7266bbb-b9d5-4de7-826e-6a060f51173a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:32.037235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7266bbb-b9d5-4de7-826e-6a060f51173a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:32.037698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7266bbb-b9d5-4de7-826e-6a060f51173a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:32.038522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7266bbb-b9d5-4de7-826e-6a060f51173a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:32.038972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7266bbb-b9d5-4de7-826e-6a060f51173a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:32.290370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a7266bbb-b9d5-4de7-826e-6a060f51173a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:32.305027 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7266bbb-b9d5-4de7-826e-6a060f51173a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1314 microversion: 2.1 time: 0.277635 Mar 12 20:54:32.305760 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1193/1961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:32 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:32.311441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67ff8b7d-9552-40c7-a599-c92eb9aa1edc tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:32.312199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-67ff8b7d-9552-40c7-a599-c92eb9aa1edc tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:32.328357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67ff8b7d-9552-40c7-a599-c92eb9aa1edc tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:32.329686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67ff8b7d-9552-40c7-a599-c92eb9aa1edc tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:32.330677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67ff8b7d-9552-40c7-a599-c92eb9aa1edc tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:32.331288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67ff8b7d-9552-40c7-a599-c92eb9aa1edc tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:32.347178 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-67ff8b7d-9552-40c7-a599-c92eb9aa1edc tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] HTTP exception thrown: Instance 38ff9d8c-f4bd-442a-93c8-a913aefe358e could not be found. Mar 12 20:54:32.347805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67ff8b7d-9552-40c7-a599-c92eb9aa1edc tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Returning 404 to user: Instance 38ff9d8c-f4bd-442a-93c8-a913aefe358e could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:32.348654 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67ff8b7d-9552-40c7-a599-c92eb9aa1edc tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e" status: 404 len: 111 microversion: 2.1 time: 0.041770 Mar 12 20:54:32.349533 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1194/1962] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:54:32 2022] DELETE /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:32.354955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dfb5840c-5bf1-4fee-ba04-5ed8bb638b6a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:32.355575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dfb5840c-5bf1-4fee-ba04-5ed8bb638b6a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:32.362157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfb5840c-5bf1-4fee-ba04-5ed8bb638b6a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:32.362619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfb5840c-5bf1-4fee-ba04-5ed8bb638b6a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:32.363413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfb5840c-5bf1-4fee-ba04-5ed8bb638b6a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:32.363906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfb5840c-5bf1-4fee-ba04-5ed8bb638b6a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:32.622987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dfb5840c-5bf1-4fee-ba04-5ed8bb638b6a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:32.630482 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dfb5840c-5bf1-4fee-ba04-5ed8bb638b6a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1324 microversion: 2.1 time: 0.279645 Mar 12 20:54:32.641097 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1195/1963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:32 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1324 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:32.646215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e373436e-1f88-4d4a-a824-e9679a051317 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:32.647254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e373436e-1f88-4d4a-a824-e9679a051317 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] [instance: 38ff9d8c-f4bd-442a-93c8-a913aefe358e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:32.653353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e373436e-1f88-4d4a-a824-e9679a051317 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:32.654648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e373436e-1f88-4d4a-a824-e9679a051317 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:32.655869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e373436e-1f88-4d4a-a824-e9679a051317 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:32.656788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e373436e-1f88-4d4a-a824-e9679a051317 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:32.675821 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e373436e-1f88-4d4a-a824-e9679a051317 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] HTTP exception thrown: Instance 38ff9d8c-f4bd-442a-93c8-a913aefe358e could not be found. Mar 12 20:54:32.676719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e373436e-1f88-4d4a-a824-e9679a051317 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] Returning 404 to user: Instance 38ff9d8c-f4bd-442a-93c8-a913aefe358e could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:32.677738 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e373436e-1f88-4d4a-a824-e9679a051317 tempest-ImagesNegativeTestJSON-1861780904 tempest-ImagesNegativeTestJSON-1861780904-project] 10.222.0.30 "GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e" status: 404 len: 111 microversion: 2.1 time: 0.035399 Mar 12 20:54:32.678498 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1196/1964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:32 2022] GET /compute/v2.1/servers/38ff9d8c-f4bd-442a-93c8-a913aefe358e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:32.683848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-97da1c4d-da14-4a08-bdfc-950750d8de92 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:32.684963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-97da1c4d-da14-4a08-bdfc-950750d8de92 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:32.691325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97da1c4d-da14-4a08-bdfc-950750d8de92 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:32.692184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97da1c4d-da14-4a08-bdfc-950750d8de92 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:32.693432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97da1c4d-da14-4a08-bdfc-950750d8de92 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:32.694065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97da1c4d-da14-4a08-bdfc-950750d8de92 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:32.952009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-97da1c4d-da14-4a08-bdfc-950750d8de92 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:32.965558 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-97da1c4d-da14-4a08-bdfc-950750d8de92 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182" status: 200 len: 1324 microversion: 2.1 time: 0.285816 Mar 12 20:54:32.976848 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1197/1965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:32 2022] GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182 => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:32.984027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-81d0fda0-f72e-495e-b280-474b595199a2 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:32.984653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-81d0fda0-f72e-495e-b280-474b595199a2 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:33.000069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81d0fda0-f72e-495e-b280-474b595199a2 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:33.000858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81d0fda0-f72e-495e-b280-474b595199a2 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:33.001892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81d0fda0-f72e-495e-b280-474b595199a2 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:33.002496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81d0fda0-f72e-495e-b280-474b595199a2 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:33.276378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-81d0fda0-f72e-495e-b280-474b595199a2 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:33.288470 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-81d0fda0-f72e-495e-b280-474b595199a2 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5" status: 200 len: 1575 microversion: 2.1 time: 0.310307 Mar 12 20:54:33.289714 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1198/1966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:32 2022] GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5 => generated 1575 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:33.321724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-100e98d4-70c4-4985-96c8-121b9e6a4850 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:33.322694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-100e98d4-70c4-4985-96c8-121b9e6a4850 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:33.331311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-100e98d4-70c4-4985-96c8-121b9e6a4850 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:33.331809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-100e98d4-70c4-4985-96c8-121b9e6a4850 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:33.332576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-100e98d4-70c4-4985-96c8-121b9e6a4850 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:33.333013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-100e98d4-70c4-4985-96c8-121b9e6a4850 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:33.542171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-100e98d4-70c4-4985-96c8-121b9e6a4850 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:33.552499 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-100e98d4-70c4-4985-96c8-121b9e6a4850 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1463 microversion: 2.1 time: 0.234982 Mar 12 20:54:33.566472 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1199/1967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:33 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1463 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:33.575219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9d77a821-4112-4120-97ce-dd621c3a5ca2 req-4189e438-1bd7-4c82-bc75-ea311ada125f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993ea61d-e3db-46d0-a7c8-830cef8ad182", "name": "network-vif-plugged", "status": "completed", "tag": "1f65e31a-18ac-4f20-88b6-ab21f98f3482"}, {"server_uuid": "9194940b-98b0-48a5-a60e-465ff599b850", "name": "network-vif-plugged", "status": "completed", "tag": "f12db82e-2096-4b5f-932a-29a10f30a068"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:33.587084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9d77a821-4112-4120-97ce-dd621c3a5ca2 req-4189e438-1bd7-4c82-bc75-ea311ada125f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:33.588275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9d77a821-4112-4120-97ce-dd621c3a5ca2 req-4189e438-1bd7-4c82-bc75-ea311ada125f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:33.604871 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9d77a821-4112-4120-97ce-dd621c3a5ca2 req-4189e438-1bd7-4c82-bc75-ea311ada125f service nova] Creating event network-vif-plugged:1f65e31a-18ac-4f20-88b6-ab21f98f3482 for instance 993ea61d-e3db-46d0-a7c8-830cef8ad182 on nch2-master-1 Mar 12 20:54:33.606595 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9d77a821-4112-4120-97ce-dd621c3a5ca2 req-4189e438-1bd7-4c82-bc75-ea311ada125f service nova] Creating event network-vif-plugged:f12db82e-2096-4b5f-932a-29a10f30a068 for instance 9194940b-98b0-48a5-a60e-465ff599b850 on nch1-master-1 Mar 12 20:54:33.619723 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9d77a821-4112-4120-97ce-dd621c3a5ca2 req-4189e438-1bd7-4c82-bc75-ea311ada125f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051197 Mar 12 20:54:33.620821 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1200/1968] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:33.651074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6eaaab9c-b85e-4aae-a0fd-5f35bc0028e1 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:33.651853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6eaaab9c-b85e-4aae-a0fd-5f35bc0028e1 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:33.681865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6eaaab9c-b85e-4aae-a0fd-5f35bc0028e1 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:33.685373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6eaaab9c-b85e-4aae-a0fd-5f35bc0028e1 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:33.688730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6eaaab9c-b85e-4aae-a0fd-5f35bc0028e1 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:33.690962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6eaaab9c-b85e-4aae-a0fd-5f35bc0028e1 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:34.016143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6eaaab9c-b85e-4aae-a0fd-5f35bc0028e1 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:34.029898 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6eaaab9c-b85e-4aae-a0fd-5f35bc0028e1 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1324 microversion: 2.1 time: 0.381892 Mar 12 20:54:34.031183 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1201/1969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:33 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1324 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:34.043713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-462566052", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "eb11b2e1-92f9-4b42-8158-fd559447adc2"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:34.120068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:54:34.417977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:54:34.418414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:54:34.418901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:54:34.419595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:54:34.419831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:54:34.432635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:34.433410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:34.434435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:34.435911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:34.455979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Getting quotas for project 3f2df40602ee43d4a6ecbf8147e170d0. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:54:34.461656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Getting quotas for user 2f02e3887cad43d1a9e95f876aff1a5f and project 3f2df40602ee43d4a6ecbf8147e170d0. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:54:34.474227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:54:34.476545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 49462c08-773d-44d6-8122-ca42b0c747ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:54:34.522234 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-859f3150-b882-4d41-b1bc-9ce9e9739fb8 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489730 Mar 12 20:54:34.523229 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1202/1970] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:54:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:54:34.528188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fa47d71c-867b-43b4-a351-5ecc41916ed4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:34.529275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fa47d71c-867b-43b4-a351-5ecc41916ed4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:34.535875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa47d71c-867b-43b4-a351-5ecc41916ed4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:34.536342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa47d71c-867b-43b4-a351-5ecc41916ed4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:34.537316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa47d71c-867b-43b4-a351-5ecc41916ed4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:34.537980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa47d71c-867b-43b4-a351-5ecc41916ed4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:34.709168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fa47d71c-867b-43b4-a351-5ecc41916ed4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:34.719379 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fa47d71c-867b-43b4-a351-5ecc41916ed4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182" status: 200 len: 1324 microversion: 2.1 time: 0.194966 Mar 12 20:54:34.720315 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1203/1971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:34 2022] GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182 => generated 1324 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:34.733536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9484de15-aec5-4ec6-bde9-9bc33d84ad8c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:34.734430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9484de15-aec5-4ec6-bde9-9bc33d84ad8c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:34.741982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9484de15-aec5-4ec6-bde9-9bc33d84ad8c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:34.742663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9484de15-aec5-4ec6-bde9-9bc33d84ad8c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:34.743642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9484de15-aec5-4ec6-bde9-9bc33d84ad8c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:34.744251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9484de15-aec5-4ec6-bde9-9bc33d84ad8c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:34.969454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9484de15-aec5-4ec6-bde9-9bc33d84ad8c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:34.977084 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9484de15-aec5-4ec6-bde9-9bc33d84ad8c tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5" status: 200 len: 1573 microversion: 2.1 time: 0.255102 Mar 12 20:54:34.978597 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1204/1972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:34 2022] GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5 => generated 1573 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:34.983858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ce9de08-f21c-4887-90db-8842d34ee1b1 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:34.984478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5ce9de08-f21c-4887-90db-8842d34ee1b1 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 49462c08-773d-44d6-8122-ca42b0c747ef] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:35.046631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5ce9de08-f21c-4887-90db-8842d34ee1b1 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:35.061640 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ce9de08-f21c-4887-90db-8842d34ee1b1 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef" status: 200 len: 1213 microversion: 2.1 time: 0.081971 Mar 12 20:54:35.063765 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1205/1973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:34 2022] GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:35.078338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-385ef729-c833-4dc0-8f6f-faa925cb8d61 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1892052874"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:35.079137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-385ef729-c833-4dc0-8f6f-faa925cb8d61 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:35.090216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-385ef729-c833-4dc0-8f6f-faa925cb8d61 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:35.090881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-385ef729-c833-4dc0-8f6f-faa925cb8d61 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:35.095347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-385ef729-c833-4dc0-8f6f-faa925cb8d61 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:35.096746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-385ef729-c833-4dc0-8f6f-faa925cb8d61 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:35.292429 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.network.security_group_api [None req-385ef729-c833-4dc0-8f6f-faa925cb8d61 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Adding security group 1b0e47ee-b662-4717-bb01-56e3abba40a4 to port cdb1e534-85b7-4963-aa13-4a5219d8ce83 Mar 12 20:54:35.743896 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-385ef729-c833-4dc0-8f6f-faa925cb8d61 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5/action" status: 202 len: 0 microversion: 2.1 time: 0.678531 Mar 12 20:54:35.746662 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1206/1974] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:54:35 2022] POST /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:35.756116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e25d4127-56ed-411e-a441-4cdeb2b2ee7c tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:35.757320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e25d4127-56ed-411e-a441-4cdeb2b2ee7c tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:35.773312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e25d4127-56ed-411e-a441-4cdeb2b2ee7c tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:35.774119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e25d4127-56ed-411e-a441-4cdeb2b2ee7c tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:35.776518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e25d4127-56ed-411e-a441-4cdeb2b2ee7c tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:35.778239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e25d4127-56ed-411e-a441-4cdeb2b2ee7c tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:36.161918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e25d4127-56ed-411e-a441-4cdeb2b2ee7c tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:36.173933 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e25d4127-56ed-411e-a441-4cdeb2b2ee7c tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1522 microversion: 2.1 time: 0.425036 Mar 12 20:54:36.174531 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1207/1975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:35 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:36.444543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7dde66d-9d87-4727-8904-98d56292a74a tempest-ListImageFiltersNegativeTestJSON-341856772 tempest-ListImageFiltersNegativeTestJSON-341856772-project] Calling method '.version_select at 0x7f6e48d5ce50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:36.484960 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f7dde66d-9d87-4727-8904-98d56292a74a tempest-ListImageFiltersNegativeTestJSON-341856772 tempest-ListImageFiltersNegativeTestJSON-341856772-project] HTTP exception thrown: Image not found. Mar 12 20:54:36.485751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7dde66d-9d87-4727-8904-98d56292a74a tempest-ListImageFiltersNegativeTestJSON-341856772 tempest-ListImageFiltersNegativeTestJSON-341856772-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:36.486782 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f7dde66d-9d87-4727-8904-98d56292a74a tempest-ListImageFiltersNegativeTestJSON-341856772 tempest-ListImageFiltersNegativeTestJSON-341856772-project] 10.222.0.30 "GET /compute/v2.1/images/6ed93e41-e6ee-4ab3-bf16-3882ebae3d67" status: 404 len: 62 microversion: 2.1 time: 0.308010 Mar 12 20:54:36.487738 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1208/1976] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:54:36 2022] GET /compute/v2.1/images/6ed93e41-e6ee-4ab3-bf16-3882ebae3d67 => generated 62 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:54:36.497169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1b7bba4d-4f4e-4941-8337-2fa458d9319f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:36.498682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1b7bba4d-4f4e-4941-8337-2fa458d9319f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:36.511331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b7bba4d-4f4e-4941-8337-2fa458d9319f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:36.513970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b7bba4d-4f4e-4941-8337-2fa458d9319f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:36.515961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b7bba4d-4f4e-4941-8337-2fa458d9319f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:36.519002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b7bba4d-4f4e-4941-8337-2fa458d9319f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:36.842200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1b7bba4d-4f4e-4941-8337-2fa458d9319f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:36.852896 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1b7bba4d-4f4e-4941-8337-2fa458d9319f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182" status: 200 len: 1520 microversion: 2.1 time: 0.363785 Mar 12 20:54:36.853491 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1209/1977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:36 2022] GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:36.861490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7469462d-53d3-48a2-b1d9-e12ead4acb26 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48cb0670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:37.432993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-7469462d-53d3-48a2-b1d9-e12ead4acb26 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 1b0e47ee-b662-4717-bb01-56e3abba40a4 in use.", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:54:37.434201 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-7469462d-53d3-48a2-b1d9-e12ead4acb26 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Security Group 1b0e47ee-b662-4717-bb01-56e3abba40a4 in use. Mar 12 20:54:37.434201 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-72f0b949-d31b-4014-9194-db4b2804fec9'] Mar 12 20:54:37.435865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7469462d-53d3-48a2-b1d9-e12ead4acb26 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 400 to user: Security Group 1b0e47ee-b662-4717-bb01-56e3abba40a4 in use. Mar 12 20:54:37.435865 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-72f0b949-d31b-4014-9194-db4b2804fec9'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:37.437609 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7469462d-53d3-48a2-b1d9-e12ead4acb26 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/1b0e47ee-b662-4717-bb01-56e3abba40a4" status: 400 len: 185 microversion: 2.1 time: 0.583081 Mar 12 20:54:37.439110 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1210/1978] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:54:36 2022] DELETE /compute/v2.1/os-security-groups/1b0e47ee-b662-4717-bb01-56e3abba40a4 => generated 185 bytes in 585 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:54:37.445637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bb207f3c-72ab-4df8-9d90-ff2535c66dac req-f4229c9a-afd4-4187-85a6-3c35c9d14ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9c4738-03fa-4cbc-a9a2-0648450befb5", "tag": "cdb1e534-85b7-4963-aa13-4a5219d8ce83"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:37.459031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bb207f3c-72ab-4df8-9d90-ff2535c66dac req-f4229c9a-afd4-4187-85a6-3c35c9d14ffa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:37.459822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bb207f3c-72ab-4df8-9d90-ff2535c66dac req-f4229c9a-afd4-4187-85a6-3c35c9d14ffa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:37.475280 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bb207f3c-72ab-4df8-9d90-ff2535c66dac req-f4229c9a-afd4-4187-85a6-3c35c9d14ffa service nova] Creating event network-changed:cdb1e534-85b7-4963-aa13-4a5219d8ce83 for instance da9c4738-03fa-4cbc-a9a2-0648450befb5 on nch2-master-1 Mar 12 20:54:37.482066 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bb207f3c-72ab-4df8-9d90-ff2535c66dac req-f4229c9a-afd4-4187-85a6-3c35c9d14ffa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041429 Mar 12 20:54:37.483304 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1211/1979] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:37.489403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-520acd14-3067-42fe-99d3-c1e03e7bf9f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:37.490539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-520acd14-3067-42fe-99d3-c1e03e7bf9f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 49462c08-773d-44d6-8122-ca42b0c747ef] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:37.498250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-520acd14-3067-42fe-99d3-c1e03e7bf9f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:37.499276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-520acd14-3067-42fe-99d3-c1e03e7bf9f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:37.500447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-520acd14-3067-42fe-99d3-c1e03e7bf9f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:37.501117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-520acd14-3067-42fe-99d3-c1e03e7bf9f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:37.756876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-520acd14-3067-42fe-99d3-c1e03e7bf9f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:37.770334 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-520acd14-3067-42fe-99d3-c1e03e7bf9f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef" status: 200 len: 1313 microversion: 2.1 time: 0.285388 Mar 12 20:54:37.772016 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1212/1980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:37 2022] GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:37.780089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a5f2665-521a-4818-a036-2410f2031f40 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:37.780984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a5f2665-521a-4818-a036-2410f2031f40 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:37.789545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a5f2665-521a-4818-a036-2410f2031f40 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:37.790245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a5f2665-521a-4818-a036-2410f2031f40 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:37.791546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a5f2665-521a-4818-a036-2410f2031f40 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:37.792233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a5f2665-521a-4818-a036-2410f2031f40 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:38.191610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8a5f2665-521a-4818-a036-2410f2031f40 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:38.206348 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a5f2665-521a-4818-a036-2410f2031f40 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1522 microversion: 2.1 time: 0.432947 Mar 12 20:54:38.206939 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1213/1981] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:37 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:38.504245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5c6f1fa-8d90-4b29-8b8a-20dde7978993 tempest-QuotaClassesAdmin257Test-1127610336 tempest-QuotaClassesAdmin257Test-1127610336-project-admin] Calling method '.version_select at 0x7f6e48d11310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:38.505563 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:54:38.505563 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:54:38.534788 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c5c6f1fa-8d90-4b29-8b8a-20dde7978993 tempest-QuotaClassesAdmin257Test-1127610336 tempest-QuotaClassesAdmin257Test-1127610336-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.326467 Mar 12 20:54:38.543193 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1214/1982] 10.222.0.30 () {60 vars in 1225 bytes} [Sat Mar 12 20:54:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:54:38.554550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09922658-2d24-4219-bd62-a8332a27d233 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Action: 'action', calling method: .version_select at 0x7f6e45f53670>, body: {"addFloatingIp": {"address": "172.35.0.129"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:38.556465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-09922658-2d24-4219-bd62-a8332a27d233 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:38.603848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09922658-2d24-4219-bd62-a8332a27d233 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:38.604726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09922658-2d24-4219-bd62-a8332a27d233 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:38.607607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09922658-2d24-4219-bd62-a8332a27d233 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:38.608627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09922658-2d24-4219-bd62-a8332a27d233 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:38.719174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09922658-2d24-4219-bd62-a8332a27d233 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Acquired lock "refresh_cache-a1757801-9401-43bb-9739-88275226163b" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 20:54:40.441087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-09922658-2d24-4219-bd62-a8332a27d233 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Building network info cache for instance {{(pid=136302) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 12 20:54:41.147665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-09922658-2d24-4219-bd62-a8332a27d233 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Updating instance_info_cache with network_info: [{"id": "fd63e40c-0216-442b-b910-13f01aad794f", "address": "fa:16:3e:8c:0e:74", "network": {"id": "34a96fe2-32a3-4bf3-8c1e-f56f90cdec96", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-963529398-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bea8388cb0554c74b7db0bedfb0ca482", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfd63e40c-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136302) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 12 20:54:41.166835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09922658-2d24-4219-bd62-a8332a27d233 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Releasing lock "refresh_cache-a1757801-9401-43bb-9739-88275226163b" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 20:54:41.168221 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09922658-2d24-4219-bd62-a8332a27d233 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "POST /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b/action" status: 202 len: 0 microversion: 2.1 time: 2.622474 Mar 12 20:54:41.169608 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1215/1983] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:54:38 2022] POST /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b/action => generated 0 bytes in 2625 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 12 20:54:41.175097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4d3829f-37fb-45d3-bd58-94dddb90f015 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:41.175851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b4d3829f-37fb-45d3-bd58-94dddb90f015 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:41.182610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4d3829f-37fb-45d3-bd58-94dddb90f015 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:41.183329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4d3829f-37fb-45d3-bd58-94dddb90f015 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:41.185225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4d3829f-37fb-45d3-bd58-94dddb90f015 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:41.185915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4d3829f-37fb-45d3-bd58-94dddb90f015 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:41.222999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b4d3829f-37fb-45d3-bd58-94dddb90f015 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:54:41.335037 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b4d3829f-37fb-45d3-bd58-94dddb90f015 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5" status: 204 len: 0 microversion: 2.1 time: 0.163882 Mar 12 20:54:41.335640 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1216/1984] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:54:41 2022] DELETE /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:54:41.347978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0971e61a-d5e1-4bd3-8b46-5ea9b6fe0905 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-288390445", "metadata": {"": ""}}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:41.366255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0971e61a-d5e1-4bd3-8b46-5ea9b6fe0905 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:41.367247 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0971e61a-d5e1-4bd3-8b46-5ea9b6fe0905 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "POST /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850/action" status: 400 len: 170 microversion: 2.1 time: 0.027120 Mar 12 20:54:41.371069 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1217/1985] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Mar 12 20:54:41 2022] POST /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850/action => generated 170 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:54:41.377458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5035bbb8-bd52-4944-b03a-32f5d9dc244e tempest-QuotaClassesAdmin257Test-1127610336 tempest-QuotaClassesAdmin257Test-1127610336-project-admin] Action: 'update', calling method: .version_select at 0x7f6e48d5ce50>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:41.383275 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:54:41.383275 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:54:41.535918 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5035bbb8-bd52-4944-b03a-32f5d9dc244e tempest-QuotaClassesAdmin257Test-1127610336 tempest-QuotaClassesAdmin257Test-1127610336-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.164830 Mar 12 20:54:41.538992 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1218/1986] 10.222.0.30 () {62 vars in 1246 bytes} [Sat Mar 12 20:54:41 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:54:41.545597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-237a248e-2c88-4bae-af97-59cf7145a6a4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:41.557847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-237a248e-2c88-4bae-af97-59cf7145a6a4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 49462c08-773d-44d6-8122-ca42b0c747ef] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:41.568519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-237a248e-2c88-4bae-af97-59cf7145a6a4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:41.569410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-237a248e-2c88-4bae-af97-59cf7145a6a4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:41.573399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-237a248e-2c88-4bae-af97-59cf7145a6a4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:41.574180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-237a248e-2c88-4bae-af97-59cf7145a6a4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:41.787404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-237a248e-2c88-4bae-af97-59cf7145a6a4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:41.800324 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-237a248e-2c88-4bae-af97-59cf7145a6a4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef" status: 200 len: 1313 microversion: 2.1 time: 0.259034 Mar 12 20:54:41.800932 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1219/1987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:41 2022] GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:41.822591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ed1ffbf0-7512-41d1-9c8d-c746df7573f0 req-5b33699e-132c-4db8-a5e2-3efa0002f826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49462c08-773d-44d6-8122-ca42b0c747ef", "tag": "e398a928-4978-47a9-99c7-cf09b38614c3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:41.848541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ed1ffbf0-7512-41d1-9c8d-c746df7573f0 req-5b33699e-132c-4db8-a5e2-3efa0002f826 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:41.849314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ed1ffbf0-7512-41d1-9c8d-c746df7573f0 req-5b33699e-132c-4db8-a5e2-3efa0002f826 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:41.877721 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ed1ffbf0-7512-41d1-9c8d-c746df7573f0 req-5b33699e-132c-4db8-a5e2-3efa0002f826 service nova] Creating event network-changed:e398a928-4978-47a9-99c7-cf09b38614c3 for instance 49462c08-773d-44d6-8122-ca42b0c747ef on nch1-master-1 Mar 12 20:54:41.883677 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ed1ffbf0-7512-41d1-9c8d-c746df7573f0 req-5b33699e-132c-4db8-a5e2-3efa0002f826 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081348 Mar 12 20:54:41.885318 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1220/1988] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:42.054458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7af492f-9d2b-436f-b749-d6e8a30804bc tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Calling method '.version_select at 0x7f6e48ccf940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:42.139540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-e7af492f-9d2b-436f-b749-d6e8a30804bc tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 39b2d3c1-d809-42ce-9be5-f918eb273ca3 does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:54:42.141033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-e7af492f-9d2b-436f-b749-d6e8a30804bc tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Neutron security group 39b2d3c1-d809-42ce-9be5-f918eb273ca3 not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:54:42.143220 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e7af492f-9d2b-436f-b749-d6e8a30804bc tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] HTTP exception thrown: Security group 39b2d3c1-d809-42ce-9be5-f918eb273ca3 does not exist Mar 12 20:54:42.143220 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-8d4820c1-661f-4c68-930b-73de9ec5540f'] Mar 12 20:54:42.144761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7af492f-9d2b-436f-b749-d6e8a30804bc tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Returning 404 to user: Security group 39b2d3c1-d809-42ce-9be5-f918eb273ca3 does not exist Mar 12 20:54:42.144761 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-8d4820c1-661f-4c68-930b-73de9ec5540f'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:42.147247 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e7af492f-9d2b-436f-b749-d6e8a30804bc tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/39b2d3c1-d809-42ce-9be5-f918eb273ca3" status: 404 len: 194 microversion: 2.1 time: 0.259932 Mar 12 20:54:42.148132 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1221/1989] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:54:41 2022] DELETE /compute/v2.1/os-security-groups/39b2d3c1-d809-42ce-9be5-f918eb273ca3 => generated 194 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:42.158370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.129"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:42.160536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:42.171584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:42.173360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:42.175025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:42.175715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:42.209942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Acquired lock "refresh_cache-993ea61d-e3db-46d0-a7c8-830cef8ad182" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 20:54:44.627023 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.network.neutron [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] re-assign floating IP 172.35.0.129 from instance a1757801-9401-43bb-9739-88275226163b Mar 12 20:54:44.679972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Building network info cache for instance {{(pid=136302) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 12 20:54:45.239065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Updating instance_info_cache with network_info: [{"id": "fd63e40c-0216-442b-b910-13f01aad794f", "address": "fa:16:3e:8c:0e:74", "network": {"id": "34a96fe2-32a3-4bf3-8c1e-f56f90cdec96", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-963529398-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bea8388cb0554c74b7db0bedfb0ca482", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfd63e40c-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136302) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 12 20:54:45.254759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Building network info cache for instance {{(pid=136302) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 12 20:54:45.815844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Updating instance_info_cache with network_info: [{"id": "1f65e31a-18ac-4f20-88b6-ab21f98f3482", "address": "fa:16:3e:fa:61:5d", "network": {"id": "34a96fe2-32a3-4bf3-8c1e-f56f90cdec96", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-963529398-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bea8388cb0554c74b7db0bedfb0ca482", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1f65e31a-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136302) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 12 20:54:45.828416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Releasing lock "refresh_cache-993ea61d-e3db-46d0-a7c8-830cef8ad182" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 20:54:45.830335 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a840f249-15b1-48e5-9551-de2eee55cb32 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "POST /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182/action" status: 202 len: 0 microversion: 2.1 time: 3.679884 Mar 12 20:54:45.831418 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1222/1990] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:54:42 2022] POST /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182/action => generated 0 bytes in 3682 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 12 20:54:45.839700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-62307449-db54-43dc-b61a-b8cc9de79da9 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:45.840500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-62307449-db54-43dc-b61a-b8cc9de79da9 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:45.847660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62307449-db54-43dc-b61a-b8cc9de79da9 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:45.848203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62307449-db54-43dc-b61a-b8cc9de79da9 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:45.849038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62307449-db54-43dc-b61a-b8cc9de79da9 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:45.849543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62307449-db54-43dc-b61a-b8cc9de79da9 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:46.072849 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-62307449-db54-43dc-b61a-b8cc9de79da9 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Instance da9c4738-03fa-4cbc-a9a2-0648450befb5 could not be found. Mar 12 20:54:46.073474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-62307449-db54-43dc-b61a-b8cc9de79da9 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Instance da9c4738-03fa-4cbc-a9a2-0648450befb5 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:46.074600 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-62307449-db54-43dc-b61a-b8cc9de79da9 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5" status: 404 len: 111 microversion: 2.1 time: 0.238450 Mar 12 20:54:46.075170 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1223/1991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:45 2022] GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5 => generated 111 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:46.080223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-19bf79b3-0ce9-4136-a9b7-8bbb79aaf1e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:46.080838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19bf79b3-0ce9-4136-a9b7-8bbb79aaf1e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:46.086581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19bf79b3-0ce9-4136-a9b7-8bbb79aaf1e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:46.087042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19bf79b3-0ce9-4136-a9b7-8bbb79aaf1e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:46.087822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19bf79b3-0ce9-4136-a9b7-8bbb79aaf1e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:46.088265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19bf79b3-0ce9-4136-a9b7-8bbb79aaf1e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:46.221676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-19bf79b3-0ce9-4136-a9b7-8bbb79aaf1e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:46.229018 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-19bf79b3-0ce9-4136-a9b7-8bbb79aaf1e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1522 microversion: 2.1 time: 0.152350 Mar 12 20:54:46.229585 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1224/1992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:46 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:46.234052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f26de71-9220-42d2-bce5-fde8069cef1e tempest-QuotaClassesAdmin257Test-1127610336 tempest-QuotaClassesAdmin257Test-1127610336-project-admin] Calling method '.version_select at 0x7f6e48cb0dc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:46.234936 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:54:46.234936 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:54:46.247489 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f26de71-9220-42d2-bce5-fde8069cef1e tempest-QuotaClassesAdmin257Test-1127610336 tempest-QuotaClassesAdmin257Test-1127610336-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.016815 Mar 12 20:54:46.248050 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1225/1993] 10.222.0.30 () {60 vars in 1225 bytes} [Sat Mar 12 20:54:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:54:46.252574 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1a7eea34-ff19-48ae-b08a-678db349c91c tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003596 Mar 12 20:54:46.253162 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1226/1994] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Mar 12 20:54:46 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 12 20:54:46.311647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2267b5a5-de90-4574-bef3-35b40c934baf tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] Action: 'create', calling method: .version_select at 0x7f6e48cdb820>, body: {"pool": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:47.476114 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2267b5a5-de90-4574-bef3-35b40c934baf tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.218230 Mar 12 20:54:47.477588 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1227/1995] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Mar 12 20:54:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:47.484672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f09fae5b-4b19-47e0-a248-42e4268da0f5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:47.485415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f09fae5b-4b19-47e0-a248-42e4268da0f5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 49462c08-773d-44d6-8122-ca42b0c747ef] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:47.492081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f09fae5b-4b19-47e0-a248-42e4268da0f5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:47.492549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f09fae5b-4b19-47e0-a248-42e4268da0f5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:47.493372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f09fae5b-4b19-47e0-a248-42e4268da0f5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:47.493888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f09fae5b-4b19-47e0-a248-42e4268da0f5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:47.628398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f09fae5b-4b19-47e0-a248-42e4268da0f5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:47.635838 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f09fae5b-4b19-47e0-a248-42e4268da0f5 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef" status: 200 len: 1313 microversion: 2.1 time: 0.156916 Mar 12 20:54:47.636401 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1228/1996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:47 2022] GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:47.648644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8a82bea1-8a2c-4fea-9044-30502ef4bbb4 req-f6660dbd-5a21-4206-8084-c7794a4fe52d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1757801-9401-43bb-9739-88275226163b", "tag": "fd63e40c-0216-442b-b910-13f01aad794f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:47.658919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8a82bea1-8a2c-4fea-9044-30502ef4bbb4 req-f6660dbd-5a21-4206-8084-c7794a4fe52d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:47.659447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8a82bea1-8a2c-4fea-9044-30502ef4bbb4 req-f6660dbd-5a21-4206-8084-c7794a4fe52d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:47.671602 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8a82bea1-8a2c-4fea-9044-30502ef4bbb4 req-f6660dbd-5a21-4206-8084-c7794a4fe52d service nova] Creating event network-changed:fd63e40c-0216-442b-b910-13f01aad794f for instance a1757801-9401-43bb-9739-88275226163b on nch2-master-1 Mar 12 20:54:47.678037 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8a82bea1-8a2c-4fea-9044-30502ef4bbb4 req-f6660dbd-5a21-4206-8084-c7794a4fe52d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039937 Mar 12 20:54:47.678823 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1229/1997] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:47.686052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5b217a70-b49b-4d58-bc91-cedc23b7e944 req-1e5f2adc-d93d-4b65-b778-b6b27c989d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9c4738-03fa-4cbc-a9a2-0648450befb5", "name": "network-vif-deleted", "tag": "cdb1e534-85b7-4963-aa13-4a5219d8ce83"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:47.695855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5b217a70-b49b-4d58-bc91-cedc23b7e944 req-1e5f2adc-d93d-4b65-b778-b6b27c989d8b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:47.696483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5b217a70-b49b-4d58-bc91-cedc23b7e944 req-1e5f2adc-d93d-4b65-b778-b6b27c989d8b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:47.709498 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5b217a70-b49b-4d58-bc91-cedc23b7e944 req-1e5f2adc-d93d-4b65-b778-b6b27c989d8b service nova] Creating event network-vif-deleted:cdb1e534-85b7-4963-aa13-4a5219d8ce83 for instance da9c4738-03fa-4cbc-a9a2-0648450befb5 on nch2-master-1 Mar 12 20:54:47.716380 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5b217a70-b49b-4d58-bc91-cedc23b7e944 req-1e5f2adc-d93d-4b65-b778-b6b27c989d8b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035562 Mar 12 20:54:47.717751 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1230/1998] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:47.724784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7de6c1d-377d-4db7-888e-39fe1b0643df tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Action: 'action', calling method: .version_select at 0x7f6e45f53820>, body: {"removeFloatingIp": {"address": "172.35.0.129"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:47.898094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e7de6c1d-377d-4db7-888e-39fe1b0643df tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:47.906873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7de6c1d-377d-4db7-888e-39fe1b0643df tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:47.907329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7de6c1d-377d-4db7-888e-39fe1b0643df tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:47.908124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7de6c1d-377d-4db7-888e-39fe1b0643df tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:47.908565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7de6c1d-377d-4db7-888e-39fe1b0643df tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:48.127858 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e7de6c1d-377d-4db7-888e-39fe1b0643df tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] HTTP exception thrown: Floating IP 172.35.0.129 is not associated with instance a1757801-9401-43bb-9739-88275226163b. Mar 12 20:54:48.128549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7de6c1d-377d-4db7-888e-39fe1b0643df tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Returning 409 to user: Floating IP 172.35.0.129 is not associated with instance a1757801-9401-43bb-9739-88275226163b. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:48.129482 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e7de6c1d-377d-4db7-888e-39fe1b0643df tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "POST /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b/action" status: 409 len: 146 microversion: 2.1 time: 0.410374 Mar 12 20:54:48.133667 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1231/1999] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:54:47 2022] POST /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b/action => generated 146 bytes in 415 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:54:48.138709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-deecc002-3da5-4a00-8ca4-d1c9eca82899 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48cdb280>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:48.334785 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-deecc002-3da5-4a00-8ca4-d1c9eca82899 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/8f925d6f-e6d1-401d-b6a3-81bd6e554c85" status: 202 len: 0 microversion: 2.1 time: 0.199749 Mar 12 20:54:48.335473 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1232/2000] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:54:48 2022] DELETE /compute/v2.1/os-security-groups/8f925d6f-e6d1-401d-b6a3-81bd6e554c85 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:48.342057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-64e79627-40ce-4170-b39f-24756f7603ab tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:48.342999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-64e79627-40ce-4170-b39f-24756f7603ab tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:48.349860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64e79627-40ce-4170-b39f-24756f7603ab tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:48.350402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64e79627-40ce-4170-b39f-24756f7603ab tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:48.351481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64e79627-40ce-4170-b39f-24756f7603ab tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:48.352100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64e79627-40ce-4170-b39f-24756f7603ab tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:48.493859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-64e79627-40ce-4170-b39f-24756f7603ab tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:48.501682 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-64e79627-40ce-4170-b39f-24756f7603ab tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1522 microversion: 2.1 time: 0.164745 Mar 12 20:54:48.502311 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1233/2001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:48 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:48.507865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f2f3137-5d7b-4c8b-be19-205d2d929435 tempest-QuotaClassesAdmin257Test-1127610336 tempest-QuotaClassesAdmin257Test-1127610336-project-admin] Action: 'update', calling method: .version_select at 0x7f6e48cdbdc0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:48.509839 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:54:48.509839 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:54:48.574685 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f2f3137-5d7b-4c8b-be19-205d2d929435 tempest-QuotaClassesAdmin257Test-1127610336 tempest-QuotaClassesAdmin257Test-1127610336-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.070404 Mar 12 20:54:48.575904 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1234/2002] 10.222.0.30 () {62 vars in 1246 bytes} [Sat Mar 12 20:54:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:54:48.582875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7c8fcb8-8f16-4162-a57e-1b25d007617c tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Calling method '.version_select at 0x7f6e48ccd9d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:48.730885 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7c8fcb8-8f16-4162-a57e-1b25d007617c tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.151937 Mar 12 20:54:48.731644 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1235/2003] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 20:54:48 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:48.736739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-180ff4ef-f844-4f94-a4b1-e9eed8757cc9 tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] Calling method '.version_select at 0x7f6e48cb0160>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:48.946448 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-180ff4ef-f844-4f94-a4b1-e9eed8757cc9 tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/9724d83e-fb97-451d-a0c0-2bf5d2cb0f6a" status: 200 len: 142 microversion: 2.1 time: 0.213433 Mar 12 20:54:48.947032 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1236/2004] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Mar 12 20:54:48 2022] GET /compute/v2.1/os-floating-ips/9724d83e-fb97-451d-a0c0-2bf5d2cb0f6a => generated 142 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:48.952431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-38dbd200-c43a-42c7-81ad-63084e9dda81 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.129"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:49.394536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-38dbd200-c43a-42c7-81ad-63084e9dda81 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:49.402895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38dbd200-c43a-42c7-81ad-63084e9dda81 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:49.404072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38dbd200-c43a-42c7-81ad-63084e9dda81 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:49.405059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38dbd200-c43a-42c7-81ad-63084e9dda81 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:49.405670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38dbd200-c43a-42c7-81ad-63084e9dda81 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:49.625124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38dbd200-c43a-42c7-81ad-63084e9dda81 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Acquired lock "refresh_cache-993ea61d-e3db-46d0-a7c8-830cef8ad182" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 20:54:50.295784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-38dbd200-c43a-42c7-81ad-63084e9dda81 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Building network info cache for instance {{(pid=136302) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 12 20:54:50.851159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-38dbd200-c43a-42c7-81ad-63084e9dda81 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Updating instance_info_cache with network_info: [{"id": "1f65e31a-18ac-4f20-88b6-ab21f98f3482", "address": "fa:16:3e:fa:61:5d", "network": {"id": "34a96fe2-32a3-4bf3-8c1e-f56f90cdec96", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-963529398-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bea8388cb0554c74b7db0bedfb0ca482", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1f65e31a-18", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136302) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 12 20:54:50.865353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38dbd200-c43a-42c7-81ad-63084e9dda81 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Releasing lock "refresh_cache-993ea61d-e3db-46d0-a7c8-830cef8ad182" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 20:54:50.866471 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-38dbd200-c43a-42c7-81ad-63084e9dda81 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "POST /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182/action" status: 202 len: 0 microversion: 2.1 time: 1.918512 Mar 12 20:54:50.868059 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1237/2005] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:54:48 2022] POST /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182/action => generated 0 bytes in 1920 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 12 20:54:50.874195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-41978320-c0fb-4f06-a71d-bc4a8727fef4 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48cdb0d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:51.072509 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-41978320-c0fb-4f06-a71d-bc4a8727fef4 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/1b0e47ee-b662-4717-bb01-56e3abba40a4" status: 202 len: 0 microversion: 2.1 time: 0.201836 Mar 12 20:54:51.072509 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1238/2006] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:54:50 2022] DELETE /compute/v2.1/os-security-groups/1b0e47ee-b662-4717-bb01-56e3abba40a4 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:51.085755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2f75e075-ff19-433e-a3f0-09767c17ee59 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1836812748", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:51.087965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2f75e075-ff19-433e-a3f0-09767c17ee59 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:51.096597 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2f75e075-ff19-433e-a3f0-09767c17ee59 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "POST /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850/action" status: 400 len: 938 microversion: 2.1 time: 0.016016 Mar 12 20:54:51.097442 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1239/2007] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Mar 12 20:54:51 2022] POST /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850/action => generated 938 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:54:51.105201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-610b9051-17cb-4d37-988e-faecdea4b5e9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:51.107380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-610b9051-17cb-4d37-988e-faecdea4b5e9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 49462c08-773d-44d6-8122-ca42b0c747ef] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:51.124764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-610b9051-17cb-4d37-988e-faecdea4b5e9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:51.125361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-610b9051-17cb-4d37-988e-faecdea4b5e9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:51.126348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-610b9051-17cb-4d37-988e-faecdea4b5e9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:51.126801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-610b9051-17cb-4d37-988e-faecdea4b5e9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:51.293002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-610b9051-17cb-4d37-988e-faecdea4b5e9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:51.302840 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-610b9051-17cb-4d37-988e-faecdea4b5e9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef" status: 200 len: 1313 microversion: 2.1 time: 0.202936 Mar 12 20:54:51.303754 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1240/2008] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:51 2022] GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:51.308851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7e2acd1-87af-4614-8209-f52e141bfc07 tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Calling method '.version_select at 0x7f6e48ccd9d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:51.439313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-c7e2acd1-87af-4614-8209-f52e141bfc07 tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:54:51.440013 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c7e2acd1-87af-4614-8209-f52e141bfc07 tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] HTTP exception thrown: Insufficient rights for removing default security group. Mar 12 20:54:51.440013 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-0802c692-a133-497a-8b5e-331eed26091f'] Mar 12 20:54:51.440612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7e2acd1-87af-4614-8209-f52e141bfc07 tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Returning 400 to user: Insufficient rights for removing default security group. Mar 12 20:54:51.440612 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-0802c692-a133-497a-8b5e-331eed26091f'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:51.442051 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7e2acd1-87af-4614-8209-f52e141bfc07 tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/bf11b2fc-0460-48ab-aaea-1dcfeefab9e5" status: 400 len: 182 microversion: 2.1 time: 0.136685 Mar 12 20:54:51.442879 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1241/2009] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:54:51 2022] DELETE /compute/v2.1/os-security-groups/bf11b2fc-0460-48ab-aaea-1dcfeefab9e5 => generated 182 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:54:51.453129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3fb34a85-3d7e-4dfe-b9de-471dadb2c5fe req-d4c00f25-de01-4a86-b14b-0d6835e9b4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49462c08-773d-44d6-8122-ca42b0c747ef", "name": "network-vif-plugged", "status": "completed", "tag": "e398a928-4978-47a9-99c7-cf09b38614c3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:51.462896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3fb34a85-3d7e-4dfe-b9de-471dadb2c5fe req-d4c00f25-de01-4a86-b14b-0d6835e9b4ba service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:51.463343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3fb34a85-3d7e-4dfe-b9de-471dadb2c5fe req-d4c00f25-de01-4a86-b14b-0d6835e9b4ba service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:51.474900 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3fb34a85-3d7e-4dfe-b9de-471dadb2c5fe req-d4c00f25-de01-4a86-b14b-0d6835e9b4ba service nova] Creating event network-vif-plugged:e398a928-4978-47a9-99c7-cf09b38614c3 for instance 49462c08-773d-44d6-8122-ca42b0c747ef on nch1-master-1 Mar 12 20:54:51.481197 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3fb34a85-3d7e-4dfe-b9de-471dadb2c5fe req-d4c00f25-de01-4a86-b14b-0d6835e9b4ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036547 Mar 12 20:54:51.482826 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1242/2010] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:51.488205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9c03856-9a60-4fac-97ca-1ee3bf784267 tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] Calling method '.version_select at 0x7f6e48ccdca0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:51.767462 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9c03856-9a60-4fac-97ca-1ee3bf784267 tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.282937 Mar 12 20:54:51.768149 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1243/2011] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Mar 12 20:54:51 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:51.773504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8a83262a-a9fe-4d36-b5e1-a179d1c746df req-44c6e5dc-ddea-4e92-9155-f8ae3a2608ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1757801-9401-43bb-9739-88275226163b", "tag": "fd63e40c-0216-442b-b910-13f01aad794f"}, {"name": "network-changed", "server_uuid": "993ea61d-e3db-46d0-a7c8-830cef8ad182", "tag": "1f65e31a-18ac-4f20-88b6-ab21f98f3482"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:51.783251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8a83262a-a9fe-4d36-b5e1-a179d1c746df req-44c6e5dc-ddea-4e92-9155-f8ae3a2608ac service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:51.783710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8a83262a-a9fe-4d36-b5e1-a179d1c746df req-44c6e5dc-ddea-4e92-9155-f8ae3a2608ac service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:51.797398 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8a83262a-a9fe-4d36-b5e1-a179d1c746df req-44c6e5dc-ddea-4e92-9155-f8ae3a2608ac service nova] Creating event network-changed:fd63e40c-0216-442b-b910-13f01aad794f for instance a1757801-9401-43bb-9739-88275226163b on nch2-master-1 Mar 12 20:54:51.797979 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8a83262a-a9fe-4d36-b5e1-a179d1c746df req-44c6e5dc-ddea-4e92-9155-f8ae3a2608ac service nova] Creating event network-changed:1f65e31a-18ac-4f20-88b6-ab21f98f3482 for instance 993ea61d-e3db-46d0-a7c8-830cef8ad182 on nch2-master-1 Mar 12 20:54:51.805489 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8a83262a-a9fe-4d36-b5e1-a179d1c746df req-44c6e5dc-ddea-4e92-9155-f8ae3a2608ac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035988 Mar 12 20:54:51.806133 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1244/2012] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:51.811372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b6e02ada-ac71-4304-9dc4-29f0c5198cdf tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:51.811964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b6e02ada-ac71-4304-9dc4-29f0c5198cdf tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:51.818460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b6e02ada-ac71-4304-9dc4-29f0c5198cdf tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:51.818920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b6e02ada-ac71-4304-9dc4-29f0c5198cdf tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:51.819705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b6e02ada-ac71-4304-9dc4-29f0c5198cdf tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:51.820156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b6e02ada-ac71-4304-9dc4-29f0c5198cdf tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:51.846338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b6e02ada-ac71-4304-9dc4-29f0c5198cdf tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:54:51.921299 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b6e02ada-ac71-4304-9dc4-29f0c5198cdf tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "DELETE /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182" status: 204 len: 0 microversion: 2.1 time: 0.113786 Mar 12 20:54:51.926956 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1245/2013] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:54:51 2022] DELETE /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:54:51.932324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-034ac79a-2a95-4ea0-a86f-44e025bfa8cb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'create', calling method: .version_select at 0x7f6e48ccfd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-189605361", "description": "tempest-description-1961287317"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:52.063950 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-034ac79a-2a95-4ea0-a86f-44e025bfa8cb tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.135667 Mar 12 20:54:52.070052 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1246/2014] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 20:54:51 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:52.075027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b544a7d9-82e3-4fb8-a25d-e4926914ebce tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:52.076398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b544a7d9-82e3-4fb8-a25d-e4926914ebce tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:52.091819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b544a7d9-82e3-4fb8-a25d-e4926914ebce tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:52.092287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b544a7d9-82e3-4fb8-a25d-e4926914ebce tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:52.093083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b544a7d9-82e3-4fb8-a25d-e4926914ebce tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:52.093532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b544a7d9-82e3-4fb8-a25d-e4926914ebce tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:52.228847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b544a7d9-82e3-4fb8-a25d-e4926914ebce tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:52.236391 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b544a7d9-82e3-4fb8-a25d-e4926914ebce tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1522 microversion: 2.1 time: 0.165213 Mar 12 20:54:52.236964 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1247/2015] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:52 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:52.241724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ffbfa07-fda7-499a-a719-39c4fef80d0d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:52.242193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ffbfa07-fda7-499a-a719-39c4fef80d0d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:52.247828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ffbfa07-fda7-499a-a719-39c4fef80d0d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:52.248345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ffbfa07-fda7-499a-a719-39c4fef80d0d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:52.249210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ffbfa07-fda7-499a-a719-39c4fef80d0d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:52.249661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ffbfa07-fda7-499a-a719-39c4fef80d0d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:52.278149 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ffbfa07-fda7-499a-a719-39c4fef80d0d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/os-volume_attachments/5c01ce6d-3ce1-40f2-b374-ddff1153114b" status: 200 len: 194 microversion: 2.20 time: 0.040084 Mar 12 20:54:52.279367 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1248/2016] 10.222.0.30 () {60 vars in 1453 bytes} [Sat Mar 12 20:54:52 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/os-volume_attachments/5c01ce6d-3ce1-40f2-b374-ddff1153114b => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:54:52.283788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ed65cad8-a493-467f-9811-96f0f227034a tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Calling method '.version_select at 0x7f6e48ccd040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:52.305495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-ed65cad8-a493-467f-9811-96f0f227034a tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 159f33c7-b894-4284-a348-3df7fcbbeeb1 does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:54:52.306151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-ed65cad8-a493-467f-9811-96f0f227034a tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Neutron security group 159f33c7-b894-4284-a348-3df7fcbbeeb1 not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:54:52.306983 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ed65cad8-a493-467f-9811-96f0f227034a tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] HTTP exception thrown: Security group 159f33c7-b894-4284-a348-3df7fcbbeeb1 does not exist Mar 12 20:54:52.306983 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-1300b9d6-f6a8-44d8-b643-e4a91a579495'] Mar 12 20:54:52.307601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ed65cad8-a493-467f-9811-96f0f227034a tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Returning 404 to user: Security group 159f33c7-b894-4284-a348-3df7fcbbeeb1 does not exist Mar 12 20:54:52.307601 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-1300b9d6-f6a8-44d8-b643-e4a91a579495'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:52.308439 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ed65cad8-a493-467f-9811-96f0f227034a tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/159f33c7-b894-4284-a348-3df7fcbbeeb1" status: 404 len: 194 microversion: 2.1 time: 0.028164 Mar 12 20:54:52.313234 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1249/2017] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 20:54:52 2022] GET /compute/v2.1/os-security-groups/159f33c7-b894-4284-a348-3df7fcbbeeb1 => generated 194 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:52.445938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d706b67c-0259-4ea0-b499-53c3ee95f0ee tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:52.447288 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:54:52.447288 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:54:52.448502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d706b67c-0259-4ea0-b499-53c3ee95f0ee tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:52.448963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d706b67c-0259-4ea0-b499-53c3ee95f0ee tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:52.449795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d706b67c-0259-4ea0-b499-53c3ee95f0ee tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:52.450804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d706b67c-0259-4ea0-b499-53c3ee95f0ee tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:52.473528 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d706b67c-0259-4ea0-b499-53c3ee95f0ee tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.163510 Mar 12 20:54:52.474135 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1250/2018] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:54:52 2022] GET /compute/v2.1/os-services => generated 947 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:52.478759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39f66d79-10d4-430f-b637-c6b41a343630 tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] Calling method '.version_select at 0x7f6e3670f310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:53.180772 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39f66d79-10d4-430f-b637-c6b41a343630 tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/9724d83e-fb97-451d-a0c0-2bf5d2cb0f6a" status: 202 len: 0 microversion: 2.1 time: 0.705541 Mar 12 20:54:53.181851 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1251/2019] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:54:52 2022] DELETE /compute/v2.1/os-floating-ips/9724d83e-fb97-451d-a0c0-2bf5d2cb0f6a => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:53.186857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af584e80-d98a-447f-a2c4-21baf10dc94f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.129"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:53.188045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af584e80-d98a-447f-a2c4-21baf10dc94f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:53.197633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af584e80-d98a-447f-a2c4-21baf10dc94f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:53.198216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af584e80-d98a-447f-a2c4-21baf10dc94f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:53.199070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af584e80-d98a-447f-a2c4-21baf10dc94f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:53.199516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af584e80-d98a-447f-a2c4-21baf10dc94f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:53.224672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af584e80-d98a-447f-a2c4-21baf10dc94f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Acquired lock "refresh_cache-a1757801-9401-43bb-9739-88275226163b" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 20:54:54.645921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-af584e80-d98a-447f-a2c4-21baf10dc94f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Building network info cache for instance {{(pid=136302) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 12 20:54:55.139622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-af584e80-d98a-447f-a2c4-21baf10dc94f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Updating instance_info_cache with network_info: [{"id": "fd63e40c-0216-442b-b910-13f01aad794f", "address": "fa:16:3e:8c:0e:74", "network": {"id": "34a96fe2-32a3-4bf3-8c1e-f56f90cdec96", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-963529398-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bea8388cb0554c74b7db0bedfb0ca482", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfd63e40c-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136302) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 12 20:54:55.150607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af584e80-d98a-447f-a2c4-21baf10dc94f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Releasing lock "refresh_cache-a1757801-9401-43bb-9739-88275226163b" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 20:54:55.151755 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af584e80-d98a-447f-a2c4-21baf10dc94f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "POST /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b/action" status: 202 len: 0 microversion: 2.1 time: 1.969182 Mar 12 20:54:55.152368 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1252/2020] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:54:53 2022] POST /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b/action => generated 0 bytes in 1970 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 12 20:54:55.157030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e4dd532d-95f3-43ea-92b2-f0a8da137105 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Action: 'update', calling method: .version_select at 0x7f6e3670f160>, body: {"security_group": {"name": "tempest-sg-hth-791263335", "description": "tempest-description-hth-2003424384"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:55.300147 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e4dd532d-95f3-43ea-92b2-f0a8da137105 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/3c6af828-363f-4bd2-9a3a-27b866cf8f0a" status: 200 len: 217 microversion: 2.1 time: 0.146621 Mar 12 20:54:55.300913 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1253/2021] 10.222.0.30 () {60 vars in 1289 bytes} [Sat Mar 12 20:54:55 2022] PUT /compute/v2.1/os-security-groups/3c6af828-363f-4bd2-9a3a-27b866cf8f0a => generated 217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:55.313657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6ba44e0-871b-4467-95f5-df748cb5437f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:55.314285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d6ba44e0-871b-4467-95f5-df748cb5437f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:55.320649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6ba44e0-871b-4467-95f5-df748cb5437f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:55.321107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6ba44e0-871b-4467-95f5-df748cb5437f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:55.321954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6ba44e0-871b-4467-95f5-df748cb5437f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:55.322406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6ba44e0-871b-4467-95f5-df748cb5437f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:55.457671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d6ba44e0-871b-4467-95f5-df748cb5437f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:55.465259 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d6ba44e0-871b-4467-95f5-df748cb5437f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1522 microversion: 2.1 time: 0.155932 Mar 12 20:54:55.466445 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1254/2022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:55 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:55.477061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2b444d39-5556-4ca9-88d8-7b5d0ae25837 tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Action: 'update', calling method: .version_select at 0x7f6e48d1bd30>, body: {"security_group": {"name": "tempest-sg-584509127", "description": "tempest-description-744548116"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:55.492716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-2b444d39-5556-4ca9-88d8-7b5d0ae25837 tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d5815248-7ab4-4124-9239-a8a322d00dfa does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:54:55.493386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-2b444d39-5556-4ca9-88d8-7b5d0ae25837 tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Neutron security group d5815248-7ab4-4124-9239-a8a322d00dfa not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:54:55.494032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-2b444d39-5556-4ca9-88d8-7b5d0ae25837 tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] HTTP exception thrown: Security group d5815248-7ab4-4124-9239-a8a322d00dfa does not exist Mar 12 20:54:55.494032 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-5307c467-1d09-435e-9a64-3ac318586613'] Mar 12 20:54:55.494772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2b444d39-5556-4ca9-88d8-7b5d0ae25837 tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] Returning 404 to user: Security group d5815248-7ab4-4124-9239-a8a322d00dfa does not exist Mar 12 20:54:55.494772 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-5307c467-1d09-435e-9a64-3ac318586613'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:55.495760 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2b444d39-5556-4ca9-88d8-7b5d0ae25837 tempest-SecurityGroupsNegativeTestJSON-527924878 tempest-SecurityGroupsNegativeTestJSON-527924878-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/d5815248-7ab4-4124-9239-a8a322d00dfa" status: 404 len: 194 microversion: 2.1 time: 0.028296 Mar 12 20:54:55.496413 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1255/2023] 10.222.0.30 () {60 vars in 1289 bytes} [Sat Mar 12 20:54:55 2022] PUT /compute/v2.1/os-security-groups/d5815248-7ab4-4124-9239-a8a322d00dfa => generated 194 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:54:55.503798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dfda10e5-5e12-4d15-8345-b18aff7fa46c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:55.503798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dfda10e5-5e12-4d15-8345-b18aff7fa46c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 49462c08-773d-44d6-8122-ca42b0c747ef] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:55.509982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfda10e5-5e12-4d15-8345-b18aff7fa46c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:55.510454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfda10e5-5e12-4d15-8345-b18aff7fa46c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:55.511259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfda10e5-5e12-4d15-8345-b18aff7fa46c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:55.511697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfda10e5-5e12-4d15-8345-b18aff7fa46c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:55.664349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dfda10e5-5e12-4d15-8345-b18aff7fa46c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:54:55.679482 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dfda10e5-5e12-4d15-8345-b18aff7fa46c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef" status: 200 len: 1462 microversion: 2.1 time: 0.181661 Mar 12 20:54:55.690366 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1256/2024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:54:55 2022] GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef => generated 1462 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:55.696851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a35eb9f7-8a7c-42fc-acb5-45b14910ab0f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:55.697725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a35eb9f7-8a7c-42fc-acb5-45b14910ab0f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:55.709253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a35eb9f7-8a7c-42fc-acb5-45b14910ab0f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:55.710546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a35eb9f7-8a7c-42fc-acb5-45b14910ab0f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:55.711522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a35eb9f7-8a7c-42fc-acb5-45b14910ab0f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:55.712133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a35eb9f7-8a7c-42fc-acb5-45b14910ab0f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:55.806780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-a35eb9f7-8a7c-42fc-acb5-45b14910ab0f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lazy-loading 'services' on Instance uuid 5ae82842-58a0-4d5e-a522-a1c83c53e101 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:54:55.894420 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a35eb9f7-8a7c-42fc-acb5-45b14910ab0f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/os-volume_attachments/5c01ce6d-3ce1-40f2-b374-ddff1153114b" status: 202 len: 0 microversion: 2.20 time: 0.201714 Mar 12 20:54:55.895023 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1257/2025] 10.222.0.30 () {60 vars in 1456 bytes} [Sat Mar 12 20:54:55 2022] DELETE /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/os-volume_attachments/5c01ce6d-3ce1-40f2-b374-ddff1153114b => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:54:55.901207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4659e1cb-1ea5-419b-bbba-813924d4b2e4 tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:55.902616 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:54:55.902616 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:54:55.903858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4659e1cb-1ea5-419b-bbba-813924d4b2e4 tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:55.904475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4659e1cb-1ea5-419b-bbba-813924d4b2e4 tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:55.905605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4659e1cb-1ea5-419b-bbba-813924d4b2e4 tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:55.906089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4659e1cb-1ea5-419b-bbba-813924d4b2e4 tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:55.932000 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4659e1cb-1ea5-419b-bbba-813924d4b2e4 tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.035596 Mar 12 20:54:55.932602 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1258/2026] 10.222.0.30 () {58 vars in 1173 bytes} [Sat Mar 12 20:54:55 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:55.939761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9410c385-2d23-42da-988b-6bd9ce799094 tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] Action: 'create', calling method: .version_select at 0x7f6e48d99ca0>, body: {"pool": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:57.135335 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9410c385-2d23-42da-988b-6bd9ce799094 tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.201418 Mar 12 20:54:57.135936 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1259/2027] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Mar 12 20:54:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:57.141316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3cf5f7d5-a61e-4d2b-8dcc-4ea12a56e4cf req-bd608678-4515-4d1f-b41a-94f116ffcf4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993ea61d-e3db-46d0-a7c8-830cef8ad182", "tag": "1f65e31a-18ac-4f20-88b6-ab21f98f3482"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:57.150570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3cf5f7d5-a61e-4d2b-8dcc-4ea12a56e4cf req-bd608678-4515-4d1f-b41a-94f116ffcf4a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:57.151025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3cf5f7d5-a61e-4d2b-8dcc-4ea12a56e4cf req-bd608678-4515-4d1f-b41a-94f116ffcf4a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:57.161320 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3cf5f7d5-a61e-4d2b-8dcc-4ea12a56e4cf req-bd608678-4515-4d1f-b41a-94f116ffcf4a service nova] Creating event network-changed:1f65e31a-18ac-4f20-88b6-ab21f98f3482 for instance 993ea61d-e3db-46d0-a7c8-830cef8ad182 on nch2-master-1 Mar 12 20:54:57.166558 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3cf5f7d5-a61e-4d2b-8dcc-4ea12a56e4cf req-bd608678-4515-4d1f-b41a-94f116ffcf4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029531 Mar 12 20:54:57.167556 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1260/2028] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:57.172385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2ddaf267-d8d9-44f7-b6c3-731ed2c31b05 req-61786ba2-c677-4e15-9780-6dc24fa03fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993ea61d-e3db-46d0-a7c8-830cef8ad182", "name": "network-vif-deleted", "tag": "1f65e31a-18ac-4f20-88b6-ab21f98f3482"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:57.180854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2ddaf267-d8d9-44f7-b6c3-731ed2c31b05 req-61786ba2-c677-4e15-9780-6dc24fa03fff service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:57.181589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2ddaf267-d8d9-44f7-b6c3-731ed2c31b05 req-61786ba2-c677-4e15-9780-6dc24fa03fff service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:57.195501 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2ddaf267-d8d9-44f7-b6c3-731ed2c31b05 req-61786ba2-c677-4e15-9780-6dc24fa03fff service nova] Creating event network-vif-deleted:1f65e31a-18ac-4f20-88b6-ab21f98f3482 for instance 993ea61d-e3db-46d0-a7c8-830cef8ad182 on nch2-master-1 Mar 12 20:54:57.201640 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2ddaf267-d8d9-44f7-b6c3-731ed2c31b05 req-61786ba2-c677-4e15-9780-6dc24fa03fff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031947 Mar 12 20:54:57.202276 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1261/2029] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:57.207249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de3b76f8-5332-4a8f-942a-528a4b5c6321 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '.version_select at 0x7f6e441eed30>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:57.393882 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de3b76f8-5332-4a8f-942a-528a4b5c6321 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/2bb3fe9e-5210-49a7-aaea-6eacb39babaa" status: 200 len: 185 microversion: 2.1 time: 0.190387 Mar 12 20:54:57.394469 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1262/2030] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Mar 12 20:54:57 2022] GET /compute/v2.1/os-floating-ips/2bb3fe9e-5210-49a7-aaea-6eacb39babaa => generated 185 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:57.398964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bef34108-24cb-49f4-9b1d-952a77413689 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48d99c10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:57.449255 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bef34108-24cb-49f4-9b1d-952a77413689 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/3c6af828-363f-4bd2-9a3a-27b866cf8f0a" status: 200 len: 217 microversion: 2.1 time: 0.053721 Mar 12 20:54:57.449870 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1263/2031] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 20:54:57 2022] GET /compute/v2.1/os-security-groups/3c6af828-363f-4bd2-9a3a-27b866cf8f0a => generated 217 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:57.455555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-13b808ce-2873-40ba-b0cf-3eef18b6fe89 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:57.457422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-13b808ce-2873-40ba-b0cf-3eef18b6fe89 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:54:57.458259 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-13b808ce-2873-40ba-b0cf-3eef18b6fe89 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "POST /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850/action" status: 400 len: 619 microversion: 2.1 time: 0.006971 Mar 12 20:54:57.458789 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1264/2032] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Mar 12 20:54:57 2022] POST /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850/action => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:54:57.643410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-06d31e94-ba9e-4b67-a177-2f97db703344 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:57.647429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-06d31e94-ba9e-4b67-a177-2f97db703344 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Searching by: {'deleted': False, 'project_id': 'e6713a3004d24719ab3aab38da32461e'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:54:57.653841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06d31e94-ba9e-4b67-a177-2f97db703344 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:57.654299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06d31e94-ba9e-4b67-a177-2f97db703344 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:57.655104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06d31e94-ba9e-4b67-a177-2f97db703344 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:57.655542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06d31e94-ba9e-4b67-a177-2f97db703344 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:57.753123 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-06d31e94-ba9e-4b67-a177-2f97db703344 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.293278 Mar 12 20:54:57.753700 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1265/2033] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:54:57 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:54:57.758465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5fc29631-8eee-4799-83f8-7de9eace1d6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:57.759485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5fc29631-8eee-4799-83f8-7de9eace1d6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:57.769037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fc29631-8eee-4799-83f8-7de9eace1d6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:57.769568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fc29631-8eee-4799-83f8-7de9eace1d6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:57.770387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fc29631-8eee-4799-83f8-7de9eace1d6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:57.771098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fc29631-8eee-4799-83f8-7de9eace1d6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:57.804820 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5fc29631-8eee-4799-83f8-7de9eace1d6e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050020 Mar 12 20:54:57.806968 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1266/2034] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Mar 12 20:54:57 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:54:57.812395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-28d507eb-2dfd-4f0c-a1d0-44f9bf64640d tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:57.814263 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:54:57.814263 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:54:57.817499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28d507eb-2dfd-4f0c-a1d0-44f9bf64640d tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:57.818272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28d507eb-2dfd-4f0c-a1d0-44f9bf64640d tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:57.819102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28d507eb-2dfd-4f0c-a1d0-44f9bf64640d tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:57.820115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28d507eb-2dfd-4f0c-a1d0-44f9bf64640d tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:57.852998 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-28d507eb-2dfd-4f0c-a1d0-44f9bf64640d tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044751 Mar 12 20:54:57.853807 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1267/2035] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Mar 12 20:54:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:54:57.871770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7cfa0669-4a9c-4336-add9-c19ce25f5c8a tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] Calling method '.version_select at 0x7f6e48ca7820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:54:59.325430 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7cfa0669-4a9c-4336-add9-c19ce25f5c8a tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/01dbaf42-be35-4681-aa53-f4e2c3807687" status: 202 len: 0 microversion: 2.1 time: 1.464560 Mar 12 20:54:59.326598 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1268/2036] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:54:57 2022] DELETE /compute/v2.1/os-floating-ips/01dbaf42-be35-4681-aa53-f4e2c3807687 => generated 0 bytes in 1472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:54:59.333199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c4b2ad94-1e08-47b5-bb29-b16f555225f4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.129"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:54:59.546986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c4b2ad94-1e08-47b5-bb29-b16f555225f4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:54:59.554201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4b2ad94-1e08-47b5-bb29-b16f555225f4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:59.554986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4b2ad94-1e08-47b5-bb29-b16f555225f4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:59.555871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4b2ad94-1e08-47b5-bb29-b16f555225f4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:54:59.556509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4b2ad94-1e08-47b5-bb29-b16f555225f4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:54:59.845391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4b2ad94-1e08-47b5-bb29-b16f555225f4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Acquired lock "refresh_cache-a1757801-9401-43bb-9739-88275226163b" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 20:55:01.039482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-c4b2ad94-1e08-47b5-bb29-b16f555225f4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Building network info cache for instance {{(pid=136302) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 12 20:55:01.942520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-c4b2ad94-1e08-47b5-bb29-b16f555225f4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Updating instance_info_cache with network_info: [{"id": "fd63e40c-0216-442b-b910-13f01aad794f", "address": "fa:16:3e:8c:0e:74", "network": {"id": "34a96fe2-32a3-4bf3-8c1e-f56f90cdec96", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-963529398-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bea8388cb0554c74b7db0bedfb0ca482", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfd63e40c-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136302) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 12 20:55:01.955938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4b2ad94-1e08-47b5-bb29-b16f555225f4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Releasing lock "refresh_cache-a1757801-9401-43bb-9739-88275226163b" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 20:55:01.956848 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c4b2ad94-1e08-47b5-bb29-b16f555225f4 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "POST /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b/action" status: 202 len: 0 microversion: 2.1 time: 2.629011 Mar 12 20:55:01.957931 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1269/2037] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:54:59 2022] POST /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b/action => generated 0 bytes in 2630 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 12 20:55:01.964110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14159310-4a30-4bda-a676-ad5faa630bff tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48d11e50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:02.180496 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14159310-4a30-4bda-a676-ad5faa630bff tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/3c6af828-363f-4bd2-9a3a-27b866cf8f0a" status: 202 len: 0 microversion: 2.1 time: 0.221349 Mar 12 20:55:02.182251 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1270/2038] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:55:01 2022] DELETE /compute/v2.1/os-security-groups/3c6af828-363f-4bd2-9a3a-27b866cf8f0a => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:55:02.189188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9b4909c-d228-4e24-9612-ba16c7517fe5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:02.191249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9b4909c-d228-4e24-9612-ba16c7517fe5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:02.213019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9b4909c-d228-4e24-9612-ba16c7517fe5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:02.214130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9b4909c-d228-4e24-9612-ba16c7517fe5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:02.217315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9b4909c-d228-4e24-9612-ba16c7517fe5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:02.218300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9b4909c-d228-4e24-9612-ba16c7517fe5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:02.409119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9b4909c-d228-4e24-9612-ba16c7517fe5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:02.417215 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9b4909c-d228-4e24-9612-ba16c7517fe5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1522 microversion: 2.1 time: 0.233122 Mar 12 20:55:02.425631 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1271/2039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:02 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:02.455822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d798b877-c8db-46d9-a781-40df78ab786e tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:02.466432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d798b877-c8db-46d9-a781-40df78ab786e tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Searching by: {'deleted': False} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:55:02.471761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d798b877-c8db-46d9-a781-40df78ab786e tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:02.475197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d798b877-c8db-46d9-a781-40df78ab786e tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:02.476294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d798b877-c8db-46d9-a781-40df78ab786e tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:02.477051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d798b877-c8db-46d9-a781-40df78ab786e tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:02.596576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-d798b877-c8db-46d9-a781-40df78ab786e tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:55:02.728816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d798b877-c8db-46d9-a781-40df78ab786e tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:02.729284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d798b877-c8db-46d9-a781-40df78ab786e tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.065613 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d798b877-c8db-46d9-a781-40df78ab786e tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11750 microversion: 2.1 time: 0.646334 Mar 12 20:55:03.066338 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1272/2040] 10.222.0.30 () {58 vars in 1170 bytes} [Sat Mar 12 20:55:02 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11750 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:55:03.091472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d02a678-d420-41dc-aceb-b3ca5ffb8b5b tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:03.093377 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 20:55:03.093377 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 20:55:03.096383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d02a678-d420-41dc-aceb-b3ca5ffb8b5b tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.098407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d02a678-d420-41dc-aceb-b3ca5ffb8b5b tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.099445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d02a678-d420-41dc-aceb-b3ca5ffb8b5b tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.100246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d02a678-d420-41dc-aceb-b3ca5ffb8b5b tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.141032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d02a678-d420-41dc-aceb-b3ca5ffb8b5b tempest-ServicesAdminTestJSON-578071230 tempest-ServicesAdminTestJSON-578071230-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.061643 Mar 12 20:55:03.141032 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1273/2041] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:55:03 2022] GET /compute/v2.1/os-services => generated 947 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:03.141032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7c52d281-baf9-4a57-8fa4-152839845e87 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:03.141032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7c52d281-baf9-4a57-8fa4-152839845e87 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:03.145164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c52d281-baf9-4a57-8fa4-152839845e87 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.145726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c52d281-baf9-4a57-8fa4-152839845e87 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.147202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c52d281-baf9-4a57-8fa4-152839845e87 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.148487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c52d281-baf9-4a57-8fa4-152839845e87 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.197431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7c52d281-baf9-4a57-8fa4-152839845e87 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:55:03.344658 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7c52d281-baf9-4a57-8fa4-152839845e87 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 204 len: 0 microversion: 2.20 time: 0.211950 Mar 12 20:55:03.345546 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1274/2042] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:55:03 2022] DELETE /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:55:03.354039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2438c2c7-7abe-4afa-8ff5-d76f5b45a0f0 req-393872c0-7b26-4a5b-be05-888a18d05164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1757801-9401-43bb-9739-88275226163b", "tag": "fd63e40c-0216-442b-b910-13f01aad794f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:03.365252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2438c2c7-7abe-4afa-8ff5-d76f5b45a0f0 req-393872c0-7b26-4a5b-be05-888a18d05164 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.365807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2438c2c7-7abe-4afa-8ff5-d76f5b45a0f0 req-393872c0-7b26-4a5b-be05-888a18d05164 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.385020 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2438c2c7-7abe-4afa-8ff5-d76f5b45a0f0 req-393872c0-7b26-4a5b-be05-888a18d05164 service nova] Creating event network-changed:fd63e40c-0216-442b-b910-13f01aad794f for instance a1757801-9401-43bb-9739-88275226163b on nch2-master-1 Mar 12 20:55:03.391366 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2438c2c7-7abe-4afa-8ff5-d76f5b45a0f0 req-393872c0-7b26-4a5b-be05-888a18d05164 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042693 Mar 12 20:55:03.392417 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1275/2043] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:03.400014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be9741cf-b83b-4361-a378-cf157f06868d tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] Calling method '.version_select at 0x7f6e48dd9dc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:03.532294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-be9741cf-b83b-4361-a378-cf157f06868d tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 01dbaf42-be35-4681-aa53-f4e2c3807687 could not be found", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:55:03.533033 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-be9741cf-b83b-4361-a378-cf157f06868d tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] HTTP exception thrown: Floating IP not found for ID 01dbaf42-be35-4681-aa53-f4e2c3807687 Mar 12 20:55:03.533652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be9741cf-b83b-4361-a378-cf157f06868d tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] Returning 404 to user: Floating IP not found for ID 01dbaf42-be35-4681-aa53-f4e2c3807687 {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:03.535143 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be9741cf-b83b-4361-a378-cf157f06868d tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/01dbaf42-be35-4681-aa53-f4e2c3807687" status: 404 len: 111 microversion: 2.1 time: 0.141060 Mar 12 20:55:03.535885 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1276/2044] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Mar 12 20:55:03 2022] GET /compute/v2.1/os-floating-ips/01dbaf42-be35-4681-aa53-f4e2c3807687 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:03.543089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-370bb920-fb33-410f-bf90-b86aaa822525 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:03.545419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-370bb920-fb33-410f-bf90-b86aaa822525 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:03.566633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-370bb920-fb33-410f-bf90-b86aaa822525 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.567449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-370bb920-fb33-410f-bf90-b86aaa822525 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.568696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-370bb920-fb33-410f-bf90-b86aaa822525 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.571152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-370bb920-fb33-410f-bf90-b86aaa822525 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.608332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-370bb920-fb33-410f-bf90-b86aaa822525 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] HTTP exception thrown: Instance 993ea61d-e3db-46d0-a7c8-830cef8ad182 could not be found. Mar 12 20:55:03.608986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-370bb920-fb33-410f-bf90-b86aaa822525 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Returning 404 to user: Instance 993ea61d-e3db-46d0-a7c8-830cef8ad182 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:03.609909 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-370bb920-fb33-410f-bf90-b86aaa822525 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "DELETE /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182" status: 404 len: 111 microversion: 2.1 time: 0.072886 Mar 12 20:55:03.613328 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1277/2045] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:55:03 2022] DELETE /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:03.622438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f844623f-687b-48a5-9ef2-80af29b4db44 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:03.626957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f844623f-687b-48a5-9ef2-80af29b4db44 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:03.640477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f844623f-687b-48a5-9ef2-80af29b4db44 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.642040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f844623f-687b-48a5-9ef2-80af29b4db44 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.643638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f844623f-687b-48a5-9ef2-80af29b4db44 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.645363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f844623f-687b-48a5-9ef2-80af29b4db44 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.669190 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f844623f-687b-48a5-9ef2-80af29b4db44 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Instance da9c4738-03fa-4cbc-a9a2-0648450befb5 could not be found. Mar 12 20:55:03.670098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f844623f-687b-48a5-9ef2-80af29b4db44 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Instance da9c4738-03fa-4cbc-a9a2-0648450befb5 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:03.671254 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f844623f-687b-48a5-9ef2-80af29b4db44 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5" status: 404 len: 111 microversion: 2.1 time: 0.056470 Mar 12 20:55:03.672007 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1278/2046] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:55:03 2022] DELETE /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:03.682337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d34cd541-41bd-4764-9a9b-6233d3666561 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:03.683661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d34cd541-41bd-4764-9a9b-6233d3666561 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:03.695833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d34cd541-41bd-4764-9a9b-6233d3666561 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.696295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d34cd541-41bd-4764-9a9b-6233d3666561 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.697282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d34cd541-41bd-4764-9a9b-6233d3666561 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.698383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d34cd541-41bd-4764-9a9b-6233d3666561 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.951695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d34cd541-41bd-4764-9a9b-6233d3666561 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:03.962491 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d34cd541-41bd-4764-9a9b-6233d3666561 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1522 microversion: 2.1 time: 0.288839 Mar 12 20:55:03.963503 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1279/2047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:03 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:03.979954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-841d4683-ea36-497d-abaa-c835e9ab12a6 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:03.986745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-841d4683-ea36-497d-abaa-c835e9ab12a6 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Searching by: {'deleted': False, 'project_id': 'e6713a3004d24719ab3aab38da32461e'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:55:03.993421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-841d4683-ea36-497d-abaa-c835e9ab12a6 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.994526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-841d4683-ea36-497d-abaa-c835e9ab12a6 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:03.996076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-841d4683-ea36-497d-abaa-c835e9ab12a6 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:03.996763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-841d4683-ea36-497d-abaa-c835e9ab12a6 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:04.036969 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-841d4683-ea36-497d-abaa-c835e9ab12a6 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?tenant_id=3f2df40602ee43d4a6ecbf8147e170d0" status: 200 len: 15 microversion: 2.1 time: 0.071932 Mar 12 20:55:04.038383 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1280/2048] 10.222.0.30 () {58 vars in 1230 bytes} [Sat Mar 12 20:55:03 2022] GET /compute/v2.1/servers/detail?tenant_id=3f2df40602ee43d4a6ecbf8147e170d0 => generated 15 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:55:04.045137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b39df785-e805-4393-ba77-675ececcad82 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:04.046645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b39df785-e805-4393-ba77-675ececcad82 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:04.056738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b39df785-e805-4393-ba77-675ececcad82 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:04.057318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b39df785-e805-4393-ba77-675ececcad82 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:04.058431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b39df785-e805-4393-ba77-675ececcad82 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:04.059116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b39df785-e805-4393-ba77-675ececcad82 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:04.245818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b39df785-e805-4393-ba77-675ececcad82 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:04.259904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b39df785-e805-4393-ba77-675ececcad82 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:04.261436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b39df785-e805-4393-ba77-675ececcad82 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:04.265110 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b39df785-e805-4393-ba77-675ececcad82 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1723 microversion: 2.20 time: 0.222415 Mar 12 20:55:04.266362 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1281/2049] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:55:04 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:55:04.272059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d618e574-335b-4366-8181-25cf809b2d3e tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] Calling method '.version_select at 0x7f6e48e08790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:04.327686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-d618e574-335b-4366-8181-25cf809b2d3e tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 01dbaf42-be35-4681-aa53-f4e2c3807687 could not be found", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:55:04.328391 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d618e574-335b-4366-8181-25cf809b2d3e tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] HTTP exception thrown: Floating IP not found for ID 01dbaf42-be35-4681-aa53-f4e2c3807687 Mar 12 20:55:04.328957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d618e574-335b-4366-8181-25cf809b2d3e tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] Returning 404 to user: Floating IP not found for ID 01dbaf42-be35-4681-aa53-f4e2c3807687 {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:04.331106 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d618e574-335b-4366-8181-25cf809b2d3e tempest-FloatingIPsTestJSON-1603313639 tempest-FloatingIPsTestJSON-1603313639-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/01dbaf42-be35-4681-aa53-f4e2c3807687" status: 404 len: 111 microversion: 2.1 time: 0.061663 Mar 12 20:55:04.333545 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1282/2050] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:55:04 2022] DELETE /compute/v2.1/os-floating-ips/01dbaf42-be35-4681-aa53-f4e2c3807687 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:04.344772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ce5d6ef-408f-4baf-9efe-867ba4467699 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:04.345609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ce5d6ef-408f-4baf-9efe-867ba4467699 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: 993ea61d-e3db-46d0-a7c8-830cef8ad182] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:04.359793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ce5d6ef-408f-4baf-9efe-867ba4467699 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:04.360335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ce5d6ef-408f-4baf-9efe-867ba4467699 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:04.361147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ce5d6ef-408f-4baf-9efe-867ba4467699 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:04.361593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ce5d6ef-408f-4baf-9efe-867ba4467699 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:04.413117 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9ce5d6ef-408f-4baf-9efe-867ba4467699 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] HTTP exception thrown: Instance 993ea61d-e3db-46d0-a7c8-830cef8ad182 could not be found. Mar 12 20:55:04.414087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ce5d6ef-408f-4baf-9efe-867ba4467699 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Returning 404 to user: Instance 993ea61d-e3db-46d0-a7c8-830cef8ad182 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:04.414836 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ce5d6ef-408f-4baf-9efe-867ba4467699 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182" status: 404 len: 111 microversion: 2.1 time: 0.080336 Mar 12 20:55:04.418667 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1283/2051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:04 2022] GET /compute/v2.1/servers/993ea61d-e3db-46d0-a7c8-830cef8ad182 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:04.421415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d88c244f-5420-440c-8e17-a092f23996d5 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:04.422238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d88c244f-5420-440c-8e17-a092f23996d5 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: da9c4738-03fa-4cbc-a9a2-0648450befb5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:04.433300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d88c244f-5420-440c-8e17-a092f23996d5 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:04.433849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d88c244f-5420-440c-8e17-a092f23996d5 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:04.434767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d88c244f-5420-440c-8e17-a092f23996d5 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:04.435286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d88c244f-5420-440c-8e17-a092f23996d5 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:04.452355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d88c244f-5420-440c-8e17-a092f23996d5 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Instance da9c4738-03fa-4cbc-a9a2-0648450befb5 could not be found. Mar 12 20:55:04.456657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d88c244f-5420-440c-8e17-a092f23996d5 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Instance da9c4738-03fa-4cbc-a9a2-0648450befb5 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:04.456657 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d88c244f-5420-440c-8e17-a092f23996d5 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5" status: 404 len: 111 microversion: 2.1 time: 0.037500 Mar 12 20:55:04.456657 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1284/2052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:04 2022] GET /compute/v2.1/servers/da9c4738-03fa-4cbc-a9a2-0648450befb5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:04.766713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bded6bb6-3176-4123-890b-e11b1eb1bb7f tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Action: 'create', calling method: .version_select at 0x7f6e48e081f0>, body: {"keypair": {"name": "tempest-keypair-1688196215"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:04.789387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bded6bb6-3176-4123-890b-e11b1eb1bb7f tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Getting quotas for project 8c4cadf7e0ab4a41aaa15be6665667db. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:04.799495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bded6bb6-3176-4123-890b-e11b1eb1bb7f tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Getting quotas for user 8638326f0172475e8e97d4cc21fd80ca and project 8c4cadf7e0ab4a41aaa15be6665667db. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:05.315297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bded6bb6-3176-4123-890b-e11b1eb1bb7f tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Getting quotas for project 8c4cadf7e0ab4a41aaa15be6665667db. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:05.323022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bded6bb6-3176-4123-890b-e11b1eb1bb7f tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Getting quotas for user 8638326f0172475e8e97d4cc21fd80ca and project 8c4cadf7e0ab4a41aaa15be6665667db. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:05.343617 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bded6bb6-3176-4123-890b-e11b1eb1bb7f tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.887033 Mar 12 20:55:05.345818 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1285/2053] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:55:04 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:05.349959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7ad09df8-bf9d-4848-a8d9-bacdabdec867 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-711363075"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:05.350949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7ad09df8-bf9d-4848-a8d9-bacdabdec867 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:05.359137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ad09df8-bf9d-4848-a8d9-bacdabdec867 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:05.359608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ad09df8-bf9d-4848-a8d9-bacdabdec867 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:05.360421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ad09df8-bf9d-4848-a8d9-bacdabdec867 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:05.360874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ad09df8-bf9d-4848-a8d9-bacdabdec867 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:05.953080 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7ad09df8-bf9d-4848-a8d9-bacdabdec867 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "POST /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850/action" status: 202 len: 0 microversion: 2.1 time: 0.607093 Mar 12 20:55:05.955515 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1286/2054] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:55:05 2022] POST /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 12 20:55:05.974543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3994084d-0d2d-44a0-8f34-9c01a5ff3b13 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:05.980973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3994084d-0d2d-44a0-8f34-9c01a5ff3b13 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Searching by: {'tenant_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'deleted': False} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:55:05.988049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3994084d-0d2d-44a0-8f34-9c01a5ff3b13 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:05.989178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3994084d-0d2d-44a0-8f34-9c01a5ff3b13 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:05.990255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3994084d-0d2d-44a0-8f34-9c01a5ff3b13 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:05.990974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3994084d-0d2d-44a0-8f34-9c01a5ff3b13 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:06.050136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-3994084d-0d2d-44a0-8f34-9c01a5ff3b13 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:55:06.189314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3994084d-0d2d-44a0-8f34-9c01a5ff3b13 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:06.190053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3994084d-0d2d-44a0-8f34-9c01a5ff3b13 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:06.553242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3994084d-0d2d-44a0-8f34-9c01a5ff3b13 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3f2df40602ee43d4a6ecbf8147e170d0" status: 200 len: 4824 microversion: 2.1 time: 0.595421 Mar 12 20:55:06.555973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1287/2055] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Mar 12 20:55:05 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3f2df40602ee43d4a6ecbf8147e170d0 => generated 4824 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:06.563733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-28719e22-4fbd-4fef-ad18-bb328bc99d9f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '.version_select at 0x7f6e48ccd310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:07.865637 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-28719e22-4fbd-4fef-ad18-bb328bc99d9f tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/2bb3fe9e-5210-49a7-aaea-6eacb39babaa" status: 202 len: 0 microversion: 2.1 time: 1.307562 Mar 12 20:55:07.866888 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1288/2056] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:55:06 2022] DELETE /compute/v2.1/os-floating-ips/2bb3fe9e-5210-49a7-aaea-6eacb39babaa => generated 0 bytes in 1310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:55:07.871732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-83a2d641-76a9-444c-9b8a-de9d320b1966 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48e08a60>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:07.912299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-83a2d641-76a9-444c-9b8a-de9d320b1966 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1b0e47ee-b662-4717-bb01-56e3abba40a4 does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:55:07.913281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-83a2d641-76a9-444c-9b8a-de9d320b1966 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Neutron security group 1b0e47ee-b662-4717-bb01-56e3abba40a4 not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:55:07.913861 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-83a2d641-76a9-444c-9b8a-de9d320b1966 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Security group 1b0e47ee-b662-4717-bb01-56e3abba40a4 does not exist Mar 12 20:55:07.913861 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-8b0a70fd-a6a6-4847-b562-29ec81bb2591'] Mar 12 20:55:07.914475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-83a2d641-76a9-444c-9b8a-de9d320b1966 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Security group 1b0e47ee-b662-4717-bb01-56e3abba40a4 does not exist Mar 12 20:55:07.914475 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-8b0a70fd-a6a6-4847-b562-29ec81bb2591'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:07.916028 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-83a2d641-76a9-444c-9b8a-de9d320b1966 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/1b0e47ee-b662-4717-bb01-56e3abba40a4" status: 404 len: 194 microversion: 2.1 time: 0.048065 Mar 12 20:55:07.917526 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1289/2057] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:55:07 2022] DELETE /compute/v2.1/os-security-groups/1b0e47ee-b662-4717-bb01-56e3abba40a4 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:07.926465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9880c426-32da-488e-959c-64b0f471ed3c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:07.927477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9880c426-32da-488e-959c-64b0f471ed3c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:07.938385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9880c426-32da-488e-959c-64b0f471ed3c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:07.950362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9880c426-32da-488e-959c-64b0f471ed3c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:07.951463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9880c426-32da-488e-959c-64b0f471ed3c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:07.953670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9880c426-32da-488e-959c-64b0f471ed3c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:08.069974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9880c426-32da-488e-959c-64b0f471ed3c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:08.079823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9880c426-32da-488e-959c-64b0f471ed3c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:08.082560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9880c426-32da-488e-959c-64b0f471ed3c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:08.083806 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9880c426-32da-488e-959c-64b0f471ed3c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 200 len: 1656 microversion: 2.20 time: 0.161341 Mar 12 20:55:08.084868 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1290/2058] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:55:07 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:55:08.089605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-01487ce0-5b55-4296-8188-3714c691149b req-6d295e5f-ce51-4072-a2b5-c41c5b12ffa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1757801-9401-43bb-9739-88275226163b", "tag": "fd63e40c-0216-442b-b910-13f01aad794f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:08.099176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-01487ce0-5b55-4296-8188-3714c691149b req-6d295e5f-ce51-4072-a2b5-c41c5b12ffa7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:08.099631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-01487ce0-5b55-4296-8188-3714c691149b req-6d295e5f-ce51-4072-a2b5-c41c5b12ffa7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:08.113005 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-01487ce0-5b55-4296-8188-3714c691149b req-6d295e5f-ce51-4072-a2b5-c41c5b12ffa7 service nova] Creating event network-changed:fd63e40c-0216-442b-b910-13f01aad794f for instance a1757801-9401-43bb-9739-88275226163b on nch2-master-1 Mar 12 20:55:08.118781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-01487ce0-5b55-4296-8188-3714c691149b req-6d295e5f-ce51-4072-a2b5-c41c5b12ffa7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032649 Mar 12 20:55:08.122780 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1291/2059] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:08.128543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-daa7ad46-457e-4cb7-aa33-43d7ffbf3c07 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1651316490"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:08.129686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-daa7ad46-457e-4cb7-aa33-43d7ffbf3c07 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:08.143952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daa7ad46-457e-4cb7-aa33-43d7ffbf3c07 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:08.144422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daa7ad46-457e-4cb7-aa33-43d7ffbf3c07 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:08.145227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daa7ad46-457e-4cb7-aa33-43d7ffbf3c07 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:08.145900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daa7ad46-457e-4cb7-aa33-43d7ffbf3c07 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:08.187817 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-daa7ad46-457e-4cb7-aa33-43d7ffbf3c07 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] HTTP exception thrown: Cannot 'createImage' instance 9194940b-98b0-48a5-a60e-465ff599b850 while it is in task_state image_snapshot Mar 12 20:55:08.188433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-daa7ad46-457e-4cb7-aa33-43d7ffbf3c07 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 409 to user: Cannot 'createImage' instance 9194940b-98b0-48a5-a60e-465ff599b850 while it is in task_state image_snapshot {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:08.189361 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-daa7ad46-457e-4cb7-aa33-43d7ffbf3c07 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "POST /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850/action" status: 409 len: 159 microversion: 2.1 time: 0.065329 Mar 12 20:55:08.190104 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1292/2060] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:55:08 2022] POST /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850/action => generated 159 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:55:08.366616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16dbfc14-cac6-4d54-b519-a30983ef00c3 tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] Calling method '.version_select at 0x7f6e48dd9700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:08.389975 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-16dbfc14-cac6-4d54-b519-a30983ef00c3 tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] HTTP exception thrown: Image not found. Mar 12 20:55:08.390877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16dbfc14-cac6-4d54-b519-a30983ef00c3 tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:08.392121 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16dbfc14-cac6-4d54-b519-a30983ef00c3 tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] 10.222.0.30 "DELETE /compute/v2.1/images/5ffe336b-fe84-4dc9-8132-9d0d96f13fe9/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.201190 Mar 12 20:55:08.392921 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1293/2061] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Mar 12 20:55:08 2022] DELETE /compute/v2.1/images/5ffe336b-fe84-4dc9-8132-9d0d96f13fe9/metadata/os_distro => generated 62 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:55:08.400662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec3bf69a-7821-4be8-bab8-7fe075ed06a1 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:08.407163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec3bf69a-7821-4be8-bab8-7fe075ed06a1 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Searching by: {'tenant_id': 'e6713a3004d24719ab3aab38da32461e', 'deleted': False} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:55:08.412786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec3bf69a-7821-4be8-bab8-7fe075ed06a1 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:08.413242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec3bf69a-7821-4be8-bab8-7fe075ed06a1 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:08.414093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec3bf69a-7821-4be8-bab8-7fe075ed06a1 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:08.414548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec3bf69a-7821-4be8-bab8-7fe075ed06a1 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:08.447542 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec3bf69a-7821-4be8-bab8-7fe075ed06a1 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e6713a3004d24719ab3aab38da32461e" status: 200 len: 15 microversion: 2.1 time: 0.053186 Mar 12 20:55:08.450161 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1294/2062] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Mar 12 20:55:08 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e6713a3004d24719ab3aab38da32461e => generated 15 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:55:08.454444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e114da9c-d8a9-4e72-bc97-f183e6634e1c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:08.454993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e114da9c-d8a9-4e72-bc97-f183e6634e1c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:08.464590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e114da9c-d8a9-4e72-bc97-f183e6634e1c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:08.465311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e114da9c-d8a9-4e72-bc97-f183e6634e1c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:08.467278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e114da9c-d8a9-4e72-bc97-f183e6634e1c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:08.467893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e114da9c-d8a9-4e72-bc97-f183e6634e1c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:08.498314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e114da9c-d8a9-4e72-bc97-f183e6634e1c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:55:08.603102 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e114da9c-d8a9-4e72-bc97-f183e6634e1c tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b" status: 204 len: 0 microversion: 2.1 time: 0.151880 Mar 12 20:55:08.603946 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1295/2063] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:55:08 2022] DELETE /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:55:08.621852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-387a25cd-cead-4fb0-9350-d4337b35bd26 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48dd90d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:08.679132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-387a25cd-cead-4fb0-9350-d4337b35bd26 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8f925d6f-e6d1-401d-b6a3-81bd6e554c85 does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:55:08.680374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-387a25cd-cead-4fb0-9350-d4337b35bd26 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Neutron security group 8f925d6f-e6d1-401d-b6a3-81bd6e554c85 not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:55:08.682250 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-387a25cd-cead-4fb0-9350-d4337b35bd26 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Security group 8f925d6f-e6d1-401d-b6a3-81bd6e554c85 does not exist Mar 12 20:55:08.682250 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-142fda24-dbc8-41c7-bd19-7ac7c6399365'] Mar 12 20:55:08.683650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-387a25cd-cead-4fb0-9350-d4337b35bd26 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Security group 8f925d6f-e6d1-401d-b6a3-81bd6e554c85 does not exist Mar 12 20:55:08.683650 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-142fda24-dbc8-41c7-bd19-7ac7c6399365'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:08.685714 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-387a25cd-cead-4fb0-9350-d4337b35bd26 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/8f925d6f-e6d1-401d-b6a3-81bd6e554c85" status: 404 len: 194 microversion: 2.1 time: 0.080034 Mar 12 20:55:08.687675 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1296/2064] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:55:08 2022] DELETE /compute/v2.1/os-security-groups/8f925d6f-e6d1-401d-b6a3-81bd6e554c85 => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:08.698884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-701262f8-3748-403c-8f2a-d76ba04d1969 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '.version_select at 0x7f6e48d11820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:08.936740 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-701262f8-3748-403c-8f2a-d76ba04d1969 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "DELETE /compute/v2.1/images/102f4e43-e0d2-45bb-b3a7-dedceae99f28" status: 204 len: 0 microversion: 2.1 time: 0.246833 Mar 12 20:55:08.937916 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1297/2065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:08 2022] DELETE /compute/v2.1/images/102f4e43-e0d2-45bb-b3a7-dedceae99f28 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:55:08.970665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-725a547d-fac1-4b4c-a028-fccd33939140 tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] Calling method '.version_select at 0x7f6e48dd9dc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:09.019738 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-725a547d-fac1-4b4c-a028-fccd33939140 tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] HTTP exception thrown: Image not found. Mar 12 20:55:09.022403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-725a547d-fac1-4b4c-a028-fccd33939140 tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:09.026555 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-725a547d-fac1-4b4c-a028-fccd33939140 tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] 10.222.0.30 "GET /compute/v2.1/images/a4d65a55-4b86-4b9c-b299-6a60d8ddf9cc/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.085290 Mar 12 20:55:09.032412 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1298/2066] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Mar 12 20:55:08 2022] GET /compute/v2.1/images/a4d65a55-4b86-4b9c-b299-6a60d8ddf9cc/metadata/os_version => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:55:09.065253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6daa6297-7036-4bfa-b58c-f6b5998e8cec tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:09.079527 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6daa6297-7036-4bfa-b58c-f6b5998e8cec tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.042261 Mar 12 20:55:09.080563 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1299/2067] 10.222.0.30 () {58 vars in 1188 bytes} [Sat Mar 12 20:55:09 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:55:09.098814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d26b8b36-bac1-4ef2-be7a-08396e7d8d40 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:09.100199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d26b8b36-bac1-4ef2-be7a-08396e7d8d40 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:09.123027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d26b8b36-bac1-4ef2-be7a-08396e7d8d40 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:09.125735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d26b8b36-bac1-4ef2-be7a-08396e7d8d40 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:09.130874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d26b8b36-bac1-4ef2-be7a-08396e7d8d40 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:09.131894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d26b8b36-bac1-4ef2-be7a-08396e7d8d40 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:09.446188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d26b8b36-bac1-4ef2-be7a-08396e7d8d40 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d139f357097469880d0cc2631ee8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea8388cb0554c74b7db0bedfb0ca482', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:09.460074 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d26b8b36-bac1-4ef2-be7a-08396e7d8d40 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b" status: 200 len: 1526 microversion: 2.1 time: 0.376622 Mar 12 20:55:09.463639 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1300/2068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:09 2022] GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b => generated 1526 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:09.480523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0b4a96b-b284-4270-a1bc-ff6e8791df03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48cdbee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:09.527352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-b0b4a96b-b284-4270-a1bc-ff6e8791df03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1dce0245-049d-4a48-bd74-e2f4cfb13794 does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:55:09.528971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-b0b4a96b-b284-4270-a1bc-ff6e8791df03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Neutron security group 1dce0245-049d-4a48-bd74-e2f4cfb13794 not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:55:09.530165 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b0b4a96b-b284-4270-a1bc-ff6e8791df03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Security group 1dce0245-049d-4a48-bd74-e2f4cfb13794 does not exist Mar 12 20:55:09.530165 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-43e7eda4-07f0-4bce-a2ff-a1a2ca453a17'] Mar 12 20:55:09.531727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0b4a96b-b284-4270-a1bc-ff6e8791df03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Security group 1dce0245-049d-4a48-bd74-e2f4cfb13794 does not exist Mar 12 20:55:09.531727 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-43e7eda4-07f0-4bce-a2ff-a1a2ca453a17'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:09.533004 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0b4a96b-b284-4270-a1bc-ff6e8791df03 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/1dce0245-049d-4a48-bd74-e2f4cfb13794" status: 404 len: 194 microversion: 2.1 time: 0.067971 Mar 12 20:55:09.534231 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1301/2069] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:55:09 2022] DELETE /compute/v2.1/os-security-groups/1dce0245-049d-4a48-bd74-e2f4cfb13794 => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:09.540143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2e9af8d3-4e43-4a14-a930-b14e20a18079 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:09.540792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2e9af8d3-4e43-4a14-a930-b14e20a18079 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:09.549450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e9af8d3-4e43-4a14-a930-b14e20a18079 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:09.549945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e9af8d3-4e43-4a14-a930-b14e20a18079 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:09.551309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e9af8d3-4e43-4a14-a930-b14e20a18079 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:09.551759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e9af8d3-4e43-4a14-a930-b14e20a18079 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:09.896243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2e9af8d3-4e43-4a14-a930-b14e20a18079 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:09.907584 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2e9af8d3-4e43-4a14-a930-b14e20a18079 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1540 microversion: 2.1 time: 0.371632 Mar 12 20:55:09.918525 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1302/2070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:09 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1540 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:09.918525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e281b30a-e3fd-406c-bad1-575fdfe6744a tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] Calling method '.version_select at 0x7f6e48e08ee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:09.937644 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e281b30a-e3fd-406c-bad1-575fdfe6744a tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] HTTP exception thrown: Image not found. Mar 12 20:55:09.939455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e281b30a-e3fd-406c-bad1-575fdfe6744a tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:09.940500 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e281b30a-e3fd-406c-bad1-575fdfe6744a tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] 10.222.0.30 "GET /compute/v2.1/images/4218f6e1-c32d-4811-8334-e3ece0154746/metadata" status: 404 len: 62 microversion: 2.1 time: 0.030895 Mar 12 20:55:09.946629 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1303/2071] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Mar 12 20:55:09 2022] GET /compute/v2.1/images/4218f6e1-c32d-4811-8334-e3ece0154746/metadata => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:55:09.951931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2feed7b8-f92c-4f03-a0cf-a021d64b2fe9 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:09.953279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2feed7b8-f92c-4f03-a0cf-a021d64b2fe9 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:09.963152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2feed7b8-f92c-4f03-a0cf-a021d64b2fe9 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:09.964553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2feed7b8-f92c-4f03-a0cf-a021d64b2fe9 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:09.965674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2feed7b8-f92c-4f03-a0cf-a021d64b2fe9 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:09.966602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2feed7b8-f92c-4f03-a0cf-a021d64b2fe9 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:10.078155 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2feed7b8-f92c-4f03-a0cf-a021d64b2fe9 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action" status: 202 len: 0 microversion: 2.1 time: 0.130412 Mar 12 20:55:10.079493 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1304/2072] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:55:09 2022] POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:55:10.085818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3203d98-45f1-4127-856c-2fe64c1b9211 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:10.086602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c3203d98-45f1-4127-856c-2fe64c1b9211 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:10.094401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3203d98-45f1-4127-856c-2fe64c1b9211 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:10.095151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3203d98-45f1-4127-856c-2fe64c1b9211 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:10.096023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3203d98-45f1-4127-856c-2fe64c1b9211 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:10.096715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3203d98-45f1-4127-856c-2fe64c1b9211 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:10.115444 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c3203d98-45f1-4127-856c-2fe64c1b9211 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] HTTP exception thrown: Instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 could not be found. Mar 12 20:55:10.116449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3203d98-45f1-4127-856c-2fe64c1b9211 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Returning 404 to user: Instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:10.117541 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3203d98-45f1-4127-856c-2fe64c1b9211 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 404 len: 111 microversion: 2.20 time: 0.036890 Mar 12 20:55:10.118716 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1305/2073] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:55:10 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:55:10.131710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1992893559", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "70ecd91f-ca78-4265-8796-d69d38740396"}], "security_groups": [{"name": "tempest-securitygroup--571321150"}], "key_name": "tempest-keypair-1688196215", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:10.282283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] validate_networks() for [('70ecd91f-ca78-4265-8796-d69d38740396', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:55:11.111329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Getting quotas for project 8c4cadf7e0ab4a41aaa15be6665667db. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:11.122388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Getting quotas for user 8638326f0172475e8e97d4cc21fd80ca and project 8c4cadf7e0ab4a41aaa15be6665667db. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:11.143535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:55:11.144182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:55:11.144872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:55:11.145301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:55:11.145719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:55:11.156548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:11.157653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:11.158664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:11.159293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:11.190279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Getting quotas for project 8c4cadf7e0ab4a41aaa15be6665667db. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:11.196307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Getting quotas for user 8638326f0172475e8e97d4cc21fd80ca and project 8c4cadf7e0ab4a41aaa15be6665667db. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:11.211485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:55:11.214088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:55:11.276948 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2acb3b47-2aaf-4ddf-afb2-b532c79c0610 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.156784 Mar 12 20:55:11.278925 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1306/2074] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:55:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:55:11.285527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d66aa1e9-bea7-440b-b082-75b84c318f33 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48e1b280>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:11.313692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-d66aa1e9-bea7-440b-b082-75b84c318f33 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 53757a32-4ce4-402a-ad4f-76b8d53502fd does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:55:11.314331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-d66aa1e9-bea7-440b-b082-75b84c318f33 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Neutron security group 53757a32-4ce4-402a-ad4f-76b8d53502fd not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:55:11.314861 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d66aa1e9-bea7-440b-b082-75b84c318f33 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Security group 53757a32-4ce4-402a-ad4f-76b8d53502fd does not exist Mar 12 20:55:11.314861 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-73c55568-eb60-495d-ae42-59e710ac85cb'] Mar 12 20:55:11.315454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d66aa1e9-bea7-440b-b082-75b84c318f33 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Security group 53757a32-4ce4-402a-ad4f-76b8d53502fd does not exist Mar 12 20:55:11.315454 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-73c55568-eb60-495d-ae42-59e710ac85cb'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:11.316284 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d66aa1e9-bea7-440b-b082-75b84c318f33 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/53757a32-4ce4-402a-ad4f-76b8d53502fd" status: 404 len: 194 microversion: 2.1 time: 0.036212 Mar 12 20:55:11.318135 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1307/2075] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:55:11 2022] DELETE /compute/v2.1/os-security-groups/53757a32-4ce4-402a-ad4f-76b8d53502fd => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:11.336222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de6510ae-8435-435c-8d75-a7dd6bbd54a2 tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] Action: 'update_all', calling method: .version_select at 0x7f6e48df7a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:11.369228 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-de6510ae-8435-435c-8d75-a7dd6bbd54a2 tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] HTTP exception thrown: Image not found. Mar 12 20:55:11.370155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de6510ae-8435-435c-8d75-a7dd6bbd54a2 tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:11.370846 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de6510ae-8435-435c-8d75-a7dd6bbd54a2 tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] 10.222.0.30 "PUT /compute/v2.1/images/aac3c519-ad1e-4f30-ab8c-d0beb8c4a737/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049318 Mar 12 20:55:11.377443 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1308/2076] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:55:11 2022] PUT /compute/v2.1/images/aac3c519-ad1e-4f30-ab8c-d0beb8c4a737/metadata => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:55:11.388272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c1e8a528-49c9-43e2-ad2e-6b3cf7c8cea6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:11.394250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c1e8a528-49c9-43e2-ad2e-6b3cf7c8cea6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:11.395085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c1e8a528-49c9-43e2-ad2e-6b3cf7c8cea6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:55:11.408655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1e8a528-49c9-43e2-ad2e-6b3cf7c8cea6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:11.409123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1e8a528-49c9-43e2-ad2e-6b3cf7c8cea6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:11.410109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1e8a528-49c9-43e2-ad2e-6b3cf7c8cea6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:11.410569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1e8a528-49c9-43e2-ad2e-6b3cf7c8cea6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:11.496028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-c1e8a528-49c9-43e2-ad2e-6b3cf7c8cea6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:55:11.554693 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c1e8a528-49c9-43e2-ad2e-6b3cf7c8cea6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.176076 Mar 12 20:55:11.555678 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1309/2077] 10.222.0.30 () {58 vars in 1149 bytes} [Sat Mar 12 20:55:11 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:11.565418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99d4abe2-fe85-4720-b921-10794815e54e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '.version_select at 0x7f6e48d11e50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:11.588521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99d4abe2-fe85-4720-b921-10794815e54e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1407543264" status: 204 len: 0 microversion: 2.20 time: 0.031415 Mar 12 20:55:11.594501 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1310/2078] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Mar 12 20:55:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1407543264 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:55:11.599974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ae36cd5d-9a34-4a9a-89d1-bba73163eefb req-e3b14963-2eba-41cf-9841-6e44adc1a151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae82842-58a0-4d5e-a522-a1c83c53e101", "name": "network-vif-deleted", "tag": "c40c686b-b640-42d0-a899-bda5e43f8663"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:11.611907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ae36cd5d-9a34-4a9a-89d1-bba73163eefb req-e3b14963-2eba-41cf-9841-6e44adc1a151 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:11.612664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ae36cd5d-9a34-4a9a-89d1-bba73163eefb req-e3b14963-2eba-41cf-9841-6e44adc1a151 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:11.625651 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ae36cd5d-9a34-4a9a-89d1-bba73163eefb req-e3b14963-2eba-41cf-9841-6e44adc1a151 service nova] Creating event network-vif-deleted:c40c686b-b640-42d0-a899-bda5e43f8663 for instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 on nch1-master-1 Mar 12 20:55:11.632031 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ae36cd5d-9a34-4a9a-89d1-bba73163eefb req-e3b14963-2eba-41cf-9841-6e44adc1a151 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036183 Mar 12 20:55:11.632656 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1311/2079] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:11.639606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-95090f8b-11c2-4950-b1aa-4b8a15afe1b3 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:11.640328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-95090f8b-11c2-4950-b1aa-4b8a15afe1b3 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] [instance: a1757801-9401-43bb-9739-88275226163b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:11.646964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95090f8b-11c2-4950-b1aa-4b8a15afe1b3 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:11.647401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95090f8b-11c2-4950-b1aa-4b8a15afe1b3 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:11.648504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95090f8b-11c2-4950-b1aa-4b8a15afe1b3 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:11.648965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95090f8b-11c2-4950-b1aa-4b8a15afe1b3 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:11.677877 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-95090f8b-11c2-4950-b1aa-4b8a15afe1b3 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] HTTP exception thrown: Instance a1757801-9401-43bb-9739-88275226163b could not be found. Mar 12 20:55:11.678508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-95090f8b-11c2-4950-b1aa-4b8a15afe1b3 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] Returning 404 to user: Instance a1757801-9401-43bb-9739-88275226163b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:11.679376 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-95090f8b-11c2-4950-b1aa-4b8a15afe1b3 tempest-FloatingIPsAssociationTestJSON-121308160 tempest-FloatingIPsAssociationTestJSON-121308160-project] 10.222.0.30 "GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b" status: 404 len: 111 microversion: 2.1 time: 0.045642 Mar 12 20:55:11.679942 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1312/2080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:11 2022] GET /compute/v2.1/servers/a1757801-9401-43bb-9739-88275226163b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:11.685008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b938b4cb-9e50-40cf-8ef9-06d27688fe7a req-84aafe02-6429-4a64-983b-a7c658f1b6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1757801-9401-43bb-9739-88275226163b", "name": "network-vif-deleted", "tag": "fd63e40c-0216-442b-b910-13f01aad794f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:11.696294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b938b4cb-9e50-40cf-8ef9-06d27688fe7a req-84aafe02-6429-4a64-983b-a7c658f1b6d5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:11.696778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b938b4cb-9e50-40cf-8ef9-06d27688fe7a req-84aafe02-6429-4a64-983b-a7c658f1b6d5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:11.708432 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b938b4cb-9e50-40cf-8ef9-06d27688fe7a req-84aafe02-6429-4a64-983b-a7c658f1b6d5 service nova] Creating event network-vif-deleted:fd63e40c-0216-442b-b910-13f01aad794f for instance a1757801-9401-43bb-9739-88275226163b on nch2-master-1 Mar 12 20:55:11.716375 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b938b4cb-9e50-40cf-8ef9-06d27688fe7a req-84aafe02-6429-4a64-983b-a7c658f1b6d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035219 Mar 12 20:55:11.717193 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1313/2081] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:11.722614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ed17728c-5efe-4a37-9d6f-830bf102ef4f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:11.723817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ed17728c-5efe-4a37-9d6f-830bf102ef4f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:11.731811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed17728c-5efe-4a37-9d6f-830bf102ef4f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:11.732275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed17728c-5efe-4a37-9d6f-830bf102ef4f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:11.733262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed17728c-5efe-4a37-9d6f-830bf102ef4f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:11.734189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed17728c-5efe-4a37-9d6f-830bf102ef4f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:12.041890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ed17728c-5efe-4a37-9d6f-830bf102ef4f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:12.055710 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ed17728c-5efe-4a37-9d6f-830bf102ef4f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1540 microversion: 2.1 time: 0.337200 Mar 12 20:55:12.056902 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1314/2082] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:11 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1540 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:12.061675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0623b1d-fa5e-4830-a3ad-4e12f35a0e64 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:12.062315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b0623b1d-fa5e-4830-a3ad-4e12f35a0e64 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:12.069443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0623b1d-fa5e-4830-a3ad-4e12f35a0e64 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:12.070302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0623b1d-fa5e-4830-a3ad-4e12f35a0e64 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:12.072239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0623b1d-fa5e-4830-a3ad-4e12f35a0e64 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:12.072861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0623b1d-fa5e-4830-a3ad-4e12f35a0e64 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:12.166078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b0623b1d-fa5e-4830-a3ad-4e12f35a0e64 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:12.180317 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0623b1d-fa5e-4830-a3ad-4e12f35a0e64 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f" status: 200 len: 1282 microversion: 2.1 time: 0.120676 Mar 12 20:55:12.182078 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1315/2083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:12 2022] GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f => generated 1282 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:12.187464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bcb0e563-d0eb-432d-b424-b056598a3c80 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48df7dc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:12.223092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-bcb0e563-d0eb-432d-b424-b056598a3c80 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a3cc8b3f-054c-478e-80aa-8a0614e48a98 does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:55:12.223746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-bcb0e563-d0eb-432d-b424-b056598a3c80 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Neutron security group a3cc8b3f-054c-478e-80aa-8a0614e48a98 not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:55:12.226013 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bcb0e563-d0eb-432d-b424-b056598a3c80 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Security group a3cc8b3f-054c-478e-80aa-8a0614e48a98 does not exist Mar 12 20:55:12.226013 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-9826b6b2-7937-4588-a11c-0dc5fd264424'] Mar 12 20:55:12.227028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bcb0e563-d0eb-432d-b424-b056598a3c80 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Security group a3cc8b3f-054c-478e-80aa-8a0614e48a98 does not exist Mar 12 20:55:12.227028 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-9826b6b2-7937-4588-a11c-0dc5fd264424'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:12.228914 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bcb0e563-d0eb-432d-b424-b056598a3c80 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a3cc8b3f-054c-478e-80aa-8a0614e48a98" status: 404 len: 194 microversion: 2.1 time: 0.045696 Mar 12 20:55:12.229818 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1316/2084] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:55:12 2022] DELETE /compute/v2.1/os-security-groups/a3cc8b3f-054c-478e-80aa-8a0614e48a98 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:12.237429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52d44f4c-50e8-4d21-9f83-dc5ca0e7b18a tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] Action: 'update', calling method: .version_select at 0x7f6e48dec5e0>, body: {"meta": {"os_distro": "alt"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:12.263278 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-52d44f4c-50e8-4d21-9f83-dc5ca0e7b18a tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] HTTP exception thrown: Image not found. Mar 12 20:55:12.264112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52d44f4c-50e8-4d21-9f83-dc5ca0e7b18a tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:12.265123 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-52d44f4c-50e8-4d21-9f83-dc5ca0e7b18a tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] 10.222.0.30 "PUT /compute/v2.1/images/0b878ad5-f8d4-4176-b351-8e5a7acfcecb/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.034081 Mar 12 20:55:12.265877 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1317/2085] 10.222.0.30 () {60 vars in 1309 bytes} [Sat Mar 12 20:55:12 2022] PUT /compute/v2.1/images/0b878ad5-f8d4-4176-b351-8e5a7acfcecb/metadata/os_distro => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:55:12.274824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-171ccf34-d93c-4e4e-8006-ca4f0305a31b tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:12.275932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-171ccf34-d93c-4e4e-8006-ca4f0305a31b tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:12.283078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-171ccf34-d93c-4e4e-8006-ca4f0305a31b tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:12.284179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-171ccf34-d93c-4e4e-8006-ca4f0305a31b tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:12.285025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-171ccf34-d93c-4e4e-8006-ca4f0305a31b tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:12.285618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-171ccf34-d93c-4e4e-8006-ca4f0305a31b tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:12.385055 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-171ccf34-d93c-4e4e-8006-ca4f0305a31b tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action" status: 202 len: 0 microversion: 2.1 time: 0.117494 Mar 12 20:55:12.386320 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1318/2086] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:55:12 2022] POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:55:12.394739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d6c6814-f350-44cd-898e-fae7a0761308 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e48cdbc10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:12.454137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-7d6c6814-f350-44cd-898e-fae7a0761308 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9c4d8665-ebfd-40d1-ad59-64d4cc26f82a does not exist", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:55:12.455030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-7d6c6814-f350-44cd-898e-fae7a0761308 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Neutron security group 9c4d8665-ebfd-40d1-ad59-64d4cc26f82a not found {{(pid=136302) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 12 20:55:12.456262 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-7d6c6814-f350-44cd-898e-fae7a0761308 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Security group 9c4d8665-ebfd-40d1-ad59-64d4cc26f82a does not exist Mar 12 20:55:12.456262 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-f113f593-b277-4492-869f-dd54bf406893'] Mar 12 20:55:12.457193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d6c6814-f350-44cd-898e-fae7a0761308 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Security group 9c4d8665-ebfd-40d1-ad59-64d4cc26f82a does not exist Mar 12 20:55:12.457193 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-f113f593-b277-4492-869f-dd54bf406893'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:12.458516 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d6c6814-f350-44cd-898e-fae7a0761308 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/9c4d8665-ebfd-40d1-ad59-64d4cc26f82a" status: 404 len: 194 microversion: 2.1 time: 0.071056 Mar 12 20:55:12.459632 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1319/2087] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:55:12 2022] DELETE /compute/v2.1/os-security-groups/9c4d8665-ebfd-40d1-ad59-64d4cc26f82a => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:12.466686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-06826bfb-1776-4dfa-830b-7dbfbfadd2cb tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] Action: 'create', calling method: .version_select at 0x7f6e48df7670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:12.488692 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-06826bfb-1776-4dfa-830b-7dbfbfadd2cb tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] HTTP exception thrown: Image not found. Mar 12 20:55:12.489389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-06826bfb-1776-4dfa-830b-7dbfbfadd2cb tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:12.490464 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-06826bfb-1776-4dfa-830b-7dbfbfadd2cb tempest-ImagesMetadataNegativeTestJSON-1636896214 tempest-ImagesMetadataNegativeTestJSON-1636896214-project] 10.222.0.30 "POST /compute/v2.1/images/762dcd0a-6685-4e0c-999c-bbe1bb6d2e98/metadata" status: 404 len: 62 microversion: 2.1 time: 0.029665 Mar 12 20:55:12.495673 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1320/2088] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Mar 12 20:55:12 2022] POST /compute/v2.1/images/762dcd0a-6685-4e0c-999c-bbe1bb6d2e98/metadata => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:55:12.499456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-76f3a5bd-ce21-4ee4-8c4a-a50fd8eba541 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:12.500169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-76f3a5bd-ce21-4ee4-8c4a-a50fd8eba541 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:12.507026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76f3a5bd-ce21-4ee4-8c4a-a50fd8eba541 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:12.508082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76f3a5bd-ce21-4ee4-8c4a-a50fd8eba541 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:12.509478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76f3a5bd-ce21-4ee4-8c4a-a50fd8eba541 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:12.510070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76f3a5bd-ce21-4ee4-8c4a-a50fd8eba541 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:12.825127 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-76f3a5bd-ce21-4ee4-8c4a-a50fd8eba541 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1614 microversion: 2.1 time: 0.332777 Mar 12 20:55:12.827879 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1321/2089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:12 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1614 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:12.835928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f121b2e4-7682-4eaf-add1-74a83b96ba2d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:12.838373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f121b2e4-7682-4eaf-add1-74a83b96ba2d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:12.849166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f121b2e4-7682-4eaf-add1-74a83b96ba2d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:12.850004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f121b2e4-7682-4eaf-add1-74a83b96ba2d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:12.850974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f121b2e4-7682-4eaf-add1-74a83b96ba2d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:12.851591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f121b2e4-7682-4eaf-add1-74a83b96ba2d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:12.968429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f121b2e4-7682-4eaf-add1-74a83b96ba2d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:55:13.155488 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f121b2e4-7682-4eaf-add1-74a83b96ba2d tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a" status: 204 len: 0 microversion: 2.1 time: 0.325054 Mar 12 20:55:13.156860 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1322/2090] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:55:12 2022] DELETE /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:55:13.165193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d640f6c-c197-461a-b8bc-52b6861d7c8c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Action: 'create', calling method: .version_select at 0x7f6e48e4f9d0>, body: {"keypair": {"name": "tempest-keypair-1530783224"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:13.199192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-5d640f6c-c197-461a-b8bc-52b6861d7c8c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Getting quotas for project f0a5497c8a2449c89a200ddd03ce5aeb. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:13.207409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-5d640f6c-c197-461a-b8bc-52b6861d7c8c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Getting quotas for user 38372b69c92d4456879f7fa00239f0c8 and project f0a5497c8a2449c89a200ddd03ce5aeb. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:13.543684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-5d640f6c-c197-461a-b8bc-52b6861d7c8c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Getting quotas for project f0a5497c8a2449c89a200ddd03ce5aeb. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:13.550669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-5d640f6c-c197-461a-b8bc-52b6861d7c8c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Getting quotas for user 38372b69c92d4456879f7fa00239f0c8 and project f0a5497c8a2449c89a200ddd03ce5aeb. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:13.568284 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5d640f6c-c197-461a-b8bc-52b6861d7c8c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.409581 Mar 12 20:55:13.574308 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1323/2091] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Mar 12 20:55:13 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 417 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:55:13.580296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce2a81b7-290c-4ef1-b7b0-75cac0d6ea9d tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:13.581696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce2a81b7-290c-4ef1-b7b0-75cac0d6ea9d tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:13.587637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce2a81b7-290c-4ef1-b7b0-75cac0d6ea9d tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:13.588334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce2a81b7-290c-4ef1-b7b0-75cac0d6ea9d tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:13.589458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce2a81b7-290c-4ef1-b7b0-75cac0d6ea9d tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:13.589891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce2a81b7-290c-4ef1-b7b0-75cac0d6ea9d tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:13.876557 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce2a81b7-290c-4ef1-b7b0-75cac0d6ea9d tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1614 microversion: 2.1 time: 0.298550 Mar 12 20:55:13.878073 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1324/2092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:13 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1614 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:13.890088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f78456d1-0cb7-4484-9851-0aad536a9df8 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:13.891353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f78456d1-0cb7-4484-9851-0aad536a9df8 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:13.902128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f78456d1-0cb7-4484-9851-0aad536a9df8 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:13.902593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f78456d1-0cb7-4484-9851-0aad536a9df8 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:13.904243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f78456d1-0cb7-4484-9851-0aad536a9df8 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:13.905506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f78456d1-0cb7-4484-9851-0aad536a9df8 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:14.265811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f78456d1-0cb7-4484-9851-0aad536a9df8 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:14.280946 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f78456d1-0cb7-4484-9851-0aad536a9df8 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1540 microversion: 2.1 time: 0.399976 Mar 12 20:55:14.292436 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1325/2093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:13 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1540 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:14.302396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a2517210-6679-4699-91ed-2a9d1ae3b3ba tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:14.303270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a2517210-6679-4699-91ed-2a9d1ae3b3ba tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:14.311609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2517210-6679-4699-91ed-2a9d1ae3b3ba tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:14.324455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2517210-6679-4699-91ed-2a9d1ae3b3ba tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:14.326660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2517210-6679-4699-91ed-2a9d1ae3b3ba tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:14.327222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2517210-6679-4699-91ed-2a9d1ae3b3ba tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:14.779166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a2517210-6679-4699-91ed-2a9d1ae3b3ba tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b362003f1aa4db6a6c1e57e90c69ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c8d35436d54ee4887f69c41ec160f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:14.790164 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a2517210-6679-4699-91ed-2a9d1ae3b3ba tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a" status: 200 len: 1647 microversion: 2.1 time: 0.493889 Mar 12 20:55:14.790836 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1326/2094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:14 2022] GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a => generated 1647 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:14.808414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd750f1b-ed67-415f-b0ba-76478a90a87a tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:14.808552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd750f1b-ed67-415f-b0ba-76478a90a87a tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:14.828173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd750f1b-ed67-415f-b0ba-76478a90a87a tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:14.828638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd750f1b-ed67-415f-b0ba-76478a90a87a tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:14.829439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd750f1b-ed67-415f-b0ba-76478a90a87a tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:14.830997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd750f1b-ed67-415f-b0ba-76478a90a87a tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:15.316579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fd750f1b-ed67-415f-b0ba-76478a90a87a tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:15.330152 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd750f1b-ed67-415f-b0ba-76478a90a87a tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f" status: 200 len: 1403 microversion: 2.1 time: 0.525831 Mar 12 20:55:15.331046 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1327/2095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:14 2022] GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f => generated 1403 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:15.336868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-355165fa-7466-4d34-9ccd-40db35f20a9e req-ca34714c-2212-4482-9151-b7560ecb6b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9194940b-98b0-48a5-a60e-465ff599b850", "name": "network-vif-plugged", "status": "completed", "tag": "f12db82e-2096-4b5f-932a-29a10f30a068"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:15.348919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-355165fa-7466-4d34-9ccd-40db35f20a9e req-ca34714c-2212-4482-9151-b7560ecb6b22 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:15.350267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-355165fa-7466-4d34-9ccd-40db35f20a9e req-ca34714c-2212-4482-9151-b7560ecb6b22 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:15.368613 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-355165fa-7466-4d34-9ccd-40db35f20a9e req-ca34714c-2212-4482-9151-b7560ecb6b22 service nova] Creating event network-vif-plugged:f12db82e-2096-4b5f-932a-29a10f30a068 for instance 9194940b-98b0-48a5-a60e-465ff599b850 on nch1-master-1 Mar 12 20:55:15.376252 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-355165fa-7466-4d34-9ccd-40db35f20a9e req-ca34714c-2212-4482-9151-b7560ecb6b22 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043410 Mar 12 20:55:15.377050 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1328/2096] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:15.382683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86177fef-647f-4ed0-8408-ed7017a614f4 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:15.392707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86177fef-647f-4ed0-8408-ed7017a614f4 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:55:15.401134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86177fef-647f-4ed0-8408-ed7017a614f4 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:15.402275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86177fef-647f-4ed0-8408-ed7017a614f4 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:15.403804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86177fef-647f-4ed0-8408-ed7017a614f4 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:15.404601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86177fef-647f-4ed0-8408-ed7017a614f4 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:15.554737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-86177fef-647f-4ed0-8408-ed7017a614f4 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:55:15.644773 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86177fef-647f-4ed0-8408-ed7017a614f4 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 1000 microversion: 2.1 time: 0.265750 Mar 12 20:55:15.651463 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1329/2097] 10.222.0.30 () {58 vars in 1189 bytes} [Sat Mar 12 20:55:15 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 1000 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:15.861903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-70c45e15-31ce-49ca-9f47-2def28aa92c8 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Action: 'create', calling method: .version_select at 0x7f6e48dec940>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:15.877751 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-70c45e15-31ce-49ca-9f47-2def28aa92c8 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Mar 12 20:55:15.879662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-70c45e15-31ce-49ca-9f47-2def28aa92c8 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:15.885682 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-70c45e15-31ce-49ca-9f47-2def28aa92c8 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.233334 Mar 12 20:55:15.890716 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1330/2098] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:55:15 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 239 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:55:15.895574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6be26342-69df-4923-bb83-a94f97532bbd tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:15.905682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6be26342-69df-4923-bb83-a94f97532bbd tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:15.916763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6be26342-69df-4923-bb83-a94f97532bbd tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:15.917229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6be26342-69df-4923-bb83-a94f97532bbd tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:15.919794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6be26342-69df-4923-bb83-a94f97532bbd tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:15.920254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6be26342-69df-4923-bb83-a94f97532bbd tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:16.646587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6be26342-69df-4923-bb83-a94f97532bbd tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:16.657713 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6be26342-69df-4923-bb83-a94f97532bbd tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1535 microversion: 2.1 time: 0.768605 Mar 12 20:55:16.667664 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1331/2099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:15 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1535 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:16.672105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5258dbf9-2e97-4972-a750-d45567f41d36 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:16.678677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5258dbf9-2e97-4972-a750-d45567f41d36 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:55:16.684011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5258dbf9-2e97-4972-a750-d45567f41d36 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:16.685106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5258dbf9-2e97-4972-a750-d45567f41d36 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:16.686026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5258dbf9-2e97-4972-a750-d45567f41d36 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:16.686757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5258dbf9-2e97-4972-a750-d45567f41d36 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:16.709840 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5258dbf9-2e97-4972-a750-d45567f41d36 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.042044 Mar 12 20:55:16.710446 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1332/2100] 10.222.0.30 () {58 vars in 1195 bytes} [Sat Mar 12 20:55:16 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:55:16.715574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5916be83-6139-4ba0-aca5-4fc9707ca580 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:16.716681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5916be83-6139-4ba0-aca5-4fc9707ca580 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] [instance: c25b8295-eac5-4598-9776-94fad81bc42a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:16.723426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5916be83-6139-4ba0-aca5-4fc9707ca580 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:16.723957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5916be83-6139-4ba0-aca5-4fc9707ca580 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:16.724915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5916be83-6139-4ba0-aca5-4fc9707ca580 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:16.725560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5916be83-6139-4ba0-aca5-4fc9707ca580 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:16.740911 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-5916be83-6139-4ba0-aca5-4fc9707ca580 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] HTTP exception thrown: Instance c25b8295-eac5-4598-9776-94fad81bc42a could not be found. Mar 12 20:55:16.741528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5916be83-6139-4ba0-aca5-4fc9707ca580 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Returning 404 to user: Instance c25b8295-eac5-4598-9776-94fad81bc42a could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:16.742825 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5916be83-6139-4ba0-aca5-4fc9707ca580 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a" status: 404 len: 111 microversion: 2.1 time: 0.031265 Mar 12 20:55:16.743932 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1333/2101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:16 2022] GET /compute/v2.1/servers/c25b8295-eac5-4598-9776-94fad81bc42a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:16.749452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-67ddd558-9e3d-4dff-a131-e458317ad0e8 req-b650dfc5-ff05-4c2c-b488-92daeed12f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25b8295-eac5-4598-9776-94fad81bc42a", "name": "network-vif-deleted", "tag": "8fbb98dd-c64e-4f04-b014-2c1dbc456627"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:16.757969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-67ddd558-9e3d-4dff-a131-e458317ad0e8 req-b650dfc5-ff05-4c2c-b488-92daeed12f50 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:16.758425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-67ddd558-9e3d-4dff-a131-e458317ad0e8 req-b650dfc5-ff05-4c2c-b488-92daeed12f50 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:16.770761 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-67ddd558-9e3d-4dff-a131-e458317ad0e8 req-b650dfc5-ff05-4c2c-b488-92daeed12f50 service nova] Creating event network-vif-deleted:8fbb98dd-c64e-4f04-b014-2c1dbc456627 for instance c25b8295-eac5-4598-9776-94fad81bc42a on nch2-master-1 Mar 12 20:55:16.776028 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-67ddd558-9e3d-4dff-a131-e458317ad0e8 req-b650dfc5-ff05-4c2c-b488-92daeed12f50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030700 Mar 12 20:55:16.776639 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1334/2102] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:16.795314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7aa5066a-7417-4f3d-b79b-256d830b1b7e tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Action: 'create', calling method: .version_select at 0x7f6e3725ac10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-792427281", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:16.818964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7aa5066a-7417-4f3d-b79b-256d830b1b7e tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Getting quotas for project 3fe1ccdc85964667a8e52ccc1817f6f8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:16.825297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7aa5066a-7417-4f3d-b79b-256d830b1b7e tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Getting quotas for user 456d0d4e30ba4ac29bfb11dbe8a8c133 and project 3fe1ccdc85964667a8e52ccc1817f6f8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:16.848497 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-7aa5066a-7417-4f3d-b79b-256d830b1b7e tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Mar 12 20:55:16.849199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7aa5066a-7417-4f3d-b79b-256d830b1b7e tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:16.850272 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7aa5066a-7417-4f3d-b79b-256d830b1b7e tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.072197 Mar 12 20:55:16.850943 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1335/2103] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Mar 12 20:55:16 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:55:16.858812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-292c6e21-a9a0-46d2-910f-54c587c97d26 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:16.859688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-292c6e21-a9a0-46d2-910f-54c587c97d26 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:16.868462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-292c6e21-a9a0-46d2-910f-54c587c97d26 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:16.868961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-292c6e21-a9a0-46d2-910f-54c587c97d26 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:16.869864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-292c6e21-a9a0-46d2-910f-54c587c97d26 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:16.870692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-292c6e21-a9a0-46d2-910f-54c587c97d26 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:17.066699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-292c6e21-a9a0-46d2-910f-54c587c97d26 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:17.076647 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-292c6e21-a9a0-46d2-910f-54c587c97d26 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f" status: 200 len: 1403 microversion: 2.1 time: 0.224350 Mar 12 20:55:17.085859 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1336/2104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:16 2022] GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f => generated 1403 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:17.091289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96b0ce91-011a-4096-b987-faf94252a922 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:17.092678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96b0ce91-011a-4096-b987-faf94252a922 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:17.100366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96b0ce91-011a-4096-b987-faf94252a922 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:17.100953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96b0ce91-011a-4096-b987-faf94252a922 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:17.101938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96b0ce91-011a-4096-b987-faf94252a922 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:17.103112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96b0ce91-011a-4096-b987-faf94252a922 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:17.216904 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96b0ce91-011a-4096-b987-faf94252a922 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action" status: 202 len: 0 microversion: 2.1 time: 0.136456 Mar 12 20:55:17.218228 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1337/2105] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:55:17 2022] POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:55:17.223962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7296415d-2eeb-4f51-84c1-158f50f633df tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e37249820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:17.613613 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7296415d-2eeb-4f51-84c1-158f50f633df tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/8a20781e-800f-4674-9ecb-973f41cc9b49" status: 202 len: 0 microversion: 2.1 time: 0.394116 Mar 12 20:55:17.614616 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1338/2106] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:55:17 2022] DELETE /compute/v2.1/os-security-groups/8a20781e-800f-4674-9ecb-973f41cc9b49 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:55:17.624286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e180c684-d5b4-4cf4-b43a-499b0f72e1c0 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Action: 'create', calling method: .version_select at 0x7f6e48deca60>, body: {"keypair": {"name": "tempest-keypair-1310366646"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:17.657894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e180c684-d5b4-4cf4-b43a-499b0f72e1c0 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Getting quotas for project 3fe1ccdc85964667a8e52ccc1817f6f8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:17.667161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e180c684-d5b4-4cf4-b43a-499b0f72e1c0 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Getting quotas for user 456d0d4e30ba4ac29bfb11dbe8a8c133 and project 3fe1ccdc85964667a8e52ccc1817f6f8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:18.412710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e180c684-d5b4-4cf4-b43a-499b0f72e1c0 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Getting quotas for project 3fe1ccdc85964667a8e52ccc1817f6f8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:18.418194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e180c684-d5b4-4cf4-b43a-499b0f72e1c0 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Getting quotas for user 456d0d4e30ba4ac29bfb11dbe8a8c133 and project 3fe1ccdc85964667a8e52ccc1817f6f8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:18.434087 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e180c684-d5b4-4cf4-b43a-499b0f72e1c0 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.818144 Mar 12 20:55:18.439547 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1339/2107] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:55:17 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:18.444416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:18.445944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:18.452612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:18.453114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:18.453914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:18.454355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:18.541796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:55:18.542242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:55:18.542712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:55:18.543116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:55:18.543595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:55:18.604729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:18.612383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:18.613079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:18.614647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:18.614946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:18.644620 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f882c120-02e5-4ba7-9ab0-0ef94388b958 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action" status: 202 len: 1067 microversion: 2.1 time: 0.208344 Mar 12 20:55:18.645271 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1340/2108] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:55:18 2022] POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action => generated 1067 bytes in 210 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 12 20:55:18.650318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-dd7c840e-0b1e-4a7d-b1e3-05a75decb2c7 req-967d9ee1-20ac-44b2-a540-3ca7b3e98edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb2fd2e-7732-4147-a539-bc8f0629504f", "tag": "a99ba367-b732-4ccf-812e-7e277a1090f2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:18.659073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-dd7c840e-0b1e-4a7d-b1e3-05a75decb2c7 req-967d9ee1-20ac-44b2-a540-3ca7b3e98edf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:18.660221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-dd7c840e-0b1e-4a7d-b1e3-05a75decb2c7 req-967d9ee1-20ac-44b2-a540-3ca7b3e98edf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:18.671241 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-dd7c840e-0b1e-4a7d-b1e3-05a75decb2c7 req-967d9ee1-20ac-44b2-a540-3ca7b3e98edf service nova] Creating event network-changed:a99ba367-b732-4ccf-812e-7e277a1090f2 for instance 0bb2fd2e-7732-4147-a539-bc8f0629504f on nch2-master-1 Mar 12 20:55:18.677265 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-dd7c840e-0b1e-4a7d-b1e3-05a75decb2c7 req-967d9ee1-20ac-44b2-a540-3ca7b3e98edf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030401 Mar 12 20:55:18.678516 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1341/2109] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:18.686290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7c9465f-ed43-485d-afbe-9a9c9d5698a6 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] Calling method '.version_select at 0x7f6e37235670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:18.880156 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7c9465f-ed43-485d-afbe-9a9c9d5698a6 tempest-SecurityGroupsTestJSON-811797342 tempest-SecurityGroupsTestJSON-811797342-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/b3716991-0e82-44fa-873e-c50052162046" status: 202 len: 0 microversion: 2.1 time: 0.200415 Mar 12 20:55:18.881054 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1342/2110] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 20:55:18 2022] DELETE /compute/v2.1/os-security-groups/b3716991-0e82-44fa-873e-c50052162046 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:55:18.890944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5b04629-d289-480e-b737-6cc5ac32ab1d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:18.891890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e5b04629-d289-480e-b737-6cc5ac32ab1d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:18.910653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5b04629-d289-480e-b737-6cc5ac32ab1d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:18.911404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5b04629-d289-480e-b737-6cc5ac32ab1d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:18.912931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5b04629-d289-480e-b737-6cc5ac32ab1d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:18.913606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5b04629-d289-480e-b737-6cc5ac32ab1d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:19.176783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e5b04629-d289-480e-b737-6cc5ac32ab1d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:19.186865 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e5b04629-d289-480e-b737-6cc5ac32ab1d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1522 microversion: 2.1 time: 0.301272 Mar 12 20:55:19.190224 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1343/2111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:18 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:19.200560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0bf5f2d3-048b-4c79-a0c3-18d0f1ed3273 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:19.206418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0bf5f2d3-048b-4c79-a0c3-18d0f1ed3273 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:19.230071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bf5f2d3-048b-4c79-a0c3-18d0f1ed3273 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:19.230792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bf5f2d3-048b-4c79-a0c3-18d0f1ed3273 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:19.232511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bf5f2d3-048b-4c79-a0c3-18d0f1ed3273 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:19.232623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bf5f2d3-048b-4c79-a0c3-18d0f1ed3273 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:19.524191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0bf5f2d3-048b-4c79-a0c3-18d0f1ed3273 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:19.532781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0bf5f2d3-048b-4c79-a0c3-18d0f1ed3273 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f" status: 200 len: 1403 microversion: 2.1 time: 0.338007 Mar 12 20:55:19.533657 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1344/2112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:19 2022] GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f => generated 1403 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:19.538297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab59c8bc-a05a-4952-ad93-c049a4074eca tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Action: 'create', calling method: .version_select at 0x7f6e374f10d0>, body: {"keypair": {"name": "tempest-keypair-1310366646"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:19.554558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ab59c8bc-a05a-4952-ad93-c049a4074eca tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Getting quotas for project 3fe1ccdc85964667a8e52ccc1817f6f8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:19.560319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ab59c8bc-a05a-4952-ad93-c049a4074eca tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Getting quotas for user 456d0d4e30ba4ac29bfb11dbe8a8c133 and project 3fe1ccdc85964667a8e52ccc1817f6f8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:19.846527 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ab59c8bc-a05a-4952-ad93-c049a4074eca tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] HTTP exception thrown: Key pair 'tempest-keypair-1310366646' already exists. Mar 12 20:55:19.847850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab59c8bc-a05a-4952-ad93-c049a4074eca tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Returning 409 to user: Key pair 'tempest-keypair-1310366646' already exists. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:19.850815 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ab59c8bc-a05a-4952-ad93-c049a4074eca tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.316447 Mar 12 20:55:19.855146 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1345/2113] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:55:19 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 321 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:55:19.863384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ea113cd-0ee0-4cb6-b453-ab7716f12309 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:19.864452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ea113cd-0ee0-4cb6-b453-ab7716f12309 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:19.871237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ea113cd-0ee0-4cb6-b453-ab7716f12309 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:19.871978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ea113cd-0ee0-4cb6-b453-ab7716f12309 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:19.873121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ea113cd-0ee0-4cb6-b453-ab7716f12309 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:19.873787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ea113cd-0ee0-4cb6-b453-ab7716f12309 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:20.172090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ea113cd-0ee0-4cb6-b453-ab7716f12309 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:20.180148 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ea113cd-0ee0-4cb6-b453-ab7716f12309 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1471 microversion: 2.1 time: 0.323346 Mar 12 20:55:20.181171 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1346/2114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:19 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1471 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:20.196222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f0278953-f094-4bae-b815-ac6f16c45afe tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:20.196980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f0278953-f094-4bae-b815-ac6f16c45afe tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:20.204319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0278953-f094-4bae-b815-ac6f16c45afe tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:20.205721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0278953-f094-4bae-b815-ac6f16c45afe tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:20.209095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0278953-f094-4bae-b815-ac6f16c45afe tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:20.209791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0278953-f094-4bae-b815-ac6f16c45afe tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:20.272779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f0278953-f094-4bae-b815-ac6f16c45afe tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:55:20.470777 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f0278953-f094-4bae-b815-ac6f16c45afe tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 204 len: 0 microversion: 2.1 time: 0.278173 Mar 12 20:55:20.471334 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1347/2115] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:55:20 2022] DELETE /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:55:20.483878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-84189037", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a51710d4-9f40-4852-b011-5741f102b40f"}], "security_groups": [{"name": "tempest-securitygroup--1194006531"}], "key_name": "tempest-keypair-1530783224", "user_data": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:20.669759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] validate_networks() for [('a51710d4-9f40-4852-b011-5741f102b40f', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:55:21.383893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:55:21.384547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:55:21.384771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:55:21.385395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:55:21.386035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:55:21.407102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:21.407816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:21.408776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:21.409410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:21.450653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Getting quotas for project f0a5497c8a2449c89a200ddd03ce5aeb. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:21.458061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Getting quotas for user 38372b69c92d4456879f7fa00239f0c8 and project f0a5497c8a2449c89a200ddd03ce5aeb. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:21.475157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:55:21.478055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:55:21.611904 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b853d30-0ddc-4956-9981-497d220ed827 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.138553 Mar 12 20:55:21.620311 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1348/2116] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:55:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 20:55:21.633046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d39099f5-028d-4e95-b009-87fc54a55204 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Calling method '.version_select at 0x7f6e37249e50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:21.694389 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d39099f5-028d-4e95-b009-87fc54a55204 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310366646" status: 202 len: 0 microversion: 2.1 time: 0.072560 Mar 12 20:55:21.695878 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1349/2117] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Mar 12 20:55:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310366646 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:55:21.710047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f22ef65e-7fc0-40e3-8980-502811e088a5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:21.711176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f22ef65e-7fc0-40e3-8980-502811e088a5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:21.724868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f22ef65e-7fc0-40e3-8980-502811e088a5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:21.728387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f22ef65e-7fc0-40e3-8980-502811e088a5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:21.729907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f22ef65e-7fc0-40e3-8980-502811e088a5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:21.732569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f22ef65e-7fc0-40e3-8980-502811e088a5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:22.283546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f22ef65e-7fc0-40e3-8980-502811e088a5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:22.294481 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f22ef65e-7fc0-40e3-8980-502811e088a5 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1528 microversion: 2.1 time: 0.596313 Mar 12 20:55:22.306799 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1350/2118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:21 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1528 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:22.335540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf1be324-7997-4f59-b332-ee1b4576c8d0 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:22.338450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bf1be324-7997-4f59-b332-ee1b4576c8d0 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:22.361426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf1be324-7997-4f59-b332-ee1b4576c8d0 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:22.362056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf1be324-7997-4f59-b332-ee1b4576c8d0 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:22.370678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf1be324-7997-4f59-b332-ee1b4576c8d0 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:22.371655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf1be324-7997-4f59-b332-ee1b4576c8d0 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:22.793723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bf1be324-7997-4f59-b332-ee1b4576c8d0 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:22.801755 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bf1be324-7997-4f59-b332-ee1b4576c8d0 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f" status: 200 len: 1403 microversion: 2.1 time: 0.480898 Mar 12 20:55:22.809825 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1351/2119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:22 2022] GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f => generated 1403 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:22.824383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0ab7c3cf-5237-4edb-8151-911192430e7d req-9a72694d-c3cd-4ba0-b819-522664f761ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9194940b-98b0-48a5-a60e-465ff599b850", "name": "network-vif-unplugged", "status": "completed", "tag": "f12db82e-2096-4b5f-932a-29a10f30a068"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:22.840909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0ab7c3cf-5237-4edb-8151-911192430e7d req-9a72694d-c3cd-4ba0-b819-522664f761ca service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:22.841395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0ab7c3cf-5237-4edb-8151-911192430e7d req-9a72694d-c3cd-4ba0-b819-522664f761ca service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:22.894029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0ab7c3cf-5237-4edb-8151-911192430e7d req-9a72694d-c3cd-4ba0-b819-522664f761ca service nova] Creating event network-vif-unplugged:f12db82e-2096-4b5f-932a-29a10f30a068 for instance 9194940b-98b0-48a5-a60e-465ff599b850 on nch1-master-1 Mar 12 20:55:22.901542 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0ab7c3cf-5237-4edb-8151-911192430e7d req-9a72694d-c3cd-4ba0-b819-522664f761ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091587 Mar 12 20:55:22.903606 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1352/2120] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:22.911802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a47396fc-1430-4e84-b548-39d5bf773891 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:22.913018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a47396fc-1430-4e84-b548-39d5bf773891 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:22.922510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a47396fc-1430-4e84-b548-39d5bf773891 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:22.924090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a47396fc-1430-4e84-b548-39d5bf773891 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:22.925317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a47396fc-1430-4e84-b548-39d5bf773891 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:22.926021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a47396fc-1430-4e84-b548-39d5bf773891 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:23.720129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a47396fc-1430-4e84-b548-39d5bf773891 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:23.727692 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a47396fc-1430-4e84-b548-39d5bf773891 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1471 microversion: 2.1 time: 0.822385 Mar 12 20:55:23.728272 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1353/2121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:22 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1471 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:23.917505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ce2e50f-6a79-43d8-a1f2-b4c85cd8882e tempest-AZV2TestJSON-328676373 tempest-AZV2TestJSON-328676373-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:23.920823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ce2e50f-6a79-43d8-a1f2-b4c85cd8882e tempest-AZV2TestJSON-328676373 tempest-AZV2TestJSON-328676373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:23.920823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ce2e50f-6a79-43d8-a1f2-b4c85cd8882e tempest-AZV2TestJSON-328676373 tempest-AZV2TestJSON-328676373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:23.921450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ce2e50f-6a79-43d8-a1f2-b4c85cd8882e tempest-AZV2TestJSON-328676373 tempest-AZV2TestJSON-328676373-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:23.921946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ce2e50f-6a79-43d8-a1f2-b4c85cd8882e tempest-AZV2TestJSON-328676373 tempest-AZV2TestJSON-328676373-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:23.962250 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ce2e50f-6a79-43d8-a1f2-b4c85cd8882e tempest-AZV2TestJSON-328676373 tempest-AZV2TestJSON-328676373-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.228105 Mar 12 20:55:23.963489 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1354/2122] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Mar 12 20:55:23 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:55:23.969694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c0716eef-c180-4567-9d28-dc178ef5114e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:23.970527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c0716eef-c180-4567-9d28-dc178ef5114e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:23.977007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0716eef-c180-4567-9d28-dc178ef5114e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:23.977705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0716eef-c180-4567-9d28-dc178ef5114e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:23.978829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0716eef-c180-4567-9d28-dc178ef5114e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:23.979431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0716eef-c180-4567-9d28-dc178ef5114e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:24.096136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0716eef-c180-4567-9d28-dc178ef5114e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:24.109883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0716eef-c180-4567-9d28-dc178ef5114e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:24.112756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0716eef-c180-4567-9d28-dc178ef5114e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:24.114847 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c0716eef-c180-4567-9d28-dc178ef5114e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1338 microversion: 2.20 time: 0.149610 Mar 12 20:55:24.116404 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1355/2123] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:55:23 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1338 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:55:24.122671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b715cc9c-51fb-457d-a74c-944718a46abc tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Action: 'create', calling method: .version_select at 0x7f6e372e5160>, body: {"keypair": {"name": ""}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:24.124425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b715cc9c-51fb-457d-a74c-944718a46abc tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:24.127150 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b715cc9c-51fb-457d-a74c-944718a46abc tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009439 Mar 12 20:55:24.128254 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1356/2124] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:55:24 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:55:24.138563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14330857-78d0-40ef-941c-e7d0feabcb2f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:24.139445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14330857-78d0-40ef-941c-e7d0feabcb2f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:24.161105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14330857-78d0-40ef-941c-e7d0feabcb2f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:24.161841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14330857-78d0-40ef-941c-e7d0feabcb2f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:24.162912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14330857-78d0-40ef-941c-e7d0feabcb2f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:24.164162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14330857-78d0-40ef-941c-e7d0feabcb2f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:24.392327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14330857-78d0-40ef-941c-e7d0feabcb2f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:24.404861 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14330857-78d0-40ef-941c-e7d0feabcb2f tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 200 len: 1486 microversion: 2.1 time: 0.275184 Mar 12 20:55:24.405946 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1357/2125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:24 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 1486 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:24.813522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-45512ced-2e1a-446b-9382-6b4b5a06ad4d tempest-FloatingIPsNegativeTestJSON-1719022491 tempest-FloatingIPsNegativeTestJSON-1719022491-project] Calling method '.version_select at 0x7f6e3727c310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:24.909131 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-45512ced-2e1a-446b-9382-6b4b5a06ad4d tempest-FloatingIPsNegativeTestJSON-1719022491 tempest-FloatingIPsNegativeTestJSON-1719022491-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.501951 Mar 12 20:55:24.916193 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1358/2126] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Mar 12 20:55:24 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:55:24.916193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b6a4b5d-20d5-4c28-83b3-4f3a8bedd83b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:24.916193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b6a4b5d-20d5-4c28-83b3-4f3a8bedd83b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:24.931264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b6a4b5d-20d5-4c28-83b3-4f3a8bedd83b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:24.932422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b6a4b5d-20d5-4c28-83b3-4f3a8bedd83b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:24.933208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b6a4b5d-20d5-4c28-83b3-4f3a8bedd83b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:24.933643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b6a4b5d-20d5-4c28-83b3-4f3a8bedd83b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:25.311254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b6a4b5d-20d5-4c28-83b3-4f3a8bedd83b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:25.324450 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b6a4b5d-20d5-4c28-83b3-4f3a8bedd83b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f" status: 200 len: 1403 microversion: 2.1 time: 0.413440 Mar 12 20:55:25.325588 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1359/2127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:24 2022] GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f => generated 1403 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:25.339084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d707920-49f4-4bc0-83d4-fe2bc935963d tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Action: 'create', calling method: .version_select at 0x7f6e48ccd940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-605800208", "public_key": " "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:25.386850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7d707920-49f4-4bc0-83d4-fe2bc935963d tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Getting quotas for project 3fe1ccdc85964667a8e52ccc1817f6f8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:25.403104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7d707920-49f4-4bc0-83d4-fe2bc935963d tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Getting quotas for user 456d0d4e30ba4ac29bfb11dbe8a8c133 and project 3fe1ccdc85964667a8e52ccc1817f6f8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:25.456627 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-7d707920-49f4-4bc0-83d4-fe2bc935963d tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Mar 12 20:55:25.457513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d707920-49f4-4bc0-83d4-fe2bc935963d tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:25.458575 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d707920-49f4-4bc0-83d4-fe2bc935963d tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.129343 Mar 12 20:55:25.464111 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1360/2128] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:55:25 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:55:25.473043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4de27200-0b49-4f87-8ff6-065c8dba17be req-7f74af99-c5aa-4d58-bf51-bf6c26a4523d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9194940b-98b0-48a5-a60e-465ff599b850", "name": "network-vif-deleted", "tag": "f12db82e-2096-4b5f-932a-29a10f30a068"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:25.492327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4de27200-0b49-4f87-8ff6-065c8dba17be req-7f74af99-c5aa-4d58-bf51-bf6c26a4523d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:25.495182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4de27200-0b49-4f87-8ff6-065c8dba17be req-7f74af99-c5aa-4d58-bf51-bf6c26a4523d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:25.517573 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4de27200-0b49-4f87-8ff6-065c8dba17be req-7f74af99-c5aa-4d58-bf51-bf6c26a4523d service nova] Creating event network-vif-deleted:f12db82e-2096-4b5f-932a-29a10f30a068 for instance 9194940b-98b0-48a5-a60e-465ff599b850 on nch1-master-1 Mar 12 20:55:25.536313 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4de27200-0b49-4f87-8ff6-065c8dba17be req-7f74af99-c5aa-4d58-bf51-bf6c26a4523d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069471 Mar 12 20:55:25.538710 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1361/2129] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:25.552929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f51abfd2-9ccd-4ade-9ea2-81e2ee34ce8f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:25.554879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f51abfd2-9ccd-4ade-9ea2-81e2ee34ce8f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:25.566899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f51abfd2-9ccd-4ade-9ea2-81e2ee34ce8f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:25.571378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f51abfd2-9ccd-4ade-9ea2-81e2ee34ce8f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:25.573432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f51abfd2-9ccd-4ade-9ea2-81e2ee34ce8f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:25.576775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f51abfd2-9ccd-4ade-9ea2-81e2ee34ce8f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:26.129734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f51abfd2-9ccd-4ade-9ea2-81e2ee34ce8f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:26.154762 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f51abfd2-9ccd-4ade-9ea2-81e2ee34ce8f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1471 microversion: 2.1 time: 0.614575 Mar 12 20:55:26.163046 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1362/2130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:25 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1471 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:26.173956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-781c6f5f-4e83-4ec1-9e9c-0ca9f3c14a12 tempest-FloatingIPsNegativeTestJSON-1719022491 tempest-FloatingIPsNegativeTestJSON-1719022491-project] Action: 'create', calling method: .version_select at 0x7f6e48df7820>, body: {"pool": "non_exist_pool"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:26.249580 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-781c6f5f-4e83-4ec1-9e9c-0ca9f3c14a12 tempest-FloatingIPsNegativeTestJSON-1719022491 tempest-FloatingIPsNegativeTestJSON-1719022491-project] HTTP exception thrown: Floating IP pool not found. Mar 12 20:55:26.250230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-781c6f5f-4e83-4ec1-9e9c-0ca9f3c14a12 tempest-FloatingIPsNegativeTestJSON-1719022491 tempest-FloatingIPsNegativeTestJSON-1719022491-project] Returning 404 to user: Floating IP pool not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:26.251083 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-781c6f5f-4e83-4ec1-9e9c-0ca9f3c14a12 tempest-FloatingIPsNegativeTestJSON-1719022491 tempest-FloatingIPsNegativeTestJSON-1719022491-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.086439 Mar 12 20:55:26.257492 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1363/2131] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Mar 12 20:55:26 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:55:26.263635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c89be371-fa2f-4232-8d10-3d17faf47013 req-cca6de2f-239e-4dd7-a2c8-b653e3527c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb2fd2e-7732-4147-a539-bc8f0629504f", "name": "network-vif-plugged", "status": "completed", "tag": "a99ba367-b732-4ccf-812e-7e277a1090f2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:26.286302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c89be371-fa2f-4232-8d10-3d17faf47013 req-cca6de2f-239e-4dd7-a2c8-b653e3527c30 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:26.286765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c89be371-fa2f-4232-8d10-3d17faf47013 req-cca6de2f-239e-4dd7-a2c8-b653e3527c30 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:26.321730 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c89be371-fa2f-4232-8d10-3d17faf47013 req-cca6de2f-239e-4dd7-a2c8-b653e3527c30 service nova] Creating event network-vif-plugged:a99ba367-b732-4ccf-812e-7e277a1090f2 for instance 0bb2fd2e-7732-4147-a539-bc8f0629504f on nch2-master-1 Mar 12 20:55:26.332767 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c89be371-fa2f-4232-8d10-3d17faf47013 req-cca6de2f-239e-4dd7-a2c8-b653e3527c30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073565 Mar 12 20:55:26.333391 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1364/2132] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:26.353421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-73ff1725-f224-43ac-80a2-676da3c766ad tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:26.354396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-73ff1725-f224-43ac-80a2-676da3c766ad tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:26.374325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73ff1725-f224-43ac-80a2-676da3c766ad tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:26.374999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73ff1725-f224-43ac-80a2-676da3c766ad tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:26.381321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73ff1725-f224-43ac-80a2-676da3c766ad tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:26.381965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73ff1725-f224-43ac-80a2-676da3c766ad tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:26.846646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-73ff1725-f224-43ac-80a2-676da3c766ad tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:26.860625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-73ff1725-f224-43ac-80a2-676da3c766ad tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:26.863645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-73ff1725-f224-43ac-80a2-676da3c766ad tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:26.865061 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-73ff1725-f224-43ac-80a2-676da3c766ad tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1406 microversion: 2.20 time: 0.523781 Mar 12 20:55:26.866236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1365/2133] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:55:26 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1406 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:55:26.871211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f42b1812-5050-47f7-80a0-2a834fcfb8b7 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:26.872812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f42b1812-5050-47f7-80a0-2a834fcfb8b7 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:26.879571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f42b1812-5050-47f7-80a0-2a834fcfb8b7 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:26.880420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f42b1812-5050-47f7-80a0-2a834fcfb8b7 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:26.881482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f42b1812-5050-47f7-80a0-2a834fcfb8b7 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:26.882205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f42b1812-5050-47f7-80a0-2a834fcfb8b7 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:26.899236 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f42b1812-5050-47f7-80a0-2a834fcfb8b7 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] HTTP exception thrown: Instance 9194940b-98b0-48a5-a60e-465ff599b850 could not be found. Mar 12 20:55:26.900377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f42b1812-5050-47f7-80a0-2a834fcfb8b7 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 404 to user: Instance 9194940b-98b0-48a5-a60e-465ff599b850 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:26.901471 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f42b1812-5050-47f7-80a0-2a834fcfb8b7 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 404 len: 111 microversion: 2.1 time: 0.034035 Mar 12 20:55:26.902284 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1366/2134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:26 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:26.907617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49c7f5be-942d-4a1a-8541-e2a7b2373bce tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Action: 'create', calling method: .version_select at 0x7f6e3725a1f0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:26.910159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49c7f5be-942d-4a1a-8541-e2a7b2373bce tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:26.911378 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-49c7f5be-942d-4a1a-8541-e2a7b2373bce tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.007699 Mar 12 20:55:26.916646 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1367/2135] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Mar 12 20:55:26 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:55:26.923206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-40e0c9e7-a96e-4198-85a4-504d549671bf req-6d7ac84a-1005-4352-b3a9-d66dc44aff96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27f34eb-a809-408c-9262-cec7223eee56", "tag": "74c66795-a7e0-451e-bc40-b9db6d6b19d0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:26.934922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-40e0c9e7-a96e-4198-85a4-504d549671bf req-6d7ac84a-1005-4352-b3a9-d66dc44aff96 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:26.937232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-40e0c9e7-a96e-4198-85a4-504d549671bf req-6d7ac84a-1005-4352-b3a9-d66dc44aff96 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:26.954142 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-40e0c9e7-a96e-4198-85a4-504d549671bf req-6d7ac84a-1005-4352-b3a9-d66dc44aff96 service nova] Creating event network-changed:74c66795-a7e0-451e-bc40-b9db6d6b19d0 for instance f27f34eb-a809-408c-9262-cec7223eee56 on nch2-master-1 Mar 12 20:55:26.963581 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-40e0c9e7-a96e-4198-85a4-504d549671bf req-6d7ac84a-1005-4352-b3a9-d66dc44aff96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045252 Mar 12 20:55:26.964918 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1368/2136] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:26.971010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a42d4eaa-06e7-4265-9ea7-faf9855413af tempest-FloatingIPsNegativeTestJSON-1719022491 tempest-FloatingIPsNegativeTestJSON-1719022491-project] Calling method '.version_select at 0x7f6e3728d1f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:27.050267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-a42d4eaa-06e7-4265-9ea7-faf9855413af tempest-FloatingIPsNegativeTestJSON-1719022491 tempest-FloatingIPsNegativeTestJSON-1719022491-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ad1bee60-2165-46bf-aeab-429eb9c8193b could not be found", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:55:27.051418 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a42d4eaa-06e7-4265-9ea7-faf9855413af tempest-FloatingIPsNegativeTestJSON-1719022491 tempest-FloatingIPsNegativeTestJSON-1719022491-project] HTTP exception thrown: Floating IP not found for ID ad1bee60-2165-46bf-aeab-429eb9c8193b Mar 12 20:55:27.052290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a42d4eaa-06e7-4265-9ea7-faf9855413af tempest-FloatingIPsNegativeTestJSON-1719022491 tempest-FloatingIPsNegativeTestJSON-1719022491-project] Returning 404 to user: Floating IP not found for ID ad1bee60-2165-46bf-aeab-429eb9c8193b {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:27.053593 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a42d4eaa-06e7-4265-9ea7-faf9855413af tempest-FloatingIPsNegativeTestJSON-1719022491 tempest-FloatingIPsNegativeTestJSON-1719022491-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/ad1bee60-2165-46bf-aeab-429eb9c8193b" status: 404 len: 111 microversion: 2.1 time: 0.087206 Mar 12 20:55:27.056302 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1369/2137] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:55:26 2022] DELETE /compute/v2.1/os-floating-ips/ad1bee60-2165-46bf-aeab-429eb9c8193b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:27.066879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-45f3640f-f356-4774-b7bf-97c896ad9c16 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:27.068202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-45f3640f-f356-4774-b7bf-97c896ad9c16 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:27.080255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45f3640f-f356-4774-b7bf-97c896ad9c16 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:27.084870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45f3640f-f356-4774-b7bf-97c896ad9c16 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:27.088451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45f3640f-f356-4774-b7bf-97c896ad9c16 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:27.095056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45f3640f-f356-4774-b7bf-97c896ad9c16 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:27.589351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-45f3640f-f356-4774-b7bf-97c896ad9c16 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:27.598029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-45f3640f-f356-4774-b7bf-97c896ad9c16 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f" status: 200 len: 1403 microversion: 2.1 time: 0.540399 Mar 12 20:55:27.598629 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1370/2138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:27 2022] GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f => generated 1403 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:27.613916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea4704b6-95a2-4ad7-83b9-980bed2c4f31 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Action: 'create', calling method: .version_select at 0x7f6e440661f0>, body: {"keypair": {"name": "tempest-keypair-2094121588"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:27.656618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ea4704b6-95a2-4ad7-83b9-980bed2c4f31 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Getting quotas for project bfa8b1575cea45b4945cd3984f6dbf64. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:27.662890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ea4704b6-95a2-4ad7-83b9-980bed2c4f31 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Getting quotas for user a0970c359e4146d9bc4b031060ec97ca and project bfa8b1575cea45b4945cd3984f6dbf64. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:27.784190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ea4704b6-95a2-4ad7-83b9-980bed2c4f31 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Getting quotas for project bfa8b1575cea45b4945cd3984f6dbf64. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:27.798855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ea4704b6-95a2-4ad7-83b9-980bed2c4f31 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Getting quotas for user a0970c359e4146d9bc4b031060ec97ca and project bfa8b1575cea45b4945cd3984f6dbf64. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:27.835031 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea4704b6-95a2-4ad7-83b9-980bed2c4f31 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.229876 Mar 12 20:55:27.836828 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1371/2139] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:55:27 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:27.849534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-041b55b4-b098-49d9-be81-d7fe4c01d7ec tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Action: 'create', calling method: .version_select at 0x7f6e37529a60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1776555270", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:27.887104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-041b55b4-b098-49d9-be81-d7fe4c01d7ec tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Getting quotas for project 3fe1ccdc85964667a8e52ccc1817f6f8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:27.903321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-041b55b4-b098-49d9-be81-d7fe4c01d7ec tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Getting quotas for user 456d0d4e30ba4ac29bfb11dbe8a8c133 and project 3fe1ccdc85964667a8e52ccc1817f6f8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:27.947906 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-041b55b4-b098-49d9-be81-d7fe4c01d7ec tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Mar 12 20:55:27.951128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-041b55b4-b098-49d9-be81-d7fe4c01d7ec tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:27.952823 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-041b55b4-b098-49d9-be81-d7fe4c01d7ec tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.115105 Mar 12 20:55:27.954525 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1372/2140] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Mar 12 20:55:27 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:55:27.970596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de39bb77-5db6-4131-b15d-1dcb03a9af41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:27.971113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-de39bb77-5db6-4131-b15d-1dcb03a9af41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:27.984555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de39bb77-5db6-4131-b15d-1dcb03a9af41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:27.985039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de39bb77-5db6-4131-b15d-1dcb03a9af41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:27.985847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de39bb77-5db6-4131-b15d-1dcb03a9af41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:27.986300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de39bb77-5db6-4131-b15d-1dcb03a9af41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:29.045354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-de39bb77-5db6-4131-b15d-1dcb03a9af41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:29.062594 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de39bb77-5db6-4131-b15d-1dcb03a9af41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1471 microversion: 2.1 time: 1.106935 Mar 12 20:55:29.063366 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1373/2141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:27 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1471 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:29.075243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5cc823e8-f5a7-4c2d-930d-e607c4dc2d21 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:29.075993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5cc823e8-f5a7-4c2d-930d-e607c4dc2d21 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:29.089748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5cc823e8-f5a7-4c2d-930d-e607c4dc2d21 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:29.090784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5cc823e8-f5a7-4c2d-930d-e607c4dc2d21 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:29.094394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5cc823e8-f5a7-4c2d-930d-e607c4dc2d21 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:29.095042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5cc823e8-f5a7-4c2d-930d-e607c4dc2d21 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:29.447727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5cc823e8-f5a7-4c2d-930d-e607c4dc2d21 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:29.459392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5cc823e8-f5a7-4c2d-930d-e607c4dc2d21 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:29.461208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5cc823e8-f5a7-4c2d-930d-e607c4dc2d21 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:29.462533 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5cc823e8-f5a7-4c2d-930d-e607c4dc2d21 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1406 microversion: 2.20 time: 0.396790 Mar 12 20:55:29.473419 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1374/2142] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:55:29 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1406 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:55:29.473419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3fc88009-34bd-4d80-972e-548566f1d2c5 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Calling method '.version_select at 0x7f6e37322040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:29.480473 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3fc88009-34bd-4d80-972e-548566f1d2c5 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-859881570 not found for user 456d0d4e30ba4ac29bfb11dbe8a8c133 Mar 12 20:55:29.481649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3fc88009-34bd-4d80-972e-548566f1d2c5 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] Returning 404 to user: Keypair tempest-keypair-non-existent-859881570 not found for user 456d0d4e30ba4ac29bfb11dbe8a8c133 {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:29.482688 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3fc88009-34bd-4d80-972e-548566f1d2c5 tempest-KeyPairsNegativeTestJSON-1085014512 tempest-KeyPairsNegativeTestJSON-1085014512-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-859881570" status: 404 len: 144 microversion: 2.1 time: 0.018209 Mar 12 20:55:29.487397 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1375/2143] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Mar 12 20:55:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-859881570 => generated 144 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:55:29.499547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d084e381-7386-4c5d-adfe-ac90421b83aa tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:29.502882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d084e381-7386-4c5d-adfe-ac90421b83aa tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:29.530540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d084e381-7386-4c5d-adfe-ac90421b83aa tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:29.531219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d084e381-7386-4c5d-adfe-ac90421b83aa tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:29.532693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d084e381-7386-4c5d-adfe-ac90421b83aa tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:29.534756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d084e381-7386-4c5d-adfe-ac90421b83aa tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:30.255376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d084e381-7386-4c5d-adfe-ac90421b83aa tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:30.285021 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d084e381-7386-4c5d-adfe-ac90421b83aa tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f" status: 200 len: 1590 microversion: 2.1 time: 0.800094 Mar 12 20:55:30.286163 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1376/2144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:29 2022] GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f => generated 1590 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:30.304597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d5551ee3-f412-496d-bf6f-16373127f6d0 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:30.305902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d5551ee3-f412-496d-bf6f-16373127f6d0 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:30.322929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5551ee3-f412-496d-bf6f-16373127f6d0 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:30.323382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5551ee3-f412-496d-bf6f-16373127f6d0 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:30.324382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5551ee3-f412-496d-bf6f-16373127f6d0 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:30.325019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5551ee3-f412-496d-bf6f-16373127f6d0 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:30.809673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d5551ee3-f412-496d-bf6f-16373127f6d0 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:30.823868 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d5551ee3-f412-496d-bf6f-16373127f6d0 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1471 microversion: 2.1 time: 0.529463 Mar 12 20:55:30.825372 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1377/2145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:30 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1471 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:30.836576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72894612-8e05-4381-a951-b5b8864870d2 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:30.838075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-72894612-8e05-4381-a951-b5b8864870d2 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:30.863168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72894612-8e05-4381-a951-b5b8864870d2 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:30.863642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72894612-8e05-4381-a951-b5b8864870d2 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:30.864460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72894612-8e05-4381-a951-b5b8864870d2 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:30.864908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72894612-8e05-4381-a951-b5b8864870d2 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:31.034492 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72894612-8e05-4381-a951-b5b8864870d2 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207258 Mar 12 20:55:31.035125 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1378/2146] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 20:55:30 2022] GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:31.040554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0715c084-25df-49f2-a68a-e100321a3d33 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:31.041453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0715c084-25df-49f2-a68a-e100321a3d33 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:31.050718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0715c084-25df-49f2-a68a-e100321a3d33 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:31.051587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0715c084-25df-49f2-a68a-e100321a3d33 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:31.053233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0715c084-25df-49f2-a68a-e100321a3d33 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:31.054362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0715c084-25df-49f2-a68a-e100321a3d33 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:31.606755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0715c084-25df-49f2-a68a-e100321a3d33 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:31.622953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0715c084-25df-49f2-a68a-e100321a3d33 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:31.625453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0715c084-25df-49f2-a68a-e100321a3d33 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:31.628069 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0715c084-25df-49f2-a68a-e100321a3d33 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1406 microversion: 2.20 time: 0.591903 Mar 12 20:55:31.637525 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1379/2147] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:55:31 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1406 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:55:31.841881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e60375bc-9fa9-4c33-bdbe-21e06dde293d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:31.843119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e60375bc-9fa9-4c33-bdbe-21e06dde293d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:31.851312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e60375bc-9fa9-4c33-bdbe-21e06dde293d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:31.851996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e60375bc-9fa9-4c33-bdbe-21e06dde293d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:31.852802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e60375bc-9fa9-4c33-bdbe-21e06dde293d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:31.861480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e60375bc-9fa9-4c33-bdbe-21e06dde293d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:32.502137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e60375bc-9fa9-4c33-bdbe-21e06dde293d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:32.524214 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e60375bc-9fa9-4c33-bdbe-21e06dde293d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1477 microversion: 2.1 time: 0.685676 Mar 12 20:55:32.525451 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1380/2148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:31 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1477 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:32.650026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-40243497-8d9e-41a5-8a45-8c118ed63071 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:32.650810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-40243497-8d9e-41a5-8a45-8c118ed63071 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:32.663828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40243497-8d9e-41a5-8a45-8c118ed63071 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:32.666621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40243497-8d9e-41a5-8a45-8c118ed63071 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:32.667557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40243497-8d9e-41a5-8a45-8c118ed63071 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:32.683758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40243497-8d9e-41a5-8a45-8c118ed63071 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:33.446482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-40243497-8d9e-41a5-8a45-8c118ed63071 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:33.455282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-40243497-8d9e-41a5-8a45-8c118ed63071 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:33.457847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-40243497-8d9e-41a5-8a45-8c118ed63071 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:33.459406 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-40243497-8d9e-41a5-8a45-8c118ed63071 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1406 microversion: 2.20 time: 0.814775 Mar 12 20:55:33.461242 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1381/2149] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:55:32 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1406 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:55:33.543859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-53b2ac47-c249-4a40-89bb-6cc645fc7a45 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:33.544819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-53b2ac47-c249-4a40-89bb-6cc645fc7a45 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:33.556140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53b2ac47-c249-4a40-89bb-6cc645fc7a45 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:33.556866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53b2ac47-c249-4a40-89bb-6cc645fc7a45 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:33.557876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53b2ac47-c249-4a40-89bb-6cc645fc7a45 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:33.563407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53b2ac47-c249-4a40-89bb-6cc645fc7a45 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:34.590751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-53b2ac47-c249-4a40-89bb-6cc645fc7a45 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:34.604660 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-53b2ac47-c249-4a40-89bb-6cc645fc7a45 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1477 microversion: 2.1 time: 1.062741 Mar 12 20:55:34.606574 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1382/2150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:33 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1477 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:34.896843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1964450232", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "b4e9d70b-0c2d-48a2-9a27-65eb2a85fa28"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:35.009390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] validate_networks() for [('b4e9d70b-0c2d-48a2-9a27-65eb2a85fa28', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:55:36.325033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:55:36.326276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:55:36.326980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:55:36.327616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:55:36.328431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:55:36.341202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:36.344830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:36.346061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:36.349007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:36.374002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Getting quotas for project ac28bffb2b9f4caab5629ef7386d614b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:36.380492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Getting quotas for user ff6b63421c354f86844d9914d80d957c and project ac28bffb2b9f4caab5629ef7386d614b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:36.396397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:55:36.399017 ncdv-master-1 devstack@n-api.service[136302]: WARNING nova.utils [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1964450232 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-196445023 Mar 12 20:55:36.400054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:55:36.496896 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2920b1a3-2f14-4804-9787-60f603516669 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.888384 Mar 12 20:55:36.502014 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1383/2151] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:55:36.503881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1417413409", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:36.638950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] validate_networks() for [('7c321848-4ca1-49a4-9c10-c7b92ae09b50', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:55:39.092079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:55:39.093115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:55:39.095225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:55:39.095641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:55:39.096260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:55:39.111657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:39.112378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:39.114140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:39.114872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:39.149035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Getting quotas for project bfa8b1575cea45b4945cd3984f6dbf64. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:39.155829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Getting quotas for user a0970c359e4146d9bc4b031060ec97ca and project bfa8b1575cea45b4945cd3984f6dbf64. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:39.171257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:55:39.174678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:55:39.229738 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f9758e0-3ae6-4649-92ab-d4c317bf4717 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.730411 Mar 12 20:55:39.236281 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1384/2152] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:55:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:55:39.236919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-46b8c998-8714-41e1-b56c-32671b86da7e req-c83ec83a-5167-4557-ae06-01eed775ad22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27f34eb-a809-408c-9262-cec7223eee56", "name": "network-vif-plugged", "status": "completed", "tag": "74c66795-a7e0-451e-bc40-b9db6d6b19d0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:39.248173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-46b8c998-8714-41e1-b56c-32671b86da7e req-c83ec83a-5167-4557-ae06-01eed775ad22 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:39.249217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-46b8c998-8714-41e1-b56c-32671b86da7e req-c83ec83a-5167-4557-ae06-01eed775ad22 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:39.294632 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-46b8c998-8714-41e1-b56c-32671b86da7e req-c83ec83a-5167-4557-ae06-01eed775ad22 service nova] Creating event network-vif-plugged:74c66795-a7e0-451e-bc40-b9db6d6b19d0 for instance f27f34eb-a809-408c-9262-cec7223eee56 on nch2-master-1 Mar 12 20:55:39.307618 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-46b8c998-8714-41e1-b56c-32671b86da7e req-c83ec83a-5167-4557-ae06-01eed775ad22 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074572 Mar 12 20:55:39.314800 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1385/2153] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:39.323617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a6cfcc29-056a-4ae0-bdd3-cc1ede69753c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:39.330517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a6cfcc29-056a-4ae0-bdd3-cc1ede69753c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:39.342720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6cfcc29-056a-4ae0-bdd3-cc1ede69753c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:39.343182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6cfcc29-056a-4ae0-bdd3-cc1ede69753c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:39.343982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6cfcc29-056a-4ae0-bdd3-cc1ede69753c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:39.347613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6cfcc29-056a-4ae0-bdd3-cc1ede69753c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:40.153319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a6cfcc29-056a-4ae0-bdd3-cc1ede69753c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:40.164003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a6cfcc29-056a-4ae0-bdd3-cc1ede69753c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:40.166651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a6cfcc29-056a-4ae0-bdd3-cc1ede69753c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:40.168736 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a6cfcc29-056a-4ae0-bdd3-cc1ede69753c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1406 microversion: 2.20 time: 0.851728 Mar 12 20:55:40.170045 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1386/2154] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:55:39 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1406 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:55:40.178118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56bc34e0-010d-48f1-8040-b1e5d2d58cdc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:40.180077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-56bc34e0-010d-48f1-8040-b1e5d2d58cdc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:40.194523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56bc34e0-010d-48f1-8040-b1e5d2d58cdc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:40.206620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56bc34e0-010d-48f1-8040-b1e5d2d58cdc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:40.207576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56bc34e0-010d-48f1-8040-b1e5d2d58cdc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:40.208122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56bc34e0-010d-48f1-8040-b1e5d2d58cdc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:40.588859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-56bc34e0-010d-48f1-8040-b1e5d2d58cdc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:40.603024 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56bc34e0-010d-48f1-8040-b1e5d2d58cdc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f" status: 200 len: 1590 microversion: 2.1 time: 0.431756 Mar 12 20:55:40.628604 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1387/2155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:40 2022] GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f => generated 1590 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:40.636616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-604cbb7e-09b2-4860-9217-11515f6c622c req-662fa292-af04-4cc0-bc79-e05696546c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb2fd2e-7732-4147-a539-bc8f0629504f", "tag": "a99ba367-b732-4ccf-812e-7e277a1090f2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:40.658423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-604cbb7e-09b2-4860-9217-11515f6c622c req-662fa292-af04-4cc0-bc79-e05696546c2b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:40.659048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-604cbb7e-09b2-4860-9217-11515f6c622c req-662fa292-af04-4cc0-bc79-e05696546c2b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:40.677257 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-604cbb7e-09b2-4860-9217-11515f6c622c req-662fa292-af04-4cc0-bc79-e05696546c2b service nova] Creating event network-changed:a99ba367-b732-4ccf-812e-7e277a1090f2 for instance 0bb2fd2e-7732-4147-a539-bc8f0629504f on nch2-master-1 Mar 12 20:55:40.690881 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-604cbb7e-09b2-4860-9217-11515f6c622c req-662fa292-af04-4cc0-bc79-e05696546c2b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060913 Mar 12 20:55:40.691717 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1388/2156] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:40.698931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27bc1c4e-9399-4db3-895e-daf24ab4c90a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:40.700418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27bc1c4e-9399-4db3-895e-daf24ab4c90a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:40.707908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27bc1c4e-9399-4db3-895e-daf24ab4c90a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:40.708571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27bc1c4e-9399-4db3-895e-daf24ab4c90a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:40.709564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27bc1c4e-9399-4db3-895e-daf24ab4c90a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:40.710240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27bc1c4e-9399-4db3-895e-daf24ab4c90a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:41.992659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27bc1c4e-9399-4db3-895e-daf24ab4c90a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:42.016391 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27bc1c4e-9399-4db3-895e-daf24ab4c90a tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1477 microversion: 2.1 time: 1.322236 Mar 12 20:55:42.019461 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1389/2157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:40 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1477 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:42.034784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cf21791c-2b5e-4b62-b579-24e0f46fab49 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:42.035596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cf21791c-2b5e-4b62-b579-24e0f46fab49 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:42.047697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf21791c-2b5e-4b62-b579-24e0f46fab49 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:42.048167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf21791c-2b5e-4b62-b579-24e0f46fab49 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:42.048962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf21791c-2b5e-4b62-b579-24e0f46fab49 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:42.054262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf21791c-2b5e-4b62-b579-24e0f46fab49 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:43.014147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cf21791c-2b5e-4b62-b579-24e0f46fab49 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6b63421c354f86844d9914d80d957c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac28bffb2b9f4caab5629ef7386d614b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:43.022252 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cf21791c-2b5e-4b62-b579-24e0f46fab49 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296" status: 200 len: 1332 microversion: 2.1 time: 0.999436 Mar 12 20:55:43.023804 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1390/2158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:42 2022] GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296 => generated 1332 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:43.294342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-364331b2-2602-4e36-acb9-325291d9d5db tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Action: 'create', calling method: .version_select at 0x7f6e3769bee0>, body: {"keypair": {"name": "tempest-keypair-1447556936"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:43.309683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-364331b2-2602-4e36-acb9-325291d9d5db tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Getting quotas for project 8119a0f5bb1f49beb778ccaca8b6ffc8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:43.315095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-364331b2-2602-4e36-acb9-325291d9d5db tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Getting quotas for user 6955785aa13940b7915fbb3e14493364 and project 8119a0f5bb1f49beb778ccaca8b6ffc8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:43.485511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-364331b2-2602-4e36-acb9-325291d9d5db tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Getting quotas for project 8119a0f5bb1f49beb778ccaca8b6ffc8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:43.492753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-364331b2-2602-4e36-acb9-325291d9d5db tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Getting quotas for user 6955785aa13940b7915fbb3e14493364 and project 8119a0f5bb1f49beb778ccaca8b6ffc8. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:43.518814 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-364331b2-2602-4e36-acb9-325291d9d5db tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.493558 Mar 12 20:55:43.524400 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1391/2159] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:55:43 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:43.525966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7432809-dcb8-4274-97ec-f778f79c4aa6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:43.526620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7432809-dcb8-4274-97ec-f778f79c4aa6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:43.534414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7432809-dcb8-4274-97ec-f778f79c4aa6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:43.535091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7432809-dcb8-4274-97ec-f778f79c4aa6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:43.536079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7432809-dcb8-4274-97ec-f778f79c4aa6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:43.536620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7432809-dcb8-4274-97ec-f778f79c4aa6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:43.965496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c7432809-dcb8-4274-97ec-f778f79c4aa6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:43.977367 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7432809-dcb8-4274-97ec-f778f79c4aa6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b" status: 200 len: 1325 microversion: 2.1 time: 0.456410 Mar 12 20:55:43.978021 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1392/2160] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:43 2022] GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b => generated 1325 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:44.090400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4e046d2a-df67-4476-a20f-aad97d7f655c tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] Calling method '.version_select at 0x7f6e37522670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:44.111256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e046d2a-df67-4476-a20f-aad97d7f655c tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:44.111704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e046d2a-df67-4476-a20f-aad97d7f655c tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:44.112502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e046d2a-df67-4476-a20f-aad97d7f655c tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:44.112935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e046d2a-df67-4476-a20f-aad97d7f655c tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:44.165303 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4e046d2a-df67-4476-a20f-aad97d7f655c tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.186192 Mar 12 20:55:44.167546 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1393/2161] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Mar 12 20:55:43 2022] GET /compute/v2.1/limits => generated 511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:44.198358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b9646c8f-76dd-4253-9212-c9aac5c645c3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:44.199044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b9646c8f-76dd-4253-9212-c9aac5c645c3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:44.213829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9646c8f-76dd-4253-9212-c9aac5c645c3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:44.214381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9646c8f-76dd-4253-9212-c9aac5c645c3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:44.223018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9646c8f-76dd-4253-9212-c9aac5c645c3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:44.223556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9646c8f-76dd-4253-9212-c9aac5c645c3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:44.991112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b9646c8f-76dd-4253-9212-c9aac5c645c3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:44.999350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b9646c8f-76dd-4253-9212-c9aac5c645c3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:45.010775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b9646c8f-76dd-4253-9212-c9aac5c645c3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:45.012055 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b9646c8f-76dd-4253-9212-c9aac5c645c3 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1598 microversion: 2.20 time: 0.843187 Mar 12 20:55:45.012633 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1394/2162] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:55:44 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1598 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:55:45.028489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bce5de3c-bd55-426a-b24a-4ad5374fa1c9 req-e4d09bc8-41d5-4871-8c87-190fc4aac4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb11b2e1-92f9-4b42-8158-fd559447adc2", "name": "network-vif-unplugged", "status": "completed", "tag": "4f8f4364-9747-4729-b9eb-834dd3e8a86a"}, {"server_uuid": "eb11b2e1-92f9-4b42-8158-fd559447adc2", "name": "network-vif-plugged", "status": "completed", "tag": "4f8f4364-9747-4729-b9eb-834dd3e8a86a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:45.039293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bce5de3c-bd55-426a-b24a-4ad5374fa1c9 req-e4d09bc8-41d5-4871-8c87-190fc4aac4d5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:45.039746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bce5de3c-bd55-426a-b24a-4ad5374fa1c9 req-e4d09bc8-41d5-4871-8c87-190fc4aac4d5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:45.069978 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bce5de3c-bd55-426a-b24a-4ad5374fa1c9 req-e4d09bc8-41d5-4871-8c87-190fc4aac4d5 service nova] Creating event network-vif-unplugged:4f8f4364-9747-4729-b9eb-834dd3e8a86a for instance eb11b2e1-92f9-4b42-8158-fd559447adc2 on nch1-master-1 Mar 12 20:55:45.070811 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bce5de3c-bd55-426a-b24a-4ad5374fa1c9 req-e4d09bc8-41d5-4871-8c87-190fc4aac4d5 service nova] Creating event network-vif-plugged:4f8f4364-9747-4729-b9eb-834dd3e8a86a for instance eb11b2e1-92f9-4b42-8158-fd559447adc2 on nch1-master-1 Mar 12 20:55:45.079875 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bce5de3c-bd55-426a-b24a-4ad5374fa1c9 req-e4d09bc8-41d5-4871-8c87-190fc4aac4d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.065954 Mar 12 20:55:45.086996 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1395/2163] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:45.094292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-616b48d5-f2c5-42e6-b010-f16633c674f7 req-287f1a3a-7b0f-4003-8f8e-e144b7be16fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d492a34a-8d20-476f-b6d8-16d2f26b7a9b", "tag": "0b69c220-3b92-4db9-aaf4-6607ee92908c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:45.118090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-616b48d5-f2c5-42e6-b010-f16633c674f7 req-287f1a3a-7b0f-4003-8f8e-e144b7be16fc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:45.118915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-616b48d5-f2c5-42e6-b010-f16633c674f7 req-287f1a3a-7b0f-4003-8f8e-e144b7be16fc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:45.138800 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-616b48d5-f2c5-42e6-b010-f16633c674f7 req-287f1a3a-7b0f-4003-8f8e-e144b7be16fc service nova] Creating event network-changed:0b69c220-3b92-4db9-aaf4-6607ee92908c for instance d492a34a-8d20-476f-b6d8-16d2f26b7a9b on nch1-master-1 Mar 12 20:55:45.156477 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-616b48d5-f2c5-42e6-b010-f16633c674f7 req-287f1a3a-7b0f-4003-8f8e-e144b7be16fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067777 Mar 12 20:55:45.157869 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1396/2164] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:45.171623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-beca7eb3-5b13-462e-b6a2-11be044b6a4b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:45.172771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-beca7eb3-5b13-462e-b6a2-11be044b6a4b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:45.188073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-beca7eb3-5b13-462e-b6a2-11be044b6a4b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:45.189442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-beca7eb3-5b13-462e-b6a2-11be044b6a4b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:45.193881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-beca7eb3-5b13-462e-b6a2-11be044b6a4b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:45.194708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-beca7eb3-5b13-462e-b6a2-11be044b6a4b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:45.657598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-beca7eb3-5b13-462e-b6a2-11be044b6a4b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:45.665492 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-beca7eb3-5b13-462e-b6a2-11be044b6a4b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1477 microversion: 2.1 time: 0.506161 Mar 12 20:55:45.666116 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1397/2165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:45 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1477 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:45.677140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7e8f0200-b62a-40d9-b3c9-2202348901f4 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:45.684033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7e8f0200-b62a-40d9-b3c9-2202348901f4 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:45.691070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e8f0200-b62a-40d9-b3c9-2202348901f4 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:45.693825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e8f0200-b62a-40d9-b3c9-2202348901f4 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:45.697209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e8f0200-b62a-40d9-b3c9-2202348901f4 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:45.700424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e8f0200-b62a-40d9-b3c9-2202348901f4 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:45.966342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7e8f0200-b62a-40d9-b3c9-2202348901f4 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6b63421c354f86844d9914d80d957c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac28bffb2b9f4caab5629ef7386d614b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:45.974558 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7e8f0200-b62a-40d9-b3c9-2202348901f4 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296" status: 200 len: 1332 microversion: 2.1 time: 0.303713 Mar 12 20:55:45.977628 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1398/2166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:45 2022] GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296 => generated 1332 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:45.992007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-354ee79c-f7b7-4f13-b4ec-bec82b2ac8b5 req-4431644c-8c10-43e2-80c6-620df798a2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19da1f10-cf24-4d3c-b9d0-590bed88d296", "tag": "f53de0ce-ddf9-4e2b-8630-cb04bfc544ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:46.003974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-354ee79c-f7b7-4f13-b4ec-bec82b2ac8b5 req-4431644c-8c10-43e2-80c6-620df798a2e9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:46.004829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-354ee79c-f7b7-4f13-b4ec-bec82b2ac8b5 req-4431644c-8c10-43e2-80c6-620df798a2e9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:46.026907 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-354ee79c-f7b7-4f13-b4ec-bec82b2ac8b5 req-4431644c-8c10-43e2-80c6-620df798a2e9 service nova] Creating event network-changed:f53de0ce-ddf9-4e2b-8630-cb04bfc544ab for instance 19da1f10-cf24-4d3c-b9d0-590bed88d296 on nch1-master-1 Mar 12 20:55:46.032702 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-354ee79c-f7b7-4f13-b4ec-bec82b2ac8b5 req-4431644c-8c10-43e2-80c6-620df798a2e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049608 Mar 12 20:55:46.033578 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1399/2167] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:46.040608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a9f088d9-2f86-4199-b612-76625c5a18c5 tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-542360078", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:46.113518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a9f088d9-2f86-4199-b612-76625c5a18c5 tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:55:47.101837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a9f088d9-2f86-4199-b612-76625c5a18c5 tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] Getting quotas for project 60cae4f960fa444f8f37c4c8f9fad12d. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:47.109892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a9f088d9-2f86-4199-b612-76625c5a18c5 tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] Getting quotas for user 88bcc57f612f4cb2abd1ff4f07c354e3 and project 60cae4f960fa444f8f37c4c8f9fad12d. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:47.125332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a9f088d9-2f86-4199-b612-76625c5a18c5 tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Mar 12 20:55:47.125990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a9f088d9-2f86-4199-b612-76625c5a18c5 tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:47.126799 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a9f088d9-2f86-4199-b612-76625c5a18c5 tempest-AbsoluteLimitsNegativeTestJSON-1391055679 tempest-AbsoluteLimitsNegativeTestJSON-1391055679-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.091736 Mar 12 20:55:47.127376 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1400/2168] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Mar 12 20:55:46 2022] POST /compute/v2.1/servers => generated 87 bytes in 1093 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:55:47.132327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec3342ab-57d7-443a-b0e0-7e81531352cf tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:47.133755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec3342ab-57d7-443a-b0e0-7e81531352cf tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:47.159910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec3342ab-57d7-443a-b0e0-7e81531352cf tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:47.163325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec3342ab-57d7-443a-b0e0-7e81531352cf tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:47.164261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec3342ab-57d7-443a-b0e0-7e81531352cf tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:47.164713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec3342ab-57d7-443a-b0e0-7e81531352cf tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:47.700127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ec3342ab-57d7-443a-b0e0-7e81531352cf tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:47.712610 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec3342ab-57d7-443a-b0e0-7e81531352cf tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b" status: 200 len: 1325 microversion: 2.1 time: 0.583503 Mar 12 20:55:47.714493 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1401/2169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:47 2022] GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b => generated 1325 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:47.721126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0017b28-09a7-435b-af01-46c5236fcce5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:47.721914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b0017b28-09a7-435b-af01-46c5236fcce5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:47.730050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0017b28-09a7-435b-af01-46c5236fcce5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:47.731453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0017b28-09a7-435b-af01-46c5236fcce5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:47.732686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0017b28-09a7-435b-af01-46c5236fcce5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:47.733350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0017b28-09a7-435b-af01-46c5236fcce5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:48.093020 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0017b28-09a7-435b-af01-46c5236fcce5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.376054 Mar 12 20:55:48.093627 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1402/2170] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Mar 12 20:55:47 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/os-interface => generated 285 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:55:48.109813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1644788387", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4d3497f4-90f9-4318-8ad7-916b3d5b89f7"}], "security_groups": [{"name": "tempest-securitygroup--428173616"}], "key_name": "tempest-keypair-1447556936", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:48.361521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] validate_networks() for [('4d3497f4-90f9-4318-8ad7-916b3d5b89f7', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:55:49.193454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Getting quotas for project 8119a0f5bb1f49beb778ccaca8b6ffc8. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:49.202246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Getting quotas for user 6955785aa13940b7915fbb3e14493364 and project 8119a0f5bb1f49beb778ccaca8b6ffc8. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:49.265044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:55:49.267922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:55:49.268714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:55:49.269375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:55:49.270141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:55:49.285460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:49.286886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:49.288166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:49.288861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:49.321571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Getting quotas for project 8119a0f5bb1f49beb778ccaca8b6ffc8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:55:49.341467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Getting quotas for user 6955785aa13940b7915fbb3e14493364 and project 8119a0f5bb1f49beb778ccaca8b6ffc8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:55:49.359218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:55:49.362292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:55:49.438904 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72348226-d7d4-43da-af69-255e05c72531 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.344077 Mar 12 20:55:49.439572 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1403/2171] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:55:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:55:49.453104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4eef47a8-9443-403b-930b-aae2179834ab tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:49.453725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4eef47a8-9443-403b-930b-aae2179834ab tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:49.461803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eef47a8-9443-403b-930b-aae2179834ab tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:49.462252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eef47a8-9443-403b-930b-aae2179834ab tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:49.463193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eef47a8-9443-403b-930b-aae2179834ab tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:49.463643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eef47a8-9443-403b-930b-aae2179834ab tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:49.648467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4eef47a8-9443-403b-930b-aae2179834ab tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:49.655876 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4eef47a8-9443-403b-930b-aae2179834ab tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1463 microversion: 2.1 time: 0.215315 Mar 12 20:55:49.656440 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1404/2172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:49 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1463 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:49.671166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d4cfc8b-e9ba-457f-9307-bfdfe2c1eb0b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:49.672420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8d4cfc8b-e9ba-457f-9307-bfdfe2c1eb0b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:49.678448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d4cfc8b-e9ba-457f-9307-bfdfe2c1eb0b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:49.679034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d4cfc8b-e9ba-457f-9307-bfdfe2c1eb0b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:49.680217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d4cfc8b-e9ba-457f-9307-bfdfe2c1eb0b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:49.686476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d4cfc8b-e9ba-457f-9307-bfdfe2c1eb0b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:49.934981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d4cfc8b-e9ba-457f-9307-bfdfe2c1eb0b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6b63421c354f86844d9914d80d957c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac28bffb2b9f4caab5629ef7386d614b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:49.949307 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d4cfc8b-e9ba-457f-9307-bfdfe2c1eb0b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296" status: 200 len: 1332 microversion: 2.1 time: 0.280655 Mar 12 20:55:49.950569 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1405/2173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:49 2022] GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296 => generated 1332 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:49.967156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5af1b97f-eef6-4068-9057-41516536a407 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:49.968223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5af1b97f-eef6-4068-9057-41516536a407 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:49.986917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5af1b97f-eef6-4068-9057-41516536a407 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:49.987751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5af1b97f-eef6-4068-9057-41516536a407 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:49.990556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5af1b97f-eef6-4068-9057-41516536a407 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:49.992414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5af1b97f-eef6-4068-9057-41516536a407 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:50.245307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5af1b97f-eef6-4068-9057-41516536a407 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:50.270123 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5af1b97f-eef6-4068-9057-41516536a407 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b" status: 200 len: 1325 microversion: 2.1 time: 0.317976 Mar 12 20:55:50.274878 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1406/2174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:49 2022] GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b => generated 1325 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:50.294040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-64ba6df1-7471-40c8-86e1-86ab05e9b7a2 req-9bfc0b7c-6720-49d1-9098-e9802d67aa01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d492a34a-8d20-476f-b6d8-16d2f26b7a9b", "name": "network-vif-plugged", "status": "completed", "tag": "0b69c220-3b92-4db9-aaf4-6607ee92908c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:50.352053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-64ba6df1-7471-40c8-86e1-86ab05e9b7a2 req-9bfc0b7c-6720-49d1-9098-e9802d67aa01 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:50.352504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-64ba6df1-7471-40c8-86e1-86ab05e9b7a2 req-9bfc0b7c-6720-49d1-9098-e9802d67aa01 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:50.384276 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-64ba6df1-7471-40c8-86e1-86ab05e9b7a2 req-9bfc0b7c-6720-49d1-9098-e9802d67aa01 service nova] Creating event network-vif-plugged:0b69c220-3b92-4db9-aaf4-6607ee92908c for instance d492a34a-8d20-476f-b6d8-16d2f26b7a9b on nch1-master-1 Mar 12 20:55:50.395224 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-64ba6df1-7471-40c8-86e1-86ab05e9b7a2 req-9bfc0b7c-6720-49d1-9098-e9802d67aa01 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116704 Mar 12 20:55:50.397605 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1407/2175] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:50.410246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-32108fa7-f78e-4f51-9922-3136c8800990 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:50.412943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-32108fa7-f78e-4f51-9922-3136c8800990 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:50.437947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32108fa7-f78e-4f51-9922-3136c8800990 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:50.438709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32108fa7-f78e-4f51-9922-3136c8800990 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:50.439681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32108fa7-f78e-4f51-9922-3136c8800990 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:50.440299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32108fa7-f78e-4f51-9922-3136c8800990 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:50.575923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-32108fa7-f78e-4f51-9922-3136c8800990 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:50.594736 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-32108fa7-f78e-4f51-9922-3136c8800990 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863" status: 200 len: 1266 microversion: 2.1 time: 0.193653 Mar 12 20:55:50.595337 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1408/2176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:50 2022] GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:50.599841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a2df06cf-232b-4fec-988f-cd8718e3a088 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:50.600452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a2df06cf-232b-4fec-988f-cd8718e3a088 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:50.615369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2df06cf-232b-4fec-988f-cd8718e3a088 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:50.617256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2df06cf-232b-4fec-988f-cd8718e3a088 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:50.618546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2df06cf-232b-4fec-988f-cd8718e3a088 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:50.619380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2df06cf-232b-4fec-988f-cd8718e3a088 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:50.859945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a2df06cf-232b-4fec-988f-cd8718e3a088 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:50.869296 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a2df06cf-232b-4fec-988f-cd8718e3a088 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1463 microversion: 2.1 time: 0.272855 Mar 12 20:55:50.872301 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1409/2177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:50 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1463 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:50.885692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b7cdd32f-012c-4473-ac42-95504db6614c req-81925def-425c-48d8-a3a7-c821ff5e1749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27f34eb-a809-408c-9262-cec7223eee56", "tag": "74c66795-a7e0-451e-bc40-b9db6d6b19d0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:50.907332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b7cdd32f-012c-4473-ac42-95504db6614c req-81925def-425c-48d8-a3a7-c821ff5e1749 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:50.908380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b7cdd32f-012c-4473-ac42-95504db6614c req-81925def-425c-48d8-a3a7-c821ff5e1749 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:50.944747 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b7cdd32f-012c-4473-ac42-95504db6614c req-81925def-425c-48d8-a3a7-c821ff5e1749 service nova] Creating event network-changed:74c66795-a7e0-451e-bc40-b9db6d6b19d0 for instance f27f34eb-a809-408c-9262-cec7223eee56 on nch2-master-1 Mar 12 20:55:50.956298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b7cdd32f-012c-4473-ac42-95504db6614c req-81925def-425c-48d8-a3a7-c821ff5e1749 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082434 Mar 12 20:55:50.958354 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1410/2178] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:50.966529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:50.968049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:50.988775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:50.989240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:50.998307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:50.998874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:51.160199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:55:51.160629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:55:51.161569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:55:51.161569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:55:51.161960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:55:51.305976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:51.325871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:51.326960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:51.328382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:51.329024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:51.396992 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-810baf57-da07-49e9-90df-c55c21fe3dc2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action" status: 202 len: 1067 microversion: 2.1 time: 0.436887 Mar 12 20:55:51.409236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1411/2179] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:55:50 2022] POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action => generated 1067 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 12 20:55:51.419994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a676f049-4680-496b-a691-5cbaa25bce8f tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:51.425869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a676f049-4680-496b-a691-5cbaa25bce8f tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:51.432566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a676f049-4680-496b-a691-5cbaa25bce8f tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:51.438469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a676f049-4680-496b-a691-5cbaa25bce8f tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:51.439791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a676f049-4680-496b-a691-5cbaa25bce8f tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:51.440430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a676f049-4680-496b-a691-5cbaa25bce8f tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:52.281761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a676f049-4680-496b-a691-5cbaa25bce8f tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6b63421c354f86844d9914d80d957c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac28bffb2b9f4caab5629ef7386d614b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:52.294965 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a676f049-4680-496b-a691-5cbaa25bce8f tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296" status: 200 len: 1332 microversion: 2.1 time: 0.884181 Mar 12 20:55:52.295851 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1412/2180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:51 2022] GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296 => generated 1332 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:52.310054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-07eed25a-519d-4753-87a9-3c50942aae5e tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:52.311000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-07eed25a-519d-4753-87a9-3c50942aae5e tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:52.329406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07eed25a-519d-4753-87a9-3c50942aae5e tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:52.330292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07eed25a-519d-4753-87a9-3c50942aae5e tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:52.331292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07eed25a-519d-4753-87a9-3c50942aae5e tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:52.332467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07eed25a-519d-4753-87a9-3c50942aae5e tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:52.734678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-07eed25a-519d-4753-87a9-3c50942aae5e tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:52.745616 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-07eed25a-519d-4753-87a9-3c50942aae5e tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b" status: 200 len: 1522 microversion: 2.1 time: 0.447880 Mar 12 20:55:52.746948 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1413/2181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:52 2022] GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:52.754026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f50d39e7-f9ec-4241-9e67-4c12eccc56c6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:52.754925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f50d39e7-f9ec-4241-9e67-4c12eccc56c6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:52.780561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f50d39e7-f9ec-4241-9e67-4c12eccc56c6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:52.783115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f50d39e7-f9ec-4241-9e67-4c12eccc56c6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:52.784121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f50d39e7-f9ec-4241-9e67-4c12eccc56c6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:52.784742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f50d39e7-f9ec-4241-9e67-4c12eccc56c6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:53.229436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f50d39e7-f9ec-4241-9e67-4c12eccc56c6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:53.239044 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f50d39e7-f9ec-4241-9e67-4c12eccc56c6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1472 microversion: 2.1 time: 0.490951 Mar 12 20:55:53.240244 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1414/2182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:52 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1472 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:53.246333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-89a2d21f-7aba-4ea8-8eec-3463a92ce8d5 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:53.247168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89a2d21f-7aba-4ea8-8eec-3463a92ce8d5 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:53.256655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89a2d21f-7aba-4ea8-8eec-3463a92ce8d5 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:53.268142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89a2d21f-7aba-4ea8-8eec-3463a92ce8d5 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:53.269514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89a2d21f-7aba-4ea8-8eec-3463a92ce8d5 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:53.270203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89a2d21f-7aba-4ea8-8eec-3463a92ce8d5 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:53.375343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-89a2d21f-7aba-4ea8-8eec-3463a92ce8d5 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:53.383360 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-89a2d21f-7aba-4ea8-8eec-3463a92ce8d5 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863" status: 200 len: 1328 microversion: 2.1 time: 0.141761 Mar 12 20:55:53.386752 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1415/2183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:53 2022] GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 => generated 1328 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:53.411842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-57710717-dcb0-4066-a663-ea660deb5c84 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:53.414947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-57710717-dcb0-4066-a663-ea660deb5c84 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:53.431744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57710717-dcb0-4066-a663-ea660deb5c84 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:53.432217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57710717-dcb0-4066-a663-ea660deb5c84 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:53.436093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57710717-dcb0-4066-a663-ea660deb5c84 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:53.436620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57710717-dcb0-4066-a663-ea660deb5c84 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:54.206582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-57710717-dcb0-4066-a663-ea660deb5c84 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:54.230029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-57710717-dcb0-4066-a663-ea660deb5c84 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b" status: 200 len: 1522 microversion: 2.1 time: 0.837169 Mar 12 20:55:54.256462 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1416/2184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:53 2022] GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b => generated 1522 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:54.282572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ac268d29-fb19-40a6-9bbb-5d3d4d16ae9e tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:54.283589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ac268d29-fb19-40a6-9bbb-5d3d4d16ae9e tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:54.300577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac268d29-fb19-40a6-9bbb-5d3d4d16ae9e tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:54.301040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac268d29-fb19-40a6-9bbb-5d3d4d16ae9e tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:54.301939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac268d29-fb19-40a6-9bbb-5d3d4d16ae9e tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:54.302348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac268d29-fb19-40a6-9bbb-5d3d4d16ae9e tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:54.816501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ac268d29-fb19-40a6-9bbb-5d3d4d16ae9e tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6b63421c354f86844d9914d80d957c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac28bffb2b9f4caab5629ef7386d614b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:54.849656 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ac268d29-fb19-40a6-9bbb-5d3d4d16ae9e tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296" status: 200 len: 1332 microversion: 2.1 time: 0.591743 Mar 12 20:55:54.852637 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1417/2185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:54 2022] GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296 => generated 1332 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:54.864389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c44060ef-6116-4d7e-924d-585cdce7e72d req-eba1415c-63ea-477a-9448-924d0615a74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19da1f10-cf24-4d3c-b9d0-590bed88d296", "name": "network-vif-plugged", "status": "completed", "tag": "f53de0ce-ddf9-4e2b-8630-cb04bfc544ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:54.905640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c44060ef-6116-4d7e-924d-585cdce7e72d req-eba1415c-63ea-477a-9448-924d0615a74c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:54.906262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c44060ef-6116-4d7e-924d-585cdce7e72d req-eba1415c-63ea-477a-9448-924d0615a74c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:54.930255 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c44060ef-6116-4d7e-924d-585cdce7e72d req-eba1415c-63ea-477a-9448-924d0615a74c service nova] Creating event network-vif-plugged:f53de0ce-ddf9-4e2b-8630-cb04bfc544ab for instance 19da1f10-cf24-4d3c-b9d0-590bed88d296 on nch1-master-1 Mar 12 20:55:54.938067 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c44060ef-6116-4d7e-924d-585cdce7e72d req-eba1415c-63ea-477a-9448-924d0615a74c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083785 Mar 12 20:55:54.938967 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1418/2186] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:54.945413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f78da77-a067-412b-8cb0-dc6c948fb4ef tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-643472165"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:54.946610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f78da77-a067-412b-8cb0-dc6c948fb4ef tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:54.958882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f78da77-a067-412b-8cb0-dc6c948fb4ef tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:54.959825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f78da77-a067-412b-8cb0-dc6c948fb4ef tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:54.963057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f78da77-a067-412b-8cb0-dc6c948fb4ef tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:54.963945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f78da77-a067-412b-8cb0-dc6c948fb4ef tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:55.382703 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f78da77-a067-412b-8cb0-dc6c948fb4ef tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "POST /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b/action" status: 202 len: 0 microversion: 2.1 time: 0.442242 Mar 12 20:55:55.400496 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1419/2187] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:55:54 2022] POST /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 12 20:55:55.408775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aea5d96e-6722-4598-8e43-18ccf2110fc9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:55.409796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aea5d96e-6722-4598-8e43-18ccf2110fc9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:55.417013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aea5d96e-6722-4598-8e43-18ccf2110fc9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:55.418329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aea5d96e-6722-4598-8e43-18ccf2110fc9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:55.419286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aea5d96e-6722-4598-8e43-18ccf2110fc9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:55.419894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aea5d96e-6722-4598-8e43-18ccf2110fc9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:55.884229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aea5d96e-6722-4598-8e43-18ccf2110fc9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:55.889829 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aea5d96e-6722-4598-8e43-18ccf2110fc9 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1472 microversion: 2.1 time: 0.487736 Mar 12 20:55:55.898917 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1420/2188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:55 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1472 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:55.912583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cc493c7c-32a3-4091-a48d-c5434753f13e tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:55.913213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc493c7c-32a3-4091-a48d-c5434753f13e tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:55.940116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc493c7c-32a3-4091-a48d-c5434753f13e tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:55.940581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc493c7c-32a3-4091-a48d-c5434753f13e tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:55.941638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc493c7c-32a3-4091-a48d-c5434753f13e tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:55.942109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc493c7c-32a3-4091-a48d-c5434753f13e tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:57.012699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cc493c7c-32a3-4091-a48d-c5434753f13e tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:57.023721 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cc493c7c-32a3-4091-a48d-c5434753f13e tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863" status: 200 len: 1395 microversion: 2.1 time: 1.123642 Mar 12 20:55:57.024314 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1421/2189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:55 2022] GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 => generated 1395 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:57.030312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1d65be4-d1e6-4ce7-bc95-aec8d4caaed0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '.version_select at 0x7f6e375d3670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:57.239541 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1d65be4-d1e6-4ce7-bc95-aec8d4caaed0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "DELETE /compute/v2.1/images/5091b1c4-f7e4-4c5f-a072-bad30bf15cdf" status: 204 len: 0 microversion: 2.1 time: 0.213856 Mar 12 20:55:57.240003 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1422/2190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:57 2022] DELETE /compute/v2.1/images/5091b1c4-f7e4-4c5f-a072-bad30bf15cdf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:55:57.247537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-57b55f14-78f0-4ac2-8155-ad7c2842390c req-eaa120f6-fa59-411c-9cc9-2218fd101292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b6c23e-c579-4ba8-8b9f-e64ca0f5a863", "tag": "0c6e0f4f-faf2-424e-96ce-825ee679ee1b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:55:57.256929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-57b55f14-78f0-4ac2-8155-ad7c2842390c req-eaa120f6-fa59-411c-9cc9-2218fd101292 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:57.257376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-57b55f14-78f0-4ac2-8155-ad7c2842390c req-eaa120f6-fa59-411c-9cc9-2218fd101292 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:57.277845 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-57b55f14-78f0-4ac2-8155-ad7c2842390c req-eaa120f6-fa59-411c-9cc9-2218fd101292 service nova] Creating event network-changed:0c6e0f4f-faf2-424e-96ce-825ee679ee1b for instance 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 on nch2-master-1 Mar 12 20:55:57.289005 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-57b55f14-78f0-4ac2-8155-ad7c2842390c req-eaa120f6-fa59-411c-9cc9-2218fd101292 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047486 Mar 12 20:55:57.290528 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1423/2191] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:55:57.299250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b330fe2-0de6-4032-89f6-d08da7922fdc tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:57.300239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b330fe2-0de6-4032-89f6-d08da7922fdc tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:57.309820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b330fe2-0de6-4032-89f6-d08da7922fdc tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:57.311231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b330fe2-0de6-4032-89f6-d08da7922fdc tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:57.312450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b330fe2-0de6-4032-89f6-d08da7922fdc tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:57.313078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b330fe2-0de6-4032-89f6-d08da7922fdc tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:57.725172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8b330fe2-0de6-4032-89f6-d08da7922fdc tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6b63421c354f86844d9914d80d957c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac28bffb2b9f4caab5629ef7386d614b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:57.738270 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b330fe2-0de6-4032-89f6-d08da7922fdc tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296" status: 200 len: 1535 microversion: 2.1 time: 0.445410 Mar 12 20:55:57.739894 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1424/2192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:57 2022] GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296 => generated 1535 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:57.744743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67da1e22-8242-497c-8774-11447d55c94e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:57.751180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-67da1e22-8242-497c-8774-11447d55c94e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:55:57.780811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67da1e22-8242-497c-8774-11447d55c94e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:57.781265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67da1e22-8242-497c-8774-11447d55c94e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:57.782078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67da1e22-8242-497c-8774-11447d55c94e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:55:57.785001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67da1e22-8242-497c-8774-11447d55c94e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:55:58.769243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-67da1e22-8242-497c-8774-11447d55c94e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:55:58.782183 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67da1e22-8242-497c-8774-11447d55c94e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1472 microversion: 2.1 time: 1.040709 Mar 12 20:55:58.793474 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1425/2193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:55:57 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1472 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:55:58.807307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e84137dd-667d-4638-b142-a9eba8e54c81 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '.version_select at 0x7f6e3728d430>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:55:58.852182 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e84137dd-667d-4638-b142-a9eba8e54c81 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] HTTP exception thrown: Image not found. Mar 12 20:55:58.853202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e84137dd-667d-4638-b142-a9eba8e54c81 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:55:58.854461 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e84137dd-667d-4638-b142-a9eba8e54c81 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/images/5091b1c4-f7e4-4c5f-a072-bad30bf15cdf" status: 404 len: 62 microversion: 2.1 time: 0.058141 Mar 12 20:55:58.855404 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1426/2194] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:55:58 2022] GET /compute/v2.1/images/5091b1c4-f7e4-4c5f-a072-bad30bf15cdf => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:55:58.860212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-317862cb-f1e9-4da6-9b8f-907ca48e6d36 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Action: 'create', calling method: .version_select at 0x7f6e370d94c0>, body: {"pool": "3252baf5-f0b3-4623-ae48-9d502be240a5"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:01.413694 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-317862cb-f1e9-4da6-9b8f-907ca48e6d36 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.555700 Mar 12 20:56:01.415620 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1427/2195] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Mar 12 20:55:58 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:01.430355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e231680c-745a-4eb4-9d6d-4920effe26a7 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:01.431293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e231680c-745a-4eb4-9d6d-4920effe26a7 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:01.438957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e231680c-745a-4eb4-9d6d-4920effe26a7 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:01.439448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e231680c-745a-4eb4-9d6d-4920effe26a7 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:01.440130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e231680c-745a-4eb4-9d6d-4920effe26a7 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:01.440756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e231680c-745a-4eb4-9d6d-4920effe26a7 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:01.608230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e231680c-745a-4eb4-9d6d-4920effe26a7 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:01.625553 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e231680c-745a-4eb4-9d6d-4920effe26a7 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863" status: 200 len: 1395 microversion: 2.1 time: 0.199635 Mar 12 20:56:01.626207 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1428/2196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:01 2022] GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 => generated 1395 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:01.632281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dfeb8410-6de1-489c-a1cd-9ab2ff229830 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:01.633052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dfeb8410-6de1-489c-a1cd-9ab2ff229830 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:01.640677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfeb8410-6de1-489c-a1cd-9ab2ff229830 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:01.641390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfeb8410-6de1-489c-a1cd-9ab2ff229830 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:01.642430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfeb8410-6de1-489c-a1cd-9ab2ff229830 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:01.642975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfeb8410-6de1-489c-a1cd-9ab2ff229830 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:01.810398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dfeb8410-6de1-489c-a1cd-9ab2ff229830 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:01.818480 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dfeb8410-6de1-489c-a1cd-9ab2ff229830 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b" status: 200 len: 1540 microversion: 2.1 time: 0.190814 Mar 12 20:56:01.819138 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1429/2197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:01 2022] GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b => generated 1540 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:01.824983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-db043796-1082-42ef-8495-b1a669861be1 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:01.825925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-db043796-1082-42ef-8495-b1a669861be1 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:01.840537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db043796-1082-42ef-8495-b1a669861be1 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:01.841400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db043796-1082-42ef-8495-b1a669861be1 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:01.842449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db043796-1082-42ef-8495-b1a669861be1 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:01.843099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db043796-1082-42ef-8495-b1a669861be1 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:01.997933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-db043796-1082-42ef-8495-b1a669861be1 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:02.005234 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-db043796-1082-42ef-8495-b1a669861be1 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1472 microversion: 2.1 time: 0.184488 Mar 12 20:56:02.005828 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1430/2198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:01 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:02.118187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-05fc2196-0db9-450a-8ef7-632712c1dd99 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Action: 'create', calling method: .version_select at 0x7f6e44051040>, body: {"keypair": {"name": "tempest-keypair-165975545"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:02.132166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-05fc2196-0db9-450a-8ef7-632712c1dd99 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Getting quotas for project aa582db14978426d8da203d574a93759. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:02.137762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-05fc2196-0db9-450a-8ef7-632712c1dd99 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Getting quotas for user b9f1371d10334e049b1110c147ad80ea and project aa582db14978426d8da203d574a93759. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:02.720011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-05fc2196-0db9-450a-8ef7-632712c1dd99 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Getting quotas for project aa582db14978426d8da203d574a93759. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:02.725107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-05fc2196-0db9-450a-8ef7-632712c1dd99 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Getting quotas for user b9f1371d10334e049b1110c147ad80ea and project aa582db14978426d8da203d574a93759. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:02.740238 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-05fc2196-0db9-450a-8ef7-632712c1dd99 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.733422 Mar 12 20:56:02.740852 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1431/2199] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:56:02 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:02.745521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ebd45bf0-5d6d-4f8e-adc7-1bf503871c2c tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.5"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:02.747426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ebd45bf0-5d6d-4f8e-adc7-1bf503871c2c tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:02.754724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebd45bf0-5d6d-4f8e-adc7-1bf503871c2c tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:02.755600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebd45bf0-5d6d-4f8e-adc7-1bf503871c2c tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:02.756925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebd45bf0-5d6d-4f8e-adc7-1bf503871c2c tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:02.757471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebd45bf0-5d6d-4f8e-adc7-1bf503871c2c tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:02.786745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebd45bf0-5d6d-4f8e-adc7-1bf503871c2c tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Acquired lock "refresh_cache-19da1f10-cf24-4d3c-b9d0-590bed88d296" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 20:56:04.818914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-ebd45bf0-5d6d-4f8e-adc7-1bf503871c2c tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Building network info cache for instance {{(pid=136302) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 12 20:56:05.613594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-ebd45bf0-5d6d-4f8e-adc7-1bf503871c2c tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Updating instance_info_cache with network_info: [{"id": "f53de0ce-ddf9-4e2b-8630-cb04bfc544ab", "address": "fa:16:3e:54:9b:a0", "network": {"id": "b4e9d70b-0c2d-48a2-9a27-65eb2a85fa28", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-774081018-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ac28bffb2b9f4caab5629ef7386d614b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf53de0ce-dd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136302) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 12 20:56:05.629107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebd45bf0-5d6d-4f8e-adc7-1bf503871c2c tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Releasing lock "refresh_cache-19da1f10-cf24-4d3c-b9d0-590bed88d296" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 20:56:05.630572 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ebd45bf0-5d6d-4f8e-adc7-1bf503871c2c tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "POST /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296/action" status: 202 len: 0 microversion: 2.1 time: 2.888734 Mar 12 20:56:05.638060 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1432/2200] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:56:02 2022] POST /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296/action => generated 0 bytes in 2892 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 12 20:56:05.649129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8c46da1f-7010-465a-bb3f-cc4e13045eb4 req-5d9d9f2b-606f-4434-9c7f-5a47b74030bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d492a34a-8d20-476f-b6d8-16d2f26b7a9b", "name": "network-vif-plugged", "status": "completed", "tag": "0b69c220-3b92-4db9-aaf4-6607ee92908c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:05.673188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8c46da1f-7010-465a-bb3f-cc4e13045eb4 req-5d9d9f2b-606f-4434-9c7f-5a47b74030bc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:05.674268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8c46da1f-7010-465a-bb3f-cc4e13045eb4 req-5d9d9f2b-606f-4434-9c7f-5a47b74030bc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:05.691711 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8c46da1f-7010-465a-bb3f-cc4e13045eb4 req-5d9d9f2b-606f-4434-9c7f-5a47b74030bc service nova] Creating event network-vif-plugged:0b69c220-3b92-4db9-aaf4-6607ee92908c for instance d492a34a-8d20-476f-b6d8-16d2f26b7a9b on nch1-master-1 Mar 12 20:56:05.715650 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8c46da1f-7010-465a-bb3f-cc4e13045eb4 req-5d9d9f2b-606f-4434-9c7f-5a47b74030bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075504 Mar 12 20:56:05.716281 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1433/2201] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:05.726791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2220f5b2-5b5a-4c4c-b084-2d5fc2ede89d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:05.727733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2220f5b2-5b5a-4c4c-b084-2d5fc2ede89d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:05.735598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2220f5b2-5b5a-4c4c-b084-2d5fc2ede89d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:05.736062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2220f5b2-5b5a-4c4c-b084-2d5fc2ede89d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:05.736847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2220f5b2-5b5a-4c4c-b084-2d5fc2ede89d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:05.737283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2220f5b2-5b5a-4c4c-b084-2d5fc2ede89d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:05.955384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2220f5b2-5b5a-4c4c-b084-2d5fc2ede89d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:05.963782 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2220f5b2-5b5a-4c4c-b084-2d5fc2ede89d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863" status: 200 len: 1395 microversion: 2.1 time: 0.241283 Mar 12 20:56:05.964739 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1434/2202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:05 2022] GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 => generated 1395 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:05.970714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4a0bd1b-f6b7-4a22-9cdb-a395c86feb66 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:05.971652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b4a0bd1b-f6b7-4a22-9cdb-a395c86feb66 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:05.979365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4a0bd1b-f6b7-4a22-9cdb-a395c86feb66 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:05.980199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4a0bd1b-f6b7-4a22-9cdb-a395c86feb66 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:05.981051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4a0bd1b-f6b7-4a22-9cdb-a395c86feb66 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:05.981488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4a0bd1b-f6b7-4a22-9cdb-a395c86feb66 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:06.140663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b4a0bd1b-f6b7-4a22-9cdb-a395c86feb66 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:06.147997 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b4a0bd1b-f6b7-4a22-9cdb-a395c86feb66 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b" status: 200 len: 1522 microversion: 2.1 time: 0.181980 Mar 12 20:56:06.148582 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1435/2203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:05 2022] GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:06.152957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86b45309-e77a-420c-8100-ac96217bec6f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:06.153566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86b45309-e77a-420c-8100-ac96217bec6f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:06.159057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86b45309-e77a-420c-8100-ac96217bec6f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:06.159510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86b45309-e77a-420c-8100-ac96217bec6f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:06.160484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86b45309-e77a-420c-8100-ac96217bec6f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:06.160929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86b45309-e77a-420c-8100-ac96217bec6f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:06.307125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86b45309-e77a-420c-8100-ac96217bec6f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:06.315703 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86b45309-e77a-420c-8100-ac96217bec6f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1472 microversion: 2.1 time: 0.166136 Mar 12 20:56:06.316514 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1436/2204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:06 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:06.333334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-294ad5ef-8263-467e-a3dd-4362eca916fc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:06.336888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-294ad5ef-8263-467e-a3dd-4362eca916fc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:06.337658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-294ad5ef-8263-467e-a3dd-4362eca916fc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Searching by: {'deleted': False, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:56:06.343046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-294ad5ef-8263-467e-a3dd-4362eca916fc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:06.343500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-294ad5ef-8263-467e-a3dd-4362eca916fc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:06.344302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-294ad5ef-8263-467e-a3dd-4362eca916fc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:06.344747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-294ad5ef-8263-467e-a3dd-4362eca916fc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:06.431532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-294ad5ef-8263-467e-a3dd-4362eca916fc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:56:06.490183 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-294ad5ef-8263-467e-a3dd-4362eca916fc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.161004 Mar 12 20:56:06.497239 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1437/2205] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 20:56:06 2022] GET /compute/v2.1/servers => generated 340 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:06.497239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "a1205ee7-732f-4108-9784-fddb1600cc24"}], "security_groups": [{"name": "tempest-securitygroup--1751554844"}], "key_name": "tempest-keypair-165975545", "user_data": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:06.600964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] validate_networks() for [('a1205ee7-732f-4108-9784-fddb1600cc24', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:56:07.278987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:56:07.279668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:56:07.279886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:56:07.280720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:56:07.281156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:56:07.291398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:07.291868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:07.292760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:07.293207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:07.317805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Getting quotas for project aa582db14978426d8da203d574a93759. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:07.324547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Getting quotas for user b9f1371d10334e049b1110c147ad80ea and project aa582db14978426d8da203d574a93759. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:07.340548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:56:07.344384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] [instance: e95eb8bf-09bf-447a-bdd0-613b2a2dbabd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:56:07.397207 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c605517-56e4-4d50-8aaa-b3a33f7c77df tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.905258 Mar 12 20:56:07.397907 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1438/2206] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:56:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:56:07.402715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-48d9dfa6-1a7f-4f76-b3c5-bb93a8199d5b req-19a295db-13ac-4ffc-80f5-2543e7e915cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19da1f10-cf24-4d3c-b9d0-590bed88d296", "tag": "f53de0ce-ddf9-4e2b-8630-cb04bfc544ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:07.415342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-48d9dfa6-1a7f-4f76-b3c5-bb93a8199d5b req-19a295db-13ac-4ffc-80f5-2543e7e915cc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:07.415801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-48d9dfa6-1a7f-4f76-b3c5-bb93a8199d5b req-19a295db-13ac-4ffc-80f5-2543e7e915cc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:07.430656 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-48d9dfa6-1a7f-4f76-b3c5-bb93a8199d5b req-19a295db-13ac-4ffc-80f5-2543e7e915cc service nova] Creating event network-changed:f53de0ce-ddf9-4e2b-8630-cb04bfc544ab for instance 19da1f10-cf24-4d3c-b9d0-590bed88d296 on nch1-master-1 Mar 12 20:56:07.440926 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-48d9dfa6-1a7f-4f76-b3c5-bb93a8199d5b req-19a295db-13ac-4ffc-80f5-2543e7e915cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041530 Mar 12 20:56:07.442184 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1439/2207] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:07.450040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-02d49233-d2f5-422e-bee5-ae0cd850ace6 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Action: 'create', calling method: .version_select at 0x7f6e48df78b0>, body: {"pool": "3252baf5-f0b3-4623-ae48-9d502be240a5"} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:09.739713 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-02d49233-d2f5-422e-bee5-ae0cd850ace6 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.295827 Mar 12 20:56:09.746462 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1440/2208] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Mar 12 20:56:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:09.751705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a477afc2-3a1b-4f1a-bd7b-a9430a8eaaf3 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:09.759248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a477afc2-3a1b-4f1a-bd7b-a9430a8eaaf3 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:09.773643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a477afc2-3a1b-4f1a-bd7b-a9430a8eaaf3 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:09.774688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a477afc2-3a1b-4f1a-bd7b-a9430a8eaaf3 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:09.783653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a477afc2-3a1b-4f1a-bd7b-a9430a8eaaf3 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:09.783653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a477afc2-3a1b-4f1a-bd7b-a9430a8eaaf3 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:09.821448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a477afc2-3a1b-4f1a-bd7b-a9430a8eaaf3 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:56:09.923508 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a477afc2-3a1b-4f1a-bd7b-a9430a8eaaf3 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b" status: 204 len: 0 microversion: 2.1 time: 0.174827 Mar 12 20:56:09.924351 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1441/2209] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:56:09 2022] DELETE /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:56:09.939600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ca08ef7-c518-415e-abff-c5e8a279144b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:09.944838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ca08ef7-c518-415e-abff-c5e8a279144b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:09.945835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ca08ef7-c518-415e-abff-c5e8a279144b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Searching by: {'deleted': False, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:56:09.954757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ca08ef7-c518-415e-abff-c5e8a279144b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:09.956023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ca08ef7-c518-415e-abff-c5e8a279144b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:09.959720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ca08ef7-c518-415e-abff-c5e8a279144b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:09.960185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ca08ef7-c518-415e-abff-c5e8a279144b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:10.002090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-3ca08ef7-c518-415e-abff-c5e8a279144b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:56:10.042803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ca08ef7-c518-415e-abff-c5e8a279144b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:10.049271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ca08ef7-c518-415e-abff-c5e8a279144b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:10.049736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ca08ef7-c518-415e-abff-c5e8a279144b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:10.310038 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ca08ef7-c518-415e-abff-c5e8a279144b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.383524 Mar 12 20:56:10.325462 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1442/2210] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:56:09 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:10.331215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ef7a9682-890d-4c93-9634-a4f18c773b09 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:10.331947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ef7a9682-890d-4c93-9634-a4f18c773b09 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:10.343438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9682-890d-4c93-9634-a4f18c773b09 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:10.346068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9682-890d-4c93-9634-a4f18c773b09 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:10.347093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9682-890d-4c93-9634-a4f18c773b09 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:10.349360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef7a9682-890d-4c93-9634-a4f18c773b09 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:10.801012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ef7a9682-890d-4c93-9634-a4f18c773b09 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:10.813426 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ef7a9682-890d-4c93-9634-a4f18c773b09 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863" status: 200 len: 1395 microversion: 2.1 time: 0.486324 Mar 12 20:56:10.814422 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1443/2211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:10 2022] GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 => generated 1395 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:10.826797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-213376ee-09cd-4232-9d50-a2df68f8b33f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:10.827704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-213376ee-09cd-4232-9d50-a2df68f8b33f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:10.835062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-213376ee-09cd-4232-9d50-a2df68f8b33f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:10.835526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-213376ee-09cd-4232-9d50-a2df68f8b33f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:10.836322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-213376ee-09cd-4232-9d50-a2df68f8b33f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:10.836818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-213376ee-09cd-4232-9d50-a2df68f8b33f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:11.713614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-213376ee-09cd-4232-9d50-a2df68f8b33f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:11.730616 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-213376ee-09cd-4232-9d50-a2df68f8b33f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1472 microversion: 2.1 time: 0.914514 Mar 12 20:56:11.735238 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1444/2212] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:10 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1472 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:11.744646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-adbb849e-613e-44d5-a05a-178cbee0504c tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:11.744646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-adbb849e-613e-44d5-a05a-178cbee0504c tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] [instance: e95eb8bf-09bf-447a-bdd0-613b2a2dbabd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:11.760863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-adbb849e-613e-44d5-a05a-178cbee0504c tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:11.761906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-adbb849e-613e-44d5-a05a-178cbee0504c tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:11.762715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-adbb849e-613e-44d5-a05a-178cbee0504c tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:11.772908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-adbb849e-613e-44d5-a05a-178cbee0504c tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:12.016380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-adbb849e-613e-44d5-a05a-178cbee0504c tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f1371d10334e049b1110c147ad80ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa582db14978426d8da203d574a93759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:12.026928 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-adbb849e-613e-44d5-a05a-178cbee0504c tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] 10.222.0.30 "GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd" status: 200 len: 1351 microversion: 2.1 time: 0.288149 Mar 12 20:56:12.027569 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1445/2213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:11 2022] GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd => generated 1351 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:12.037699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-67e06d70-c0b6-424b-a6df-7b03ce698c73 req-ea7379a7-7ce0-438e-afde-97fcc60d8cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b6c23e-c579-4ba8-8b9f-e64ca0f5a863", "name": "network-vif-plugged", "status": "completed", "tag": "0c6e0f4f-faf2-424e-96ce-825ee679ee1b"}, {"server_uuid": "d492a34a-8d20-476f-b6d8-16d2f26b7a9b", "name": "network-vif-unplugged", "status": "completed", "tag": "0b69c220-3b92-4db9-aaf4-6607ee92908c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:12.052465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-67e06d70-c0b6-424b-a6df-7b03ce698c73 req-ea7379a7-7ce0-438e-afde-97fcc60d8cbf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:12.053193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-67e06d70-c0b6-424b-a6df-7b03ce698c73 req-ea7379a7-7ce0-438e-afde-97fcc60d8cbf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:12.069016 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-67e06d70-c0b6-424b-a6df-7b03ce698c73 req-ea7379a7-7ce0-438e-afde-97fcc60d8cbf service nova] Creating event network-vif-plugged:0c6e0f4f-faf2-424e-96ce-825ee679ee1b for instance 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 on nch2-master-1 Mar 12 20:56:12.075997 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-67e06d70-c0b6-424b-a6df-7b03ce698c73 req-ea7379a7-7ce0-438e-afde-97fcc60d8cbf service nova] Creating event network-vif-unplugged:0b69c220-3b92-4db9-aaf4-6607ee92908c for instance d492a34a-8d20-476f-b6d8-16d2f26b7a9b on nch1-master-1 Mar 12 20:56:12.112306 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-67e06d70-c0b6-424b-a6df-7b03ce698c73 req-ea7379a7-7ce0-438e-afde-97fcc60d8cbf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.080540 Mar 12 20:56:12.114300 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1446/2214] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:12.119952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb032a83-d47c-4338-9142-08a7ca82052b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.155"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:12.138394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb032a83-d47c-4338-9142-08a7ca82052b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:12.149242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb032a83-d47c-4338-9142-08a7ca82052b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:12.150780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb032a83-d47c-4338-9142-08a7ca82052b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:12.152183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb032a83-d47c-4338-9142-08a7ca82052b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:12.152942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb032a83-d47c-4338-9142-08a7ca82052b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:12.204637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb032a83-d47c-4338-9142-08a7ca82052b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Acquired lock "refresh_cache-19da1f10-cf24-4d3c-b9d0-590bed88d296" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 20:56:12.992383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG neutronclient.v2_0.client [None req-bb032a83-d47c-4338-9142-08a7ca82052b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.0.155 (384859d8-4ff2-4a29-9801-36014c6f1435) with port f53de0ce-ddf9-4e2b-8630-cb04bfc544ab using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 3252baf5-f0b3-4623-ae48-9d502be240a5.", "detail": ""}} {{(pid=136302) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Mar 12 20:56:12.992985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb032a83-d47c-4338-9142-08a7ca82052b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Releasing lock "refresh_cache-19da1f10-cf24-4d3c-b9d0-590bed88d296" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 20:56:12.993584 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bb032a83-d47c-4338-9142-08a7ca82052b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] HTTP exception thrown: Cannot associate floating IP 172.35.0.155 (384859d8-4ff2-4a29-9801-36014c6f1435) with port f53de0ce-ddf9-4e2b-8630-cb04bfc544ab using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 3252baf5-f0b3-4623-ae48-9d502be240a5. Mar 12 20:56:12.993584 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-dff7e561-9cb0-4580-bd50-71bc15540fbc'] Mar 12 20:56:12.994198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb032a83-d47c-4338-9142-08a7ca82052b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Returning 400 to user: Cannot associate floating IP 172.35.0.155 (384859d8-4ff2-4a29-9801-36014c6f1435) with port f53de0ce-ddf9-4e2b-8630-cb04bfc544ab using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 3252baf5-f0b3-4623-ae48-9d502be240a5. Mar 12 20:56:12.994198 ncdv-master-1 devstack@n-api.service[136302]: Neutron server returns request_ids: ['req-dff7e561-9cb0-4580-bd50-71bc15540fbc'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:12.995051 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb032a83-d47c-4338-9142-08a7ca82052b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "POST /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296/action" status: 400 len: 381 microversion: 2.1 time: 0.879372 Mar 12 20:56:12.996223 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1447/2215] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:56:12 2022] POST /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296/action => generated 381 bytes in 881 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:56:13.003364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04df82ed-bedd-4813-a04c-a0a3467aed10 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:13.003996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04df82ed-bedd-4813-a04c-a0a3467aed10 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:13.011752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04df82ed-bedd-4813-a04c-a0a3467aed10 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:13.012204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04df82ed-bedd-4813-a04c-a0a3467aed10 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:13.012992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04df82ed-bedd-4813-a04c-a0a3467aed10 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:13.013433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04df82ed-bedd-4813-a04c-a0a3467aed10 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:13.161856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04df82ed-bedd-4813-a04c-a0a3467aed10 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:13.173284 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04df82ed-bedd-4813-a04c-a0a3467aed10 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b" status: 200 len: 1486 microversion: 2.1 time: 0.175293 Mar 12 20:56:13.174941 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1448/2216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:12 2022] GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b => generated 1486 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:13.187867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a72edd62-24d8-40ff-a3b6-0a4daaee3abb tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:13.201205 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a72edd62-24d8-40ff-a3b6-0a4daaee3abb tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023592 Mar 12 20:56:13.216547 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1449/2217] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:56:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:13.223405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-062df394-b552-4821-934e-fd5fb972eae5 req-63ae28e1-7c59-4158-8b3a-62c7850d34da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e95eb8bf-09bf-447a-bdd0-613b2a2dbabd", "tag": "4f015eca-2247-4791-a553-c370ed582acf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:13.233106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-062df394-b552-4821-934e-fd5fb972eae5 req-63ae28e1-7c59-4158-8b3a-62c7850d34da service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:13.233565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-062df394-b552-4821-934e-fd5fb972eae5 req-63ae28e1-7c59-4158-8b3a-62c7850d34da service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:13.251820 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-062df394-b552-4821-934e-fd5fb972eae5 req-63ae28e1-7c59-4158-8b3a-62c7850d34da service nova] Creating event network-changed:4f015eca-2247-4791-a553-c370ed582acf for instance e95eb8bf-09bf-447a-bdd0-613b2a2dbabd on nch2-master-1 Mar 12 20:56:13.264201 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-062df394-b552-4821-934e-fd5fb972eae5 req-63ae28e1-7c59-4158-8b3a-62c7850d34da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046187 Mar 12 20:56:13.264810 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1450/2218] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:13.283114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-88e2d3ff-fb5b-4882-8d91-08d671f83db9 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:13.285598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-88e2d3ff-fb5b-4882-8d91-08d671f83db9 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:13.305577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88e2d3ff-fb5b-4882-8d91-08d671f83db9 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:13.306568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88e2d3ff-fb5b-4882-8d91-08d671f83db9 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:13.311373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88e2d3ff-fb5b-4882-8d91-08d671f83db9 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:13.311829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88e2d3ff-fb5b-4882-8d91-08d671f83db9 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:13.606297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-88e2d3ff-fb5b-4882-8d91-08d671f83db9 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:13.623093 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-88e2d3ff-fb5b-4882-8d91-08d671f83db9 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863" status: 200 len: 1395 microversion: 2.1 time: 0.356994 Mar 12 20:56:13.652315 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1451/2219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:13 2022] GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 => generated 1395 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:13.682320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b583eb9-76a9-40df-8fcd-7487ad5113ff tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:13.687053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b583eb9-76a9-40df-8fcd-7487ad5113ff tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:13.708904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b583eb9-76a9-40df-8fcd-7487ad5113ff tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:13.709674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b583eb9-76a9-40df-8fcd-7487ad5113ff tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:13.710518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b583eb9-76a9-40df-8fcd-7487ad5113ff tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:13.713169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b583eb9-76a9-40df-8fcd-7487ad5113ff tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:13.900704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b583eb9-76a9-40df-8fcd-7487ad5113ff tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:13.911299 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b583eb9-76a9-40df-8fcd-7487ad5113ff tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1472 microversion: 2.1 time: 0.255675 Mar 12 20:56:13.920823 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1452/2220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:13 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1472 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:13.925591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-608d2b11-49a5-479c-85da-fabde4dba62b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Calling method '.version_select at 0x7f6e48df7f70>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:14.661457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-608d2b11-49a5-479c-85da-fabde4dba62b tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/384859d8-4ff2-4a29-9801-36014c6f1435" status: 202 len: 0 microversion: 2.1 time: 0.739465 Mar 12 20:56:14.662084 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1453/2221] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:56:13 2022] DELETE /compute/v2.1/os-floating-ips/384859d8-4ff2-4a29-9801-36014c6f1435 => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:56:14.667998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b5778609-d84b-4de3-96b6-d0a54958044d tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:14.668659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b5778609-d84b-4de3-96b6-d0a54958044d tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] [instance: e95eb8bf-09bf-447a-bdd0-613b2a2dbabd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:14.674845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5778609-d84b-4de3-96b6-d0a54958044d tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:14.675305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5778609-d84b-4de3-96b6-d0a54958044d tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:14.676160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5778609-d84b-4de3-96b6-d0a54958044d tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:14.676608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5778609-d84b-4de3-96b6-d0a54958044d tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:14.812756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b5778609-d84b-4de3-96b6-d0a54958044d tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f1371d10334e049b1110c147ad80ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa582db14978426d8da203d574a93759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:14.820486 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b5778609-d84b-4de3-96b6-d0a54958044d tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] 10.222.0.30 "GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd" status: 200 len: 1351 microversion: 2.1 time: 0.157433 Mar 12 20:56:14.821066 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1454/2222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:14 2022] GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd => generated 1351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:14.829758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6bb41e2f-de93-4f8f-8c3e-e9a232f6fd0b req-5c7ba714-7fac-4e0e-a083-ff7dce4250bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d492a34a-8d20-476f-b6d8-16d2f26b7a9b", "name": "network-vif-deleted", "tag": "0b69c220-3b92-4db9-aaf4-6607ee92908c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:14.833490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6bb41e2f-de93-4f8f-8c3e-e9a232f6fd0b req-5c7ba714-7fac-4e0e-a083-ff7dce4250bb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:14.833979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6bb41e2f-de93-4f8f-8c3e-e9a232f6fd0b req-5c7ba714-7fac-4e0e-a083-ff7dce4250bb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:14.845070 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6bb41e2f-de93-4f8f-8c3e-e9a232f6fd0b req-5c7ba714-7fac-4e0e-a083-ff7dce4250bb service nova] Creating event network-vif-deleted:0b69c220-3b92-4db9-aaf4-6607ee92908c for instance d492a34a-8d20-476f-b6d8-16d2f26b7a9b on nch1-master-1 Mar 12 20:56:14.849805 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6bb41e2f-de93-4f8f-8c3e-e9a232f6fd0b req-5c7ba714-7fac-4e0e-a083-ff7dce4250bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027620 Mar 12 20:56:14.850396 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1455/2223] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:14.855907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2b283f5b-2e83-4b49-956f-d18d6312f416 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Action: 'create', calling method: .version_select at 0x7f6e37799820>, body: {"keypair": {"name": "tempest-keypair-328788283"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:14.869546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2b283f5b-2e83-4b49-956f-d18d6312f416 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Getting quotas for project eb2b785d4ebf43779d20d8d18d4ef5af. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:14.874741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2b283f5b-2e83-4b49-956f-d18d6312f416 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Getting quotas for user 32fae6060ad1458891c8c19554a03582 and project eb2b785d4ebf43779d20d8d18d4ef5af. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:15.201481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2b283f5b-2e83-4b49-956f-d18d6312f416 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Getting quotas for project eb2b785d4ebf43779d20d8d18d4ef5af. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:15.206678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2b283f5b-2e83-4b49-956f-d18d6312f416 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Getting quotas for user 32fae6060ad1458891c8c19554a03582 and project eb2b785d4ebf43779d20d8d18d4ef5af. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:15.220918 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2b283f5b-2e83-4b49-956f-d18d6312f416 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.42 time: 0.369441 Mar 12 20:56:15.221519 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1456/2224] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Mar 12 20:56:14 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 371 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:56:15.226035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-36b2132e-927e-4d2a-a8c5-694e415ffbbc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:15.226654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-36b2132e-927e-4d2a-a8c5-694e415ffbbc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:15.234692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36b2132e-927e-4d2a-a8c5-694e415ffbbc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:15.235159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36b2132e-927e-4d2a-a8c5-694e415ffbbc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:15.235947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36b2132e-927e-4d2a-a8c5-694e415ffbbc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:15.236630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36b2132e-927e-4d2a-a8c5-694e415ffbbc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:15.263662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-36b2132e-927e-4d2a-a8c5-694e415ffbbc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:56:15.348152 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-36b2132e-927e-4d2a-a8c5-694e415ffbbc tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f" status: 204 len: 0 microversion: 2.1 time: 0.125223 Mar 12 20:56:15.348746 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1457/2225] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:56:15 2022] DELETE /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:56:15.358345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9515f25-f9bc-4d4b-a0a8-8abc01e5204d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:15.359057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9515f25-f9bc-4d4b-a0a8-8abc01e5204d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:15.367435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9515f25-f9bc-4d4b-a0a8-8abc01e5204d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:15.367994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9515f25-f9bc-4d4b-a0a8-8abc01e5204d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:15.368869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9515f25-f9bc-4d4b-a0a8-8abc01e5204d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:15.369411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9515f25-f9bc-4d4b-a0a8-8abc01e5204d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:15.388171 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f9515f25-f9bc-4d4b-a0a8-8abc01e5204d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] HTTP exception thrown: Instance d492a34a-8d20-476f-b6d8-16d2f26b7a9b could not be found. Mar 12 20:56:15.388836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9515f25-f9bc-4d4b-a0a8-8abc01e5204d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 404 to user: Instance d492a34a-8d20-476f-b6d8-16d2f26b7a9b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:15.389985 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9515f25-f9bc-4d4b-a0a8-8abc01e5204d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b" status: 404 len: 111 microversion: 2.1 time: 0.036908 Mar 12 20:56:15.390527 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1458/2226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:15 2022] GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:56:15.394929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb44c2e7-8fdb-43d5-a01a-df33dc08e508 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:15.395535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fb44c2e7-8fdb-43d5-a01a-df33dc08e508 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:15.402771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb44c2e7-8fdb-43d5-a01a-df33dc08e508 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:15.403306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb44c2e7-8fdb-43d5-a01a-df33dc08e508 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:15.404191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb44c2e7-8fdb-43d5-a01a-df33dc08e508 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:15.404963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb44c2e7-8fdb-43d5-a01a-df33dc08e508 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:15.581160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fb44c2e7-8fdb-43d5-a01a-df33dc08e508 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:15.588744 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb44c2e7-8fdb-43d5-a01a-df33dc08e508 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863" status: 200 len: 1577 microversion: 2.1 time: 0.197245 Mar 12 20:56:15.589857 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1459/2227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:15 2022] GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:15.595992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a6456324-3a02-4a6e-869a-4191ee4939da tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.5"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:15.731822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a6456324-3a02-4a6e-869a-4191ee4939da tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:15.738078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6456324-3a02-4a6e-869a-4191ee4939da tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:15.738653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6456324-3a02-4a6e-869a-4191ee4939da tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:15.739557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6456324-3a02-4a6e-869a-4191ee4939da tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:15.741198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6456324-3a02-4a6e-869a-4191ee4939da tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:15.956879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6456324-3a02-4a6e-869a-4191ee4939da tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Acquired lock "refresh_cache-19da1f10-cf24-4d3c-b9d0-590bed88d296" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 20:56:16.617059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a6456324-3a02-4a6e-869a-4191ee4939da tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Building network info cache for instance {{(pid=136302) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 12 20:56:17.109592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a6456324-3a02-4a6e-869a-4191ee4939da tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Updating instance_info_cache with network_info: [{"id": "f53de0ce-ddf9-4e2b-8630-cb04bfc544ab", "address": "fa:16:3e:54:9b:a0", "network": {"id": "b4e9d70b-0c2d-48a2-9a27-65eb2a85fa28", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-774081018-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ac28bffb2b9f4caab5629ef7386d614b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf53de0ce-dd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136302) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 12 20:56:17.125018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6456324-3a02-4a6e-869a-4191ee4939da tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Releasing lock "refresh_cache-19da1f10-cf24-4d3c-b9d0-590bed88d296" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 20:56:17.126383 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a6456324-3a02-4a6e-869a-4191ee4939da tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "POST /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296/action" status: 202 len: 0 microversion: 2.1 time: 1.534583 Mar 12 20:56:17.127536 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1460/2228] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:56:15 2022] POST /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296/action => generated 0 bytes in 1537 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 12 20:56:17.132712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e88473bc-2678-4671-acf3-feaf59879b9e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:17.133524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e88473bc-2678-4671-acf3-feaf59879b9e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:17.140742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e88473bc-2678-4671-acf3-feaf59879b9e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:17.141402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e88473bc-2678-4671-acf3-feaf59879b9e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:17.142384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e88473bc-2678-4671-acf3-feaf59879b9e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:17.142986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e88473bc-2678-4671-acf3-feaf59879b9e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:17.294951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e88473bc-2678-4671-acf3-feaf59879b9e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:17.304368 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e88473bc-2678-4671-acf3-feaf59879b9e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1472 microversion: 2.1 time: 0.175647 Mar 12 20:56:17.315741 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1461/2229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:17 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1472 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:17.315741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5855f370-b363-459e-9085-a255708641a8 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:17.315741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5855f370-b363-459e-9085-a255708641a8 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:17.324845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5855f370-b363-459e-9085-a255708641a8 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:17.325705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5855f370-b363-459e-9085-a255708641a8 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:17.326531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5855f370-b363-459e-9085-a255708641a8 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:17.327020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5855f370-b363-459e-9085-a255708641a8 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:17.399097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5855f370-b363-459e-9085-a255708641a8 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8638326f0172475e8e97d4cc21fd80ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4cadf7e0ab4a41aaa15be6665667db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:17.407959 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5855f370-b363-459e-9085-a255708641a8 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f" status: 200 len: 1648 microversion: 2.1 time: 0.100497 Mar 12 20:56:17.408882 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1462/2230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:17 2022] GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f => generated 1648 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:17.422458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-910297030", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:17.485434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] validate_networks() for [('7c321848-4ca1-49a4-9c10-c7b92ae09b50', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:56:17.927806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:56:17.928721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:56:17.929412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:56:17.929861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:56:17.930559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:56:17.944021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:17.945425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:17.947276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:17.947917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:17.971514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Getting quotas for project bfa8b1575cea45b4945cd3984f6dbf64. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:17.978515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Getting quotas for user a0970c359e4146d9bc4b031060ec97ca and project bfa8b1575cea45b4945cd3984f6dbf64. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:17.993463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:56:17.996253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: b155ccae-645c-404b-b1f2-82d1c7e56880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:56:18.055103 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0bcdf988-c1b3-45ce-9522-046767eff01a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.644906 Mar 12 20:56:18.056204 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1463/2231] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:56:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:56:18.065605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-44f2ea18-2c25-447d-b2cd-bafeb618b575 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:18.067188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-44f2ea18-2c25-447d-b2cd-bafeb618b575 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:18.078272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44f2ea18-2c25-447d-b2cd-bafeb618b575 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:18.079419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44f2ea18-2c25-447d-b2cd-bafeb618b575 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:18.080234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44f2ea18-2c25-447d-b2cd-bafeb618b575 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:18.080688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44f2ea18-2c25-447d-b2cd-bafeb618b575 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:18.208492 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-44f2ea18-2c25-447d-b2cd-bafeb618b575 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150855 Mar 12 20:56:18.209655 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1464/2232] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 20:56:18 2022] GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:18.215038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-76978d63-6884-4d66-b9bc-62e7dc311146 req-49df5ac2-f01b-453e-9b4f-e2ba1ffe3ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95eb8bf-09bf-447a-bdd0-613b2a2dbabd", "name": "network-vif-plugged", "status": "completed", "tag": "4f015eca-2247-4791-a553-c370ed582acf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:18.239274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-76978d63-6884-4d66-b9bc-62e7dc311146 req-49df5ac2-f01b-453e-9b4f-e2ba1ffe3ea5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:18.239741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-76978d63-6884-4d66-b9bc-62e7dc311146 req-49df5ac2-f01b-453e-9b4f-e2ba1ffe3ea5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:18.271728 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-76978d63-6884-4d66-b9bc-62e7dc311146 req-49df5ac2-f01b-453e-9b4f-e2ba1ffe3ea5 service nova] Creating event network-vif-plugged:4f015eca-2247-4791-a553-c370ed582acf for instance e95eb8bf-09bf-447a-bdd0-613b2a2dbabd on nch2-master-1 Mar 12 20:56:18.280643 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-76978d63-6884-4d66-b9bc-62e7dc311146 req-49df5ac2-f01b-453e-9b4f-e2ba1ffe3ea5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069213 Mar 12 20:56:18.286959 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1465/2233] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:18.311247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c711e68-c51e-46c1-a1ca-63c5c15bdd1a tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:18.312318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c711e68-c51e-46c1-a1ca-63c5c15bdd1a tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] [instance: e95eb8bf-09bf-447a-bdd0-613b2a2dbabd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:18.324672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c711e68-c51e-46c1-a1ca-63c5c15bdd1a tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:18.326083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c711e68-c51e-46c1-a1ca-63c5c15bdd1a tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:18.327281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c711e68-c51e-46c1-a1ca-63c5c15bdd1a tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:18.328250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c711e68-c51e-46c1-a1ca-63c5c15bdd1a tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:18.561309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c711e68-c51e-46c1-a1ca-63c5c15bdd1a tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f1371d10334e049b1110c147ad80ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa582db14978426d8da203d574a93759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:18.581303 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c711e68-c51e-46c1-a1ca-63c5c15bdd1a tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] 10.222.0.30 "GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd" status: 200 len: 1351 microversion: 2.1 time: 0.278363 Mar 12 20:56:18.584735 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1466/2234] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:18 2022] GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd => generated 1351 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:18.590336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-179527029", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1ac260e9-1bb3-4433-a16a-727030e5b1c1"}, {"port": "5117c932-be7d-489d-a963-7d04449bc8e8", "tag": "port-1"}, {"port": "feb9a6ae-78a3-4d7d-91b6-857a0852a53d", "tag": "port-2"}, {"uuid": "6d7430a7-a29b-43be-8d25-a000590e0bf7", "tag": "net-1"}, {"uuid": "6d7430a7-a29b-43be-8d25-a000590e0bf7"}, {"uuid": "ed06fef5-1d9d-4d70-af5c-3afc0ea0fe04", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ed06fef5-1d9d-4d70-af5c-3afc0ea0fe04", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6f1be946-45cc-48af-a0e2-eb5cba840969", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e8c35abf-0b4f-4a90-bee3-81247d77c9d6", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1966892418"}], "key_name": "tempest-keypair-328788283", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:18.732823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] validate_networks() for [('1ac260e9-1bb3-4433-a16a-727030e5b1c1', None, None, None, None, None), (None, None, '5117c932-be7d-489d-a963-7d04449bc8e8', None, None, None), (None, None, 'feb9a6ae-78a3-4d7d-91b6-857a0852a53d', None, None, None), ('6d7430a7-a29b-43be-8d25-a000590e0bf7', None, None, None, None, None), ('6d7430a7-a29b-43be-8d25-a000590e0bf7', None, None, None, None, None), ('ed06fef5-1d9d-4d70-af5c-3afc0ea0fe04', '10.2.2.100', None, None, None, None), ('ed06fef5-1d9d-4d70-af5c-3afc0ea0fe04', '10.2.2.200', None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:56:22.198215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:56:22.198811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:56:22.199287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:56:22.199765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:56:22.200241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:56:22.210918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:22.211373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:22.212181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:22.212625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:22.230614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Getting quotas for project eb2b785d4ebf43779d20d8d18d4ef5af. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:22.235849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Getting quotas for user 32fae6060ad1458891c8c19554a03582 and project eb2b785d4ebf43779d20d8d18d4ef5af. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:22.380057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:56:22.382837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6f1be946-45cc-48af-a0e2-eb5cba840969',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='aa9089c6-1fb1-4cbd-a05a-f93ed5efcab8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8c35abf-0b4f-4a90-bee3-81247d77c9d6',volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:56:22.662507 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b08f2c12-8c01-49ba-98a7-7cd2dcaae946 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 4.076559 Mar 12 20:56:22.663333 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1467/2235] 10.222.0.30 () {62 vars in 1188 bytes} [Sat Mar 12 20:56:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 4078 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 20:56:22.668799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-15c7521b-43cf-44f9-9f8c-490cf6868700 req-80c8c391-0250-43d6-bead-f53767f41752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19da1f10-cf24-4d3c-b9d0-590bed88d296", "tag": "f53de0ce-ddf9-4e2b-8630-cb04bfc544ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:22.678285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-15c7521b-43cf-44f9-9f8c-490cf6868700 req-80c8c391-0250-43d6-bead-f53767f41752 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:22.678739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-15c7521b-43cf-44f9-9f8c-490cf6868700 req-80c8c391-0250-43d6-bead-f53767f41752 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:22.690075 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-15c7521b-43cf-44f9-9f8c-490cf6868700 req-80c8c391-0250-43d6-bead-f53767f41752 service nova] Creating event network-changed:f53de0ce-ddf9-4e2b-8630-cb04bfc544ab for instance 19da1f10-cf24-4d3c-b9d0-590bed88d296 on nch1-master-1 Mar 12 20:56:22.695132 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-15c7521b-43cf-44f9-9f8c-490cf6868700 req-80c8c391-0250-43d6-bead-f53767f41752 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030622 Mar 12 20:56:22.695802 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1468/2236] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:22.701439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa3363f2-be00-4cbb-ac0c-69e1e3554606 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Calling method '.version_select at 0x7f6e370a6670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:24.130468 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aa3363f2-be00-4cbb-ac0c-69e1e3554606 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/ebd244ee-557a-493d-8019-b97d607075bf" status: 202 len: 0 microversion: 2.1 time: 1.433196 Mar 12 20:56:24.137317 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1469/2237] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:56:22 2022] DELETE /compute/v2.1/os-floating-ips/ebd244ee-557a-493d-8019-b97d607075bf => generated 0 bytes in 1441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:56:24.142384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8ec492d5-3c55-4062-916e-73e0accfacf8 req-fc2ace8b-dbdb-4aa3-8cc9-cf4f5d63c05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb2fd2e-7732-4147-a539-bc8f0629504f", "name": "network-vif-deleted", "tag": "a99ba367-b732-4ccf-812e-7e277a1090f2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:24.160990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8ec492d5-3c55-4062-916e-73e0accfacf8 req-fc2ace8b-dbdb-4aa3-8cc9-cf4f5d63c05d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:24.161685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8ec492d5-3c55-4062-916e-73e0accfacf8 req-fc2ace8b-dbdb-4aa3-8cc9-cf4f5d63c05d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:24.172587 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8ec492d5-3c55-4062-916e-73e0accfacf8 req-fc2ace8b-dbdb-4aa3-8cc9-cf4f5d63c05d service nova] Creating event network-vif-deleted:a99ba367-b732-4ccf-812e-7e277a1090f2 for instance 0bb2fd2e-7732-4147-a539-bc8f0629504f on nch2-master-1 Mar 12 20:56:24.177714 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8ec492d5-3c55-4062-916e-73e0accfacf8 req-fc2ace8b-dbdb-4aa3-8cc9-cf4f5d63c05d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039159 Mar 12 20:56:24.178706 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1470/2238] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:24.293895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2b5ac6b2-3e24-4369-a2a7-f5a3cceedfb6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:24.294493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2b5ac6b2-3e24-4369-a2a7-f5a3cceedfb6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:24.300681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b5ac6b2-3e24-4369-a2a7-f5a3cceedfb6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:24.301134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b5ac6b2-3e24-4369-a2a7-f5a3cceedfb6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:24.301936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b5ac6b2-3e24-4369-a2a7-f5a3cceedfb6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:24.302381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b5ac6b2-3e24-4369-a2a7-f5a3cceedfb6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:24.327347 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2b5ac6b2-3e24-4369-a2a7-f5a3cceedfb6 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/ips" status: 200 len: 151 microversion: 2.20 time: 0.147262 Mar 12 20:56:24.328578 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1471/2239] 10.222.0.30 () {60 vars in 1288 bytes} [Sat Mar 12 20:56:24 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/ips => generated 151 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:56:24.333370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-22b0ffa4-ef66-41b2-a625-447e7ea6272d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:24.334192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-22b0ffa4-ef66-41b2-a625-447e7ea6272d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: b155ccae-645c-404b-b1f2-82d1c7e56880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:24.341305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22b0ffa4-ef66-41b2-a625-447e7ea6272d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:24.341987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22b0ffa4-ef66-41b2-a625-447e7ea6272d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:24.342960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22b0ffa4-ef66-41b2-a625-447e7ea6272d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:24.343575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22b0ffa4-ef66-41b2-a625-447e7ea6272d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:24.500444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-22b0ffa4-ef66-41b2-a625-447e7ea6272d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:24.511660 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-22b0ffa4-ef66-41b2-a625-447e7ea6272d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880" status: 200 len: 1324 microversion: 2.1 time: 0.181730 Mar 12 20:56:24.513956 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1472/2240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:24 2022] GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880 => generated 1324 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:24.519329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-31bd8819-9115-4822-a7ba-72da5cc330f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:24.521249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-31bd8819-9115-4822-a7ba-72da5cc330f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:24.528610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31bd8819-9115-4822-a7ba-72da5cc330f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:24.529577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31bd8819-9115-4822-a7ba-72da5cc330f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:24.531727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31bd8819-9115-4822-a7ba-72da5cc330f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:24.532419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31bd8819-9115-4822-a7ba-72da5cc330f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:24.721960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-31bd8819-9115-4822-a7ba-72da5cc330f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:24.734377 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-31bd8819-9115-4822-a7ba-72da5cc330f6 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1478 microversion: 2.1 time: 0.218756 Mar 12 20:56:24.745383 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1473/2241] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:24 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1478 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:24.751430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52b59709-07ab-4608-9e50-e7f5f212de3b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:24.752524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-52b59709-07ab-4608-9e50-e7f5f212de3b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] [instance: 0bb2fd2e-7732-4147-a539-bc8f0629504f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:24.760519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52b59709-07ab-4608-9e50-e7f5f212de3b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:24.761220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52b59709-07ab-4608-9e50-e7f5f212de3b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:24.762299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52b59709-07ab-4608-9e50-e7f5f212de3b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:24.762996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52b59709-07ab-4608-9e50-e7f5f212de3b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:24.781971 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-52b59709-07ab-4608-9e50-e7f5f212de3b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] HTTP exception thrown: Instance 0bb2fd2e-7732-4147-a539-bc8f0629504f could not be found. Mar 12 20:56:24.782641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52b59709-07ab-4608-9e50-e7f5f212de3b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Returning 404 to user: Instance 0bb2fd2e-7732-4147-a539-bc8f0629504f could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:24.783493 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-52b59709-07ab-4608-9e50-e7f5f212de3b tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f" status: 404 len: 111 microversion: 2.1 time: 0.036826 Mar 12 20:56:24.784377 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1474/2242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:24 2022] GET /compute/v2.1/servers/0bb2fd2e-7732-4147-a539-bc8f0629504f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:56:24.789610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f01b628-e732-417e-8396-5df59681c9e7 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:24.790277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4f01b628-e732-417e-8396-5df59681c9e7 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] [instance: e95eb8bf-09bf-447a-bdd0-613b2a2dbabd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:24.797231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f01b628-e732-417e-8396-5df59681c9e7 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:24.797694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f01b628-e732-417e-8396-5df59681c9e7 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:24.798710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f01b628-e732-417e-8396-5df59681c9e7 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:24.799349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f01b628-e732-417e-8396-5df59681c9e7 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:24.975948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4f01b628-e732-417e-8396-5df59681c9e7 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f1371d10334e049b1110c147ad80ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa582db14978426d8da203d574a93759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:24.989664 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4f01b628-e732-417e-8396-5df59681c9e7 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] 10.222.0.30 "GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd" status: 200 len: 1539 microversion: 2.1 time: 0.204139 Mar 12 20:56:24.990664 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1475/2243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:24 2022] GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd => generated 1539 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:24.997801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71599dac-2132-4a99-adfe-4fdf35d19aab tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:24.998692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71599dac-2132-4a99-adfe-4fdf35d19aab tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:25.008157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71599dac-2132-4a99-adfe-4fdf35d19aab tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:25.008898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71599dac-2132-4a99-adfe-4fdf35d19aab tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:25.010033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71599dac-2132-4a99-adfe-4fdf35d19aab tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:25.011628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71599dac-2132-4a99-adfe-4fdf35d19aab tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:25.176223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-71599dac-2132-4a99-adfe-4fdf35d19aab tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:25.187545 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71599dac-2132-4a99-adfe-4fdf35d19aab tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863" status: 200 len: 1577 microversion: 2.1 time: 0.195604 Mar 12 20:56:25.188882 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1476/2244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:24 2022] GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:25.208691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d2018a7-69bc-47b7-aed1-083555292e86 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:25.209447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0d2018a7-69bc-47b7-aed1-083555292e86 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:25.217618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d2018a7-69bc-47b7-aed1-083555292e86 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:25.219487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d2018a7-69bc-47b7-aed1-083555292e86 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:25.223071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d2018a7-69bc-47b7-aed1-083555292e86 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:25.223665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d2018a7-69bc-47b7-aed1-083555292e86 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:25.427255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0d2018a7-69bc-47b7-aed1-083555292e86 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:25.436445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0d2018a7-69bc-47b7-aed1-083555292e86 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:25.438099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0d2018a7-69bc-47b7-aed1-083555292e86 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:25.439390 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d2018a7-69bc-47b7-aed1-083555292e86 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1660 microversion: 2.42 time: 0.249315 Mar 12 20:56:25.439968 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1477/2245] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:25 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1660 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:25.445120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-038335a5-e222-486a-b93e-a575902da0c5 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:25.446427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-038335a5-e222-486a-b93e-a575902da0c5 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:25.447436 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-038335a5-e222-486a-b93e-a575902da0c5 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "POST /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296/action" status: 400 len: 142 microversion: 2.1 time: 0.006238 Mar 12 20:56:25.447946 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1478/2246] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:56:25 2022] POST /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296/action => generated 142 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:56:25.454049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a63e5404-8733-46cc-8d26-69fe53e61a38 req-12bf8646-6b6d-4003-ac9a-56a4eaa9ed1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b155ccae-645c-404b-b1f2-82d1c7e56880", "tag": "4f3ff0ad-14ab-43dc-8cfc-4b3877b3f697"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:25.463193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a63e5404-8733-46cc-8d26-69fe53e61a38 req-12bf8646-6b6d-4003-ac9a-56a4eaa9ed1d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:25.463584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a63e5404-8733-46cc-8d26-69fe53e61a38 req-12bf8646-6b6d-4003-ac9a-56a4eaa9ed1d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:25.474989 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a63e5404-8733-46cc-8d26-69fe53e61a38 req-12bf8646-6b6d-4003-ac9a-56a4eaa9ed1d service nova] Creating event network-changed:4f3ff0ad-14ab-43dc-8cfc-4b3877b3f697 for instance b155ccae-645c-404b-b1f2-82d1c7e56880 on nch1-master-1 Mar 12 20:56:25.480861 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a63e5404-8733-46cc-8d26-69fe53e61a38 req-12bf8646-6b6d-4003-ac9a-56a4eaa9ed1d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030646 Mar 12 20:56:25.482727 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1479/2247] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:25.490414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-beeb1da2-6d9e-40e7-8c0c-944f258c5479 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] Calling method '.version_select at 0x7f6e3734f280>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:25.515507 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-beeb1da2-6d9e-40e7-8c0c-944f258c5479 tempest-ServersTestManualDisk-110720109 tempest-ServersTestManualDisk-110720109-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688196215" status: 202 len: 0 microversion: 2.1 time: 0.031638 Mar 12 20:56:25.516897 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1480/2248] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Mar 12 20:56:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688196215 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:56:25.523052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a7e693f-5c43-4ed4-8fbf-34d1500b2670 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:25.524565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0a7e693f-5c43-4ed4-8fbf-34d1500b2670 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] [instance: e95eb8bf-09bf-447a-bdd0-613b2a2dbabd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:25.532478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a7e693f-5c43-4ed4-8fbf-34d1500b2670 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:25.533045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a7e693f-5c43-4ed4-8fbf-34d1500b2670 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:25.533952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a7e693f-5c43-4ed4-8fbf-34d1500b2670 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:25.534616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a7e693f-5c43-4ed4-8fbf-34d1500b2670 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:25.685930 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0a7e693f-5c43-4ed4-8fbf-34d1500b2670 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] 10.222.0.30 "GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167652 Mar 12 20:56:25.686834 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1481/2249] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 20:56:25 2022] GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:25.697399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a15543e-2a81-4fd5-af98-9c34eae23abd tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:25.698681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a15543e-2a81-4fd5-af98-9c34eae23abd tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:25.707884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a15543e-2a81-4fd5-af98-9c34eae23abd tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:25.711915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a15543e-2a81-4fd5-af98-9c34eae23abd tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:25.712824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a15543e-2a81-4fd5-af98-9c34eae23abd tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:25.713399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a15543e-2a81-4fd5-af98-9c34eae23abd tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:25.778833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a15543e-2a81-4fd5-af98-9c34eae23abd tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Acquired lock "refresh_cache-19da1f10-cf24-4d3c-b9d0-590bed88d296" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 20:56:26.181392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a15543e-2a81-4fd5-af98-9c34eae23abd tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Releasing lock "refresh_cache-19da1f10-cf24-4d3c-b9d0-590bed88d296" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 20:56:26.183260 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-5a15543e-2a81-4fd5-af98-9c34eae23abd tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] HTTP exception thrown: floating IP not found Mar 12 20:56:26.185972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a15543e-2a81-4fd5-af98-9c34eae23abd tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Returning 404 to user: floating IP not found {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:26.187078 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a15543e-2a81-4fd5-af98-9c34eae23abd tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "POST /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296/action" status: 404 len: 67 microversion: 2.1 time: 0.499312 Mar 12 20:56:26.194017 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1482/2250] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:56:25 2022] POST /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296/action => generated 67 bytes in 506 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:56:26.201686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-08f3a384-436f-4bd7-b4af-a313f15f131a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:26.202786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-08f3a384-436f-4bd7-b4af-a313f15f131a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: b155ccae-645c-404b-b1f2-82d1c7e56880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:26.210283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08f3a384-436f-4bd7-b4af-a313f15f131a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:26.211451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08f3a384-436f-4bd7-b4af-a313f15f131a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:26.212517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08f3a384-436f-4bd7-b4af-a313f15f131a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:26.213193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08f3a384-436f-4bd7-b4af-a313f15f131a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:26.810390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-08f3a384-436f-4bd7-b4af-a313f15f131a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:26.828538 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-08f3a384-436f-4bd7-b4af-a313f15f131a tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880" status: 200 len: 1324 microversion: 2.1 time: 0.632430 Mar 12 20:56:26.829755 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1483/2251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:26 2022] GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880 => generated 1324 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:26.840206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-68c0d456-dbd7-4aa5-bd57-fb1f6e5794b2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:26.841658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-68c0d456-dbd7-4aa5-bd57-fb1f6e5794b2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:26.852056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c0d456-dbd7-4aa5-bd57-fb1f6e5794b2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:26.852819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c0d456-dbd7-4aa5-bd57-fb1f6e5794b2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:26.855555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c0d456-dbd7-4aa5-bd57-fb1f6e5794b2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:26.856280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c0d456-dbd7-4aa5-bd57-fb1f6e5794b2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:27.251170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-68c0d456-dbd7-4aa5-bd57-fb1f6e5794b2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:27.258782 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-68c0d456-dbd7-4aa5-bd57-fb1f6e5794b2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1478 microversion: 2.1 time: 0.427845 Mar 12 20:56:27.263080 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1484/2252] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:26 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1478 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:27.272498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a3249071-fec6-40c6-9017-5aa13c6beadd req-f1a9bc79-1562-4b72-8080-785befcfd558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b6c23e-c579-4ba8-8b9f-e64ca0f5a863", "tag": "0c6e0f4f-faf2-424e-96ce-825ee679ee1b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:27.291184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a3249071-fec6-40c6-9017-5aa13c6beadd req-f1a9bc79-1562-4b72-8080-785befcfd558 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:27.291640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a3249071-fec6-40c6-9017-5aa13c6beadd req-f1a9bc79-1562-4b72-8080-785befcfd558 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:27.313679 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a3249071-fec6-40c6-9017-5aa13c6beadd req-f1a9bc79-1562-4b72-8080-785befcfd558 service nova] Creating event network-changed:0c6e0f4f-faf2-424e-96ce-825ee679ee1b for instance 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 on nch2-master-1 Mar 12 20:56:27.329148 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a3249071-fec6-40c6-9017-5aa13c6beadd req-f1a9bc79-1562-4b72-8080-785befcfd558 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064830 Mar 12 20:56:27.330180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1485/2253] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:27.335490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52b88071-47a8-430f-a91d-08fa7266e4ba tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:27.850004 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-52b88071-47a8-430f-a91d-08fa7266e4ba tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Mar 12 20:56:27.850686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52b88071-47a8-430f-a91d-08fa7266e4ba tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:27.854838 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-52b88071-47a8-430f-a91d-08fa7266e4ba tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "POST /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296/action" status: 404 len: 88 microversion: 2.1 time: 0.520269 Mar 12 20:56:27.855456 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1486/2254] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:56:27 2022] POST /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296/action => generated 88 bytes in 525 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:56:27.867893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f06bba0-4bb3-4f23-9304-50dfaf74824b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:27.868624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f06bba0-4bb3-4f23-9304-50dfaf74824b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:27.890438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f06bba0-4bb3-4f23-9304-50dfaf74824b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:27.890438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f06bba0-4bb3-4f23-9304-50dfaf74824b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:27.890438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f06bba0-4bb3-4f23-9304-50dfaf74824b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:27.890438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f06bba0-4bb3-4f23-9304-50dfaf74824b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:27.938346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-1f06bba0-4bb3-4f23-9304-50dfaf74824b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lazy-loading 'flavor' on Instance uuid f27f34eb-a809-408c-9262-cec7223eee56 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:56:28.250614 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f06bba0-4bb3-4f23-9304-50dfaf74824b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "POST /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/action" status: 202 len: 0 microversion: 2.20 time: 0.393709 Mar 12 20:56:28.251340 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1487/2255] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 20:56:27 2022] POST /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:56:28.257759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b00b56d-8130-47cf-a736-f5eec375b8b4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:28.258501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b00b56d-8130-47cf-a736-f5eec375b8b4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:28.267479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b00b56d-8130-47cf-a736-f5eec375b8b4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:28.267948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b00b56d-8130-47cf-a736-f5eec375b8b4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:28.268798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b00b56d-8130-47cf-a736-f5eec375b8b4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:28.269249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b00b56d-8130-47cf-a736-f5eec375b8b4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:28.830117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b00b56d-8130-47cf-a736-f5eec375b8b4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:28.845881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b00b56d-8130-47cf-a736-f5eec375b8b4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:28.847554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b00b56d-8130-47cf-a736-f5eec375b8b4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:28.848873 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b00b56d-8130-47cf-a736-f5eec375b8b4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1789 microversion: 2.42 time: 0.596460 Mar 12 20:56:28.860226 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1488/2256] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:28 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1789 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:28.860226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c73e1ad9-4ce8-48e5-b3b8-3b780b142252 req-bdc91559-63d1-453e-b921-d4559a246830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb11b2e1-92f9-4b42-8158-fd559447adc2", "name": "network-vif-unplugged", "status": "completed", "tag": "4f8f4364-9747-4729-b9eb-834dd3e8a86a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:28.866051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c73e1ad9-4ce8-48e5-b3b8-3b780b142252 req-bdc91559-63d1-453e-b921-d4559a246830 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:28.866600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c73e1ad9-4ce8-48e5-b3b8-3b780b142252 req-bdc91559-63d1-453e-b921-d4559a246830 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:28.877855 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c73e1ad9-4ce8-48e5-b3b8-3b780b142252 req-bdc91559-63d1-453e-b921-d4559a246830 service nova] Creating event network-vif-unplugged:4f8f4364-9747-4729-b9eb-834dd3e8a86a for instance eb11b2e1-92f9-4b42-8158-fd559447adc2 on nch1-master-1 Mar 12 20:56:28.883224 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c73e1ad9-4ce8-48e5-b3b8-3b780b142252 req-bdc91559-63d1-453e-b921-d4559a246830 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032088 Mar 12 20:56:28.884162 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1489/2257] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:28.893800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a01412e2-ce74-40b0-9f67-b2981a0ac286 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:28.894508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a01412e2-ce74-40b0-9f67-b2981a0ac286 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: b155ccae-645c-404b-b1f2-82d1c7e56880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:28.900721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a01412e2-ce74-40b0-9f67-b2981a0ac286 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:28.901278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a01412e2-ce74-40b0-9f67-b2981a0ac286 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:28.902158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a01412e2-ce74-40b0-9f67-b2981a0ac286 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:28.902601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a01412e2-ce74-40b0-9f67-b2981a0ac286 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:29.384598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a01412e2-ce74-40b0-9f67-b2981a0ac286 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:29.399440 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a01412e2-ce74-40b0-9f67-b2981a0ac286 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880" status: 200 len: 1324 microversion: 2.1 time: 0.510620 Mar 12 20:56:29.400031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1490/2258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:28 2022] GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880 => generated 1324 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:29.410088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-140d1a2a-f6f3-42f6-8585-ac5b2d234091 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:29.414834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-140d1a2a-f6f3-42f6-8585-ac5b2d234091 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:29.428286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-140d1a2a-f6f3-42f6-8585-ac5b2d234091 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:29.428920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-140d1a2a-f6f3-42f6-8585-ac5b2d234091 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:29.430314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-140d1a2a-f6f3-42f6-8585-ac5b2d234091 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:29.430771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-140d1a2a-f6f3-42f6-8585-ac5b2d234091 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:29.485606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-140d1a2a-f6f3-42f6-8585-ac5b2d234091 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:56:29.599340 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-140d1a2a-f6f3-42f6-8585-ac5b2d234091 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296" status: 204 len: 0 microversion: 2.1 time: 0.196993 Mar 12 20:56:29.600460 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1491/2259] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:56:29 2022] DELETE /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:56:29.611670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-daa9404f-48ce-4801-a362-3fb6daacdbee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:29.612895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-daa9404f-48ce-4801-a362-3fb6daacdbee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:29.624990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daa9404f-48ce-4801-a362-3fb6daacdbee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:29.627061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daa9404f-48ce-4801-a362-3fb6daacdbee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:29.629054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daa9404f-48ce-4801-a362-3fb6daacdbee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:29.629531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daa9404f-48ce-4801-a362-3fb6daacdbee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:29.893288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-daa9404f-48ce-4801-a362-3fb6daacdbee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:29.902592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-daa9404f-48ce-4801-a362-3fb6daacdbee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:29.904391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-daa9404f-48ce-4801-a362-3fb6daacdbee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:29.905588 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-daa9404f-48ce-4801-a362-3fb6daacdbee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1722 microversion: 2.20 time: 0.298495 Mar 12 20:56:29.906193 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1492/2260] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:29 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:29.910912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea5f8e58-010e-47f6-89ad-4cc0a5696d6c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:29.911737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea5f8e58-010e-47f6-89ad-4cc0a5696d6c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:29.919419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea5f8e58-010e-47f6-89ad-4cc0a5696d6c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:29.920069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea5f8e58-010e-47f6-89ad-4cc0a5696d6c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:29.921628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea5f8e58-010e-47f6-89ad-4cc0a5696d6c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:29.922287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea5f8e58-010e-47f6-89ad-4cc0a5696d6c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:30.196565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ea5f8e58-010e-47f6-89ad-4cc0a5696d6c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:30.208201 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea5f8e58-010e-47f6-89ad-4cc0a5696d6c tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1478 microversion: 2.1 time: 0.300738 Mar 12 20:56:30.209734 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1493/2261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:29 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1478 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:30.217157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c07dfc6c-5506-426c-bb4e-920a993fc0d1 req-b76d95a1-1bea-49e3-a8a7-4df043ccc429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e95eb8bf-09bf-447a-bdd0-613b2a2dbabd", "tag": "4f015eca-2247-4791-a553-c370ed582acf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:30.236547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c07dfc6c-5506-426c-bb4e-920a993fc0d1 req-b76d95a1-1bea-49e3-a8a7-4df043ccc429 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:30.244391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c07dfc6c-5506-426c-bb4e-920a993fc0d1 req-b76d95a1-1bea-49e3-a8a7-4df043ccc429 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:30.264848 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c07dfc6c-5506-426c-bb4e-920a993fc0d1 req-b76d95a1-1bea-49e3-a8a7-4df043ccc429 service nova] Creating event network-changed:4f015eca-2247-4791-a553-c370ed582acf for instance e95eb8bf-09bf-447a-bdd0-613b2a2dbabd on nch2-master-1 Mar 12 20:56:30.273604 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c07dfc6c-5506-426c-bb4e-920a993fc0d1 req-b76d95a1-1bea-49e3-a8a7-4df043ccc429 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062551 Mar 12 20:56:30.274747 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1494/2262] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:30.280601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-975c5fa6-c2e1-4ba4-9d2d-41829ba47c6c req-8ed2e2d7-b4c9-4605-b26b-d11b37cc4be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "tag": "053e3ca3-8105-4491-a39b-6cdfdf4aee9c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:30.290263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-975c5fa6-c2e1-4ba4-9d2d-41829ba47c6c req-8ed2e2d7-b4c9-4605-b26b-d11b37cc4be5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:30.291150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-975c5fa6-c2e1-4ba4-9d2d-41829ba47c6c req-8ed2e2d7-b4c9-4605-b26b-d11b37cc4be5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:30.316457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-975c5fa6-c2e1-4ba4-9d2d-41829ba47c6c req-8ed2e2d7-b4c9-4605-b26b-d11b37cc4be5 service nova] Creating event network-changed:053e3ca3-8105-4491-a39b-6cdfdf4aee9c for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:56:30.323061 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-975c5fa6-c2e1-4ba4-9d2d-41829ba47c6c req-8ed2e2d7-b4c9-4605-b26b-d11b37cc4be5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046745 Mar 12 20:56:30.325271 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1495/2263] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:30.344591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a62caf6c-1b2b-4e7d-abf5-f4d44c7f6871 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:30.345302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a62caf6c-1b2b-4e7d-abf5-f4d44c7f6871 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:30.352684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a62caf6c-1b2b-4e7d-abf5-f4d44c7f6871 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:30.353403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a62caf6c-1b2b-4e7d-abf5-f4d44c7f6871 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:30.356203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a62caf6c-1b2b-4e7d-abf5-f4d44c7f6871 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:30.357005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a62caf6c-1b2b-4e7d-abf5-f4d44c7f6871 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:31.194574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a62caf6c-1b2b-4e7d-abf5-f4d44c7f6871 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6b63421c354f86844d9914d80d957c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac28bffb2b9f4caab5629ef7386d614b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:31.208597 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a62caf6c-1b2b-4e7d-abf5-f4d44c7f6871 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296" status: 200 len: 1541 microversion: 2.1 time: 0.879250 Mar 12 20:56:31.212562 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1496/2264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:30 2022] GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296 => generated 1541 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:31.224682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ff2c10b-42f1-44ba-940b-ab11782b779f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:31.226133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5ff2c10b-42f1-44ba-940b-ab11782b779f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:31.240674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ff2c10b-42f1-44ba-940b-ab11782b779f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:31.242054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ff2c10b-42f1-44ba-940b-ab11782b779f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:31.243136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ff2c10b-42f1-44ba-940b-ab11782b779f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:31.243761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ff2c10b-42f1-44ba-940b-ab11782b779f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:31.800800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5ff2c10b-42f1-44ba-940b-ab11782b779f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:31.812453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5ff2c10b-42f1-44ba-940b-ab11782b779f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:31.814333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5ff2c10b-42f1-44ba-940b-ab11782b779f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:31.815795 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ff2c10b-42f1-44ba-940b-ab11782b779f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.601436 Mar 12 20:56:31.828080 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1497/2265] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:31 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:31.833204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-063b208e-b7e1-490a-b49d-e6fd3b9b0522 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:31.834179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-063b208e-b7e1-490a-b49d-e6fd3b9b0522 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: b155ccae-645c-404b-b1f2-82d1c7e56880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:31.840546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-063b208e-b7e1-490a-b49d-e6fd3b9b0522 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:31.841292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-063b208e-b7e1-490a-b49d-e6fd3b9b0522 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:31.842392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-063b208e-b7e1-490a-b49d-e6fd3b9b0522 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:31.843060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-063b208e-b7e1-490a-b49d-e6fd3b9b0522 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:32.390020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-063b208e-b7e1-490a-b49d-e6fd3b9b0522 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:32.400193 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-063b208e-b7e1-490a-b49d-e6fd3b9b0522 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880" status: 200 len: 1324 microversion: 2.1 time: 0.570678 Mar 12 20:56:32.401461 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1498/2266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:31 2022] GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880 => generated 1324 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:32.407157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-22d933b7-fa7b-45c8-ab93-8acc2119a148 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:32.408053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-22d933b7-fa7b-45c8-ab93-8acc2119a148 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:32.416069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22d933b7-fa7b-45c8-ab93-8acc2119a148 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:32.416528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22d933b7-fa7b-45c8-ab93-8acc2119a148 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:32.417704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22d933b7-fa7b-45c8-ab93-8acc2119a148 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:32.418181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22d933b7-fa7b-45c8-ab93-8acc2119a148 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:32.754274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-22d933b7-fa7b-45c8-ab93-8acc2119a148 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:32.780843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-22d933b7-fa7b-45c8-ab93-8acc2119a148 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:32.784616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-22d933b7-fa7b-45c8-ab93-8acc2119a148 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:32.786280 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-22d933b7-fa7b-45c8-ab93-8acc2119a148 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1722 microversion: 2.20 time: 0.383441 Mar 12 20:56:32.788358 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1499/2267] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:32 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:32.795724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de175710-fe95-4f9f-8e54-6a0affc1886d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:32.796626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-de175710-fe95-4f9f-8e54-6a0affc1886d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:32.803908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de175710-fe95-4f9f-8e54-6a0affc1886d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:32.804738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de175710-fe95-4f9f-8e54-6a0affc1886d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:32.805921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de175710-fe95-4f9f-8e54-6a0affc1886d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:32.806587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de175710-fe95-4f9f-8e54-6a0affc1886d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:32.983973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-de175710-fe95-4f9f-8e54-6a0affc1886d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:32.994342 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de175710-fe95-4f9f-8e54-6a0affc1886d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1478 microversion: 2.1 time: 0.204605 Mar 12 20:56:33.004349 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1500/2268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:32 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1478 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:33.010297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-cfe1f9e3-ed7f-41ad-a9b8-876f57492394 req-6bd2bccd-227a-4eba-9385-522956037cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b155ccae-645c-404b-b1f2-82d1c7e56880", "name": "network-vif-plugged", "status": "completed", "tag": "4f3ff0ad-14ab-43dc-8cfc-4b3877b3f697"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:33.022617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cfe1f9e3-ed7f-41ad-a9b8-876f57492394 req-6bd2bccd-227a-4eba-9385-522956037cc5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:33.023081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cfe1f9e3-ed7f-41ad-a9b8-876f57492394 req-6bd2bccd-227a-4eba-9385-522956037cc5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:33.038824 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-cfe1f9e3-ed7f-41ad-a9b8-876f57492394 req-6bd2bccd-227a-4eba-9385-522956037cc5 service nova] Creating event network-vif-plugged:4f3ff0ad-14ab-43dc-8cfc-4b3877b3f697 for instance b155ccae-645c-404b-b1f2-82d1c7e56880 on nch1-master-1 Mar 12 20:56:33.046913 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-cfe1f9e3-ed7f-41ad-a9b8-876f57492394 req-6bd2bccd-227a-4eba-9385-522956037cc5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040241 Mar 12 20:56:33.048163 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1501/2269] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:33.055515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16ec6fe3-b800-48c5-9642-70221a8f6d28 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:33.070170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16ec6fe3-b800-48c5-9642-70221a8f6d28 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:33.079543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16ec6fe3-b800-48c5-9642-70221a8f6d28 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:33.080302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16ec6fe3-b800-48c5-9642-70221a8f6d28 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:33.081267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16ec6fe3-b800-48c5-9642-70221a8f6d28 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:33.081903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16ec6fe3-b800-48c5-9642-70221a8f6d28 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:33.128610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16ec6fe3-b800-48c5-9642-70221a8f6d28 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:33.129337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16ec6fe3-b800-48c5-9642-70221a8f6d28 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:33.130000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-16ec6fe3-b800-48c5-9642-70221a8f6d28 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lazy-loading 'fault' on Instance uuid 19da1f10-cf24-4d3c-b9d0-590bed88d296 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:56:33.222938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16ec6fe3-b800-48c5-9642-70221a8f6d28 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff6b63421c354f86844d9914d80d957c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac28bffb2b9f4caab5629ef7386d614b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:33.235023 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16ec6fe3-b800-48c5-9642-70221a8f6d28 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296" status: 200 len: 1322 microversion: 2.1 time: 0.185380 Mar 12 20:56:33.235902 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1502/2270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:33 2022] GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:33.245582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6765bbaf-2aa8-453c-8bbf-36d6af6b64bc req-3e2794ee-7bec-4ecc-a09d-86a046d9dd9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "tag": "5117c932-be7d-489d-a963-7d04449bc8e8"}, {"name": "network-changed", "server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "tag": "feb9a6ae-78a3-4d7d-91b6-857a0852a53d"}, {"name": "network-changed", "server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "tag": "42ca35d6-c5fd-420f-a20f-a4b2b0e1afa2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:33.257580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6765bbaf-2aa8-453c-8bbf-36d6af6b64bc req-3e2794ee-7bec-4ecc-a09d-86a046d9dd9d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:33.259063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6765bbaf-2aa8-453c-8bbf-36d6af6b64bc req-3e2794ee-7bec-4ecc-a09d-86a046d9dd9d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:33.287701 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6765bbaf-2aa8-453c-8bbf-36d6af6b64bc req-3e2794ee-7bec-4ecc-a09d-86a046d9dd9d service nova] Creating event network-changed:5117c932-be7d-489d-a963-7d04449bc8e8 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:56:33.288744 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6765bbaf-2aa8-453c-8bbf-36d6af6b64bc req-3e2794ee-7bec-4ecc-a09d-86a046d9dd9d service nova] Creating event network-changed:feb9a6ae-78a3-4d7d-91b6-857a0852a53d for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:56:33.290988 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6765bbaf-2aa8-453c-8bbf-36d6af6b64bc req-3e2794ee-7bec-4ecc-a09d-86a046d9dd9d service nova] Creating event network-changed:42ca35d6-c5fd-420f-a20f-a4b2b0e1afa2 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:56:33.300449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6765bbaf-2aa8-453c-8bbf-36d6af6b64bc req-3e2794ee-7bec-4ecc-a09d-86a046d9dd9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.060771 Mar 12 20:56:33.302419 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1503/2271] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:33.311160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8089ae97-da16-4e3a-ae3f-1174c75cb00f req-ca417555-1a3b-4f00-a3a3-39cb1b1eb5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19da1f10-cf24-4d3c-b9d0-590bed88d296", "name": "network-vif-deleted", "tag": "f53de0ce-ddf9-4e2b-8630-cb04bfc544ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:33.324450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8089ae97-da16-4e3a-ae3f-1174c75cb00f req-ca417555-1a3b-4f00-a3a3-39cb1b1eb5ea service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:33.325239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8089ae97-da16-4e3a-ae3f-1174c75cb00f req-ca417555-1a3b-4f00-a3a3-39cb1b1eb5ea service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:33.349271 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8089ae97-da16-4e3a-ae3f-1174c75cb00f req-ca417555-1a3b-4f00-a3a3-39cb1b1eb5ea service nova] Creating event network-vif-deleted:f53de0ce-ddf9-4e2b-8630-cb04bfc544ab for instance 19da1f10-cf24-4d3c-b9d0-590bed88d296 on nch1-master-1 Mar 12 20:56:33.358164 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8089ae97-da16-4e3a-ae3f-1174c75cb00f req-ca417555-1a3b-4f00-a3a3-39cb1b1eb5ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053910 Mar 12 20:56:33.359162 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1504/2272] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:33.365145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1eb17ec3-5bf3-4d05-95c8-663c614b87c8 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:33.365938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1eb17ec3-5bf3-4d05-95c8-663c614b87c8 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:33.374515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1eb17ec3-5bf3-4d05-95c8-663c614b87c8 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:33.375306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1eb17ec3-5bf3-4d05-95c8-663c614b87c8 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:33.376368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1eb17ec3-5bf3-4d05-95c8-663c614b87c8 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:33.377178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1eb17ec3-5bf3-4d05-95c8-663c614b87c8 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:34.029347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1eb17ec3-5bf3-4d05-95c8-663c614b87c8 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:34.040486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1eb17ec3-5bf3-4d05-95c8-663c614b87c8 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:34.042085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1eb17ec3-5bf3-4d05-95c8-663c614b87c8 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:34.043287 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1eb17ec3-5bf3-4d05-95c8-663c614b87c8 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.683022 Mar 12 20:56:34.044192 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1505/2273] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:33 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:34.048718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc9fa974-60ff-4d91-8f27-b9ae914a85d6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:34.049425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc9fa974-60ff-4d91-8f27-b9ae914a85d6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: b155ccae-645c-404b-b1f2-82d1c7e56880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:34.064189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc9fa974-60ff-4d91-8f27-b9ae914a85d6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:34.064672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc9fa974-60ff-4d91-8f27-b9ae914a85d6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:34.065649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc9fa974-60ff-4d91-8f27-b9ae914a85d6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:34.066034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc9fa974-60ff-4d91-8f27-b9ae914a85d6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:34.757948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc9fa974-60ff-4d91-8f27-b9ae914a85d6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:34.768873 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc9fa974-60ff-4d91-8f27-b9ae914a85d6 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880" status: 200 len: 1324 microversion: 2.1 time: 0.723856 Mar 12 20:56:34.779463 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1506/2274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:34 2022] GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880 => generated 1324 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:34.785067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-451fd669-2b22-487d-a626-c21cd1c5fe2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:34.786188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-451fd669-2b22-487d-a626-c21cd1c5fe2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:34.806362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-451fd669-2b22-487d-a626-c21cd1c5fe2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:34.806824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-451fd669-2b22-487d-a626-c21cd1c5fe2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:34.808858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-451fd669-2b22-487d-a626-c21cd1c5fe2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:34.809675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-451fd669-2b22-487d-a626-c21cd1c5fe2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:35.090951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-451fd669-2b22-487d-a626-c21cd1c5fe2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:35.101370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-451fd669-2b22-487d-a626-c21cd1c5fe2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:35.103332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-451fd669-2b22-487d-a626-c21cd1c5fe2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:35.105310 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-451fd669-2b22-487d-a626-c21cd1c5fe2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1722 microversion: 2.20 time: 0.323565 Mar 12 20:56:35.106009 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1507/2275] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:34 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:35.114839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cd552aca-5d1c-49ae-aee9-9e394bb16d0f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:35.115485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cd552aca-5d1c-49ae-aee9-9e394bb16d0f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:35.122237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd552aca-5d1c-49ae-aee9-9e394bb16d0f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:35.123016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd552aca-5d1c-49ae-aee9-9e394bb16d0f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:35.124039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd552aca-5d1c-49ae-aee9-9e394bb16d0f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:35.124709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd552aca-5d1c-49ae-aee9-9e394bb16d0f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:35.393598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd552aca-5d1c-49ae-aee9-9e394bb16d0f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:35.405878 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cd552aca-5d1c-49ae-aee9-9e394bb16d0f tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1478 microversion: 2.1 time: 0.298028 Mar 12 20:56:35.417857 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1508/2276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:35 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1478 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:35.425592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1fc631a-1f67-46b9-b4b0-d9f8fca2bcde tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:35.426456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1fc631a-1f67-46b9-b4b0-d9f8fca2bcde tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] [instance: 19da1f10-cf24-4d3c-b9d0-590bed88d296] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:35.448588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1fc631a-1f67-46b9-b4b0-d9f8fca2bcde tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:35.449553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1fc631a-1f67-46b9-b4b0-d9f8fca2bcde tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:35.450746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1fc631a-1f67-46b9-b4b0-d9f8fca2bcde tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:35.451366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1fc631a-1f67-46b9-b4b0-d9f8fca2bcde tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:35.472687 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d1fc631a-1f67-46b9-b4b0-d9f8fca2bcde tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] HTTP exception thrown: Instance 19da1f10-cf24-4d3c-b9d0-590bed88d296 could not be found. Mar 12 20:56:35.473555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1fc631a-1f67-46b9-b4b0-d9f8fca2bcde tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] Returning 404 to user: Instance 19da1f10-cf24-4d3c-b9d0-590bed88d296 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:35.474451 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1fc631a-1f67-46b9-b4b0-d9f8fca2bcde tempest-FloatingIPsAssociationNegativeTestJSON-1428546311 tempest-FloatingIPsAssociationNegativeTestJSON-1428546311-project] 10.222.0.30 "GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296" status: 404 len: 111 microversion: 2.1 time: 0.055257 Mar 12 20:56:35.475021 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1509/2277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:35 2022] GET /compute/v2.1/servers/19da1f10-cf24-4d3c-b9d0-590bed88d296 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:56:35.482650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eefbfc4c-820e-415e-8568-c19e48133466 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:35.483328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eefbfc4c-820e-415e-8568-c19e48133466 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:35.489302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eefbfc4c-820e-415e-8568-c19e48133466 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:35.489760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eefbfc4c-820e-415e-8568-c19e48133466 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:35.490632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eefbfc4c-820e-415e-8568-c19e48133466 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:35.491082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eefbfc4c-820e-415e-8568-c19e48133466 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:35.834807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eefbfc4c-820e-415e-8568-c19e48133466 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:35.846205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eefbfc4c-820e-415e-8568-c19e48133466 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:35.848122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eefbfc4c-820e-415e-8568-c19e48133466 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:35.849430 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eefbfc4c-820e-415e-8568-c19e48133466 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.373230 Mar 12 20:56:35.854584 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1510/2278] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:35 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:35.863448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9dcfb32c-7328-443c-bc78-a77c8fe0d116 req-11bc6cc3-8127-4f28-92cb-6dd1eec6ced0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb11b2e1-92f9-4b42-8158-fd559447adc2", "name": "network-vif-plugged", "status": "completed", "tag": "4f8f4364-9747-4729-b9eb-834dd3e8a86a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:35.873661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9dcfb32c-7328-443c-bc78-a77c8fe0d116 req-11bc6cc3-8127-4f28-92cb-6dd1eec6ced0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:35.874250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9dcfb32c-7328-443c-bc78-a77c8fe0d116 req-11bc6cc3-8127-4f28-92cb-6dd1eec6ced0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:35.887295 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9dcfb32c-7328-443c-bc78-a77c8fe0d116 req-11bc6cc3-8127-4f28-92cb-6dd1eec6ced0 service nova] Creating event network-vif-plugged:4f8f4364-9747-4729-b9eb-834dd3e8a86a for instance eb11b2e1-92f9-4b42-8158-fd559447adc2 on nch1-master-1 Mar 12 20:56:35.897115 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9dcfb32c-7328-443c-bc78-a77c8fe0d116 req-11bc6cc3-8127-4f28-92cb-6dd1eec6ced0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045228 Mar 12 20:56:35.898089 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1511/2279] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:35.905728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5f355ead-b693-4854-a531-aeaf92e6d990 req-28432c9a-2cf0-4c5f-9b15-b799ab7e3e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "tag": "0015b623-5a0c-4812-a5b5-eb6d23db47f1"}, {"name": "network-changed", "server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "tag": "d9049983-2bce-4893-98d7-264a9e284203"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:35.928296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5f355ead-b693-4854-a531-aeaf92e6d990 req-28432c9a-2cf0-4c5f-9b15-b799ab7e3e10 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:35.928662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5f355ead-b693-4854-a531-aeaf92e6d990 req-28432c9a-2cf0-4c5f-9b15-b799ab7e3e10 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:35.945546 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5f355ead-b693-4854-a531-aeaf92e6d990 req-28432c9a-2cf0-4c5f-9b15-b799ab7e3e10 service nova] Creating event network-changed:0015b623-5a0c-4812-a5b5-eb6d23db47f1 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:56:35.946171 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5f355ead-b693-4854-a531-aeaf92e6d990 req-28432c9a-2cf0-4c5f-9b15-b799ab7e3e10 service nova] Creating event network-changed:d9049983-2bce-4893-98d7-264a9e284203 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:56:35.955109 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5f355ead-b693-4854-a531-aeaf92e6d990 req-28432c9a-2cf0-4c5f-9b15-b799ab7e3e10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054048 Mar 12 20:56:35.956266 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1512/2280] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:35.963181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6a2fe135-47cc-480b-b3dd-a0b2e3d559e9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:35.964050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6a2fe135-47cc-480b-b3dd-a0b2e3d559e9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: b155ccae-645c-404b-b1f2-82d1c7e56880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:35.975371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a2fe135-47cc-480b-b3dd-a0b2e3d559e9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:35.975854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a2fe135-47cc-480b-b3dd-a0b2e3d559e9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:35.977498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a2fe135-47cc-480b-b3dd-a0b2e3d559e9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:35.978175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a2fe135-47cc-480b-b3dd-a0b2e3d559e9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:36.510004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6a2fe135-47cc-480b-b3dd-a0b2e3d559e9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:36.520142 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6a2fe135-47cc-480b-b3dd-a0b2e3d559e9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880" status: 200 len: 1521 microversion: 2.1 time: 0.562679 Mar 12 20:56:36.520977 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1513/2281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:35 2022] GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880 => generated 1521 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:36.527660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd430d35-9cfd-4121-9192-6b6c405e9e66 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:36.528603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd430d35-9cfd-4121-9192-6b6c405e9e66 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:36.538627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd430d35-9cfd-4121-9192-6b6c405e9e66 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:36.539194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd430d35-9cfd-4121-9192-6b6c405e9e66 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:36.540068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd430d35-9cfd-4121-9192-6b6c405e9e66 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:36.540716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd430d35-9cfd-4121-9192-6b6c405e9e66 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:36.863893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fd430d35-9cfd-4121-9192-6b6c405e9e66 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:36.872860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fd430d35-9cfd-4121-9192-6b6c405e9e66 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:36.874524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fd430d35-9cfd-4121-9192-6b6c405e9e66 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:36.875805 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd430d35-9cfd-4121-9192-6b6c405e9e66 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1722 microversion: 2.20 time: 0.353557 Mar 12 20:56:36.877191 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1514/2282] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:36 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:36.881050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b56e4c1c-6a7f-4384-b4b6-268ec2452442 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:36.881677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b56e4c1c-6a7f-4384-b4b6-268ec2452442 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:36.889898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b56e4c1c-6a7f-4384-b4b6-268ec2452442 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:36.890356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b56e4c1c-6a7f-4384-b4b6-268ec2452442 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:36.891183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b56e4c1c-6a7f-4384-b4b6-268ec2452442 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:36.891620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b56e4c1c-6a7f-4384-b4b6-268ec2452442 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:37.503776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b56e4c1c-6a7f-4384-b4b6-268ec2452442 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:37.512716 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b56e4c1c-6a7f-4384-b4b6-268ec2452442 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1478 microversion: 2.1 time: 0.635196 Mar 12 20:56:37.522928 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1515/2283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:36 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1478 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:37.528059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-66e891d0-2a1d-403f-bd8b-bf582d21202d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:37.528705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-66e891d0-2a1d-403f-bd8b-bf582d21202d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: b155ccae-645c-404b-b1f2-82d1c7e56880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:37.534987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66e891d0-2a1d-403f-bd8b-bf582d21202d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:37.535849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66e891d0-2a1d-403f-bd8b-bf582d21202d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:37.536912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66e891d0-2a1d-403f-bd8b-bf582d21202d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:37.537582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66e891d0-2a1d-403f-bd8b-bf582d21202d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:37.569602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-66e891d0-2a1d-403f-bd8b-bf582d21202d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: b155ccae-645c-404b-b1f2-82d1c7e56880] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:56:37.671434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-66e891d0-2a1d-403f-bd8b-bf582d21202d tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880" status: 204 len: 0 microversion: 2.1 time: 0.147886 Mar 12 20:56:37.672789 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1516/2284] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:56:37 2022] DELETE /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:56:37.678465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-633307ac-b99a-4808-8071-77fc4b0150c7 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:37.679507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-633307ac-b99a-4808-8071-77fc4b0150c7 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:37.686472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-633307ac-b99a-4808-8071-77fc4b0150c7 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:37.687174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-633307ac-b99a-4808-8071-77fc4b0150c7 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:37.688262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-633307ac-b99a-4808-8071-77fc4b0150c7 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:37.688999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-633307ac-b99a-4808-8071-77fc4b0150c7 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:38.124905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-633307ac-b99a-4808-8071-77fc4b0150c7 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:38.153310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-633307ac-b99a-4808-8071-77fc4b0150c7 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:38.157042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-633307ac-b99a-4808-8071-77fc4b0150c7 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:38.158750 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-633307ac-b99a-4808-8071-77fc4b0150c7 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.484583 Mar 12 20:56:38.159694 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1517/2285] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:37 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:38.177933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abfaeb93-ecd0-437a-bef0-9dd4a72290e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:38.178787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-abfaeb93-ecd0-437a-bef0-9dd4a72290e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: b155ccae-645c-404b-b1f2-82d1c7e56880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:38.186674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abfaeb93-ecd0-437a-bef0-9dd4a72290e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:38.187138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abfaeb93-ecd0-437a-bef0-9dd4a72290e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:38.187924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abfaeb93-ecd0-437a-bef0-9dd4a72290e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:38.188362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abfaeb93-ecd0-437a-bef0-9dd4a72290e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:38.538648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-abfaeb93-ecd0-437a-bef0-9dd4a72290e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:38.547721 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-abfaeb93-ecd0-437a-bef0-9dd4a72290e0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880" status: 200 len: 1527 microversion: 2.1 time: 0.375104 Mar 12 20:56:38.548322 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1518/2286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:38 2022] GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880 => generated 1527 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:38.553069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e959657e-b283-4cdd-b967-8bc6000c7484 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:38.553674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e959657e-b283-4cdd-b967-8bc6000c7484 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:38.560291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e959657e-b283-4cdd-b967-8bc6000c7484 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:38.560676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e959657e-b283-4cdd-b967-8bc6000c7484 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:38.561441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e959657e-b283-4cdd-b967-8bc6000c7484 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:38.561900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e959657e-b283-4cdd-b967-8bc6000c7484 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:38.900213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e959657e-b283-4cdd-b967-8bc6000c7484 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:38.911179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e959657e-b283-4cdd-b967-8bc6000c7484 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:38.912683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e959657e-b283-4cdd-b967-8bc6000c7484 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:38.913862 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e959657e-b283-4cdd-b967-8bc6000c7484 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1722 microversion: 2.20 time: 0.364466 Mar 12 20:56:38.914617 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1519/2287] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:38 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:38.919331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f1df6483-fdfc-413b-a6e0-6a99af455bce req-895a4c9c-c24f-4ae4-a263-b66b5d0aef17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "tag": "0468882e-03df-441e-9049-75f95b5e3334"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:38.929004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f1df6483-fdfc-413b-a6e0-6a99af455bce req-895a4c9c-c24f-4ae4-a263-b66b5d0aef17 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:38.929474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f1df6483-fdfc-413b-a6e0-6a99af455bce req-895a4c9c-c24f-4ae4-a263-b66b5d0aef17 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:38.940565 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f1df6483-fdfc-413b-a6e0-6a99af455bce req-895a4c9c-c24f-4ae4-a263-b66b5d0aef17 service nova] Creating event network-changed:0468882e-03df-441e-9049-75f95b5e3334 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:56:38.946388 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f1df6483-fdfc-413b-a6e0-6a99af455bce req-895a4c9c-c24f-4ae4-a263-b66b5d0aef17 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030317 Mar 12 20:56:38.947419 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1520/2288] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:39.087668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-489453996", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "f9a37655-b450-4556-a41b-12a59d1d79f0"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:39.145539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] validate_networks() for [('f9a37655-b450-4556-a41b-12a59d1d79f0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:56:40.190031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:56:40.190691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:56:40.191503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:56:40.191925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:56:40.192668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:56:40.221821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:40.224365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:40.227429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:40.228329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:40.267033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Getting quotas for project 6629e3cb02ae4e54a2bd5971423b88a7. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:40.274321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Getting quotas for user f4c8688bddda473ebeeef9a20b13be66 and project 6629e3cb02ae4e54a2bd5971423b88a7. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:40.322169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:56:40.327390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:56:40.417365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-78a4f3df-263a-4830-ac66-1ed331e8e933 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.469094 Mar 12 20:56:40.418433 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1521/2289] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:56:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:56:40.424902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b52528ba-3922-4a02-bec2-4943516af08b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:40.425705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b52528ba-3922-4a02-bec2-4943516af08b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:40.441209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b52528ba-3922-4a02-bec2-4943516af08b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:40.441960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b52528ba-3922-4a02-bec2-4943516af08b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:40.444622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b52528ba-3922-4a02-bec2-4943516af08b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:40.445073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b52528ba-3922-4a02-bec2-4943516af08b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:40.875626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b52528ba-3922-4a02-bec2-4943516af08b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:40.885191 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b52528ba-3922-4a02-bec2-4943516af08b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1463 microversion: 2.1 time: 0.465649 Mar 12 20:56:40.900708 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1522/2290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:40 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1463 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:40.907965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ae30851-29f8-49af-b71a-40620a6d2fef tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:40.908865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ae30851-29f8-49af-b71a-40620a6d2fef tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:40.915884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ae30851-29f8-49af-b71a-40620a6d2fef tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:40.916714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ae30851-29f8-49af-b71a-40620a6d2fef tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:40.917783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ae30851-29f8-49af-b71a-40620a6d2fef tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:40.918656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ae30851-29f8-49af-b71a-40620a6d2fef tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:41.301671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ae30851-29f8-49af-b71a-40620a6d2fef tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:41.312269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ae30851-29f8-49af-b71a-40620a6d2fef tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:41.313834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ae30851-29f8-49af-b71a-40620a6d2fef tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:41.314982 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ae30851-29f8-49af-b71a-40620a6d2fef tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.412321 Mar 12 20:56:41.315799 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1523/2291] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:40 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:41.322690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85eb14f7-fe7a-4793-b00b-40b632d2bdc0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:41.324296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85eb14f7-fe7a-4793-b00b-40b632d2bdc0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: b155ccae-645c-404b-b1f2-82d1c7e56880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:41.338731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85eb14f7-fe7a-4793-b00b-40b632d2bdc0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:41.339415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85eb14f7-fe7a-4793-b00b-40b632d2bdc0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:41.340392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85eb14f7-fe7a-4793-b00b-40b632d2bdc0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:41.341013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85eb14f7-fe7a-4793-b00b-40b632d2bdc0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:41.375874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85eb14f7-fe7a-4793-b00b-40b632d2bdc0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:41.376677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85eb14f7-fe7a-4793-b00b-40b632d2bdc0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:41.377312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-85eb14f7-fe7a-4793-b00b-40b632d2bdc0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lazy-loading 'fault' on Instance uuid b155ccae-645c-404b-b1f2-82d1c7e56880 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:56:41.428406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-85eb14f7-fe7a-4793-b00b-40b632d2bdc0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0970c359e4146d9bc4b031060ec97ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa8b1575cea45b4945cd3984f6dbf64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:41.446520 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85eb14f7-fe7a-4793-b00b-40b632d2bdc0 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880" status: 200 len: 1314 microversion: 2.1 time: 0.129514 Mar 12 20:56:41.447146 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1524/2292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:41 2022] GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880 => generated 1314 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:41.452512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b5b564a-fb45-4898-9d95-69f4d518c445 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:41.460084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b5b564a-fb45-4898-9d95-69f4d518c445 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:41.467562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b5b564a-fb45-4898-9d95-69f4d518c445 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:41.468060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b5b564a-fb45-4898-9d95-69f4d518c445 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:41.468854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b5b564a-fb45-4898-9d95-69f4d518c445 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:41.469319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b5b564a-fb45-4898-9d95-69f4d518c445 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:41.808172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b5b564a-fb45-4898-9d95-69f4d518c445 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:41.839387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b5b564a-fb45-4898-9d95-69f4d518c445 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:41.841571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b5b564a-fb45-4898-9d95-69f4d518c445 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:41.843629 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b5b564a-fb45-4898-9d95-69f4d518c445 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1738 microversion: 2.20 time: 0.395528 Mar 12 20:56:41.847346 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1525/2293] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:41 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1738 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:41.861721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b3f5c052-2037-4d8a-b812-e4594b1da71b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:41.864603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b3f5c052-2037-4d8a-b812-e4594b1da71b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:41.883342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3f5c052-2037-4d8a-b812-e4594b1da71b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:41.884069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3f5c052-2037-4d8a-b812-e4594b1da71b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:41.885356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3f5c052-2037-4d8a-b812-e4594b1da71b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:41.886398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3f5c052-2037-4d8a-b812-e4594b1da71b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:42.029652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b3f5c052-2037-4d8a-b812-e4594b1da71b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:42.037411 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b3f5c052-2037-4d8a-b812-e4594b1da71b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1275 microversion: 2.1 time: 0.186139 Mar 12 20:56:42.038021 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1526/2294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:41 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1275 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:42.045062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5aba6aef-77c8-42d0-9677-857304824600 req-a6e91805-4580-4e16-9784-9e80f01a79c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b155ccae-645c-404b-b1f2-82d1c7e56880", "name": "network-vif-deleted", "tag": "4f3ff0ad-14ab-43dc-8cfc-4b3877b3f697"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:42.076971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5aba6aef-77c8-42d0-9677-857304824600 req-a6e91805-4580-4e16-9784-9e80f01a79c1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:42.077429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5aba6aef-77c8-42d0-9677-857304824600 req-a6e91805-4580-4e16-9784-9e80f01a79c1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:42.098250 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5aba6aef-77c8-42d0-9677-857304824600 req-a6e91805-4580-4e16-9784-9e80f01a79c1 service nova] Creating event network-vif-deleted:4f3ff0ad-14ab-43dc-8cfc-4b3877b3f697 for instance b155ccae-645c-404b-b1f2-82d1c7e56880 on nch1-master-1 Mar 12 20:56:42.106379 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5aba6aef-77c8-42d0-9677-857304824600 req-a6e91805-4580-4e16-9784-9e80f01a79c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064707 Mar 12 20:56:42.107007 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1527/2295] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:42.112015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6657b2ab-b7e6-45e7-9762-447e5cde8849 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:42.113081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6657b2ab-b7e6-45e7-9762-447e5cde8849 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:42.119701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6657b2ab-b7e6-45e7-9762-447e5cde8849 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:42.120953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6657b2ab-b7e6-45e7-9762-447e5cde8849 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:42.121956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6657b2ab-b7e6-45e7-9762-447e5cde8849 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:42.122605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6657b2ab-b7e6-45e7-9762-447e5cde8849 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:42.206052 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6657b2ab-b7e6-45e7-9762-447e5cde8849 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action" status: 202 len: 0 microversion: 2.1 time: 0.097611 Mar 12 20:56:42.206873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1528/2296] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:56:42 2022] POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:56:42.219202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-86ade247-71fe-4e8e-8efd-8ef758dd4548 req-b391ab19-a32d-4abc-b27e-8e9fe8627bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27f34eb-a809-408c-9262-cec7223eee56", "name": "network-vif-plugged", "status": "completed", "tag": "74c66795-a7e0-451e-bc40-b9db6d6b19d0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:42.227723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-86ade247-71fe-4e8e-8efd-8ef758dd4548 req-b391ab19-a32d-4abc-b27e-8e9fe8627bd2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:42.228490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-86ade247-71fe-4e8e-8efd-8ef758dd4548 req-b391ab19-a32d-4abc-b27e-8e9fe8627bd2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:42.241503 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-86ade247-71fe-4e8e-8efd-8ef758dd4548 req-b391ab19-a32d-4abc-b27e-8e9fe8627bd2 service nova] Creating event network-vif-plugged:74c66795-a7e0-451e-bc40-b9db6d6b19d0 for instance f27f34eb-a809-408c-9262-cec7223eee56 on nch2-master-1 Mar 12 20:56:42.249869 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-86ade247-71fe-4e8e-8efd-8ef758dd4548 req-b391ab19-a32d-4abc-b27e-8e9fe8627bd2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038068 Mar 12 20:56:42.254121 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1529/2297] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:42.259700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7f7a814-d182-4b2b-b134-40cb58e1a41f tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:42.261230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7f7a814-d182-4b2b-b134-40cb58e1a41f tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:42.267991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7f7a814-d182-4b2b-b134-40cb58e1a41f tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:42.268520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7f7a814-d182-4b2b-b134-40cb58e1a41f tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:42.269680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7f7a814-d182-4b2b-b134-40cb58e1a41f tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:42.270160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7f7a814-d182-4b2b-b134-40cb58e1a41f tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:42.307722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7f7a814-d182-4b2b-b134-40cb58e1a41f tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:42.308372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7f7a814-d182-4b2b-b134-40cb58e1a41f tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:42.308636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-c7f7a814-d182-4b2b-b134-40cb58e1a41f tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lazy-loading 'fault' on Instance uuid eb11b2e1-92f9-4b42-8158-fd559447adc2 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:56:42.713677 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7f7a814-d182-4b2b-b134-40cb58e1a41f tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1597 microversion: 2.1 time: 0.456364 Mar 12 20:56:42.716748 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1530/2298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:42 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1597 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:42.733809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c73f0c8-ff25-4057-bcc8-6c425f3e115e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:42.734757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2c73f0c8-ff25-4057-bcc8-6c425f3e115e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:42.742496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c73f0c8-ff25-4057-bcc8-6c425f3e115e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:42.745993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c73f0c8-ff25-4057-bcc8-6c425f3e115e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:42.747497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c73f0c8-ff25-4057-bcc8-6c425f3e115e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:42.749060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c73f0c8-ff25-4057-bcc8-6c425f3e115e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:43.506908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c73f0c8-ff25-4057-bcc8-6c425f3e115e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:43.521499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c73f0c8-ff25-4057-bcc8-6c425f3e115e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:43.523361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c73f0c8-ff25-4057-bcc8-6c425f3e115e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:43.524732 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c73f0c8-ff25-4057-bcc8-6c425f3e115e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.806873 Mar 12 20:56:43.525802 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1531/2299] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:42 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:43.542928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dbe96377-84ba-40cc-9025-97ca620c60d9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:43.543540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dbe96377-84ba-40cc-9025-97ca620c60d9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: b155ccae-645c-404b-b1f2-82d1c7e56880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:43.557291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbe96377-84ba-40cc-9025-97ca620c60d9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:43.558841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbe96377-84ba-40cc-9025-97ca620c60d9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:43.559847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbe96377-84ba-40cc-9025-97ca620c60d9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:43.560291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbe96377-84ba-40cc-9025-97ca620c60d9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:43.577966 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-dbe96377-84ba-40cc-9025-97ca620c60d9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] HTTP exception thrown: Instance b155ccae-645c-404b-b1f2-82d1c7e56880 could not be found. Mar 12 20:56:43.579200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dbe96377-84ba-40cc-9025-97ca620c60d9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 404 to user: Instance b155ccae-645c-404b-b1f2-82d1c7e56880 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:43.580203 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dbe96377-84ba-40cc-9025-97ca620c60d9 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880" status: 404 len: 111 microversion: 2.1 time: 0.052615 Mar 12 20:56:43.581219 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1532/2300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:43 2022] GET /compute/v2.1/servers/b155ccae-645c-404b-b1f2-82d1c7e56880 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:56:43.585917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-01a12448-2fce-42fa-8582-5d22c43ecbe2 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:43.591688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-01a12448-2fce-42fa-8582-5d22c43ecbe2 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:43.598579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01a12448-2fce-42fa-8582-5d22c43ecbe2 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:43.599028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01a12448-2fce-42fa-8582-5d22c43ecbe2 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:43.600015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01a12448-2fce-42fa-8582-5d22c43ecbe2 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:43.600452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01a12448-2fce-42fa-8582-5d22c43ecbe2 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:43.706312 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-01a12448-2fce-42fa-8582-5d22c43ecbe2 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action" status: 202 len: 0 microversion: 2.1 time: 0.123776 Mar 12 20:56:43.707434 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1533/2301] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:56:43 2022] POST /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:56:43.942946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d69beb1-8ec5-4b70-9091-0680d36ac9e3 tempest-ListImagesTestJSON-1239113555 tempest-ListImagesTestJSON-1239113555-project] Calling method '.version_select at 0x7f6e36cafc10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:43.991684 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d69beb1-8ec5-4b70-9091-0680d36ac9e3 tempest-ListImagesTestJSON-1239113555 tempest-ListImagesTestJSON-1239113555-project] 10.222.0.30 "GET /compute/v2.1/images/539171db-0bd3-4f16-95fd-a7cd5530137d" status: 200 len: 784 microversion: 2.1 time: 0.282123 Mar 12 20:56:44.000246 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1534/2302] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 20:56:43 2022] GET /compute/v2.1/images/539171db-0bd3-4f16-95fd-a7cd5530137d => generated 784 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:44.005302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bde6b50c-1054-4f3c-967a-6490c1eb512c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:44.006152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bde6b50c-1054-4f3c-967a-6490c1eb512c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:44.013797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bde6b50c-1054-4f3c-967a-6490c1eb512c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:44.014504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bde6b50c-1054-4f3c-967a-6490c1eb512c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:44.015457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bde6b50c-1054-4f3c-967a-6490c1eb512c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:44.016072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bde6b50c-1054-4f3c-967a-6490c1eb512c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:44.399040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bde6b50c-1054-4f3c-967a-6490c1eb512c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:44.407782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bde6b50c-1054-4f3c-967a-6490c1eb512c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:44.409643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bde6b50c-1054-4f3c-967a-6490c1eb512c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:44.411152 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bde6b50c-1054-4f3c-967a-6490c1eb512c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1738 microversion: 2.20 time: 0.409673 Mar 12 20:56:44.422395 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1535/2303] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:44 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1738 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:44.427633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-92184d04-1392-483f-921a-eb5e083104cb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:44.428570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-92184d04-1392-483f-921a-eb5e083104cb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:44.435016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92184d04-1392-483f-921a-eb5e083104cb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:44.435808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92184d04-1392-483f-921a-eb5e083104cb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:44.436848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92184d04-1392-483f-921a-eb5e083104cb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:44.437392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92184d04-1392-483f-921a-eb5e083104cb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:44.822124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-92184d04-1392-483f-921a-eb5e083104cb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:44.835220 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-92184d04-1392-483f-921a-eb5e083104cb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1317 microversion: 2.1 time: 0.411136 Mar 12 20:56:44.836020 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1536/2304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:44 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:44.846476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d41426a-386f-4801-a51d-c7a5ea9676aa tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '.version_select at 0x7f6e36df6af0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:44.875847 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-2d41426a-386f-4801-a51d-c7a5ea9676aa tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] HTTP exception thrown: Image not found. Mar 12 20:56:44.877420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d41426a-386f-4801-a51d-c7a5ea9676aa tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:44.878794 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d41426a-386f-4801-a51d-c7a5ea9676aa tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "DELETE /compute/v2.1/images/5091b1c4-f7e4-4c5f-a072-bad30bf15cdf" status: 404 len: 62 microversion: 2.1 time: 0.041611 Mar 12 20:56:44.880769 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1537/2305] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:44 2022] DELETE /compute/v2.1/images/5091b1c4-f7e4-4c5f-a072-bad30bf15cdf => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:56:44.888945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8cbee798-8cf7-4050-8810-9f5cab36b133 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:44.889933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8cbee798-8cf7-4050-8810-9f5cab36b133 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:44.898623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cbee798-8cf7-4050-8810-9f5cab36b133 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:44.899384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cbee798-8cf7-4050-8810-9f5cab36b133 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:44.900547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cbee798-8cf7-4050-8810-9f5cab36b133 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:44.901899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cbee798-8cf7-4050-8810-9f5cab36b133 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:45.257155 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8cbee798-8cf7-4050-8810-9f5cab36b133 tempest-ServersAdminTestJSON-346081579 tempest-ServersAdminTestJSON-346081579-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1614 microversion: 2.1 time: 0.374736 Mar 12 20:56:45.258761 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1538/2306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:44 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1614 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:45.263954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6a1daccd-a37d-4ace-bc7d-b6e89e319038 tempest-ListImagesTestJSON-1239113555 tempest-ListImagesTestJSON-1239113555-project] Calling method '.version_select at 0x7f6e3708a8b0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:45.346725 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6a1daccd-a37d-4ace-bc7d-b6e89e319038 tempest-ListImagesTestJSON-1239113555 tempest-ListImagesTestJSON-1239113555-project] 10.222.0.30 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.087505 Mar 12 20:56:45.347517 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1539/2307] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Mar 12 20:56:45 2022] GET /compute/v2.1/images => generated 445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:45.359676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04dc450c-9abf-4474-bc74-4f3800198a88 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:45.360304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04dc450c-9abf-4474-bc74-4f3800198a88 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:45.367641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04dc450c-9abf-4474-bc74-4f3800198a88 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:45.368098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04dc450c-9abf-4474-bc74-4f3800198a88 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:45.368904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04dc450c-9abf-4474-bc74-4f3800198a88 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:45.369349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04dc450c-9abf-4474-bc74-4f3800198a88 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:45.681474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04dc450c-9abf-4474-bc74-4f3800198a88 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:45.695372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04dc450c-9abf-4474-bc74-4f3800198a88 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:45.697474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04dc450c-9abf-4474-bc74-4f3800198a88 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:45.699118 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04dc450c-9abf-4474-bc74-4f3800198a88 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.344818 Mar 12 20:56:45.700239 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1540/2308] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:45 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:45.705263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c00c8bc-f104-4a54-a44f-5cebe7a0a4cb tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:45.705973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c00c8bc-f104-4a54-a44f-5cebe7a0a4cb tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:45.715541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c00c8bc-f104-4a54-a44f-5cebe7a0a4cb tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:45.716252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c00c8bc-f104-4a54-a44f-5cebe7a0a4cb tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:45.717267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c00c8bc-f104-4a54-a44f-5cebe7a0a4cb tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:45.718067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c00c8bc-f104-4a54-a44f-5cebe7a0a4cb tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:45.740292 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3c00c8bc-f104-4a54-a44f-5cebe7a0a4cb tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] HTTP exception thrown: Instance d492a34a-8d20-476f-b6d8-16d2f26b7a9b could not be found. Mar 12 20:56:45.740904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c00c8bc-f104-4a54-a44f-5cebe7a0a4cb tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 404 to user: Instance d492a34a-8d20-476f-b6d8-16d2f26b7a9b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:45.741759 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c00c8bc-f104-4a54-a44f-5cebe7a0a4cb tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b" status: 404 len: 111 microversion: 2.1 time: 0.040330 Mar 12 20:56:45.745719 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1541/2309] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:56:45 2022] DELETE /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:56:45.752980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2b51729b-cd60-4693-8154-9f99a0a472a2 req-be7b7c98-2783-43b1-a0c4-4a60cdb46398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85242d3f-d68b-418e-8788-978e8b8e1a57", "tag": "5b9f6f03-0f86-4781-9004-bc10c692eaba"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:45.762961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2b51729b-cd60-4693-8154-9f99a0a472a2 req-be7b7c98-2783-43b1-a0c4-4a60cdb46398 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:45.763653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2b51729b-cd60-4693-8154-9f99a0a472a2 req-be7b7c98-2783-43b1-a0c4-4a60cdb46398 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:45.777945 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2b51729b-cd60-4693-8154-9f99a0a472a2 req-be7b7c98-2783-43b1-a0c4-4a60cdb46398 service nova] Creating event network-changed:5b9f6f03-0f86-4781-9004-bc10c692eaba for instance 85242d3f-d68b-418e-8788-978e8b8e1a57 on nch1-master-1 Mar 12 20:56:45.784572 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2b51729b-cd60-4693-8154-9f99a0a472a2 req-be7b7c98-2783-43b1-a0c4-4a60cdb46398 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035135 Mar 12 20:56:45.786034 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1542/2310] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:45.793327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16cc81e3-a496-4fcc-887b-757555836257 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:45.794287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16cc81e3-a496-4fcc-887b-757555836257 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 49462c08-773d-44d6-8122-ca42b0c747ef] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:45.806639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16cc81e3-a496-4fcc-887b-757555836257 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:45.807097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16cc81e3-a496-4fcc-887b-757555836257 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:45.807938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16cc81e3-a496-4fcc-887b-757555836257 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:45.814728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16cc81e3-a496-4fcc-887b-757555836257 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:45.861761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16cc81e3-a496-4fcc-887b-757555836257 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 49462c08-773d-44d6-8122-ca42b0c747ef] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:56:45.974501 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16cc81e3-a496-4fcc-887b-757555836257 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "DELETE /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef" status: 204 len: 0 microversion: 2.1 time: 0.186553 Mar 12 20:56:45.978057 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1543/2311] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:56:45 2022] DELETE /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:56:45.982388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e9e365e0-0cbb-43e9-a3eb-f12bf9f2db80 tempest-ListImagesTestJSON-1239113555 tempest-ListImagesTestJSON-1239113555-project] Calling method '.version_select at 0x7f6e3715f8b0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:46.035655 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e9e365e0-0cbb-43e9-a3eb-f12bf9f2db80 tempest-ListImagesTestJSON-1239113555 tempest-ListImagesTestJSON-1239113555-project] 10.222.0.30 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.058456 Mar 12 20:56:46.036387 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1544/2312] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 20:56:45 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:46.041346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c193f7e-aa1d-4354-af2a-3d60fe274015 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:46.043135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c193f7e-aa1d-4354-af2a-3d60fe274015 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:46.056923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c193f7e-aa1d-4354-af2a-3d60fe274015 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:46.058339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c193f7e-aa1d-4354-af2a-3d60fe274015 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:46.059526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c193f7e-aa1d-4354-af2a-3d60fe274015 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:46.060172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c193f7e-aa1d-4354-af2a-3d60fe274015 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:46.588440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c193f7e-aa1d-4354-af2a-3d60fe274015 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:46.603326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c193f7e-aa1d-4354-af2a-3d60fe274015 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:46.607553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c193f7e-aa1d-4354-af2a-3d60fe274015 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:46.613100 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c193f7e-aa1d-4354-af2a-3d60fe274015 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1738 microversion: 2.20 time: 0.575655 Mar 12 20:56:46.613692 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1545/2313] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:46 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1738 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:46.631618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9168798d-5562-44e4-983a-5d431e67cb4b tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:46.633031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9168798d-5562-44e4-983a-5d431e67cb4b tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: d492a34a-8d20-476f-b6d8-16d2f26b7a9b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:46.666410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9168798d-5562-44e4-983a-5d431e67cb4b tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:46.667162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9168798d-5562-44e4-983a-5d431e67cb4b tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:46.672722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9168798d-5562-44e4-983a-5d431e67cb4b tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:46.673242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9168798d-5562-44e4-983a-5d431e67cb4b tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:46.704255 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9168798d-5562-44e4-983a-5d431e67cb4b tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] HTTP exception thrown: Instance d492a34a-8d20-476f-b6d8-16d2f26b7a9b could not be found. Mar 12 20:56:46.705164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9168798d-5562-44e4-983a-5d431e67cb4b tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 404 to user: Instance d492a34a-8d20-476f-b6d8-16d2f26b7a9b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:46.706243 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9168798d-5562-44e4-983a-5d431e67cb4b tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b" status: 404 len: 111 microversion: 2.1 time: 0.090982 Mar 12 20:56:46.707439 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1546/2314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:46 2022] GET /compute/v2.1/servers/d492a34a-8d20-476f-b6d8-16d2f26b7a9b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:56:46.728338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-724fff5c-d381-4914-8239-5a12875474e0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:46.730137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-724fff5c-d381-4914-8239-5a12875474e0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:46.747274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-724fff5c-d381-4914-8239-5a12875474e0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:46.747750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-724fff5c-d381-4914-8239-5a12875474e0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:46.748525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-724fff5c-d381-4914-8239-5a12875474e0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:46.748964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-724fff5c-d381-4914-8239-5a12875474e0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:46.944946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-724fff5c-d381-4914-8239-5a12875474e0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:46.959046 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-724fff5c-d381-4914-8239-5a12875474e0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1317 microversion: 2.1 time: 0.248145 Mar 12 20:56:46.959046 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1547/2315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:46 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:46.962298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-572bba2d-2079-4d64-99eb-b37a80edfb89 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:46.962922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-572bba2d-2079-4d64-99eb-b37a80edfb89 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 49462c08-773d-44d6-8122-ca42b0c747ef] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:46.969786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-572bba2d-2079-4d64-99eb-b37a80edfb89 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:46.970257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-572bba2d-2079-4d64-99eb-b37a80edfb89 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:46.971044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-572bba2d-2079-4d64-99eb-b37a80edfb89 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:46.971519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-572bba2d-2079-4d64-99eb-b37a80edfb89 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:47.177270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-572bba2d-2079-4d64-99eb-b37a80edfb89 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:47.186813 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-572bba2d-2079-4d64-99eb-b37a80edfb89 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef" status: 200 len: 1468 microversion: 2.1 time: 0.227762 Mar 12 20:56:47.195110 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1548/2316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:46 2022] GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef => generated 1468 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:47.205568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1d9b80c4-dc1d-4c99-9adf-811d74735970 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '.version_select at 0x7f6e36f3cc10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:47.226569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1d9b80c4-dc1d-4c99-9adf-811d74735970 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094121588" status: 202 len: 0 microversion: 2.1 time: 0.028899 Mar 12 20:56:47.227361 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1549/2317] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Mar 12 20:56:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2094121588 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:56:47.235058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a024b3ee-2915-4bee-8879-d47e9d6f943a tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:47.235669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a024b3ee-2915-4bee-8879-d47e9d6f943a tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:47.243045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a024b3ee-2915-4bee-8879-d47e9d6f943a tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:47.243639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a024b3ee-2915-4bee-8879-d47e9d6f943a tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:47.244634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a024b3ee-2915-4bee-8879-d47e9d6f943a tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:47.245994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a024b3ee-2915-4bee-8879-d47e9d6f943a tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:47.309825 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 20:56:47.310568 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 20:56:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 20:56:47.658186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a024b3ee-2915-4bee-8879-d47e9d6f943a tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:47.667388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a024b3ee-2915-4bee-8879-d47e9d6f943a tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:47.668900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a024b3ee-2915-4bee-8879-d47e9d6f943a tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:47.670092 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a024b3ee-2915-4bee-8879-d47e9d6f943a tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.438921 Mar 12 20:56:47.670654 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1550/2318] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:47 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:47.693115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cd43df0c-d059-48d5-8faa-986bd89be033 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:47.694075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cd43df0c-d059-48d5-8faa-986bd89be033 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:47.702955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd43df0c-d059-48d5-8faa-986bd89be033 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:47.711953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd43df0c-d059-48d5-8faa-986bd89be033 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:47.712992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd43df0c-d059-48d5-8faa-986bd89be033 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:47.714542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd43df0c-d059-48d5-8faa-986bd89be033 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:48.211573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd43df0c-d059-48d5-8faa-986bd89be033 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:48.221485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd43df0c-d059-48d5-8faa-986bd89be033 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:48.230128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd43df0c-d059-48d5-8faa-986bd89be033 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:48.231595 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cd43df0c-d059-48d5-8faa-986bd89be033 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1738 microversion: 2.20 time: 0.554119 Mar 12 20:56:48.236637 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1551/2319] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:47 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1738 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:48.245860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-027f24b2-141e-4a7c-bb5f-123da81fa13f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:48.246695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-027f24b2-141e-4a7c-bb5f-123da81fa13f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:48.259844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-027f24b2-141e-4a7c-bb5f-123da81fa13f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:48.261162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-027f24b2-141e-4a7c-bb5f-123da81fa13f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:48.266279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-027f24b2-141e-4a7c-bb5f-123da81fa13f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:48.266910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-027f24b2-141e-4a7c-bb5f-123da81fa13f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:48.792360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-027f24b2-141e-4a7c-bb5f-123da81fa13f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:48.800077 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-027f24b2-141e-4a7c-bb5f-123da81fa13f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1317 microversion: 2.1 time: 0.562061 Mar 12 20:56:48.810438 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1552/2320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:48 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:48.815621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-64e2a2e6-f132-44c8-b0bb-2a7c5b11bb77 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:48.816563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-64e2a2e6-f132-44c8-b0bb-2a7c5b11bb77 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 49462c08-773d-44d6-8122-ca42b0c747ef] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:48.823598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64e2a2e6-f132-44c8-b0bb-2a7c5b11bb77 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:48.824375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64e2a2e6-f132-44c8-b0bb-2a7c5b11bb77 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:48.825432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64e2a2e6-f132-44c8-b0bb-2a7c5b11bb77 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:48.826643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64e2a2e6-f132-44c8-b0bb-2a7c5b11bb77 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:49.268229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-64e2a2e6-f132-44c8-b0bb-2a7c5b11bb77 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:49.282029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-64e2a2e6-f132-44c8-b0bb-2a7c5b11bb77 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef" status: 200 len: 1468 microversion: 2.1 time: 0.465523 Mar 12 20:56:49.292181 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1553/2321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:48 2022] GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef => generated 1468 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:49.317719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb68d09b-b91d-4c90-ae72-d4ab7069829d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:49.318364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fb68d09b-b91d-4c90-ae72-d4ab7069829d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:49.337721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb68d09b-b91d-4c90-ae72-d4ab7069829d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:49.338203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb68d09b-b91d-4c90-ae72-d4ab7069829d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:49.339580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb68d09b-b91d-4c90-ae72-d4ab7069829d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:49.340027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb68d09b-b91d-4c90-ae72-d4ab7069829d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.089933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fb68d09b-b91d-4c90-ae72-d4ab7069829d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:50.102891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fb68d09b-b91d-4c90-ae72-d4ab7069829d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:50.105074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fb68d09b-b91d-4c90-ae72-d4ab7069829d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:50.106545 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb68d09b-b91d-4c90-ae72-d4ab7069829d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.812985 Mar 12 20:56:50.124603 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1554/2322] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:49 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:50.130422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc95d980-111c-4a23-8459-c16bfafc871e tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '.version_select at 0x7f6e36df6550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:50.155910 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-dc95d980-111c-4a23-8459-c16bfafc871e tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] HTTP exception thrown: Image not found. Mar 12 20:56:50.156527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc95d980-111c-4a23-8459-c16bfafc871e tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 404 to user: Image not found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:50.157366 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc95d980-111c-4a23-8459-c16bfafc871e tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "DELETE /compute/v2.1/images/102f4e43-e0d2-45bb-b3a7-dedceae99f28" status: 404 len: 62 microversion: 2.1 time: 0.030734 Mar 12 20:56:50.158719 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1555/2323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:50 2022] DELETE /compute/v2.1/images/102f4e43-e0d2-45bb-b3a7-dedceae99f28 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:56:50.164817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27bd7049-3d63-4df3-9c82-fa83a444c653 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:50.165521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27bd7049-3d63-4df3-9c82-fa83a444c653 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:50.178595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27bd7049-3d63-4df3-9c82-fa83a444c653 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.179207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27bd7049-3d63-4df3-9c82-fa83a444c653 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.180161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27bd7049-3d63-4df3-9c82-fa83a444c653 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.180908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27bd7049-3d63-4df3-9c82-fa83a444c653 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.428927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27bd7049-3d63-4df3-9c82-fa83a444c653 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:50.444336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27bd7049-3d63-4df3-9c82-fa83a444c653 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:50.450090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27bd7049-3d63-4df3-9c82-fa83a444c653 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:50.458653 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27bd7049-3d63-4df3-9c82-fa83a444c653 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1738 microversion: 2.20 time: 0.291823 Mar 12 20:56:50.461839 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1556/2324] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:50 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:50.478884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-15603111-9a56-42ef-966c-b7b142bb38a8 req-e4fea65b-8c84-4fb2-82f1-8c1513a03eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49462c08-773d-44d6-8122-ca42b0c747ef", "name": "network-vif-deleted", "tag": "e398a928-4978-47a9-99c7-cf09b38614c3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:50.503785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-15603111-9a56-42ef-966c-b7b142bb38a8 req-e4fea65b-8c84-4fb2-82f1-8c1513a03eb6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.515702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-15603111-9a56-42ef-966c-b7b142bb38a8 req-e4fea65b-8c84-4fb2-82f1-8c1513a03eb6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.538578 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-15603111-9a56-42ef-966c-b7b142bb38a8 req-e4fea65b-8c84-4fb2-82f1-8c1513a03eb6 service nova] Creating event network-vif-deleted:e398a928-4978-47a9-99c7-cf09b38614c3 for instance 49462c08-773d-44d6-8122-ca42b0c747ef on nch1-master-1 Mar 12 20:56:50.554734 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-15603111-9a56-42ef-966c-b7b142bb38a8 req-e4fea65b-8c84-4fb2-82f1-8c1513a03eb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082938 Mar 12 20:56:50.555971 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1557/2325] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:50.565925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bca83777-349c-411f-bd4b-97bc376dc25a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:50.566969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bca83777-349c-411f-bd4b-97bc376dc25a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:50.575188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bca83777-349c-411f-bd4b-97bc376dc25a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.575974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bca83777-349c-411f-bd4b-97bc376dc25a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.576993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bca83777-349c-411f-bd4b-97bc376dc25a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.577654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bca83777-349c-411f-bd4b-97bc376dc25a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.787672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bca83777-349c-411f-bd4b-97bc376dc25a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:50.797080 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bca83777-349c-411f-bd4b-97bc376dc25a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1317 microversion: 2.1 time: 0.239142 Mar 12 20:56:50.798562 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1558/2326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:50 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:50.804289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20a11d24-3b0e-44b5-9a0e-5b8a752a2b47 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:50.805222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20a11d24-3b0e-44b5-9a0e-5b8a752a2b47 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:50.812680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20a11d24-3b0e-44b5-9a0e-5b8a752a2b47 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.813540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20a11d24-3b0e-44b5-9a0e-5b8a752a2b47 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.814831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20a11d24-3b0e-44b5-9a0e-5b8a752a2b47 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.815594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20a11d24-3b0e-44b5-9a0e-5b8a752a2b47 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.841252 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-20a11d24-3b0e-44b5-9a0e-5b8a752a2b47 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] HTTP exception thrown: Instance 9194940b-98b0-48a5-a60e-465ff599b850 could not be found. Mar 12 20:56:50.842989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20a11d24-3b0e-44b5-9a0e-5b8a752a2b47 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 404 to user: Instance 9194940b-98b0-48a5-a60e-465ff599b850 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:50.844187 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20a11d24-3b0e-44b5-9a0e-5b8a752a2b47 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 404 len: 111 microversion: 2.1 time: 0.044469 Mar 12 20:56:50.845429 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1559/2327] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:56:50 2022] DELETE /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:56:50.850236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab68672f-21e3-40f4-bcfb-e584d5d259f4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:50.851143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ab68672f-21e3-40f4-bcfb-e584d5d259f4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 49462c08-773d-44d6-8122-ca42b0c747ef] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:50.868674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab68672f-21e3-40f4-bcfb-e584d5d259f4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.870810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab68672f-21e3-40f4-bcfb-e584d5d259f4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.872411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab68672f-21e3-40f4-bcfb-e584d5d259f4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.873947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab68672f-21e3-40f4-bcfb-e584d5d259f4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.896148 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ab68672f-21e3-40f4-bcfb-e584d5d259f4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] HTTP exception thrown: Instance 49462c08-773d-44d6-8122-ca42b0c747ef could not be found. Mar 12 20:56:50.897854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab68672f-21e3-40f4-bcfb-e584d5d259f4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Returning 404 to user: Instance 49462c08-773d-44d6-8122-ca42b0c747ef could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:50.898933 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ab68672f-21e3-40f4-bcfb-e584d5d259f4 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef" status: 404 len: 111 microversion: 2.1 time: 0.052310 Mar 12 20:56:50.900242 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1560/2328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:50 2022] GET /compute/v2.1/servers/49462c08-773d-44d6-8122-ca42b0c747ef => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:56:50.906787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8acadc3d-ba43-4dc5-98fc-f05ea7853195 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:50.908759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8acadc3d-ba43-4dc5-98fc-f05ea7853195 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] [instance: 9194940b-98b0-48a5-a60e-465ff599b850] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:50.917981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8acadc3d-ba43-4dc5-98fc-f05ea7853195 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.918805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8acadc3d-ba43-4dc5-98fc-f05ea7853195 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.921280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8acadc3d-ba43-4dc5-98fc-f05ea7853195 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.921983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8acadc3d-ba43-4dc5-98fc-f05ea7853195 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.947657 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8acadc3d-ba43-4dc5-98fc-f05ea7853195 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] HTTP exception thrown: Instance 9194940b-98b0-48a5-a60e-465ff599b850 could not be found. Mar 12 20:56:50.952820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8acadc3d-ba43-4dc5-98fc-f05ea7853195 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] Returning 404 to user: Instance 9194940b-98b0-48a5-a60e-465ff599b850 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:50.954938 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8acadc3d-ba43-4dc5-98fc-f05ea7853195 tempest-ImagesOneServerNegativeTestJSON-976280246 tempest-ImagesOneServerNegativeTestJSON-976280246-project] 10.222.0.30 "GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850" status: 404 len: 111 microversion: 2.1 time: 0.053078 Mar 12 20:56:50.956110 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1561/2329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:50 2022] GET /compute/v2.1/servers/9194940b-98b0-48a5-a60e-465ff599b850 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:56:50.976308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2fe31752-7725-45c4-8da2-0c614f87fa41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:50.977197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2fe31752-7725-45c4-8da2-0c614f87fa41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 454e487a-2c6b-4bb7-8957-03e591b61651] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:50.992819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fe31752-7725-45c4-8da2-0c614f87fa41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.993729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fe31752-7725-45c4-8da2-0c614f87fa41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:50.996925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fe31752-7725-45c4-8da2-0c614f87fa41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:50.999106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fe31752-7725-45c4-8da2-0c614f87fa41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:51.068321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2fe31752-7725-45c4-8da2-0c614f87fa41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 454e487a-2c6b-4bb7-8957-03e591b61651] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:56:51.261872 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2fe31752-7725-45c4-8da2-0c614f87fa41 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "DELETE /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651" status: 204 len: 0 microversion: 2.1 time: 0.303293 Mar 12 20:56:51.266685 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1562/2330] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:56:50 2022] DELETE /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:56:51.279507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-02efcbc4-0fb3-4bc8-a006-eb6dd53b0786 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:51.280614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-02efcbc4-0fb3-4bc8-a006-eb6dd53b0786 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:51.298102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02efcbc4-0fb3-4bc8-a006-eb6dd53b0786 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:51.298730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02efcbc4-0fb3-4bc8-a006-eb6dd53b0786 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:51.301709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02efcbc4-0fb3-4bc8-a006-eb6dd53b0786 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:51.302523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02efcbc4-0fb3-4bc8-a006-eb6dd53b0786 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:51.743040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-02efcbc4-0fb3-4bc8-a006-eb6dd53b0786 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:51.757755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-02efcbc4-0fb3-4bc8-a006-eb6dd53b0786 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:51.761408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-02efcbc4-0fb3-4bc8-a006-eb6dd53b0786 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:51.764328 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-02efcbc4-0fb3-4bc8-a006-eb6dd53b0786 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.495901 Mar 12 20:56:51.771515 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1563/2331] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:51 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:51.785948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a47cc472-9d95-4667-9376-4c4fe9576189 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:51.786866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a47cc472-9d95-4667-9376-4c4fe9576189 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 454e487a-2c6b-4bb7-8957-03e591b61651] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:51.796848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a47cc472-9d95-4667-9376-4c4fe9576189 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:51.797303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a47cc472-9d95-4667-9376-4c4fe9576189 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:51.798147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a47cc472-9d95-4667-9376-4c4fe9576189 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:51.798607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a47cc472-9d95-4667-9376-4c4fe9576189 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:52.183905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a47cc472-9d95-4667-9376-4c4fe9576189 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:52.194336 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a47cc472-9d95-4667-9376-4c4fe9576189 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651" status: 200 len: 1469 microversion: 2.1 time: 0.419471 Mar 12 20:56:52.195915 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1564/2332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:51 2022] GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651 => generated 1469 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:52.202158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2b8c25a0-0c86-461b-bff3-9f0bb8343757 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:52.203040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2b8c25a0-0c86-461b-bff3-9f0bb8343757 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:52.215343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b8c25a0-0c86-461b-bff3-9f0bb8343757 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:52.218250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b8c25a0-0c86-461b-bff3-9f0bb8343757 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:52.219579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b8c25a0-0c86-461b-bff3-9f0bb8343757 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:52.220449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b8c25a0-0c86-461b-bff3-9f0bb8343757 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:52.487803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2b8c25a0-0c86-461b-bff3-9f0bb8343757 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:52.503329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2b8c25a0-0c86-461b-bff3-9f0bb8343757 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:52.505851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2b8c25a0-0c86-461b-bff3-9f0bb8343757 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:52.507586 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2b8c25a0-0c86-461b-bff3-9f0bb8343757 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1738 microversion: 2.20 time: 0.310492 Mar 12 20:56:52.508758 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1565/2333] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:52 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1738 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:52.514833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67bfc70d-96d5-4c46-a28a-5afb19e3fed6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:52.516162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-67bfc70d-96d5-4c46-a28a-5afb19e3fed6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:52.525235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67bfc70d-96d5-4c46-a28a-5afb19e3fed6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:52.526544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67bfc70d-96d5-4c46-a28a-5afb19e3fed6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:52.531491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67bfc70d-96d5-4c46-a28a-5afb19e3fed6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:52.532326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67bfc70d-96d5-4c46-a28a-5afb19e3fed6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:52.798478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-67bfc70d-96d5-4c46-a28a-5afb19e3fed6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:52.841991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67bfc70d-96d5-4c46-a28a-5afb19e3fed6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1317 microversion: 2.1 time: 0.302792 Mar 12 20:56:52.853338 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1566/2334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:52 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:52.864666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25df6e8d-dc89-476c-876b-b59d3b0830bd tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:52.866263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-25df6e8d-dc89-476c-876b-b59d3b0830bd tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:52.892465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25df6e8d-dc89-476c-876b-b59d3b0830bd tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:52.892920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25df6e8d-dc89-476c-876b-b59d3b0830bd tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:52.893952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25df6e8d-dc89-476c-876b-b59d3b0830bd tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:52.894464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25df6e8d-dc89-476c-876b-b59d3b0830bd tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:53.467176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-25df6e8d-dc89-476c-876b-b59d3b0830bd tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:53.482960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-25df6e8d-dc89-476c-876b-b59d3b0830bd tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:53.487027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-25df6e8d-dc89-476c-876b-b59d3b0830bd tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:53.487840 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-25df6e8d-dc89-476c-876b-b59d3b0830bd tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.636901 Mar 12 20:56:53.492093 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1567/2335] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:52 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:53.503836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-38820e5e-35df-48f8-930c-3ec08c8e6d6b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:53.506895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-38820e5e-35df-48f8-930c-3ec08c8e6d6b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 454e487a-2c6b-4bb7-8957-03e591b61651] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:53.521286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38820e5e-35df-48f8-930c-3ec08c8e6d6b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:53.522985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38820e5e-35df-48f8-930c-3ec08c8e6d6b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:53.523872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38820e5e-35df-48f8-930c-3ec08c8e6d6b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:53.524320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38820e5e-35df-48f8-930c-3ec08c8e6d6b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:53.910890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-38820e5e-35df-48f8-930c-3ec08c8e6d6b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:53.925237 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-38820e5e-35df-48f8-930c-3ec08c8e6d6b tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651" status: 200 len: 1469 microversion: 2.1 time: 0.427536 Mar 12 20:56:53.927647 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1568/2336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:53 2022] GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651 => generated 1469 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:53.940981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c6546d3d-5e6f-4c5b-a8ba-db08441a88fa tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:53.941221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c6546d3d-5e6f-4c5b-a8ba-db08441a88fa tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:53.957433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6546d3d-5e6f-4c5b-a8ba-db08441a88fa tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:53.958290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6546d3d-5e6f-4c5b-a8ba-db08441a88fa tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:53.959165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6546d3d-5e6f-4c5b-a8ba-db08441a88fa tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:53.959798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6546d3d-5e6f-4c5b-a8ba-db08441a88fa tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:54.536651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c6546d3d-5e6f-4c5b-a8ba-db08441a88fa tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:54.550626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c6546d3d-5e6f-4c5b-a8ba-db08441a88fa tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:54.553004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c6546d3d-5e6f-4c5b-a8ba-db08441a88fa tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:54.555332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c6546d3d-5e6f-4c5b-a8ba-db08441a88fa tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1738 microversion: 2.20 time: 0.626427 Mar 12 20:56:54.556666 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1569/2337] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:53 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1738 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:54.564909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-46bc0cbc-8c6e-4e95-91ac-bb0104207afd tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:54.566061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-46bc0cbc-8c6e-4e95-91ac-bb0104207afd tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:54.578612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46bc0cbc-8c6e-4e95-91ac-bb0104207afd tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:54.579466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46bc0cbc-8c6e-4e95-91ac-bb0104207afd tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:54.580479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46bc0cbc-8c6e-4e95-91ac-bb0104207afd tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:54.581182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46bc0cbc-8c6e-4e95-91ac-bb0104207afd tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:54.857737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-46bc0cbc-8c6e-4e95-91ac-bb0104207afd tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:54.871160 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-46bc0cbc-8c6e-4e95-91ac-bb0104207afd tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1317 microversion: 2.1 time: 0.313040 Mar 12 20:56:54.872628 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1570/2338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:54 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:54.878864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8489974d-d41f-4eaf-aa1c-670aba8a58c7 req-4539a123-dda0-4519-860f-a09cd7c61057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85242d3f-d68b-418e-8788-978e8b8e1a57", "name": "network-vif-plugged", "status": "completed", "tag": "5b9f6f03-0f86-4781-9004-bc10c692eaba"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:54.891302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8489974d-d41f-4eaf-aa1c-670aba8a58c7 req-4539a123-dda0-4519-860f-a09cd7c61057 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:54.893136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8489974d-d41f-4eaf-aa1c-670aba8a58c7 req-4539a123-dda0-4519-860f-a09cd7c61057 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:54.911356 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8489974d-d41f-4eaf-aa1c-670aba8a58c7 req-4539a123-dda0-4519-860f-a09cd7c61057 service nova] Creating event network-vif-plugged:5b9f6f03-0f86-4781-9004-bc10c692eaba for instance 85242d3f-d68b-418e-8788-978e8b8e1a57 on nch1-master-1 Mar 12 20:56:54.919983 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8489974d-d41f-4eaf-aa1c-670aba8a58c7 req-4539a123-dda0-4519-860f-a09cd7c61057 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044596 Mar 12 20:56:54.921494 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1571/2339] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:54.945122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c49aaebf-74b7-4738-966b-1c5b43ad2859 req-402a6e7d-20d7-41b0-aa82-64baa676cca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454e487a-2c6b-4bb7-8957-03e591b61651", "name": "network-vif-deleted", "tag": "dacd774b-2b1a-4299-bb3b-af1495dfda3b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:54.966542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c49aaebf-74b7-4738-966b-1c5b43ad2859 req-402a6e7d-20d7-41b0-aa82-64baa676cca2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:54.971553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c49aaebf-74b7-4738-966b-1c5b43ad2859 req-402a6e7d-20d7-41b0-aa82-64baa676cca2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:55.005343 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c49aaebf-74b7-4738-966b-1c5b43ad2859 req-402a6e7d-20d7-41b0-aa82-64baa676cca2 service nova] Creating event network-vif-deleted:dacd774b-2b1a-4299-bb3b-af1495dfda3b for instance 454e487a-2c6b-4bb7-8957-03e591b61651 on nch2-master-1 Mar 12 20:56:55.018933 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c49aaebf-74b7-4738-966b-1c5b43ad2859 req-402a6e7d-20d7-41b0-aa82-64baa676cca2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095797 Mar 12 20:56:55.025656 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1572/2340] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:55.040587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6709afb0-24b0-465e-8348-cf1721262b28 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:55.042861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6709afb0-24b0-465e-8348-cf1721262b28 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:55.062318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6709afb0-24b0-465e-8348-cf1721262b28 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:55.063845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6709afb0-24b0-465e-8348-cf1721262b28 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:55.078846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6709afb0-24b0-465e-8348-cf1721262b28 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:55.081613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6709afb0-24b0-465e-8348-cf1721262b28 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:55.649893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6709afb0-24b0-465e-8348-cf1721262b28 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:55.660798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6709afb0-24b0-465e-8348-cf1721262b28 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:55.663601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6709afb0-24b0-465e-8348-cf1721262b28 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:55.666450 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6709afb0-24b0-465e-8348-cf1721262b28 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.636568 Mar 12 20:56:55.671418 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1573/2341] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:55 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:55.682089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c541f180-a66e-469f-a8ca-4615147c74e2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:55.682897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c541f180-a66e-469f-a8ca-4615147c74e2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: 454e487a-2c6b-4bb7-8957-03e591b61651] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:55.692036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c541f180-a66e-469f-a8ca-4615147c74e2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:55.693038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c541f180-a66e-469f-a8ca-4615147c74e2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:55.693862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c541f180-a66e-469f-a8ca-4615147c74e2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:55.694311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c541f180-a66e-469f-a8ca-4615147c74e2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:55.709991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c541f180-a66e-469f-a8ca-4615147c74e2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] HTTP exception thrown: Instance 454e487a-2c6b-4bb7-8957-03e591b61651 could not be found. Mar 12 20:56:55.710780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c541f180-a66e-469f-a8ca-4615147c74e2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Returning 404 to user: Instance 454e487a-2c6b-4bb7-8957-03e591b61651 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:56:55.711633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c541f180-a66e-469f-a8ca-4615147c74e2 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651" status: 404 len: 111 microversion: 2.1 time: 0.038874 Mar 12 20:56:55.712697 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1574/2342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:55 2022] GET /compute/v2.1/servers/454e487a-2c6b-4bb7-8957-03e591b61651 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:56:55.722062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b0b8dc9-e866-4492-a939-f3aeafe9a513 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:55.722697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3b0b8dc9-e866-4492-a939-f3aeafe9a513 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:55.728702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b0b8dc9-e866-4492-a939-f3aeafe9a513 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:55.730187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b0b8dc9-e866-4492-a939-f3aeafe9a513 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:55.731165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b0b8dc9-e866-4492-a939-f3aeafe9a513 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:55.731734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b0b8dc9-e866-4492-a939-f3aeafe9a513 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:56.013438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3b0b8dc9-e866-4492-a939-f3aeafe9a513 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:56.022423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3b0b8dc9-e866-4492-a939-f3aeafe9a513 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:56.023951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3b0b8dc9-e866-4492-a939-f3aeafe9a513 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:56.025202 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b0b8dc9-e866-4492-a939-f3aeafe9a513 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1738 microversion: 2.20 time: 0.311450 Mar 12 20:56:56.036277 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1575/2343] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:55 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1738 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:56.036277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-624c2cb9-8884-46d4-a1ed-132e038ce889 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:56.036277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-624c2cb9-8884-46d4-a1ed-132e038ce889 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:56.043957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-624c2cb9-8884-46d4-a1ed-132e038ce889 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:56.048044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-624c2cb9-8884-46d4-a1ed-132e038ce889 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:56.050435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-624c2cb9-8884-46d4-a1ed-132e038ce889 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:56.051438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-624c2cb9-8884-46d4-a1ed-132e038ce889 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:56.085656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-624c2cb9-8884-46d4-a1ed-132e038ce889 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:56:56.258001 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-624c2cb9-8884-46d4-a1ed-132e038ce889 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 204 len: 0 microversion: 2.1 time: 0.228993 Mar 12 20:56:56.267575 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1576/2344] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:56:56 2022] DELETE /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:56:56.470706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7f72aa8-5f9a-4503-a2c8-cafe1362136f tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Action: 'create', calling method: .version_select at 0x7f6e37515dc0>, body: {"keypair": {"name": "tempest-keypair-1254335039"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:56.485340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c7f72aa8-5f9a-4503-a2c8-cafe1362136f tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:56.493187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c7f72aa8-5f9a-4503-a2c8-cafe1362136f tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:56.697133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c7f72aa8-5f9a-4503-a2c8-cafe1362136f tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:56.706274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c7f72aa8-5f9a-4503-a2c8-cafe1362136f tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:56.726222 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7f72aa8-5f9a-4503-a2c8-cafe1362136f tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.457213 Mar 12 20:56:56.729968 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1577/2345] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Mar 12 20:56:56 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 459 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:56:56.739408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce502085-fe2d-475e-981c-a6c5b27b8eee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:56.741121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce502085-fe2d-475e-981c-a6c5b27b8eee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:56.754088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce502085-fe2d-475e-981c-a6c5b27b8eee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:56.754731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce502085-fe2d-475e-981c-a6c5b27b8eee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:56.755727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce502085-fe2d-475e-981c-a6c5b27b8eee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:56.756331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce502085-fe2d-475e-981c-a6c5b27b8eee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:56.950721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce502085-fe2d-475e-981c-a6c5b27b8eee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:56.963148 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce502085-fe2d-475e-981c-a6c5b27b8eee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1317 microversion: 2.1 time: 0.233751 Mar 12 20:56:56.964667 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1578/2346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:56 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:56.970333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6cd00c93-f734-4a42-a222-e91555b3010d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:56.972073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6cd00c93-f734-4a42-a222-e91555b3010d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:56.982673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cd00c93-f734-4a42-a222-e91555b3010d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:56.985290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cd00c93-f734-4a42-a222-e91555b3010d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:56.987976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cd00c93-f734-4a42-a222-e91555b3010d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:56.990354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cd00c93-f734-4a42-a222-e91555b3010d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:57.207588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6cd00c93-f734-4a42-a222-e91555b3010d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:57.220639 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6cd00c93-f734-4a42-a222-e91555b3010d tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1469 microversion: 2.1 time: 0.254398 Mar 12 20:56:57.221592 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1579/2347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:56 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1469 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:57.295918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce6161f1-e2da-457a-90a9-247adabdc320 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Action: 'create', calling method: .version_select at 0x7f6e36e07700>, body: {"keypair": {"name": "tempest-keypair-350042122"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:57.322254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ce6161f1-e2da-457a-90a9-247adabdc320 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Getting quotas for project 399f94948e49454d9b058817feac550a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:57.328165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ce6161f1-e2da-457a-90a9-247adabdc320 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Getting quotas for user cd7e5a284a5c44f7b941b18974da4e33 and project 399f94948e49454d9b058817feac550a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:57.537265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ce6161f1-e2da-457a-90a9-247adabdc320 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Getting quotas for project 399f94948e49454d9b058817feac550a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:57.543184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ce6161f1-e2da-457a-90a9-247adabdc320 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Getting quotas for user cd7e5a284a5c44f7b941b18974da4e33 and project 399f94948e49454d9b058817feac550a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:57.560015 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce6161f1-e2da-457a-90a9-247adabdc320 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.337126 Mar 12 20:56:57.560772 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1580/2348] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:56:57 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:57.571688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d1741eb-454f-459d-8db5-bd5395f2243e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:57.572536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d1741eb-454f-459d-8db5-bd5395f2243e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:57.580779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d1741eb-454f-459d-8db5-bd5395f2243e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:57.581918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d1741eb-454f-459d-8db5-bd5395f2243e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:57.582946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d1741eb-454f-459d-8db5-bd5395f2243e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:57.583515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d1741eb-454f-459d-8db5-bd5395f2243e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:57.880477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d1741eb-454f-459d-8db5-bd5395f2243e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:57.893842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d1741eb-454f-459d-8db5-bd5395f2243e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:57.895899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d1741eb-454f-459d-8db5-bd5395f2243e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:57.897541 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d1741eb-454f-459d-8db5-bd5395f2243e tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.335516 Mar 12 20:56:57.898744 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1581/2349] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:57 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:57.906635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eb746b6c-0f6c-4964-b61a-acae58929aff tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e376599d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:57.917275 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eb746b6c-0f6c-4964-b61a-acae58929aff tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1254335039" status: 200 len: 707 microversion: 2.2 time: 0.016834 Mar 12 20:56:57.918613 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1582/2350] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Mar 12 20:56:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1254335039 => generated 707 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:57.924699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7fad275-7f20-423c-a237-778eb443cb1a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:57.926331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7fad275-7f20-423c-a237-778eb443cb1a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:57.939973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7fad275-7f20-423c-a237-778eb443cb1a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:57.940358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7fad275-7f20-423c-a237-778eb443cb1a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:57.941157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7fad275-7f20-423c-a237-778eb443cb1a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:57.950170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7fad275-7f20-423c-a237-778eb443cb1a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:58.767206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c7fad275-7f20-423c-a237-778eb443cb1a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:58.782932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c7fad275-7f20-423c-a237-778eb443cb1a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:58.794678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c7fad275-7f20-423c-a237-778eb443cb1a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:58.796495 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7fad275-7f20-423c-a237-778eb443cb1a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1738 microversion: 2.20 time: 0.876493 Mar 12 20:56:58.798119 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1583/2351] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:57 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1738 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:58.804317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-73814e9a-4ec2-411a-b6d1-2324330a5264 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e36e6e0d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:58.847481 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-73814e9a-4ec2-411a-b6d1-2324330a5264 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254335039" status: 204 len: 0 microversion: 2.2 time: 0.048046 Mar 12 20:56:58.848452 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1584/2352] 10.222.0.30 () {60 vars in 1260 bytes} [Sat Mar 12 20:56:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254335039 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:56:58.869940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ae9b2c1e-564d-4b4e-84c2-5e71d5a84711 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:58.886509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ae9b2c1e-564d-4b4e-84c2-5e71d5a84711 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:58.891563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ae9b2c1e-564d-4b4e-84c2-5e71d5a84711 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Searching by: {'deleted': False, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:56:58.907960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae9b2c1e-564d-4b4e-84c2-5e71d5a84711 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:58.910462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae9b2c1e-564d-4b4e-84c2-5e71d5a84711 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:58.914172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae9b2c1e-564d-4b4e-84c2-5e71d5a84711 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:58.915024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae9b2c1e-564d-4b4e-84c2-5e71d5a84711 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:58.959510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-ae9b2c1e-564d-4b4e-84c2-5e71d5a84711 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:56:58.993375 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ae9b2c1e-564d-4b4e-84c2-5e71d5a84711 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.136246 Mar 12 20:56:58.994068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1585/2353] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 20:56:58 2022] GET /compute/v2.1/servers => generated 334 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:56:59.000849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a6f5ea1a-182a-42dd-93d7-26208908999a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:59.001665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a6f5ea1a-182a-42dd-93d7-26208908999a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:59.009689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6f5ea1a-182a-42dd-93d7-26208908999a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:59.010731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6f5ea1a-182a-42dd-93d7-26208908999a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:59.011533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6f5ea1a-182a-42dd-93d7-26208908999a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:59.012324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6f5ea1a-182a-42dd-93d7-26208908999a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:59.372256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a6f5ea1a-182a-42dd-93d7-26208908999a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:59.380957 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a6f5ea1a-182a-42dd-93d7-26208908999a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1507 microversion: 2.1 time: 0.385250 Mar 12 20:56:59.392965 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1586/2354] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:58 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:59.398096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-294df34e-1cae-4a8e-bb9c-776bed425014 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:59.398704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-294df34e-1cae-4a8e-bb9c-776bed425014 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:59.407033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-294df34e-1cae-4a8e-bb9c-776bed425014 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:59.407488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-294df34e-1cae-4a8e-bb9c-776bed425014 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:59.408276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-294df34e-1cae-4a8e-bb9c-776bed425014 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:59.408714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-294df34e-1cae-4a8e-bb9c-776bed425014 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:59.459072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-294df34e-1cae-4a8e-bb9c-776bed425014 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:59.459803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-294df34e-1cae-4a8e-bb9c-776bed425014 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:59.460317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-294df34e-1cae-4a8e-bb9c-776bed425014 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lazy-loading 'fault' on Instance uuid eb11b2e1-92f9-4b42-8158-fd559447adc2 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:56:59.510792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-294df34e-1cae-4a8e-bb9c-776bed425014 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f02e3887cad43d1a9e95f876aff1a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2df40602ee43d4a6ecbf8147e170d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:59.519988 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-294df34e-1cae-4a8e-bb9c-776bed425014 tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 200 len: 1304 microversion: 2.1 time: 0.125823 Mar 12 20:56:59.520703 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1587/2355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:56:59 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:56:59.525455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd94ff14-e1e5-4609-bb15-9a21298f2a79 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Action: 'create', calling method: .version_select at 0x7f6e3775db80>, body: {"keypair": {"name": "tempest-keypair-1628729509"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:56:59.540305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fd94ff14-e1e5-4609-bb15-9a21298f2a79 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:59.545321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fd94ff14-e1e5-4609-bb15-9a21298f2a79 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:59.681441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fd94ff14-e1e5-4609-bb15-9a21298f2a79 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:56:59.690613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fd94ff14-e1e5-4609-bb15-9a21298f2a79 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:56:59.708644 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd94ff14-e1e5-4609-bb15-9a21298f2a79 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.186928 Mar 12 20:56:59.709528 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1588/2356] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Mar 12 20:56:59 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:56:59.714553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ad05787-bc68-4e35-95ba-537afaee2e3d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:59.715412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ad05787-bc68-4e35-95ba-537afaee2e3d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:56:59.721702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ad05787-bc68-4e35-95ba-537afaee2e3d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:59.722280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ad05787-bc68-4e35-95ba-537afaee2e3d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:59.723069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ad05787-bc68-4e35-95ba-537afaee2e3d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:59.723515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ad05787-bc68-4e35-95ba-537afaee2e3d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:59.936481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ad05787-bc68-4e35-95ba-537afaee2e3d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:59.951792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ad05787-bc68-4e35-95ba-537afaee2e3d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:59.953104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ad05787-bc68-4e35-95ba-537afaee2e3d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:59.954340 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ad05787-bc68-4e35-95ba-537afaee2e3d tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.244133 Mar 12 20:56:59.955046 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1589/2357] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:56:59 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:56:59.962722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c18f98d-8d2f-4d74-a9c8-ae7a8e579174 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:56:59.967276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8c18f98d-8d2f-4d74-a9c8-ae7a8e579174 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:56:59.968640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c18f98d-8d2f-4d74-a9c8-ae7a8e579174 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Searching by: {'deleted': False, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:56:59.983591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c18f98d-8d2f-4d74-a9c8-ae7a8e579174 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:59.984300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c18f98d-8d2f-4d74-a9c8-ae7a8e579174 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:56:59.985173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c18f98d-8d2f-4d74-a9c8-ae7a8e579174 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:56:59.985681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c18f98d-8d2f-4d74-a9c8-ae7a8e579174 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.018645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-8c18f98d-8d2f-4d74-a9c8-ae7a8e579174 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:57:00.064055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8c18f98d-8d2f-4d74-a9c8-ae7a8e579174 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:00.071038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c18f98d-8d2f-4d74-a9c8-ae7a8e579174 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.071643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c18f98d-8d2f-4d74-a9c8-ae7a8e579174 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.217111 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c18f98d-8d2f-4d74-a9c8-ae7a8e579174 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.260731 Mar 12 20:57:00.218187 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1590/2358] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:56:59 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:00.235520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-da79139a-3c87-49b0-ad8c-98a7d1f81aaa req-0d6f7636-34ae-42f6-95b4-9fdbb1a1a48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27f34eb-a809-408c-9262-cec7223eee56", "name": "network-vif-unplugged", "status": "completed", "tag": "74c66795-a7e0-451e-bc40-b9db6d6b19d0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:00.244300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-da79139a-3c87-49b0-ad8c-98a7d1f81aaa req-0d6f7636-34ae-42f6-95b4-9fdbb1a1a48d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.245309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-da79139a-3c87-49b0-ad8c-98a7d1f81aaa req-0d6f7636-34ae-42f6-95b4-9fdbb1a1a48d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.258368 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-da79139a-3c87-49b0-ad8c-98a7d1f81aaa req-0d6f7636-34ae-42f6-95b4-9fdbb1a1a48d service nova] Creating event network-vif-unplugged:74c66795-a7e0-451e-bc40-b9db6d6b19d0 for instance f27f34eb-a809-408c-9262-cec7223eee56 on nch2-master-1 Mar 12 20:57:00.264917 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-da79139a-3c87-49b0-ad8c-98a7d1f81aaa req-0d6f7636-34ae-42f6-95b4-9fdbb1a1a48d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032974 Mar 12 20:57:00.269536 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1591/2359] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:00.275672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b42bea45-f1b8-456d-b95d-f50218f7d24b req-bcf9967b-9745-4f59-8936-fed1d483552e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb11b2e1-92f9-4b42-8158-fd559447adc2", "name": "network-vif-deleted", "tag": "4f8f4364-9747-4729-b9eb-834dd3e8a86a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:00.285146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b42bea45-f1b8-456d-b95d-f50218f7d24b req-bcf9967b-9745-4f59-8936-fed1d483552e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.285672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b42bea45-f1b8-456d-b95d-f50218f7d24b req-bcf9967b-9745-4f59-8936-fed1d483552e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.298449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b42bea45-f1b8-456d-b95d-f50218f7d24b req-bcf9967b-9745-4f59-8936-fed1d483552e service nova] Creating event network-vif-deleted:4f8f4364-9747-4729-b9eb-834dd3e8a86a for instance eb11b2e1-92f9-4b42-8158-fd559447adc2 on nch1-master-1 Mar 12 20:57:00.303814 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b42bea45-f1b8-456d-b95d-f50218f7d24b req-bcf9967b-9745-4f59-8936-fed1d483552e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032535 Mar 12 20:57:00.304712 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1592/2360] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:00.311223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-60e50ab5-b7ba-418e-a02e-c1653d51def4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:00.311659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-60e50ab5-b7ba-418e-a02e-c1653d51def4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:00.318829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60e50ab5-b7ba-418e-a02e-c1653d51def4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.319033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60e50ab5-b7ba-418e-a02e-c1653d51def4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.320059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60e50ab5-b7ba-418e-a02e-c1653d51def4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.320530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60e50ab5-b7ba-418e-a02e-c1653d51def4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.493145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-60e50ab5-b7ba-418e-a02e-c1653d51def4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:00.502118 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-60e50ab5-b7ba-418e-a02e-c1653d51def4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1507 microversion: 2.1 time: 0.196162 Mar 12 20:57:00.509120 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1593/2361] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:00 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:00.516334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c817dde0-106c-4597-8420-38ab31561e05 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e36e6e0d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:00.538658 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c817dde0-106c-4597-8420-38ab31561e05 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1628729509" status: 204 len: 0 microversion: 2.2 time: 0.028160 Mar 12 20:57:00.539260 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1594/2362] 10.222.0.30 () {60 vars in 1260 bytes} [Sat Mar 12 20:57:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1628729509 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:00.544376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-045b3295-91e2-457e-90f3-d22b4fc77d60 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:00.544997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-045b3295-91e2-457e-90f3-d22b4fc77d60 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:00.551090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-045b3295-91e2-457e-90f3-d22b4fc77d60 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.551551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-045b3295-91e2-457e-90f3-d22b4fc77d60 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.552332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-045b3295-91e2-457e-90f3-d22b4fc77d60 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.552779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-045b3295-91e2-457e-90f3-d22b4fc77d60 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.688262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-045b3295-91e2-457e-90f3-d22b4fc77d60 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:00.696570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-045b3295-91e2-457e-90f3-d22b4fc77d60 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:00.698123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-045b3295-91e2-457e-90f3-d22b4fc77d60 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:00.699301 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-045b3295-91e2-457e-90f3-d22b4fc77d60 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1720 microversion: 2.20 time: 0.159125 Mar 12 20:57:00.699879 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1595/2363] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:00 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:00.704247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-adfa5dbb-71cc-49cb-9621-f96e07ab0595 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:00.711933 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-adfa5dbb-71cc-49cb-9621-f96e07ab0595 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011097 Mar 12 20:57:00.712482 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1596/2364] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:57:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:00.717421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "OS-DCF:diskConfig": "AUTO"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:00.718933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:00.724614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.725076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.725877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.726326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.806152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:57:00.806695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:57:00.807443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:57:00.808424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:57:00.809035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:57:00.871659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:00.879008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.879706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.880720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.881462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.910314 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c427de99-de46-4aa5-90be-aef2f66bc834 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "POST /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57/action" status: 202 len: 1109 microversion: 2.1 time: 0.196764 Mar 12 20:57:00.911561 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1597/2365] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:57:00 2022] POST /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57/action => generated 1109 bytes in 199 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 12 20:57:00.918336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-361e644a-6524-422e-b882-737baabb554e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:00.919481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-361e644a-6524-422e-b882-737baabb554e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] [instance: eb11b2e1-92f9-4b42-8158-fd559447adc2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:00.929733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-361e644a-6524-422e-b882-737baabb554e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.930290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-361e644a-6524-422e-b882-737baabb554e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.931095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-361e644a-6524-422e-b882-737baabb554e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:00.931459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-361e644a-6524-422e-b882-737baabb554e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:00.948319 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-361e644a-6524-422e-b882-737baabb554e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] HTTP exception thrown: Instance eb11b2e1-92f9-4b42-8158-fd559447adc2 could not be found. Mar 12 20:57:00.949659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-361e644a-6524-422e-b882-737baabb554e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] Returning 404 to user: Instance eb11b2e1-92f9-4b42-8158-fd559447adc2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:57:00.950701 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-361e644a-6524-422e-b882-737baabb554e tempest-ServersAdminTestJSON-1614158363 tempest-ServersAdminTestJSON-1614158363-project] 10.222.0.30 "GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2" status: 404 len: 111 microversion: 2.1 time: 0.037872 Mar 12 20:57:00.951746 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1598/2366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:00 2022] GET /compute/v2.1/servers/eb11b2e1-92f9-4b42-8158-fd559447adc2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:57:00.957392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-292a0720-a0f1-4886-ad1c-dd8bf061f1bd tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Action: 'create', calling method: .version_select at 0x7f6e36ebc0d0>, body: {"keypair": {"name": "tempest-keypair-99853908", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:00.987439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-292a0720-a0f1-4886-ad1c-dd8bf061f1bd tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:00.993425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-292a0720-a0f1-4886-ad1c-dd8bf061f1bd tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:01.034391 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-292a0720-a0f1-4886-ad1c-dd8bf061f1bd tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 587 microversion: 2.2 time: 0.080957 Mar 12 20:57:01.041539 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1599/2367] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Mar 12 20:57:00 2022] POST /compute/v2.1/os-keypairs => generated 587 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Mar 12 20:57:01.055511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-91afd7e2-be1e-4a5e-84a4-db14a3b38303 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:01.056316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-91afd7e2-be1e-4a5e-84a4-db14a3b38303 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:01.072198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91afd7e2-be1e-4a5e-84a4-db14a3b38303 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:01.073631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91afd7e2-be1e-4a5e-84a4-db14a3b38303 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:01.077387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91afd7e2-be1e-4a5e-84a4-db14a3b38303 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:01.077883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91afd7e2-be1e-4a5e-84a4-db14a3b38303 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:01.340514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-91afd7e2-be1e-4a5e-84a4-db14a3b38303 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:01.351586 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-91afd7e2-be1e-4a5e-84a4-db14a3b38303 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1514 microversion: 2.1 time: 0.308181 Mar 12 20:57:01.352486 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1600/2368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:01 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1514 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:01.357952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7758efcd-3c8e-4312-8d1d-09a7ec1fd2c9 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:01.358775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7758efcd-3c8e-4312-8d1d-09a7ec1fd2c9 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:01.367130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7758efcd-3c8e-4312-8d1d-09a7ec1fd2c9 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:01.368619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7758efcd-3c8e-4312-8d1d-09a7ec1fd2c9 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:01.371128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7758efcd-3c8e-4312-8d1d-09a7ec1fd2c9 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:01.371767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7758efcd-3c8e-4312-8d1d-09a7ec1fd2c9 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:01.909067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7758efcd-3c8e-4312-8d1d-09a7ec1fd2c9 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:01.920833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7758efcd-3c8e-4312-8d1d-09a7ec1fd2c9 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:01.923425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7758efcd-3c8e-4312-8d1d-09a7ec1fd2c9 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:01.925629 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7758efcd-3c8e-4312-8d1d-09a7ec1fd2c9 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.570639 Mar 12 20:57:01.926684 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1601/2369] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:01 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:01.932641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7db2e52-9787-4ce6-a16f-145381e4b98d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:01.933744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7db2e52-9787-4ce6-a16f-145381e4b98d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:01.940206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7db2e52-9787-4ce6-a16f-145381e4b98d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:01.940971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7db2e52-9787-4ce6-a16f-145381e4b98d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:01.942448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7db2e52-9787-4ce6-a16f-145381e4b98d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:01.943128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7db2e52-9787-4ce6-a16f-145381e4b98d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:01.969712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7db2e52-9787-4ce6-a16f-145381e4b98d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:57:02.086563 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7db2e52-9787-4ce6-a16f-145381e4b98d tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "DELETE /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863" status: 204 len: 0 microversion: 2.1 time: 0.158206 Mar 12 20:57:02.087202 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1602/2370] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:57:01 2022] DELETE /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:02.098271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51b38d2b-858e-4163-b050-fe002fabdd95 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e36dcb8b0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:02.123487 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51b38d2b-858e-4163-b050-fe002fabdd95 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-99853908" status: 204 len: 0 microversion: 2.2 time: 0.033009 Mar 12 20:57:02.124517 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1603/2371] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Mar 12 20:57:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-99853908 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:02.132007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2ed8f0b-3b36-4de4-afb6-1be7ea3f0777 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:02.133092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2ed8f0b-3b36-4de4-afb6-1be7ea3f0777 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:02.143878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2ed8f0b-3b36-4de4-afb6-1be7ea3f0777 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:02.144338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2ed8f0b-3b36-4de4-afb6-1be7ea3f0777 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:02.145335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2ed8f0b-3b36-4de4-afb6-1be7ea3f0777 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:02.145993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2ed8f0b-3b36-4de4-afb6-1be7ea3f0777 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:02.379720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f2ed8f0b-3b36-4de4-afb6-1be7ea3f0777 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:02.390808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f2ed8f0b-3b36-4de4-afb6-1be7ea3f0777 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:02.392616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f2ed8f0b-3b36-4de4-afb6-1be7ea3f0777 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:02.393910 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2ed8f0b-3b36-4de4-afb6-1be7ea3f0777 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1663 microversion: 2.20 time: 0.268160 Mar 12 20:57:02.411097 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1604/2372] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:02 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1663 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:02.416130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9c50f54-dceb-4d20-8df4-23dcf499ad21 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:02.417355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9c50f54-dceb-4d20-8df4-23dcf499ad21 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:02.424239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9c50f54-dceb-4d20-8df4-23dcf499ad21 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:02.424762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9c50f54-dceb-4d20-8df4-23dcf499ad21 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:02.425616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9c50f54-dceb-4d20-8df4-23dcf499ad21 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:02.426210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9c50f54-dceb-4d20-8df4-23dcf499ad21 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:02.641634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f9c50f54-dceb-4d20-8df4-23dcf499ad21 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6955785aa13940b7915fbb3e14493364', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8119a0f5bb1f49beb778ccaca8b6ffc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:02.649141 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9c50f54-dceb-4d20-8df4-23dcf499ad21 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863" status: 200 len: 1701 microversion: 2.1 time: 0.236838 Mar 12 20:57:02.660784 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1605/2373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:02 2022] GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 => generated 1701 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:02.665732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-430fb532-c18f-4ccb-bbb3-5cddd08bde3c tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Action: 'create', calling method: .version_select at 0x7f6e36dcbdc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-22470341"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:02.680195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-430fb532-c18f-4ccb-bbb3-5cddd08bde3c tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:02.699341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-430fb532-c18f-4ccb-bbb3-5cddd08bde3c tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:03.147834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-430fb532-c18f-4ccb-bbb3-5cddd08bde3c tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:03.153110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-430fb532-c18f-4ccb-bbb3-5cddd08bde3c tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:03.174039 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-430fb532-c18f-4ccb-bbb3-5cddd08bde3c tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2334 microversion: 2.2 time: 0.511997 Mar 12 20:57:03.179372 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1606/2374] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Mar 12 20:57:02 2022] POST /compute/v2.1/os-keypairs => generated 2334 bytes in 518 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:03.185168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-9014697", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d997c47f-e3e4-4250-92c6-44358d54558f"}], "security_groups": [{"name": "tempest-securitygroup--1697718291"}], "key_name": "tempest-keypair-350042122", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "9ac4bf34-1155-4331-8494-1fdbe3a58339", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:03.313225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] validate_networks() for [('d997c47f-e3e4-4250-92c6-44358d54558f', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:57:04.301154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Getting quotas for project 399f94948e49454d9b058817feac550a. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:04.306622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Getting quotas for user cd7e5a284a5c44f7b941b18974da4e33 and project 399f94948e49454d9b058817feac550a. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:04.321017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:57:04.321462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:57:04.322035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:57:04.322461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:57:04.323462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:57:04.336590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:04.337122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:04.338058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:04.339149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:04.357535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Getting quotas for project 399f94948e49454d9b058817feac550a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:04.364085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Getting quotas for user cd7e5a284a5c44f7b941b18974da4e33 and project 399f94948e49454d9b058817feac550a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:04.428266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:57:04.430459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ac4bf34-1155-4331-8494-1fdbe3a58339',volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:57:04.566709 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fc56f326-536e-446c-b9dc-6412e1b5eee2 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.386376 Mar 12 20:57:04.567994 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1607/2375] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:57:03 2022] POST /compute/v2.1/servers => generated 407 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:57:04.573674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f8cb92d4-541e-4b28-b05d-b44c138506c9 req-3e0030a7-acd1-49bd-bcee-7d514ee46295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-plugged", "status": "completed", "tag": "42ca35d6-c5fd-420f-a20f-a4b2b0e1afa2"}, {"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-plugged", "status": "completed", "tag": "d9049983-2bce-4893-98d7-264a9e284203"}, {"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-plugged", "status": "completed", "tag": "053e3ca3-8105-4491-a39b-6cdfdf4aee9c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:04.582867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f8cb92d4-541e-4b28-b05d-b44c138506c9 req-3e0030a7-acd1-49bd-bcee-7d514ee46295 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:04.583560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f8cb92d4-541e-4b28-b05d-b44c138506c9 req-3e0030a7-acd1-49bd-bcee-7d514ee46295 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:04.594712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f8cb92d4-541e-4b28-b05d-b44c138506c9 req-3e0030a7-acd1-49bd-bcee-7d514ee46295 service nova] Creating event network-vif-plugged:42ca35d6-c5fd-420f-a20f-a4b2b0e1afa2 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:57:04.595217 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f8cb92d4-541e-4b28-b05d-b44c138506c9 req-3e0030a7-acd1-49bd-bcee-7d514ee46295 service nova] Creating event network-vif-plugged:d9049983-2bce-4893-98d7-264a9e284203 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:57:04.595993 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f8cb92d4-541e-4b28-b05d-b44c138506c9 req-3e0030a7-acd1-49bd-bcee-7d514ee46295 service nova] Creating event network-vif-plugged:053e3ca3-8105-4491-a39b-6cdfdf4aee9c for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:57:04.602287 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f8cb92d4-541e-4b28-b05d-b44c138506c9 req-3e0030a7-acd1-49bd-bcee-7d514ee46295 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.032728 Mar 12 20:57:04.602933 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1608/2376] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:04.608305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c58dcad-59e1-4f1e-9d87-bb4f0fed2c42 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:04.609003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c58dcad-59e1-4f1e-9d87-bb4f0fed2c42 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:04.620939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c58dcad-59e1-4f1e-9d87-bb4f0fed2c42 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:04.621592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c58dcad-59e1-4f1e-9d87-bb4f0fed2c42 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:04.622523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c58dcad-59e1-4f1e-9d87-bb4f0fed2c42 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:04.622992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c58dcad-59e1-4f1e-9d87-bb4f0fed2c42 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:04.879977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9c58dcad-59e1-4f1e-9d87-bb4f0fed2c42 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:04.889081 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c58dcad-59e1-4f1e-9d87-bb4f0fed2c42 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1514 microversion: 2.1 time: 0.284819 Mar 12 20:57:04.890872 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1609/2377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:04 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:04.896376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-719138d0-b7b5-416b-8b37-8cfbf53b894c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6353a058-d60e-41ef-a491-c72834a85958"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:04.898054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-719138d0-b7b5-416b-8b37-8cfbf53b894c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:04.905531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-719138d0-b7b5-416b-8b37-8cfbf53b894c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:04.906451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-719138d0-b7b5-416b-8b37-8cfbf53b894c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:04.907509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-719138d0-b7b5-416b-8b37-8cfbf53b894c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:04.908786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-719138d0-b7b5-416b-8b37-8cfbf53b894c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:05.275729 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-719138d0-b7b5-416b-8b37-8cfbf53b894c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "POST /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.383485 Mar 12 20:57:05.276652 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1610/2378] 10.222.0.30 () {62 vars in 1363 bytes} [Sat Mar 12 20:57:04 2022] POST /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/os-volume_attachments => generated 188 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:57:05.282245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a3afdc92-5cc3-4d87-9380-7b4b3576f683 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:05.288774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a3afdc92-5cc3-4d87-9380-7b4b3576f683 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:05.290559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3afdc92-5cc3-4d87-9380-7b4b3576f683 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:05.291110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3afdc92-5cc3-4d87-9380-7b4b3576f683 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:05.292401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3afdc92-5cc3-4d87-9380-7b4b3576f683 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:05.293105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3afdc92-5cc3-4d87-9380-7b4b3576f683 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:05.546998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a3afdc92-5cc3-4d87-9380-7b4b3576f683 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:05.556040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a3afdc92-5cc3-4d87-9380-7b4b3576f683 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:05.558165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a3afdc92-5cc3-4d87-9380-7b4b3576f683 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:05.559316 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a3afdc92-5cc3-4d87-9380-7b4b3576f683 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.281734 Mar 12 20:57:05.559891 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1611/2379] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:05 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:05.564413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2f4aa04-5a3c-4a09-a369-8d7efb720e70 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Action: 'create', calling method: .version_select at 0x7f6e366f71f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1596744801"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:05.577961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e2f4aa04-5a3c-4a09-a369-8d7efb720e70 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:05.582996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e2f4aa04-5a3c-4a09-a369-8d7efb720e70 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:05.835473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e2f4aa04-5a3c-4a09-a369-8d7efb720e70 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:05.841155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e2f4aa04-5a3c-4a09-a369-8d7efb720e70 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:05.857235 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2f4aa04-5a3c-4a09-a369-8d7efb720e70 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.2 time: 0.296313 Mar 12 20:57:05.857992 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1612/2380] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Mar 12 20:57:05 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 298 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:05.868944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12846833-7509-4071-b7e4-71319212c827 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:05.870145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-12846833-7509-4071-b7e4-71319212c827 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] [instance: 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:05.876673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12846833-7509-4071-b7e4-71319212c827 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:05.877432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12846833-7509-4071-b7e4-71319212c827 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:05.878914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12846833-7509-4071-b7e4-71319212c827 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:05.879675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12846833-7509-4071-b7e4-71319212c827 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:05.894699 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-12846833-7509-4071-b7e4-71319212c827 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] HTTP exception thrown: Instance 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 could not be found. Mar 12 20:57:05.895940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12846833-7509-4071-b7e4-71319212c827 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Returning 404 to user: Instance 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:57:05.897365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-12846833-7509-4071-b7e4-71319212c827 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863" status: 404 len: 111 microversion: 2.1 time: 0.032892 Mar 12 20:57:05.898193 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1613/2381] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:05 2022] GET /compute/v2.1/servers/51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:57:05.903848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c1cc187-8b0d-41ee-bcbf-3b1ee2921b5b tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:05.904604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c1cc187-8b0d-41ee-bcbf-3b1ee2921b5b tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] [instance: e95eb8bf-09bf-447a-bdd0-613b2a2dbabd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:05.911236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1cc187-8b0d-41ee-bcbf-3b1ee2921b5b tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:05.912054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1cc187-8b0d-41ee-bcbf-3b1ee2921b5b tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:05.913028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1cc187-8b0d-41ee-bcbf-3b1ee2921b5b tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:05.913664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1cc187-8b0d-41ee-bcbf-3b1ee2921b5b tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:05.952329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c1cc187-8b0d-41ee-bcbf-3b1ee2921b5b tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] [instance: e95eb8bf-09bf-447a-bdd0-613b2a2dbabd] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:57:06.058616 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c1cc187-8b0d-41ee-bcbf-3b1ee2921b5b tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd" status: 204 len: 0 microversion: 2.1 time: 0.158528 Mar 12 20:57:06.059299 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1614/2382] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:57:05 2022] DELETE /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:06.218528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-918764406", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:06.276746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:57:06.643015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:57:06.643638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:57:06.643974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:57:06.644498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:57:06.645055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:57:06.654764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:06.655344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:06.656315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:06.656899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:06.675203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:06.680833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:06.694678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:57:06.697039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 4979bdb6-1c95-4d29-909c-194f16259f42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:57:06.774177 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1355de29-6c3b-4446-9987-bb50186cf2fc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712968 Mar 12 20:57:06.777372 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1615/2383] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:57:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:57:06.792248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-559768f3-d684-4e70-beae-9cc25d614fa4 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:06.793083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-559768f3-d684-4e70-beae-9cc25d614fa4 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:06.800767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-559768f3-d684-4e70-beae-9cc25d614fa4 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:06.801224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-559768f3-d684-4e70-beae-9cc25d614fa4 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:06.802045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-559768f3-d684-4e70-beae-9cc25d614fa4 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:06.802722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-559768f3-d684-4e70-beae-9cc25d614fa4 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:07.323919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-559768f3-d684-4e70-beae-9cc25d614fa4 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:07.332570 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-559768f3-d684-4e70-beae-9cc25d614fa4 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1302 microversion: 2.1 time: 0.554126 Mar 12 20:57:07.333325 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1616/2384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:06 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1302 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:07.339010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2d0a7da8-230b-4419-be8f-aa4546ea077c req-beddb9ec-fc23-4ccd-aac9-d397da9a0d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b6c23e-c579-4ba8-8b9f-e64ca0f5a863", "name": "network-vif-deleted", "tag": "0c6e0f4f-faf2-424e-96ce-825ee679ee1b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:07.348984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2d0a7da8-230b-4419-be8f-aa4546ea077c req-beddb9ec-fc23-4ccd-aac9-d397da9a0d9f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:07.349912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2d0a7da8-230b-4419-be8f-aa4546ea077c req-beddb9ec-fc23-4ccd-aac9-d397da9a0d9f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:07.367406 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2d0a7da8-230b-4419-be8f-aa4546ea077c req-beddb9ec-fc23-4ccd-aac9-d397da9a0d9f service nova] Creating event network-vif-deleted:0c6e0f4f-faf2-424e-96ce-825ee679ee1b for instance 51b6c23e-c579-4ba8-8b9f-e64ca0f5a863 on nch2-master-1 Mar 12 20:57:07.373155 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2d0a7da8-230b-4419-be8f-aa4546ea077c req-beddb9ec-fc23-4ccd-aac9-d397da9a0d9f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038446 Mar 12 20:57:07.373757 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1617/2385] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:07.379103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2a0692ee-ce96-469a-b526-75991744252e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:07.379688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2a0692ee-ce96-469a-b526-75991744252e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:07.386447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a0692ee-ce96-469a-b526-75991744252e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:07.386896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a0692ee-ce96-469a-b526-75991744252e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:07.388115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a0692ee-ce96-469a-b526-75991744252e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:07.388787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a0692ee-ce96-469a-b526-75991744252e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:07.635396 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2a0692ee-ce96-469a-b526-75991744252e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/os-volume_attachments/6353a058-d60e-41ef-a491-c72834a85958" status: 202 len: 0 microversion: 2.20 time: 0.260047 Mar 12 20:57:07.636587 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1618/2386] 10.222.0.30 () {60 vars in 1456 bytes} [Sat Mar 12 20:57:07 2022] DELETE /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/os-volume_attachments/6353a058-d60e-41ef-a491-c72834a85958 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:07.641517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e95944cc-cc9f-4da3-9eb5-ad6b91efe5a2 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Action: 'create', calling method: .version_select at 0x7f6e3775d160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1271155224"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:07.656821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e95944cc-cc9f-4da3-9eb5-ad6b91efe5a2 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:07.663431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e95944cc-cc9f-4da3-9eb5-ad6b91efe5a2 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:08.094693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e95944cc-cc9f-4da3-9eb5-ad6b91efe5a2 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:08.101243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e95944cc-cc9f-4da3-9eb5-ad6b91efe5a2 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:08.124951 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e95944cc-cc9f-4da3-9eb5-ad6b91efe5a2 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.2 time: 0.487290 Mar 12 20:57:08.129793 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1619/2387] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Mar 12 20:57:07 2022] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 489 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:08.131327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ebda7f5e-4289-4a79-be72-6b896b2f18c6 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] Calling method '.version_select at 0x7f6e3775d1f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:08.151755 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ebda7f5e-4289-4a79-be72-6b896b2f18c6 tempest-ServersTestJSON-968525075 tempest-ServersTestJSON-968525075-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447556936" status: 202 len: 0 microversion: 2.1 time: 0.024870 Mar 12 20:57:08.152355 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1620/2388] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Mar 12 20:57:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447556936 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:57:08.158027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c51dfc4-ed59-43d3-94f6-0001c5d9219c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:08.158650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c51dfc4-ed59-43d3-94f6-0001c5d9219c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:08.164787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c51dfc4-ed59-43d3-94f6-0001c5d9219c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:08.165244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c51dfc4-ed59-43d3-94f6-0001c5d9219c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:08.166057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c51dfc4-ed59-43d3-94f6-0001c5d9219c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:08.166540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c51dfc4-ed59-43d3-94f6-0001c5d9219c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:08.565956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c51dfc4-ed59-43d3-94f6-0001c5d9219c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:08.581246 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c51dfc4-ed59-43d3-94f6-0001c5d9219c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1514 microversion: 2.1 time: 0.427568 Mar 12 20:57:08.591553 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1621/2389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:08 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1514 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:08.596540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec76431f-517f-4dc1-b0e1-d69d8212871e tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:08.597231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec76431f-517f-4dc1-b0e1-d69d8212871e tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] [instance: e95eb8bf-09bf-447a-bdd0-613b2a2dbabd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:08.603762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec76431f-517f-4dc1-b0e1-d69d8212871e tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:08.604333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec76431f-517f-4dc1-b0e1-d69d8212871e tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:08.605201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec76431f-517f-4dc1-b0e1-d69d8212871e tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:08.605733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec76431f-517f-4dc1-b0e1-d69d8212871e tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:08.697189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ec76431f-517f-4dc1-b0e1-d69d8212871e tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f1371d10334e049b1110c147ad80ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa582db14978426d8da203d574a93759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:08.706975 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec76431f-517f-4dc1-b0e1-d69d8212871e tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] 10.222.0.30 "GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd" status: 200 len: 1596 microversion: 2.1 time: 0.114199 Mar 12 20:57:08.707975 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1622/2390] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:08 2022] GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd => generated 1596 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:08.721137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-22337107-07ae-476c-8186-6fcd350ca13f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:08.721893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-22337107-07ae-476c-8186-6fcd350ca13f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:08.728679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22337107-07ae-476c-8186-6fcd350ca13f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:08.729448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22337107-07ae-476c-8186-6fcd350ca13f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:08.730597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22337107-07ae-476c-8186-6fcd350ca13f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:08.731043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22337107-07ae-476c-8186-6fcd350ca13f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:09.231195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-22337107-07ae-476c-8186-6fcd350ca13f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:09.261818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-22337107-07ae-476c-8186-6fcd350ca13f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:09.263357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-22337107-07ae-476c-8186-6fcd350ca13f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:09.264560 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-22337107-07ae-476c-8186-6fcd350ca13f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1878 microversion: 2.42 time: 0.549631 Mar 12 20:57:09.265362 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1623/2391] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:08 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1878 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:09.284901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-45140e14-85c3-4e81-91b2-ad173c27de38 req-15a1d438-7b75-44d5-8635-f774692aca7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-plugged", "status": "completed", "tag": "5117c932-be7d-489d-a963-7d04449bc8e8"}, {"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-plugged", "status": "completed", "tag": "0468882e-03df-441e-9049-75f95b5e3334"}, {"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-plugged", "status": "completed", "tag": "0015b623-5a0c-4812-a5b5-eb6d23db47f1"}, {"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-plugged", "status": "completed", "tag": "feb9a6ae-78a3-4d7d-91b6-857a0852a53d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:09.300042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-45140e14-85c3-4e81-91b2-ad173c27de38 req-15a1d438-7b75-44d5-8635-f774692aca7a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:09.300591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-45140e14-85c3-4e81-91b2-ad173c27de38 req-15a1d438-7b75-44d5-8635-f774692aca7a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:09.315127 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-45140e14-85c3-4e81-91b2-ad173c27de38 req-15a1d438-7b75-44d5-8635-f774692aca7a service nova] Creating event network-vif-plugged:5117c932-be7d-489d-a963-7d04449bc8e8 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:57:09.315645 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-45140e14-85c3-4e81-91b2-ad173c27de38 req-15a1d438-7b75-44d5-8635-f774692aca7a service nova] Creating event network-vif-plugged:0468882e-03df-441e-9049-75f95b5e3334 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:57:09.316151 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-45140e14-85c3-4e81-91b2-ad173c27de38 req-15a1d438-7b75-44d5-8635-f774692aca7a service nova] Creating event network-vif-plugged:0015b623-5a0c-4812-a5b5-eb6d23db47f1 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:57:09.316814 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-45140e14-85c3-4e81-91b2-ad173c27de38 req-15a1d438-7b75-44d5-8635-f774692aca7a service nova] Creating event network-vif-plugged:feb9a6ae-78a3-4d7d-91b6-857a0852a53d for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:57:09.333342 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-45140e14-85c3-4e81-91b2-ad173c27de38 req-15a1d438-7b75-44d5-8635-f774692aca7a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.052416 Mar 12 20:57:09.334630 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1624/2392] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:09.356408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c1eb3397-120e-4914-97d3-9f6f35185438 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:09.360513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c1eb3397-120e-4914-97d3-9f6f35185438 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 4979bdb6-1c95-4d29-909c-194f16259f42] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:09.378690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1eb3397-120e-4914-97d3-9f6f35185438 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:09.379155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1eb3397-120e-4914-97d3-9f6f35185438 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:09.379948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1eb3397-120e-4914-97d3-9f6f35185438 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:09.380580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1eb3397-120e-4914-97d3-9f6f35185438 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:09.777134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c1eb3397-120e-4914-97d3-9f6f35185438 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:09.786774 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c1eb3397-120e-4914-97d3-9f6f35185438 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42" status: 200 len: 1316 microversion: 2.1 time: 0.450700 Mar 12 20:57:09.787366 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1625/2393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:09 2022] GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42 => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:09.805617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4e4afeab-55f8-4989-ae8b-4c73de9b02ee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:09.817789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4e4afeab-55f8-4989-ae8b-4c73de9b02ee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:09.824431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e4afeab-55f8-4989-ae8b-4c73de9b02ee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:09.824898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e4afeab-55f8-4989-ae8b-4c73de9b02ee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:09.825688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e4afeab-55f8-4989-ae8b-4c73de9b02ee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:09.826164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e4afeab-55f8-4989-ae8b-4c73de9b02ee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:10.015099 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4e4afeab-55f8-4989-ae8b-4c73de9b02ee tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "POST /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/action" status: 202 len: 0 microversion: 2.20 time: 0.215610 Mar 12 20:57:10.015719 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1626/2394] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 20:57:09 2022] POST /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:10.036978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0556b2f8-ac21-43f2-b48d-4fbbc521a1b4 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e36dcbdc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:10.044301 ncdv-master-1 devstack@n-api.service[136302]: WARNING oslo_db.sqlalchemy.utils [None req-0556b2f8-ac21-43f2-b48d-4fbbc521a1b4 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 12 20:57:10.051866 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0556b2f8-ac21-43f2-b48d-4fbbc521a1b4 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1722 microversion: 2.2 time: 0.031150 Mar 12 20:57:10.053790 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1627/2395] 10.222.0.30 () {60 vars in 1176 bytes} [Sat Mar 12 20:57:10 2022] GET /compute/v2.1/os-keypairs => generated 1722 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:10.061240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-299fea08-87c0-4194-9522-9de6d8deea09 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:10.062238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-299fea08-87c0-4194-9522-9de6d8deea09 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:10.071112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-299fea08-87c0-4194-9522-9de6d8deea09 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:10.071808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-299fea08-87c0-4194-9522-9de6d8deea09 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:10.073523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-299fea08-87c0-4194-9522-9de6d8deea09 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:10.074197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-299fea08-87c0-4194-9522-9de6d8deea09 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:10.435330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-299fea08-87c0-4194-9522-9de6d8deea09 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:10.443466 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-299fea08-87c0-4194-9522-9de6d8deea09 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1290 microversion: 2.1 time: 0.388356 Mar 12 20:57:10.445236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1628/2396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:10 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1290 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:10.465286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-770a1a49-1921-45c9-89f9-663dc7e3fa70 req-a47d45c2-6af2-4dda-a1da-dddbc8d6cacd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c731ea4c-67c7-4d48-846f-c10bada24535", "tag": "79824ce4-3174-493e-aa2c-fe0b709c7d89"}, {"server_uuid": "e95eb8bf-09bf-447a-bdd0-613b2a2dbabd", "name": "network-vif-deleted", "tag": "4f015eca-2247-4791-a553-c370ed582acf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:10.476825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-770a1a49-1921-45c9-89f9-663dc7e3fa70 req-a47d45c2-6af2-4dda-a1da-dddbc8d6cacd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:10.482627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-770a1a49-1921-45c9-89f9-663dc7e3fa70 req-a47d45c2-6af2-4dda-a1da-dddbc8d6cacd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:10.508355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-770a1a49-1921-45c9-89f9-663dc7e3fa70 req-a47d45c2-6af2-4dda-a1da-dddbc8d6cacd service nova] Creating event network-changed:79824ce4-3174-493e-aa2c-fe0b709c7d89 for instance c731ea4c-67c7-4d48-846f-c10bada24535 on nch1-master-1 Mar 12 20:57:10.509015 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-770a1a49-1921-45c9-89f9-663dc7e3fa70 req-a47d45c2-6af2-4dda-a1da-dddbc8d6cacd service nova] Creating event network-vif-deleted:4f015eca-2247-4791-a553-c370ed582acf for instance e95eb8bf-09bf-447a-bdd0-613b2a2dbabd on nch2-master-1 Mar 12 20:57:10.522539 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-770a1a49-1921-45c9-89f9-663dc7e3fa70 req-a47d45c2-6af2-4dda-a1da-dddbc8d6cacd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.073627 Mar 12 20:57:10.527481 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1629/2397] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:10.538966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-05605f9e-de68-45c9-830e-a87627a4ccf3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:10.539795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-05605f9e-de68-45c9-830e-a87627a4ccf3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:10.549460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05605f9e-de68-45c9-830e-a87627a4ccf3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:10.552847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05605f9e-de68-45c9-830e-a87627a4ccf3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:10.554675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05605f9e-de68-45c9-830e-a87627a4ccf3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:10.559481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05605f9e-de68-45c9-830e-a87627a4ccf3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:11.194763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-05605f9e-de68-45c9-830e-a87627a4ccf3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:11.203401 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-05605f9e-de68-45c9-830e-a87627a4ccf3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1514 microversion: 2.1 time: 0.674612 Mar 12 20:57:11.204205 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1630/2398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:10 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1514 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:11.208954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-18584f38-bc91-4e1e-a578-c46cf8c842dc tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:11.209831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-18584f38-bc91-4e1e-a578-c46cf8c842dc tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] [instance: e95eb8bf-09bf-447a-bdd0-613b2a2dbabd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:11.217754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18584f38-bc91-4e1e-a578-c46cf8c842dc tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:11.218274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18584f38-bc91-4e1e-a578-c46cf8c842dc tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:11.219055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18584f38-bc91-4e1e-a578-c46cf8c842dc tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:11.219499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18584f38-bc91-4e1e-a578-c46cf8c842dc tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:11.233168 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-18584f38-bc91-4e1e-a578-c46cf8c842dc tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] HTTP exception thrown: Instance e95eb8bf-09bf-447a-bdd0-613b2a2dbabd could not be found. Mar 12 20:57:11.234997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-18584f38-bc91-4e1e-a578-c46cf8c842dc tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Returning 404 to user: Instance e95eb8bf-09bf-447a-bdd0-613b2a2dbabd could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:57:11.235844 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-18584f38-bc91-4e1e-a578-c46cf8c842dc tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] 10.222.0.30 "GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd" status: 404 len: 111 microversion: 2.1 time: 0.030554 Mar 12 20:57:11.239605 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1631/2399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:11 2022] GET /compute/v2.1/servers/e95eb8bf-09bf-447a-bdd0-613b2a2dbabd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:57:11.241666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5b895afb-dc73-4339-af03-9f3ec3ccfa19 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:11.242359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5b895afb-dc73-4339-af03-9f3ec3ccfa19 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:11.249732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b895afb-dc73-4339-af03-9f3ec3ccfa19 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:11.250385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b895afb-dc73-4339-af03-9f3ec3ccfa19 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:11.251152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b895afb-dc73-4339-af03-9f3ec3ccfa19 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:11.251606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b895afb-dc73-4339-af03-9f3ec3ccfa19 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:11.589826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5b895afb-dc73-4339-af03-9f3ec3ccfa19 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:11.599533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5b895afb-dc73-4339-af03-9f3ec3ccfa19 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:11.602278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5b895afb-dc73-4339-af03-9f3ec3ccfa19 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:11.604294 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5b895afb-dc73-4339-af03-9f3ec3ccfa19 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1671 microversion: 2.20 time: 0.365894 Mar 12 20:57:11.615519 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1632/2400] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:11 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1671 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:11.615773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f8d99632-60b9-4102-935f-6430a93a8e63 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e3622fe50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:11.635402 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f8d99632-60b9-4102-935f-6430a93a8e63 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1271155224" status: 204 len: 0 microversion: 2.2 time: 0.023762 Mar 12 20:57:11.636228 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1633/2401] 10.222.0.30 () {60 vars in 1320 bytes} [Sat Mar 12 20:57:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1271155224 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:11.641524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d7954239-e22f-43e5-a5df-48c073e765e0 req-423de799-e6f4-4459-bd30-c214141caa87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4979bdb6-1c95-4d29-909c-194f16259f42", "tag": "c5c00d27-1c29-43a3-9105-95a81311c350"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:11.649827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d7954239-e22f-43e5-a5df-48c073e765e0 req-423de799-e6f4-4459-bd30-c214141caa87 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:11.650591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d7954239-e22f-43e5-a5df-48c073e765e0 req-423de799-e6f4-4459-bd30-c214141caa87 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:11.903374 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d7954239-e22f-43e5-a5df-48c073e765e0 req-423de799-e6f4-4459-bd30-c214141caa87 service nova] Creating event network-changed:c5c00d27-1c29-43a3-9105-95a81311c350 for instance 4979bdb6-1c95-4d29-909c-194f16259f42 on nch2-master-1 Mar 12 20:57:11.908246 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d7954239-e22f-43e5-a5df-48c073e765e0 req-423de799-e6f4-4459-bd30-c214141caa87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270863 Mar 12 20:57:11.909052 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1634/2402] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:11.914139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c7f139b-03ec-4acf-8fec-4e0c473e2d8c tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:11.914843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2c7f139b-03ec-4acf-8fec-4e0c473e2d8c tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:11.921648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c7f139b-03ec-4acf-8fec-4e0c473e2d8c tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:11.922157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c7f139b-03ec-4acf-8fec-4e0c473e2d8c tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:11.923001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c7f139b-03ec-4acf-8fec-4e0c473e2d8c tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:11.923455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c7f139b-03ec-4acf-8fec-4e0c473e2d8c tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:12.341943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c7f139b-03ec-4acf-8fec-4e0c473e2d8c tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:12.354473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c7f139b-03ec-4acf-8fec-4e0c473e2d8c tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:12.356409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c7f139b-03ec-4acf-8fec-4e0c473e2d8c tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:12.357870 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c7f139b-03ec-4acf-8fec-4e0c473e2d8c tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 2833 microversion: 2.42 time: 0.447733 Mar 12 20:57:12.358849 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1635/2403] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:11 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 2833 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:12.363487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-624a2895-8613-403f-a380-1171e7b9a05d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:12.364306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-624a2895-8613-403f-a380-1171e7b9a05d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 4979bdb6-1c95-4d29-909c-194f16259f42] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:12.370609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-624a2895-8613-403f-a380-1171e7b9a05d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:12.371258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-624a2895-8613-403f-a380-1171e7b9a05d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:12.372340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-624a2895-8613-403f-a380-1171e7b9a05d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:12.372945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-624a2895-8613-403f-a380-1171e7b9a05d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:13.069947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-624a2895-8613-403f-a380-1171e7b9a05d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:13.077714 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-624a2895-8613-403f-a380-1171e7b9a05d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42" status: 200 len: 1316 microversion: 2.1 time: 0.717654 Mar 12 20:57:13.078625 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1636/2404] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:12 2022] GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42 => generated 1316 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:13.083282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b9907bdd-7078-43c7-ae33-347336f9edb6 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] Calling method '.version_select at 0x7f6e3622f4c0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:13.104316 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b9907bdd-7078-43c7-ae33-347336f9edb6 tempest-ServersTestFqdnHostnames-1653663752 tempest-ServersTestFqdnHostnames-1653663752-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165975545" status: 202 len: 0 microversion: 2.1 time: 0.024116 Mar 12 20:57:13.105295 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1637/2405] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Mar 12 20:57:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165975545 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:57:13.110657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c9637d8b-33fe-4c0a-a5c7-ce379016f8ac tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:13.111732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c9637d8b-33fe-4c0a-a5c7-ce379016f8ac tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:13.118495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9637d8b-33fe-4c0a-a5c7-ce379016f8ac tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:13.119122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9637d8b-33fe-4c0a-a5c7-ce379016f8ac tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:13.120569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9637d8b-33fe-4c0a-a5c7-ce379016f8ac tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:13.121282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9637d8b-33fe-4c0a-a5c7-ce379016f8ac tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:13.541258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c9637d8b-33fe-4c0a-a5c7-ce379016f8ac tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:13.550215 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c9637d8b-33fe-4c0a-a5c7-ce379016f8ac tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1290 microversion: 2.1 time: 0.443728 Mar 12 20:57:13.553567 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1638/2406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:13 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1290 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:13.567305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-918096b7-ac43-4c21-a716-a8b0467eb907 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e37378550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:13.604521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-918096b7-ac43-4c21-a716-a8b0467eb907 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1596744801" status: 204 len: 0 microversion: 2.2 time: 0.048212 Mar 12 20:57:13.605904 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1639/2407] 10.222.0.30 () {60 vars in 1320 bytes} [Sat Mar 12 20:57:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1596744801 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:13.612638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ae3cf5c-6ec6-4371-88af-75d4ac86ec4d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:13.613712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ae3cf5c-6ec6-4371-88af-75d4ac86ec4d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:13.626357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ae3cf5c-6ec6-4371-88af-75d4ac86ec4d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:13.627863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ae3cf5c-6ec6-4371-88af-75d4ac86ec4d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:13.629871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ae3cf5c-6ec6-4371-88af-75d4ac86ec4d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:13.630334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ae3cf5c-6ec6-4371-88af-75d4ac86ec4d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:14.199432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9ae3cf5c-6ec6-4371-88af-75d4ac86ec4d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:14.209550 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ae3cf5c-6ec6-4371-88af-75d4ac86ec4d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1514 microversion: 2.1 time: 0.601676 Mar 12 20:57:14.228190 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1640/2408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:13 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1514 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:14.233841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-866a7709-ad4a-44bf-bf1d-8b28c6a74919 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:14.234706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-866a7709-ad4a-44bf-bf1d-8b28c6a74919 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:14.241916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-866a7709-ad4a-44bf-bf1d-8b28c6a74919 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:14.247607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-866a7709-ad4a-44bf-bf1d-8b28c6a74919 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:14.248806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-866a7709-ad4a-44bf-bf1d-8b28c6a74919 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:14.249482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-866a7709-ad4a-44bf-bf1d-8b28c6a74919 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:14.538643 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-866a7709-ad4a-44bf-bf1d-8b28c6a74919 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.308699 Mar 12 20:57:14.539255 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1641/2409] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Mar 12 20:57:14 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065/os-interface => generated 1829 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:14.544055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-78a3fe97-bd8b-4189-8984-54690974f730 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:14.547545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-78a3fe97-bd8b-4189-8984-54690974f730 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:14.554434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78a3fe97-bd8b-4189-8984-54690974f730 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:14.555466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78a3fe97-bd8b-4189-8984-54690974f730 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:14.556493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78a3fe97-bd8b-4189-8984-54690974f730 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:14.557142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78a3fe97-bd8b-4189-8984-54690974f730 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:15.004346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-78a3fe97-bd8b-4189-8984-54690974f730 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:15.018068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-78a3fe97-bd8b-4189-8984-54690974f730 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:15.019901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-78a3fe97-bd8b-4189-8984-54690974f730 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:15.021359 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-78a3fe97-bd8b-4189-8984-54690974f730 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1729 microversion: 2.20 time: 0.481148 Mar 12 20:57:15.042460 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1642/2410] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:14 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1729 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:15.048539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec267645-2c56-46be-aa3b-b6b95552c075 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e37378310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:15.072103 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec267645-2c56-46be-aa3b-b6b95552c075 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-22470341" status: 204 len: 0 microversion: 2.2 time: 0.028090 Mar 12 20:57:15.074278 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1643/2411] 10.222.0.30 () {60 vars in 1314 bytes} [Sat Mar 12 20:57:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-22470341 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:15.081041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b3e69c1c-4a8f-48a5-92da-8e381e571af4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:15.082486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b3e69c1c-4a8f-48a5-92da-8e381e571af4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 4979bdb6-1c95-4d29-909c-194f16259f42] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:15.093933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3e69c1c-4a8f-48a5-92da-8e381e571af4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:15.094671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3e69c1c-4a8f-48a5-92da-8e381e571af4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:15.095848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3e69c1c-4a8f-48a5-92da-8e381e571af4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:15.096622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3e69c1c-4a8f-48a5-92da-8e381e571af4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:15.417464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b3e69c1c-4a8f-48a5-92da-8e381e571af4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:15.427374 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b3e69c1c-4a8f-48a5-92da-8e381e571af4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42" status: 200 len: 1316 microversion: 2.1 time: 0.351721 Mar 12 20:57:15.428835 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1644/2412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:15 2022] GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42 => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:15.433606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-120e7720-de29-4fb0-9aa0-393f169c5f36 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:15.434867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-120e7720-de29-4fb0-9aa0-393f169c5f36 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:15.440444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-120e7720-de29-4fb0-9aa0-393f169c5f36 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:15.441012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-120e7720-de29-4fb0-9aa0-393f169c5f36 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:15.441913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-120e7720-de29-4fb0-9aa0-393f169c5f36 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:15.442668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-120e7720-de29-4fb0-9aa0-393f169c5f36 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:16.061075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-120e7720-de29-4fb0-9aa0-393f169c5f36 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:16.085089 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-120e7720-de29-4fb0-9aa0-393f169c5f36 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1290 microversion: 2.1 time: 0.655093 Mar 12 20:57:16.086919 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1645/2413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:15 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1290 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:16.094224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2adee010-83b0-4abc-b4cc-e22a4b5b5c41 req-d490008f-1175-446a-abac-a2b0b9c1297f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f27f34eb-a809-408c-9262-cec7223eee56", "tag": "74c66795-a7e0-451e-bc40-b9db6d6b19d0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:16.104725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2adee010-83b0-4abc-b4cc-e22a4b5b5c41 req-d490008f-1175-446a-abac-a2b0b9c1297f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:16.106145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2adee010-83b0-4abc-b4cc-e22a4b5b5c41 req-d490008f-1175-446a-abac-a2b0b9c1297f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:16.127242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2adee010-83b0-4abc-b4cc-e22a4b5b5c41 req-d490008f-1175-446a-abac-a2b0b9c1297f service nova] Creating event network-changed:74c66795-a7e0-451e-bc40-b9db6d6b19d0 for instance f27f34eb-a809-408c-9262-cec7223eee56 on nch1-master-1 Mar 12 20:57:16.136547 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2adee010-83b0-4abc-b4cc-e22a4b5b5c41 req-d490008f-1175-446a-abac-a2b0b9c1297f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047653 Mar 12 20:57:16.138072 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1646/2414] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:16.143336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30cbb6c3-7164-4f54-98e7-3cc35c8529e8 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Action: 'create', calling method: .version_select at 0x7f6e36f00700>, body: {"keypair": {"name": "tempest-keypair-380482242"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:16.160944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-30cbb6c3-7164-4f54-98e7-3cc35c8529e8 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:16.170455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-30cbb6c3-7164-4f54-98e7-3cc35c8529e8 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:16.789972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-30cbb6c3-7164-4f54-98e7-3cc35c8529e8 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:16.797989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-30cbb6c3-7164-4f54-98e7-3cc35c8529e8 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:16.817879 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30cbb6c3-7164-4f54-98e7-3cc35c8529e8 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.2 time: 0.678175 Mar 12 20:57:16.819462 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1647/2415] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Mar 12 20:57:16 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 681 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:16.825480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-39518f3a-0aca-4e1e-8f7b-39421c07dce8 req-b3be82d0-6ab6-4b50-9e72-b71780219907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4979bdb6-1c95-4d29-909c-194f16259f42", "name": "network-vif-plugged", "status": "completed", "tag": "c5c00d27-1c29-43a3-9105-95a81311c350"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:16.838615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-39518f3a-0aca-4e1e-8f7b-39421c07dce8 req-b3be82d0-6ab6-4b50-9e72-b71780219907 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:16.839960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-39518f3a-0aca-4e1e-8f7b-39421c07dce8 req-b3be82d0-6ab6-4b50-9e72-b71780219907 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:16.854830 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-39518f3a-0aca-4e1e-8f7b-39421c07dce8 req-b3be82d0-6ab6-4b50-9e72-b71780219907 service nova] Creating event network-vif-plugged:c5c00d27-1c29-43a3-9105-95a81311c350 for instance 4979bdb6-1c95-4d29-909c-194f16259f42 on nch2-master-1 Mar 12 20:57:16.864706 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-39518f3a-0aca-4e1e-8f7b-39421c07dce8 req-b3be82d0-6ab6-4b50-9e72-b71780219907 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043374 Mar 12 20:57:16.866072 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1648/2416] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:16.886323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4ad99291-8922-42d3-bcd2-224dafd84730 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:16.887433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4ad99291-8922-42d3-bcd2-224dafd84730 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:16.897080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ad99291-8922-42d3-bcd2-224dafd84730 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:16.898031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ad99291-8922-42d3-bcd2-224dafd84730 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:16.899155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ad99291-8922-42d3-bcd2-224dafd84730 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:16.913440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ad99291-8922-42d3-bcd2-224dafd84730 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:18.063910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4ad99291-8922-42d3-bcd2-224dafd84730 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:18.080949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4ad99291-8922-42d3-bcd2-224dafd84730 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1514 microversion: 2.1 time: 1.213386 Mar 12 20:57:18.081651 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1649/2417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:16 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1514 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:18.097087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f6435b4e-9a84-4dc6-abaa-c3da3d8d1782 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:18.097962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f6435b4e-9a84-4dc6-abaa-c3da3d8d1782 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:18.120753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6435b4e-9a84-4dc6-abaa-c3da3d8d1782 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:18.121538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6435b4e-9a84-4dc6-abaa-c3da3d8d1782 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:18.124358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6435b4e-9a84-4dc6-abaa-c3da3d8d1782 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:18.124850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6435b4e-9a84-4dc6-abaa-c3da3d8d1782 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:18.644002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f6435b4e-9a84-4dc6-abaa-c3da3d8d1782 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:18.657726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f6435b4e-9a84-4dc6-abaa-c3da3d8d1782 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:18.659309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f6435b4e-9a84-4dc6-abaa-c3da3d8d1782 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:18.660581 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f6435b4e-9a84-4dc6-abaa-c3da3d8d1782 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1729 microversion: 2.20 time: 0.567560 Mar 12 20:57:18.661156 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1650/2418] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:18 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1729 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:18.668578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6d8bd383-ca67-44aa-80aa-39601e1c008f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:18.669311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6d8bd383-ca67-44aa-80aa-39601e1c008f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 4979bdb6-1c95-4d29-909c-194f16259f42] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:18.697416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d8bd383-ca67-44aa-80aa-39601e1c008f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:18.697929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d8bd383-ca67-44aa-80aa-39601e1c008f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:18.698726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d8bd383-ca67-44aa-80aa-39601e1c008f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:18.699746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d8bd383-ca67-44aa-80aa-39601e1c008f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:19.052225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6d8bd383-ca67-44aa-80aa-39601e1c008f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:19.060782 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6d8bd383-ca67-44aa-80aa-39601e1c008f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42" status: 200 len: 1466 microversion: 2.1 time: 0.398621 Mar 12 20:57:19.065618 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1651/2419] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:18 2022] GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42 => generated 1466 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:19.070918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-be71c4bc-4734-473c-a80b-94f3080a0ffc req-40ff4411-53f2-45f1-9946-33d35ae8c5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "tag": "053e3ca3-8105-4491-a39b-6cdfdf4aee9c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:19.092931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-be71c4bc-4734-473c-a80b-94f3080a0ffc req-40ff4411-53f2-45f1-9946-33d35ae8c5f4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:19.099839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-be71c4bc-4734-473c-a80b-94f3080a0ffc req-40ff4411-53f2-45f1-9946-33d35ae8c5f4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:19.124898 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-be71c4bc-4734-473c-a80b-94f3080a0ffc req-40ff4411-53f2-45f1-9946-33d35ae8c5f4 service nova] Creating event network-changed:053e3ca3-8105-4491-a39b-6cdfdf4aee9c for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 20:57:19.139702 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-be71c4bc-4734-473c-a80b-94f3080a0ffc req-40ff4411-53f2-45f1-9946-33d35ae8c5f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072654 Mar 12 20:57:19.140481 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1652/2420] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:19.145887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d74806b4-469b-4814-a9b7-73c2bdf972ab tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e36d5be50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:19.153506 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d74806b4-469b-4814-a9b7-73c2bdf972ab tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-380482242" status: 200 len: 706 microversion: 2.2 time: 0.011707 Mar 12 20:57:19.154476 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1653/2421] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Mar 12 20:57:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-380482242 => generated 706 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:19.159305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20d2ea5d-1d99-4200-9f4e-900aba90ba67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:19.160318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20d2ea5d-1d99-4200-9f4e-900aba90ba67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:19.167389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20d2ea5d-1d99-4200-9f4e-900aba90ba67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:19.168420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20d2ea5d-1d99-4200-9f4e-900aba90ba67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:19.169388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20d2ea5d-1d99-4200-9f4e-900aba90ba67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:19.170019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20d2ea5d-1d99-4200-9f4e-900aba90ba67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:19.493902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-20d2ea5d-1d99-4200-9f4e-900aba90ba67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:19.503606 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20d2ea5d-1d99-4200-9f4e-900aba90ba67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1290 microversion: 2.1 time: 0.347826 Mar 12 20:57:19.505834 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1654/2422] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:19 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1290 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:19.511366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d9b5f006-8e57-4d09-984c-5c616f951f7e req-1a2c59fb-f8e8-4737-bf7b-10fd435dee82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c731ea4c-67c7-4d48-846f-c10bada24535", "name": "network-vif-plugged", "status": "completed", "tag": "79824ce4-3174-493e-aa2c-fe0b709c7d89"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:19.520347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d9b5f006-8e57-4d09-984c-5c616f951f7e req-1a2c59fb-f8e8-4737-bf7b-10fd435dee82 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:19.521077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d9b5f006-8e57-4d09-984c-5c616f951f7e req-1a2c59fb-f8e8-4737-bf7b-10fd435dee82 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:19.533100 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d9b5f006-8e57-4d09-984c-5c616f951f7e req-1a2c59fb-f8e8-4737-bf7b-10fd435dee82 service nova] Creating event network-vif-plugged:79824ce4-3174-493e-aa2c-fe0b709c7d89 for instance c731ea4c-67c7-4d48-846f-c10bada24535 on nch1-master-1 Mar 12 20:57:19.539036 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d9b5f006-8e57-4d09-984c-5c616f951f7e req-1a2c59fb-f8e8-4737-bf7b-10fd435dee82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031792 Mar 12 20:57:19.544538 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1655/2423] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:19.904708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-42bdf557-a18d-40fb-af7a-4dd5fb34030e tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:19.907475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-42bdf557-a18d-40fb-af7a-4dd5fb34030e tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] [instance: 4979bdb6-1c95-4d29-909c-194f16259f42] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:19.918305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42bdf557-a18d-40fb-af7a-4dd5fb34030e tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:19.919699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42bdf557-a18d-40fb-af7a-4dd5fb34030e tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:19.920668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42bdf557-a18d-40fb-af7a-4dd5fb34030e tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:19.921738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42bdf557-a18d-40fb-af7a-4dd5fb34030e tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:20.374107 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-42bdf557-a18d-40fb-af7a-4dd5fb34030e tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42" status: 200 len: 1617 microversion: 2.1 time: 0.825826 Mar 12 20:57:20.388889 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1656/2424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:19 2022] GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42 => generated 1617 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:20.406122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ced0313d-d702-4a46-94c0-d1be8f02b817 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:20.409353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ced0313d-d702-4a46-94c0-d1be8f02b817 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:20.444095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ced0313d-d702-4a46-94c0-d1be8f02b817 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:20.446067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ced0313d-d702-4a46-94c0-d1be8f02b817 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:20.448033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ced0313d-d702-4a46-94c0-d1be8f02b817 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:20.448663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ced0313d-d702-4a46-94c0-d1be8f02b817 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:20.777019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ced0313d-d702-4a46-94c0-d1be8f02b817 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:20.796139 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ced0313d-d702-4a46-94c0-d1be8f02b817 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1514 microversion: 2.1 time: 0.402440 Mar 12 20:57:20.797192 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1657/2425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:20 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1514 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:20.805439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f8ac6cb3-a5a1-4d94-9e23-e9de5520af3e tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e36f9b0d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:20.809861 ncdv-master-1 devstack@n-api.service[136302]: WARNING oslo_db.sqlalchemy.utils [None req-f8ac6cb3-a5a1-4d94-9e23-e9de5520af3e tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 12 20:57:20.820975 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f8ac6cb3-a5a1-4d94-9e23-e9de5520af3e tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 563 microversion: 2.2 time: 0.022323 Mar 12 20:57:20.828061 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1658/2426] 10.222.0.30 () {60 vars in 1176 bytes} [Sat Mar 12 20:57:20 2022] GET /compute/v2.1/os-keypairs => generated 563 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:20.828781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4eb28f5c-6adf-4e4d-a33f-67250e3ec05d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:20.829631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4eb28f5c-6adf-4e4d-a33f-67250e3ec05d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:20.840480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eb28f5c-6adf-4e4d-a33f-67250e3ec05d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:20.840699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eb28f5c-6adf-4e4d-a33f-67250e3ec05d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:20.841894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eb28f5c-6adf-4e4d-a33f-67250e3ec05d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:20.842758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eb28f5c-6adf-4e4d-a33f-67250e3ec05d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:21.180780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4eb28f5c-6adf-4e4d-a33f-67250e3ec05d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:21.207719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4eb28f5c-6adf-4e4d-a33f-67250e3ec05d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:21.215057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4eb28f5c-6adf-4e4d-a33f-67250e3ec05d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:21.216428 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4eb28f5c-6adf-4e4d-a33f-67250e3ec05d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1729 microversion: 2.20 time: 0.391454 Mar 12 20:57:21.217747 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1659/2427] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:20 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1729 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:21.226021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a4ee075a-39df-49ed-8d75-10fd1dd8c3dc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Action: 'create', calling method: .version_select at 0x7f6e366f7d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-337695105", "policies": ["affinity"]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:21.263116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a4ee075a-39df-49ed-8d75-10fd1dd8c3dc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:21.281180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a4ee075a-39df-49ed-8d75-10fd1dd8c3dc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:21.460722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a4ee075a-39df-49ed-8d75-10fd1dd8c3dc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:21.482053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a4ee075a-39df-49ed-8d75-10fd1dd8c3dc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:21.532124 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a4ee075a-39df-49ed-8d75-10fd1dd8c3dc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.312907 Mar 12 20:57:21.536525 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1660/2428] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Mar 12 20:57:21 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:21.575019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-32582836-b436-4372-b050-fb70234816a6 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:21.575874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-32582836-b436-4372-b050-fb70234816a6 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:21.600576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32582836-b436-4372-b050-fb70234816a6 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:21.604409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32582836-b436-4372-b050-fb70234816a6 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:21.605750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32582836-b436-4372-b050-fb70234816a6 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:21.606472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32582836-b436-4372-b050-fb70234816a6 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:22.158184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-32582836-b436-4372-b050-fb70234816a6 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:22.166644 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-32582836-b436-4372-b050-fb70234816a6 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1290 microversion: 2.1 time: 0.602982 Mar 12 20:57:22.167241 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1661/2429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:21 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1290 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:22.171789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-91e6a376-562e-4630-ad23-3b9540eae46d tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e36dcb670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:22.233037 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-91e6a376-562e-4630-ad23-3b9540eae46d tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-380482242" status: 204 len: 0 microversion: 2.2 time: 0.054511 Mar 12 20:57:22.233897 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1662/2430] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Mar 12 20:57:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-380482242 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:22.247553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-850407628", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0d258fbc-c769-4150-a109-d47a8ca6d4fa"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:22.338700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:57:22.735143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:57:22.737010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:57:22.737915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:57:22.738559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:57:22.739758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:57:22.783311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:22.784721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:22.787573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:22.790230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:22.833366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:22.843082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:22.931334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Going to run 2 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:57:22.942737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: a861691b-98dc-49c0-9a22-ecc3a4d67534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:57:23.092318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:23.102939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:23.220781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:23.233627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:23.266264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: f5af603d-9610-4c9e-bf45-9df1de0504e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=a861691b-98dc-49c0-9a22-ecc3a4d67534,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:57:23.378782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:23.395756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:23.473643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:23.487182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:23.559652 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-031605e5-ee00-48be-9d28-98b81e380699 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.324327 Mar 12 20:57:23.563547 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1663/2431] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:57:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 1329 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Mar 12 20:57:23.573856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a16459ee-bb52-4591-b750-e8466d2b0be0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:23.574523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a16459ee-bb52-4591-b750-e8466d2b0be0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:23.590775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a16459ee-bb52-4591-b750-e8466d2b0be0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:23.591965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a16459ee-bb52-4591-b750-e8466d2b0be0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:23.594131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a16459ee-bb52-4591-b750-e8466d2b0be0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:23.596702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a16459ee-bb52-4591-b750-e8466d2b0be0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:23.957910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a16459ee-bb52-4591-b750-e8466d2b0be0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:23.966611 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a16459ee-bb52-4591-b750-e8466d2b0be0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1514 microversion: 2.1 time: 0.401970 Mar 12 20:57:23.969463 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1664/2432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:23 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1514 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:23.991559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bbad8634-df33-4c3a-82c8-be7f42325efb tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:23.992468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bbad8634-df33-4c3a-82c8-be7f42325efb tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:23.998883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbad8634-df33-4c3a-82c8-be7f42325efb tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:23.999609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbad8634-df33-4c3a-82c8-be7f42325efb tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:24.000571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbad8634-df33-4c3a-82c8-be7f42325efb tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:24.003089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbad8634-df33-4c3a-82c8-be7f42325efb tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:24.225331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bbad8634-df33-4c3a-82c8-be7f42325efb tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:24.236700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bbad8634-df33-4c3a-82c8-be7f42325efb tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:24.239921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bbad8634-df33-4c3a-82c8-be7f42325efb tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:24.243045 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bbad8634-df33-4c3a-82c8-be7f42325efb tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1729 microversion: 2.20 time: 0.267431 Mar 12 20:57:24.254304 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1665/2433] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:23 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1729 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:24.260094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f66734d1-deac-4cb3-bd82-3df4f04c4598 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Action: 'create', calling method: .version_select at 0x7f6e36f9b550>, body: {"keypair": {"name": "tempest-keypair-1289083645", "type": "x509"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:24.279119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f66734d1-deac-4cb3-bd82-3df4f04c4598 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:24.286046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f66734d1-deac-4cb3-bd82-3df4f04c4598 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:24.318635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.processutils [None req-f66734d1-deac-4cb3-bd82-3df4f04c4598 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpv_1dn3yq/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpv_1dn3yq/temp.key -subj /CN=e148dd693a8e4ba9a50d797ab6074abe -extensions v3_req_client {{(pid=136302) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:57:24.767425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.processutils [None req-f66734d1-deac-4cb3-bd82-3df4f04c4598 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpv_1dn3yq/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpv_1dn3yq/temp.key -subj /CN=e148dd693a8e4ba9a50d797ab6074abe -extensions v3_req_client" returned: 0 in 0.448s {{(pid=136302) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:57:24.769214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.processutils [None req-f66734d1-deac-4cb3-bd82-3df4f04c4598 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpv_1dn3yq/temp.key -password pass: {{(pid=136302) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 12 20:57:24.818240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.processutils [None req-f66734d1-deac-4cb3-bd82-3df4f04c4598 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpv_1dn3yq/temp.key -password pass:" returned: 0 in 0.048s {{(pid=136302) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 12 20:57:24.927035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f66734d1-deac-4cb3-bd82-3df4f04c4598 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:24.943298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f66734d1-deac-4cb3-bd82-3df4f04c4598 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Getting quotas for user e148dd693a8e4ba9a50d797ab6074abe and project 9346a21cb7264bfba21cce2500015b0a. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:24.990009 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f66734d1-deac-4cb3-bd82-3df4f04c4598 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.733512 Mar 12 20:57:24.993649 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1666/2434] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Mar 12 20:57:24 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 737 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:25.397041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1898393521", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "5539f6d8-de40-4b77-b815-97c46c328352"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:25.464466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] validate_networks() for [('5539f6d8-de40-4b77-b815-97c46c328352', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:57:26.325217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:57:26.327786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:57:26.328546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:57:26.329165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:57:26.330072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:57:26.345147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:26.345734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:26.348734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:26.349267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:26.394479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Getting quotas for project 8f20d256a7184343ac31ebd4d701ce83. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:26.408275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Getting quotas for user b7638f3b550c4fb2a85186af43b4ccf6 and project 8f20d256a7184343ac31ebd4d701ce83. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:26.424946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:57:26.427468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:57:26.499980 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c442532-f1c4-4982-85df-9a59e4d8f815 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.505019 Mar 12 20:57:26.506095 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1667/2435] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:57:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:57:26.511829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6cd25b8f-a2c6-47b2-b561-a011b3f7a71a tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:26.512704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6cd25b8f-a2c6-47b2-b561-a011b3f7a71a tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:26.524303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cd25b8f-a2c6-47b2-b561-a011b3f7a71a tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:26.527713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cd25b8f-a2c6-47b2-b561-a011b3f7a71a tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:26.530758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cd25b8f-a2c6-47b2-b561-a011b3f7a71a tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:26.530942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cd25b8f-a2c6-47b2-b561-a011b3f7a71a tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:26.702739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6cd25b8f-a2c6-47b2-b561-a011b3f7a71a tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:26.711655 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6cd25b8f-a2c6-47b2-b561-a011b3f7a71a tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1290 microversion: 2.1 time: 0.204196 Mar 12 20:57:26.712545 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1668/2436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:26 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1290 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:26.722529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b45fe002-d64b-436b-b038-1e19e92f3f4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:26.726101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b45fe002-d64b-436b-b038-1e19e92f3f4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:26.726932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b45fe002-d64b-436b-b038-1e19e92f3f4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Searching by: {'deleted': False, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:57:26.733009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b45fe002-d64b-436b-b038-1e19e92f3f4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:26.733481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b45fe002-d64b-436b-b038-1e19e92f3f4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:26.734360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b45fe002-d64b-436b-b038-1e19e92f3f4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:26.734806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b45fe002-d64b-436b-b038-1e19e92f3f4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:26.762744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-b45fe002-d64b-436b-b038-1e19e92f3f4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:57:26.792777 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b45fe002-d64b-436b-b038-1e19e92f3f4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.077926 Mar 12 20:57:26.793637 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1669/2437] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 20:57:26 2022] GET /compute/v2.1/servers => generated 1001 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:26.800513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04e68a41-0c44-4715-b87f-36c428c78182 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:26.801147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04e68a41-0c44-4715-b87f-36c428c78182 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:26.808140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04e68a41-0c44-4715-b87f-36c428c78182 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:26.808384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04e68a41-0c44-4715-b87f-36c428c78182 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:26.809573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04e68a41-0c44-4715-b87f-36c428c78182 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:26.809573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04e68a41-0c44-4715-b87f-36c428c78182 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:27.011912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04e68a41-0c44-4715-b87f-36c428c78182 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:27.020427 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04e68a41-0c44-4715-b87f-36c428c78182 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1514 microversion: 2.1 time: 0.224928 Mar 12 20:57:27.021011 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1670/2438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:26 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:27.030697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be2f4531-d806-4d5a-b1a0-b9f3e5c25200 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e3622f9d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:27.047342 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be2f4531-d806-4d5a-b1a0-b9f3e5c25200 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1289083645" status: 200 len: 1534 microversion: 2.2 time: 0.022192 Mar 12 20:57:27.047933 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1671/2439] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Mar 12 20:57:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1289083645 => generated 1534 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:27.091320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5438afc0-ab4b-4915-b08e-ae52f221e2e5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:27.092800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5438afc0-ab4b-4915-b08e-ae52f221e2e5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:27.104768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5438afc0-ab4b-4915-b08e-ae52f221e2e5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:27.105794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5438afc0-ab4b-4915-b08e-ae52f221e2e5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:27.108651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5438afc0-ab4b-4915-b08e-ae52f221e2e5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:27.109383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5438afc0-ab4b-4915-b08e-ae52f221e2e5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:27.477238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5438afc0-ab4b-4915-b08e-ae52f221e2e5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:27.485679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5438afc0-ab4b-4915-b08e-ae52f221e2e5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:27.487236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5438afc0-ab4b-4915-b08e-ae52f221e2e5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:27.488469 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5438afc0-ab4b-4915-b08e-ae52f221e2e5 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1729 microversion: 2.20 time: 0.437621 Mar 12 20:57:27.489050 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1672/2440] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:27 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1729 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:27.493430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-652f0110-613c-4930-a915-26051f68fc0b tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:27.494654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-652f0110-613c-4930-a915-26051f68fc0b tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:27.500423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-652f0110-613c-4930-a915-26051f68fc0b tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:27.501117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-652f0110-613c-4930-a915-26051f68fc0b tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:27.501923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-652f0110-613c-4930-a915-26051f68fc0b tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:27.502372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-652f0110-613c-4930-a915-26051f68fc0b tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:27.633158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-652f0110-613c-4930-a915-26051f68fc0b tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7638f3b550c4fb2a85186af43b4ccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20d256a7184343ac31ebd4d701ce83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:27.655599 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-652f0110-613c-4930-a915-26051f68fc0b tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 200 len: 1229 microversion: 2.1 time: 0.165288 Mar 12 20:57:27.674068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1673/2441] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:27 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 1229 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:27.687755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-83dee332-e77f-4b8a-88f6-462a9ef84bc5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:27.689512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-83dee332-e77f-4b8a-88f6-462a9ef84bc5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: a861691b-98dc-49c0-9a22-ecc3a4d67534] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:27.722367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83dee332-e77f-4b8a-88f6-462a9ef84bc5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:27.725315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83dee332-e77f-4b8a-88f6-462a9ef84bc5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:27.726646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83dee332-e77f-4b8a-88f6-462a9ef84bc5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:27.731378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83dee332-e77f-4b8a-88f6-462a9ef84bc5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:28.131161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-83dee332-e77f-4b8a-88f6-462a9ef84bc5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:28.146486 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-83dee332-e77f-4b8a-88f6-462a9ef84bc5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534" status: 200 len: 1318 microversion: 2.1 time: 0.466772 Mar 12 20:57:28.147199 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1674/2442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:27 2022] GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534 => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:28.164293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c57ec690-c31f-413a-8b9f-3d85ad23aec0 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e36f9ba60>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:28.169545 ncdv-master-1 devstack@n-api.service[136302]: WARNING oslo_db.sqlalchemy.utils [None req-c57ec690-c31f-413a-8b9f-3d85ad23aec0 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 12 20:57:28.175438 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c57ec690-c31f-413a-8b9f-3d85ad23aec0 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.017749 Mar 12 20:57:28.176038 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1675/2443] 10.222.0.30 () {60 vars in 1176 bytes} [Sat Mar 12 20:57:28 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:28.181919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-168173ba-f3e8-4c97-8829-1b521ffcce5b tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:28.182771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-168173ba-f3e8-4c97-8829-1b521ffcce5b tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:28.189208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-168173ba-f3e8-4c97-8829-1b521ffcce5b tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:28.189675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-168173ba-f3e8-4c97-8829-1b521ffcce5b tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:28.190740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-168173ba-f3e8-4c97-8829-1b521ffcce5b tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:28.191416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-168173ba-f3e8-4c97-8829-1b521ffcce5b tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:28.464573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-168173ba-f3e8-4c97-8829-1b521ffcce5b tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:28.473645 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-168173ba-f3e8-4c97-8829-1b521ffcce5b tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1290 microversion: 2.1 time: 0.296239 Mar 12 20:57:28.483531 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1676/2444] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:28 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1290 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:28.489899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9676bcd-5b4d-4ade-91d6-62062f7bbff8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:28.490814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9676bcd-5b4d-4ade-91d6-62062f7bbff8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:28.497731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9676bcd-5b4d-4ade-91d6-62062f7bbff8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:28.498238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9676bcd-5b4d-4ade-91d6-62062f7bbff8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:28.499017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9676bcd-5b4d-4ade-91d6-62062f7bbff8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:28.499454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9676bcd-5b4d-4ade-91d6-62062f7bbff8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:28.756075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9676bcd-5b4d-4ade-91d6-62062f7bbff8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:28.763987 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9676bcd-5b4d-4ade-91d6-62062f7bbff8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1514 microversion: 2.1 time: 0.278605 Mar 12 20:57:28.764844 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1677/2445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:28 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:28.770598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-cdb54b81-1d9c-498b-8c5d-2a6723cdae8e req-21f475ec-2168-4793-9b36-748a5182df74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a861691b-98dc-49c0-9a22-ecc3a4d67534", "tag": "d454d31e-14e7-42aa-82d6-43badb4a25f3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:28.779335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cdb54b81-1d9c-498b-8c5d-2a6723cdae8e req-21f475ec-2168-4793-9b36-748a5182df74 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:28.779824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cdb54b81-1d9c-498b-8c5d-2a6723cdae8e req-21f475ec-2168-4793-9b36-748a5182df74 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:28.791373 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-cdb54b81-1d9c-498b-8c5d-2a6723cdae8e req-21f475ec-2168-4793-9b36-748a5182df74 service nova] Creating event network-changed:d454d31e-14e7-42aa-82d6-43badb4a25f3 for instance a861691b-98dc-49c0-9a22-ecc3a4d67534 on nch2-master-1 Mar 12 20:57:28.796401 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-cdb54b81-1d9c-498b-8c5d-2a6723cdae8e req-21f475ec-2168-4793-9b36-748a5182df74 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030110 Mar 12 20:57:28.797014 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1678/2446] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:28.963833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-863641199", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "84a692de-7cf4-4c9e-9c30-c242eccb991c"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:29.026160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] validate_networks() for [('84a692de-7cf4-4c9e-9c30-c242eccb991c', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:57:29.810140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:57:29.810723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:57:29.811040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:57:29.811483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:57:29.811904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:57:29.821792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:29.822827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:29.823664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:29.824130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:29.841217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Getting quotas for project 8ff28f8551f948d881c281fadc6cf37b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:29.846401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Getting quotas for user 92756542c3fd441981da69834af9bc0b and project 8ff28f8551f948d881c281fadc6cf37b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:29.858327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:57:29.860848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:57:29.906490 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3a25bd77-16d4-4036-b7c2-c50291830b0a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.108001 Mar 12 20:57:29.907340 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1679/2447] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:57:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 20:57:29.912076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e05f277-4635-4aa8-81e2-20ad2351f4b3 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] Calling method '.version_select at 0x7f6e36f9bb80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:29.930545 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e05f277-4635-4aa8-81e2-20ad2351f4b3 tempest-KeyPairsV22TestJSON-1887233264 tempest-KeyPairsV22TestJSON-1887233264-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289083645" status: 204 len: 0 microversion: 2.2 time: 0.021938 Mar 12 20:57:29.931901 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1680/2448] 10.222.0.30 () {60 vars in 1260 bytes} [Sat Mar 12 20:57:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289083645 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:29.936473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3f808596-9781-4b92-9ba3-578b0fe14e85 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:29.937088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3f808596-9781-4b92-9ba3-578b0fe14e85 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:29.943830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f808596-9781-4b92-9ba3-578b0fe14e85 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:29.944292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f808596-9781-4b92-9ba3-578b0fe14e85 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:29.945070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f808596-9781-4b92-9ba3-578b0fe14e85 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:29.945516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f808596-9781-4b92-9ba3-578b0fe14e85 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:30.114310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3f808596-9781-4b92-9ba3-578b0fe14e85 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:30.122737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3f808596-9781-4b92-9ba3-578b0fe14e85 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:30.124457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3f808596-9781-4b92-9ba3-578b0fe14e85 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:30.125983 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3f808596-9781-4b92-9ba3-578b0fe14e85 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1729 microversion: 2.20 time: 0.193212 Mar 12 20:57:30.137099 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1681/2449] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:29 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:30.138644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ac57433a-ccc2-4886-b295-b54dbc59b675 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:30.139622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ac57433a-ccc2-4886-b295-b54dbc59b675 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:30.147396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac57433a-ccc2-4886-b295-b54dbc59b675 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:30.147857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac57433a-ccc2-4886-b295-b54dbc59b675 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:30.148730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac57433a-ccc2-4886-b295-b54dbc59b675 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:30.149264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac57433a-ccc2-4886-b295-b54dbc59b675 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:30.231857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ac57433a-ccc2-4886-b295-b54dbc59b675 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7638f3b550c4fb2a85186af43b4ccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20d256a7184343ac31ebd4d701ce83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:30.243463 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ac57433a-ccc2-4886-b295-b54dbc59b675 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 200 len: 1229 microversion: 2.1 time: 0.112086 Mar 12 20:57:30.245380 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1682/2450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:30 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 1229 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:30.250283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-55f7f0bd-4bd6-45e3-b8d0-980c5ecd5d6c req-8c6a913d-3702-4505-8cfc-eae2efaebb6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5af603d-9610-4c9e-bf45-9df1de0504e1", "tag": "cdf7109b-2b24-4768-9c41-d98c340ad31a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:30.259412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-55f7f0bd-4bd6-45e3-b8d0-980c5ecd5d6c req-8c6a913d-3702-4505-8cfc-eae2efaebb6d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:30.259999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-55f7f0bd-4bd6-45e3-b8d0-980c5ecd5d6c req-8c6a913d-3702-4505-8cfc-eae2efaebb6d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:30.282931 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-55f7f0bd-4bd6-45e3-b8d0-980c5ecd5d6c req-8c6a913d-3702-4505-8cfc-eae2efaebb6d service nova] Creating event network-changed:cdf7109b-2b24-4768-9c41-d98c340ad31a for instance f5af603d-9610-4c9e-bf45-9df1de0504e1 on nch2-master-1 Mar 12 20:57:30.301264 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-55f7f0bd-4bd6-45e3-b8d0-980c5ecd5d6c req-8c6a913d-3702-4505-8cfc-eae2efaebb6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054202 Mar 12 20:57:30.303953 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1683/2451] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:30.326902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e573b586-71c2-4904-8725-b1846abe3f9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:30.327691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e573b586-71c2-4904-8725-b1846abe3f9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: a861691b-98dc-49c0-9a22-ecc3a4d67534] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:30.341894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e573b586-71c2-4904-8725-b1846abe3f9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:30.342351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e573b586-71c2-4904-8725-b1846abe3f9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:30.343268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e573b586-71c2-4904-8725-b1846abe3f9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:30.343785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e573b586-71c2-4904-8725-b1846abe3f9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:30.753298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e573b586-71c2-4904-8725-b1846abe3f9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:30.761689 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e573b586-71c2-4904-8725-b1846abe3f9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534" status: 200 len: 1318 microversion: 2.1 time: 0.454199 Mar 12 20:57:30.772080 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1684/2452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:30 2022] GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:30.777752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5fe422bf-a065-4aec-9011-555222492b59 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:30.778855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5fe422bf-a065-4aec-9011-555222492b59 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:30.785512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fe422bf-a065-4aec-9011-555222492b59 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:30.786660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fe422bf-a065-4aec-9011-555222492b59 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:30.788228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fe422bf-a065-4aec-9011-555222492b59 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:30.789355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fe422bf-a065-4aec-9011-555222492b59 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:31.190672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5fe422bf-a065-4aec-9011-555222492b59 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:31.203737 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5fe422bf-a065-4aec-9011-555222492b59 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1290 microversion: 2.1 time: 0.430181 Mar 12 20:57:31.204466 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1685/2453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:30 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1290 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:31.211132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8381a16d-5ea8-48fd-ae77-e27605ead3b3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:31.211745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8381a16d-5ea8-48fd-ae77-e27605ead3b3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:31.227479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8381a16d-5ea8-48fd-ae77-e27605ead3b3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:31.227981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8381a16d-5ea8-48fd-ae77-e27605ead3b3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:31.229113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8381a16d-5ea8-48fd-ae77-e27605ead3b3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:31.229614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8381a16d-5ea8-48fd-ae77-e27605ead3b3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:31.632476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8381a16d-5ea8-48fd-ae77-e27605ead3b3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:31.642937 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8381a16d-5ea8-48fd-ae77-e27605ead3b3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1514 microversion: 2.1 time: 0.437432 Mar 12 20:57:31.644109 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1686/2454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:31 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1514 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:31.650067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cc88f071-3e27-4793-93a9-937ea9da64cc tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:31.651119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc88f071-3e27-4793-93a9-937ea9da64cc tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:31.661543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc88f071-3e27-4793-93a9-937ea9da64cc tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:31.662061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc88f071-3e27-4793-93a9-937ea9da64cc tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:31.663015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc88f071-3e27-4793-93a9-937ea9da64cc tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:31.668212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc88f071-3e27-4793-93a9-937ea9da64cc tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:31.774076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cc88f071-3e27-4793-93a9-937ea9da64cc tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:31.791159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cc88f071-3e27-4793-93a9-937ea9da64cc tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:31.794762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cc88f071-3e27-4793-93a9-937ea9da64cc tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:31.796277 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cc88f071-3e27-4793-93a9-937ea9da64cc tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 200 len: 1316 microversion: 2.21 time: 0.150734 Mar 12 20:57:31.797100 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1687/2455] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:31 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:31.812891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d3e1686-c08f-4bd6-b6f7-db1fb91f949d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:31.813595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d3e1686-c08f-4bd6-b6f7-db1fb91f949d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:31.820189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d3e1686-c08f-4bd6-b6f7-db1fb91f949d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:31.820951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d3e1686-c08f-4bd6-b6f7-db1fb91f949d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:31.822042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d3e1686-c08f-4bd6-b6f7-db1fb91f949d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:31.822660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d3e1686-c08f-4bd6-b6f7-db1fb91f949d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:32.127940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d3e1686-c08f-4bd6-b6f7-db1fb91f949d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:32.140636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d3e1686-c08f-4bd6-b6f7-db1fb91f949d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:32.143067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d3e1686-c08f-4bd6-b6f7-db1fb91f949d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:32.145126 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d3e1686-c08f-4bd6-b6f7-db1fb91f949d tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1729 microversion: 2.20 time: 0.335874 Mar 12 20:57:32.146685 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1688/2456] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:31 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1729 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:32.161321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d5833dd3-a58e-42bc-9475-f0e96a263146 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:32.162009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d5833dd3-a58e-42bc-9475-f0e96a263146 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:32.168674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5833dd3-a58e-42bc-9475-f0e96a263146 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:32.169374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5833dd3-a58e-42bc-9475-f0e96a263146 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:32.170258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5833dd3-a58e-42bc-9475-f0e96a263146 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:32.170857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5833dd3-a58e-42bc-9475-f0e96a263146 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:32.251492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d5833dd3-a58e-42bc-9475-f0e96a263146 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7638f3b550c4fb2a85186af43b4ccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20d256a7184343ac31ebd4d701ce83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:32.259895 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d5833dd3-a58e-42bc-9475-f0e96a263146 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 200 len: 1283 microversion: 2.1 time: 0.111706 Mar 12 20:57:32.260840 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1689/2457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:32 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 1283 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:32.265634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b05c54d8-3e79-4480-940b-07f29134b3a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:32.266461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b05c54d8-3e79-4480-940b-07f29134b3a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: a861691b-98dc-49c0-9a22-ecc3a4d67534] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:32.273873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b05c54d8-3e79-4480-940b-07f29134b3a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:32.274571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b05c54d8-3e79-4480-940b-07f29134b3a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:32.275950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b05c54d8-3e79-4480-940b-07f29134b3a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:32.287312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b05c54d8-3e79-4480-940b-07f29134b3a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:32.710726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b05c54d8-3e79-4480-940b-07f29134b3a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:32.720310 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b05c54d8-3e79-4480-940b-07f29134b3a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534" status: 200 len: 1318 microversion: 2.1 time: 0.458094 Mar 12 20:57:32.721493 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1690/2458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:32 2022] GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:32.726568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-46af6f44-5537-4a2f-b7cb-fdd5a60f1449 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:32.727400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-46af6f44-5537-4a2f-b7cb-fdd5a60f1449 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:32.738471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46af6f44-5537-4a2f-b7cb-fdd5a60f1449 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:32.738928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46af6f44-5537-4a2f-b7cb-fdd5a60f1449 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:32.740115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46af6f44-5537-4a2f-b7cb-fdd5a60f1449 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:32.740254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46af6f44-5537-4a2f-b7cb-fdd5a60f1449 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:33.127282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-46af6f44-5537-4a2f-b7cb-fdd5a60f1449 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:33.143851 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-46af6f44-5537-4a2f-b7cb-fdd5a60f1449 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1482 microversion: 2.1 time: 0.420455 Mar 12 20:57:33.147284 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1691/2459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:32 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1482 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:33.159500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-54b42f73-1e25-48e6-986d-5bf16afd94ee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:33.161070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-54b42f73-1e25-48e6-986d-5bf16afd94ee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:33.182858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54b42f73-1e25-48e6-986d-5bf16afd94ee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:33.184630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54b42f73-1e25-48e6-986d-5bf16afd94ee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:33.185699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54b42f73-1e25-48e6-986d-5bf16afd94ee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:33.187831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54b42f73-1e25-48e6-986d-5bf16afd94ee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:33.522539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-54b42f73-1e25-48e6-986d-5bf16afd94ee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:33.541680 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-54b42f73-1e25-48e6-986d-5bf16afd94ee tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1520 microversion: 2.1 time: 0.390897 Mar 12 20:57:33.544385 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1692/2460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:33 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:33.558304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c4b27a75-3fe3-461b-82b0-0c930c73ef72 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:33.559021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c4b27a75-3fe3-461b-82b0-0c930c73ef72 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:33.570532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4b27a75-3fe3-461b-82b0-0c930c73ef72 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:33.571054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4b27a75-3fe3-461b-82b0-0c930c73ef72 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:33.572017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4b27a75-3fe3-461b-82b0-0c930c73ef72 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:33.572551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4b27a75-3fe3-461b-82b0-0c930c73ef72 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:33.923306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c4b27a75-3fe3-461b-82b0-0c930c73ef72 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:33.933512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c4b27a75-3fe3-461b-82b0-0c930c73ef72 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:33.936472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c4b27a75-3fe3-461b-82b0-0c930c73ef72 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:33.938043 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c4b27a75-3fe3-461b-82b0-0c930c73ef72 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 200 len: 1358 microversion: 2.21 time: 0.389795 Mar 12 20:57:33.939876 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1693/2461] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:33 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:33.944976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6eb3b075-d6d2-472b-8b9d-9ff50c35b546 req-18d5736f-2c21-4d64-8647-766431639181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a693b891-c5a5-407f-81c8-617a1c1b75d3", "tag": "d1058ce8-0025-4049-8e0f-48c7c6b0b8c5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:33.953922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6eb3b075-d6d2-472b-8b9d-9ff50c35b546 req-18d5736f-2c21-4d64-8647-766431639181 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:33.954536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6eb3b075-d6d2-472b-8b9d-9ff50c35b546 req-18d5736f-2c21-4d64-8647-766431639181 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:33.967360 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6eb3b075-d6d2-472b-8b9d-9ff50c35b546 req-18d5736f-2c21-4d64-8647-766431639181 service nova] Creating event network-changed:d1058ce8-0025-4049-8e0f-48c7c6b0b8c5 for instance a693b891-c5a5-407f-81c8-617a1c1b75d3 on nch1-master-1 Mar 12 20:57:33.972348 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6eb3b075-d6d2-472b-8b9d-9ff50c35b546 req-18d5736f-2c21-4d64-8647-766431639181 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031086 Mar 12 20:57:33.973155 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1694/2462] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:33.978741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8bcd3ebd-ddda-499d-87b0-04fe9759c346 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:33.979351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8bcd3ebd-ddda-499d-87b0-04fe9759c346 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:33.985952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8bcd3ebd-ddda-499d-87b0-04fe9759c346 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:33.986560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8bcd3ebd-ddda-499d-87b0-04fe9759c346 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:33.987280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8bcd3ebd-ddda-499d-87b0-04fe9759c346 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:33.987789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8bcd3ebd-ddda-499d-87b0-04fe9759c346 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:34.130232 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8bcd3ebd-ddda-499d-87b0-04fe9759c346 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.155861 Mar 12 20:57:34.131132 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1695/2463] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 20:57:33 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:34.142113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c000107-301d-42c6-9e74-e5e363b4b502 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:34.142732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c000107-301d-42c6-9e74-e5e363b4b502 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:34.149601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c000107-301d-42c6-9e74-e5e363b4b502 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:34.151068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c000107-301d-42c6-9e74-e5e363b4b502 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:34.152048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c000107-301d-42c6-9e74-e5e363b4b502 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:34.152728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c000107-301d-42c6-9e74-e5e363b4b502 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:34.858406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c000107-301d-42c6-9e74-e5e363b4b502 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:34.867319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c000107-301d-42c6-9e74-e5e363b4b502 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:34.871084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c000107-301d-42c6-9e74-e5e363b4b502 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:34.872887 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c000107-301d-42c6-9e74-e5e363b4b502 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1729 microversion: 2.20 time: 0.736510 Mar 12 20:57:34.881717 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1696/2464] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:34 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1729 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:34.881717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-74298edd-9ffa-47a6-b421-30f46dc910f2 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:34.881717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-74298edd-9ffa-47a6-b421-30f46dc910f2 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:34.888645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74298edd-9ffa-47a6-b421-30f46dc910f2 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:34.888645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74298edd-9ffa-47a6-b421-30f46dc910f2 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:34.890293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74298edd-9ffa-47a6-b421-30f46dc910f2 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:34.890846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74298edd-9ffa-47a6-b421-30f46dc910f2 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:35.225137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-74298edd-9ffa-47a6-b421-30f46dc910f2 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7638f3b550c4fb2a85186af43b4ccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20d256a7184343ac31ebd4d701ce83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:35.232985 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-74298edd-9ffa-47a6-b421-30f46dc910f2 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 200 len: 1325 microversion: 2.1 time: 0.357322 Mar 12 20:57:35.233569 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1697/2465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:34 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 1325 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:35.237931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-731ec86e-91b3-4334-8031-4b5ad8ad5011 req-56e6520b-efbb-4638-8074-5e1ea8885b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a861691b-98dc-49c0-9a22-ecc3a4d67534", "name": "network-vif-plugged", "status": "completed", "tag": "d454d31e-14e7-42aa-82d6-43badb4a25f3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:35.246334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-731ec86e-91b3-4334-8031-4b5ad8ad5011 req-56e6520b-efbb-4638-8074-5e1ea8885b39 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:35.246930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-731ec86e-91b3-4334-8031-4b5ad8ad5011 req-56e6520b-efbb-4638-8074-5e1ea8885b39 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:35.259832 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-731ec86e-91b3-4334-8031-4b5ad8ad5011 req-56e6520b-efbb-4638-8074-5e1ea8885b39 service nova] Creating event network-vif-plugged:d454d31e-14e7-42aa-82d6-43badb4a25f3 for instance a861691b-98dc-49c0-9a22-ecc3a4d67534 on nch2-master-1 Mar 12 20:57:35.265388 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-731ec86e-91b3-4334-8031-4b5ad8ad5011 req-56e6520b-efbb-4638-8074-5e1ea8885b39 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030620 Mar 12 20:57:35.266289 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1698/2466] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:35.273754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43685f82-2cc4-42d8-9186-797a4be241e9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:35.274697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-43685f82-2cc4-42d8-9186-797a4be241e9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: a861691b-98dc-49c0-9a22-ecc3a4d67534] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:35.283932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43685f82-2cc4-42d8-9186-797a4be241e9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:35.284396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43685f82-2cc4-42d8-9186-797a4be241e9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:35.285464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43685f82-2cc4-42d8-9186-797a4be241e9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:35.285606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43685f82-2cc4-42d8-9186-797a4be241e9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:35.621896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-43685f82-2cc4-42d8-9186-797a4be241e9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:35.631332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-43685f82-2cc4-42d8-9186-797a4be241e9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534" status: 200 len: 1318 microversion: 2.1 time: 0.362000 Mar 12 20:57:35.641945 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1699/2467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:35 2022] GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:35.779278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-234244933", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "515bd55a-bb93-474b-81a3-fbef96cc33b3"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:35.866265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] validate_networks() for [('515bd55a-bb93-474b-81a3-fbef96cc33b3', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:57:36.252160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:57:36.252612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:57:36.253083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:57:36.254400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:57:36.254827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:57:36.263485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:36.263963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:36.264758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:36.265194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:36.282910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Getting quotas for project db8dc11dabab4a8b94a51b93bfb98810. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:36.288630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Getting quotas for user 57b95b2e34c2476487ae862473d71fbd and project db8dc11dabab4a8b94a51b93bfb98810. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:36.301407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:57:36.303722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:57:36.349724 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71a701aa-91c7-44da-af28-a4ff66618f44 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706022 Mar 12 20:57:36.356833 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1700/2468] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:57:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:57:36.356833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7c974df9-19ec-4cdf-94c1-9867f51f55ce req-84ced0c1-bd37-4ef6-a329-e75276cc543d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fba405bb-14ed-4856-8142-96f30d5ee210", "tag": "4db8ead6-fe1e-439b-9358-369422d07f91"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:36.373573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7c974df9-19ec-4cdf-94c1-9867f51f55ce req-84ced0c1-bd37-4ef6-a329-e75276cc543d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:36.374509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7c974df9-19ec-4cdf-94c1-9867f51f55ce req-84ced0c1-bd37-4ef6-a329-e75276cc543d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:36.385740 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7c974df9-19ec-4cdf-94c1-9867f51f55ce req-84ced0c1-bd37-4ef6-a329-e75276cc543d service nova] Creating event network-changed:4db8ead6-fe1e-439b-9358-369422d07f91 for instance fba405bb-14ed-4856-8142-96f30d5ee210 on nch1-master-1 Mar 12 20:57:36.391595 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7c974df9-19ec-4cdf-94c1-9867f51f55ce req-84ced0c1-bd37-4ef6-a329-e75276cc543d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039817 Mar 12 20:57:36.392684 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1701/2469] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:36.399368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2520630-2ede-414a-9b5b-f8188ab8eba8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:36.400146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2520630-2ede-414a-9b5b-f8188ab8eba8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:36.411032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2520630-2ede-414a-9b5b-f8188ab8eba8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:36.411577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2520630-2ede-414a-9b5b-f8188ab8eba8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:36.412368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2520630-2ede-414a-9b5b-f8188ab8eba8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:36.412804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2520630-2ede-414a-9b5b-f8188ab8eba8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:36.649156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f2520630-2ede-414a-9b5b-f8188ab8eba8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:36.669422 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2520630-2ede-414a-9b5b-f8188ab8eba8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1520 microversion: 2.1 time: 0.264666 Mar 12 20:57:36.671093 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1702/2470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:36 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:36.676158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b90d5ac-05ce-4f16-b89a-6b71622b9986 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:36.686206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b90d5ac-05ce-4f16-b89a-6b71622b9986 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:36.702864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b90d5ac-05ce-4f16-b89a-6b71622b9986 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:36.704545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b90d5ac-05ce-4f16-b89a-6b71622b9986 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:36.706443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b90d5ac-05ce-4f16-b89a-6b71622b9986 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:36.708257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b90d5ac-05ce-4f16-b89a-6b71622b9986 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:37.041522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b90d5ac-05ce-4f16-b89a-6b71622b9986 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:37.052212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b90d5ac-05ce-4f16-b89a-6b71622b9986 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:37.054488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b90d5ac-05ce-4f16-b89a-6b71622b9986 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:37.055701 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b90d5ac-05ce-4f16-b89a-6b71622b9986 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 200 len: 1358 microversion: 2.21 time: 0.383343 Mar 12 20:57:37.056907 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1703/2471] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:36 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 1358 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:37.062059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0e9aae88-406b-4c9a-9061-4b294d728850 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:37.062652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0e9aae88-406b-4c9a-9061-4b294d728850 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:37.072908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e9aae88-406b-4c9a-9061-4b294d728850 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:37.073374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e9aae88-406b-4c9a-9061-4b294d728850 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:37.074566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e9aae88-406b-4c9a-9061-4b294d728850 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:37.075045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e9aae88-406b-4c9a-9061-4b294d728850 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:37.310298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0e9aae88-406b-4c9a-9061-4b294d728850 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:37.320446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0e9aae88-406b-4c9a-9061-4b294d728850 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:37.322617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0e9aae88-406b-4c9a-9061-4b294d728850 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:37.323969 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0e9aae88-406b-4c9a-9061-4b294d728850 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1729 microversion: 2.20 time: 0.266130 Mar 12 20:57:37.324954 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1704/2472] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:37 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1729 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:37.330437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c6054fe-12da-4cfc-b5aa-17d41b56eaa0 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:37.331182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c6054fe-12da-4cfc-b5aa-17d41b56eaa0 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:37.339287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c6054fe-12da-4cfc-b5aa-17d41b56eaa0 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:37.339877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c6054fe-12da-4cfc-b5aa-17d41b56eaa0 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:37.340794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c6054fe-12da-4cfc-b5aa-17d41b56eaa0 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:37.341384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c6054fe-12da-4cfc-b5aa-17d41b56eaa0 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:37.515831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9c6054fe-12da-4cfc-b5aa-17d41b56eaa0 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:37.527521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c6054fe-12da-4cfc-b5aa-17d41b56eaa0 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1482 microversion: 2.1 time: 0.200808 Mar 12 20:57:37.528583 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1705/2473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:37 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1482 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:37.536564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a25defe-3425-4aaf-a640-98d6b42c0fa3 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:37.538822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a25defe-3425-4aaf-a640-98d6b42c0fa3 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:37.547729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a25defe-3425-4aaf-a640-98d6b42c0fa3 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:37.548878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a25defe-3425-4aaf-a640-98d6b42c0fa3 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:37.551565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a25defe-3425-4aaf-a640-98d6b42c0fa3 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:37.552268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a25defe-3425-4aaf-a640-98d6b42c0fa3 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:37.890573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8a25defe-3425-4aaf-a640-98d6b42c0fa3 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7638f3b550c4fb2a85186af43b4ccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20d256a7184343ac31ebd4d701ce83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:37.899680 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a25defe-3425-4aaf-a640-98d6b42c0fa3 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 200 len: 1325 microversion: 2.1 time: 0.368366 Mar 12 20:57:37.900644 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1706/2474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:37 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 1325 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:37.912098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-58afa767-2455-4c00-be1f-a03b4208d8b7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:37.913673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-58afa767-2455-4c00-be1f-a03b4208d8b7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:37.921941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58afa767-2455-4c00-be1f-a03b4208d8b7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:37.922540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58afa767-2455-4c00-be1f-a03b4208d8b7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:37.923517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58afa767-2455-4c00-be1f-a03b4208d8b7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:37.923999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58afa767-2455-4c00-be1f-a03b4208d8b7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:38.006141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-58afa767-2455-4c00-be1f-a03b4208d8b7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:38.015799 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-58afa767-2455-4c00-be1f-a03b4208d8b7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 200 len: 1274 microversion: 2.1 time: 0.113724 Mar 12 20:57:38.025965 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1707/2475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:37 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:38.031758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fbe4d364-4467-4333-9c7a-d6f5c1672760 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:38.032463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fbe4d364-4467-4333-9c7a-d6f5c1672760 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: a861691b-98dc-49c0-9a22-ecc3a4d67534] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:38.040139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbe4d364-4467-4333-9c7a-d6f5c1672760 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:38.041078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbe4d364-4467-4333-9c7a-d6f5c1672760 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:38.042115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbe4d364-4467-4333-9c7a-d6f5c1672760 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:38.042840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbe4d364-4467-4333-9c7a-d6f5c1672760 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:38.310644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fbe4d364-4467-4333-9c7a-d6f5c1672760 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:38.318362 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fbe4d364-4467-4333-9c7a-d6f5c1672760 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534" status: 200 len: 1468 microversion: 2.1 time: 0.291289 Mar 12 20:57:38.318966 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1708/2476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:38 2022] GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534 => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:38.323982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-06bdc61a-eac2-458c-a81e-53316ff8e52c req-b8bb9c86-8a81-43db-ab09-5342cd619b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5af603d-9610-4c9e-bf45-9df1de0504e1", "name": "network-vif-plugged", "status": "completed", "tag": "cdf7109b-2b24-4768-9c41-d98c340ad31a"}, {"server_uuid": "85242d3f-d68b-418e-8788-978e8b8e1a57", "name": "network-vif-unplugged", "status": "completed", "tag": "5b9f6f03-0f86-4781-9004-bc10c692eaba"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:38.333190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-06bdc61a-eac2-458c-a81e-53316ff8e52c req-b8bb9c86-8a81-43db-ab09-5342cd619b74 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:38.333648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-06bdc61a-eac2-458c-a81e-53316ff8e52c req-b8bb9c86-8a81-43db-ab09-5342cd619b74 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:38.346772 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-06bdc61a-eac2-458c-a81e-53316ff8e52c req-b8bb9c86-8a81-43db-ab09-5342cd619b74 service nova] Creating event network-vif-plugged:cdf7109b-2b24-4768-9c41-d98c340ad31a for instance f5af603d-9610-4c9e-bf45-9df1de0504e1 on nch2-master-1 Mar 12 20:57:38.347290 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-06bdc61a-eac2-458c-a81e-53316ff8e52c req-b8bb9c86-8a81-43db-ab09-5342cd619b74 service nova] Creating event network-vif-unplugged:5b9f6f03-0f86-4781-9004-bc10c692eaba for instance 85242d3f-d68b-418e-8788-978e8b8e1a57 on nch1-master-1 Mar 12 20:57:38.355559 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-06bdc61a-eac2-458c-a81e-53316ff8e52c req-b8bb9c86-8a81-43db-ab09-5342cd619b74 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035477 Mar 12 20:57:38.356168 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1709/2477] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:38.369505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0fb620bd-be33-49fe-989f-1a19761f9c17 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:38.370930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0fb620bd-be33-49fe-989f-1a19761f9c17 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:38.385622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fb620bd-be33-49fe-989f-1a19761f9c17 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:38.387076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fb620bd-be33-49fe-989f-1a19761f9c17 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:38.388407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fb620bd-be33-49fe-989f-1a19761f9c17 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:38.388407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fb620bd-be33-49fe-989f-1a19761f9c17 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:38.653397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0fb620bd-be33-49fe-989f-1a19761f9c17 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:38.662176 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0fb620bd-be33-49fe-989f-1a19761f9c17 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1520 microversion: 2.1 time: 0.298387 Mar 12 20:57:38.674747 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1710/2478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:38 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:38.680231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8047e867-c5e6-44e6-bb84-634beeff9303 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:38.680857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8047e867-c5e6-44e6-bb84-634beeff9303 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:38.687598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8047e867-c5e6-44e6-bb84-634beeff9303 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:38.688058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8047e867-c5e6-44e6-bb84-634beeff9303 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:38.688837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8047e867-c5e6-44e6-bb84-634beeff9303 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:38.689281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8047e867-c5e6-44e6-bb84-634beeff9303 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:38.938628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8047e867-c5e6-44e6-bb84-634beeff9303 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:38.948468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8047e867-c5e6-44e6-bb84-634beeff9303 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:38.950240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8047e867-c5e6-44e6-bb84-634beeff9303 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:38.951513 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8047e867-c5e6-44e6-bb84-634beeff9303 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 200 len: 1358 microversion: 2.21 time: 0.275233 Mar 12 20:57:38.952144 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1711/2479] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:38 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:38.968686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-db62e491-50e9-41a2-b33f-ebcf39f7b02c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:38.969337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-db62e491-50e9-41a2-b33f-ebcf39f7b02c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: f5af603d-9610-4c9e-bf45-9df1de0504e1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:38.975677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db62e491-50e9-41a2-b33f-ebcf39f7b02c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:38.976890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db62e491-50e9-41a2-b33f-ebcf39f7b02c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:38.976890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db62e491-50e9-41a2-b33f-ebcf39f7b02c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:38.977331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db62e491-50e9-41a2-b33f-ebcf39f7b02c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:39.477151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-db62e491-50e9-41a2-b33f-ebcf39f7b02c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:39.487534 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-db62e491-50e9-41a2-b33f-ebcf39f7b02c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1" status: 200 len: 1318 microversion: 2.1 time: 0.523009 Mar 12 20:57:39.488216 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1712/2480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:38 2022] GET /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:39.493028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-965597ff-4622-4098-bcea-c4888cf33811 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:39.494301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-965597ff-4622-4098-bcea-c4888cf33811 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:39.500905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-965597ff-4622-4098-bcea-c4888cf33811 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:39.501372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-965597ff-4622-4098-bcea-c4888cf33811 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:39.502348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-965597ff-4622-4098-bcea-c4888cf33811 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:39.502886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-965597ff-4622-4098-bcea-c4888cf33811 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:39.733112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-965597ff-4622-4098-bcea-c4888cf33811 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:39.746634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-965597ff-4622-4098-bcea-c4888cf33811 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:39.748920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-965597ff-4622-4098-bcea-c4888cf33811 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:39.751637 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-965597ff-4622-4098-bcea-c4888cf33811 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1729 microversion: 2.20 time: 0.262423 Mar 12 20:57:39.753499 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1713/2481] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:39 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1729 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:39.758380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-91ae7917-a3b6-4588-a082-3cd942b97f88 req-55b88d40-6ca2-4711-b8f7-e2479403d273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c731ea4c-67c7-4d48-846f-c10bada24535", "tag": "79824ce4-3174-493e-aa2c-fe0b709c7d89"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:39.771750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-91ae7917-a3b6-4588-a082-3cd942b97f88 req-55b88d40-6ca2-4711-b8f7-e2479403d273 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:39.776332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-91ae7917-a3b6-4588-a082-3cd942b97f88 req-55b88d40-6ca2-4711-b8f7-e2479403d273 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:39.795916 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-91ae7917-a3b6-4588-a082-3cd942b97f88 req-55b88d40-6ca2-4711-b8f7-e2479403d273 service nova] Creating event network-changed:79824ce4-3174-493e-aa2c-fe0b709c7d89 for instance c731ea4c-67c7-4d48-846f-c10bada24535 on nch1-master-1 Mar 12 20:57:39.803376 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-91ae7917-a3b6-4588-a082-3cd942b97f88 req-55b88d40-6ca2-4711-b8f7-e2479403d273 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048352 Mar 12 20:57:39.804360 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1714/2482] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:39.820345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d756018d-f5c0-4e27-a774-5e9fbba5f82e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:39.822783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d756018d-f5c0-4e27-a774-5e9fbba5f82e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:39.838751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d756018d-f5c0-4e27-a774-5e9fbba5f82e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:39.839231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d756018d-f5c0-4e27-a774-5e9fbba5f82e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:39.842596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d756018d-f5c0-4e27-a774-5e9fbba5f82e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:39.843077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d756018d-f5c0-4e27-a774-5e9fbba5f82e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:40.192239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d756018d-f5c0-4e27-a774-5e9fbba5f82e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7638f3b550c4fb2a85186af43b4ccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20d256a7184343ac31ebd4d701ce83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:40.201733 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d756018d-f5c0-4e27-a774-5e9fbba5f82e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 200 len: 1325 microversion: 2.1 time: 0.395881 Mar 12 20:57:40.209122 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1715/2483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:39 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 1325 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:40.216268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-54658cb4-30d2-4931-85c6-3942617f41a2 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:40.216991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-54658cb4-30d2-4931-85c6-3942617f41a2 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:40.224332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54658cb4-30d2-4931-85c6-3942617f41a2 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:40.224627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54658cb4-30d2-4931-85c6-3942617f41a2 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:40.225422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54658cb4-30d2-4931-85c6-3942617f41a2 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:40.226147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54658cb4-30d2-4931-85c6-3942617f41a2 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:40.570068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-54658cb4-30d2-4931-85c6-3942617f41a2 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:40.579554 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-54658cb4-30d2-4931-85c6-3942617f41a2 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 200 len: 1316 microversion: 2.1 time: 0.368523 Mar 12 20:57:40.580104 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1716/2484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:40 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:40.588205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5aa3a45a-8a2f-4af6-a7b4-f9c74dfeb96c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:40.588205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5aa3a45a-8a2f-4af6-a7b4-f9c74dfeb96c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:40.591408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5aa3a45a-8a2f-4af6-a7b4-f9c74dfeb96c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:40.591863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5aa3a45a-8a2f-4af6-a7b4-f9c74dfeb96c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:40.592739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5aa3a45a-8a2f-4af6-a7b4-f9c74dfeb96c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:40.593190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5aa3a45a-8a2f-4af6-a7b4-f9c74dfeb96c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:40.890022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5aa3a45a-8a2f-4af6-a7b4-f9c74dfeb96c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:40.898107 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5aa3a45a-8a2f-4af6-a7b4-f9c74dfeb96c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1520 microversion: 2.1 time: 0.316900 Mar 12 20:57:40.898696 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1717/2485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:40 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:40.903751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d1e59e2-f6d4-41cb-8bc7-797b14f32810 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:40.904359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d1e59e2-f6d4-41cb-8bc7-797b14f32810 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:40.910961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d1e59e2-f6d4-41cb-8bc7-797b14f32810 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:40.911499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d1e59e2-f6d4-41cb-8bc7-797b14f32810 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:40.912318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d1e59e2-f6d4-41cb-8bc7-797b14f32810 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:40.912916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d1e59e2-f6d4-41cb-8bc7-797b14f32810 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:41.066711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d1e59e2-f6d4-41cb-8bc7-797b14f32810 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:41.075411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d1e59e2-f6d4-41cb-8bc7-797b14f32810 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:41.077712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d1e59e2-f6d4-41cb-8bc7-797b14f32810 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:41.082477 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d1e59e2-f6d4-41cb-8bc7-797b14f32810 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 200 len: 1358 microversion: 2.21 time: 0.179125 Mar 12 20:57:41.083080 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1718/2486] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:40 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:41.088386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2bc10393-41c4-4e16-b55e-6aabce8fc232 req-b3d13eb7-e1ba-447e-96e7-d50508681528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27f34eb-a809-408c-9262-cec7223eee56", "name": "network-vif-plugged", "status": "completed", "tag": "74c66795-a7e0-451e-bc40-b9db6d6b19d0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:41.097956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2bc10393-41c4-4e16-b55e-6aabce8fc232 req-b3d13eb7-e1ba-447e-96e7-d50508681528 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:41.098421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2bc10393-41c4-4e16-b55e-6aabce8fc232 req-b3d13eb7-e1ba-447e-96e7-d50508681528 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:41.111105 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2bc10393-41c4-4e16-b55e-6aabce8fc232 req-b3d13eb7-e1ba-447e-96e7-d50508681528 service nova] Creating event network-vif-plugged:74c66795-a7e0-451e-bc40-b9db6d6b19d0 for instance f27f34eb-a809-408c-9262-cec7223eee56 on nch1-master-1 Mar 12 20:57:41.115925 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2bc10393-41c4-4e16-b55e-6aabce8fc232 req-b3d13eb7-e1ba-447e-96e7-d50508681528 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031597 Mar 12 20:57:41.116641 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1719/2487] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:41.121404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7c5208b-ba34-42ad-a2ef-1b9c9ecb717a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:41.122123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e7c5208b-ba34-42ad-a2ef-1b9c9ecb717a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: f5af603d-9610-4c9e-bf45-9df1de0504e1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:41.128380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7c5208b-ba34-42ad-a2ef-1b9c9ecb717a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:41.128844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7c5208b-ba34-42ad-a2ef-1b9c9ecb717a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:41.129613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7c5208b-ba34-42ad-a2ef-1b9c9ecb717a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:41.130097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7c5208b-ba34-42ad-a2ef-1b9c9ecb717a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:41.309158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e7c5208b-ba34-42ad-a2ef-1b9c9ecb717a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:41.316759 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e7c5208b-ba34-42ad-a2ef-1b9c9ecb717a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1" status: 200 len: 1468 microversion: 2.1 time: 0.199134 Mar 12 20:57:41.317607 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1720/2488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:41 2022] GET /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1 => generated 1468 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:41.322307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-29822dca-6c76-4a92-a6ae-778e2c253c4c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:41.322921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-29822dca-6c76-4a92-a6ae-778e2c253c4c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:41.328976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29822dca-6c76-4a92-a6ae-778e2c253c4c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:41.329445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29822dca-6c76-4a92-a6ae-778e2c253c4c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:41.330349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29822dca-6c76-4a92-a6ae-778e2c253c4c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:41.330861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29822dca-6c76-4a92-a6ae-778e2c253c4c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:41.485190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-29822dca-6c76-4a92-a6ae-778e2c253c4c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:41.493979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-29822dca-6c76-4a92-a6ae-778e2c253c4c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:41.495534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-29822dca-6c76-4a92-a6ae-778e2c253c4c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:41.496763 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-29822dca-6c76-4a92-a6ae-778e2c253c4c tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1729 microversion: 2.20 time: 0.178171 Mar 12 20:57:41.497436 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1721/2489] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:41 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:41.501980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd6cb531-b99d-41b4-9d92-3b4824225caf tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:41.502721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd6cb531-b99d-41b4-9d92-3b4824225caf tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:41.508792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd6cb531-b99d-41b4-9d92-3b4824225caf tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:41.509756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd6cb531-b99d-41b4-9d92-3b4824225caf tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:41.510656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd6cb531-b99d-41b4-9d92-3b4824225caf tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:41.511145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd6cb531-b99d-41b4-9d92-3b4824225caf tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:41.675222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bd6cb531-b99d-41b4-9d92-3b4824225caf tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7638f3b550c4fb2a85186af43b4ccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20d256a7184343ac31ebd4d701ce83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:41.684120 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd6cb531-b99d-41b4-9d92-3b4824225caf tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 200 len: 1325 microversion: 2.1 time: 0.185645 Mar 12 20:57:41.684722 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1722/2490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:41 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 1325 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:41.698986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3937d5d-cfd6-454c-bb45-1bb59aadbd7b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:41.702836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c3937d5d-cfd6-454c-bb45-1bb59aadbd7b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:41.703734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c3937d5d-cfd6-454c-bb45-1bb59aadbd7b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Searching by: {'reservation_id': 'r-rf96ci07', 'deleted': False, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:57:41.711314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3937d5d-cfd6-454c-bb45-1bb59aadbd7b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:41.712956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3937d5d-cfd6-454c-bb45-1bb59aadbd7b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:41.714674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3937d5d-cfd6-454c-bb45-1bb59aadbd7b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:41.715651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3937d5d-cfd6-454c-bb45-1bb59aadbd7b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:41.885395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-c3937d5d-cfd6-454c-bb45-1bb59aadbd7b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:57:41.958307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c3937d5d-cfd6-454c-bb45-1bb59aadbd7b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:41.966207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3937d5d-cfd6-454c-bb45-1bb59aadbd7b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:41.966922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3937d5d-cfd6-454c-bb45-1bb59aadbd7b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:42.107219 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3937d5d-cfd6-454c-bb45-1bb59aadbd7b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-rf96ci07" status: 200 len: 2929 microversion: 2.1 time: 0.412307 Mar 12 20:57:42.107947 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1723/2491] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Mar 12 20:57:41 2022] GET /compute/v2.1/servers/detail?reservation_id=r-rf96ci07 => generated 2929 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:42.116754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e9a42126-2490-4129-858f-27d7c4e9b0db tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:42.117389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e9a42126-2490-4129-858f-27d7c4e9b0db tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:42.126772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9a42126-2490-4129-858f-27d7c4e9b0db tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:42.127242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9a42126-2490-4129-858f-27d7c4e9b0db tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:42.128117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9a42126-2490-4129-858f-27d7c4e9b0db tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:42.128554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9a42126-2490-4129-858f-27d7c4e9b0db tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:42.278282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e9a42126-2490-4129-858f-27d7c4e9b0db tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:42.286624 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e9a42126-2490-4129-858f-27d7c4e9b0db tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 200 len: 1316 microversion: 2.1 time: 0.177640 Mar 12 20:57:42.287973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1724/2492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:42 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:42.294647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d5a51823-bd49-4f17-89d5-3881b7062547 req-6a1068e2-35dc-499a-829f-09198028e617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c4f5f58-247e-456b-95e8-88ce6cf71c0f", "tag": "fd02cdd5-cc27-4ea3-b3bc-1ae0ca6dcd04"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:42.303600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d5a51823-bd49-4f17-89d5-3881b7062547 req-6a1068e2-35dc-499a-829f-09198028e617 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:42.304150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d5a51823-bd49-4f17-89d5-3881b7062547 req-6a1068e2-35dc-499a-829f-09198028e617 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:42.320679 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d5a51823-bd49-4f17-89d5-3881b7062547 req-6a1068e2-35dc-499a-829f-09198028e617 service nova] Creating event network-changed:fd02cdd5-cc27-4ea3-b3bc-1ae0ca6dcd04 for instance 4c4f5f58-247e-456b-95e8-88ce6cf71c0f on nch2-master-1 Mar 12 20:57:42.325923 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d5a51823-bd49-4f17-89d5-3881b7062547 req-6a1068e2-35dc-499a-829f-09198028e617 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036585 Mar 12 20:57:42.326775 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1725/2493] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:42.335111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a7520a9-f812-44a8-b504-34314bda3b06 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:42.335883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a7520a9-f812-44a8-b504-34314bda3b06 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:42.342721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a7520a9-f812-44a8-b504-34314bda3b06 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:42.343229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a7520a9-f812-44a8-b504-34314bda3b06 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:42.344071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a7520a9-f812-44a8-b504-34314bda3b06 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:42.344517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a7520a9-f812-44a8-b504-34314bda3b06 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:42.641995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9a7520a9-f812-44a8-b504-34314bda3b06 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:42.652230 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a7520a9-f812-44a8-b504-34314bda3b06 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1520 microversion: 2.1 time: 0.321371 Mar 12 20:57:42.652944 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1726/2494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:42 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:42.658718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1ae46ac9-eb16-469f-9c65-d2465e7e9655 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:42.659847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1ae46ac9-eb16-469f-9c65-d2465e7e9655 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:42.667336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ae46ac9-eb16-469f-9c65-d2465e7e9655 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:42.668058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ae46ac9-eb16-469f-9c65-d2465e7e9655 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:42.669172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ae46ac9-eb16-469f-9c65-d2465e7e9655 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:42.669673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ae46ac9-eb16-469f-9c65-d2465e7e9655 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:43.011210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1ae46ac9-eb16-469f-9c65-d2465e7e9655 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:43.022681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1ae46ac9-eb16-469f-9c65-d2465e7e9655 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:43.025870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1ae46ac9-eb16-469f-9c65-d2465e7e9655 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:43.027958 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1ae46ac9-eb16-469f-9c65-d2465e7e9655 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 200 len: 1358 microversion: 2.21 time: 0.373215 Mar 12 20:57:43.028774 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1727/2495] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:42 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 1358 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:43.049583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3a22986b-aed6-4c1a-a24c-80a278720e73 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:43.074639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.compute.server_groups [None req-3a22986b-aed6-4c1a-a24c-80a278720e73 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Querying cell 4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) for 2 instances {{(pid=136302) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 12 20:57:43.076019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a22986b-aed6-4c1a-a24c-80a278720e73 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:43.077809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a22986b-aed6-4c1a-a24c-80a278720e73 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:43.105948 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3a22986b-aed6-4c1a-a24c-80a278720e73 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/0d258fbc-c769-4150-a109-d47a8ca6d4fa" status: 200 len: 265 microversion: 2.1 time: 0.060851 Mar 12 20:57:43.107187 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1728/2496] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:57:43 2022] GET /compute/v2.1/os-server-groups/0d258fbc-c769-4150-a109-d47a8ca6d4fa => generated 265 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:43.117098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c9b22ccf-403f-453a-a212-dddf93c1ac80 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:43.118116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c9b22ccf-403f-453a-a212-dddf93c1ac80 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:43.124953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9b22ccf-403f-453a-a212-dddf93c1ac80 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:43.125426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9b22ccf-403f-453a-a212-dddf93c1ac80 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:43.126617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9b22ccf-403f-453a-a212-dddf93c1ac80 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:43.127034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9b22ccf-403f-453a-a212-dddf93c1ac80 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:43.342360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c9b22ccf-403f-453a-a212-dddf93c1ac80 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:43.355190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c9b22ccf-403f-453a-a212-dddf93c1ac80 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:43.357439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c9b22ccf-403f-453a-a212-dddf93c1ac80 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:43.358469 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c9b22ccf-403f-453a-a212-dddf93c1ac80 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1729 microversion: 2.20 time: 0.250067 Mar 12 20:57:43.359904 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1729/2497] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:43 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1729 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:43.367185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56871d3c-0f51-4a90-9fa2-61f8827a044e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:43.368082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-56871d3c-0f51-4a90-9fa2-61f8827a044e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:43.376302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56871d3c-0f51-4a90-9fa2-61f8827a044e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:43.377024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56871d3c-0f51-4a90-9fa2-61f8827a044e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:43.377649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56871d3c-0f51-4a90-9fa2-61f8827a044e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:43.378175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56871d3c-0f51-4a90-9fa2-61f8827a044e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:43.559663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-56871d3c-0f51-4a90-9fa2-61f8827a044e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7638f3b550c4fb2a85186af43b4ccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20d256a7184343ac31ebd4d701ce83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:43.573938 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56871d3c-0f51-4a90-9fa2-61f8827a044e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 200 len: 1325 microversion: 2.1 time: 0.213107 Mar 12 20:57:43.576225 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1730/2498] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:43 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 1325 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:43.583675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-978c5500-5c83-422e-bfa4-a84eb0dd2a3d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:43.584670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-978c5500-5c83-422e-bfa4-a84eb0dd2a3d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] [instance: a861691b-98dc-49c0-9a22-ecc3a4d67534] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:43.596689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-978c5500-5c83-422e-bfa4-a84eb0dd2a3d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:43.598199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-978c5500-5c83-422e-bfa4-a84eb0dd2a3d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:43.599307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-978c5500-5c83-422e-bfa4-a84eb0dd2a3d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:43.600331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-978c5500-5c83-422e-bfa4-a84eb0dd2a3d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:43.766003 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-978c5500-5c83-422e-bfa4-a84eb0dd2a3d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534" status: 200 len: 1619 microversion: 2.1 time: 0.188047 Mar 12 20:57:43.768265 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1731/2499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:43 2022] GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534 => generated 1619 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:43.773001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2d6c5e62-7d94-4fe1-92e4-cc7ee2dd9fc5 req-e1b9cbfb-3aec-4b07-9ddc-e7b59e2ca923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fba405bb-14ed-4856-8142-96f30d5ee210", "name": "network-vif-plugged", "status": "completed", "tag": "4db8ead6-fe1e-439b-9358-369422d07f91"}, {"server_uuid": "85242d3f-d68b-418e-8788-978e8b8e1a57", "name": "network-vif-plugged", "status": "completed", "tag": "5b9f6f03-0f86-4781-9004-bc10c692eaba"}, {"server_uuid": "a693b891-c5a5-407f-81c8-617a1c1b75d3", "name": "network-vif-plugged", "status": "completed", "tag": "d1058ce8-0025-4049-8e0f-48c7c6b0b8c5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:43.784556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2d6c5e62-7d94-4fe1-92e4-cc7ee2dd9fc5 req-e1b9cbfb-3aec-4b07-9ddc-e7b59e2ca923 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:43.785318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2d6c5e62-7d94-4fe1-92e4-cc7ee2dd9fc5 req-e1b9cbfb-3aec-4b07-9ddc-e7b59e2ca923 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:43.805822 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2d6c5e62-7d94-4fe1-92e4-cc7ee2dd9fc5 req-e1b9cbfb-3aec-4b07-9ddc-e7b59e2ca923 service nova] Creating event network-vif-plugged:4db8ead6-fe1e-439b-9358-369422d07f91 for instance fba405bb-14ed-4856-8142-96f30d5ee210 on nch1-master-1 Mar 12 20:57:43.806954 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2d6c5e62-7d94-4fe1-92e4-cc7ee2dd9fc5 req-e1b9cbfb-3aec-4b07-9ddc-e7b59e2ca923 service nova] Creating event network-vif-plugged:5b9f6f03-0f86-4781-9004-bc10c692eaba for instance 85242d3f-d68b-418e-8788-978e8b8e1a57 on nch1-master-1 Mar 12 20:57:43.807617 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2d6c5e62-7d94-4fe1-92e4-cc7ee2dd9fc5 req-e1b9cbfb-3aec-4b07-9ddc-e7b59e2ca923 service nova] Creating event network-vif-plugged:d1058ce8-0025-4049-8e0f-48c7c6b0b8c5 for instance a693b891-c5a5-407f-81c8-617a1c1b75d3 on nch1-master-1 Mar 12 20:57:43.817862 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2d6c5e62-7d94-4fe1-92e4-cc7ee2dd9fc5 req-e1b9cbfb-3aec-4b07-9ddc-e7b59e2ca923 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047883 Mar 12 20:57:43.818619 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1732/2500] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:43.825298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9d0a1e89-480f-4328-9847-a1ba3d38b792 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:43.826191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9d0a1e89-480f-4328-9847-a1ba3d38b792 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:43.837012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d0a1e89-480f-4328-9847-a1ba3d38b792 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:43.837741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d0a1e89-480f-4328-9847-a1ba3d38b792 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:43.838986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d0a1e89-480f-4328-9847-a1ba3d38b792 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:43.839769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d0a1e89-480f-4328-9847-a1ba3d38b792 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:44.073490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9d0a1e89-480f-4328-9847-a1ba3d38b792 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:44.082339 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9d0a1e89-480f-4328-9847-a1ba3d38b792 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 200 len: 1316 microversion: 2.1 time: 0.262416 Mar 12 20:57:44.083019 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1733/2501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:43 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:44.094488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7824088-44a0-429f-bced-1bcb3139be64 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:44.095115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7824088-44a0-429f-bced-1bcb3139be64 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:44.101686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7824088-44a0-429f-bced-1bcb3139be64 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:44.102355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7824088-44a0-429f-bced-1bcb3139be64 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:44.103608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7824088-44a0-429f-bced-1bcb3139be64 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:44.104182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7824088-44a0-429f-bced-1bcb3139be64 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:44.251582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c7824088-44a0-429f-bced-1bcb3139be64 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:44.259508 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7824088-44a0-429f-bced-1bcb3139be64 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1520 microversion: 2.1 time: 0.175385 Mar 12 20:57:44.260078 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1734/2502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:44 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:44.264634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e73293ec-311f-4ea6-a6a6-2d11c1aaa658 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:44.265252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e73293ec-311f-4ea6-a6a6-2d11c1aaa658 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] [instance: f5af603d-9610-4c9e-bf45-9df1de0504e1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:44.271628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e73293ec-311f-4ea6-a6a6-2d11c1aaa658 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:44.272203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e73293ec-311f-4ea6-a6a6-2d11c1aaa658 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:44.273041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e73293ec-311f-4ea6-a6a6-2d11c1aaa658 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:44.273536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e73293ec-311f-4ea6-a6a6-2d11c1aaa658 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:44.413021 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e73293ec-311f-4ea6-a6a6-2d11c1aaa658 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1" status: 200 len: 1619 microversion: 2.1 time: 0.151638 Mar 12 20:57:44.413748 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1735/2503] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:44 2022] GET /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1 => generated 1619 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:44.421345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4aa919e9-a83e-41c7-abe6-bf4e9630f064 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:44.422139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4aa919e9-a83e-41c7-abe6-bf4e9630f064 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:44.429013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4aa919e9-a83e-41c7-abe6-bf4e9630f064 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:44.429226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4aa919e9-a83e-41c7-abe6-bf4e9630f064 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:44.430131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4aa919e9-a83e-41c7-abe6-bf4e9630f064 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:44.430575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4aa919e9-a83e-41c7-abe6-bf4e9630f064 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:44.590060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4aa919e9-a83e-41c7-abe6-bf4e9630f064 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:44.599047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4aa919e9-a83e-41c7-abe6-bf4e9630f064 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:44.600835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4aa919e9-a83e-41c7-abe6-bf4e9630f064 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:44.602158 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4aa919e9-a83e-41c7-abe6-bf4e9630f064 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 200 len: 1358 microversion: 2.21 time: 0.187376 Mar 12 20:57:44.602803 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1736/2504] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:44 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:44.607268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1d3f641-9baa-43cc-9110-e6c18814c12f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:44.607875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1d3f641-9baa-43cc-9110-e6c18814c12f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:44.613562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1d3f641-9baa-43cc-9110-e6c18814c12f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:44.614037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1d3f641-9baa-43cc-9110-e6c18814c12f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:44.614890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1d3f641-9baa-43cc-9110-e6c18814c12f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:44.615322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1d3f641-9baa-43cc-9110-e6c18814c12f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:44.766324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1d3f641-9baa-43cc-9110-e6c18814c12f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:44.775310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1d3f641-9baa-43cc-9110-e6c18814c12f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:44.777157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1d3f641-9baa-43cc-9110-e6c18814c12f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:44.779365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1d3f641-9baa-43cc-9110-e6c18814c12f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1716 microversion: 2.20 time: 0.175281 Mar 12 20:57:44.785919 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1737/2505] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:44 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1716 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:44.790055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bfaa7ee0-7a5f-4ab5-bfa9-511ccb3dab9a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Action: 'create', calling method: .version_select at 0x7f6e36f46af0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-280391969", "policies": ["anti-affinity"]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:44.811385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bfaa7ee0-7a5f-4ab5-bfa9-511ccb3dab9a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:44.817738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bfaa7ee0-7a5f-4ab5-bfa9-511ccb3dab9a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:44.866452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bfaa7ee0-7a5f-4ab5-bfa9-511ccb3dab9a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:44.873806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bfaa7ee0-7a5f-4ab5-bfa9-511ccb3dab9a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:44.889521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bfaa7ee0-7a5f-4ab5-bfa9-511ccb3dab9a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.107683 Mar 12 20:57:44.890942 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1738/2506] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Mar 12 20:57:44 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:44.895989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04b13d1e-388b-441d-8bbb-2cfd771a6b50 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:44.896728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04b13d1e-388b-441d-8bbb-2cfd771a6b50 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:44.904889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04b13d1e-388b-441d-8bbb-2cfd771a6b50 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:44.905557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04b13d1e-388b-441d-8bbb-2cfd771a6b50 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:44.906704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04b13d1e-388b-441d-8bbb-2cfd771a6b50 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:44.907177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04b13d1e-388b-441d-8bbb-2cfd771a6b50 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:45.084142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04b13d1e-388b-441d-8bbb-2cfd771a6b50 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7638f3b550c4fb2a85186af43b4ccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20d256a7184343ac31ebd4d701ce83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:45.092159 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04b13d1e-388b-441d-8bbb-2cfd771a6b50 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 200 len: 1325 microversion: 2.1 time: 0.200025 Mar 12 20:57:45.093200 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1739/2507] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:44 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 1325 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:45.098537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1374935856", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "92042547-d653-45b7-b21a-c88bdb8985a1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:45.153746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:57:45.376789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:57:45.377233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:57:45.377717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:57:45.378164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:57:45.378625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:57:45.393949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:45.394408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:45.395233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:45.395677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:45.414409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:45.420654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:45.434271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Going to run 2 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:57:45.436817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 49ed298c-3e5a-4f2c-930f-7d7feb65126c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:57:45.486059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:45.491193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:45.524184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:45.529196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:45.543516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=49ed298c-3e5a-4f2c-930f-7d7feb65126c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:57:45.590440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:45.595383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:45.636083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:45.641724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'server_group_members'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:45.679286 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-32c00518-df4b-409d-85df-72535c35d991 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.585381 Mar 12 20:57:45.680421 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1740/2508] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:57:45 2022] POST /compute/v2.1/servers => generated 32 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Mar 12 20:57:45.686225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-573db6ac-a780-4be7-974a-015da0145928 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:45.686971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-573db6ac-a780-4be7-974a-015da0145928 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:45.694772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-573db6ac-a780-4be7-974a-015da0145928 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:45.695342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-573db6ac-a780-4be7-974a-015da0145928 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:45.696243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-573db6ac-a780-4be7-974a-015da0145928 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:45.696887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-573db6ac-a780-4be7-974a-015da0145928 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:45.850475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-573db6ac-a780-4be7-974a-015da0145928 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:45.861367 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-573db6ac-a780-4be7-974a-015da0145928 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 200 len: 1316 microversion: 2.1 time: 0.179585 Mar 12 20:57:45.862740 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1741/2509] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:45 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:45.878137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39c5fcee-2f20-4758-b8ce-f6bf44cb7721 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:45.878137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39c5fcee-2f20-4758-b8ce-f6bf44cb7721 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:45.885358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39c5fcee-2f20-4758-b8ce-f6bf44cb7721 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:45.886061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39c5fcee-2f20-4758-b8ce-f6bf44cb7721 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:45.887441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39c5fcee-2f20-4758-b8ce-f6bf44cb7721 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:45.888230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39c5fcee-2f20-4758-b8ce-f6bf44cb7721 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.053217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39c5fcee-2f20-4758-b8ce-f6bf44cb7721 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:46.061367 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39c5fcee-2f20-4758-b8ce-f6bf44cb7721 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1520 microversion: 2.1 time: 0.197249 Mar 12 20:57:46.062352 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1742/2510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:45 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:46.067171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cb2e6283-687c-43f6-a8c3-c398b804df33 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:46.067835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cb2e6283-687c-43f6-a8c3-c398b804df33 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:46.082349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb2e6283-687c-43f6-a8c3-c398b804df33 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.082820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb2e6283-687c-43f6-a8c3-c398b804df33 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.083616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb2e6283-687c-43f6-a8c3-c398b804df33 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.084071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb2e6283-687c-43f6-a8c3-c398b804df33 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.232297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cb2e6283-687c-43f6-a8c3-c398b804df33 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:46.240867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cb2e6283-687c-43f6-a8c3-c398b804df33 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:46.242447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cb2e6283-687c-43f6-a8c3-c398b804df33 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:46.243677 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cb2e6283-687c-43f6-a8c3-c398b804df33 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 200 len: 1358 microversion: 2.21 time: 0.180223 Mar 12 20:57:46.244267 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1743/2511] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:46 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:46.248618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c43af81e-c637-4c37-87e6-bd4d81f91bf1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:46.251933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c43af81e-c637-4c37-87e6-bd4d81f91bf1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:46.252718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c43af81e-c637-4c37-87e6-bd4d81f91bf1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Searching by: {'deleted': False, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:57:46.269326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c43af81e-c637-4c37-87e6-bd4d81f91bf1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.269833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c43af81e-c637-4c37-87e6-bd4d81f91bf1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.270638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c43af81e-c637-4c37-87e6-bd4d81f91bf1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.271112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c43af81e-c637-4c37-87e6-bd4d81f91bf1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.305821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-c43af81e-c637-4c37-87e6-bd4d81f91bf1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:57:46.339497 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c43af81e-c637-4c37-87e6-bd4d81f91bf1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.094124 Mar 12 20:57:46.340565 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1744/2512] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 20:57:46 2022] GET /compute/v2.1/servers => generated 1663 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:46.345720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7affdf8b-6f39-4cd2-b203-5a0480b9b798 req-a0ec3d9b-f71e-4270-b69a-1aa887cfdaf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4f5f58-247e-456b-95e8-88ce6cf71c0f", "name": "network-vif-plugged", "status": "completed", "tag": "fd02cdd5-cc27-4ea3-b3bc-1ae0ca6dcd04"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:46.355527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7affdf8b-6f39-4cd2-b203-5a0480b9b798 req-a0ec3d9b-f71e-4270-b69a-1aa887cfdaf6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.356074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7affdf8b-6f39-4cd2-b203-5a0480b9b798 req-a0ec3d9b-f71e-4270-b69a-1aa887cfdaf6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.367935 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7affdf8b-6f39-4cd2-b203-5a0480b9b798 req-a0ec3d9b-f71e-4270-b69a-1aa887cfdaf6 service nova] Creating event network-vif-plugged:fd02cdd5-cc27-4ea3-b3bc-1ae0ca6dcd04 for instance 4c4f5f58-247e-456b-95e8-88ce6cf71c0f on nch2-master-1 Mar 12 20:57:46.374245 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7affdf8b-6f39-4cd2-b203-5a0480b9b798 req-a0ec3d9b-f71e-4270-b69a-1aa887cfdaf6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032148 Mar 12 20:57:46.374973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1745/2513] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:46.380640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c112ced-4598-43d1-9ac0-23bf0e6b577e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:46.381620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c112ced-4598-43d1-9ac0-23bf0e6b577e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:46.388565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c112ced-4598-43d1-9ac0-23bf0e6b577e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.389071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c112ced-4598-43d1-9ac0-23bf0e6b577e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.389918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c112ced-4598-43d1-9ac0-23bf0e6b577e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.390428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c112ced-4598-43d1-9ac0-23bf0e6b577e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.613789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8c112ced-4598-43d1-9ac0-23bf0e6b577e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7638f3b550c4fb2a85186af43b4ccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20d256a7184343ac31ebd4d701ce83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:46.639504 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c112ced-4598-43d1-9ac0-23bf0e6b577e tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 200 len: 1520 microversion: 2.1 time: 0.262991 Mar 12 20:57:46.640921 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1746/2514] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:46 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:46.648328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6de289c7-ff27-4735-b9c2-02a246009503 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:46.650221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6de289c7-ff27-4735-b9c2-02a246009503 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:46.658901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6de289c7-ff27-4735-b9c2-02a246009503 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.659492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6de289c7-ff27-4735-b9c2-02a246009503 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.660474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6de289c7-ff27-4735-b9c2-02a246009503 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.661079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6de289c7-ff27-4735-b9c2-02a246009503 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.731030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6de289c7-ff27-4735-b9c2-02a246009503 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:46.738869 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6de289c7-ff27-4735-b9c2-02a246009503 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864" status: 200 len: 1215 microversion: 2.1 time: 0.096734 Mar 12 20:57:46.739450 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1747/2515] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:46 2022] GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:46.744099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-efa9f389-4d24-4c39-9be9-9f16ef64b08d tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:46.744797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-efa9f389-4d24-4c39-9be9-9f16ef64b08d tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:46.750874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efa9f389-4d24-4c39-9be9-9f16ef64b08d tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.751329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efa9f389-4d24-4c39-9be9-9f16ef64b08d tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.752107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efa9f389-4d24-4c39-9be9-9f16ef64b08d tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.752567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efa9f389-4d24-4c39-9be9-9f16ef64b08d tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.781860 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-efa9f389-4d24-4c39-9be9-9f16ef64b08d tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] HTTP exception thrown: Action 999 not found Mar 12 20:57:46.782528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-efa9f389-4d24-4c39-9be9-9f16ef64b08d tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Returning 404 to user: Action 999 not found {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:57:46.783444 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-efa9f389-4d24-4c39-9be9-9f16ef64b08d tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.043035 Mar 12 20:57:46.784048 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1748/2516] 10.222.0.30 () {58 vars in 1307 bytes} [Sat Mar 12 20:57:46 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210/os-instance-actions/999 => generated 66 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 20:57:46.794346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e00727bc-95c3-4317-8a64-82e5dd8e5ff8 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '.version_select at 0x7f6e3622f160>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:46.795106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e00727bc-95c3-4317-8a64-82e5dd8e5ff8 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: f5417c78-f6fe-403c-b8f3-d8ec56ed69a9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:46.800625 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e00727bc-95c3-4317-8a64-82e5dd8e5ff8 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] HTTP exception thrown: Instance f5417c78-f6fe-403c-b8f3-d8ec56ed69a9 could not be found. Mar 12 20:57:46.801238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e00727bc-95c3-4317-8a64-82e5dd8e5ff8 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Returning 404 to user: Instance f5417c78-f6fe-403c-b8f3-d8ec56ed69a9 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:57:46.802065 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e00727bc-95c3-4317-8a64-82e5dd8e5ff8 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/f5417c78-f6fe-403c-b8f3-d8ec56ed69a9/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.012470 Mar 12 20:57:46.802617 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1749/2517] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Mar 12 20:57:46 2022] GET /compute/v2.1/servers/f5417c78-f6fe-403c-b8f3-d8ec56ed69a9/os-instance-actions => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:57:46.812578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-217f8083-5cff-4110-8e8d-c7b50f6e132a tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:46.813025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-217f8083-5cff-4110-8e8d-c7b50f6e132a tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:46.820104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-217f8083-5cff-4110-8e8d-c7b50f6e132a tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.820569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-217f8083-5cff-4110-8e8d-c7b50f6e132a tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.821349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-217f8083-5cff-4110-8e8d-c7b50f6e132a tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.821833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-217f8083-5cff-4110-8e8d-c7b50f6e132a tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.848720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-217f8083-5cff-4110-8e8d-c7b50f6e132a tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:57:46.925445 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-217f8083-5cff-4110-8e8d-c7b50f6e132a tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 204 len: 0 microversion: 2.1 time: 0.116170 Mar 12 20:57:46.926293 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1750/2518] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:57:46 2022] DELETE /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 20:57:46.931754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0fcc7079-0d46-4d82-a382-322585763c1d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:46.932501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0fcc7079-0d46-4d82-a382-322585763c1d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:46.938783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fcc7079-0d46-4d82-a382-322585763c1d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.939245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fcc7079-0d46-4d82-a382-322585763c1d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:46.940030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fcc7079-0d46-4d82-a382-322585763c1d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:46.940477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fcc7079-0d46-4d82-a382-322585763c1d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:47.084959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0fcc7079-0d46-4d82-a382-322585763c1d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:47.093950 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0fcc7079-0d46-4d82-a382-322585763c1d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 200 len: 1316 microversion: 2.1 time: 0.166618 Mar 12 20:57:47.095031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1751/2519] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:46 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:47.099860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ece1f2c7-015d-4fc8-af06-d99986bb2bb4 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:47.100598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ece1f2c7-015d-4fc8-af06-d99986bb2bb4 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:47.107282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ece1f2c7-015d-4fc8-af06-d99986bb2bb4 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:47.108074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ece1f2c7-015d-4fc8-af06-d99986bb2bb4 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:47.109098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ece1f2c7-015d-4fc8-af06-d99986bb2bb4 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:47.109721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ece1f2c7-015d-4fc8-af06-d99986bb2bb4 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:47.259700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ece1f2c7-015d-4fc8-af06-d99986bb2bb4 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7638f3b550c4fb2a85186af43b4ccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20d256a7184343ac31ebd4d701ce83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:47.267800 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ece1f2c7-015d-4fc8-af06-d99986bb2bb4 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 200 len: 1526 microversion: 2.1 time: 0.171844 Mar 12 20:57:47.268500 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1752/2520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:47 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 1526 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:47.278622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b5973f6-ca5f-4c7c-bf4a-8639f9d350f1 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:47.278622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3b5973f6-ca5f-4c7c-bf4a-8639f9d350f1 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:47.280659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b5973f6-ca5f-4c7c-bf4a-8639f9d350f1 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:47.281232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b5973f6-ca5f-4c7c-bf4a-8639f9d350f1 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:47.282182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b5973f6-ca5f-4c7c-bf4a-8639f9d350f1 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:47.282710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b5973f6-ca5f-4c7c-bf4a-8639f9d350f1 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:47.503553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3b5973f6-ca5f-4c7c-bf4a-8639f9d350f1 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:47.511883 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b5973f6-ca5f-4c7c-bf4a-8639f9d350f1 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1505 microversion: 2.1 time: 0.242294 Mar 12 20:57:47.512480 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1753/2521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:47 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:47.528082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-61457c55-e1e3-4b3e-ba33-95c59b7ffb64 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:47.528710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-61457c55-e1e3-4b3e-ba33-95c59b7ffb64 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:47.534829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61457c55-e1e3-4b3e-ba33-95c59b7ffb64 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:47.535194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61457c55-e1e3-4b3e-ba33-95c59b7ffb64 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:47.536030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61457c55-e1e3-4b3e-ba33-95c59b7ffb64 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:47.536432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61457c55-e1e3-4b3e-ba33-95c59b7ffb64 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:47.785131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-61457c55-e1e3-4b3e-ba33-95c59b7ffb64 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:47.833979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-61457c55-e1e3-4b3e-ba33-95c59b7ffb64 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:47.841178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-61457c55-e1e3-4b3e-ba33-95c59b7ffb64 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:47.843848 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-61457c55-e1e3-4b3e-ba33-95c59b7ffb64 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 200 len: 1551 microversion: 2.21 time: 0.330087 Mar 12 20:57:47.856982 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1754/2522] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:47 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 1551 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:47.867054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b016a16f-7bfd-4333-9e39-308009597e79 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:47.869086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b016a16f-7bfd-4333-9e39-308009597e79 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:47.879634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b016a16f-7bfd-4333-9e39-308009597e79 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:47.880135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b016a16f-7bfd-4333-9e39-308009597e79 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:47.882169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b016a16f-7bfd-4333-9e39-308009597e79 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:47.882813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b016a16f-7bfd-4333-9e39-308009597e79 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:48.528322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b016a16f-7bfd-4333-9e39-308009597e79 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:48.535879 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b016a16f-7bfd-4333-9e39-308009597e79 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 200 len: 1505 microversion: 2.1 time: 0.677323 Mar 12 20:57:48.537072 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1755/2523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:47 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 1505 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:48.541632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7285969d-c198-4c76-a832-54bb7a046850 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:48.542484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7285969d-c198-4c76-a832-54bb7a046850 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:48.548390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7285969d-c198-4c76-a832-54bb7a046850 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:48.548852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7285969d-c198-4c76-a832-54bb7a046850 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:48.549697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7285969d-c198-4c76-a832-54bb7a046850 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:48.550234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7285969d-c198-4c76-a832-54bb7a046850 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:48.632677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7285969d-c198-4c76-a832-54bb7a046850 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:48.640431 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7285969d-c198-4c76-a832-54bb7a046850 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864" status: 200 len: 1277 microversion: 2.1 time: 0.102860 Mar 12 20:57:48.647617 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1756/2524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:48 2022] GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864 => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:48.682308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b2695ee5-3e65-4f3b-95d7-655a8ab5dd3a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:48.682977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b2695ee5-3e65-4f3b-95d7-655a8ab5dd3a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:48.690984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2695ee5-3e65-4f3b-95d7-655a8ab5dd3a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:48.692084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2695ee5-3e65-4f3b-95d7-655a8ab5dd3a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:48.695423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2695ee5-3e65-4f3b-95d7-655a8ab5dd3a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:48.696156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2695ee5-3e65-4f3b-95d7-655a8ab5dd3a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:48.753305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b2695ee5-3e65-4f3b-95d7-655a8ab5dd3a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:57:48.862506 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b2695ee5-3e65-4f3b-95d7-655a8ab5dd3a tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 204 len: 0 microversion: 2.21 time: 0.183816 Mar 12 20:57:48.864006 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1757/2525] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:57:48 2022] DELETE /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:57:48.870042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51a53269-ef06-451f-9e68-8e030960c368 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:48.871353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51a53269-ef06-451f-9e68-8e030960c368 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:48.880681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51a53269-ef06-451f-9e68-8e030960c368 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:48.884679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51a53269-ef06-451f-9e68-8e030960c368 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:48.885736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51a53269-ef06-451f-9e68-8e030960c368 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:48.886380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51a53269-ef06-451f-9e68-8e030960c368 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:49.197549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51a53269-ef06-451f-9e68-8e030960c368 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:49.206074 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51a53269-ef06-451f-9e68-8e030960c368 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 200 len: 1505 microversion: 2.1 time: 0.340636 Mar 12 20:57:49.207486 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1758/2526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:48 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:49.211640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-62b9f1ef-909d-4453-9ede-0a5c2a2c7ab1 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:49.212954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-62b9f1ef-909d-4453-9ede-0a5c2a2c7ab1 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:49.224567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62b9f1ef-909d-4453-9ede-0a5c2a2c7ab1 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:49.225029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62b9f1ef-909d-4453-9ede-0a5c2a2c7ab1 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:49.230521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62b9f1ef-909d-4453-9ede-0a5c2a2c7ab1 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:49.230767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62b9f1ef-909d-4453-9ede-0a5c2a2c7ab1 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:49.533748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-62b9f1ef-909d-4453-9ede-0a5c2a2c7ab1 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7638f3b550c4fb2a85186af43b4ccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20d256a7184343ac31ebd4d701ce83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:49.556954 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-62b9f1ef-909d-4453-9ede-0a5c2a2c7ab1 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 200 len: 1526 microversion: 2.1 time: 0.348048 Mar 12 20:57:49.558440 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1759/2527] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:49 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 1526 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:49.566682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fdf46fc7-f21d-4d68-bba3-078e3262c232 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:49.567670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fdf46fc7-f21d-4d68-bba3-078e3262c232 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:49.582116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fdf46fc7-f21d-4d68-bba3-078e3262c232 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:49.583669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fdf46fc7-f21d-4d68-bba3-078e3262c232 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:49.584686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fdf46fc7-f21d-4d68-bba3-078e3262c232 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:49.586636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fdf46fc7-f21d-4d68-bba3-078e3262c232 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:49.622381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fdf46fc7-f21d-4d68-bba3-078e3262c232 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:57:49.763449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fdf46fc7-f21d-4d68-bba3-078e3262c232 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 204 len: 0 microversion: 2.1 time: 0.200865 Mar 12 20:57:49.765628 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1760/2528] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:57:49 2022] DELETE /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:49.781397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1abb4976-e863-4783-8dda-eee122ec43da tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:49.781987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1abb4976-e863-4783-8dda-eee122ec43da tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:49.807935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1abb4976-e863-4783-8dda-eee122ec43da tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:49.808366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1abb4976-e863-4783-8dda-eee122ec43da tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:49.811259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1abb4976-e863-4783-8dda-eee122ec43da tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:49.811726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1abb4976-e863-4783-8dda-eee122ec43da tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:50.168592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1abb4976-e863-4783-8dda-eee122ec43da tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:50.179895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1abb4976-e863-4783-8dda-eee122ec43da tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:50.183549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1abb4976-e863-4783-8dda-eee122ec43da tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:50.187808 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1abb4976-e863-4783-8dda-eee122ec43da tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 200 len: 1557 microversion: 2.21 time: 0.418461 Mar 12 20:57:50.189113 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1761/2529] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:49 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 1557 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:50.195153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5f22b8cf-f0d1-4fd5-a4df-1fbabf41b591 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:50.195778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5f22b8cf-f0d1-4fd5-a4df-1fbabf41b591 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:50.202609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f22b8cf-f0d1-4fd5-a4df-1fbabf41b591 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:50.203322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f22b8cf-f0d1-4fd5-a4df-1fbabf41b591 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:50.205868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f22b8cf-f0d1-4fd5-a4df-1fbabf41b591 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:50.206433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f22b8cf-f0d1-4fd5-a4df-1fbabf41b591 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:50.255399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f22b8cf-f0d1-4fd5-a4df-1fbabf41b591 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:50.261341 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5f22b8cf-f0d1-4fd5-a4df-1fbabf41b591 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f/os-instance-actions/req-71a701aa-91c7-44da-af28-a4ff66618f44" status: 200 len: 313 microversion: 2.1 time: 0.069552 Mar 12 20:57:50.262454 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1762/2530] 10.222.0.30 () {58 vars in 1418 bytes} [Sat Mar 12 20:57:50 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f/os-instance-actions/req-71a701aa-91c7-44da-af28-a4ff66618f44 => generated 313 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:50.268754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-578a91e0-6890-4b33-8156-061273ab9619 req-de5a776e-b4b2-48eb-b2e8-b1a50425c0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ed298c-3e5a-4f2c-930f-7d7feb65126c", "tag": "9ff3e2ff-a91c-42c5-ab98-b9c1d789e350"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:50.278479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-578a91e0-6890-4b33-8156-061273ab9619 req-de5a776e-b4b2-48eb-b2e8-b1a50425c0a4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:50.279108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-578a91e0-6890-4b33-8156-061273ab9619 req-de5a776e-b4b2-48eb-b2e8-b1a50425c0a4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:50.310208 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-578a91e0-6890-4b33-8156-061273ab9619 req-de5a776e-b4b2-48eb-b2e8-b1a50425c0a4 service nova] Creating event network-changed:9ff3e2ff-a91c-42c5-ab98-b9c1d789e350 for instance 49ed298c-3e5a-4f2c-930f-7d7feb65126c on nch1-master-1 Mar 12 20:57:50.329424 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-578a91e0-6890-4b33-8156-061273ab9619 req-de5a776e-b4b2-48eb-b2e8-b1a50425c0a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065484 Mar 12 20:57:50.332650 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1763/2531] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:50.346273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8249abc0-2202-4fa3-9208-f549f8192b03 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:50.347291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8249abc0-2202-4fa3-9208-f549f8192b03 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:50.359396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8249abc0-2202-4fa3-9208-f549f8192b03 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:50.360559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8249abc0-2202-4fa3-9208-f549f8192b03 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:50.361599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8249abc0-2202-4fa3-9208-f549f8192b03 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:50.362392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8249abc0-2202-4fa3-9208-f549f8192b03 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:50.601608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8249abc0-2202-4fa3-9208-f549f8192b03 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:50.611666 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8249abc0-2202-4fa3-9208-f549f8192b03 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864" status: 200 len: 1319 microversion: 2.1 time: 0.275891 Mar 12 20:57:50.612885 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1764/2532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:50 2022] GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:50.617695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5d10bbd2-0b1f-4191-b3ee-43807d9f8392 req-93c218a1-a1dc-4872-9db1-c5beed458bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44289ad3-751a-4eee-ba1a-9637a3696864", "tag": "b31eaefc-fcf6-426a-be94-19a6c528b552"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:50.628117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5d10bbd2-0b1f-4191-b3ee-43807d9f8392 req-93c218a1-a1dc-4872-9db1-c5beed458bb4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:50.628604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5d10bbd2-0b1f-4191-b3ee-43807d9f8392 req-93c218a1-a1dc-4872-9db1-c5beed458bb4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:50.643349 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5d10bbd2-0b1f-4191-b3ee-43807d9f8392 req-93c218a1-a1dc-4872-9db1-c5beed458bb4 service nova] Creating event network-changed:b31eaefc-fcf6-426a-be94-19a6c528b552 for instance 44289ad3-751a-4eee-ba1a-9637a3696864 on nch2-master-1 Mar 12 20:57:50.651378 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5d10bbd2-0b1f-4191-b3ee-43807d9f8392 req-93c218a1-a1dc-4872-9db1-c5beed458bb4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035136 Mar 12 20:57:50.652216 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1765/2533] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:50.658821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-963163112", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "f9a37655-b450-4556-a41b-12a59d1d79f0"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:50.717394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] validate_networks() for [('f9a37655-b450-4556-a41b-12a59d1d79f0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:57:51.382501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:57:51.383043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:57:51.383663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:57:51.384733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:57:51.385416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:57:51.394653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:51.395384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:51.396316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:51.396869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:51.416472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Getting quotas for project 6629e3cb02ae4e54a2bd5971423b88a7. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:57:51.422089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Getting quotas for user f4c8688bddda473ebeeef9a20b13be66 and project 6629e3cb02ae4e54a2bd5971423b88a7. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:57:51.435199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:57:51.437662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:57:51.525783 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af23d6f5-8219-4492-b939-9fd45835309e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871007 Mar 12 20:57:51.527569 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1766/2534] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:57:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:57:51.533669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8669136-1f7e-4d1b-9d88-917ac2b01c7f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:51.535207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8669136-1f7e-4d1b-9d88-917ac2b01c7f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:51.544909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8669136-1f7e-4d1b-9d88-917ac2b01c7f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:51.545378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8669136-1f7e-4d1b-9d88-917ac2b01c7f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:51.546416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8669136-1f7e-4d1b-9d88-917ac2b01c7f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:51.546705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8669136-1f7e-4d1b-9d88-917ac2b01c7f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:51.677386 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8669136-1f7e-4d1b-9d88-917ac2b01c7f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "POST /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f/action" status: 202 len: 0 microversion: 2.1 time: 0.147713 Mar 12 20:57:51.681559 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1767/2535] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:57:51 2022] POST /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:57:51.686415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c2e689fb-f181-4afd-bb5d-9d541b326778 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:51.687215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c2e689fb-f181-4afd-bb5d-9d541b326778 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] [instance: fba405bb-14ed-4856-8142-96f30d5ee210] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:51.695662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2e689fb-f181-4afd-bb5d-9d541b326778 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:51.696269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2e689fb-f181-4afd-bb5d-9d541b326778 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:51.697760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2e689fb-f181-4afd-bb5d-9d541b326778 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:51.698347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2e689fb-f181-4afd-bb5d-9d541b326778 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:51.730955 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c2e689fb-f181-4afd-bb5d-9d541b326778 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] HTTP exception thrown: Instance fba405bb-14ed-4856-8142-96f30d5ee210 could not be found. Mar 12 20:57:51.731896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c2e689fb-f181-4afd-bb5d-9d541b326778 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] Returning 404 to user: Instance fba405bb-14ed-4856-8142-96f30d5ee210 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:57:51.733698 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c2e689fb-f181-4afd-bb5d-9d541b326778 tempest-InstanceActionsNegativeTestJSON-280308672 tempest-InstanceActionsNegativeTestJSON-280308672-project] 10.222.0.30 "GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210" status: 404 len: 111 microversion: 2.1 time: 0.053841 Mar 12 20:57:51.734958 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1768/2536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:51 2022] GET /compute/v2.1/servers/fba405bb-14ed-4856-8142-96f30d5ee210 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:57:51.748643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da6654e3-fe7b-49ae-b876-92a9ead89537 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:51.752621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da6654e3-fe7b-49ae-b876-92a9ead89537 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:51.761834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da6654e3-fe7b-49ae-b876-92a9ead89537 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:51.762561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da6654e3-fe7b-49ae-b876-92a9ead89537 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:51.763602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da6654e3-fe7b-49ae-b876-92a9ead89537 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:51.764231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da6654e3-fe7b-49ae-b876-92a9ead89537 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:52.370029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da6654e3-fe7b-49ae-b876-92a9ead89537 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:52.383611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da6654e3-fe7b-49ae-b876-92a9ead89537 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:52.385193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da6654e3-fe7b-49ae-b876-92a9ead89537 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92756542c3fd441981da69834af9bc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff28f8551f948d881c281fadc6cf37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:52.393661 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da6654e3-fe7b-49ae-b876-92a9ead89537 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 200 len: 1557 microversion: 2.21 time: 0.649477 Mar 12 20:57:52.394497 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1769/2537] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:51 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 1557 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:57:52.404195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67f30971-1137-4932-8a08-6c30c6be84db tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:52.404809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-67f30971-1137-4932-8a08-6c30c6be84db tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:52.412088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67f30971-1137-4932-8a08-6c30c6be84db tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:52.412551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67f30971-1137-4932-8a08-6c30c6be84db tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:52.413335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67f30971-1137-4932-8a08-6c30c6be84db tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:52.414156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67f30971-1137-4932-8a08-6c30c6be84db tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:52.573649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-67f30971-1137-4932-8a08-6c30c6be84db tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:52.584828 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67f30971-1137-4932-8a08-6c30c6be84db tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1269 microversion: 2.1 time: 0.185043 Mar 12 20:57:52.585348 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1770/2538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:52 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:52.594798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d4508b6-5d80-4340-969a-e12e69fbb07e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:52.595528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2d4508b6-5d80-4340-969a-e12e69fbb07e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:52.605957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d4508b6-5d80-4340-969a-e12e69fbb07e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:52.607166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d4508b6-5d80-4340-969a-e12e69fbb07e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:52.608330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d4508b6-5d80-4340-969a-e12e69fbb07e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:52.608958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d4508b6-5d80-4340-969a-e12e69fbb07e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:53.140367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2d4508b6-5d80-4340-969a-e12e69fbb07e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:53.149666 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d4508b6-5d80-4340-969a-e12e69fbb07e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864" status: 200 len: 1319 microversion: 2.1 time: 0.562836 Mar 12 20:57:53.150297 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1771/2539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:52 2022] GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864 => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:53.158668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a3c57cec-54ab-4b8a-a673-ef5bfae8789d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:53.162498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a3c57cec-54ab-4b8a-a673-ef5bfae8789d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:53.175812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3c57cec-54ab-4b8a-a673-ef5bfae8789d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:53.176279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3c57cec-54ab-4b8a-a673-ef5bfae8789d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:53.179079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3c57cec-54ab-4b8a-a673-ef5bfae8789d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:53.179546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3c57cec-54ab-4b8a-a673-ef5bfae8789d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:53.378100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a3c57cec-54ab-4b8a-a673-ef5bfae8789d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:53.388749 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a3c57cec-54ab-4b8a-a673-ef5bfae8789d tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 200 len: 1507 microversion: 2.1 time: 0.233815 Mar 12 20:57:53.398531 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1772/2540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:53 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:53.420437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-28c89729-70a3-46e6-a57a-90dd65f2f6a2 req-66207663-ca20-44ff-be32-2c5afdd7fc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fba405bb-14ed-4856-8142-96f30d5ee210", "name": "network-vif-deleted", "tag": "4db8ead6-fe1e-439b-9358-369422d07f91"}, {"server_uuid": "a693b891-c5a5-407f-81c8-617a1c1b75d3", "name": "network-vif-deleted", "tag": "d1058ce8-0025-4049-8e0f-48c7c6b0b8c5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:53.440919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-28c89729-70a3-46e6-a57a-90dd65f2f6a2 req-66207663-ca20-44ff-be32-2c5afdd7fc34 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:53.441380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-28c89729-70a3-46e6-a57a-90dd65f2f6a2 req-66207663-ca20-44ff-be32-2c5afdd7fc34 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:53.460062 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-28c89729-70a3-46e6-a57a-90dd65f2f6a2 req-66207663-ca20-44ff-be32-2c5afdd7fc34 service nova] Creating event network-vif-deleted:4db8ead6-fe1e-439b-9358-369422d07f91 for instance fba405bb-14ed-4856-8142-96f30d5ee210 on nch1-master-1 Mar 12 20:57:53.460546 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-28c89729-70a3-46e6-a57a-90dd65f2f6a2 req-66207663-ca20-44ff-be32-2c5afdd7fc34 service nova] Creating event network-vif-deleted:d1058ce8-0025-4049-8e0f-48c7c6b0b8c5 for instance a693b891-c5a5-407f-81c8-617a1c1b75d3 on nch1-master-1 Mar 12 20:57:53.486502 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-28c89729-70a3-46e6-a57a-90dd65f2f6a2 req-66207663-ca20-44ff-be32-2c5afdd7fc34 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086730 Mar 12 20:57:53.487650 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1773/2541] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:53.502902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bcacee3c-e984-4fe3-a4c1-2fd4bf7ffc8e req-2337b768-7214-4791-b421-9e7fcebf5497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85242d3f-d68b-418e-8788-978e8b8e1a57", "name": "network-vif-deleted", "tag": "5b9f6f03-0f86-4781-9004-bc10c692eaba"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:53.528479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bcacee3c-e984-4fe3-a4c1-2fd4bf7ffc8e req-2337b768-7214-4791-b421-9e7fcebf5497 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:53.529250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bcacee3c-e984-4fe3-a4c1-2fd4bf7ffc8e req-2337b768-7214-4791-b421-9e7fcebf5497 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:53.544167 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bcacee3c-e984-4fe3-a4c1-2fd4bf7ffc8e req-2337b768-7214-4791-b421-9e7fcebf5497 service nova] Creating event network-vif-deleted:5b9f6f03-0f86-4781-9004-bc10c692eaba for instance 85242d3f-d68b-418e-8788-978e8b8e1a57 on nch1-master-1 Mar 12 20:57:53.550840 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bcacee3c-e984-4fe3-a4c1-2fd4bf7ffc8e req-2337b768-7214-4791-b421-9e7fcebf5497 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061474 Mar 12 20:57:53.552907 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1774/2542] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:53.562695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-820bfc1d-d871-44d0-9cd9-eb1587e6d26b tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:53.563642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-820bfc1d-d871-44d0-9cd9-eb1587e6d26b tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:53.574311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-820bfc1d-d871-44d0-9cd9-eb1587e6d26b tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:53.575053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-820bfc1d-d871-44d0-9cd9-eb1587e6d26b tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:53.576317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-820bfc1d-d871-44d0-9cd9-eb1587e6d26b tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:53.577167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-820bfc1d-d871-44d0-9cd9-eb1587e6d26b tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:53.606489 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-820bfc1d-d871-44d0-9cd9-eb1587e6d26b tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] HTTP exception thrown: Instance a693b891-c5a5-407f-81c8-617a1c1b75d3 could not be found. Mar 12 20:57:53.621074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-820bfc1d-d871-44d0-9cd9-eb1587e6d26b tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Returning 404 to user: Instance a693b891-c5a5-407f-81c8-617a1c1b75d3 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:57:53.622038 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-820bfc1d-d871-44d0-9cd9-eb1587e6d26b tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 404 len: 111 microversion: 2.21 time: 0.067615 Mar 12 20:57:53.622869 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1775/2543] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:53 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:57:53.636178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09a9e31a-11e7-408e-8dcd-fe4fccc6fb1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:53.637062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-09a9e31a-11e7-408e-8dcd-fe4fccc6fb1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:53.644310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09a9e31a-11e7-408e-8dcd-fe4fccc6fb1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:53.645208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09a9e31a-11e7-408e-8dcd-fe4fccc6fb1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:53.645547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09a9e31a-11e7-408e-8dcd-fe4fccc6fb1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:53.646028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09a9e31a-11e7-408e-8dcd-fe4fccc6fb1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:53.749320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09a9e31a-11e7-408e-8dcd-fe4fccc6fb1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:53.759383 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09a9e31a-11e7-408e-8dcd-fe4fccc6fb1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1275 microversion: 2.1 time: 0.127995 Mar 12 20:57:53.761475 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1776/2544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:53 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1275 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:53.783735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cbd22f45-487c-46d2-acd1-ebc418f608d9 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '.version_select at 0x7f6e370a61f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:53.784446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cbd22f45-487c-46d2-acd1-ebc418f608d9 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:53.792461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbd22f45-487c-46d2-acd1-ebc418f608d9 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:53.792873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbd22f45-487c-46d2-acd1-ebc418f608d9 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:53.793836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbd22f45-487c-46d2-acd1-ebc418f608d9 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:53.794184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbd22f45-487c-46d2-acd1-ebc418f608d9 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:53.931765 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cbd22f45-487c-46d2-acd1-ebc418f608d9 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.164895 Mar 12 20:57:53.934706 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1777/2545] 10.222.0.30 () {60 vars in 1336 bytes} [Sat Mar 12 20:57:53 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3/os-instance-actions => generated 611 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 20:57:53.954847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-593801c6-7ce1-4835-ab36-7616fc504e14 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:53.957540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-593801c6-7ce1-4835-ab36-7616fc504e14 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:53.980996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-593801c6-7ce1-4835-ab36-7616fc504e14 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:53.981991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-593801c6-7ce1-4835-ab36-7616fc504e14 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:53.984110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-593801c6-7ce1-4835-ab36-7616fc504e14 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:53.984760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-593801c6-7ce1-4835-ab36-7616fc504e14 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:54.067732 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-593801c6-7ce1-4835-ab36-7616fc504e14 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] HTTP exception thrown: Instance a693b891-c5a5-407f-81c8-617a1c1b75d3 could not be found. Mar 12 20:57:54.069156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-593801c6-7ce1-4835-ab36-7616fc504e14 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Returning 404 to user: Instance a693b891-c5a5-407f-81c8-617a1c1b75d3 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:57:54.070376 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-593801c6-7ce1-4835-ab36-7616fc504e14 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 404 len: 111 microversion: 2.21 time: 0.122158 Mar 12 20:57:54.073372 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1778/2546] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:57:53 2022] DELETE /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:57:54.082599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c871b51-c5a2-4bd7-b7eb-ef24539c23e7 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:54.083291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2c871b51-c5a2-4bd7-b7eb-ef24539c23e7 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] [instance: a693b891-c5a5-407f-81c8-617a1c1b75d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:54.116015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c871b51-c5a2-4bd7-b7eb-ef24539c23e7 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:54.116542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c871b51-c5a2-4bd7-b7eb-ef24539c23e7 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:54.117398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c871b51-c5a2-4bd7-b7eb-ef24539c23e7 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:54.117877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c871b51-c5a2-4bd7-b7eb-ef24539c23e7 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:54.152646 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-2c871b51-c5a2-4bd7-b7eb-ef24539c23e7 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] HTTP exception thrown: Instance a693b891-c5a5-407f-81c8-617a1c1b75d3 could not be found. Mar 12 20:57:54.153853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c871b51-c5a2-4bd7-b7eb-ef24539c23e7 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] Returning 404 to user: Instance a693b891-c5a5-407f-81c8-617a1c1b75d3 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:57:54.155404 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c871b51-c5a2-4bd7-b7eb-ef24539c23e7 tempest-InstanceActionsV221TestJSON-1823101043 tempest-InstanceActionsV221TestJSON-1823101043-project] 10.222.0.30 "GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3" status: 404 len: 111 microversion: 2.21 time: 0.077523 Mar 12 20:57:54.156909 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1779/2547] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:57:54 2022] GET /compute/v2.1/servers/a693b891-c5a5-407f-81c8-617a1c1b75d3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:57:54.177144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b3100eb-b318-4140-b6ef-9f7f026846b1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:54.178009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b3100eb-b318-4140-b6ef-9f7f026846b1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:54.192341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b3100eb-b318-4140-b6ef-9f7f026846b1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:54.194511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b3100eb-b318-4140-b6ef-9f7f026846b1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:54.195510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b3100eb-b318-4140-b6ef-9f7f026846b1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:54.196113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b3100eb-b318-4140-b6ef-9f7f026846b1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:54.787058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b3100eb-b318-4140-b6ef-9f7f026846b1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:54.796236 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b3100eb-b318-4140-b6ef-9f7f026846b1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864" status: 200 len: 1319 microversion: 2.1 time: 0.625090 Mar 12 20:57:54.807278 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1780/2548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:54 2022] GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864 => generated 1319 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:54.807278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f20d74a-219a-4662-bcfc-70a0e2dcdc82 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:54.807278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f20d74a-219a-4662-bcfc-70a0e2dcdc82 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:54.818102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f20d74a-219a-4662-bcfc-70a0e2dcdc82 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:54.818567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f20d74a-219a-4662-bcfc-70a0e2dcdc82 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:54.819509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f20d74a-219a-4662-bcfc-70a0e2dcdc82 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:54.820052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f20d74a-219a-4662-bcfc-70a0e2dcdc82 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:55.107663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f20d74a-219a-4662-bcfc-70a0e2dcdc82 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:55.118822 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f20d74a-219a-4662-bcfc-70a0e2dcdc82 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 200 len: 1505 microversion: 2.1 time: 0.318771 Mar 12 20:57:55.119777 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1781/2549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:54 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:55.127840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-588aadc0-9dac-4cba-9f6a-b3559078b2c3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:55.128959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-588aadc0-9dac-4cba-9f6a-b3559078b2c3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:55.136393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-588aadc0-9dac-4cba-9f6a-b3559078b2c3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:55.136972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-588aadc0-9dac-4cba-9f6a-b3559078b2c3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:55.137855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-588aadc0-9dac-4cba-9f6a-b3559078b2c3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:55.138395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-588aadc0-9dac-4cba-9f6a-b3559078b2c3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:55.387206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-588aadc0-9dac-4cba-9f6a-b3559078b2c3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:55.399184 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-588aadc0-9dac-4cba-9f6a-b3559078b2c3 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1317 microversion: 2.1 time: 0.278038 Mar 12 20:57:55.401313 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1782/2550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:55 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:55.406325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b06a06c-4216-4d6f-b6af-59cef689f070 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '.version_select at 0x7f6e3715bca0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:55.407619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b06a06c-4216-4d6f-b6af-59cef689f070 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:55.419015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b06a06c-4216-4d6f-b6af-59cef689f070 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:55.420110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b06a06c-4216-4d6f-b6af-59cef689f070 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:55.420991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b06a06c-4216-4d6f-b6af-59cef689f070 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:55.421508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b06a06c-4216-4d6f-b6af-59cef689f070 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:55.462734 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b06a06c-4216-4d6f-b6af-59cef689f070 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.060404 Mar 12 20:57:55.463580 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1783/2551] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Mar 12 20:57:55 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f/os-instance-actions => generated 611 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:55.480905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ff4b4d45-318d-4752-b0c9-54ef524cd31f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:55.481535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ff4b4d45-318d-4752-b0c9-54ef524cd31f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:55.491867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff4b4d45-318d-4752-b0c9-54ef524cd31f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:55.492353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff4b4d45-318d-4752-b0c9-54ef524cd31f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:55.493129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff4b4d45-318d-4752-b0c9-54ef524cd31f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:55.493703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff4b4d45-318d-4752-b0c9-54ef524cd31f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:55.527521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ff4b4d45-318d-4752-b0c9-54ef524cd31f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:57:55.652089 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ff4b4d45-318d-4752-b0c9-54ef524cd31f tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 204 len: 0 microversion: 2.1 time: 0.177695 Mar 12 20:57:55.655398 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1784/2552] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:57:55 2022] DELETE /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:57:55.673170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd8a7e51-176d-4e30-9068-39613e0d32fb tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:55.675374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd8a7e51-176d-4e30-9068-39613e0d32fb tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:55.692781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd8a7e51-176d-4e30-9068-39613e0d32fb tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:55.693080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd8a7e51-176d-4e30-9068-39613e0d32fb tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:55.694751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd8a7e51-176d-4e30-9068-39613e0d32fb tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:55.698697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd8a7e51-176d-4e30-9068-39613e0d32fb tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:56.017889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fd8a7e51-176d-4e30-9068-39613e0d32fb tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:56.033921 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd8a7e51-176d-4e30-9068-39613e0d32fb tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 200 len: 1511 microversion: 2.1 time: 0.373299 Mar 12 20:57:56.035896 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1785/2553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:55 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 1511 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:56.044005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e99a0866-8f62-4ffc-95a1-a708de0a96b2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:56.044732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e99a0866-8f62-4ffc-95a1-a708de0a96b2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:56.054674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e99a0866-8f62-4ffc-95a1-a708de0a96b2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:56.055306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e99a0866-8f62-4ffc-95a1-a708de0a96b2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:56.056218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e99a0866-8f62-4ffc-95a1-a708de0a96b2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:56.057027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e99a0866-8f62-4ffc-95a1-a708de0a96b2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:56.297394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e99a0866-8f62-4ffc-95a1-a708de0a96b2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:56.310180 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e99a0866-8f62-4ffc-95a1-a708de0a96b2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864" status: 200 len: 1319 microversion: 2.1 time: 0.272436 Mar 12 20:57:56.311209 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1786/2554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:56 2022] GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:56.317244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-edd0ba3e-36e6-4104-9630-bb882b3c2bc5 req-958bccd8-a9fc-4295-8dd3-4202acc52b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ed298c-3e5a-4f2c-930f-7d7feb65126c", "name": "network-vif-plugged", "status": "completed", "tag": "9ff3e2ff-a91c-42c5-ab98-b9c1d789e350"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:56.329364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-edd0ba3e-36e6-4104-9630-bb882b3c2bc5 req-958bccd8-a9fc-4295-8dd3-4202acc52b5d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:56.330099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-edd0ba3e-36e6-4104-9630-bb882b3c2bc5 req-958bccd8-a9fc-4295-8dd3-4202acc52b5d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:56.348261 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-edd0ba3e-36e6-4104-9630-bb882b3c2bc5 req-958bccd8-a9fc-4295-8dd3-4202acc52b5d service nova] Creating event network-vif-plugged:9ff3e2ff-a91c-42c5-ab98-b9c1d789e350 for instance 49ed298c-3e5a-4f2c-930f-7d7feb65126c on nch1-master-1 Mar 12 20:57:56.355425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-edd0ba3e-36e6-4104-9630-bb882b3c2bc5 req-958bccd8-a9fc-4295-8dd3-4202acc52b5d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042580 Mar 12 20:57:56.357105 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1787/2555] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:56.366661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-cf418229-ced3-4832-af51-a20899e92171 req-a0963d98-c1bc-41cc-a055-ff478b76b1bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de07409-369a-4686-9c06-7627d6f500fd", "tag": "311242c0-e8db-4f1a-b67c-30feecab67fd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:56.378591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cf418229-ced3-4832-af51-a20899e92171 req-a0963d98-c1bc-41cc-a055-ff478b76b1bc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:56.379485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cf418229-ced3-4832-af51-a20899e92171 req-a0963d98-c1bc-41cc-a055-ff478b76b1bc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:56.393574 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-cf418229-ced3-4832-af51-a20899e92171 req-a0963d98-c1bc-41cc-a055-ff478b76b1bc service nova] Creating event network-changed:311242c0-e8db-4f1a-b67c-30feecab67fd for instance 3de07409-369a-4686-9c06-7627d6f500fd on nch2-master-1 Mar 12 20:57:56.401959 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-cf418229-ced3-4832-af51-a20899e92171 req-a0963d98-c1bc-41cc-a055-ff478b76b1bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042714 Mar 12 20:57:56.403498 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1788/2556] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:56.420024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4ab6e6d9-3b0f-4535-aabd-185679ee821b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:56.422598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4ab6e6d9-3b0f-4535-aabd-185679ee821b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:56.436168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ab6e6d9-3b0f-4535-aabd-185679ee821b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:56.436694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ab6e6d9-3b0f-4535-aabd-185679ee821b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:56.438297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ab6e6d9-3b0f-4535-aabd-185679ee821b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:56.438754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ab6e6d9-3b0f-4535-aabd-185679ee821b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:56.676304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4ab6e6d9-3b0f-4535-aabd-185679ee821b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:56.685574 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4ab6e6d9-3b0f-4535-aabd-185679ee821b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1317 microversion: 2.1 time: 0.271989 Mar 12 20:57:56.686218 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1789/2557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:56 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:57.057280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b1818cfb-bf45-4eb1-9430-d8fad77c561c tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:57.058588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b1818cfb-bf45-4eb1-9430-d8fad77c561c tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:57.073469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1818cfb-bf45-4eb1-9430-d8fad77c561c tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:57.074845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1818cfb-bf45-4eb1-9430-d8fad77c561c tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:57.077412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1818cfb-bf45-4eb1-9430-d8fad77c561c tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:57.078068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1818cfb-bf45-4eb1-9430-d8fad77c561c tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:57.453595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b1818cfb-bf45-4eb1-9430-d8fad77c561c tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:57.464415 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b1818cfb-bf45-4eb1-9430-d8fad77c561c tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 200 len: 1511 microversion: 2.1 time: 0.412678 Mar 12 20:57:57.476685 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1790/2558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:57 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 1511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:57.482935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1c004491-35c9-4654-8fe9-4886af875c9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:57.483912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1c004491-35c9-4654-8fe9-4886af875c9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:57.491450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c004491-35c9-4654-8fe9-4886af875c9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:57.502114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c004491-35c9-4654-8fe9-4886af875c9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:57.503593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c004491-35c9-4654-8fe9-4886af875c9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:57.504271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c004491-35c9-4654-8fe9-4886af875c9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:57.824836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1c004491-35c9-4654-8fe9-4886af875c9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:57.845438 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1c004491-35c9-4654-8fe9-4886af875c9b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864" status: 200 len: 1319 microversion: 2.1 time: 0.367141 Mar 12 20:57:57.846792 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1791/2559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:57 2022] GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:57.860541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8422c2b7-8573-44eb-94d4-41672dc470d4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:57.862523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8422c2b7-8573-44eb-94d4-41672dc470d4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:57.873508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8422c2b7-8573-44eb-94d4-41672dc470d4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:57.874447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8422c2b7-8573-44eb-94d4-41672dc470d4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:57.875428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8422c2b7-8573-44eb-94d4-41672dc470d4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:57.876095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8422c2b7-8573-44eb-94d4-41672dc470d4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:58.087372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8422c2b7-8573-44eb-94d4-41672dc470d4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:58.098485 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8422c2b7-8573-44eb-94d4-41672dc470d4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1317 microversion: 2.1 time: 0.250181 Mar 12 20:57:58.099994 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1792/2560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:57 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:58.373450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0ef7a990-4920-4d28-8bb4-265c14ab3b9e req-66643ee6-3ad6-4d4b-a264-a0c7ecb30ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44289ad3-751a-4eee-ba1a-9637a3696864", "name": "network-vif-plugged", "status": "completed", "tag": "b31eaefc-fcf6-426a-be94-19a6c528b552"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:58.384716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0ef7a990-4920-4d28-8bb4-265c14ab3b9e req-66643ee6-3ad6-4d4b-a264-a0c7ecb30ac7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:58.385551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0ef7a990-4920-4d28-8bb4-265c14ab3b9e req-66643ee6-3ad6-4d4b-a264-a0c7ecb30ac7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:58.401723 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0ef7a990-4920-4d28-8bb4-265c14ab3b9e req-66643ee6-3ad6-4d4b-a264-a0c7ecb30ac7 service nova] Creating event network-vif-plugged:b31eaefc-fcf6-426a-be94-19a6c528b552 for instance 44289ad3-751a-4eee-ba1a-9637a3696864 on nch2-master-1 Mar 12 20:57:58.407463 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0ef7a990-4920-4d28-8bb4-265c14ab3b9e req-66643ee6-3ad6-4d4b-a264-a0c7ecb30ac7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038219 Mar 12 20:57:58.408163 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1793/2561] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:57:58.484018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-199cfb5c-6a58-4adb-b8d8-61075f36a574 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:58.486010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-199cfb5c-6a58-4adb-b8d8-61075f36a574 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:58.493335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-199cfb5c-6a58-4adb-b8d8-61075f36a574 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:58.494251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-199cfb5c-6a58-4adb-b8d8-61075f36a574 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:58.495275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-199cfb5c-6a58-4adb-b8d8-61075f36a574 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:58.495927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-199cfb5c-6a58-4adb-b8d8-61075f36a574 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:58.787526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-199cfb5c-6a58-4adb-b8d8-61075f36a574 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b95b2e34c2476487ae862473d71fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8dc11dabab4a8b94a51b93bfb98810', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:58.799730 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-199cfb5c-6a58-4adb-b8d8-61075f36a574 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 200 len: 1511 microversion: 2.1 time: 0.320531 Mar 12 20:57:58.801445 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1794/2562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:58 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 1511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:58.866880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-78c3f14d-b75d-495f-90bb-5ee59ac3c2ed tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:58.867625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-78c3f14d-b75d-495f-90bb-5ee59ac3c2ed tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:58.875619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78c3f14d-b75d-495f-90bb-5ee59ac3c2ed tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:58.876073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78c3f14d-b75d-495f-90bb-5ee59ac3c2ed tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:58.877369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78c3f14d-b75d-495f-90bb-5ee59ac3c2ed tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:58.878216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78c3f14d-b75d-495f-90bb-5ee59ac3c2ed tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:59.072328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-78c3f14d-b75d-495f-90bb-5ee59ac3c2ed tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:59.080862 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-78c3f14d-b75d-495f-90bb-5ee59ac3c2ed tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864" status: 200 len: 1319 microversion: 2.1 time: 0.220702 Mar 12 20:57:59.081454 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1795/2563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:58 2022] GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:57:59.125608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2de809db-2f98-40da-b00b-87dace962e45 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:57:59.126743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2de809db-2f98-40da-b00b-87dace962e45 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:57:59.139941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2de809db-2f98-40da-b00b-87dace962e45 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:59.140408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2de809db-2f98-40da-b00b-87dace962e45 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:59.141220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2de809db-2f98-40da-b00b-87dace962e45 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:59.143839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2de809db-2f98-40da-b00b-87dace962e45 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:59.411797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2de809db-2f98-40da-b00b-87dace962e45 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:57:59.423922 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2de809db-2f98-40da-b00b-87dace962e45 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1317 microversion: 2.1 time: 0.307653 Mar 12 20:57:59.427066 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1796/2564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:57:59 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:57:59.432842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a495dcd7-5164-41e1-b22a-295415607532 req-e0a10d98-9a3d-45d1-9299-d31b13306ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4f5f58-247e-456b-95e8-88ce6cf71c0f", "name": "network-vif-deleted", "tag": "fd02cdd5-cc27-4ea3-b3bc-1ae0ca6dcd04"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:59.443536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a495dcd7-5164-41e1-b22a-295415607532 req-e0a10d98-9a3d-45d1-9299-d31b13306ed1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:57:59.444619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a495dcd7-5164-41e1-b22a-295415607532 req-e0a10d98-9a3d-45d1-9299-d31b13306ed1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:57:59.467914 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a495dcd7-5164-41e1-b22a-295415607532 req-e0a10d98-9a3d-45d1-9299-d31b13306ed1 service nova] Creating event network-vif-deleted:fd02cdd5-cc27-4ea3-b3bc-1ae0ca6dcd04 for instance 4c4f5f58-247e-456b-95e8-88ce6cf71c0f on nch2-master-1 Mar 12 20:57:59.473615 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a495dcd7-5164-41e1-b22a-295415607532 req-e0a10d98-9a3d-45d1-9299-d31b13306ed1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045220 Mar 12 20:57:59.474315 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1797/2565] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:57:59.650004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-942466643", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "afaa632a-6d08-448e-a8e0-18c2f0bb350a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:57:59.715246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] validate_networks() for [('afaa632a-6d08-448e-a8e0-18c2f0bb350a', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:58:00.262336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:00.264814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:00.265551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:00.266745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:00.267348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:00.280552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:00.281607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:00.282659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:00.284672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:00.308419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Getting quotas for project 069a60bde3d648c3b37be99cf893a073. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:00.318061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Getting quotas for user a3da84d6d8e240418c4aa8ad06711f71 and project 069a60bde3d648c3b37be99cf893a073. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:00.339514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:58:00.345099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:58:00.420359 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-694f62e7-5421-4830-8bec-a6abee9afaa8 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944738 Mar 12 20:58:00.428729 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1798/2566] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:57:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:58:00.449560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-00cd0466-b93b-4858-a72b-c795d002bca7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:00.450143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-00cd0466-b93b-4858-a72b-c795d002bca7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] [instance: 4c4f5f58-247e-456b-95e8-88ce6cf71c0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:00.466005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-00cd0466-b93b-4858-a72b-c795d002bca7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:00.466547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-00cd0466-b93b-4858-a72b-c795d002bca7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:00.468252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-00cd0466-b93b-4858-a72b-c795d002bca7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:00.468765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-00cd0466-b93b-4858-a72b-c795d002bca7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:00.486496 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-00cd0466-b93b-4858-a72b-c795d002bca7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] HTTP exception thrown: Instance 4c4f5f58-247e-456b-95e8-88ce6cf71c0f could not be found. Mar 12 20:58:00.487105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-00cd0466-b93b-4858-a72b-c795d002bca7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] Returning 404 to user: Instance 4c4f5f58-247e-456b-95e8-88ce6cf71c0f could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:58:00.488260 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-00cd0466-b93b-4858-a72b-c795d002bca7 tempest-InstanceActionsTestJSON-1094089459 tempest-InstanceActionsTestJSON-1094089459-project] 10.222.0.30 "GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f" status: 404 len: 111 microversion: 2.1 time: 0.057763 Mar 12 20:58:00.494094 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1799/2567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:00 2022] GET /compute/v2.1/servers/4c4f5f58-247e-456b-95e8-88ce6cf71c0f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:58:00.501417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad2bb07d-998f-4cc8-9e01-90ba86f37dfc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:00.503360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad2bb07d-998f-4cc8-9e01-90ba86f37dfc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:00.512413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad2bb07d-998f-4cc8-9e01-90ba86f37dfc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:00.513164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad2bb07d-998f-4cc8-9e01-90ba86f37dfc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:00.514427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad2bb07d-998f-4cc8-9e01-90ba86f37dfc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:00.515129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad2bb07d-998f-4cc8-9e01-90ba86f37dfc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:00.804261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad2bb07d-998f-4cc8-9e01-90ba86f37dfc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:00.817344 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad2bb07d-998f-4cc8-9e01-90ba86f37dfc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864" status: 200 len: 1469 microversion: 2.1 time: 0.320872 Mar 12 20:58:00.837012 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1800/2568] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:00 2022] GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864 => generated 1469 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:00.847098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-509a05f0-eb76-45bb-a92b-c2d5b6200ab5 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:00.848130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-509a05f0-eb76-45bb-a92b-c2d5b6200ab5 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:00.962278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-509a05f0-eb76-45bb-a92b-c2d5b6200ab5 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3da84d6d8e240418c4aa8ad06711f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60bde3d648c3b37be99cf893a073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:00.971385 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-509a05f0-eb76-45bb-a92b-c2d5b6200ab5 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de" status: 200 len: 1216 microversion: 2.1 time: 0.128273 Mar 12 20:58:00.972491 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1801/2569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:00 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de => generated 1216 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:00.980426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-209bef33-1d06-4c9f-97db-d6dc8d9e66c0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:00.981613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-209bef33-1d06-4c9f-97db-d6dc8d9e66c0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:00.988895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-209bef33-1d06-4c9f-97db-d6dc8d9e66c0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:00.989793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-209bef33-1d06-4c9f-97db-d6dc8d9e66c0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:00.992192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-209bef33-1d06-4c9f-97db-d6dc8d9e66c0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:00.995039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-209bef33-1d06-4c9f-97db-d6dc8d9e66c0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:01.212591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-209bef33-1d06-4c9f-97db-d6dc8d9e66c0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:01.222172 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-209bef33-1d06-4c9f-97db-d6dc8d9e66c0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1317 microversion: 2.1 time: 0.248263 Mar 12 20:58:01.223384 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1802/2570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:00 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:01.230725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b8c380f-3a66-4171-b7ba-4f60f489b3d8 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:01.231615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b8c380f-3a66-4171-b7ba-4f60f489b3d8 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 49ed298c-3e5a-4f2c-930f-7d7feb65126c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:01.245351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b8c380f-3a66-4171-b7ba-4f60f489b3d8 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:01.247323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b8c380f-3a66-4171-b7ba-4f60f489b3d8 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:01.250403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b8c380f-3a66-4171-b7ba-4f60f489b3d8 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:01.251254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b8c380f-3a66-4171-b7ba-4f60f489b3d8 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:01.476532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b8c380f-3a66-4171-b7ba-4f60f489b3d8 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:01.489544 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b8c380f-3a66-4171-b7ba-4f60f489b3d8 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/49ed298c-3e5a-4f2c-930f-7d7feb65126c" status: 200 len: 1469 microversion: 2.1 time: 0.264581 Mar 12 20:58:01.491942 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1803/2571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:01 2022] GET /compute/v2.1/servers/49ed298c-3e5a-4f2c-930f-7d7feb65126c => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:01.510013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d64de79e-0129-4f3f-8d93-6bf92378ad45 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:01.515379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d64de79e-0129-4f3f-8d93-6bf92378ad45 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:01.516873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d64de79e-0129-4f3f-8d93-6bf92378ad45 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Searching by: {'reservation_id': 'r-oyka6ajz', 'deleted': False, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:01.526843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d64de79e-0129-4f3f-8d93-6bf92378ad45 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:01.527710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d64de79e-0129-4f3f-8d93-6bf92378ad45 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:01.528859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d64de79e-0129-4f3f-8d93-6bf92378ad45 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:01.530201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d64de79e-0129-4f3f-8d93-6bf92378ad45 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:01.650023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-d64de79e-0129-4f3f-8d93-6bf92378ad45 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:58:01.734831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d64de79e-0129-4f3f-8d93-6bf92378ad45 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:01.743333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d64de79e-0129-4f3f-8d93-6bf92378ad45 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:01.744073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d64de79e-0129-4f3f-8d93-6bf92378ad45 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:02.102533 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d64de79e-0129-4f3f-8d93-6bf92378ad45 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-oyka6ajz" status: 200 len: 2931 microversion: 2.1 time: 0.596883 Mar 12 20:58:02.120882 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1804/2572] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Mar 12 20:58:01 2022] GET /compute/v2.1/servers/detail?reservation_id=r-oyka6ajz => generated 2931 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:02.130637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f608ff5-9f9c-43d6-ae86-aaf26bc31b87 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:02.131532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f608ff5-9f9c-43d6-ae86-aaf26bc31b87 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:02.141396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f608ff5-9f9c-43d6-ae86-aaf26bc31b87 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:02.142247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f608ff5-9f9c-43d6-ae86-aaf26bc31b87 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:02.143296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f608ff5-9f9c-43d6-ae86-aaf26bc31b87 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:02.144135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f608ff5-9f9c-43d6-ae86-aaf26bc31b87 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:02.275775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f608ff5-9f9c-43d6-ae86-aaf26bc31b87 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3da84d6d8e240418c4aa8ad06711f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60bde3d648c3b37be99cf893a073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:02.289376 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f608ff5-9f9c-43d6-ae86-aaf26bc31b87 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de" status: 200 len: 1274 microversion: 2.1 time: 0.165874 Mar 12 20:58:02.292139 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1805/2573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:02 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:02.322300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-882a6fcf-5520-4af4-989e-e6a9c9203263 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:02.354565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.compute.server_groups [None req-882a6fcf-5520-4af4-989e-e6a9c9203263 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Querying cell 4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) for 2 instances {{(pid=136302) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Mar 12 20:58:02.355902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-882a6fcf-5520-4af4-989e-e6a9c9203263 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:02.356516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-882a6fcf-5520-4af4-989e-e6a9c9203263 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:02.383199 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-882a6fcf-5520-4af4-989e-e6a9c9203263 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/92042547-d653-45b7-b21a-c88bdb8985a1" status: 200 len: 270 microversion: 2.1 time: 0.089724 Mar 12 20:58:02.384254 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1806/2574] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:58:02 2022] GET /compute/v2.1/os-server-groups/92042547-d653-45b7-b21a-c88bdb8985a1 => generated 270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:02.390719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad2aaed4-3a1c-4822-8398-d05ae0bb08f8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:02.391972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad2aaed4-3a1c-4822-8398-d05ae0bb08f8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:02.405254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad2aaed4-3a1c-4822-8398-d05ae0bb08f8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:02.405648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad2aaed4-3a1c-4822-8398-d05ae0bb08f8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:02.407652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad2aaed4-3a1c-4822-8398-d05ae0bb08f8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:02.408539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad2aaed4-3a1c-4822-8398-d05ae0bb08f8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:02.730247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad2aaed4-3a1c-4822-8398-d05ae0bb08f8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:02.753436 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad2aaed4-3a1c-4822-8398-d05ae0bb08f8 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1317 microversion: 2.1 time: 0.367810 Mar 12 20:58:02.754099 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1807/2575] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:02 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:02.777384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-62a594c1-e98f-4e93-b270-4e4ca020abd9 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:02.778256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-62a594c1-e98f-4e93-b270-4e4ca020abd9 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:02.790543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62a594c1-e98f-4e93-b270-4e4ca020abd9 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:02.790967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62a594c1-e98f-4e93-b270-4e4ca020abd9 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:02.791764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62a594c1-e98f-4e93-b270-4e4ca020abd9 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:02.792207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62a594c1-e98f-4e93-b270-4e4ca020abd9 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:03.263602 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-62a594c1-e98f-4e93-b270-4e4ca020abd9 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864" status: 200 len: 1620 microversion: 2.1 time: 0.508417 Mar 12 20:58:03.264192 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1808/2576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:02 2022] GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864 => generated 1620 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:03.283367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-167d4dcd-de3a-4a20-acbf-2c8ee867902d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:03.284022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-167d4dcd-de3a-4a20-acbf-2c8ee867902d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] [instance: 49ed298c-3e5a-4f2c-930f-7d7feb65126c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:03.295665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-167d4dcd-de3a-4a20-acbf-2c8ee867902d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:03.298129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-167d4dcd-de3a-4a20-acbf-2c8ee867902d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:03.300180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-167d4dcd-de3a-4a20-acbf-2c8ee867902d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:03.303867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-167d4dcd-de3a-4a20-acbf-2c8ee867902d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:03.739118 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-167d4dcd-de3a-4a20-acbf-2c8ee867902d tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/49ed298c-3e5a-4f2c-930f-7d7feb65126c" status: 200 len: 1620 microversion: 2.1 time: 0.460623 Mar 12 20:58:03.747660 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1809/2577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:03 2022] GET /compute/v2.1/servers/49ed298c-3e5a-4f2c-930f-7d7feb65126c => generated 1620 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:03.757340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-714b63fb-8eeb-4e6d-a2f7-8cf4c74b4564 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:03.758453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-714b63fb-8eeb-4e6d-a2f7-8cf4c74b4564 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:03.780497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-714b63fb-8eeb-4e6d-a2f7-8cf4c74b4564 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:03.781625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-714b63fb-8eeb-4e6d-a2f7-8cf4c74b4564 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:03.782943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-714b63fb-8eeb-4e6d-a2f7-8cf4c74b4564 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:03.783901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-714b63fb-8eeb-4e6d-a2f7-8cf4c74b4564 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:04.231590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-714b63fb-8eeb-4e6d-a2f7-8cf4c74b4564 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3da84d6d8e240418c4aa8ad06711f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60bde3d648c3b37be99cf893a073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:04.244461 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-714b63fb-8eeb-4e6d-a2f7-8cf4c74b4564 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de" status: 200 len: 1316 microversion: 2.1 time: 0.495615 Mar 12 20:58:04.245950 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1810/2578] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:03 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:04.250891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8afb372-e5aa-48f2-9602-d44f0584cc86 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:04.252070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8afb372-e5aa-48f2-9602-d44f0584cc86 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:04.260266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8afb372-e5aa-48f2-9602-d44f0584cc86 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:04.260971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8afb372-e5aa-48f2-9602-d44f0584cc86 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:04.262365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8afb372-e5aa-48f2-9602-d44f0584cc86 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:04.263016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8afb372-e5aa-48f2-9602-d44f0584cc86 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:04.669568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c8afb372-e5aa-48f2-9602-d44f0584cc86 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:04.684157 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8afb372-e5aa-48f2-9602-d44f0584cc86 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1317 microversion: 2.1 time: 0.436875 Mar 12 20:58:04.688000 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1811/2579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:04 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:04.705115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-92422994", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "4979bdb6-1c95-4d29-909c-194f16259f42"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:04.782821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:58:05.840752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:05.842250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:05.843481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:05.843621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:05.843996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:05.864928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:05.866331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:05.867322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:05.868336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:05.894411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:05.901235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:05.915947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:58:05.918472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:58:05.981121 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cf40132c-044d-4751-96c0-50e8e8bfe0d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.284924 Mar 12 20:58:05.982250 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1812/2580] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:58:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:58:06.225479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ded20de-9e8e-4cf9-8e55-50239b1787b5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Action: 'create', calling method: .version_select at 0x7f6e3769b0d0>, body: {"keypair": {"name": "tempest-keypair-1103388820"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:06.262509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9ded20de-9e8e-4cf9-8e55-50239b1787b5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Getting quotas for project b4da7920d54243cd8381e283021d7745. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:06.277914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9ded20de-9e8e-4cf9-8e55-50239b1787b5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Getting quotas for user ec384ea1fe344a08a8b9491f10f3b211 and project b4da7920d54243cd8381e283021d7745. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:06.974388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9ded20de-9e8e-4cf9-8e55-50239b1787b5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Getting quotas for project b4da7920d54243cd8381e283021d7745. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:06.981727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9ded20de-9e8e-4cf9-8e55-50239b1787b5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Getting quotas for user ec384ea1fe344a08a8b9491f10f3b211 and project b4da7920d54243cd8381e283021d7745. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:07.011611 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ded20de-9e8e-4cf9-8e55-50239b1787b5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.027603 Mar 12 20:58:07.012279 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1813/2581] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:58:05 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:07.043481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-92cb9bac-239c-4f0f-8b8b-3d77a19bfff2 req-63dea8c2-43dc-452b-b934-c533700b5e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de07409-369a-4686-9c06-7627d6f500fd", "name": "network-vif-plugged", "status": "completed", "tag": "311242c0-e8db-4f1a-b67c-30feecab67fd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:07.068462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-92cb9bac-239c-4f0f-8b8b-3d77a19bfff2 req-63dea8c2-43dc-452b-b934-c533700b5e54 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:07.069235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-92cb9bac-239c-4f0f-8b8b-3d77a19bfff2 req-63dea8c2-43dc-452b-b934-c533700b5e54 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:07.097008 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-92cb9bac-239c-4f0f-8b8b-3d77a19bfff2 req-63dea8c2-43dc-452b-b934-c533700b5e54 service nova] Creating event network-vif-plugged:311242c0-e8db-4f1a-b67c-30feecab67fd for instance 3de07409-369a-4686-9c06-7627d6f500fd on nch2-master-1 Mar 12 20:58:07.109521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-92cb9bac-239c-4f0f-8b8b-3d77a19bfff2 req-63dea8c2-43dc-452b-b934-c533700b5e54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092558 Mar 12 20:58:07.112197 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1814/2582] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:07.126708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-611afe3b-da3d-40f7-89cd-5a356a018826 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:07.127432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-611afe3b-da3d-40f7-89cd-5a356a018826 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:07.152622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-611afe3b-da3d-40f7-89cd-5a356a018826 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:07.153473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-611afe3b-da3d-40f7-89cd-5a356a018826 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:07.154695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-611afe3b-da3d-40f7-89cd-5a356a018826 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:07.155429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-611afe3b-da3d-40f7-89cd-5a356a018826 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:07.686162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-611afe3b-da3d-40f7-89cd-5a356a018826 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3da84d6d8e240418c4aa8ad06711f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60bde3d648c3b37be99cf893a073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:07.700164 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-611afe3b-da3d-40f7-89cd-5a356a018826 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de" status: 200 len: 1316 microversion: 2.1 time: 0.584299 Mar 12 20:58:07.705954 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1815/2583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:07 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:07.718639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-af55882a-d1d6-43fb-b11b-c4a2da8de64b req-8aae3c85-27ee-4ce5-a28a-05b0e7fc4e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e143847-c1bf-46aa-9566-63ee1abad6de", "tag": "9aa103ae-2149-4294-bf15-57e730d1ad20"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:07.732195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-af55882a-d1d6-43fb-b11b-c4a2da8de64b req-8aae3c85-27ee-4ce5-a28a-05b0e7fc4e3e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:07.732896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-af55882a-d1d6-43fb-b11b-c4a2da8de64b req-8aae3c85-27ee-4ce5-a28a-05b0e7fc4e3e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:07.750466 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-af55882a-d1d6-43fb-b11b-c4a2da8de64b req-8aae3c85-27ee-4ce5-a28a-05b0e7fc4e3e service nova] Creating event network-changed:9aa103ae-2149-4294-bf15-57e730d1ad20 for instance 5e143847-c1bf-46aa-9566-63ee1abad6de on nch1-master-1 Mar 12 20:58:07.758158 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-af55882a-d1d6-43fb-b11b-c4a2da8de64b req-8aae3c85-27ee-4ce5-a28a-05b0e7fc4e3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047789 Mar 12 20:58:07.759513 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1816/2584] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:07.767744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-efc1bb2d-f2ef-4e26-88a4-aeaae1a86311 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:07.768745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-efc1bb2d-f2ef-4e26-88a4-aeaae1a86311 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:07.778206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efc1bb2d-f2ef-4e26-88a4-aeaae1a86311 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:07.779692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efc1bb2d-f2ef-4e26-88a4-aeaae1a86311 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:07.781194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efc1bb2d-f2ef-4e26-88a4-aeaae1a86311 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:07.782194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efc1bb2d-f2ef-4e26-88a4-aeaae1a86311 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:08.533805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-efc1bb2d-f2ef-4e26-88a4-aeaae1a86311 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:08.564773 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-efc1bb2d-f2ef-4e26-88a4-aeaae1a86311 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1317 microversion: 2.1 time: 0.803701 Mar 12 20:58:08.571587 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1817/2585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:07 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1317 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:08.585413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c9f073ca-c6be-4ed6-942b-b5d193a70568 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:08.586151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c9f073ca-c6be-4ed6-942b-b5d193a70568 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:08.595345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9f073ca-c6be-4ed6-942b-b5d193a70568 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:08.595851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9f073ca-c6be-4ed6-942b-b5d193a70568 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:08.596896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9f073ca-c6be-4ed6-942b-b5d193a70568 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:08.597348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9f073ca-c6be-4ed6-942b-b5d193a70568 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:08.829090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c9f073ca-c6be-4ed6-942b-b5d193a70568 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:08.840990 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c9f073ca-c6be-4ed6-942b-b5d193a70568 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731" status: 200 len: 1273 microversion: 2.1 time: 0.260468 Mar 12 20:58:08.842303 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1818/2586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:08 2022] GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731 => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:08.986607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1793297865", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "4023b517-1da4-4a46-823d-8ac0c5033a09"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:09.098056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] validate_networks() for [('4023b517-1da4-4a46-823d-8ac0c5033a09', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:58:10.435397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:10.436773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:10.437453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:10.438808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:10.440201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:10.462714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:10.463748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:10.465669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:10.466417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:10.505816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Getting quotas for project 84ff5395a6a5454a8ea72a2746c2b196. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:10.527777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Getting quotas for user f4be5e0b42c345288554763a59b7a53f and project 84ff5395a6a5454a8ea72a2746c2b196. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:10.550573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:58:10.554127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:58:10.641587 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-763d00a2-fd82-4809-ad6b-14e1695e5ce3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.797312 Mar 12 20:58:10.652564 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1819/2587] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:58:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:58:10.652564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-65957001-55d9-4229-883b-864c0e17e974 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:10.652564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-65957001-55d9-4229-883b-864c0e17e974 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:10.655691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65957001-55d9-4229-883b-864c0e17e974 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:10.655691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65957001-55d9-4229-883b-864c0e17e974 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:10.656529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65957001-55d9-4229-883b-864c0e17e974 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:10.656980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65957001-55d9-4229-883b-864c0e17e974 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:11.435093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-65957001-55d9-4229-883b-864c0e17e974 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3da84d6d8e240418c4aa8ad06711f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60bde3d648c3b37be99cf893a073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:11.444489 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-65957001-55d9-4229-883b-864c0e17e974 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de" status: 200 len: 1316 microversion: 2.1 time: 0.800651 Mar 12 20:58:11.446450 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1820/2588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:10 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de => generated 1316 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:11.453174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6edb9faa-fe3c-4ab8-9e9f-4a78efa3bb30 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:11.454085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6edb9faa-fe3c-4ab8-9e9f-4a78efa3bb30 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:11.466538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6edb9faa-fe3c-4ab8-9e9f-4a78efa3bb30 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:11.467232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6edb9faa-fe3c-4ab8-9e9f-4a78efa3bb30 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:11.468427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6edb9faa-fe3c-4ab8-9e9f-4a78efa3bb30 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:11.469181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6edb9faa-fe3c-4ab8-9e9f-4a78efa3bb30 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:11.744289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6edb9faa-fe3c-4ab8-9e9f-4a78efa3bb30 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:11.756624 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6edb9faa-fe3c-4ab8-9e9f-4a78efa3bb30 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1508 microversion: 2.1 time: 0.308647 Mar 12 20:58:11.757324 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1821/2589] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:11 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1508 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:11.763641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b9e2e569-49b4-4fb3-bfcd-3a9e9a39bf8b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:11.764749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b9e2e569-49b4-4fb3-bfcd-3a9e9a39bf8b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:11.771813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9e2e569-49b4-4fb3-bfcd-3a9e9a39bf8b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:11.772279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9e2e569-49b4-4fb3-bfcd-3a9e9a39bf8b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:11.773636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9e2e569-49b4-4fb3-bfcd-3a9e9a39bf8b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:11.774646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9e2e569-49b4-4fb3-bfcd-3a9e9a39bf8b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:12.014263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b9e2e569-49b4-4fb3-bfcd-3a9e9a39bf8b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:12.025707 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b9e2e569-49b4-4fb3-bfcd-3a9e9a39bf8b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731" status: 200 len: 1315 microversion: 2.1 time: 0.267209 Mar 12 20:58:12.026562 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1822/2590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:11 2022] GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:12.040132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-555520278", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "4023b517-1da4-4a46-823d-8ac0c5033a09"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:12.139241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] validate_networks() for [('4023b517-1da4-4a46-823d-8ac0c5033a09', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:58:12.691264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:12.693039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:12.693661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:12.694470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:12.695310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:12.706576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:12.707269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:12.708032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:12.709384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:12.733349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Getting quotas for project 84ff5395a6a5454a8ea72a2746c2b196. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:12.739047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Getting quotas for user f4be5e0b42c345288554763a59b7a53f and project 84ff5395a6a5454a8ea72a2746c2b196. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:12.753325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:58:12.756104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 326ae42b-a952-4626-b027-90afe2eed7af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:58:12.808460 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-096a7236-cad3-4035-b5c2-c83b971614f3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780458 Mar 12 20:58:12.809234 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1823/2591] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:58:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:58:12.813867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e0114949-2cb0-4009-bbc5-6de8e0858fa8 req-80af25b5-8dc5-428d-b2db-9c63ab646be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8267a50-c543-4753-9f09-3600de6b1731", "tag": "913fb114-5a7c-40d7-9e0c-65f8a9939a1a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:12.824853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e0114949-2cb0-4009-bbc5-6de8e0858fa8 req-80af25b5-8dc5-428d-b2db-9c63ab646be9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:12.825327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e0114949-2cb0-4009-bbc5-6de8e0858fa8 req-80af25b5-8dc5-428d-b2db-9c63ab646be9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:12.859761 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e0114949-2cb0-4009-bbc5-6de8e0858fa8 req-80af25b5-8dc5-428d-b2db-9c63ab646be9 service nova] Creating event network-changed:913fb114-5a7c-40d7-9e0c-65f8a9939a1a for instance b8267a50-c543-4753-9f09-3600de6b1731 on nch1-master-1 Mar 12 20:58:12.868099 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e0114949-2cb0-4009-bbc5-6de8e0858fa8 req-80af25b5-8dc5-428d-b2db-9c63ab646be9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057292 Mar 12 20:58:12.873817 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1824/2592] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:12.881098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1803198787", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fca288f-5c1f-4dae-b9c3-eaca1253f073"}], "security_groups": [{"name": "tempest-securitygroup--358252068"}], "key_name": "tempest-keypair-1103388820", "user_data": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:13.074446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] validate_networks() for [('2fca288f-5c1f-4dae-b9c3-eaca1253f073', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:58:14.016535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:14.017163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:14.017687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:14.018151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:14.018569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:14.038626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:14.040754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:14.042560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:14.049281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:14.095187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Getting quotas for project b4da7920d54243cd8381e283021d7745. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:14.101823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Getting quotas for user ec384ea1fe344a08a8b9491f10f3b211 and project b4da7920d54243cd8381e283021d7745. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:14.129049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:58:14.134764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:58:14.230277 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-556e0944-6c2e-42b6-8c2e-b0a7163bddb0 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.354878 Mar 12 20:58:14.230958 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1825/2593] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:58:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:58:14.261054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9448de61-4900-4cbe-8559-26928e52806a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:14.263067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9448de61-4900-4cbe-8559-26928e52806a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:14.277336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9448de61-4900-4cbe-8559-26928e52806a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:14.278373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9448de61-4900-4cbe-8559-26928e52806a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:14.279671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9448de61-4900-4cbe-8559-26928e52806a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:14.280290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9448de61-4900-4cbe-8559-26928e52806a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:14.704915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9448de61-4900-4cbe-8559-26928e52806a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:14.716524 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9448de61-4900-4cbe-8559-26928e52806a tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1508 microversion: 2.1 time: 0.476317 Mar 12 20:58:14.717277 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1826/2594] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:14 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1508 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:14.726542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da42173b-6b4a-4be6-8d98-62bd83c48e6f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:14.727729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da42173b-6b4a-4be6-8d98-62bd83c48e6f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:14.735816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da42173b-6b4a-4be6-8d98-62bd83c48e6f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:14.736263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da42173b-6b4a-4be6-8d98-62bd83c48e6f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:14.737888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da42173b-6b4a-4be6-8d98-62bd83c48e6f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:14.738481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da42173b-6b4a-4be6-8d98-62bd83c48e6f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:14.959665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da42173b-6b4a-4be6-8d98-62bd83c48e6f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3da84d6d8e240418c4aa8ad06711f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60bde3d648c3b37be99cf893a073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:14.970557 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da42173b-6b4a-4be6-8d98-62bd83c48e6f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de" status: 200 len: 1316 microversion: 2.1 time: 0.252385 Mar 12 20:58:14.971178 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1827/2595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:14 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:14.985694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1419965504", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "451", "networks": [{"uuid": "4023b517-1da4-4a46-823d-8ac0c5033a09"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:15.050211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] validate_networks() for [('4023b517-1da4-4a46-823d-8ac0c5033a09', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:58:15.805606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:15.806360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:15.807078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:15.807722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:15.808336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:15.826074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:15.827011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:15.828046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:15.832713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:15.881121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Getting quotas for project 84ff5395a6a5454a8ea72a2746c2b196. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:15.891097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Getting quotas for user f4be5e0b42c345288554763a59b7a53f and project 84ff5395a6a5454a8ea72a2746c2b196. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:15.913019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:58:15.916791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:58:15.998904 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d7476ca0-82c8-40fd-acae-865d82fc9641 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026651 Mar 12 20:58:15.999563 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1828/2596] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:58:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:58:16.006140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-367a870b-f932-4274-828d-8f116bc3ca27 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:16.016487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-367a870b-f932-4274-828d-8f116bc3ca27 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:16.024042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-367a870b-f932-4274-828d-8f116bc3ca27 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:16.025039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-367a870b-f932-4274-828d-8f116bc3ca27 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:16.025861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-367a870b-f932-4274-828d-8f116bc3ca27 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:16.026664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-367a870b-f932-4274-828d-8f116bc3ca27 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:16.726533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-367a870b-f932-4274-828d-8f116bc3ca27 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:16.737453 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-367a870b-f932-4274-828d-8f116bc3ca27 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731" status: 200 len: 1315 microversion: 2.1 time: 0.736636 Mar 12 20:58:16.750365 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1829/2597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:15 2022] GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:16.763594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ef0f3ae7-f6fd-4237-8d7c-731f132a089c req-23fac32a-93da-49bb-b36f-bd466a43ea33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "460d935d-1340-4a97-8a3f-16a589c5d9c2", "tag": "6c4c4034-d1c8-4fc0-a67f-2c2cc7c8495b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:16.784513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ef0f3ae7-f6fd-4237-8d7c-731f132a089c req-23fac32a-93da-49bb-b36f-bd466a43ea33 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:16.786906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ef0f3ae7-f6fd-4237-8d7c-731f132a089c req-23fac32a-93da-49bb-b36f-bd466a43ea33 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:16.818460 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ef0f3ae7-f6fd-4237-8d7c-731f132a089c req-23fac32a-93da-49bb-b36f-bd466a43ea33 service nova] Creating event network-changed:6c4c4034-d1c8-4fc0-a67f-2c2cc7c8495b for instance 460d935d-1340-4a97-8a3f-16a589c5d9c2 on nch2-master-1 Mar 12 20:58:16.838258 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ef0f3ae7-f6fd-4237-8d7c-731f132a089c req-23fac32a-93da-49bb-b36f-bd466a43ea33 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092967 Mar 12 20:58:16.839698 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1830/2598] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:16.845954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fc7a126f-26b9-4b2a-93c4-b7236bcf32c2 req-f5458e18-a396-4347-ba62-6d43276f0148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e143847-c1bf-46aa-9566-63ee1abad6de", "name": "network-vif-plugged", "status": "completed", "tag": "9aa103ae-2149-4294-bf15-57e730d1ad20"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:16.876414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fc7a126f-26b9-4b2a-93c4-b7236bcf32c2 req-f5458e18-a396-4347-ba62-6d43276f0148 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:16.877128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fc7a126f-26b9-4b2a-93c4-b7236bcf32c2 req-f5458e18-a396-4347-ba62-6d43276f0148 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:16.895005 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fc7a126f-26b9-4b2a-93c4-b7236bcf32c2 req-f5458e18-a396-4347-ba62-6d43276f0148 service nova] Creating event network-vif-plugged:9aa103ae-2149-4294-bf15-57e730d1ad20 for instance 5e143847-c1bf-46aa-9566-63ee1abad6de on nch1-master-1 Mar 12 20:58:16.906884 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fc7a126f-26b9-4b2a-93c4-b7236bcf32c2 req-f5458e18-a396-4347-ba62-6d43276f0148 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063023 Mar 12 20:58:16.909495 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1831/2599] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:16.936338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e9bb4fb1-f3c1-451b-8176-090f651eb05f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:16.937577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e9bb4fb1-f3c1-451b-8176-090f651eb05f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:16.947378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9bb4fb1-f3c1-451b-8176-090f651eb05f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:16.948153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9bb4fb1-f3c1-451b-8176-090f651eb05f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:16.949281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9bb4fb1-f3c1-451b-8176-090f651eb05f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:16.950438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9bb4fb1-f3c1-451b-8176-090f651eb05f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:17.300615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e9bb4fb1-f3c1-451b-8176-090f651eb05f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:17.320205 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e9bb4fb1-f3c1-451b-8176-090f651eb05f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1363 microversion: 2.1 time: 0.407679 Mar 12 20:58:17.323436 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1832/2600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:16 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1363 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:17.329185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c920bb45-b962-43ed-a28a-beb522977255 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:17.330884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c920bb45-b962-43ed-a28a-beb522977255 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:17.351808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c920bb45-b962-43ed-a28a-beb522977255 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:17.355400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c920bb45-b962-43ed-a28a-beb522977255 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:17.357519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c920bb45-b962-43ed-a28a-beb522977255 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:17.358610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c920bb45-b962-43ed-a28a-beb522977255 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:17.469967 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c920bb45-b962-43ed-a28a-beb522977255 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "PUT /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1080 microversion: 2.1 time: 0.144783 Mar 12 20:58:17.470951 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1833/2601] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Mar 12 20:58:17 2022] PUT /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1080 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:17.476748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be222cd2-7d01-4e82-9e23-508ae9014d0f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:17.478172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-be222cd2-7d01-4e82-9e23-508ae9014d0f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:17.488928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be222cd2-7d01-4e82-9e23-508ae9014d0f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:17.489393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be222cd2-7d01-4e82-9e23-508ae9014d0f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:17.490500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be222cd2-7d01-4e82-9e23-508ae9014d0f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:17.491179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be222cd2-7d01-4e82-9e23-508ae9014d0f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:17.673597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be222cd2-7d01-4e82-9e23-508ae9014d0f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3da84d6d8e240418c4aa8ad06711f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60bde3d648c3b37be99cf893a073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:17.688343 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be222cd2-7d01-4e82-9e23-508ae9014d0f tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de" status: 200 len: 1316 microversion: 2.1 time: 0.216074 Mar 12 20:58:17.689674 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1834/2602] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:17 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:17.695509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04236438-2d85-4c7e-b01b-9357ab66c811 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:17.696908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04236438-2d85-4c7e-b01b-9357ab66c811 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:17.705980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04236438-2d85-4c7e-b01b-9357ab66c811 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:17.706472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04236438-2d85-4c7e-b01b-9357ab66c811 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:17.707272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04236438-2d85-4c7e-b01b-9357ab66c811 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:17.707720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04236438-2d85-4c7e-b01b-9357ab66c811 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:17.811079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04236438-2d85-4c7e-b01b-9357ab66c811 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:17.823329 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04236438-2d85-4c7e-b01b-9357ab66c811 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1273 microversion: 2.1 time: 0.131990 Mar 12 20:58:17.823872 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1835/2603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:17 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:17.839253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f8448a69-3310-49f5-87f0-d18da2db5f8e req-4880e725-8091-4c29-b550-1cd62695b45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "326ae42b-a952-4626-b027-90afe2eed7af", "tag": "fa889e48-e7a7-41ed-8296-e78010afb112"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:17.849323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f8448a69-3310-49f5-87f0-d18da2db5f8e req-4880e725-8091-4c29-b550-1cd62695b45f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:17.850140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f8448a69-3310-49f5-87f0-d18da2db5f8e req-4880e725-8091-4c29-b550-1cd62695b45f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:17.868827 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f8448a69-3310-49f5-87f0-d18da2db5f8e req-4880e725-8091-4c29-b550-1cd62695b45f service nova] Creating event network-changed:fa889e48-e7a7-41ed-8296-e78010afb112 for instance 326ae42b-a952-4626-b027-90afe2eed7af on nch1-master-1 Mar 12 20:58:17.875627 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f8448a69-3310-49f5-87f0-d18da2db5f8e req-4880e725-8091-4c29-b550-1cd62695b45f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040580 Mar 12 20:58:17.882657 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1836/2604] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:17.909371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-08d4c572-33e4-47b5-a340-5550f7055478 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:17.910414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-08d4c572-33e4-47b5-a340-5550f7055478 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:17.934380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08d4c572-33e4-47b5-a340-5550f7055478 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:17.935175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08d4c572-33e4-47b5-a340-5550f7055478 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:17.936207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08d4c572-33e4-47b5-a340-5550f7055478 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:17.936907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08d4c572-33e4-47b5-a340-5550f7055478 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:18.310364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-08d4c572-33e4-47b5-a340-5550f7055478 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:18.320230 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-08d4c572-33e4-47b5-a340-5550f7055478 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1506 microversion: 2.1 time: 0.431938 Mar 12 20:58:18.334498 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1837/2605] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:17 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:18.340907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80a772b8-8462-4575-a017-c87f367c11eb tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:18.341569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80a772b8-8462-4575-a017-c87f367c11eb tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:18.354036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80a772b8-8462-4575-a017-c87f367c11eb tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:18.355814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80a772b8-8462-4575-a017-c87f367c11eb tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:18.357633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80a772b8-8462-4575-a017-c87f367c11eb tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:18.358366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80a772b8-8462-4575-a017-c87f367c11eb tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:18.608372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80a772b8-8462-4575-a017-c87f367c11eb tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:18.618477 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80a772b8-8462-4575-a017-c87f367c11eb tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731" status: 200 len: 1315 microversion: 2.1 time: 0.282775 Mar 12 20:58:18.629324 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1838/2606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:18 2022] GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:18.636612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-89dfd83e-8724-4623-84e7-0edddb5db3c4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:18.637564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89dfd83e-8724-4623-84e7-0edddb5db3c4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:18.644698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89dfd83e-8724-4623-84e7-0edddb5db3c4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:18.645218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89dfd83e-8724-4623-84e7-0edddb5db3c4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:18.646084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89dfd83e-8724-4623-84e7-0edddb5db3c4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:18.646555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89dfd83e-8724-4623-84e7-0edddb5db3c4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:18.912962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-89dfd83e-8724-4623-84e7-0edddb5db3c4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:18.928104 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-89dfd83e-8724-4623-84e7-0edddb5db3c4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1506 microversion: 2.1 time: 0.296770 Mar 12 20:58:18.930611 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1839/2607] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:18 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:18.945267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bcf62c9a-932f-4978-8de9-f0e421f51c3c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:18.947704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bcf62c9a-932f-4978-8de9-f0e421f51c3c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:18.958186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcf62c9a-932f-4978-8de9-f0e421f51c3c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:18.958653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcf62c9a-932f-4978-8de9-f0e421f51c3c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:18.959696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcf62c9a-932f-4978-8de9-f0e421f51c3c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:18.960172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcf62c9a-932f-4978-8de9-f0e421f51c3c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:19.278859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bcf62c9a-932f-4978-8de9-f0e421f51c3c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:19.289211 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bcf62c9a-932f-4978-8de9-f0e421f51c3c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1363 microversion: 2.1 time: 0.352023 Mar 12 20:58:19.299015 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1840/2608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:18 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:19.310237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fa1415b1-b4a9-4481-b802-fb378af1e8dc tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:19.314197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fa1415b1-b4a9-4481-b802-fb378af1e8dc tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:19.326954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa1415b1-b4a9-4481-b802-fb378af1e8dc tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:19.327474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa1415b1-b4a9-4481-b802-fb378af1e8dc tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:19.328351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa1415b1-b4a9-4481-b802-fb378af1e8dc tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:19.328893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa1415b1-b4a9-4481-b802-fb378af1e8dc tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:19.649035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fa1415b1-b4a9-4481-b802-fb378af1e8dc tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3da84d6d8e240418c4aa8ad06711f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60bde3d648c3b37be99cf893a073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:19.657384 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fa1415b1-b4a9-4481-b802-fb378af1e8dc tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de" status: 200 len: 1505 microversion: 2.1 time: 0.356837 Mar 12 20:58:19.658383 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1841/2609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:19 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:19.664321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0943ab37-6a2d-4cd5-82c8-c15e631e9f47 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:19.665356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0943ab37-6a2d-4cd5-82c8-c15e631e9f47 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:19.672383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0943ab37-6a2d-4cd5-82c8-c15e631e9f47 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:19.673106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0943ab37-6a2d-4cd5-82c8-c15e631e9f47 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:19.674161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0943ab37-6a2d-4cd5-82c8-c15e631e9f47 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:19.675167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0943ab37-6a2d-4cd5-82c8-c15e631e9f47 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:19.955226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0943ab37-6a2d-4cd5-82c8-c15e631e9f47 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:19.968449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0943ab37-6a2d-4cd5-82c8-c15e631e9f47 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1321 microversion: 2.1 time: 0.308778 Mar 12 20:58:19.969326 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1842/2610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:19 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:19.974755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5eacbee4-ef70-463e-9471-ac45993f8b92 req-2825ad0c-bc64-4163-948e-66d7573ebe65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8267a50-c543-4753-9f09-3600de6b1731", "name": "network-vif-plugged", "status": "completed", "tag": "913fb114-5a7c-40d7-9e0c-65f8a9939a1a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:20.000650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5eacbee4-ef70-463e-9471-ac45993f8b92 req-2825ad0c-bc64-4163-948e-66d7573ebe65 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:20.001107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5eacbee4-ef70-463e-9471-ac45993f8b92 req-2825ad0c-bc64-4163-948e-66d7573ebe65 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:20.014699 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5eacbee4-ef70-463e-9471-ac45993f8b92 req-2825ad0c-bc64-4163-948e-66d7573ebe65 service nova] Creating event network-vif-plugged:913fb114-5a7c-40d7-9e0c-65f8a9939a1a for instance b8267a50-c543-4753-9f09-3600de6b1731 on nch1-master-1 Mar 12 20:58:20.032065 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5eacbee4-ef70-463e-9471-ac45993f8b92 req-2825ad0c-bc64-4163-948e-66d7573ebe65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060078 Mar 12 20:58:20.035886 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1843/2611] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:20.049612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:20.061441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:20.077516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:20.078296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:20.079328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:20.080275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:20.200694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:20.201122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:20.201607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:20.202054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:20.202774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:20.284957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:20.292576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:20.293048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:20.294106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:20.294705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:20.333116 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56d49956-d3f1-4551-9230-8cdf9cd60361 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "POST /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd/action" status: 202 len: 1112 microversion: 2.1 time: 0.295866 Mar 12 20:58:20.334044 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1844/2612] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:58:20 2022] POST /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd/action => generated 1112 bytes in 298 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 12 20:58:20.351166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-871013d8-a5ec-4b4e-b681-7262a17474f4 req-47dc2cb2-5c68-4f33-b4ee-f7726d536312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f2e6c22-dc3b-4733-ba22-ab6fe0f70069", "tag": "2237d806-1e27-4862-a4ba-b751d1cb1c1d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:20.361690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-871013d8-a5ec-4b4e-b681-7262a17474f4 req-47dc2cb2-5c68-4f33-b4ee-f7726d536312 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:20.362192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-871013d8-a5ec-4b4e-b681-7262a17474f4 req-47dc2cb2-5c68-4f33-b4ee-f7726d536312 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:20.395567 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-871013d8-a5ec-4b4e-b681-7262a17474f4 req-47dc2cb2-5c68-4f33-b4ee-f7726d536312 service nova] Creating event network-changed:2237d806-1e27-4862-a4ba-b751d1cb1c1d for instance 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 on nch2-master-1 Mar 12 20:58:20.406007 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-871013d8-a5ec-4b4e-b681-7262a17474f4 req-47dc2cb2-5c68-4f33-b4ee-f7726d536312 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058696 Mar 12 20:58:20.406862 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1845/2613] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:20.422889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-466a7233-99de-492c-afaa-1ce7fee2826e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:20.423760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-466a7233-99de-492c-afaa-1ce7fee2826e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:20.430908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-466a7233-99de-492c-afaa-1ce7fee2826e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:20.431649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-466a7233-99de-492c-afaa-1ce7fee2826e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:20.432168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-466a7233-99de-492c-afaa-1ce7fee2826e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:20.432640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-466a7233-99de-492c-afaa-1ce7fee2826e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:20.670966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-466a7233-99de-492c-afaa-1ce7fee2826e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:20.680709 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-466a7233-99de-492c-afaa-1ce7fee2826e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731" status: 200 len: 1315 microversion: 2.1 time: 0.272034 Mar 12 20:58:20.681836 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1846/2614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:20 2022] GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:20.697673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ba23fbad-ddd4-4ce4-8ae7-a278811eea2d tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:20.698417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ba23fbad-ddd4-4ce4-8ae7-a278811eea2d tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:20.708698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba23fbad-ddd4-4ce4-8ae7-a278811eea2d tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:20.709474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba23fbad-ddd4-4ce4-8ae7-a278811eea2d tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:20.712316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba23fbad-ddd4-4ce4-8ae7-a278811eea2d tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:20.712790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba23fbad-ddd4-4ce4-8ae7-a278811eea2d tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:20.747039 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ba23fbad-ddd4-4ce4-8ae7-a278811eea2d tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de/ips" status: 200 len: 109 microversion: 2.1 time: 0.053876 Mar 12 20:58:20.748184 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1847/2615] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 20:58:20 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de/ips => generated 109 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:20.756287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8080bba9-46d3-46ef-8991-477fa5ac1642 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:20.756287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8080bba9-46d3-46ef-8991-477fa5ac1642 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:20.763713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8080bba9-46d3-46ef-8991-477fa5ac1642 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:20.764383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8080bba9-46d3-46ef-8991-477fa5ac1642 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:20.765235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8080bba9-46d3-46ef-8991-477fa5ac1642 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:20.765678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8080bba9-46d3-46ef-8991-477fa5ac1642 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.031448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8080bba9-46d3-46ef-8991-477fa5ac1642 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:21.041437 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8080bba9-46d3-46ef-8991-477fa5ac1642 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1363 microversion: 2.1 time: 0.292530 Mar 12 20:58:21.042061 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1848/2616] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:20 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:21.046700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6582d30d-dca2-4c98-a45f-c53232247672 req-fb3d2c05-f7c4-4765-a5d7-f6d2d9c21d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089", "tag": "f228fcf1-33a8-4130-bbcd-d7790e0ed18e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:21.058618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6582d30d-dca2-4c98-a45f-c53232247672 req-fb3d2c05-f7c4-4765-a5d7-f6d2d9c21d4a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.059155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6582d30d-dca2-4c98-a45f-c53232247672 req-fb3d2c05-f7c4-4765-a5d7-f6d2d9c21d4a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.074833 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6582d30d-dca2-4c98-a45f-c53232247672 req-fb3d2c05-f7c4-4765-a5d7-f6d2d9c21d4a service nova] Creating event network-changed:f228fcf1-33a8-4130-bbcd-d7790e0ed18e for instance 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 on nch1-master-1 Mar 12 20:58:21.080127 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6582d30d-dca2-4c98-a45f-c53232247672 req-fb3d2c05-f7c4-4765-a5d7-f6d2d9c21d4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036755 Mar 12 20:58:21.081055 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1849/2617] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:21.086937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-def7d6ee-5442-4596-b908-23603b632eef tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:21.087733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-def7d6ee-5442-4596-b908-23603b632eef tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:21.094215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-def7d6ee-5442-4596-b908-23603b632eef tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.095027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-def7d6ee-5442-4596-b908-23603b632eef tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.095891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-def7d6ee-5442-4596-b908-23603b632eef tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.096363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-def7d6ee-5442-4596-b908-23603b632eef tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.316232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-def7d6ee-5442-4596-b908-23603b632eef tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:21.326206 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-def7d6ee-5442-4596-b908-23603b632eef tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1517 microversion: 2.1 time: 0.243671 Mar 12 20:58:21.330116 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1850/2618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:21 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1517 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:21.340354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cfbce875-ecde-46b6-9681-0c7be2fc1ecb tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:21.340813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cfbce875-ecde-46b6-9681-0c7be2fc1ecb tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:21.347520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfbce875-ecde-46b6-9681-0c7be2fc1ecb tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.348120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfbce875-ecde-46b6-9681-0c7be2fc1ecb tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.348913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfbce875-ecde-46b6-9681-0c7be2fc1ecb tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.349353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfbce875-ecde-46b6-9681-0c7be2fc1ecb tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.378966 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cfbce875-ecde-46b6-9681-0c7be2fc1ecb tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de/ips" status: 200 len: 109 microversion: 2.1 time: 0.047162 Mar 12 20:58:21.385109 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1851/2619] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 20:58:21 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de/ips => generated 109 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:21.388560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ebae5707-a494-464f-a034-09bdf6495c9b tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:21.390430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ebae5707-a494-464f-a034-09bdf6495c9b tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:21.402126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebae5707-a494-464f-a034-09bdf6495c9b tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.402811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebae5707-a494-464f-a034-09bdf6495c9b tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.403446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebae5707-a494-464f-a034-09bdf6495c9b tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.403904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebae5707-a494-464f-a034-09bdf6495c9b tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.663901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ebae5707-a494-464f-a034-09bdf6495c9b tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:21.672529 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ebae5707-a494-464f-a034-09bdf6495c9b tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1321 microversion: 2.1 time: 0.290906 Mar 12 20:58:21.673159 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1852/2620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:21 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:21.677709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d4c7e7f5-37f4-4f42-aa5b-f2717e4b9c9e tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:21.678523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d4c7e7f5-37f4-4f42-aa5b-f2717e4b9c9e tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:21.685363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4c7e7f5-37f4-4f42-aa5b-f2717e4b9c9e tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.685888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4c7e7f5-37f4-4f42-aa5b-f2717e4b9c9e tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.686831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4c7e7f5-37f4-4f42-aa5b-f2717e4b9c9e tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.687301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4c7e7f5-37f4-4f42-aa5b-f2717e4b9c9e tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.717015 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d4c7e7f5-37f4-4f42-aa5b-f2717e4b9c9e tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de/ips/tempest-ServerAddressesTestJSON-1816010955-network" status: 200 len: 94 microversion: 2.1 time: 0.042694 Mar 12 20:58:21.723902 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1853/2621] 10.222.0.30 () {58 vars in 1400 bytes} [Sat Mar 12 20:58:21 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de/ips/tempest-ServerAddressesTestJSON-1816010955-network => generated 94 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:58:21.723902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ab2b788-8064-45a5-ad14-fe217d6e6203 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:21.723902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ab2b788-8064-45a5-ad14-fe217d6e6203 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:21.730722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ab2b788-8064-45a5-ad14-fe217d6e6203 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.731373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ab2b788-8064-45a5-ad14-fe217d6e6203 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.732214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ab2b788-8064-45a5-ad14-fe217d6e6203 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.732702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ab2b788-8064-45a5-ad14-fe217d6e6203 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.963889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ab2b788-8064-45a5-ad14-fe217d6e6203 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:21.972759 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ab2b788-8064-45a5-ad14-fe217d6e6203 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731" status: 200 len: 1315 microversion: 2.1 time: 0.253712 Mar 12 20:58:21.973524 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1854/2622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:21 2022] GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:21.979219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a31386a5-d7b5-459a-8f6e-591b2736dd67 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:21.980312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a31386a5-d7b5-459a-8f6e-591b2736dd67 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:21.988215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a31386a5-d7b5-459a-8f6e-591b2736dd67 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.988713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a31386a5-d7b5-459a-8f6e-591b2736dd67 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:21.989646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a31386a5-d7b5-459a-8f6e-591b2736dd67 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:21.990114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a31386a5-d7b5-459a-8f6e-591b2736dd67 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:22.017410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a31386a5-d7b5-459a-8f6e-591b2736dd67 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:58:22.096885 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a31386a5-d7b5-459a-8f6e-591b2736dd67 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de" status: 204 len: 0 microversion: 2.1 time: 0.121729 Mar 12 20:58:22.097586 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1855/2623] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:58:21 2022] DELETE /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:58:22.102949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-897d2368-9823-4a91-baad-59ade651ce2b req-17678908-98a3-4950-a447-1bf28a210d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "460d935d-1340-4a97-8a3f-16a589c5d9c2", "name": "network-vif-plugged", "status": "completed", "tag": "6c4c4034-d1c8-4fc0-a67f-2c2cc7c8495b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:22.111562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-897d2368-9823-4a91-baad-59ade651ce2b req-17678908-98a3-4950-a447-1bf28a210d5b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:22.112091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-897d2368-9823-4a91-baad-59ade651ce2b req-17678908-98a3-4950-a447-1bf28a210d5b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:22.123583 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-897d2368-9823-4a91-baad-59ade651ce2b req-17678908-98a3-4950-a447-1bf28a210d5b service nova] Creating event network-vif-plugged:6c4c4034-d1c8-4fc0-a67f-2c2cc7c8495b for instance 460d935d-1340-4a97-8a3f-16a589c5d9c2 on nch2-master-1 Mar 12 20:58:22.129106 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-897d2368-9823-4a91-baad-59ade651ce2b req-17678908-98a3-4950-a447-1bf28a210d5b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029908 Mar 12 20:58:22.129990 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1856/2624] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:22.135984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12e67f33-9780-4f2f-8579-93c7fdbbd79b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:22.136715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-12e67f33-9780-4f2f-8579-93c7fdbbd79b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:22.144580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12e67f33-9780-4f2f-8579-93c7fdbbd79b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:22.145040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12e67f33-9780-4f2f-8579-93c7fdbbd79b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:22.145930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12e67f33-9780-4f2f-8579-93c7fdbbd79b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:22.146447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12e67f33-9780-4f2f-8579-93c7fdbbd79b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:22.313065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-12e67f33-9780-4f2f-8579-93c7fdbbd79b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:22.322548 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-12e67f33-9780-4f2f-8579-93c7fdbbd79b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1363 microversion: 2.1 time: 0.191335 Mar 12 20:58:22.323210 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1857/2625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:22 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:22.327750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94296558-f675-4920-822e-7e1337807f45 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:22.328361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94296558-f675-4920-822e-7e1337807f45 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:22.334352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94296558-f675-4920-822e-7e1337807f45 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:22.334871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94296558-f675-4920-822e-7e1337807f45 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:22.335701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94296558-f675-4920-822e-7e1337807f45 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:22.338241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94296558-f675-4920-822e-7e1337807f45 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:22.476091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-94296558-f675-4920-822e-7e1337807f45 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3da84d6d8e240418c4aa8ad06711f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60bde3d648c3b37be99cf893a073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:22.484094 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94296558-f675-4920-822e-7e1337807f45 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de" status: 200 len: 1511 microversion: 2.1 time: 0.159940 Mar 12 20:58:22.484665 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1858/2626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:22 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:22.489051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4e3c0819-c940-40d6-854c-27cbd35a70a6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:22.489652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4e3c0819-c940-40d6-854c-27cbd35a70a6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:22.495893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e3c0819-c940-40d6-854c-27cbd35a70a6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:22.496343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e3c0819-c940-40d6-854c-27cbd35a70a6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:22.497107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e3c0819-c940-40d6-854c-27cbd35a70a6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:22.497543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e3c0819-c940-40d6-854c-27cbd35a70a6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:22.645248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4e3c0819-c940-40d6-854c-27cbd35a70a6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:22.653121 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4e3c0819-c940-40d6-854c-27cbd35a70a6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1517 microversion: 2.1 time: 0.167448 Mar 12 20:58:22.653745 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1859/2627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:22 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:22.689326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a989704-8f0b-4fff-a5a3-66b1c65a23b3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:22.689995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a989704-8f0b-4fff-a5a3-66b1c65a23b3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:22.696715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a989704-8f0b-4fff-a5a3-66b1c65a23b3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:22.697170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a989704-8f0b-4fff-a5a3-66b1c65a23b3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:22.697975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a989704-8f0b-4fff-a5a3-66b1c65a23b3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:22.698414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a989704-8f0b-4fff-a5a3-66b1c65a23b3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:22.825424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8a989704-8f0b-4fff-a5a3-66b1c65a23b3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:22.832767 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a989704-8f0b-4fff-a5a3-66b1c65a23b3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1321 microversion: 2.1 time: 0.147184 Mar 12 20:58:22.833337 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1860/2628] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:22 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:22.990980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5bc4060-776c-4546-8f5f-46a8c3d00d87 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:22.991588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f5bc4060-776c-4546-8f5f-46a8c3d00d87 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:22.998361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5bc4060-776c-4546-8f5f-46a8c3d00d87 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:22.998807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5bc4060-776c-4546-8f5f-46a8c3d00d87 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:22.999570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5bc4060-776c-4546-8f5f-46a8c3d00d87 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:23.000007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5bc4060-776c-4546-8f5f-46a8c3d00d87 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:23.139110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f5bc4060-776c-4546-8f5f-46a8c3d00d87 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:23.147960 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5bc4060-776c-4546-8f5f-46a8c3d00d87 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731" status: 200 len: 1465 microversion: 2.1 time: 0.160845 Mar 12 20:58:23.148546 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1861/2629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:22 2022] GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731 => generated 1465 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:23.165139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-05fce36d-18e0-4c6f-96a7-1211eec934a3 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:23.165904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-05fce36d-18e0-4c6f-96a7-1211eec934a3 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:23.171954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05fce36d-18e0-4c6f-96a7-1211eec934a3 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:23.172412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05fce36d-18e0-4c6f-96a7-1211eec934a3 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:23.173193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05fce36d-18e0-4c6f-96a7-1211eec934a3 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:23.173637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05fce36d-18e0-4c6f-96a7-1211eec934a3 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:23.309145 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-05fce36d-18e0-4c6f-96a7-1211eec934a3 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731" status: 200 len: 1616 microversion: 2.1 time: 0.148236 Mar 12 20:58:23.321997 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1862/2630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:23 2022] GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731 => generated 1616 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:23.340244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b038de9c-3255-4b6a-80f6-0aa6981f69e8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:23.340859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b038de9c-3255-4b6a-80f6-0aa6981f69e8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:23.347197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b038de9c-3255-4b6a-80f6-0aa6981f69e8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:23.347647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b038de9c-3255-4b6a-80f6-0aa6981f69e8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:23.348410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b038de9c-3255-4b6a-80f6-0aa6981f69e8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:23.348849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b038de9c-3255-4b6a-80f6-0aa6981f69e8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:23.502057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b038de9c-3255-4b6a-80f6-0aa6981f69e8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:23.510128 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b038de9c-3255-4b6a-80f6-0aa6981f69e8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1363 microversion: 2.1 time: 0.174724 Mar 12 20:58:23.510783 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1863/2631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:23 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:23.515185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1392204375", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["4979bdb6-1c95-4d29-909c-194f16259f42"]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:23.575363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:58:23.836092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:23.837647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:23.838038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:23.838348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:23.838763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:23.852635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:23.853046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:23.854018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:23.854316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:23.875783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:23.881597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:23.902403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:58:23.905639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:58:23.960496 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cd57dbcc-124f-4745-aa03-f2d09b0fac1e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.448608 Mar 12 20:58:23.966882 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1864/2632] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:58:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:58:23.967525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20d31d6c-069c-4c5f-a81c-fa35d85a0f66 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:23.968497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20d31d6c-069c-4c5f-a81c-fa35d85a0f66 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:23.975964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20d31d6c-069c-4c5f-a81c-fa35d85a0f66 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:23.976664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20d31d6c-069c-4c5f-a81c-fa35d85a0f66 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:23.977801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20d31d6c-069c-4c5f-a81c-fa35d85a0f66 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:23.978369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20d31d6c-069c-4c5f-a81c-fa35d85a0f66 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:24.246651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-20d31d6c-069c-4c5f-a81c-fa35d85a0f66 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3da84d6d8e240418c4aa8ad06711f71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069a60bde3d648c3b37be99cf893a073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:24.261395 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20d31d6c-069c-4c5f-a81c-fa35d85a0f66 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de" status: 200 len: 1511 microversion: 2.1 time: 0.297931 Mar 12 20:58:24.262480 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1865/2633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:23 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:24.267930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d3330261-a64e-4816-9083-f7ee00679145 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:24.268730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d3330261-a64e-4816-9083-f7ee00679145 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:24.277116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3330261-a64e-4816-9083-f7ee00679145 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:24.278606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3330261-a64e-4816-9083-f7ee00679145 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:24.279592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3330261-a64e-4816-9083-f7ee00679145 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:24.280372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3330261-a64e-4816-9083-f7ee00679145 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:24.524871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d3330261-a64e-4816-9083-f7ee00679145 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:24.543393 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d3330261-a64e-4816-9083-f7ee00679145 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1517 microversion: 2.1 time: 0.279653 Mar 12 20:58:24.544191 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1866/2634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:24 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1517 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:24.563765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fc3af333-960c-4d58-a6a9-18634f410878 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:24.564212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fc3af333-960c-4d58-a6a9-18634f410878 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:24.570671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc3af333-960c-4d58-a6a9-18634f410878 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:24.571056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc3af333-960c-4d58-a6a9-18634f410878 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:24.571824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc3af333-960c-4d58-a6a9-18634f410878 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:24.572268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc3af333-960c-4d58-a6a9-18634f410878 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:24.751055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fc3af333-960c-4d58-a6a9-18634f410878 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:24.759698 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fc3af333-960c-4d58-a6a9-18634f410878 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1321 microversion: 2.1 time: 0.200412 Mar 12 20:58:24.765835 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1867/2635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:24 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:24.765835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-614922b5-6b08-4b65-83c4-dd57d3330718 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:24.766065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-614922b5-6b08-4b65-83c4-dd57d3330718 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:24.773365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-614922b5-6b08-4b65-83c4-dd57d3330718 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:24.774588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-614922b5-6b08-4b65-83c4-dd57d3330718 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:24.775718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-614922b5-6b08-4b65-83c4-dd57d3330718 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:24.776255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-614922b5-6b08-4b65-83c4-dd57d3330718 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:24.838429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-614922b5-6b08-4b65-83c4-dd57d3330718 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:24.845761 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-614922b5-6b08-4b65-83c4-dd57d3330718 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1213 microversion: 2.1 time: 0.084143 Mar 12 20:58:24.846372 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1868/2636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:24 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:24.851116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6881178c-2a1a-439f-b993-7645c0605a1b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:24.851713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6881178c-2a1a-439f-b993-7645c0605a1b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:24.864564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6881178c-2a1a-439f-b993-7645c0605a1b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:24.865027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6881178c-2a1a-439f-b993-7645c0605a1b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:24.865947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6881178c-2a1a-439f-b993-7645c0605a1b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:24.866782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6881178c-2a1a-439f-b993-7645c0605a1b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:25.007370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6881178c-2a1a-439f-b993-7645c0605a1b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:25.015220 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6881178c-2a1a-439f-b993-7645c0605a1b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1363 microversion: 2.1 time: 0.167918 Mar 12 20:58:25.015794 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1869/2637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:24 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:25.020180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6d49cc4d-8343-49d3-93bc-43355daa2d4d req-3a0c9314-9c3b-4830-8de2-41bea25095cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e143847-c1bf-46aa-9566-63ee1abad6de", "name": "network-vif-deleted", "tag": "9aa103ae-2149-4294-bf15-57e730d1ad20"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:25.028272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6d49cc4d-8343-49d3-93bc-43355daa2d4d req-3a0c9314-9c3b-4830-8de2-41bea25095cc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:25.028662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6d49cc4d-8343-49d3-93bc-43355daa2d4d req-3a0c9314-9c3b-4830-8de2-41bea25095cc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:25.039020 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6d49cc4d-8343-49d3-93bc-43355daa2d4d req-3a0c9314-9c3b-4830-8de2-41bea25095cc service nova] Creating event network-vif-deleted:9aa103ae-2149-4294-bf15-57e730d1ad20 for instance 5e143847-c1bf-46aa-9566-63ee1abad6de on nch1-master-1 Mar 12 20:58:25.044195 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6d49cc4d-8343-49d3-93bc-43355daa2d4d req-3a0c9314-9c3b-4830-8de2-41bea25095cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027198 Mar 12 20:58:25.044768 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1870/2638] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:25.280649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c81c23f-ca16-4d14-8b69-43b1d11c8d10 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:25.281296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c81c23f-ca16-4d14-8b69-43b1d11c8d10 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] [instance: 5e143847-c1bf-46aa-9566-63ee1abad6de] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:25.287776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c81c23f-ca16-4d14-8b69-43b1d11c8d10 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:25.288229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c81c23f-ca16-4d14-8b69-43b1d11c8d10 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:25.289009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c81c23f-ca16-4d14-8b69-43b1d11c8d10 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:25.289456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c81c23f-ca16-4d14-8b69-43b1d11c8d10 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:25.302632 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8c81c23f-ca16-4d14-8b69-43b1d11c8d10 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] HTTP exception thrown: Instance 5e143847-c1bf-46aa-9566-63ee1abad6de could not be found. Mar 12 20:58:25.303121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c81c23f-ca16-4d14-8b69-43b1d11c8d10 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] Returning 404 to user: Instance 5e143847-c1bf-46aa-9566-63ee1abad6de could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:58:25.303987 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c81c23f-ca16-4d14-8b69-43b1d11c8d10 tempest-ServerAddressesTestJSON-1449318150 tempest-ServerAddressesTestJSON-1449318150-project] 10.222.0.30 "GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de" status: 404 len: 111 microversion: 2.1 time: 0.028225 Mar 12 20:58:25.304536 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1871/2639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:25 2022] GET /compute/v2.1/servers/5e143847-c1bf-46aa-9566-63ee1abad6de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:58:25.560726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-931d8bdb-dbcc-4da7-a71e-61ef9989b03d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:25.561385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-931d8bdb-dbcc-4da7-a71e-61ef9989b03d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:25.568022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-931d8bdb-dbcc-4da7-a71e-61ef9989b03d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:25.568475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-931d8bdb-dbcc-4da7-a71e-61ef9989b03d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:25.569247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-931d8bdb-dbcc-4da7-a71e-61ef9989b03d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:25.569691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-931d8bdb-dbcc-4da7-a71e-61ef9989b03d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:26.108644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-931d8bdb-dbcc-4da7-a71e-61ef9989b03d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:26.122751 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-931d8bdb-dbcc-4da7-a71e-61ef9989b03d tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1517 microversion: 2.1 time: 0.565861 Mar 12 20:58:26.124199 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1872/2640] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:25 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1517 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:26.129891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7cd4577a-5841-4fc6-82c5-7353533469a1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:26.130822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7cd4577a-5841-4fc6-82c5-7353533469a1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:26.137040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cd4577a-5841-4fc6-82c5-7353533469a1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:26.138569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cd4577a-5841-4fc6-82c5-7353533469a1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:26.139905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cd4577a-5841-4fc6-82c5-7353533469a1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:26.140654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cd4577a-5841-4fc6-82c5-7353533469a1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:26.410948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7cd4577a-5841-4fc6-82c5-7353533469a1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:26.419930 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7cd4577a-5841-4fc6-82c5-7353533469a1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1321 microversion: 2.1 time: 0.294359 Mar 12 20:58:26.420716 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1873/2641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:26 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:26.427787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-494939c1-9783-49d3-a9ea-3607e21859c1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:26.428735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-494939c1-9783-49d3-a9ea-3607e21859c1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:26.440373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-494939c1-9783-49d3-a9ea-3607e21859c1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:26.440940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-494939c1-9783-49d3-a9ea-3607e21859c1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:26.442169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-494939c1-9783-49d3-a9ea-3607e21859c1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:26.442788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-494939c1-9783-49d3-a9ea-3607e21859c1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:26.527458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-494939c1-9783-49d3-a9ea-3607e21859c1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:26.540255 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-494939c1-9783-49d3-a9ea-3607e21859c1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1275 microversion: 2.1 time: 0.118369 Mar 12 20:58:26.549632 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1874/2642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:26 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:26.549632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e68e044-c18f-4c52-80bd-2c4a0a7fe4fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:26.549632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e68e044-c18f-4c52-80bd-2c4a0a7fe4fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:26.555861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e68e044-c18f-4c52-80bd-2c4a0a7fe4fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:26.556442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e68e044-c18f-4c52-80bd-2c4a0a7fe4fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:26.557927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e68e044-c18f-4c52-80bd-2c4a0a7fe4fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:26.558447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e68e044-c18f-4c52-80bd-2c4a0a7fe4fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:26.869669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8e68e044-c18f-4c52-80bd-2c4a0a7fe4fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:26.880011 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8e68e044-c18f-4c52-80bd-2c4a0a7fe4fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1363 microversion: 2.1 time: 0.337288 Mar 12 20:58:26.880580 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1875/2643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:26 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:26.885587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e77b546e-64e7-4a67-b852-da65b2f1de1c req-90d9a269-5d5f-4b90-a6a5-096173e57bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "326ae42b-a952-4626-b027-90afe2eed7af", "name": "network-vif-plugged", "status": "completed", "tag": "fa889e48-e7a7-41ed-8296-e78010afb112"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:26.897873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e77b546e-64e7-4a67-b852-da65b2f1de1c req-90d9a269-5d5f-4b90-a6a5-096173e57bd9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:26.898336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e77b546e-64e7-4a67-b852-da65b2f1de1c req-90d9a269-5d5f-4b90-a6a5-096173e57bd9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:26.909893 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e77b546e-64e7-4a67-b852-da65b2f1de1c req-90d9a269-5d5f-4b90-a6a5-096173e57bd9 service nova] Creating event network-vif-plugged:fa889e48-e7a7-41ed-8296-e78010afb112 for instance 326ae42b-a952-4626-b027-90afe2eed7af on nch1-master-1 Mar 12 20:58:26.943620 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e77b546e-64e7-4a67-b852-da65b2f1de1c req-90d9a269-5d5f-4b90-a6a5-096173e57bd9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061689 Mar 12 20:58:26.944037 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1876/2644] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:27.142445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-77c80583-3e4a-493d-b3ea-178795811fc6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:27.143606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-77c80583-3e4a-493d-b3ea-178795811fc6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:27.155199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77c80583-3e4a-493d-b3ea-178795811fc6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:27.155774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77c80583-3e4a-493d-b3ea-178795811fc6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:27.156780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77c80583-3e4a-493d-b3ea-178795811fc6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:27.157472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77c80583-3e4a-493d-b3ea-178795811fc6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:27.423921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-77c80583-3e4a-493d-b3ea-178795811fc6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:27.437644 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-77c80583-3e4a-493d-b3ea-178795811fc6 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1517 microversion: 2.1 time: 0.300360 Mar 12 20:58:27.439864 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1877/2645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:27 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1517 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:27.463723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-acc3c060-8c12-4be3-b01f-1d609f65b5a3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:27.478995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-acc3c060-8c12-4be3-b01f-1d609f65b5a3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:27.495040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acc3c060-8c12-4be3-b01f-1d609f65b5a3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:27.496229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acc3c060-8c12-4be3-b01f-1d609f65b5a3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:27.497177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acc3c060-8c12-4be3-b01f-1d609f65b5a3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:27.509491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acc3c060-8c12-4be3-b01f-1d609f65b5a3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:27.768679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-acc3c060-8c12-4be3-b01f-1d609f65b5a3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:27.781707 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-acc3c060-8c12-4be3-b01f-1d609f65b5a3 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1321 microversion: 2.1 time: 0.340519 Mar 12 20:58:27.782778 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1878/2646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:27 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:27.804679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea4b6778-06b4-4e3d-bfa2-86c4ed25f183 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:27.806450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea4b6778-06b4-4e3d-bfa2-86c4ed25f183 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:27.824324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea4b6778-06b4-4e3d-bfa2-86c4ed25f183 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:27.825035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea4b6778-06b4-4e3d-bfa2-86c4ed25f183 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:27.826732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea4b6778-06b4-4e3d-bfa2-86c4ed25f183 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:27.827613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea4b6778-06b4-4e3d-bfa2-86c4ed25f183 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:28.108175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ea4b6778-06b4-4e3d-bfa2-86c4ed25f183 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:28.116774 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea4b6778-06b4-4e3d-bfa2-86c4ed25f183 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1317 microversion: 2.1 time: 0.332799 Mar 12 20:58:28.118160 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1879/2647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:27 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:28.123553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-68c683b1-895c-4aa1-8dc5-866053b271ce req-ab66c818-cc23-47da-a47c-682e642875f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131168b0-55a8-4369-814d-dcf1bb4883a3", "tag": "98fbf3f4-d851-464e-8252-15fe9f7c83dd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:28.131307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-68c683b1-895c-4aa1-8dc5-866053b271ce req-ab66c818-cc23-47da-a47c-682e642875f7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:28.131756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-68c683b1-895c-4aa1-8dc5-866053b271ce req-ab66c818-cc23-47da-a47c-682e642875f7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:28.142808 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-68c683b1-895c-4aa1-8dc5-866053b271ce req-ab66c818-cc23-47da-a47c-682e642875f7 service nova] Creating event network-changed:98fbf3f4-d851-464e-8252-15fe9f7c83dd for instance 131168b0-55a8-4369-814d-dcf1bb4883a3 on nch1-master-1 Mar 12 20:58:28.147476 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-68c683b1-895c-4aa1-8dc5-866053b271ce req-ab66c818-cc23-47da-a47c-682e642875f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028444 Mar 12 20:58:28.148071 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1880/2648] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:28.265548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1347776352", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": "none"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:28.317332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:28.317757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:28.318261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:28.318788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:28.319209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:28.328055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:28.328707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:28.329510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:28.329991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:28.347697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Getting quotas for project 9c51d49e3d6042e7b611423e7253c48d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:28.353504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Getting quotas for user 985be91b88ee41e89276a53862cc9608 and project 9c51d49e3d6042e7b611423e7253c48d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:28.365764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:58:28.368175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:58:28.413668 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e213de37-1045-4b1e-9b0f-9061da971134 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.264364 Mar 12 20:58:28.415115 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1881/2649] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:58:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 266 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 20:58:28.424409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33c199ae-fa16-4746-9560-09798f80a275 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:28.425027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-33c199ae-fa16-4746-9560-09798f80a275 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:28.431771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33c199ae-fa16-4746-9560-09798f80a275 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:28.432220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33c199ae-fa16-4746-9560-09798f80a275 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:28.433043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33c199ae-fa16-4746-9560-09798f80a275 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:28.433426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33c199ae-fa16-4746-9560-09798f80a275 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:28.723382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-33c199ae-fa16-4746-9560-09798f80a275 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:28.733459 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-33c199ae-fa16-4746-9560-09798f80a275 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1363 microversion: 2.1 time: 0.312630 Mar 12 20:58:28.734306 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1882/2650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:28 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:28.738905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be2f6242-1a4d-4594-88d6-eb26153f9c6d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:28.739648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-be2f6242-1a4d-4594-88d6-eb26153f9c6d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:28.820326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be2f6242-1a4d-4594-88d6-eb26153f9c6d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:28.828418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be2f6242-1a4d-4594-88d6-eb26153f9c6d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:28.829948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be2f6242-1a4d-4594-88d6-eb26153f9c6d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:28.831320 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be2f6242-1a4d-4594-88d6-eb26153f9c6d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1278 microversion: 2.54 time: 0.095862 Mar 12 20:58:28.832160 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1883/2651] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:28 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:28.837625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b003d4f7-acb5-4408-9915-4501b731899f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:28.838390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b003d4f7-acb5-4408-9915-4501b731899f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:28.845082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b003d4f7-acb5-4408-9915-4501b731899f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:28.845454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b003d4f7-acb5-4408-9915-4501b731899f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:28.846312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b003d4f7-acb5-4408-9915-4501b731899f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:28.846720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b003d4f7-acb5-4408-9915-4501b731899f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:29.091833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b003d4f7-acb5-4408-9915-4501b731899f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:29.099450 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b003d4f7-acb5-4408-9915-4501b731899f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1517 microversion: 2.1 time: 0.266384 Mar 12 20:58:29.100030 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1884/2652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:28 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1517 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:29.105040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9bc3c167-51e2-46ea-a8df-aa3ddf33d23e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:29.105699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9bc3c167-51e2-46ea-a8df-aa3ddf33d23e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:29.111356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bc3c167-51e2-46ea-a8df-aa3ddf33d23e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:29.111803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bc3c167-51e2-46ea-a8df-aa3ddf33d23e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:29.112569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bc3c167-51e2-46ea-a8df-aa3ddf33d23e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:29.113005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bc3c167-51e2-46ea-a8df-aa3ddf33d23e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:29.252968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9bc3c167-51e2-46ea-a8df-aa3ddf33d23e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:29.260960 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9bc3c167-51e2-46ea-a8df-aa3ddf33d23e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1321 microversion: 2.1 time: 0.159823 Mar 12 20:58:29.261537 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1885/2653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:29 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:29.265907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7d0b8141-a3ce-486b-a049-d1cea66d04b3 req-28088892-17c5-4ea1-8880-65705f097716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2e6c22-dc3b-4733-ba22-ab6fe0f70069", "name": "network-vif-plugged", "status": "completed", "tag": "2237d806-1e27-4862-a4ba-b751d1cb1c1d"}, {"server_uuid": "09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089", "name": "network-vif-plugged", "status": "completed", "tag": "f228fcf1-33a8-4130-bbcd-d7790e0ed18e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:29.274814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7d0b8141-a3ce-486b-a049-d1cea66d04b3 req-28088892-17c5-4ea1-8880-65705f097716 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:29.275339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7d0b8141-a3ce-486b-a049-d1cea66d04b3 req-28088892-17c5-4ea1-8880-65705f097716 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:29.288297 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7d0b8141-a3ce-486b-a049-d1cea66d04b3 req-28088892-17c5-4ea1-8880-65705f097716 service nova] Creating event network-vif-plugged:2237d806-1e27-4862-a4ba-b751d1cb1c1d for instance 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 on nch2-master-1 Mar 12 20:58:29.288809 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7d0b8141-a3ce-486b-a049-d1cea66d04b3 req-28088892-17c5-4ea1-8880-65705f097716 service nova] Creating event network-vif-plugged:f228fcf1-33a8-4130-bbcd-d7790e0ed18e for instance 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 on nch1-master-1 Mar 12 20:58:29.297693 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7d0b8141-a3ce-486b-a049-d1cea66d04b3 req-28088892-17c5-4ea1-8880-65705f097716 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035016 Mar 12 20:58:29.298403 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1886/2654] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:29.303568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e0b35791-72eb-4a78-8984-6c8ca70781a4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:29.304264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e0b35791-72eb-4a78-8984-6c8ca70781a4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:29.311608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0b35791-72eb-4a78-8984-6c8ca70781a4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:29.312150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0b35791-72eb-4a78-8984-6c8ca70781a4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:29.312912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0b35791-72eb-4a78-8984-6c8ca70781a4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:29.313457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0b35791-72eb-4a78-8984-6c8ca70781a4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:29.455509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e0b35791-72eb-4a78-8984-6c8ca70781a4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:29.463210 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e0b35791-72eb-4a78-8984-6c8ca70781a4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1317 microversion: 2.1 time: 0.163408 Mar 12 20:58:29.463796 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1887/2655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:29 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:29.749759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-84dc2db2-7862-4dbb-8434-e0ccc6895c48 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:29.750415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-84dc2db2-7862-4dbb-8434-e0ccc6895c48 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:29.757589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84dc2db2-7862-4dbb-8434-e0ccc6895c48 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:29.758072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84dc2db2-7862-4dbb-8434-e0ccc6895c48 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:29.758849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84dc2db2-7862-4dbb-8434-e0ccc6895c48 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:29.759433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84dc2db2-7862-4dbb-8434-e0ccc6895c48 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:29.906725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-84dc2db2-7862-4dbb-8434-e0ccc6895c48 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:29.915292 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-84dc2db2-7862-4dbb-8434-e0ccc6895c48 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1363 microversion: 2.1 time: 0.168760 Mar 12 20:58:29.925047 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1888/2656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:29 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:29.925047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9da9166f-255f-4958-aa47-41fa68ea8da5 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:29.925047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9da9166f-255f-4958-aa47-41fa68ea8da5 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:29.928772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9da9166f-255f-4958-aa47-41fa68ea8da5 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:29.929345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9da9166f-255f-4958-aa47-41fa68ea8da5 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:29.930465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9da9166f-255f-4958-aa47-41fa68ea8da5 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:29.930905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9da9166f-255f-4958-aa47-41fa68ea8da5 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:29.996750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9da9166f-255f-4958-aa47-41fa68ea8da5 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:30.005117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9da9166f-255f-4958-aa47-41fa68ea8da5 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:30.006785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9da9166f-255f-4958-aa47-41fa68ea8da5 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:30.008163 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9da9166f-255f-4958-aa47-41fa68ea8da5 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1338 microversion: 2.54 time: 0.090895 Mar 12 20:58:30.008810 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1889/2657] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:29 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1338 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:30.116674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3f83241b-8dad-4d73-8cb7-a0296c6433ca tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:30.117316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3f83241b-8dad-4d73-8cb7-a0296c6433ca tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:30.123909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f83241b-8dad-4d73-8cb7-a0296c6433ca tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:30.124434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f83241b-8dad-4d73-8cb7-a0296c6433ca tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:30.125363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f83241b-8dad-4d73-8cb7-a0296c6433ca tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:30.125841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f83241b-8dad-4d73-8cb7-a0296c6433ca tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:30.261908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3f83241b-8dad-4d73-8cb7-a0296c6433ca tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:30.269693 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3f83241b-8dad-4d73-8cb7-a0296c6433ca tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1517 microversion: 2.1 time: 0.156975 Mar 12 20:58:30.270310 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1890/2658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:30 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:30.279647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33eabd46-f754-4f81-b600-cf42160c8840 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:30.280353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-33eabd46-f754-4f81-b600-cf42160c8840 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:30.286306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33eabd46-f754-4f81-b600-cf42160c8840 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:30.286763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33eabd46-f754-4f81-b600-cf42160c8840 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:30.287531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33eabd46-f754-4f81-b600-cf42160c8840 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:30.287970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33eabd46-f754-4f81-b600-cf42160c8840 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:30.425224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-33eabd46-f754-4f81-b600-cf42160c8840 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:30.432617 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-33eabd46-f754-4f81-b600-cf42160c8840 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1321 microversion: 2.1 time: 0.157080 Mar 12 20:58:30.433185 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1891/2659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:30 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:30.479822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d733f690-888d-40d7-aca8-f48581125231 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:30.480418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d733f690-888d-40d7-aca8-f48581125231 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:30.486841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d733f690-888d-40d7-aca8-f48581125231 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:30.487295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d733f690-888d-40d7-aca8-f48581125231 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:30.488099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d733f690-888d-40d7-aca8-f48581125231 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:30.488544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d733f690-888d-40d7-aca8-f48581125231 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:30.629665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d733f690-888d-40d7-aca8-f48581125231 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:30.637892 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d733f690-888d-40d7-aca8-f48581125231 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1317 microversion: 2.1 time: 0.161921 Mar 12 20:58:30.638469 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1892/2660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:30 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:30.932505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8007d019-35c8-4216-b817-d322ed4eab49 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:30.933190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8007d019-35c8-4216-b817-d322ed4eab49 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:30.939967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8007d019-35c8-4216-b817-d322ed4eab49 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:30.940475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8007d019-35c8-4216-b817-d322ed4eab49 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:30.941327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8007d019-35c8-4216-b817-d322ed4eab49 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:30.942069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8007d019-35c8-4216-b817-d322ed4eab49 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:31.090620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8007d019-35c8-4216-b817-d322ed4eab49 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:31.098708 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8007d019-35c8-4216-b817-d322ed4eab49 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1549 microversion: 2.1 time: 0.170744 Mar 12 20:58:31.099361 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1893/2661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:30 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:31.104528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5718ae0-c392-4d2f-bb64-f64dc11c7cc3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:31.106091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e5718ae0-c392-4d2f-bb64-f64dc11c7cc3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:31.113471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5718ae0-c392-4d2f-bb64-f64dc11c7cc3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:31.113868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5718ae0-c392-4d2f-bb64-f64dc11c7cc3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:31.114745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5718ae0-c392-4d2f-bb64-f64dc11c7cc3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:31.115288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5718ae0-c392-4d2f-bb64-f64dc11c7cc3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:31.182133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e5718ae0-c392-4d2f-bb64-f64dc11c7cc3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:31.192625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e5718ae0-c392-4d2f-bb64-f64dc11c7cc3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:31.194702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e5718ae0-c392-4d2f-bb64-f64dc11c7cc3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:31.196056 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e5718ae0-c392-4d2f-bb64-f64dc11c7cc3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1336 microversion: 2.54 time: 0.095511 Mar 12 20:58:31.196925 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1894/2662] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:31 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:31.202860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-461d3789-44b8-43eb-9305-526a131fd61a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:31.203360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-461d3789-44b8-43eb-9305-526a131fd61a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:31.211231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-461d3789-44b8-43eb-9305-526a131fd61a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:31.211791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-461d3789-44b8-43eb-9305-526a131fd61a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:31.212621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-461d3789-44b8-43eb-9305-526a131fd61a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:31.213376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-461d3789-44b8-43eb-9305-526a131fd61a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:31.315569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-461d3789-44b8-43eb-9305-526a131fd61a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117407 Mar 12 20:58:31.316828 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1895/2663] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 20:58:31 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:31.321559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1e041450-99ac-473b-99f6-bb2c91dbcdb7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:31.322487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1e041450-99ac-473b-99f6-bb2c91dbcdb7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:31.329930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e041450-99ac-473b-99f6-bb2c91dbcdb7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:31.330466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e041450-99ac-473b-99f6-bb2c91dbcdb7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:31.331404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e041450-99ac-473b-99f6-bb2c91dbcdb7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:31.331973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e041450-99ac-473b-99f6-bb2c91dbcdb7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:31.497806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1e041450-99ac-473b-99f6-bb2c91dbcdb7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:31.507369 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1e041450-99ac-473b-99f6-bb2c91dbcdb7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1517 microversion: 2.1 time: 0.189682 Mar 12 20:58:31.517116 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1896/2664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:31 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:31.521886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-420fd9ce-faed-4c82-8d86-6649c5006161 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:31.522597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-420fd9ce-faed-4c82-8d86-6649c5006161 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:31.530184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-420fd9ce-faed-4c82-8d86-6649c5006161 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:31.530871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-420fd9ce-faed-4c82-8d86-6649c5006161 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:31.532112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-420fd9ce-faed-4c82-8d86-6649c5006161 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:31.532735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-420fd9ce-faed-4c82-8d86-6649c5006161 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:31.688564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-420fd9ce-faed-4c82-8d86-6649c5006161 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:31.698954 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-420fd9ce-faed-4c82-8d86-6649c5006161 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1512 microversion: 2.1 time: 0.189664 Mar 12 20:58:31.700028 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1897/2665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:31 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:31.704488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-841df38f-9021-49db-b7fa-4d8f079a2afc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:31.705108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-841df38f-9021-49db-b7fa-4d8f079a2afc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:31.712139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-841df38f-9021-49db-b7fa-4d8f079a2afc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:31.712609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-841df38f-9021-49db-b7fa-4d8f079a2afc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:31.713519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-841df38f-9021-49db-b7fa-4d8f079a2afc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:31.714376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-841df38f-9021-49db-b7fa-4d8f079a2afc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:31.898395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-841df38f-9021-49db-b7fa-4d8f079a2afc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:31.909704 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-841df38f-9021-49db-b7fa-4d8f079a2afc tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1317 microversion: 2.1 time: 0.208617 Mar 12 20:58:31.913977 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1898/2666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:31 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:31.918860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9673a922-e2e8-487c-abb8-7f6334d27e51 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:31.919758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9673a922-e2e8-487c-abb8-7f6334d27e51 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:31.928914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9673a922-e2e8-487c-abb8-7f6334d27e51 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:31.929525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9673a922-e2e8-487c-abb8-7f6334d27e51 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:31.931041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9673a922-e2e8-487c-abb8-7f6334d27e51 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:31.931519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9673a922-e2e8-487c-abb8-7f6334d27e51 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:32.101284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9673a922-e2e8-487c-abb8-7f6334d27e51 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:32.109719 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9673a922-e2e8-487c-abb8-7f6334d27e51 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1512 microversion: 2.1 time: 0.196998 Mar 12 20:58:32.110344 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1899/2667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:31 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:32.127437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14d4467c-aa78-4a6c-86e0-985416d6cde5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:32.128054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14d4467c-aa78-4a6c-86e0-985416d6cde5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 326ae42b-a952-4626-b027-90afe2eed7af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:32.135338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14d4467c-aa78-4a6c-86e0-985416d6cde5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:32.135802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14d4467c-aa78-4a6c-86e0-985416d6cde5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:32.136725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14d4467c-aa78-4a6c-86e0-985416d6cde5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:32.137243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14d4467c-aa78-4a6c-86e0-985416d6cde5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:32.300533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14d4467c-aa78-4a6c-86e0-985416d6cde5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:32.309106 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14d4467c-aa78-4a6c-86e0-985416d6cde5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af" status: 200 len: 1511 microversion: 2.1 time: 0.185897 Mar 12 20:58:32.309704 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1900/2668] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:32 2022] GET /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:32.315081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09e266af-8004-4344-8e9c-d15ff6deec39 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:32.315728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-09e266af-8004-4344-8e9c-d15ff6deec39 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:32.323443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e266af-8004-4344-8e9c-d15ff6deec39 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:32.323989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e266af-8004-4344-8e9c-d15ff6deec39 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:32.324782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e266af-8004-4344-8e9c-d15ff6deec39 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:32.325233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e266af-8004-4344-8e9c-d15ff6deec39 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:32.393510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09e266af-8004-4344-8e9c-d15ff6deec39 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:32.404010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09e266af-8004-4344-8e9c-d15ff6deec39 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:32.405526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09e266af-8004-4344-8e9c-d15ff6deec39 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:32.406728 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09e266af-8004-4344-8e9c-d15ff6deec39 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1336 microversion: 2.54 time: 0.096071 Mar 12 20:58:32.407301 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1901/2669] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:32 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:32.411782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f6c5dc11-1986-4fd9-bf57-01140f70975c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:32.416973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f6c5dc11-1986-4fd9-bf57-01140f70975c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:32.416973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f6c5dc11-1986-4fd9-bf57-01140f70975c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:32.430729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6c5dc11-1986-4fd9-bf57-01140f70975c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:32.431699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6c5dc11-1986-4fd9-bf57-01140f70975c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:32.432561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6c5dc11-1986-4fd9-bf57-01140f70975c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:32.433051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6c5dc11-1986-4fd9-bf57-01140f70975c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:32.530823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-f6c5dc11-1986-4fd9-bf57-01140f70975c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:58:32.604881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f6c5dc11-1986-4fd9-bf57-01140f70975c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:32.611589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6c5dc11-1986-4fd9-bf57-01140f70975c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:32.612081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6c5dc11-1986-4fd9-bf57-01140f70975c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:32.750318 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f6c5dc11-1986-4fd9-bf57-01140f70975c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.341917 Mar 12 20:58:32.756596 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1902/2670] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Mar 12 20:58:32 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:32.761431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27112d5a-66cf-430c-b0e9-12d3d9f5b3f0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:32.762290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27112d5a-66cf-430c-b0e9-12d3d9f5b3f0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:32.771181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27112d5a-66cf-430c-b0e9-12d3d9f5b3f0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:32.771915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27112d5a-66cf-430c-b0e9-12d3d9f5b3f0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:32.776224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27112d5a-66cf-430c-b0e9-12d3d9f5b3f0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:32.776756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27112d5a-66cf-430c-b0e9-12d3d9f5b3f0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:32.933851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27112d5a-66cf-430c-b0e9-12d3d9f5b3f0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:32.941999 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27112d5a-66cf-430c-b0e9-12d3d9f5b3f0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1517 microversion: 2.1 time: 0.183945 Mar 12 20:58:32.947494 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1903/2671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:32 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:32.958438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f924da9-6f58-43af-a804-bd2d48e3ea35 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:32.959273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f924da9-6f58-43af-a804-bd2d48e3ea35 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:32.966486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f924da9-6f58-43af-a804-bd2d48e3ea35 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:32.967097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f924da9-6f58-43af-a804-bd2d48e3ea35 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:32.968012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f924da9-6f58-43af-a804-bd2d48e3ea35 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:32.968523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f924da9-6f58-43af-a804-bd2d48e3ea35 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:33.057611 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 20:58:33.058267 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 20:58:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 20:58:33.175335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f924da9-6f58-43af-a804-bd2d48e3ea35 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:33.192136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f924da9-6f58-43af-a804-bd2d48e3ea35 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:33.194108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f924da9-6f58-43af-a804-bd2d48e3ea35 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:33.195577 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f924da9-6f58-43af-a804-bd2d48e3ea35 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 2951 microversion: 2.42 time: 0.251535 Mar 12 20:58:33.196554 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1904/2672] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:32 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 2951 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:33.201737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bb2fd7de-386e-4648-9832-7e2b8d6866b7 req-fb5f1065-fa48-451c-af16-d8a6b17d1207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f2e6c22-dc3b-4733-ba22-ab6fe0f70069", "tag": "2237d806-1e27-4862-a4ba-b751d1cb1c1d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:33.212810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bb2fd7de-386e-4648-9832-7e2b8d6866b7 req-fb5f1065-fa48-451c-af16-d8a6b17d1207 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:33.213604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bb2fd7de-386e-4648-9832-7e2b8d6866b7 req-fb5f1065-fa48-451c-af16-d8a6b17d1207 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:33.231720 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bb2fd7de-386e-4648-9832-7e2b8d6866b7 req-fb5f1065-fa48-451c-af16-d8a6b17d1207 service nova] Creating event network-changed:2237d806-1e27-4862-a4ba-b751d1cb1c1d for instance 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 on nch2-master-1 Mar 12 20:58:33.237010 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bb2fd7de-386e-4648-9832-7e2b8d6866b7 req-fb5f1065-fa48-451c-af16-d8a6b17d1207 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039020 Mar 12 20:58:33.237879 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1905/2673] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:33.243058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7f329d03-b7c4-4b5f-9343-7b2e6a8c243d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:33.247808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7f329d03-b7c4-4b5f-9343-7b2e6a8c243d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:33.249080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7f329d03-b7c4-4b5f-9343-7b2e6a8c243d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1793297865', 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:33.258601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f329d03-b7c4-4b5f-9343-7b2e6a8c243d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:33.259073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f329d03-b7c4-4b5f-9343-7b2e6a8c243d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:33.259902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f329d03-b7c4-4b5f-9343-7b2e6a8c243d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:33.260342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f329d03-b7c4-4b5f-9343-7b2e6a8c243d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:33.354516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-7f329d03-b7c4-4b5f-9343-7b2e6a8c243d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:58:33.426216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7f329d03-b7c4-4b5f-9343-7b2e6a8c243d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:33.436798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f329d03-b7c4-4b5f-9343-7b2e6a8c243d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:33.437265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f329d03-b7c4-4b5f-9343-7b2e6a8c243d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:33.577192 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7f329d03-b7c4-4b5f-9343-7b2e6a8c243d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1793297865" status: 200 len: 1515 microversion: 2.1 time: 0.337990 Mar 12 20:58:33.578343 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1906/2674] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:58:33 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1793297865 => generated 1515 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:33.582897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-87229b8e-a12b-403a-96f1-9acbb51b6925 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:33.583678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-87229b8e-a12b-403a-96f1-9acbb51b6925 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:33.595284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87229b8e-a12b-403a-96f1-9acbb51b6925 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:33.595868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87229b8e-a12b-403a-96f1-9acbb51b6925 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:33.596693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87229b8e-a12b-403a-96f1-9acbb51b6925 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:33.597145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87229b8e-a12b-403a-96f1-9acbb51b6925 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:33.776634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-87229b8e-a12b-403a-96f1-9acbb51b6925 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:33.787759 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-87229b8e-a12b-403a-96f1-9acbb51b6925 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1317 microversion: 2.1 time: 0.208352 Mar 12 20:58:33.789058 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1907/2675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:33 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:33.796064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a102fe08-9fe5-4d01-8b0b-70a70e8b2056 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:33.796562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a102fe08-9fe5-4d01-8b0b-70a70e8b2056 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:33.808940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a102fe08-9fe5-4d01-8b0b-70a70e8b2056 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:33.809613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a102fe08-9fe5-4d01-8b0b-70a70e8b2056 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:33.811130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a102fe08-9fe5-4d01-8b0b-70a70e8b2056 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:33.811357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a102fe08-9fe5-4d01-8b0b-70a70e8b2056 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.010913 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a102fe08-9fe5-4d01-8b0b-70a70e8b2056 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.219487 Mar 12 20:58:34.017852 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1908/2676] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Mar 12 20:58:33 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065/os-interface => generated 1829 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:34.017852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce5ea387-aa8d-42eb-b6bc-78b8ce7384a0 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:34.017852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce5ea387-aa8d-42eb-b6bc-78b8ce7384a0 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:34.026254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce5ea387-aa8d-42eb-b6bc-78b8ce7384a0 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.027196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce5ea387-aa8d-42eb-b6bc-78b8ce7384a0 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.028196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce5ea387-aa8d-42eb-b6bc-78b8ce7384a0 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.028764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce5ea387-aa8d-42eb-b6bc-78b8ce7384a0 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.104066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce5ea387-aa8d-42eb-b6bc-78b8ce7384a0 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:34.112429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce5ea387-aa8d-42eb-b6bc-78b8ce7384a0 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:34.114073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce5ea387-aa8d-42eb-b6bc-78b8ce7384a0 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:34.115294 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce5ea387-aa8d-42eb-b6bc-78b8ce7384a0 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1336 microversion: 2.54 time: 0.102198 Mar 12 20:58:34.116010 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1909/2677] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:34 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:34.122039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b755a9d-4387-4fa2-a468-721f8be1d0ef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:34.125703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b755a9d-4387-4fa2-a468-721f8be1d0ef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:34.126543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b755a9d-4387-4fa2-a468-721f8be1d0ef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:34.140027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b755a9d-4387-4fa2-a468-721f8be1d0ef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.140248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b755a9d-4387-4fa2-a468-721f8be1d0ef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.141085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b755a9d-4387-4fa2-a468-721f8be1d0ef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.141548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b755a9d-4387-4fa2-a468-721f8be1d0ef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.253608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-7b755a9d-4387-4fa2-a468-721f8be1d0ef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:58:34.323675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b755a9d-4387-4fa2-a468-721f8be1d0ef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:34.330911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b755a9d-4387-4fa2-a468-721f8be1d0ef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.331368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b755a9d-4387-4fa2-a468-721f8be1d0ef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.468859 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b755a9d-4387-4fa2-a468-721f8be1d0ef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.351660 Mar 12 20:58:34.469495 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1910/2678] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Mar 12 20:58:34 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:34.474013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da27104d-51f2-4571-8132-14b8543c9c34 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:34.478051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da27104d-51f2-4571-8132-14b8543c9c34 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:34.478716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da27104d-51f2-4571-8132-14b8543c9c34 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Searching by: {'deleted': False, 'project_id': '399f94948e49454d9b058817feac550a'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:34.483971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da27104d-51f2-4571-8132-14b8543c9c34 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.484888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da27104d-51f2-4571-8132-14b8543c9c34 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.485599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da27104d-51f2-4571-8132-14b8543c9c34 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.486042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da27104d-51f2-4571-8132-14b8543c9c34 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.512393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-da27104d-51f2-4571-8132-14b8543c9c34 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:58:34.540451 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da27104d-51f2-4571-8132-14b8543c9c34 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.069853 Mar 12 20:58:34.541042 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1911/2679] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 20:58:34 2022] GET /compute/v2.1/servers => generated 341 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:34.545500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0df8e85-adfe-4085-a89e-872986269ed4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:34.546138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b0df8e85-adfe-4085-a89e-872986269ed4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:34.552999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0df8e85-adfe-4085-a89e-872986269ed4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.553381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0df8e85-adfe-4085-a89e-872986269ed4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.554192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0df8e85-adfe-4085-a89e-872986269ed4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.554643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0df8e85-adfe-4085-a89e-872986269ed4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.706893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b0df8e85-adfe-4085-a89e-872986269ed4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:34.715458 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0df8e85-adfe-4085-a89e-872986269ed4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1517 microversion: 2.1 time: 0.173432 Mar 12 20:58:34.716153 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1912/2680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:34 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:34.721252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d5f70e58-6f0c-4e6f-abf6-fa12c9fff2ac req-77db31fe-ef12-47c2-94f0-98ab3b65d7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131168b0-55a8-4369-814d-dcf1bb4883a3", "name": "network-vif-plugged", "status": "completed", "tag": "98fbf3f4-d851-464e-8252-15fe9f7c83dd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:34.729819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d5f70e58-6f0c-4e6f-abf6-fa12c9fff2ac req-77db31fe-ef12-47c2-94f0-98ab3b65d7eb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.730329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d5f70e58-6f0c-4e6f-abf6-fa12c9fff2ac req-77db31fe-ef12-47c2-94f0-98ab3b65d7eb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.743044 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d5f70e58-6f0c-4e6f-abf6-fa12c9fff2ac req-77db31fe-ef12-47c2-94f0-98ab3b65d7eb service nova] Creating event network-vif-plugged:98fbf3f4-d851-464e-8252-15fe9f7c83dd for instance 131168b0-55a8-4369-814d-dcf1bb4883a3 on nch1-master-1 Mar 12 20:58:34.748053 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d5f70e58-6f0c-4e6f-abf6-fa12c9fff2ac req-77db31fe-ef12-47c2-94f0-98ab3b65d7eb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030632 Mar 12 20:58:34.748757 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1913/2681] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:34.753804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ecee58e9-c0a4-46eb-9c12-aca1258f5519 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:34.757190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ecee58e9-c0a4-46eb-9c12-aca1258f5519 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:34.757721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.compute.servers [None req-ecee58e9-c0a4-46eb-9c12-aca1258f5519 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Removing options 'limit' from query {{(pid=136302) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 12 20:58:34.758762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ecee58e9-c0a4-46eb-9c12-aca1258f5519 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:34.764104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecee58e9-c0a4-46eb-9c12-aca1258f5519 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.764559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecee58e9-c0a4-46eb-9c12-aca1258f5519 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.765365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecee58e9-c0a4-46eb-9c12-aca1258f5519 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.765967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecee58e9-c0a4-46eb-9c12-aca1258f5519 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:34.809130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ecee58e9-c0a4-46eb-9c12-aca1258f5519 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:34.818425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecee58e9-c0a4-46eb-9c12-aca1258f5519 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:34.818941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecee58e9-c0a4-46eb-9c12-aca1258f5519 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:35.008575 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ecee58e9-c0a4-46eb-9c12-aca1258f5519 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.258064 Mar 12 20:58:35.009294 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1914/2682] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Mar 12 20:58:34 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:35.014297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ac2a43ff-6b49-4cfc-9615-5dcb1c81973c tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:35.018069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ac2a43ff-6b49-4cfc-9615-5dcb1c81973c tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:35.019197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ac2a43ff-6b49-4cfc-9615-5dcb1c81973c tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Searching by: {'deleted': False, 'project_id': '399f94948e49454d9b058817feac550a'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:35.026917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac2a43ff-6b49-4cfc-9615-5dcb1c81973c tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:35.027455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac2a43ff-6b49-4cfc-9615-5dcb1c81973c tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:35.028719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac2a43ff-6b49-4cfc-9615-5dcb1c81973c tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:35.029268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac2a43ff-6b49-4cfc-9615-5dcb1c81973c tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:35.060219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-ac2a43ff-6b49-4cfc-9615-5dcb1c81973c tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:58:35.096765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ac2a43ff-6b49-4cfc-9615-5dcb1c81973c tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:35.102982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac2a43ff-6b49-4cfc-9615-5dcb1c81973c tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:35.103430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac2a43ff-6b49-4cfc-9615-5dcb1c81973c tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:35.229600 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ac2a43ff-6b49-4cfc-9615-5dcb1c81973c tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.219059 Mar 12 20:58:35.230395 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1915/2683] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:58:35 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:35.235175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aab5ae50-1b8e-4668-a266-6adb58bbddfe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:35.235899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aab5ae50-1b8e-4668-a266-6adb58bbddfe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:35.242924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aab5ae50-1b8e-4668-a266-6adb58bbddfe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:35.243479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aab5ae50-1b8e-4668-a266-6adb58bbddfe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:35.244422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aab5ae50-1b8e-4668-a266-6adb58bbddfe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:35.244992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aab5ae50-1b8e-4668-a266-6adb58bbddfe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:35.398024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aab5ae50-1b8e-4668-a266-6adb58bbddfe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:35.406816 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aab5ae50-1b8e-4668-a266-6adb58bbddfe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1317 microversion: 2.1 time: 0.175282 Mar 12 20:58:35.407488 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1916/2684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:35 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:35.412465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d3a9242f-4fe9-40f3-a9c3-2c90b815fc67 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:35.416581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d3a9242f-4fe9-40f3-a9c3-2c90b815fc67 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:35.417521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d3a9242f-4fe9-40f3-a9c3-2c90b815fc67 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:35.423025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3a9242f-4fe9-40f3-a9c3-2c90b815fc67 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:35.423516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3a9242f-4fe9-40f3-a9c3-2c90b815fc67 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:35.424349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3a9242f-4fe9-40f3-a9c3-2c90b815fc67 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:35.424792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3a9242f-4fe9-40f3-a9c3-2c90b815fc67 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:35.454461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-d3a9242f-4fe9-40f3-a9c3-2c90b815fc67 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:58:35.485259 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d3a9242f-4fe9-40f3-a9c3-2c90b815fc67 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.076668 Mar 12 20:58:35.486342 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1917/2685] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:58:35 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:35.497514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1c32b39f-6167-4845-b6ad-71251500a9b9 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:35.498391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1c32b39f-6167-4845-b6ad-71251500a9b9 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:35.501072 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 20:58:35.501990 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 20:58:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 20:58:35.505026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c32b39f-6167-4845-b6ad-71251500a9b9 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:35.505486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c32b39f-6167-4845-b6ad-71251500a9b9 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:35.506351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c32b39f-6167-4845-b6ad-71251500a9b9 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:35.506790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c32b39f-6167-4845-b6ad-71251500a9b9 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:35.579374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1c32b39f-6167-4845-b6ad-71251500a9b9 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:35.589028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1c32b39f-6167-4845-b6ad-71251500a9b9 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:35.590799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1c32b39f-6167-4845-b6ad-71251500a9b9 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:35.592187 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1c32b39f-6167-4845-b6ad-71251500a9b9 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1357 microversion: 2.54 time: 0.101463 Mar 12 20:58:35.592856 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1918/2686] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:35 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1357 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:35.597756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-74b7b38d-6b12-4675-b86f-3821ff486fb3 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:35.606327 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-74b7b38d-6b12-4675-b86f-3821ff486fb3 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012309 Mar 12 20:58:35.606940 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1919/2687] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 20:58:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:35.611682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6746e156-f623-41e0-ac73-ecc6b2205315 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:35.615351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6746e156-f623-41e0-ac73-ecc6b2205315 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:35.615847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.compute.servers [None req-6746e156-f623-41e0-ac73-ecc6b2205315 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Removing options 'limit' from query {{(pid=136302) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 12 20:58:35.616576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6746e156-f623-41e0-ac73-ecc6b2205315 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:35.623654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6746e156-f623-41e0-ac73-ecc6b2205315 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:35.624352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6746e156-f623-41e0-ac73-ecc6b2205315 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:35.625807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6746e156-f623-41e0-ac73-ecc6b2205315 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:35.626178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6746e156-f623-41e0-ac73-ecc6b2205315 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:35.659325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-6746e156-f623-41e0-ac73-ecc6b2205315 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:58:35.687450 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6746e156-f623-41e0-ac73-ecc6b2205315 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.079339 Mar 12 20:58:35.688001 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1920/2688] 10.222.0.30 () {58 vars in 1149 bytes} [Sat Mar 12 20:58:35 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:35.692963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d0437d8f-3a7f-4bfb-84a6-52b62be572f7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Action: 'create', calling method: .version_select at 0x7f6e373654c0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1658138823"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:35.707535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d0437d8f-3a7f-4bfb-84a6-52b62be572f7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Getting quotas for project 9c51d49e3d6042e7b611423e7253c48d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:35.713512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d0437d8f-3a7f-4bfb-84a6-52b62be572f7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Getting quotas for user 985be91b88ee41e89276a53862cc9608 and project 9c51d49e3d6042e7b611423e7253c48d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:36.095552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d0437d8f-3a7f-4bfb-84a6-52b62be572f7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Getting quotas for project 9c51d49e3d6042e7b611423e7253c48d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:36.101131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d0437d8f-3a7f-4bfb-84a6-52b62be572f7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Getting quotas for user 985be91b88ee41e89276a53862cc9608 and project 9c51d49e3d6042e7b611423e7253c48d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:36.121794 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d0437d8f-3a7f-4bfb-84a6-52b62be572f7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.54 time: 0.432713 Mar 12 20:58:36.122756 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1921/2689] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Mar 12 20:58:35 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 434 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:58:36.127157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-478e7948-0b42-4247-89c1-2ee6d0f0c32d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:36.130433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-478e7948-0b42-4247-89c1-2ee6d0f0c32d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:36.131102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-478e7948-0b42-4247-89c1-2ee6d0f0c32d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:36.137203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-478e7948-0b42-4247-89c1-2ee6d0f0c32d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.137663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-478e7948-0b42-4247-89c1-2ee6d0f0c32d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.138505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-478e7948-0b42-4247-89c1-2ee6d0f0c32d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.138940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-478e7948-0b42-4247-89c1-2ee6d0f0c32d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.166735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-478e7948-0b42-4247-89c1-2ee6d0f0c32d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:58:36.201749 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-478e7948-0b42-4247-89c1-2ee6d0f0c32d tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.078024 Mar 12 20:58:36.202690 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1922/2690] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 20:58:36 2022] GET /compute/v2.1/servers => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:36.208342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-396e6074-e6ef-4ddb-ab99-de2a187b1384 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:36.208342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-396e6074-e6ef-4ddb-ab99-de2a187b1384 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:36.215538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-396e6074-e6ef-4ddb-ab99-de2a187b1384 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.215988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-396e6074-e6ef-4ddb-ab99-de2a187b1384 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.216777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-396e6074-e6ef-4ddb-ab99-de2a187b1384 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.217221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-396e6074-e6ef-4ddb-ab99-de2a187b1384 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.361435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-396e6074-e6ef-4ddb-ab99-de2a187b1384 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:36.369871 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-396e6074-e6ef-4ddb-ab99-de2a187b1384 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1517 microversion: 2.1 time: 0.166087 Mar 12 20:58:36.370411 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1923/2691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:36 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:36.375152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cde14eba-91e9-4e05-9634-8d88b57757a8 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:36.375716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cde14eba-91e9-4e05-9634-8d88b57757a8 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:36.381950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cde14eba-91e9-4e05-9634-8d88b57757a8 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.382292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cde14eba-91e9-4e05-9634-8d88b57757a8 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.383095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cde14eba-91e9-4e05-9634-8d88b57757a8 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.383544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cde14eba-91e9-4e05-9634-8d88b57757a8 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.416157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cde14eba-91e9-4e05-9634-8d88b57757a8 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:58:36.519197 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cde14eba-91e9-4e05-9634-8d88b57757a8 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 204 len: 0 microversion: 2.1 time: 0.144277 Mar 12 20:58:36.520586 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1924/2692] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:58:36 2022] DELETE /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:58:36.527607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1658138823", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:36.531076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:36.536982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.537585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.538594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.539047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.640488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:36.641051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:36.641692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:36.642172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:36.642659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:36.743249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:36.750832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.751306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.752137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.752582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.787845 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2230415-f199-4aa8-aac6-2677cbf4c754 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "POST /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e/action" status: 202 len: 1140 microversion: 2.54 time: 0.265832 Mar 12 20:58:36.788707 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1925/2693] 10.222.0.30 () {62 vars in 1319 bytes} [Sat Mar 12 20:58:36 2022] POST /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e/action => generated 1140 bytes in 268 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 12 20:58:36.803724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f606501d-24de-4ed9-a13b-e342e34fd88f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:36.807957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f606501d-24de-4ed9-a13b-e342e34fd88f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:36.808939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f606501d-24de-4ed9-a13b-e342e34fd88f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:36.823006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f606501d-24de-4ed9-a13b-e342e34fd88f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.823442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f606501d-24de-4ed9-a13b-e342e34fd88f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.824440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f606501d-24de-4ed9-a13b-e342e34fd88f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.824947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f606501d-24de-4ed9-a13b-e342e34fd88f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.915070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-f606501d-24de-4ed9-a13b-e342e34fd88f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:58:36.982268 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f606501d-24de-4ed9-a13b-e342e34fd88f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.185945 Mar 12 20:58:36.982977 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1926/2694] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:58:36 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:36.988404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-07587ac9-0d81-4e79-b695-c6fc979009e3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:36.988404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-07587ac9-0d81-4e79-b695-c6fc979009e3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:36.994787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07587ac9-0d81-4e79-b695-c6fc979009e3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.995247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07587ac9-0d81-4e79-b695-c6fc979009e3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:36.996081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07587ac9-0d81-4e79-b695-c6fc979009e3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:36.996622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07587ac9-0d81-4e79-b695-c6fc979009e3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.150636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-07587ac9-0d81-4e79-b695-c6fc979009e3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:37.158713 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-07587ac9-0d81-4e79-b695-c6fc979009e3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1467 microversion: 2.1 time: 0.174674 Mar 12 20:58:37.159302 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1927/2695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:36 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1467 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:37.167532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-82e8bebd-bbe5-4c18-a259-a33436fadc64 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:37.168194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-82e8bebd-bbe5-4c18-a259-a33436fadc64 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:37.176262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82e8bebd-bbe5-4c18-a259-a33436fadc64 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:37.176706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82e8bebd-bbe5-4c18-a259-a33436fadc64 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.177501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82e8bebd-bbe5-4c18-a259-a33436fadc64 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:37.178005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82e8bebd-bbe5-4c18-a259-a33436fadc64 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.333380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-82e8bebd-bbe5-4c18-a259-a33436fadc64 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:37.341998 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-82e8bebd-bbe5-4c18-a259-a33436fadc64 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1607 microversion: 2.1 time: 0.181603 Mar 12 20:58:37.342617 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1928/2696] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:37 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1607 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:37.347290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f3b341b-09e3-4273-8041-8149bb8d547d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:37.347931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f3b341b-09e3-4273-8041-8149bb8d547d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:37.354273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f3b341b-09e3-4273-8041-8149bb8d547d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:37.354735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f3b341b-09e3-4273-8041-8149bb8d547d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.355618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f3b341b-09e3-4273-8041-8149bb8d547d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:37.356067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f3b341b-09e3-4273-8041-8149bb8d547d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.428118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f3b341b-09e3-4273-8041-8149bb8d547d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:37.438140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f3b341b-09e3-4273-8041-8149bb8d547d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:37.439884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f3b341b-09e3-4273-8041-8149bb8d547d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:37.441644 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f3b341b-09e3-4273-8041-8149bb8d547d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.097777 Mar 12 20:58:37.442295 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1929/2697] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:37 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:37.447832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-57b2cefe-5350-48e3-bdf4-90dd3bd341e5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:37.451550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-57b2cefe-5350-48e3-bdf4-90dd3bd341e5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:37.452246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.compute.servers [None req-57b2cefe-5350-48e3-bdf4-90dd3bd341e5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Removing options 'limit' from query {{(pid=136302) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 12 20:58:37.452694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-57b2cefe-5350-48e3-bdf4-90dd3bd341e5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:37.458545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57b2cefe-5350-48e3-bdf4-90dd3bd341e5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:37.459319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57b2cefe-5350-48e3-bdf4-90dd3bd341e5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.460278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57b2cefe-5350-48e3-bdf4-90dd3bd341e5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:37.460715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57b2cefe-5350-48e3-bdf4-90dd3bd341e5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.494334 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-57b2cefe-5350-48e3-bdf4-90dd3bd341e5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.050734 Mar 12 20:58:37.494970 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1930/2698] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Mar 12 20:58:37 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:37.499634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c3e5d7a-3b14-45bd-9b69-cd905c601771 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:37.500179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c3e5d7a-3b14-45bd-9b69-cd905c601771 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:37.508635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c3e5d7a-3b14-45bd-9b69-cd905c601771 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:37.509080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c3e5d7a-3b14-45bd-9b69-cd905c601771 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.510335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c3e5d7a-3b14-45bd-9b69-cd905c601771 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:37.510859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c3e5d7a-3b14-45bd-9b69-cd905c601771 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.660811 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4c3e5d7a-3b14-45bd-9b69-cd905c601771 tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1618 microversion: 2.1 time: 0.164805 Mar 12 20:58:37.661398 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1931/2699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:37 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1618 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:37.665880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2c232b1-cc26-4727-80f7-faa9162aa1f7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:37.666492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2c232b1-cc26-4727-80f7-faa9162aa1f7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:37.672356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2c232b1-cc26-4727-80f7-faa9162aa1f7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:37.672744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2c232b1-cc26-4727-80f7-faa9162aa1f7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.673521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2c232b1-cc26-4727-80f7-faa9162aa1f7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:37.674004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2c232b1-cc26-4727-80f7-faa9162aa1f7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.841561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e2c232b1-cc26-4727-80f7-faa9162aa1f7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:37.850429 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2c232b1-cc26-4727-80f7-faa9162aa1f7 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1523 microversion: 2.1 time: 0.187993 Mar 12 20:58:37.851121 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1932/2700] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:37 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:37.867904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d4eb4e3e-218c-4d14-bb84-334bdf5b974f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:37.871778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d4eb4e3e-218c-4d14-bb84-334bdf5b974f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:37.872487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d4eb4e3e-218c-4d14-bb84-334bdf5b974f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1793297865', 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:37.878825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4eb4e3e-218c-4d14-bb84-334bdf5b974f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:37.879421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4eb4e3e-218c-4d14-bb84-334bdf5b974f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.880435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4eb4e3e-218c-4d14-bb84-334bdf5b974f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:37.880940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4eb4e3e-218c-4d14-bb84-334bdf5b974f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:37.996531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-d4eb4e3e-218c-4d14-bb84-334bdf5b974f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:58:38.062198 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d4eb4e3e-218c-4d14-bb84-334bdf5b974f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1793297865" status: 200 len: 346 microversion: 2.1 time: 0.198708 Mar 12 20:58:38.063066 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1933/2701] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Mar 12 20:58:37 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1793297865 => generated 346 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:38.067972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1644040102", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4979bdb6-1c95-4d29-909c-194f16259f42"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:38.124232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:58:38.379089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:38.379525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:38.380058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:38.380544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:38.381084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:38.391396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:38.391856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:38.392673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:38.393450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:38.411838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:38.418285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Getting quotas for user b3be19bf3aba47d39a3163d43de57c78 and project 642ce33a722143ba8acb0bbbc4d0b46a. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:38.432452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:58:38.435213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:58:38.486102 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-db304687-5437-455b-9ee3-55e794916ba5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.421862 Mar 12 20:58:38.486888 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1934/2702] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:58:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:58:38.491604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6e076f3e-19e4-4911-a081-d68eeac0caf5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:38.498514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e076f3e-19e4-4911-a081-d68eeac0caf5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:38.499181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e076f3e-19e4-4911-a081-d68eeac0caf5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:38.526476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6e076f3e-19e4-4911-a081-d68eeac0caf5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Going to try to stop instance {{(pid=136302) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 12 20:58:38.577797 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6e076f3e-19e4-4911-a081-d68eeac0caf5 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "POST /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2/action" status: 202 len: 0 microversion: 2.1 time: 0.089081 Mar 12 20:58:38.578916 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1935/2703] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:58:38 2022] POST /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:58:38.585521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2a27c820-ef92-494e-a1ea-0e40184f1f67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:38.586843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2a27c820-ef92-494e-a1ea-0e40184f1f67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:38.594526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a27c820-ef92-494e-a1ea-0e40184f1f67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:38.594989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a27c820-ef92-494e-a1ea-0e40184f1f67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:38.596232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a27c820-ef92-494e-a1ea-0e40184f1f67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:38.596697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a27c820-ef92-494e-a1ea-0e40184f1f67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:38.774060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2a27c820-ef92-494e-a1ea-0e40184f1f67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:38.786103 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2a27c820-ef92-494e-a1ea-0e40184f1f67 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1607 microversion: 2.1 time: 0.205402 Mar 12 20:58:38.794747 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1936/2704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:38 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1607 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:38.794747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1cc017e3-d7da-4130-aff3-2f4667cceff7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:38.794747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1cc017e3-d7da-4130-aff3-2f4667cceff7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:38.798681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cc017e3-d7da-4130-aff3-2f4667cceff7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:38.799136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cc017e3-d7da-4130-aff3-2f4667cceff7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:38.800120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cc017e3-d7da-4130-aff3-2f4667cceff7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:38.800623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cc017e3-d7da-4130-aff3-2f4667cceff7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:38.903700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1cc017e3-d7da-4130-aff3-2f4667cceff7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:38.915598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1cc017e3-d7da-4130-aff3-2f4667cceff7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:38.917181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1cc017e3-d7da-4130-aff3-2f4667cceff7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:38.918391 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1cc017e3-d7da-4130-aff3-2f4667cceff7 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.130699 Mar 12 20:58:38.919020 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1937/2705] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:38 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:38.924681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f536328-a424-4381-a16e-27ff4e7d41a9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:38.925307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4f536328-a424-4381-a16e-27ff4e7d41a9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:38.933320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f536328-a424-4381-a16e-27ff4e7d41a9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:38.933800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f536328-a424-4381-a16e-27ff4e7d41a9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:38.934584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f536328-a424-4381-a16e-27ff4e7d41a9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:38.935146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f536328-a424-4381-a16e-27ff4e7d41a9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:39.028571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4f536328-a424-4381-a16e-27ff4e7d41a9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:39.036058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4f536328-a424-4381-a16e-27ff4e7d41a9 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1221 microversion: 2.1 time: 0.115547 Mar 12 20:58:39.036896 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1938/2706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:38 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:39.041813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1ce8b0ec-c8e1-4f0d-87b9-fa38aa4da5d7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:39.042511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1ce8b0ec-c8e1-4f0d-87b9-fa38aa4da5d7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:39.048655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ce8b0ec-c8e1-4f0d-87b9-fa38aa4da5d7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:39.049528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ce8b0ec-c8e1-4f0d-87b9-fa38aa4da5d7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:39.052518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ce8b0ec-c8e1-4f0d-87b9-fa38aa4da5d7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:39.052518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ce8b0ec-c8e1-4f0d-87b9-fa38aa4da5d7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:39.315940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1ce8b0ec-c8e1-4f0d-87b9-fa38aa4da5d7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:39.326237 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1ce8b0ec-c8e1-4f0d-87b9-fa38aa4da5d7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.288369 Mar 12 20:58:39.326817 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1939/2707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:39 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:39.332127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7534f142-73e7-4aa1-ba88-eb0ff1e0feea tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:39.332447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7534f142-73e7-4aa1-ba88-eb0ff1e0feea tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:39.338875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7534f142-73e7-4aa1-ba88-eb0ff1e0feea tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:39.339334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7534f142-73e7-4aa1-ba88-eb0ff1e0feea tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:39.340142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7534f142-73e7-4aa1-ba88-eb0ff1e0feea tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:39.340583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7534f142-73e7-4aa1-ba88-eb0ff1e0feea tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:39.544730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7534f142-73e7-4aa1-ba88-eb0ff1e0feea tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:39.554116 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7534f142-73e7-4aa1-ba88-eb0ff1e0feea tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1523 microversion: 2.1 time: 0.226251 Mar 12 20:58:39.555063 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1940/2708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:39 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:39.807667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4529fc0a-2d12-4f79-a6fb-d96ffd6d4645 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:39.808725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4529fc0a-2d12-4f79-a6fb-d96ffd6d4645 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:39.817723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4529fc0a-2d12-4f79-a6fb-d96ffd6d4645 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:39.818463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4529fc0a-2d12-4f79-a6fb-d96ffd6d4645 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:39.819482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4529fc0a-2d12-4f79-a6fb-d96ffd6d4645 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:39.819983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4529fc0a-2d12-4f79-a6fb-d96ffd6d4645 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:39.978063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4529fc0a-2d12-4f79-a6fb-d96ffd6d4645 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:39.986148 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4529fc0a-2d12-4f79-a6fb-d96ffd6d4645 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1539 microversion: 2.1 time: 0.186616 Mar 12 20:58:39.987071 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1941/2709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:39 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1539 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:39.991492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f4776a99-ff3a-41b1-ab49-be74fa532b82 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:39.992852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f4776a99-ff3a-41b1-ab49-be74fa532b82 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:40.000095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4776a99-ff3a-41b1-ab49-be74fa532b82 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:40.000586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4776a99-ff3a-41b1-ab49-be74fa532b82 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:40.001425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4776a99-ff3a-41b1-ab49-be74fa532b82 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:40.002041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4776a99-ff3a-41b1-ab49-be74fa532b82 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:40.086194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f4776a99-ff3a-41b1-ab49-be74fa532b82 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:40.098114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f4776a99-ff3a-41b1-ab49-be74fa532b82 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:40.100070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f4776a99-ff3a-41b1-ab49-be74fa532b82 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:40.102043 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f4776a99-ff3a-41b1-ab49-be74fa532b82 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.113760 Mar 12 20:58:40.109357 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1942/2710] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:39 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:40.116354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af1b8999-1db9-4c90-8038-67c29cfb04b3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:40.116999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af1b8999-1db9-4c90-8038-67c29cfb04b3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:40.126631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af1b8999-1db9-4c90-8038-67c29cfb04b3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:40.127397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af1b8999-1db9-4c90-8038-67c29cfb04b3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:40.127881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af1b8999-1db9-4c90-8038-67c29cfb04b3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:40.128335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af1b8999-1db9-4c90-8038-67c29cfb04b3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:40.225838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-af1b8999-1db9-4c90-8038-67c29cfb04b3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:40.235514 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af1b8999-1db9-4c90-8038-67c29cfb04b3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1275 microversion: 2.1 time: 0.124931 Mar 12 20:58:40.246994 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1943/2711] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:40 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:40.334159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d0cfb68c-abb4-4425-b779-810df05488bf req-2514ea69-ccfc-4ccc-9baa-6f26eaa4f3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c731ea4c-67c7-4d48-846f-c10bada24535", "name": "network-vif-deleted", "tag": "79824ce4-3174-493e-aa2c-fe0b709c7d89"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:40.344376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d0cfb68c-abb4-4425-b779-810df05488bf req-2514ea69-ccfc-4ccc-9baa-6f26eaa4f3e1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:40.344890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d0cfb68c-abb4-4425-b779-810df05488bf req-2514ea69-ccfc-4ccc-9baa-6f26eaa4f3e1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:40.360949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d0cfb68c-abb4-4425-b779-810df05488bf req-2514ea69-ccfc-4ccc-9baa-6f26eaa4f3e1 service nova] Creating event network-vif-deleted:79824ce4-3174-493e-aa2c-fe0b709c7d89 for instance c731ea4c-67c7-4d48-846f-c10bada24535 on nch1-master-1 Mar 12 20:58:40.368093 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d0cfb68c-abb4-4425-b779-810df05488bf req-2514ea69-ccfc-4ccc-9baa-6f26eaa4f3e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037943 Mar 12 20:58:40.374642 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1944/2712] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:40.382644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59be3ffe-5505-4d43-a924-ff3ccf53c961 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:40.383821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59be3ffe-5505-4d43-a924-ff3ccf53c961 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:40.399166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59be3ffe-5505-4d43-a924-ff3ccf53c961 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:40.403103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59be3ffe-5505-4d43-a924-ff3ccf53c961 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:40.403949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59be3ffe-5505-4d43-a924-ff3ccf53c961 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:40.404925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59be3ffe-5505-4d43-a924-ff3ccf53c961 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:40.651560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-59be3ffe-5505-4d43-a924-ff3ccf53c961 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:40.661985 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59be3ffe-5505-4d43-a924-ff3ccf53c961 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.284986 Mar 12 20:58:40.684658 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1945/2713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:40 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:40.684658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f03f410-6fec-4e3a-966a-426597be48ec tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:40.684658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f03f410-6fec-4e3a-966a-426597be48ec tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:40.709434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f03f410-6fec-4e3a-966a-426597be48ec tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:40.712011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f03f410-6fec-4e3a-966a-426597be48ec tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:40.713280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f03f410-6fec-4e3a-966a-426597be48ec tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:40.713749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f03f410-6fec-4e3a-966a-426597be48ec tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:40.907342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9f03f410-6fec-4e3a-966a-426597be48ec tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:40.919269 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f03f410-6fec-4e3a-966a-426597be48ec tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1523 microversion: 2.1 time: 0.239567 Mar 12 20:58:40.921971 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1946/2714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:40 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:41.005420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6730e307-9a38-44cc-837f-5468c2496953 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:41.006057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6730e307-9a38-44cc-837f-5468c2496953 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:41.015195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6730e307-9a38-44cc-837f-5468c2496953 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:41.015901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6730e307-9a38-44cc-837f-5468c2496953 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:41.016856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6730e307-9a38-44cc-837f-5468c2496953 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:41.017286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6730e307-9a38-44cc-837f-5468c2496953 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:41.081836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6730e307-9a38-44cc-837f-5468c2496953 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:41.082295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6730e307-9a38-44cc-837f-5468c2496953 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:41.082995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-6730e307-9a38-44cc-837f-5468c2496953 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lazy-loading 'fault' on Instance uuid c731ea4c-67c7-4d48-846f-c10bada24535 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:58:41.155805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6730e307-9a38-44cc-837f-5468c2496953 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd7e5a284a5c44f7b941b18974da4e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399f94948e49454d9b058817feac550a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:41.168409 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6730e307-9a38-44cc-837f-5468c2496953 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 200 len: 1254 microversion: 2.1 time: 0.166773 Mar 12 20:58:41.180355 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1947/2715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:40 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 1254 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:41.186945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-74e991a6-049c-416d-b0f3-920a3480b84a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:41.187650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-74e991a6-049c-416d-b0f3-920a3480b84a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:41.196044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74e991a6-049c-416d-b0f3-920a3480b84a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:41.196692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74e991a6-049c-416d-b0f3-920a3480b84a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:41.197694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74e991a6-049c-416d-b0f3-920a3480b84a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:41.198186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74e991a6-049c-416d-b0f3-920a3480b84a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:41.339458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-74e991a6-049c-416d-b0f3-920a3480b84a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:41.348238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-74e991a6-049c-416d-b0f3-920a3480b84a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:41.350714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-74e991a6-049c-416d-b0f3-920a3480b84a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:41.352030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-74e991a6-049c-416d-b0f3-920a3480b84a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.169582 Mar 12 20:58:41.352511 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1948/2716] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:41 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:41.362866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8bbcba7a-7da1-4a35-a31d-2de64a362222 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:41.362866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8bbcba7a-7da1-4a35-a31d-2de64a362222 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:41.365677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8bbcba7a-7da1-4a35-a31d-2de64a362222 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:41.365677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8bbcba7a-7da1-4a35-a31d-2de64a362222 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:41.366191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8bbcba7a-7da1-4a35-a31d-2de64a362222 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:41.366579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8bbcba7a-7da1-4a35-a31d-2de64a362222 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:41.592982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8bbcba7a-7da1-4a35-a31d-2de64a362222 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:41.602270 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8bbcba7a-7da1-4a35-a31d-2de64a362222 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1317 microversion: 2.1 time: 0.248039 Mar 12 20:58:41.603104 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1949/2717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:41 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:41.618284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-cbb9b9ef-c4a7-47da-81c2-e5cbc2df84a2 req-d837bd5c-a5d7-461c-a8dc-e8f2f345263b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540", "tag": "ca8d30dd-518b-4370-bba7-5a023cd1c331"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:41.626242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cbb9b9ef-c4a7-47da-81c2-e5cbc2df84a2 req-d837bd5c-a5d7-461c-a8dc-e8f2f345263b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:41.626689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cbb9b9ef-c4a7-47da-81c2-e5cbc2df84a2 req-d837bd5c-a5d7-461c-a8dc-e8f2f345263b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:41.639675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-cbb9b9ef-c4a7-47da-81c2-e5cbc2df84a2 req-d837bd5c-a5d7-461c-a8dc-e8f2f345263b service nova] Creating event network-changed:ca8d30dd-518b-4370-bba7-5a023cd1c331 for instance cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 on nch2-master-1 Mar 12 20:58:41.645109 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-cbb9b9ef-c4a7-47da-81c2-e5cbc2df84a2 req-d837bd5c-a5d7-461c-a8dc-e8f2f345263b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030824 Mar 12 20:58:41.646047 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1950/2718] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:41.694378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-63bac1c3-fce2-4914-a116-4b9c7ac0c3eb tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:41.695082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-63bac1c3-fce2-4914-a116-4b9c7ac0c3eb tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:41.701481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63bac1c3-fce2-4914-a116-4b9c7ac0c3eb tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:41.701977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63bac1c3-fce2-4914-a116-4b9c7ac0c3eb tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:41.702901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63bac1c3-fce2-4914-a116-4b9c7ac0c3eb tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:41.703357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63bac1c3-fce2-4914-a116-4b9c7ac0c3eb tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:41.851500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-63bac1c3-fce2-4914-a116-4b9c7ac0c3eb tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:41.867981 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-63bac1c3-fce2-4914-a116-4b9c7ac0c3eb tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.178901 Mar 12 20:58:41.868927 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1951/2719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:41 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:41.937054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc2e6391-230f-4895-a094-838224d7ccf0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:41.937580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc2e6391-230f-4895-a094-838224d7ccf0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:41.944130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc2e6391-230f-4895-a094-838224d7ccf0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:41.944580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc2e6391-230f-4895-a094-838224d7ccf0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:41.945972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc2e6391-230f-4895-a094-838224d7ccf0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:41.946101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc2e6391-230f-4895-a094-838224d7ccf0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:42.094980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dc2e6391-230f-4895-a094-838224d7ccf0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:42.104299 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc2e6391-230f-4895-a094-838224d7ccf0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1523 microversion: 2.1 time: 0.171477 Mar 12 20:58:42.105108 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1952/2720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:41 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:42.221156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-98e71f72-5d37-403c-b754-0c6162b0b5e9 req-03b7c519-c531-4f62-9a88-142905319e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de07409-369a-4686-9c06-7627d6f500fd", "name": "network-vif-plugged", "status": "completed", "tag": "311242c0-e8db-4f1a-b67c-30feecab67fd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:42.230715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-98e71f72-5d37-403c-b754-0c6162b0b5e9 req-03b7c519-c531-4f62-9a88-142905319e6b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:42.231170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-98e71f72-5d37-403c-b754-0c6162b0b5e9 req-03b7c519-c531-4f62-9a88-142905319e6b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:42.243485 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-98e71f72-5d37-403c-b754-0c6162b0b5e9 req-03b7c519-c531-4f62-9a88-142905319e6b service nova] Creating event network-vif-plugged:311242c0-e8db-4f1a-b67c-30feecab67fd for instance 3de07409-369a-4686-9c06-7627d6f500fd on nch2-master-1 Mar 12 20:58:42.248611 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-98e71f72-5d37-403c-b754-0c6162b0b5e9 req-03b7c519-c531-4f62-9a88-142905319e6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094944 Mar 12 20:58:42.249261 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1953/2721] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:58:42.254373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f4edd5b-ae3c-434b-ae4f-f49968ed1278 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:42.255075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f4edd5b-ae3c-434b-ae4f-f49968ed1278 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] [instance: c731ea4c-67c7-4d48-846f-c10bada24535] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:42.262594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f4edd5b-ae3c-434b-ae4f-f49968ed1278 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:42.263048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f4edd5b-ae3c-434b-ae4f-f49968ed1278 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:42.264304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f4edd5b-ae3c-434b-ae4f-f49968ed1278 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:42.264304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f4edd5b-ae3c-434b-ae4f-f49968ed1278 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:42.293303 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-0f4edd5b-ae3c-434b-ae4f-f49968ed1278 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] HTTP exception thrown: Instance c731ea4c-67c7-4d48-846f-c10bada24535 could not be found. Mar 12 20:58:42.293515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f4edd5b-ae3c-434b-ae4f-f49968ed1278 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Returning 404 to user: Instance c731ea4c-67c7-4d48-846f-c10bada24535 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:58:42.295284 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f4edd5b-ae3c-434b-ae4f-f49968ed1278 tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535" status: 404 len: 111 microversion: 2.1 time: 0.043967 Mar 12 20:58:42.298620 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1954/2722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:42 2022] GET /compute/v2.1/servers/c731ea4c-67c7-4d48-846f-c10bada24535 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:58:42.304118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6bc8720e-4f0f-4074-bd69-e684a42eb3af tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] Calling method '.version_select at 0x7f6e48d118b0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:42.331192 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6bc8720e-4f0f-4074-bd69-e684a42eb3af tempest-ServersTestBootFromVolume-1495046152 tempest-ServersTestBootFromVolume-1495046152-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-350042122" status: 202 len: 0 microversion: 2.1 time: 0.030581 Mar 12 20:58:42.331879 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1955/2723] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Mar 12 20:58:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-350042122 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:58:42.373718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-227452a9-ead3-494c-b054-badcadff7b7d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:42.374392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-227452a9-ead3-494c-b054-badcadff7b7d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:42.382006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-227452a9-ead3-494c-b054-badcadff7b7d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:42.382858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-227452a9-ead3-494c-b054-badcadff7b7d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:42.383286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-227452a9-ead3-494c-b054-badcadff7b7d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:42.383728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-227452a9-ead3-494c-b054-badcadff7b7d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:42.470015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-227452a9-ead3-494c-b054-badcadff7b7d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:42.483437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-227452a9-ead3-494c-b054-badcadff7b7d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:42.485250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-227452a9-ead3-494c-b054-badcadff7b7d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:42.486363 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-227452a9-ead3-494c-b054-badcadff7b7d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.116601 Mar 12 20:58:42.487159 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1956/2724] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:42 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:58:42.620750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4ceaf2df-43f8-4a0f-bc03-1902ed39d464 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:42.622094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4ceaf2df-43f8-4a0f-bc03-1902ed39d464 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:42.631682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ceaf2df-43f8-4a0f-bc03-1902ed39d464 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:42.632360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ceaf2df-43f8-4a0f-bc03-1902ed39d464 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:42.633602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ceaf2df-43f8-4a0f-bc03-1902ed39d464 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:42.634355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ceaf2df-43f8-4a0f-bc03-1902ed39d464 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:42.882683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4ceaf2df-43f8-4a0f-bc03-1902ed39d464 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:42.891475 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4ceaf2df-43f8-4a0f-bc03-1902ed39d464 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1317 microversion: 2.1 time: 0.276043 Mar 12 20:58:42.892062 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1957/2725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:42 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:42.897356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7c19488b-bcb3-4795-983e-0b53fd54302c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:42.898162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7c19488b-bcb3-4795-983e-0b53fd54302c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:42.906079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c19488b-bcb3-4795-983e-0b53fd54302c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:42.906873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c19488b-bcb3-4795-983e-0b53fd54302c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:42.908096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c19488b-bcb3-4795-983e-0b53fd54302c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:42.908635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c19488b-bcb3-4795-983e-0b53fd54302c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:43.133544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7c19488b-bcb3-4795-983e-0b53fd54302c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:43.141291 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7c19488b-bcb3-4795-983e-0b53fd54302c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.248106 Mar 12 20:58:43.141904 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1958/2726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:42 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:43.149432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-099b4eb7-cb0a-4e29-b3e8-f872a2025f05 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:43.149432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-099b4eb7-cb0a-4e29-b3e8-f872a2025f05 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:43.155876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-099b4eb7-cb0a-4e29-b3e8-f872a2025f05 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:43.156456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-099b4eb7-cb0a-4e29-b3e8-f872a2025f05 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:43.158348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-099b4eb7-cb0a-4e29-b3e8-f872a2025f05 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:43.158348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-099b4eb7-cb0a-4e29-b3e8-f872a2025f05 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:43.325507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-099b4eb7-cb0a-4e29-b3e8-f872a2025f05 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:43.333051 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-099b4eb7-cb0a-4e29-b3e8-f872a2025f05 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1523 microversion: 2.1 time: 0.190204 Mar 12 20:58:43.333632 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1959/2727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:43 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:43.506467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a6761841-4d6c-4af7-bb53-b71b39abc2f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:43.507076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a6761841-4d6c-4af7-bb53-b71b39abc2f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:43.513560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6761841-4d6c-4af7-bb53-b71b39abc2f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:43.514077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6761841-4d6c-4af7-bb53-b71b39abc2f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:43.514844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6761841-4d6c-4af7-bb53-b71b39abc2f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:43.515278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6761841-4d6c-4af7-bb53-b71b39abc2f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:43.581590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a6761841-4d6c-4af7-bb53-b71b39abc2f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:43.589720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a6761841-4d6c-4af7-bb53-b71b39abc2f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:43.591242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a6761841-4d6c-4af7-bb53-b71b39abc2f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:43.592392 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a6761841-4d6c-4af7-bb53-b71b39abc2f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.089845 Mar 12 20:58:43.592979 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1960/2728] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:43 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:58:43.910292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-343fdb5e-510d-4711-8ba4-2cf7590dc930 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:43.911100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-343fdb5e-510d-4711-8ba4-2cf7590dc930 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:43.918785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-343fdb5e-510d-4711-8ba4-2cf7590dc930 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:43.919330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-343fdb5e-510d-4711-8ba4-2cf7590dc930 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:43.920373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-343fdb5e-510d-4711-8ba4-2cf7590dc930 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:43.920906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-343fdb5e-510d-4711-8ba4-2cf7590dc930 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:44.062485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-343fdb5e-510d-4711-8ba4-2cf7590dc930 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:44.069952 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-343fdb5e-510d-4711-8ba4-2cf7590dc930 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1317 microversion: 2.1 time: 0.164114 Mar 12 20:58:44.070947 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1961/2729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:43 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:44.167653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7adf873f-bdbb-4ffc-9a94-79c6d08c0b69 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:44.168816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7adf873f-bdbb-4ffc-9a94-79c6d08c0b69 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:44.180933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7adf873f-bdbb-4ffc-9a94-79c6d08c0b69 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:44.181158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7adf873f-bdbb-4ffc-9a94-79c6d08c0b69 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:44.181880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7adf873f-bdbb-4ffc-9a94-79c6d08c0b69 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:44.182334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7adf873f-bdbb-4ffc-9a94-79c6d08c0b69 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:44.326132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7adf873f-bdbb-4ffc-9a94-79c6d08c0b69 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:44.334179 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7adf873f-bdbb-4ffc-9a94-79c6d08c0b69 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.177541 Mar 12 20:58:44.335041 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1962/2730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:44 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:44.357089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e4fbac24-3041-461e-b742-dc2703df6c76 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:44.357905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e4fbac24-3041-461e-b742-dc2703df6c76 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:44.369561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4fbac24-3041-461e-b742-dc2703df6c76 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:44.370060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4fbac24-3041-461e-b742-dc2703df6c76 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:44.370951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4fbac24-3041-461e-b742-dc2703df6c76 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:44.371399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4fbac24-3041-461e-b742-dc2703df6c76 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:44.512592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e4fbac24-3041-461e-b742-dc2703df6c76 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:44.520008 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e4fbac24-3041-461e-b742-dc2703df6c76 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1508 microversion: 2.1 time: 0.172191 Mar 12 20:58:44.520579 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1963/2731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:44 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:44.536236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-917d6ce7-5f4f-41d7-85bf-89f0d525b66c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:44.536861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-917d6ce7-5f4f-41d7-85bf-89f0d525b66c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:44.543071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-917d6ce7-5f4f-41d7-85bf-89f0d525b66c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:44.543598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-917d6ce7-5f4f-41d7-85bf-89f0d525b66c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:44.544361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-917d6ce7-5f4f-41d7-85bf-89f0d525b66c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:44.544822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-917d6ce7-5f4f-41d7-85bf-89f0d525b66c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:44.679870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-917d6ce7-5f4f-41d7-85bf-89f0d525b66c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:44.687611 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-917d6ce7-5f4f-41d7-85bf-89f0d525b66c tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 200 len: 1508 microversion: 2.1 time: 0.155098 Mar 12 20:58:44.688199 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1964/2732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:44 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:44.704153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ad2e81e-2c7c-4807-8050-1d5cdffa839f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:44.704873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ad2e81e-2c7c-4807-8050-1d5cdffa839f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:44.712264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ad2e81e-2c7c-4807-8050-1d5cdffa839f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:44.712843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ad2e81e-2c7c-4807-8050-1d5cdffa839f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:44.713696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ad2e81e-2c7c-4807-8050-1d5cdffa839f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:44.714369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ad2e81e-2c7c-4807-8050-1d5cdffa839f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:44.779955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ad2e81e-2c7c-4807-8050-1d5cdffa839f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:44.789309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ad2e81e-2c7c-4807-8050-1d5cdffa839f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:44.790877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ad2e81e-2c7c-4807-8050-1d5cdffa839f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:44.792968 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ad2e81e-2c7c-4807-8050-1d5cdffa839f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.094784 Mar 12 20:58:44.793983 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1965/2733] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:44 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:44.798936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ece23847-a425-499f-bad4-29b5881640c2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:44.799445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ece23847-a425-499f-bad4-29b5881640c2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:44.809145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ece23847-a425-499f-bad4-29b5881640c2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:44.809610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ece23847-a425-499f-bad4-29b5881640c2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:44.810473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ece23847-a425-499f-bad4-29b5881640c2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:44.810910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ece23847-a425-499f-bad4-29b5881640c2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:44.844366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ece23847-a425-499f-bad4-29b5881640c2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:58:44.940275 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ece23847-a425-499f-bad4-29b5881640c2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 204 len: 0 microversion: 2.1 time: 0.144343 Mar 12 20:58:44.941970 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1966/2734] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:58:44 2022] DELETE /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:58:45.050697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-739151375", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "f9a37655-b450-4556-a41b-12a59d1d79f0"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:45.106361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] validate_networks() for [('f9a37655-b450-4556-a41b-12a59d1d79f0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:58:45.579913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:45.579913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:45.580708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:45.580808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:45.581287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:45.591911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:45.592547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:45.593366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:45.593831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:45.614928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Getting quotas for project 6629e3cb02ae4e54a2bd5971423b88a7. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:45.623969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Getting quotas for user f4c8688bddda473ebeeef9a20b13be66 and project 6629e3cb02ae4e54a2bd5971423b88a7. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:45.642306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:58:45.644758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:58:45.689367 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-200a8db1-1185-4b42-a083-00c17349aa00 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642817 Mar 12 20:58:45.691592 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1967/2735] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 20:58:45.694818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b19b796f-e93c-4242-921a-a791633bd3d6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:45.695995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b19b796f-e93c-4242-921a-a791633bd3d6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:45.702587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b19b796f-e93c-4242-921a-a791633bd3d6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:45.703014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b19b796f-e93c-4242-921a-a791633bd3d6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:45.704424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b19b796f-e93c-4242-921a-a791633bd3d6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:45.705154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b19b796f-e93c-4242-921a-a791633bd3d6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:45.894991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b19b796f-e93c-4242-921a-a791633bd3d6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:45.903076 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b19b796f-e93c-4242-921a-a791633bd3d6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1317 microversion: 2.1 time: 0.211973 Mar 12 20:58:45.906272 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1968/2736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:45 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:45.911285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd810f95-ec9d-4bae-b54b-40a93e87d303 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:45.912066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd810f95-ec9d-4bae-b54b-40a93e87d303 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:45.919708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd810f95-ec9d-4bae-b54b-40a93e87d303 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:45.920158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd810f95-ec9d-4bae-b54b-40a93e87d303 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:45.920947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd810f95-ec9d-4bae-b54b-40a93e87d303 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:45.921377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd810f95-ec9d-4bae-b54b-40a93e87d303 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:46.137292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fd810f95-ec9d-4bae-b54b-40a93e87d303 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:46.150361 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd810f95-ec9d-4bae-b54b-40a93e87d303 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.245058 Mar 12 20:58:46.152815 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1969/2737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:45 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:46.172908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-74b14dbd-81c9-4837-b44b-c12fe995b3fb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:46.175218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-74b14dbd-81c9-4837-b44b-c12fe995b3fb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:46.245072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-74b14dbd-81c9-4837-b44b-c12fe995b3fb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:46.265052 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-74b14dbd-81c9-4837-b44b-c12fe995b3fb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1217 microversion: 2.1 time: 0.100996 Mar 12 20:58:46.271669 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1970/2738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:46 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:46.287408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6a99efb8-860b-4642-ae68-a02c3f17ca6e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:46.291220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6a99efb8-860b-4642-ae68-a02c3f17ca6e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:46.308301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a99efb8-860b-4642-ae68-a02c3f17ca6e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:46.308645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a99efb8-860b-4642-ae68-a02c3f17ca6e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:46.311158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a99efb8-860b-4642-ae68-a02c3f17ca6e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:46.311655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a99efb8-860b-4642-ae68-a02c3f17ca6e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:46.438149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6a99efb8-860b-4642-ae68-a02c3f17ca6e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:46.448568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6a99efb8-860b-4642-ae68-a02c3f17ca6e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:46.450465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6a99efb8-860b-4642-ae68-a02c3f17ca6e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:46.451930 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6a99efb8-860b-4642-ae68-a02c3f17ca6e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.176879 Mar 12 20:58:46.457887 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1971/2739] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:46 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:46.921200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9e205b86-ce17-44cd-b615-2cd9d73931ba tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:46.921876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9e205b86-ce17-44cd-b615-2cd9d73931ba tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:46.933003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e205b86-ce17-44cd-b615-2cd9d73931ba tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:46.933527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e205b86-ce17-44cd-b615-2cd9d73931ba tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:46.934338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e205b86-ce17-44cd-b615-2cd9d73931ba tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:46.934775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e205b86-ce17-44cd-b615-2cd9d73931ba tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:47.097597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9e205b86-ce17-44cd-b615-2cd9d73931ba tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:47.108123 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9e205b86-ce17-44cd-b615-2cd9d73931ba tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1317 microversion: 2.1 time: 0.190767 Mar 12 20:58:47.109066 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1972/2740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:46 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:47.169090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f599aa7-fa85-4887-9a17-d356b9d9f82c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:47.169968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f599aa7-fa85-4887-9a17-d356b9d9f82c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:47.182304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f599aa7-fa85-4887-9a17-d356b9d9f82c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:47.183009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f599aa7-fa85-4887-9a17-d356b9d9f82c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:47.183956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f599aa7-fa85-4887-9a17-d356b9d9f82c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:47.184583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f599aa7-fa85-4887-9a17-d356b9d9f82c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:47.437314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f599aa7-fa85-4887-9a17-d356b9d9f82c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:47.446308 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f599aa7-fa85-4887-9a17-d356b9d9f82c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.280274 Mar 12 20:58:47.447411 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1973/2741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:47 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:47.454356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b7d50982-a6e2-4759-9148-92e3f44eb3be tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:47.455162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b7d50982-a6e2-4759-9148-92e3f44eb3be tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:47.462417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7d50982-a6e2-4759-9148-92e3f44eb3be tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:47.463248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7d50982-a6e2-4759-9148-92e3f44eb3be tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:47.464110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7d50982-a6e2-4759-9148-92e3f44eb3be tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:47.464625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7d50982-a6e2-4759-9148-92e3f44eb3be tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:47.546399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b7d50982-a6e2-4759-9148-92e3f44eb3be tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:47.554826 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b7d50982-a6e2-4759-9148-92e3f44eb3be tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1275 microversion: 2.1 time: 0.105666 Mar 12 20:58:47.555740 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1974/2742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:47 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:47.713652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8405f863-d2a4-4e33-a3ed-c4f1f716a4e2 req-1fb59234-6492-4b94-bf57-d545186653dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de07409-369a-4686-9c06-7627d6f500fd", "name": "network-vif-deleted", "tag": "311242c0-e8db-4f1a-b67c-30feecab67fd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:47.730635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8405f863-d2a4-4e33-a3ed-c4f1f716a4e2 req-1fb59234-6492-4b94-bf57-d545186653dd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:47.731509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8405f863-d2a4-4e33-a3ed-c4f1f716a4e2 req-1fb59234-6492-4b94-bf57-d545186653dd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:47.751919 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8405f863-d2a4-4e33-a3ed-c4f1f716a4e2 req-1fb59234-6492-4b94-bf57-d545186653dd service nova] Creating event network-vif-deleted:311242c0-e8db-4f1a-b67c-30feecab67fd for instance 3de07409-369a-4686-9c06-7627d6f500fd on nch2-master-1 Mar 12 20:58:47.764895 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8405f863-d2a4-4e33-a3ed-c4f1f716a4e2 req-1fb59234-6492-4b94-bf57-d545186653dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203227 Mar 12 20:58:47.765746 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1975/2743] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:47.777030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1cf3770a-6c92-4a9b-8b45-dc84639f5c0e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:47.778271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1cf3770a-6c92-4a9b-8b45-dc84639f5c0e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:47.787810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cf3770a-6c92-4a9b-8b45-dc84639f5c0e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:47.789468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cf3770a-6c92-4a9b-8b45-dc84639f5c0e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:47.791049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cf3770a-6c92-4a9b-8b45-dc84639f5c0e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:47.792631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cf3770a-6c92-4a9b-8b45-dc84639f5c0e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:47.872851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1cf3770a-6c92-4a9b-8b45-dc84639f5c0e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:47.882956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1cf3770a-6c92-4a9b-8b45-dc84639f5c0e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:47.885038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1cf3770a-6c92-4a9b-8b45-dc84639f5c0e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:47.886538 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1cf3770a-6c92-4a9b-8b45-dc84639f5c0e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.119607 Mar 12 20:58:47.891126 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1976/2744] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:47 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:48.125405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-884bcf30-1f54-478f-ba53-2fd5fc7d2596 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:48.126490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-884bcf30-1f54-478f-ba53-2fd5fc7d2596 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:48.132572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-884bcf30-1f54-478f-ba53-2fd5fc7d2596 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:48.133379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-884bcf30-1f54-478f-ba53-2fd5fc7d2596 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:48.134579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-884bcf30-1f54-478f-ba53-2fd5fc7d2596 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:48.134982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-884bcf30-1f54-478f-ba53-2fd5fc7d2596 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:48.395245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-884bcf30-1f54-478f-ba53-2fd5fc7d2596 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:48.404245 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-884bcf30-1f54-478f-ba53-2fd5fc7d2596 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1317 microversion: 2.1 time: 0.283098 Mar 12 20:58:48.414396 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1977/2745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:48 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:48.463962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20a88939-64b6-45ac-a993-deecfe5e3321 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:48.464656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20a88939-64b6-45ac-a993-deecfe5e3321 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:48.480887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20a88939-64b6-45ac-a993-deecfe5e3321 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:48.481347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20a88939-64b6-45ac-a993-deecfe5e3321 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:48.482603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20a88939-64b6-45ac-a993-deecfe5e3321 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:48.483216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20a88939-64b6-45ac-a993-deecfe5e3321 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:48.747466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-20a88939-64b6-45ac-a993-deecfe5e3321 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:48.754822 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20a88939-64b6-45ac-a993-deecfe5e3321 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.295703 Mar 12 20:58:48.755398 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1978/2746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:48 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:48.760494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fc64b8b0-73f2-46d6-a3a7-6eb146bdcd99 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:48.761242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fc64b8b0-73f2-46d6-a3a7-6eb146bdcd99 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:48.767886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc64b8b0-73f2-46d6-a3a7-6eb146bdcd99 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:48.768350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc64b8b0-73f2-46d6-a3a7-6eb146bdcd99 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:48.769104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc64b8b0-73f2-46d6-a3a7-6eb146bdcd99 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:48.769542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc64b8b0-73f2-46d6-a3a7-6eb146bdcd99 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:49.007834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fc64b8b0-73f2-46d6-a3a7-6eb146bdcd99 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:49.015298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fc64b8b0-73f2-46d6-a3a7-6eb146bdcd99 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1317 microversion: 2.1 time: 0.258920 Mar 12 20:58:49.015887 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1979/2747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:48 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:49.142826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1415359521", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": "none"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:49.198531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:58:49.198961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:58:49.199443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:58:49.199859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:58:49.200277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:58:49.209532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:49.210048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:49.211048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:49.211506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:49.230902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Getting quotas for project 8b87c20286eb44c39c477861a5c01c6f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:58:49.236518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Getting quotas for user 9f036a19cfa34967a4ceb4a3f4281659 and project 8b87c20286eb44c39c477861a5c01c6f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:58:49.250229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:58:49.252542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:58:49.296922 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75a004c3-2f7e-40ec-b7d9-425e5649db48 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.279974 Mar 12 20:58:49.297588 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1980/2748] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 20:58:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 20:58:49.306937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ab64816-88c5-42f9-ab22-9626cf878dfb tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:49.307552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8ab64816-88c5-42f9-ab22-9626cf878dfb tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:49.328227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ab64816-88c5-42f9-ab22-9626cf878dfb tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:49.328683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ab64816-88c5-42f9-ab22-9626cf878dfb tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:49.329468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ab64816-88c5-42f9-ab22-9626cf878dfb tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:49.329945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ab64816-88c5-42f9-ab22-9626cf878dfb tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:49.416592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ab64816-88c5-42f9-ab22-9626cf878dfb tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:49.427324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ab64816-88c5-42f9-ab22-9626cf878dfb tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:49.428987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ab64816-88c5-42f9-ab22-9626cf878dfb tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:49.430410 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ab64816-88c5-42f9-ab22-9626cf878dfb tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.131837 Mar 12 20:58:49.431744 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1981/2749] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:49 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:49.506836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9b8c24dd-2780-41fb-9be8-22a58621b4a3 req-818d21f2-2a29-4371-95e9-79f5eb72b919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2525b05f-37e3-4a6c-8067-589b19f45e26", "tag": "6dca0f40-08da-44a6-9292-47a08459659a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:49.515528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9b8c24dd-2780-41fb-9be8-22a58621b4a3 req-818d21f2-2a29-4371-95e9-79f5eb72b919 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:49.515991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9b8c24dd-2780-41fb-9be8-22a58621b4a3 req-818d21f2-2a29-4371-95e9-79f5eb72b919 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:49.528727 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9b8c24dd-2780-41fb-9be8-22a58621b4a3 req-818d21f2-2a29-4371-95e9-79f5eb72b919 service nova] Creating event network-changed:6dca0f40-08da-44a6-9292-47a08459659a for instance 2525b05f-37e3-4a6c-8067-589b19f45e26 on nch1-master-1 Mar 12 20:58:49.534766 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9b8c24dd-2780-41fb-9be8-22a58621b4a3 req-818d21f2-2a29-4371-95e9-79f5eb72b919 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101761 Mar 12 20:58:49.535840 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1982/2750] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:49.543088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad9aad56-9cf3-4c42-958b-d6e637bc2af3 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:49.543803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad9aad56-9cf3-4c42-958b-d6e637bc2af3 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:49.631008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad9aad56-9cf3-4c42-958b-d6e637bc2af3 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:49.643436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad9aad56-9cf3-4c42-958b-d6e637bc2af3 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:49.645996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad9aad56-9cf3-4c42-958b-d6e637bc2af3 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:49.647517 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad9aad56-9cf3-4c42-958b-d6e637bc2af3 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44" status: 200 len: 1281 microversion: 2.47 time: 0.110081 Mar 12 20:58:49.659076 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1983/2751] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:49 2022] GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44 => generated 1281 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:49.659076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2de469f2-0006-441f-ac31-095c14e94f9f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:49.659076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2de469f2-0006-441f-ac31-095c14e94f9f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:49.662596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2de469f2-0006-441f-ac31-095c14e94f9f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:49.663088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2de469f2-0006-441f-ac31-095c14e94f9f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:49.664699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2de469f2-0006-441f-ac31-095c14e94f9f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:49.665208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2de469f2-0006-441f-ac31-095c14e94f9f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:49.904504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2de469f2-0006-441f-ac31-095c14e94f9f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:49.912785 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2de469f2-0006-441f-ac31-095c14e94f9f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1317 microversion: 2.1 time: 0.262332 Mar 12 20:58:49.913546 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1984/2752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:49 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:49.918646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9641d376-87d8-4050-a00e-59429695d444 req-3b5aef99-e43b-4994-84cf-00039c4408ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540", "name": "network-vif-plugged", "status": "completed", "tag": "ca8d30dd-518b-4370-bba7-5a023cd1c331"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:49.926448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9641d376-87d8-4050-a00e-59429695d444 req-3b5aef99-e43b-4994-84cf-00039c4408ca service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:49.926907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9641d376-87d8-4050-a00e-59429695d444 req-3b5aef99-e43b-4994-84cf-00039c4408ca service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:49.938176 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9641d376-87d8-4050-a00e-59429695d444 req-3b5aef99-e43b-4994-84cf-00039c4408ca service nova] Creating event network-vif-plugged:ca8d30dd-518b-4370-bba7-5a023cd1c331 for instance cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 on nch2-master-1 Mar 12 20:58:49.943563 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9641d376-87d8-4050-a00e-59429695d444 req-3b5aef99-e43b-4994-84cf-00039c4408ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028704 Mar 12 20:58:49.944534 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1985/2753] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:49.950241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1a4b1532-a534-41c2-a67f-e4ff2d387078 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:49.950954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1a4b1532-a534-41c2-a67f-e4ff2d387078 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:49.960219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a4b1532-a534-41c2-a67f-e4ff2d387078 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:49.961287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a4b1532-a534-41c2-a67f-e4ff2d387078 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:49.962633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a4b1532-a534-41c2-a67f-e4ff2d387078 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:49.963109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a4b1532-a534-41c2-a67f-e4ff2d387078 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:50.462121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1a4b1532-a534-41c2-a67f-e4ff2d387078 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:50.469390 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1a4b1532-a534-41c2-a67f-e4ff2d387078 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.523217 Mar 12 20:58:50.470059 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1986/2754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:49 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:50.474666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f65508f1-171a-4c1f-b8bc-63680a95f3a5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:50.475269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f65508f1-171a-4c1f-b8bc-63680a95f3a5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:50.482541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f65508f1-171a-4c1f-b8bc-63680a95f3a5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:50.483008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f65508f1-171a-4c1f-b8bc-63680a95f3a5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:50.483788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f65508f1-171a-4c1f-b8bc-63680a95f3a5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:50.484234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f65508f1-171a-4c1f-b8bc-63680a95f3a5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:50.629258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f65508f1-171a-4c1f-b8bc-63680a95f3a5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:50.637370 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f65508f1-171a-4c1f-b8bc-63680a95f3a5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1317 microversion: 2.1 time: 0.166306 Mar 12 20:58:50.638271 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1987/2755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:50 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:50.643111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21aa8f3b-98b4-44c3-93c7-7480078677f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:50.643720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-21aa8f3b-98b4-44c3-93c7-7480078677f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:50.649475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21aa8f3b-98b4-44c3-93c7-7480078677f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:50.649987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21aa8f3b-98b4-44c3-93c7-7480078677f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:50.650784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21aa8f3b-98b4-44c3-93c7-7480078677f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:50.651223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21aa8f3b-98b4-44c3-93c7-7480078677f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:50.714480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21aa8f3b-98b4-44c3-93c7-7480078677f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:50.722691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21aa8f3b-98b4-44c3-93c7-7480078677f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:50.724202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21aa8f3b-98b4-44c3-93c7-7480078677f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:50.725366 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21aa8f3b-98b4-44c3-93c7-7480078677f3 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.086099 Mar 12 20:58:50.726225 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1988/2756] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:50 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:50.730862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e4ece0d9-6925-4274-b20b-369c8773f4ae tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:50.731467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e4ece0d9-6925-4274-b20b-369c8773f4ae tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:50.737158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4ece0d9-6925-4274-b20b-369c8773f4ae tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:50.737610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4ece0d9-6925-4274-b20b-369c8773f4ae tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:50.738422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4ece0d9-6925-4274-b20b-369c8773f4ae tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:50.738860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4ece0d9-6925-4274-b20b-369c8773f4ae tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:50.798074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e4ece0d9-6925-4274-b20b-369c8773f4ae tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:50.806372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e4ece0d9-6925-4274-b20b-369c8773f4ae tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:50.807873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e4ece0d9-6925-4274-b20b-369c8773f4ae tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:50.808992 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e4ece0d9-6925-4274-b20b-369c8773f4ae tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44" status: 200 len: 1339 microversion: 2.47 time: 0.081579 Mar 12 20:58:50.809583 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1989/2757] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:50 2022] GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44 => generated 1339 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:50.929659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4d45b7ff-e4c4-41b2-b7e2-a367d4fdd06c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:50.930304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4d45b7ff-e4c4-41b2-b7e2-a367d4fdd06c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:50.936246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d45b7ff-e4c4-41b2-b7e2-a367d4fdd06c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:50.936703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d45b7ff-e4c4-41b2-b7e2-a367d4fdd06c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:50.937474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d45b7ff-e4c4-41b2-b7e2-a367d4fdd06c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:50.937958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d45b7ff-e4c4-41b2-b7e2-a367d4fdd06c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:51.078685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4d45b7ff-e4c4-41b2-b7e2-a367d4fdd06c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:51.086636 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4d45b7ff-e4c4-41b2-b7e2-a367d4fdd06c tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1317 microversion: 2.1 time: 0.160938 Mar 12 20:58:51.087214 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1990/2758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:50 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:51.487654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c5cc57e-11e0-4767-b998-d685eba42f89 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:51.488272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c5cc57e-11e0-4767-b998-d685eba42f89 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:51.494898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c5cc57e-11e0-4767-b998-d685eba42f89 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:51.495360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c5cc57e-11e0-4767-b998-d685eba42f89 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:51.496131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c5cc57e-11e0-4767-b998-d685eba42f89 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:51.496580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c5cc57e-11e0-4767-b998-d685eba42f89 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:51.626388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4c5cc57e-11e0-4767-b998-d685eba42f89 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:51.634873 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4c5cc57e-11e0-4767-b998-d685eba42f89 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.151614 Mar 12 20:58:51.635544 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1991/2759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:51 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:51.654031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ada4db4-e3e1-459d-8b37-b4b7a05a770e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:51.654646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ada4db4-e3e1-459d-8b37-b4b7a05a770e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:51.660416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ada4db4-e3e1-459d-8b37-b4b7a05a770e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:51.660875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ada4db4-e3e1-459d-8b37-b4b7a05a770e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:51.661645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ada4db4-e3e1-459d-8b37-b4b7a05a770e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:51.662125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ada4db4-e3e1-459d-8b37-b4b7a05a770e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:51.793721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9ada4db4-e3e1-459d-8b37-b4b7a05a770e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:51.800994 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ada4db4-e3e1-459d-8b37-b4b7a05a770e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1317 microversion: 2.1 time: 0.150612 Mar 12 20:58:51.801574 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1992/2760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:51 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:51.806551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b87e1140-1bb2-4c46-9dfa-11e1ee863c09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:51.807156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b87e1140-1bb2-4c46-9dfa-11e1ee863c09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:51.812655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b87e1140-1bb2-4c46-9dfa-11e1ee863c09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:51.813118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b87e1140-1bb2-4c46-9dfa-11e1ee863c09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:51.813921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b87e1140-1bb2-4c46-9dfa-11e1ee863c09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:51.814361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b87e1140-1bb2-4c46-9dfa-11e1ee863c09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:51.879279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b87e1140-1bb2-4c46-9dfa-11e1ee863c09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:51.887816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b87e1140-1bb2-4c46-9dfa-11e1ee863c09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:51.889320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b87e1140-1bb2-4c46-9dfa-11e1ee863c09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:51.890508 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b87e1140-1bb2-4c46-9dfa-11e1ee863c09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.087990 Mar 12 20:58:51.891077 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1993/2761] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:51 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:51.895473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a945b884-c8f3-4a57-b26e-509bb7bb62bf tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:51.896075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a945b884-c8f3-4a57-b26e-509bb7bb62bf tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:51.901516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a945b884-c8f3-4a57-b26e-509bb7bb62bf tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:51.902013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a945b884-c8f3-4a57-b26e-509bb7bb62bf tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:51.902782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a945b884-c8f3-4a57-b26e-509bb7bb62bf tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:51.903219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a945b884-c8f3-4a57-b26e-509bb7bb62bf tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:51.963402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a945b884-c8f3-4a57-b26e-509bb7bb62bf tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:51.971077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a945b884-c8f3-4a57-b26e-509bb7bb62bf tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:51.972600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a945b884-c8f3-4a57-b26e-509bb7bb62bf tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:51.973712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a945b884-c8f3-4a57-b26e-509bb7bb62bf tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44" status: 200 len: 1339 microversion: 2.47 time: 0.081725 Mar 12 20:58:51.974304 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1994/2762] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:51 2022] GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44 => generated 1339 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:52.103774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a3254fc7-8248-4249-b8b1-b9322486d4b0 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:52.104311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a3254fc7-8248-4249-b8b1-b9322486d4b0 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:52.110176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3254fc7-8248-4249-b8b1-b9322486d4b0 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:52.110635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3254fc7-8248-4249-b8b1-b9322486d4b0 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:52.111633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3254fc7-8248-4249-b8b1-b9322486d4b0 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:52.111836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3254fc7-8248-4249-b8b1-b9322486d4b0 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:52.241210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a3254fc7-8248-4249-b8b1-b9322486d4b0 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:52.248568 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a3254fc7-8248-4249-b8b1-b9322486d4b0 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1466 microversion: 2.1 time: 0.149290 Mar 12 20:58:52.249150 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1995/2763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:52 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1466 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:52.264129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b532953c-584e-45bf-929c-8553d240a43c tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:52.264734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b532953c-584e-45bf-929c-8553d240a43c tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:52.270214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b532953c-584e-45bf-929c-8553d240a43c tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:52.270672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b532953c-584e-45bf-929c-8553d240a43c tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:52.271434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b532953c-584e-45bf-929c-8553d240a43c tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:52.271879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b532953c-584e-45bf-929c-8553d240a43c tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:52.399697 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b532953c-584e-45bf-929c-8553d240a43c tempest-ServersOnMultiNodesTest-140997278 tempest-ServersOnMultiNodesTest-140997278-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1617 microversion: 2.1 time: 0.138803 Mar 12 20:58:52.400277 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1996/2764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:52 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1617 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:52.416529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b1b2d5b-33f9-44fc-b09f-7bf7f7b9af61 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:52.417024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b1b2d5b-33f9-44fc-b09f-7bf7f7b9af61 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:52.422639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b1b2d5b-33f9-44fc-b09f-7bf7f7b9af61 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:52.423089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b1b2d5b-33f9-44fc-b09f-7bf7f7b9af61 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:52.423846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b1b2d5b-33f9-44fc-b09f-7bf7f7b9af61 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:52.424285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b1b2d5b-33f9-44fc-b09f-7bf7f7b9af61 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:52.449437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b1b2d5b-33f9-44fc-b09f-7bf7f7b9af61 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:58:52.523973 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b1b2d5b-33f9-44fc-b09f-7bf7f7b9af61 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 204 len: 0 microversion: 2.1 time: 0.110787 Mar 12 20:58:52.524626 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1997/2765] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:58:52 2022] DELETE /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 20:58:52.533200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e127d007-4386-40b9-b8aa-6c05094c5b79 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:52.533942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e127d007-4386-40b9-b8aa-6c05094c5b79 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:52.539777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e127d007-4386-40b9-b8aa-6c05094c5b79 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:52.540239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e127d007-4386-40b9-b8aa-6c05094c5b79 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:52.541007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e127d007-4386-40b9-b8aa-6c05094c5b79 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:52.541503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e127d007-4386-40b9-b8aa-6c05094c5b79 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:52.672467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e127d007-4386-40b9-b8aa-6c05094c5b79 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:52.680246 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e127d007-4386-40b9-b8aa-6c05094c5b79 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1472 microversion: 2.1 time: 0.150568 Mar 12 20:58:52.680819 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1998/2766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:52 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1472 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:52.685162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0e46846a-dc0d-438a-94bd-43a75be0419a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:52.685759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0e46846a-dc0d-438a-94bd-43a75be0419a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:52.691108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e46846a-dc0d-438a-94bd-43a75be0419a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:52.691808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e46846a-dc0d-438a-94bd-43a75be0419a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:52.692556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e46846a-dc0d-438a-94bd-43a75be0419a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:52.692988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e46846a-dc0d-438a-94bd-43a75be0419a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:52.827593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0e46846a-dc0d-438a-94bd-43a75be0419a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:52.835050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0e46846a-dc0d-438a-94bd-43a75be0419a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.153296 Mar 12 20:58:52.835668 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 1999/2767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:52 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:52.840233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd3542a6-d03b-478b-bc12-150362ce2ae0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:52.840858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd3542a6-d03b-478b-bc12-150362ce2ae0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:52.846423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3542a6-d03b-478b-bc12-150362ce2ae0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:52.846872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3542a6-d03b-478b-bc12-150362ce2ae0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:52.847628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3542a6-d03b-478b-bc12-150362ce2ae0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:52.848062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3542a6-d03b-478b-bc12-150362ce2ae0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:52.984711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bd3542a6-d03b-478b-bc12-150362ce2ae0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:52.992825 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd3542a6-d03b-478b-bc12-150362ce2ae0 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1317 microversion: 2.1 time: 0.155435 Mar 12 20:58:52.993407 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2000/2768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:52 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:52.997815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5bc13b0d-5f6c-4092-b1ad-503ad8424804 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:52.998423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5bc13b0d-5f6c-4092-b1ad-503ad8424804 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:53.003932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bc13b0d-5f6c-4092-b1ad-503ad8424804 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:53.004378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bc13b0d-5f6c-4092-b1ad-503ad8424804 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:53.005146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bc13b0d-5f6c-4092-b1ad-503ad8424804 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:53.005587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bc13b0d-5f6c-4092-b1ad-503ad8424804 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:53.066003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5bc13b0d-5f6c-4092-b1ad-503ad8424804 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:53.076762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5bc13b0d-5f6c-4092-b1ad-503ad8424804 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:53.078482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5bc13b0d-5f6c-4092-b1ad-503ad8424804 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:53.079663 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5bc13b0d-5f6c-4092-b1ad-503ad8424804 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.085319 Mar 12 20:58:53.082593 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2001/2769] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:52 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:53.087716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e59cb22f-506f-4798-bf0c-39828d6643f4 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:53.088350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e59cb22f-506f-4798-bf0c-39828d6643f4 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:53.094329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e59cb22f-506f-4798-bf0c-39828d6643f4 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:53.094760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e59cb22f-506f-4798-bf0c-39828d6643f4 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:53.095523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e59cb22f-506f-4798-bf0c-39828d6643f4 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:53.095953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e59cb22f-506f-4798-bf0c-39828d6643f4 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:53.155870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e59cb22f-506f-4798-bf0c-39828d6643f4 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:53.163541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e59cb22f-506f-4798-bf0c-39828d6643f4 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:53.165647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e59cb22f-506f-4798-bf0c-39828d6643f4 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:53.166793 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e59cb22f-506f-4798-bf0c-39828d6643f4 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44" status: 200 len: 1339 microversion: 2.47 time: 0.083250 Mar 12 20:58:53.167352 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2002/2770] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:53 2022] GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44 => generated 1339 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:53.697229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-15c702aa-252d-4dbc-a82d-3b2b37688d02 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:53.697903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-15c702aa-252d-4dbc-a82d-3b2b37688d02 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:53.704634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15c702aa-252d-4dbc-a82d-3b2b37688d02 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:53.705085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15c702aa-252d-4dbc-a82d-3b2b37688d02 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:53.705884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15c702aa-252d-4dbc-a82d-3b2b37688d02 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:53.706327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15c702aa-252d-4dbc-a82d-3b2b37688d02 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:53.844794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-15c702aa-252d-4dbc-a82d-3b2b37688d02 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:53.852412 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-15c702aa-252d-4dbc-a82d-3b2b37688d02 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1472 microversion: 2.1 time: 0.159605 Mar 12 20:58:53.852989 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2003/2771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:53 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1472 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:53.857543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eaf975d5-7a4a-4b43-9cb1-10bd4f940eee tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:53.858198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eaf975d5-7a4a-4b43-9cb1-10bd4f940eee tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:53.864575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eaf975d5-7a4a-4b43-9cb1-10bd4f940eee tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:53.865034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eaf975d5-7a4a-4b43-9cb1-10bd4f940eee tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:53.865951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eaf975d5-7a4a-4b43-9cb1-10bd4f940eee tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:53.866403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eaf975d5-7a4a-4b43-9cb1-10bd4f940eee tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:53.998105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eaf975d5-7a4a-4b43-9cb1-10bd4f940eee tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:54.006062 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eaf975d5-7a4a-4b43-9cb1-10bd4f940eee tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.152045 Mar 12 20:58:54.009788 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2004/2772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:53 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:54.012033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8494e83a-68e8-4645-b0af-891891597c1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:54.012752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8494e83a-68e8-4645-b0af-891891597c1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:54.020241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8494e83a-68e8-4645-b0af-891891597c1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.020819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8494e83a-68e8-4645-b0af-891891597c1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.021668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8494e83a-68e8-4645-b0af-891891597c1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.022222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8494e83a-68e8-4645-b0af-891891597c1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.168133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8494e83a-68e8-4645-b0af-891891597c1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:54.176908 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8494e83a-68e8-4645-b0af-891891597c1f tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1317 microversion: 2.1 time: 0.169085 Mar 12 20:58:54.177565 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2005/2773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:54 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:54.190343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7ee2633e-08d0-4719-9779-e86a19807b42 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:54.190988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7ee2633e-08d0-4719-9779-e86a19807b42 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:54.197728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ee2633e-08d0-4719-9779-e86a19807b42 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.198210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ee2633e-08d0-4719-9779-e86a19807b42 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.199029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ee2633e-08d0-4719-9779-e86a19807b42 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.199426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ee2633e-08d0-4719-9779-e86a19807b42 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.261230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7ee2633e-08d0-4719-9779-e86a19807b42 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:54.269138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7ee2633e-08d0-4719-9779-e86a19807b42 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:54.270689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7ee2633e-08d0-4719-9779-e86a19807b42 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:54.271980 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7ee2633e-08d0-4719-9779-e86a19807b42 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.085376 Mar 12 20:58:54.272564 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2006/2774] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:54 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:54.277083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-63711754-b85e-4de2-8f4f-ba39cc34be1f tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:54.277694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-63711754-b85e-4de2-8f4f-ba39cc34be1f tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:54.283444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63711754-b85e-4de2-8f4f-ba39cc34be1f tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.283962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63711754-b85e-4de2-8f4f-ba39cc34be1f tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.284777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63711754-b85e-4de2-8f4f-ba39cc34be1f tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.285219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63711754-b85e-4de2-8f4f-ba39cc34be1f tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.347112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-63711754-b85e-4de2-8f4f-ba39cc34be1f tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:54.356261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-63711754-b85e-4de2-8f4f-ba39cc34be1f tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:54.357807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-63711754-b85e-4de2-8f4f-ba39cc34be1f tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:54.358992 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-63711754-b85e-4de2-8f4f-ba39cc34be1f tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44" status: 200 len: 1360 microversion: 2.47 time: 0.085324 Mar 12 20:58:54.359747 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2007/2775] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:54 2022] GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44 => generated 1360 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:54.377400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75ada2e9-b885-4f0b-acde-a706441ba40e tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-847508117"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:54.378601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75ada2e9-b885-4f0b-acde-a706441ba40e tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:54.384545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75ada2e9-b885-4f0b-acde-a706441ba40e tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.385006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75ada2e9-b885-4f0b-acde-a706441ba40e tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.385804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75ada2e9-b885-4f0b-acde-a706441ba40e tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.386288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75ada2e9-b885-4f0b-acde-a706441ba40e tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.693938 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75ada2e9-b885-4f0b-acde-a706441ba40e tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] 10.222.0.30 "POST /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44/action" status: 202 len: 52 microversion: 2.47 time: 0.320124 Mar 12 20:58:54.700794 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2008/2776] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 20:58:54 2022] POST /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44/action => generated 52 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Mar 12 20:58:54.713950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-405b8079-7ce8-4ae5-a77a-3e0c19cbdd4b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:54.714734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-405b8079-7ce8-4ae5-a77a-3e0c19cbdd4b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:54.727624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-405b8079-7ce8-4ae5-a77a-3e0c19cbdd4b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.728219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-405b8079-7ce8-4ae5-a77a-3e0c19cbdd4b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.730488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-405b8079-7ce8-4ae5-a77a-3e0c19cbdd4b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.730488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-405b8079-7ce8-4ae5-a77a-3e0c19cbdd4b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.763736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-405b8079-7ce8-4ae5-a77a-3e0c19cbdd4b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:58:54.886531 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-405b8079-7ce8-4ae5-a77a-3e0c19cbdd4b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44" status: 204 len: 0 microversion: 2.47 time: 0.181657 Mar 12 20:58:54.887592 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2009/2777] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:58:54 2022] DELETE /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:58:54.895102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3275b8d0-c55d-45f6-985a-7ebf00a273b9 req-4bdb8072-4c5c-47db-9198-651a29b15868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540", "name": "network-vif-deleted", "tag": "ca8d30dd-518b-4370-bba7-5a023cd1c331"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:54.908522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3275b8d0-c55d-45f6-985a-7ebf00a273b9 req-4bdb8072-4c5c-47db-9198-651a29b15868 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.909595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3275b8d0-c55d-45f6-985a-7ebf00a273b9 req-4bdb8072-4c5c-47db-9198-651a29b15868 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.928349 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3275b8d0-c55d-45f6-985a-7ebf00a273b9 req-4bdb8072-4c5c-47db-9198-651a29b15868 service nova] Creating event network-vif-deleted:ca8d30dd-518b-4370-bba7-5a023cd1c331 for instance cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 on nch2-master-1 Mar 12 20:58:54.935509 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3275b8d0-c55d-45f6-985a-7ebf00a273b9 req-4bdb8072-4c5c-47db-9198-651a29b15868 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046330 Mar 12 20:58:54.936456 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2010/2778] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:54.943503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd530b7f-5785-4040-800d-2c0d4d82b6f4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:54.943976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd530b7f-5785-4040-800d-2c0d4d82b6f4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:54.950912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd530b7f-5785-4040-800d-2c0d4d82b6f4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.951848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd530b7f-5785-4040-800d-2c0d4d82b6f4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.952241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd530b7f-5785-4040-800d-2c0d4d82b6f4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.952927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd530b7f-5785-4040-800d-2c0d4d82b6f4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.989143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd530b7f-5785-4040-800d-2c0d4d82b6f4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:54.989599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd530b7f-5785-4040-800d-2c0d4d82b6f4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:54.990093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-fd530b7f-5785-4040-800d-2c0d4d82b6f4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lazy-loading 'fault' on Instance uuid cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:58:55.034622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fd530b7f-5785-4040-800d-2c0d4d82b6f4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:55.042325 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd530b7f-5785-4040-800d-2c0d4d82b6f4 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 200 len: 1307 microversion: 2.1 time: 0.104662 Mar 12 20:58:55.043101 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2011/2779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:54 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:55.047426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d89bb33-16bb-4d17-b5fa-f0964e100809 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:55.048059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8d89bb33-16bb-4d17-b5fa-f0964e100809 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:55.054801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d89bb33-16bb-4d17-b5fa-f0964e100809 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:55.054971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d89bb33-16bb-4d17-b5fa-f0964e100809 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:55.055704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d89bb33-16bb-4d17-b5fa-f0964e100809 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:55.056140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d89bb33-16bb-4d17-b5fa-f0964e100809 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:55.123969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d89bb33-16bb-4d17-b5fa-f0964e100809 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:55.131975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d89bb33-16bb-4d17-b5fa-f0964e100809 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:55.134101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d89bb33-16bb-4d17-b5fa-f0964e100809 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:55.135317 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d89bb33-16bb-4d17-b5fa-f0964e100809 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44" status: 200 len: 1366 microversion: 2.47 time: 0.091485 Mar 12 20:58:55.135890 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2012/2780] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:55 2022] GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44 => generated 1366 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:55.140648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ef3e8bc3-817c-433e-92e7-3844487e0d16 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:55.141249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ef3e8bc3-817c-433e-92e7-3844487e0d16 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:55.147181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef3e8bc3-817c-433e-92e7-3844487e0d16 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:55.147754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef3e8bc3-817c-433e-92e7-3844487e0d16 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:55.149119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef3e8bc3-817c-433e-92e7-3844487e0d16 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:55.149568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef3e8bc3-817c-433e-92e7-3844487e0d16 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:55.292973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ef3e8bc3-817c-433e-92e7-3844487e0d16 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:55.302115 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ef3e8bc3-817c-433e-92e7-3844487e0d16 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.165179 Mar 12 20:58:55.303075 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2013/2781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:55 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:55.308567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34269db3-e778-46fa-a3b0-35a0e01da011 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:55.309242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34269db3-e778-46fa-a3b0-35a0e01da011 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:55.315159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34269db3-e778-46fa-a3b0-35a0e01da011 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:55.315611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34269db3-e778-46fa-a3b0-35a0e01da011 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:55.317159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34269db3-e778-46fa-a3b0-35a0e01da011 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:55.317159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34269db3-e778-46fa-a3b0-35a0e01da011 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:55.463198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34269db3-e778-46fa-a3b0-35a0e01da011 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:55.470419 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34269db3-e778-46fa-a3b0-35a0e01da011 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1317 microversion: 2.1 time: 0.166261 Mar 12 20:58:55.470990 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2014/2782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:55 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:55.475424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5fc1170-6a95-434e-aed9-273c15a3e13e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:55.476084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f5fc1170-6a95-434e-aed9-273c15a3e13e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:55.481419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5fc1170-6a95-434e-aed9-273c15a3e13e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:55.481916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5fc1170-6a95-434e-aed9-273c15a3e13e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:55.482682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5fc1170-6a95-434e-aed9-273c15a3e13e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:55.483121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5fc1170-6a95-434e-aed9-273c15a3e13e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:55.543747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f5fc1170-6a95-434e-aed9-273c15a3e13e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:55.551735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f5fc1170-6a95-434e-aed9-273c15a3e13e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:55.553257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f5fc1170-6a95-434e-aed9-273c15a3e13e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:55.554992 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5fc1170-6a95-434e-aed9-273c15a3e13e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.082553 Mar 12 20:58:55.555568 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2015/2783] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:55 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:56.059624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd0e3705-e979-4b4d-a7f7-dfff99aee965 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:56.060391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd0e3705-e979-4b4d-a7f7-dfff99aee965 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:56.069652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd0e3705-e979-4b4d-a7f7-dfff99aee965 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:56.070405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd0e3705-e979-4b4d-a7f7-dfff99aee965 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:56.071180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd0e3705-e979-4b4d-a7f7-dfff99aee965 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:56.071625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd0e3705-e979-4b4d-a7f7-dfff99aee965 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:56.085434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bd0e3705-e979-4b4d-a7f7-dfff99aee965 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] HTTP exception thrown: Instance cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 could not be found. Mar 12 20:58:56.086560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd0e3705-e979-4b4d-a7f7-dfff99aee965 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Returning 404 to user: Instance cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:58:56.087388 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd0e3705-e979-4b4d-a7f7-dfff99aee965 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540" status: 404 len: 111 microversion: 2.1 time: 0.031673 Mar 12 20:58:56.087942 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2016/2784] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:56 2022] GET /compute/v2.1/servers/cbdb3fd5-b32b-4b9a-9512-b2ffab0b9540 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:58:56.096094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3f69b1c6-6c75-4a85-b014-801c500fca26 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:56.096604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3f69b1c6-6c75-4a85-b014-801c500fca26 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:56.102976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f69b1c6-6c75-4a85-b014-801c500fca26 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:56.103507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f69b1c6-6c75-4a85-b014-801c500fca26 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:56.104273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f69b1c6-6c75-4a85-b014-801c500fca26 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:56.104715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f69b1c6-6c75-4a85-b014-801c500fca26 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:56.128813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3f69b1c6-6c75-4a85-b014-801c500fca26 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:58:56.207905 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3f69b1c6-6c75-4a85-b014-801c500fca26 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "DELETE /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 204 len: 0 microversion: 2.1 time: 0.115359 Mar 12 20:58:56.208651 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2017/2785] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:58:56 2022] DELETE /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 20:58:56.214339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-817567d7-f9d5-4790-b785-c4d750858c97 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:56.215035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-817567d7-f9d5-4790-b785-c4d750858c97 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:56.220914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-817567d7-f9d5-4790-b785-c4d750858c97 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:56.221432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-817567d7-f9d5-4790-b785-c4d750858c97 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:56.222191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-817567d7-f9d5-4790-b785-c4d750858c97 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:56.222635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-817567d7-f9d5-4790-b785-c4d750858c97 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:56.550458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-817567d7-f9d5-4790-b785-c4d750858c97 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:56.558536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-817567d7-f9d5-4790-b785-c4d750858c97 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:56.560047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-817567d7-f9d5-4790-b785-c4d750858c97 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:56.561207 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-817567d7-f9d5-4790-b785-c4d750858c97 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44" status: 200 len: 1366 microversion: 2.47 time: 0.351577 Mar 12 20:58:56.561795 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2018/2786] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:56 2022] GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:56.566076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b6d4f446-7c0e-472a-9974-6e34d83f2e51 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:56.566952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b6d4f446-7c0e-472a-9974-6e34d83f2e51 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:56.573145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b6d4f446-7c0e-472a-9974-6e34d83f2e51 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:56.573599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b6d4f446-7c0e-472a-9974-6e34d83f2e51 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:56.574393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b6d4f446-7c0e-472a-9974-6e34d83f2e51 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:56.574835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b6d4f446-7c0e-472a-9974-6e34d83f2e51 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:56.706885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b6d4f446-7c0e-472a-9974-6e34d83f2e51 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:56.714757 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b6d4f446-7c0e-472a-9974-6e34d83f2e51 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1473 microversion: 2.1 time: 0.152024 Mar 12 20:58:56.715319 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2019/2787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:56 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1473 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:56.719641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-63336157-71f7-49f2-8a0c-b7e5d3d9aaa4 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:56.720268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-63336157-71f7-49f2-8a0c-b7e5d3d9aaa4 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:56.725670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63336157-71f7-49f2-8a0c-b7e5d3d9aaa4 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:56.726157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63336157-71f7-49f2-8a0c-b7e5d3d9aaa4 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:56.726927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63336157-71f7-49f2-8a0c-b7e5d3d9aaa4 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:56.727369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63336157-71f7-49f2-8a0c-b7e5d3d9aaa4 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:56.857226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-63336157-71f7-49f2-8a0c-b7e5d3d9aaa4 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:56.864667 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-63336157-71f7-49f2-8a0c-b7e5d3d9aaa4 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.148415 Mar 12 20:58:56.865236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2020/2788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:56 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:56.870172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-87a955f8-b54d-41c5-afc7-728510f98f95 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:56.870773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-87a955f8-b54d-41c5-afc7-728510f98f95 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:56.876248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87a955f8-b54d-41c5-afc7-728510f98f95 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:56.876873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87a955f8-b54d-41c5-afc7-728510f98f95 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:56.877635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87a955f8-b54d-41c5-afc7-728510f98f95 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:56.878119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87a955f8-b54d-41c5-afc7-728510f98f95 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:57.010861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-87a955f8-b54d-41c5-afc7-728510f98f95 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:57.018155 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-87a955f8-b54d-41c5-afc7-728510f98f95 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1317 microversion: 2.1 time: 0.151948 Mar 12 20:58:57.018716 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2021/2789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:56 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:57.023095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b716612-c0ac-453c-92ab-8fe464e09e8a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:57.023701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b716612-c0ac-453c-92ab-8fe464e09e8a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:57.029160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b716612-c0ac-453c-92ab-8fe464e09e8a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:57.029619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b716612-c0ac-453c-92ab-8fe464e09e8a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:57.030424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b716612-c0ac-453c-92ab-8fe464e09e8a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:57.030870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b716612-c0ac-453c-92ab-8fe464e09e8a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:57.092609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b716612-c0ac-453c-92ab-8fe464e09e8a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:57.100502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b716612-c0ac-453c-92ab-8fe464e09e8a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:57.102084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b716612-c0ac-453c-92ab-8fe464e09e8a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:57.103255 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b716612-c0ac-453c-92ab-8fe464e09e8a tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.083625 Mar 12 20:58:57.103821 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2022/2790] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:57 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:57.580792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:57.581408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:57.587853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:57.588352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:57.589160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:57.589669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:57.620749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:57.621131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:57.621600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lazy-loading 'fault' on Instance uuid eb8d5e2a-cab6-413b-92cd-529d15b27b44 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:58:57.665266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:57.673283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:57.674867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f036a19cfa34967a4ceb4a3f4281659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b87c20286eb44c39c477861a5c01c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:57.676082 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-88d7b4dd-0fd1-4983-b455-9b9de3024a18 tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44" status: 200 len: 1371 microversion: 2.47 time: 0.099362 Mar 12 20:58:57.676651 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2023/2791] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:57 2022] GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 20:58:57.732181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f4dbadb-459a-47f7-b300-3c6acaf8362e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:57.732884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6f4dbadb-459a-47f7-b300-3c6acaf8362e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:57.738791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f4dbadb-459a-47f7-b300-3c6acaf8362e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:57.739257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f4dbadb-459a-47f7-b300-3c6acaf8362e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:57.740066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f4dbadb-459a-47f7-b300-3c6acaf8362e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:57.740511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f4dbadb-459a-47f7-b300-3c6acaf8362e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:57.883065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6f4dbadb-459a-47f7-b300-3c6acaf8362e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:57.890685 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f4dbadb-459a-47f7-b300-3c6acaf8362e tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1473 microversion: 2.1 time: 0.162308 Mar 12 20:58:57.893915 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2024/2792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:57 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1473 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:57.897670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6eb30cd1-670c-4694-a092-0aaf248d07f6 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:57.898831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6eb30cd1-670c-4694-a092-0aaf248d07f6 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:57.905111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6eb30cd1-670c-4694-a092-0aaf248d07f6 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:57.905575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6eb30cd1-670c-4694-a092-0aaf248d07f6 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:57.906397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6eb30cd1-670c-4694-a092-0aaf248d07f6 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:57.906836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6eb30cd1-670c-4694-a092-0aaf248d07f6 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:58.052428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6eb30cd1-670c-4694-a092-0aaf248d07f6 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:58.061183 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6eb30cd1-670c-4694-a092-0aaf248d07f6 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1522 microversion: 2.1 time: 0.168467 Mar 12 20:58:58.071365 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2025/2793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:57 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:58.071365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd9ab22e-d898-45f1-b06c-23236bafe706 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:58.071365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd9ab22e-d898-45f1-b06c-23236bafe706 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:58.074529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd9ab22e-d898-45f1-b06c-23236bafe706 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:58.075158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd9ab22e-d898-45f1-b06c-23236bafe706 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:58.076160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd9ab22e-d898-45f1-b06c-23236bafe706 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:58.076737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd9ab22e-d898-45f1-b06c-23236bafe706 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:58.242326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fd9ab22e-d898-45f1-b06c-23236bafe706 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:58.250178 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd9ab22e-d898-45f1-b06c-23236bafe706 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1317 microversion: 2.1 time: 0.187332 Mar 12 20:58:58.250773 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2026/2794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:58 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:58.255294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ef9805dd-90b8-491f-84f3-27f82af52bf4 req-40eed26a-3271-4c00-bfaa-e3f64fb19c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2525b05f-37e3-4a6c-8067-589b19f45e26", "name": "network-vif-plugged", "status": "completed", "tag": "6dca0f40-08da-44a6-9292-47a08459659a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:58.263674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ef9805dd-90b8-491f-84f3-27f82af52bf4 req-40eed26a-3271-4c00-bfaa-e3f64fb19c6a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:58.264122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ef9805dd-90b8-491f-84f3-27f82af52bf4 req-40eed26a-3271-4c00-bfaa-e3f64fb19c6a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:58.275545 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ef9805dd-90b8-491f-84f3-27f82af52bf4 req-40eed26a-3271-4c00-bfaa-e3f64fb19c6a service nova] Creating event network-vif-plugged:6dca0f40-08da-44a6-9292-47a08459659a for instance 2525b05f-37e3-4a6c-8067-589b19f45e26 on nch1-master-1 Mar 12 20:58:58.280347 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ef9805dd-90b8-491f-84f3-27f82af52bf4 req-40eed26a-3271-4c00-bfaa-e3f64fb19c6a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028488 Mar 12 20:58:58.280939 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2027/2795] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:58.287226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-861fac4d-a828-4c2c-9263-62ee1a3ff491 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:58.287952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-861fac4d-a828-4c2c-9263-62ee1a3ff491 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:58.294233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-861fac4d-a828-4c2c-9263-62ee1a3ff491 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:58.294684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-861fac4d-a828-4c2c-9263-62ee1a3ff491 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:58.295555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-861fac4d-a828-4c2c-9263-62ee1a3ff491 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:58.296002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-861fac4d-a828-4c2c-9263-62ee1a3ff491 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:58.371560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-861fac4d-a828-4c2c-9263-62ee1a3ff491 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:58.381897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-861fac4d-a828-4c2c-9263-62ee1a3ff491 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:58.384119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-861fac4d-a828-4c2c-9263-62ee1a3ff491 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:58.385326 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-861fac4d-a828-4c2c-9263-62ee1a3ff491 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.102413 Mar 12 20:58:58.386238 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2028/2796] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:58 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:58.696162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-210b7828-8ddb-4955-bbaa-297cd90fe21b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:58.697133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-210b7828-8ddb-4955-bbaa-297cd90fe21b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] [instance: eb8d5e2a-cab6-413b-92cd-529d15b27b44] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:58.710659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-210b7828-8ddb-4955-bbaa-297cd90fe21b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:58.711119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-210b7828-8ddb-4955-bbaa-297cd90fe21b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:58.711917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-210b7828-8ddb-4955-bbaa-297cd90fe21b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:58.712357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-210b7828-8ddb-4955-bbaa-297cd90fe21b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:58.728873 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-210b7828-8ddb-4955-bbaa-297cd90fe21b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] HTTP exception thrown: Instance eb8d5e2a-cab6-413b-92cd-529d15b27b44 could not be found. Mar 12 20:58:58.729652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-210b7828-8ddb-4955-bbaa-297cd90fe21b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] Returning 404 to user: Instance eb8d5e2a-cab6-413b-92cd-529d15b27b44 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:58:58.730534 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-210b7828-8ddb-4955-bbaa-297cd90fe21b tempest-ServersAaction247Test-306162466 tempest-ServersAaction247Test-306162466-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44" status: 404 len: 111 microversion: 2.47 time: 0.039521 Mar 12 20:58:58.732169 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2029/2797] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:58 2022] GET /compute/v2.1/servers/eb8d5e2a-cab6-413b-92cd-529d15b27b44 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 12 20:58:58.744189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c2fa3c8a-4727-4900-a902-123219e9dd19 req-40c84f83-988f-4470-b4fa-30c80aa3d46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131168b0-55a8-4369-814d-dcf1bb4883a3", "name": "network-vif-deleted", "tag": "98fbf3f4-d851-464e-8252-15fe9f7c83dd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:58.756135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c2fa3c8a-4727-4900-a902-123219e9dd19 req-40c84f83-988f-4470-b4fa-30c80aa3d46b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:58.756788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c2fa3c8a-4727-4900-a902-123219e9dd19 req-40c84f83-988f-4470-b4fa-30c80aa3d46b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:58.769243 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c2fa3c8a-4727-4900-a902-123219e9dd19 req-40c84f83-988f-4470-b4fa-30c80aa3d46b service nova] Creating event network-vif-deleted:98fbf3f4-d851-464e-8252-15fe9f7c83dd for instance 131168b0-55a8-4369-814d-dcf1bb4883a3 on nch1-master-1 Mar 12 20:58:58.775447 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c2fa3c8a-4727-4900-a902-123219e9dd19 req-40c84f83-988f-4470-b4fa-30c80aa3d46b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042055 Mar 12 20:58:58.776682 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2030/2798] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:58:58.908701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-63a954b1-b05e-446a-b918-72ffca488723 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:58.909496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-63a954b1-b05e-446a-b918-72ffca488723 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:58.921225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63a954b1-b05e-446a-b918-72ffca488723 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:58.923796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63a954b1-b05e-446a-b918-72ffca488723 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:58.924734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63a954b1-b05e-446a-b918-72ffca488723 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:58.925246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63a954b1-b05e-446a-b918-72ffca488723 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:58.983635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63a954b1-b05e-446a-b918-72ffca488723 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:58.984106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63a954b1-b05e-446a-b918-72ffca488723 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:58.986081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-63a954b1-b05e-446a-b918-72ffca488723 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lazy-loading 'fault' on Instance uuid 131168b0-55a8-4369-814d-dcf1bb4883a3 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:58:59.035387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-63a954b1-b05e-446a-b918-72ffca488723 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:59.042907 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-63a954b1-b05e-446a-b918-72ffca488723 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 200 len: 1307 microversion: 2.1 time: 0.138330 Mar 12 20:58:59.044224 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2031/2799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:58 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 1307 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:59.079298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f60f007c-39c6-4123-981c-328dd36d4094 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:59.080237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f60f007c-39c6-4123-981c-328dd36d4094 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:59.089223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f60f007c-39c6-4123-981c-328dd36d4094 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:59.090006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f60f007c-39c6-4123-981c-328dd36d4094 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:59.091505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f60f007c-39c6-4123-981c-328dd36d4094 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:59.092562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f60f007c-39c6-4123-981c-328dd36d4094 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:59.238495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f60f007c-39c6-4123-981c-328dd36d4094 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:59.246659 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f60f007c-39c6-4123-981c-328dd36d4094 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1499 microversion: 2.1 time: 0.171402 Mar 12 20:58:59.247315 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2032/2800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:59 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1499 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:58:59.262510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9e923c4-f8ad-4b14-a2ae-c280c4ac8fed tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:59.266086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9e923c4-f8ad-4b14-a2ae-c280c4ac8fed tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:59.266982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9e923c4-f8ad-4b14-a2ae-c280c4ac8fed tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:58:59.272225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9e923c4-f8ad-4b14-a2ae-c280c4ac8fed tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:59.272755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9e923c4-f8ad-4b14-a2ae-c280c4ac8fed tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:59.274196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9e923c4-f8ad-4b14-a2ae-c280c4ac8fed tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:59.274728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9e923c4-f8ad-4b14-a2ae-c280c4ac8fed tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:59.299565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-d9e923c4-f8ad-4b14-a2ae-c280c4ac8fed tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:58:59.329319 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9e923c4-f8ad-4b14-a2ae-c280c4ac8fed tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.070247 Mar 12 20:58:59.329930 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2033/2801] 10.222.0.30 () {58 vars in 1153 bytes} [Sat Mar 12 20:58:59 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:58:59.336027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6df12eca-ebad-4636-85e4-e2d7cfcc1153 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:59.336676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6df12eca-ebad-4636-85e4-e2d7cfcc1153 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:59.342601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6df12eca-ebad-4636-85e4-e2d7cfcc1153 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:59.343062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6df12eca-ebad-4636-85e4-e2d7cfcc1153 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:59.343877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6df12eca-ebad-4636-85e4-e2d7cfcc1153 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:59.344312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6df12eca-ebad-4636-85e4-e2d7cfcc1153 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:59.498658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6df12eca-ebad-4636-85e4-e2d7cfcc1153 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:59.506319 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6df12eca-ebad-4636-85e4-e2d7cfcc1153 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1317 microversion: 2.1 time: 0.175187 Mar 12 20:58:59.506907 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2034/2802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:59 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:58:59.512357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a5c3b97-c299-41d8-be1f-8509b0cee6a8 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:58:59.518629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a5c3b97-c299-41d8-be1f-8509b0cee6a8 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:59.519093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a5c3b97-c299-41d8-be1f-8509b0cee6a8 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:59.541852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a5c3b97-c299-41d8-be1f-8509b0cee6a8 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Going to try to start instance {{(pid=136302) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 12 20:58:59.588587 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a5c3b97-c299-41d8-be1f-8509b0cee6a8 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "POST /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2/action" status: 202 len: 0 microversion: 2.1 time: 0.079536 Mar 12 20:58:59.589202 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2035/2803] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:58:59 2022] POST /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:58:59.595386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a3fa4c6-d1c2-4587-a4a2-0ad74b299d04 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:59.596310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a3fa4c6-d1c2-4587-a4a2-0ad74b299d04 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:59.603767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a3fa4c6-d1c2-4587-a4a2-0ad74b299d04 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:59.603947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a3fa4c6-d1c2-4587-a4a2-0ad74b299d04 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:59.604733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a3fa4c6-d1c2-4587-a4a2-0ad74b299d04 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:59.605231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a3fa4c6-d1c2-4587-a4a2-0ad74b299d04 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:59.679960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8a3fa4c6-d1c2-4587-a4a2-0ad74b299d04 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:59.688140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8a3fa4c6-d1c2-4587-a4a2-0ad74b299d04 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:59.689638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8a3fa4c6-d1c2-4587-a4a2-0ad74b299d04 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:59.690846 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a3fa4c6-d1c2-4587-a4a2-0ad74b299d04 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.100544 Mar 12 20:58:59.693901 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2036/2804] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:58:59 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:58:59.701949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b004319e-783e-4cf1-bba7-c2fee2415849 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:58:59.703170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b004319e-783e-4cf1-bba7-c2fee2415849 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:58:59.709967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b004319e-783e-4cf1-bba7-c2fee2415849 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:59.711248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b004319e-783e-4cf1-bba7-c2fee2415849 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:59.712274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b004319e-783e-4cf1-bba7-c2fee2415849 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:58:59.712871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b004319e-783e-4cf1-bba7-c2fee2415849 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:58:59.855140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b004319e-783e-4cf1-bba7-c2fee2415849 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:58:59.864579 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b004319e-783e-4cf1-bba7-c2fee2415849 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1508 microversion: 2.1 time: 0.167814 Mar 12 20:58:59.865818 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2037/2805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:58:59 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:00.061544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-003a8333-7e37-4e8e-8196-24940d6df7e6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:00.061544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-003a8333-7e37-4e8e-8196-24940d6df7e6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 131168b0-55a8-4369-814d-dcf1bb4883a3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:00.071225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-003a8333-7e37-4e8e-8196-24940d6df7e6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:00.071968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-003a8333-7e37-4e8e-8196-24940d6df7e6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:00.072772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-003a8333-7e37-4e8e-8196-24940d6df7e6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:00.073213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-003a8333-7e37-4e8e-8196-24940d6df7e6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:00.088059 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-003a8333-7e37-4e8e-8196-24940d6df7e6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] HTTP exception thrown: Instance 131168b0-55a8-4369-814d-dcf1bb4883a3 could not be found. Mar 12 20:59:00.088710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-003a8333-7e37-4e8e-8196-24940d6df7e6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Returning 404 to user: Instance 131168b0-55a8-4369-814d-dcf1bb4883a3 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:00.089515 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-003a8333-7e37-4e8e-8196-24940d6df7e6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3" status: 404 len: 111 microversion: 2.1 time: 0.032705 Mar 12 20:59:00.090113 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2038/2806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:00 2022] GET /compute/v2.1/servers/131168b0-55a8-4369-814d-dcf1bb4883a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 20:59:00.098519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09bf73ed-6694-46e6-b9b0-83110b52e5d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:00.099026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-09bf73ed-6694-46e6-b9b0-83110b52e5d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:00.104928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09bf73ed-6694-46e6-b9b0-83110b52e5d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:00.105444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09bf73ed-6694-46e6-b9b0-83110b52e5d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:00.106225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09bf73ed-6694-46e6-b9b0-83110b52e5d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:00.106677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09bf73ed-6694-46e6-b9b0-83110b52e5d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:00.134383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-09bf73ed-6694-46e6-b9b0-83110b52e5d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:00.243045 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09bf73ed-6694-46e6-b9b0-83110b52e5d7 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731" status: 204 len: 0 microversion: 2.1 time: 0.147616 Mar 12 20:59:00.243822 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2039/2807] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:00 2022] DELETE /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 20:59:00.252771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb52a207-8429-445e-bd15-610237cbf6f6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:00.253487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb52a207-8429-445e-bd15-610237cbf6f6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:00.261864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb52a207-8429-445e-bd15-610237cbf6f6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:00.262322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb52a207-8429-445e-bd15-610237cbf6f6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:00.263396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb52a207-8429-445e-bd15-610237cbf6f6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:00.263843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb52a207-8429-445e-bd15-610237cbf6f6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:00.445677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bb52a207-8429-445e-bd15-610237cbf6f6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:00.453407 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb52a207-8429-445e-bd15-610237cbf6f6 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731" status: 200 len: 1471 microversion: 2.1 time: 0.205256 Mar 12 20:59:00.454853 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2040/2808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:00 2022] GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731 => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:00.523305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-40a88fe0-6b90-4705-a982-05d1010f3ece tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:00.523935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-40a88fe0-6b90-4705-a982-05d1010f3ece tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:00.529923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40a88fe0-6b90-4705-a982-05d1010f3ece tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:00.530514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40a88fe0-6b90-4705-a982-05d1010f3ece tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:00.531310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40a88fe0-6b90-4705-a982-05d1010f3ece tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:00.531753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40a88fe0-6b90-4705-a982-05d1010f3ece tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:00.774107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-40a88fe0-6b90-4705-a982-05d1010f3ece tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:00.784788 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-40a88fe0-6b90-4705-a982-05d1010f3ece tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1508 microversion: 2.1 time: 0.265573 Mar 12 20:59:00.786581 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2041/2809] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:00 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:59:00.797359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a84c4c4a-3193-49ad-8aeb-d0fb23d3fb2e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:00.797359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a84c4c4a-3193-49ad-8aeb-d0fb23d3fb2e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:00.799099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a84c4c4a-3193-49ad-8aeb-d0fb23d3fb2e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:00.799462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a84c4c4a-3193-49ad-8aeb-d0fb23d3fb2e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:00.800360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a84c4c4a-3193-49ad-8aeb-d0fb23d3fb2e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:00.800915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a84c4c4a-3193-49ad-8aeb-d0fb23d3fb2e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:00.870649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a84c4c4a-3193-49ad-8aeb-d0fb23d3fb2e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:00.880481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a84c4c4a-3193-49ad-8aeb-d0fb23d3fb2e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:00.882070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a84c4c4a-3193-49ad-8aeb-d0fb23d3fb2e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:00.883913 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a84c4c4a-3193-49ad-8aeb-d0fb23d3fb2e tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.096308 Mar 12 20:59:00.884498 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2042/2810] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:00 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:00.888902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-29733809-f7dd-43ea-9c38-b2a4894c3f69 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:00.889516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-29733809-f7dd-43ea-9c38-b2a4894c3f69 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:00.895367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29733809-f7dd-43ea-9c38-b2a4894c3f69 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:00.895822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29733809-f7dd-43ea-9c38-b2a4894c3f69 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:00.896597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29733809-f7dd-43ea-9c38-b2a4894c3f69 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:00.897043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29733809-f7dd-43ea-9c38-b2a4894c3f69 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.035804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-29733809-f7dd-43ea-9c38-b2a4894c3f69 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:01.044584 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-29733809-f7dd-43ea-9c38-b2a4894c3f69 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1508 microversion: 2.1 time: 0.158898 Mar 12 20:59:01.045752 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2043/2811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:00 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:01.051855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80186ac6-e7de-4b6e-acc9-3462ee013ec9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:01.052600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80186ac6-e7de-4b6e-acc9-3462ee013ec9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:01.059606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80186ac6-e7de-4b6e-acc9-3462ee013ec9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.060212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80186ac6-e7de-4b6e-acc9-3462ee013ec9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.061087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80186ac6-e7de-4b6e-acc9-3462ee013ec9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.061568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80186ac6-e7de-4b6e-acc9-3462ee013ec9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.204368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80186ac6-e7de-4b6e-acc9-3462ee013ec9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:01.212224 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80186ac6-e7de-4b6e-acc9-3462ee013ec9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1512 microversion: 2.1 time: 0.164906 Mar 12 20:59:01.213175 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2044/2812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:01 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:01.217758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c1fa592-8076-422f-bfa1-ca880a02ccbb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:01.219151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c1fa592-8076-422f-bfa1-ca880a02ccbb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:01.230243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c1fa592-8076-422f-bfa1-ca880a02ccbb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.230787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c1fa592-8076-422f-bfa1-ca880a02ccbb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.231661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c1fa592-8076-422f-bfa1-ca880a02ccbb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.232206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c1fa592-8076-422f-bfa1-ca880a02ccbb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.297028 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c1fa592-8076-422f-bfa1-ca880a02ccbb tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "PUT /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1080 microversion: 2.1 time: 0.082787 Mar 12 20:59:01.301954 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2045/2813] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Mar 12 20:59:01 2022] PUT /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1080 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:01.310660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-15d62b22-253e-4428-8d87-fc14def336f7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:01.314351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-15d62b22-253e-4428-8d87-fc14def336f7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:01.314797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.compute.servers [None req-15d62b22-253e-4428-8d87-fc14def336f7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Removing options 'limit' from query {{(pid=136302) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 12 20:59:01.315553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-15d62b22-253e-4428-8d87-fc14def336f7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:01.317136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15d62b22-253e-4428-8d87-fc14def336f7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.317607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15d62b22-253e-4428-8d87-fc14def336f7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.318439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15d62b22-253e-4428-8d87-fc14def336f7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.318877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15d62b22-253e-4428-8d87-fc14def336f7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.320279 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-15d62b22-253e-4428-8d87-fc14def336f7 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.015986 Mar 12 20:59:01.320825 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2046/2814] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Mar 12 20:59:01 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:59:01.326327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa06847e-0fbf-4842-a0ea-027823d77714 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:01.326327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aa06847e-0fbf-4842-a0ea-027823d77714 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:01.332435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa06847e-0fbf-4842-a0ea-027823d77714 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.332898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa06847e-0fbf-4842-a0ea-027823d77714 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.333669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa06847e-0fbf-4842-a0ea-027823d77714 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.334136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa06847e-0fbf-4842-a0ea-027823d77714 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.471095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aa06847e-0fbf-4842-a0ea-027823d77714 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:01.479131 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aa06847e-0fbf-4842-a0ea-027823d77714 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1506 microversion: 2.1 time: 0.157392 Mar 12 20:59:01.479699 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2047/2815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:01 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:01.490167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ff777fd-fe01-4750-9896-d35721e1b353 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:01.490167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ff777fd-fe01-4750-9896-d35721e1b353 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:01.491386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ff777fd-fe01-4750-9896-d35721e1b353 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.491880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ff777fd-fe01-4750-9896-d35721e1b353 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.492666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ff777fd-fe01-4750-9896-d35721e1b353 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.493106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ff777fd-fe01-4750-9896-d35721e1b353 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.628612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ff777fd-fe01-4750-9896-d35721e1b353 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:01.636670 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ff777fd-fe01-4750-9896-d35721e1b353 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1512 microversion: 2.1 time: 0.155941 Mar 12 20:59:01.637342 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2048/2816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:01 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:01.644364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d583fd92-6cc3-40f4-af54-b8d887216d4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:01.644985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d583fd92-6cc3-40f4-af54-b8d887216d4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:01.651572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d583fd92-6cc3-40f4-af54-b8d887216d4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.652028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d583fd92-6cc3-40f4-af54-b8d887216d4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.652840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d583fd92-6cc3-40f4-af54-b8d887216d4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.653288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d583fd92-6cc3-40f4-af54-b8d887216d4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.798704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d583fd92-6cc3-40f4-af54-b8d887216d4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:01.806490 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d583fd92-6cc3-40f4-af54-b8d887216d4d tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731" status: 200 len: 1471 microversion: 2.1 time: 0.166166 Mar 12 20:59:01.807007 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2049/2817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:01 2022] GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:01.811511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c2e3148d-2a98-4f9f-a411-ffe1b0c257d2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:01.812121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c2e3148d-2a98-4f9f-a411-ffe1b0c257d2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:01.818170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2e3148d-2a98-4f9f-a411-ffe1b0c257d2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.818632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2e3148d-2a98-4f9f-a411-ffe1b0c257d2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.819404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2e3148d-2a98-4f9f-a411-ffe1b0c257d2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:01.820394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2e3148d-2a98-4f9f-a411-ffe1b0c257d2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:01.986307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c2e3148d-2a98-4f9f-a411-ffe1b0c257d2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:01.994054 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c2e3148d-2a98-4f9f-a411-ffe1b0c257d2 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1506 microversion: 2.1 time: 0.186050 Mar 12 20:59:01.994738 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2050/2818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:01 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:01.999431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de03936b-6dfb-4972-8f29-3d21dc672db2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:02.000122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-de03936b-6dfb-4972-8f29-3d21dc672db2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 326ae42b-a952-4626-b027-90afe2eed7af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:02.006174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de03936b-6dfb-4972-8f29-3d21dc672db2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.006708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de03936b-6dfb-4972-8f29-3d21dc672db2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.008098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de03936b-6dfb-4972-8f29-3d21dc672db2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.008545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de03936b-6dfb-4972-8f29-3d21dc672db2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.142478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-de03936b-6dfb-4972-8f29-3d21dc672db2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:02.151596 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de03936b-6dfb-4972-8f29-3d21dc672db2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af" status: 200 len: 1511 microversion: 2.1 time: 0.155731 Mar 12 20:59:02.152305 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2051/2819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:01 2022] GET /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:02.158181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dec21831-12dd-4588-bc65-01825595d139 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:02.159634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dec21831-12dd-4588-bc65-01825595d139 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:02.165846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dec21831-12dd-4588-bc65-01825595d139 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.166312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dec21831-12dd-4588-bc65-01825595d139 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.167104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dec21831-12dd-4588-bc65-01825595d139 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.167550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dec21831-12dd-4588-bc65-01825595d139 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.261126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dec21831-12dd-4588-bc65-01825595d139 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:02.269508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dec21831-12dd-4588-bc65-01825595d139 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:02.271111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dec21831-12dd-4588-bc65-01825595d139 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:02.272301 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dec21831-12dd-4588-bc65-01825595d139 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.118955 Mar 12 20:59:02.273120 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2052/2820] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:02 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:02.277799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ac93903c-7a45-49cd-a0db-70f3aebcfde9 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:02.278951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ac93903c-7a45-49cd-a0db-70f3aebcfde9 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:02.284894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac93903c-7a45-49cd-a0db-70f3aebcfde9 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.285358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac93903c-7a45-49cd-a0db-70f3aebcfde9 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.286184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac93903c-7a45-49cd-a0db-70f3aebcfde9 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.286627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac93903c-7a45-49cd-a0db-70f3aebcfde9 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.316536 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ac93903c-7a45-49cd-a0db-70f3aebcfde9 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042066 Mar 12 20:59:02.317449 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2053/2821] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Mar 12 20:59:02 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:02.322790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d5d40cb4-1683-4147-bc4b-7e39c0db8296 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:02.323948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d5d40cb4-1683-4147-bc4b-7e39c0db8296 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:02.330079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5d40cb4-1683-4147-bc4b-7e39c0db8296 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.330427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5d40cb4-1683-4147-bc4b-7e39c0db8296 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.331221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5d40cb4-1683-4147-bc4b-7e39c0db8296 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.331673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5d40cb4-1683-4147-bc4b-7e39c0db8296 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.405631 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d5d40cb4-1683-4147-bc4b-7e39c0db8296 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "PUT /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1082 microversion: 2.1 time: 0.086998 Mar 12 20:59:02.406342 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2054/2822] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Mar 12 20:59:02 2022] PUT /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1082 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:02.419545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-22efe33f-828e-4f1a-9d2b-e628f54c62be tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:02.420186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-22efe33f-828e-4f1a-9d2b-e628f54c62be tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:02.426847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22efe33f-828e-4f1a-9d2b-e628f54c62be tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.427897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22efe33f-828e-4f1a-9d2b-e628f54c62be tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.428147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22efe33f-828e-4f1a-9d2b-e628f54c62be tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.429824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22efe33f-828e-4f1a-9d2b-e628f54c62be tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.662844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-22efe33f-828e-4f1a-9d2b-e628f54c62be tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:02.672030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-22efe33f-828e-4f1a-9d2b-e628f54c62be tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1512 microversion: 2.1 time: 0.264620 Mar 12 20:59:02.678841 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2055/2823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:02 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:02.685201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0305884b-06c0-4159-bea9-9200a0136758 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:02.686015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0305884b-06c0-4159-bea9-9200a0136758 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:02.692797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0305884b-06c0-4159-bea9-9200a0136758 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.693168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0305884b-06c0-4159-bea9-9200a0136758 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.693988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0305884b-06c0-4159-bea9-9200a0136758 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.694586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0305884b-06c0-4159-bea9-9200a0136758 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.724148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0305884b-06c0-4159-bea9-9200a0136758 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:02.872904 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0305884b-06c0-4159-bea9-9200a0136758 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 204 len: 0 microversion: 2.20 time: 0.198980 Mar 12 20:59:02.874147 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2056/2824] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:59:02 2022] DELETE /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:59:02.883965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5508f18f-d424-450d-89ad-59e8790841c5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:02.885021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5508f18f-d424-450d-89ad-59e8790841c5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:02.895305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5508f18f-d424-450d-89ad-59e8790841c5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.896552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5508f18f-d424-450d-89ad-59e8790841c5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:02.897498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5508f18f-d424-450d-89ad-59e8790841c5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:02.898665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5508f18f-d424-450d-89ad-59e8790841c5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:03.096894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5508f18f-d424-450d-89ad-59e8790841c5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:03.117281 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5508f18f-d424-450d-89ad-59e8790841c5 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1508 microversion: 2.1 time: 0.231308 Mar 12 20:59:03.125636 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2057/2825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:02 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:03.134212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9ff126c-d74e-4bdb-b5e9-f676fd7120c0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:03.138563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f9ff126c-d74e-4bdb-b5e9-f676fd7120c0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:03.139610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9ff126c-d74e-4bdb-b5e9-f676fd7120c0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'ip': '172.20.0.8', 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:03.332508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9ff126c-d74e-4bdb-b5e9-f676fd7120c0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:03.333150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9ff126c-d74e-4bdb-b5e9-f676fd7120c0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:03.334056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9ff126c-d74e-4bdb-b5e9-f676fd7120c0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:03.334507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9ff126c-d74e-4bdb-b5e9-f676fd7120c0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:03.433763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-f9ff126c-d74e-4bdb-b5e9-f676fd7120c0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:59:03.497508 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9ff126c-d74e-4bdb-b5e9-f676fd7120c0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0.8" status: 200 len: 346 microversion: 2.1 time: 0.369001 Mar 12 20:59:03.498204 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2058/2826] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:59:03 2022] GET /compute/v2.1/servers?ip=172.20.0.8 => generated 346 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:03.506392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-be3f1440-9ea6-422c-93e5-392e265bfdf7 req-519c64d7-4c1f-4a5f-a439-f3f467724d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8267a50-c543-4753-9f09-3600de6b1731", "name": "network-vif-deleted", "tag": "913fb114-5a7c-40d7-9e0c-65f8a9939a1a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:03.515539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-be3f1440-9ea6-422c-93e5-392e265bfdf7 req-519c64d7-4c1f-4a5f-a439-f3f467724d0d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:03.515995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-be3f1440-9ea6-422c-93e5-392e265bfdf7 req-519c64d7-4c1f-4a5f-a439-f3f467724d0d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:03.527502 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-be3f1440-9ea6-422c-93e5-392e265bfdf7 req-519c64d7-4c1f-4a5f-a439-f3f467724d0d service nova] Creating event network-vif-deleted:913fb114-5a7c-40d7-9e0c-65f8a9939a1a for instance b8267a50-c543-4753-9f09-3600de6b1731 on nch1-master-1 Mar 12 20:59:03.532503 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-be3f1440-9ea6-422c-93e5-392e265bfdf7 req-519c64d7-4c1f-4a5f-a439-f3f467724d0d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033163 Mar 12 20:59:03.533406 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2059/2827] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:03.538566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a41390c-f4e5-45df-9638-e2421d0cb54f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:03.539275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a41390c-f4e5-45df-9638-e2421d0cb54f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: b8267a50-c543-4753-9f09-3600de6b1731] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:03.545417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a41390c-f4e5-45df-9638-e2421d0cb54f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:03.545918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a41390c-f4e5-45df-9638-e2421d0cb54f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:03.546704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a41390c-f4e5-45df-9638-e2421d0cb54f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:03.547155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a41390c-f4e5-45df-9638-e2421d0cb54f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:03.562403 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8a41390c-f4e5-45df-9638-e2421d0cb54f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] HTTP exception thrown: Instance b8267a50-c543-4753-9f09-3600de6b1731 could not be found. Mar 12 20:59:03.563165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a41390c-f4e5-45df-9638-e2421d0cb54f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Returning 404 to user: Instance b8267a50-c543-4753-9f09-3600de6b1731 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:03.564038 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a41390c-f4e5-45df-9638-e2421d0cb54f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731" status: 404 len: 111 microversion: 2.1 time: 0.029502 Mar 12 20:59:03.565926 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2060/2828] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:03 2022] GET /compute/v2.1/servers/b8267a50-c543-4753-9f09-3600de6b1731 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:03.572949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a341e711-95b8-4636-a2a3-05201f302a47 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:03.573523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a341e711-95b8-4636-a2a3-05201f302a47 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:03.579555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a341e711-95b8-4636-a2a3-05201f302a47 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:03.580006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a341e711-95b8-4636-a2a3-05201f302a47 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:03.581044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a341e711-95b8-4636-a2a3-05201f302a47 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:03.581645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a341e711-95b8-4636-a2a3-05201f302a47 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:03.842062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a341e711-95b8-4636-a2a3-05201f302a47 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:03.850953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a341e711-95b8-4636-a2a3-05201f302a47 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:03.852829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a341e711-95b8-4636-a2a3-05201f302a47 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:03.854434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a341e711-95b8-4636-a2a3-05201f302a47 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1722 microversion: 2.20 time: 0.287081 Mar 12 20:59:03.866140 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2061/2829] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:03 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:03.871635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e07e4c5b-3f17-487f-9162-e1509c93db70 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:03.872267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e07e4c5b-3f17-487f-9162-e1509c93db70 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:03.878692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e07e4c5b-3f17-487f-9162-e1509c93db70 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:03.879161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e07e4c5b-3f17-487f-9162-e1509c93db70 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:03.879955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e07e4c5b-3f17-487f-9162-e1509c93db70 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:03.880487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e07e4c5b-3f17-487f-9162-e1509c93db70 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:04.120280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e07e4c5b-3f17-487f-9162-e1509c93db70 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:04.129695 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e07e4c5b-3f17-487f-9162-e1509c93db70 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1508 microversion: 2.1 time: 0.262112 Mar 12 20:59:04.130606 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2062/2830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:03 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:04.135727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eca2db26-e76d-42a8-8a43-1e83b57a084d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:04.136353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eca2db26-e76d-42a8-8a43-1e83b57a084d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:04.143934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eca2db26-e76d-42a8-8a43-1e83b57a084d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:04.144394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eca2db26-e76d-42a8-8a43-1e83b57a084d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:04.145183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eca2db26-e76d-42a8-8a43-1e83b57a084d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:04.145633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eca2db26-e76d-42a8-8a43-1e83b57a084d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:04.486605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eca2db26-e76d-42a8-8a43-1e83b57a084d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:04.496924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eca2db26-e76d-42a8-8a43-1e83b57a084d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:04.499686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eca2db26-e76d-42a8-8a43-1e83b57a084d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:04.500920 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eca2db26-e76d-42a8-8a43-1e83b57a084d tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.369538 Mar 12 20:59:04.509360 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2063/2831] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:04 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:04.509360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dbbb4bd7-2534-47ba-8d71-83c8256dabc0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:04.509360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dbbb4bd7-2534-47ba-8d71-83c8256dabc0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:04.516794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbbb4bd7-2534-47ba-8d71-83c8256dabc0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:04.517251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbbb4bd7-2534-47ba-8d71-83c8256dabc0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:04.518052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbbb4bd7-2534-47ba-8d71-83c8256dabc0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:04.518495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbbb4bd7-2534-47ba-8d71-83c8256dabc0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:04.776907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dbbb4bd7-2534-47ba-8d71-83c8256dabc0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:04.798453 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dbbb4bd7-2534-47ba-8d71-83c8256dabc0 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1512 microversion: 2.1 time: 0.295850 Mar 12 20:59:04.799068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2064/2832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:04 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1512 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:04.805504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d8201170-c35f-4856-945f-7f22101e5237 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:04.806037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d8201170-c35f-4856-945f-7f22101e5237 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 49ed298c-3e5a-4f2c-930f-7d7feb65126c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:04.818156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8201170-c35f-4856-945f-7f22101e5237 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:04.818758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8201170-c35f-4856-945f-7f22101e5237 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:04.820497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8201170-c35f-4856-945f-7f22101e5237 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:04.821020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8201170-c35f-4856-945f-7f22101e5237 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:04.849547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d8201170-c35f-4856-945f-7f22101e5237 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 49ed298c-3e5a-4f2c-930f-7d7feb65126c] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:04.946037 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d8201170-c35f-4856-945f-7f22101e5237 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "DELETE /compute/v2.1/servers/49ed298c-3e5a-4f2c-930f-7d7feb65126c" status: 204 len: 0 microversion: 2.1 time: 0.144446 Mar 12 20:59:04.947061 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2065/2833] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:04 2022] DELETE /compute/v2.1/servers/49ed298c-3e5a-4f2c-930f-7d7feb65126c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:59:04.955999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5edbae0e-d944-458b-90a8-15b206072412 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:04.957388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5edbae0e-d944-458b-90a8-15b206072412 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:04.966603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5edbae0e-d944-458b-90a8-15b206072412 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:04.967069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5edbae0e-d944-458b-90a8-15b206072412 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:04.967891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5edbae0e-d944-458b-90a8-15b206072412 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:04.968336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5edbae0e-d944-458b-90a8-15b206072412 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:05.004837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5edbae0e-d944-458b-90a8-15b206072412 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:05.096024 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5edbae0e-d944-458b-90a8-15b206072412 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 204 len: 0 microversion: 2.1 time: 0.147137 Mar 12 20:59:05.097089 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2066/2834] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:04 2022] DELETE /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:59:05.104447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce40829c-700c-494b-99aa-239142fc75dd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:05.105744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce40829c-700c-494b-99aa-239142fc75dd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 326ae42b-a952-4626-b027-90afe2eed7af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:05.115222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce40829c-700c-494b-99aa-239142fc75dd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:05.115685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce40829c-700c-494b-99aa-239142fc75dd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:05.116995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce40829c-700c-494b-99aa-239142fc75dd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:05.117465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce40829c-700c-494b-99aa-239142fc75dd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:05.530074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce40829c-700c-494b-99aa-239142fc75dd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:05.538202 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce40829c-700c-494b-99aa-239142fc75dd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af" status: 200 len: 1511 microversion: 2.1 time: 0.439405 Mar 12 20:59:05.549503 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2067/2835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:05 2022] GET /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af => generated 1511 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:05.555058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-caecd8f2-eafa-43af-99cf-3cd261975d3a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:05.555671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-caecd8f2-eafa-43af-99cf-3cd261975d3a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:05.561707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caecd8f2-eafa-43af-99cf-3cd261975d3a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:05.562207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caecd8f2-eafa-43af-99cf-3cd261975d3a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:05.563193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caecd8f2-eafa-43af-99cf-3cd261975d3a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:05.563637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caecd8f2-eafa-43af-99cf-3cd261975d3a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:05.942962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-caecd8f2-eafa-43af-99cf-3cd261975d3a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:05.954100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-caecd8f2-eafa-43af-99cf-3cd261975d3a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:05.955623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-caecd8f2-eafa-43af-99cf-3cd261975d3a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372b69c92d4456879f7fa00239f0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5497c8a2449c89a200ddd03ce5aeb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:05.957104 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-caecd8f2-eafa-43af-99cf-3cd261975d3a tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 200 len: 1722 microversion: 2.20 time: 0.406240 Mar 12 20:59:05.968034 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2068/2836] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:05 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 1722 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:05.978425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e34b0263-6f98-42a8-bf4e-2b4953a4966f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:05.978942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e34b0263-6f98-42a8-bf4e-2b4953a4966f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:05.985633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e34b0263-6f98-42a8-bf4e-2b4953a4966f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:05.986174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e34b0263-6f98-42a8-bf4e-2b4953a4966f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:05.986958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e34b0263-6f98-42a8-bf4e-2b4953a4966f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:05.987399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e34b0263-6f98-42a8-bf4e-2b4953a4966f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:06.021242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e34b0263-6f98-42a8-bf4e-2b4953a4966f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:06.120287 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e34b0263-6f98-42a8-bf4e-2b4953a4966f tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "DELETE /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864" status: 204 len: 0 microversion: 2.1 time: 0.150807 Mar 12 20:59:06.121303 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2069/2837] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:05 2022] DELETE /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:59:06.126695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea79a938-856d-4abb-96cf-45869c7ed733 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:06.127289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea79a938-856d-4abb-96cf-45869c7ed733 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:06.133865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea79a938-856d-4abb-96cf-45869c7ed733 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:06.134327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea79a938-856d-4abb-96cf-45869c7ed733 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:06.135105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea79a938-856d-4abb-96cf-45869c7ed733 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:06.135548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea79a938-856d-4abb-96cf-45869c7ed733 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:06.160252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea79a938-856d-4abb-96cf-45869c7ed733 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:06.209969 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.api [None req-ea79a938-856d-4abb-96cf-45869c7ed733 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Instance is already in deleting state, ignoring this request Mar 12 20:59:06.210949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea79a938-856d-4abb-96cf-45869c7ed733 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 204 len: 0 microversion: 2.1 time: 0.088510 Mar 12 20:59:06.211600 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2070/2838] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:06 2022] DELETE /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:59:06.216204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f05990b-beeb-4ac3-a9b5-c6e9cc8238d1 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:06.216892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f05990b-beeb-4ac3-a9b5-c6e9cc8238d1 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:06.222622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f05990b-beeb-4ac3-a9b5-c6e9cc8238d1 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:06.223154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f05990b-beeb-4ac3-a9b5-c6e9cc8238d1 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:06.223989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f05990b-beeb-4ac3-a9b5-c6e9cc8238d1 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:06.224514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f05990b-beeb-4ac3-a9b5-c6e9cc8238d1 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:06.295514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f05990b-beeb-4ac3-a9b5-c6e9cc8238d1 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:06.317585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f05990b-beeb-4ac3-a9b5-c6e9cc8238d1 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:06.319144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f05990b-beeb-4ac3-a9b5-c6e9cc8238d1 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:06.320387 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f05990b-beeb-4ac3-a9b5-c6e9cc8238d1 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.107786 Mar 12 20:59:06.331292 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2071/2839] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:06 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:06.334142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e312e48b-fe79-4408-a576-6a0e2d9fbb15 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:06.334596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e312e48b-fe79-4408-a576-6a0e2d9fbb15 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:06.341213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e312e48b-fe79-4408-a576-6a0e2d9fbb15 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:06.341865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e312e48b-fe79-4408-a576-6a0e2d9fbb15 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:06.342941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e312e48b-fe79-4408-a576-6a0e2d9fbb15 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:06.343574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e312e48b-fe79-4408-a576-6a0e2d9fbb15 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:06.674047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e312e48b-fe79-4408-a576-6a0e2d9fbb15 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:06.691577 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e312e48b-fe79-4408-a576-6a0e2d9fbb15 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1512 microversion: 2.1 time: 0.368860 Mar 12 20:59:06.706318 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2072/2840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:06 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:06.720310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c9944a78-c4b1-4406-b404-dd30e7dc9c60 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:06.720936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c9944a78-c4b1-4406-b404-dd30e7dc9c60 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 49ed298c-3e5a-4f2c-930f-7d7feb65126c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:06.743944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9944a78-c4b1-4406-b404-dd30e7dc9c60 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:06.744400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9944a78-c4b1-4406-b404-dd30e7dc9c60 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:06.749177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9944a78-c4b1-4406-b404-dd30e7dc9c60 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:06.750383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9944a78-c4b1-4406-b404-dd30e7dc9c60 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:07.078398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c9944a78-c4b1-4406-b404-dd30e7dc9c60 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:07.093403 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c9944a78-c4b1-4406-b404-dd30e7dc9c60 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/49ed298c-3e5a-4f2c-930f-7d7feb65126c" status: 200 len: 1475 microversion: 2.1 time: 0.380432 Mar 12 20:59:07.095455 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2073/2841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:06 2022] GET /compute/v2.1/servers/49ed298c-3e5a-4f2c-930f-7d7feb65126c => generated 1475 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:07.107647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d3c84c7-0562-40d3-a112-4cfb26214891 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:07.111663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5d3c84c7-0562-40d3-a112-4cfb26214891 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:07.126499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d3c84c7-0562-40d3-a112-4cfb26214891 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:07.126960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d3c84c7-0562-40d3-a112-4cfb26214891 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:07.130617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d3c84c7-0562-40d3-a112-4cfb26214891 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:07.131306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d3c84c7-0562-40d3-a112-4cfb26214891 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:07.454959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5d3c84c7-0562-40d3-a112-4cfb26214891 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c8688bddda473ebeeef9a20b13be66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6629e3cb02ae4e54a2bd5971423b88a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:07.475029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5d3c84c7-0562-40d3-a112-4cfb26214891 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 200 len: 1514 microversion: 2.1 time: 0.377870 Mar 12 20:59:07.476740 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2074/2842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:07 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 1514 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:07.842989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-443357405", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:07.957646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] validate_networks() for [('76841087-8bda-4836-86df-2560f83fb5d6', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:59:08.626669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:59:08.627347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:59:08.628025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:59:08.628686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:59:08.629310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:59:08.642251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:08.643003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:08.645061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:08.645526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:08.679382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Getting quotas for project 3570c0185b7b4af9954a67a763797f37. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:59:08.688958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Getting quotas for user 21f6deda19914710bccc01abf47935f5 and project 3570c0185b7b4af9954a67a763797f37. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:59:08.704933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:59:08.707443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:59:08.756555 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4c7a4c28-7396-4c5f-baf3-56fb259dd807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.279052 Mar 12 20:59:08.758167 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2075/2843] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:59:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:59:08.763313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-866628b7-81bb-429c-acfe-5c246cc1a585 req-1acc7d2e-4e45-4284-86c9-f433124895bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f27f34eb-a809-408c-9262-cec7223eee56", "name": "network-vif-deleted", "tag": "74c66795-a7e0-451e-bc40-b9db6d6b19d0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:08.773522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-866628b7-81bb-429c-acfe-5c246cc1a585 req-1acc7d2e-4e45-4284-86c9-f433124895bb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:08.774271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-866628b7-81bb-429c-acfe-5c246cc1a585 req-1acc7d2e-4e45-4284-86c9-f433124895bb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:08.787539 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-866628b7-81bb-429c-acfe-5c246cc1a585 req-1acc7d2e-4e45-4284-86c9-f433124895bb service nova] Creating event network-vif-deleted:74c66795-a7e0-451e-bc40-b9db6d6b19d0 for instance f27f34eb-a809-408c-9262-cec7223eee56 on nch1-master-1 Mar 12 20:59:08.794285 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-866628b7-81bb-429c-acfe-5c246cc1a585 req-1acc7d2e-4e45-4284-86c9-f433124895bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034233 Mar 12 20:59:08.795574 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2076/2844] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:08.807389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af9895f4-840e-4e6a-8d30-12199917205e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:08.812163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-af9895f4-840e-4e6a-8d30-12199917205e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:08.813037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af9895f4-840e-4e6a-8d30-12199917205e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:08.819123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af9895f4-840e-4e6a-8d30-12199917205e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:08.820385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af9895f4-840e-4e6a-8d30-12199917205e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:08.821549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af9895f4-840e-4e6a-8d30-12199917205e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:08.822186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af9895f4-840e-4e6a-8d30-12199917205e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:08.867089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-af9895f4-840e-4e6a-8d30-12199917205e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:59:08.927659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-af9895f4-840e-4e6a-8d30-12199917205e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:08.939689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af9895f4-840e-4e6a-8d30-12199917205e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:08.940157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af9895f4-840e-4e6a-8d30-12199917205e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.149449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af9895f4-840e-4e6a-8d30-12199917205e tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.352477 Mar 12 20:59:09.161851 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2077/2845] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:59:08 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:09.161851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21664c3c-a590-4e5b-9abc-ec73d752ad74 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:09.161851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-21664c3c-a590-4e5b-9abc-ec73d752ad74 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:09.163454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21664c3c-a590-4e5b-9abc-ec73d752ad74 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.163941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21664c3c-a590-4e5b-9abc-ec73d752ad74 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.164830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21664c3c-a590-4e5b-9abc-ec73d752ad74 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.165314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21664c3c-a590-4e5b-9abc-ec73d752ad74 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.187685 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-21664c3c-a590-4e5b-9abc-ec73d752ad74 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] HTTP exception thrown: Instance f27f34eb-a809-408c-9262-cec7223eee56 could not be found. Mar 12 20:59:09.188281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21664c3c-a590-4e5b-9abc-ec73d752ad74 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Returning 404 to user: Instance f27f34eb-a809-408c-9262-cec7223eee56 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:09.189211 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21664c3c-a590-4e5b-9abc-ec73d752ad74 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 404 len: 111 microversion: 2.20 time: 0.037458 Mar 12 20:59:09.196480 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2078/2846] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:09 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:59:09.202075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-66f41ca7-2e38-40cc-8039-e65cc138b864 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:09.202356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-66f41ca7-2e38-40cc-8039-e65cc138b864 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:09.208853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f41ca7-2e38-40cc-8039-e65cc138b864 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.209328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f41ca7-2e38-40cc-8039-e65cc138b864 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.210212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f41ca7-2e38-40cc-8039-e65cc138b864 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.210653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f41ca7-2e38-40cc-8039-e65cc138b864 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.294998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-66f41ca7-2e38-40cc-8039-e65cc138b864 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:09.305247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-66f41ca7-2e38-40cc-8039-e65cc138b864 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:09.308802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-66f41ca7-2e38-40cc-8039-e65cc138b864 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:09.310569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-66f41ca7-2e38-40cc-8039-e65cc138b864 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.113012 Mar 12 20:59:09.322290 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2079/2847] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:09 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:09.328240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-34e25a98-0dc2-4334-8614-982a729c4260 req-4b78762f-67b3-47f5-8f72-a0ab2041b553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2525b05f-37e3-4a6c-8067-589b19f45e26", "name": "network-vif-deleted", "tag": "6dca0f40-08da-44a6-9292-47a08459659a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:09.336915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-34e25a98-0dc2-4334-8614-982a729c4260 req-4b78762f-67b3-47f5-8f72-a0ab2041b553 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.337689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-34e25a98-0dc2-4334-8614-982a729c4260 req-4b78762f-67b3-47f5-8f72-a0ab2041b553 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.350536 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-34e25a98-0dc2-4334-8614-982a729c4260 req-4b78762f-67b3-47f5-8f72-a0ab2041b553 service nova] Creating event network-vif-deleted:6dca0f40-08da-44a6-9292-47a08459659a for instance 2525b05f-37e3-4a6c-8067-589b19f45e26 on nch1-master-1 Mar 12 20:59:09.358758 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-34e25a98-0dc2-4334-8614-982a729c4260 req-4b78762f-67b3-47f5-8f72-a0ab2041b553 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034137 Mar 12 20:59:09.359935 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2080/2848] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:09.368107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8285640d-4e1a-4474-be9d-8e308f48dfad tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:09.369336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8285640d-4e1a-4474-be9d-8e308f48dfad tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 49ed298c-3e5a-4f2c-930f-7d7feb65126c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:09.377626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8285640d-4e1a-4474-be9d-8e308f48dfad tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.378171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8285640d-4e1a-4474-be9d-8e308f48dfad tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.378978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8285640d-4e1a-4474-be9d-8e308f48dfad tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.379429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8285640d-4e1a-4474-be9d-8e308f48dfad tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.400745 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8285640d-4e1a-4474-be9d-8e308f48dfad tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] HTTP exception thrown: Instance 49ed298c-3e5a-4f2c-930f-7d7feb65126c could not be found. Mar 12 20:59:09.401667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8285640d-4e1a-4474-be9d-8e308f48dfad tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Returning 404 to user: Instance 49ed298c-3e5a-4f2c-930f-7d7feb65126c could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:09.402587 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8285640d-4e1a-4474-be9d-8e308f48dfad tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/49ed298c-3e5a-4f2c-930f-7d7feb65126c" status: 404 len: 111 microversion: 2.1 time: 0.041279 Mar 12 20:59:09.403170 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2081/2849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:09 2022] GET /compute/v2.1/servers/49ed298c-3e5a-4f2c-930f-7d7feb65126c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:09.408769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d65475c-c0e5-4c8f-ae21-779709bbff59 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:09.409405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5d65475c-c0e5-4c8f-ae21-779709bbff59 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 2525b05f-37e3-4a6c-8067-589b19f45e26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:09.417575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d65475c-c0e5-4c8f-ae21-779709bbff59 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.418087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d65475c-c0e5-4c8f-ae21-779709bbff59 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.419076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d65475c-c0e5-4c8f-ae21-779709bbff59 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.419694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d65475c-c0e5-4c8f-ae21-779709bbff59 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.452668 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-5d65475c-c0e5-4c8f-ae21-779709bbff59 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] HTTP exception thrown: Instance 2525b05f-37e3-4a6c-8067-589b19f45e26 could not be found. Mar 12 20:59:09.453297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d65475c-c0e5-4c8f-ae21-779709bbff59 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Returning 404 to user: Instance 2525b05f-37e3-4a6c-8067-589b19f45e26 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:09.454218 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5d65475c-c0e5-4c8f-ae21-779709bbff59 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26" status: 404 len: 111 microversion: 2.1 time: 0.049599 Mar 12 20:59:09.458715 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2082/2850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:09 2022] GET /compute/v2.1/servers/2525b05f-37e3-4a6c-8067-589b19f45e26 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:09.469831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2d16caf-db01-480d-807f-a15b6bcc701b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:09.472963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2d16caf-db01-480d-807f-a15b6bcc701b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:09.485593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2d16caf-db01-480d-807f-a15b6bcc701b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.486199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2d16caf-db01-480d-807f-a15b6bcc701b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.487181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2d16caf-db01-480d-807f-a15b6bcc701b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.487791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2d16caf-db01-480d-807f-a15b6bcc701b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.560299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e2d16caf-db01-480d-807f-a15b6bcc701b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:09.568158 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2d16caf-db01-480d-807f-a15b6bcc701b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1225 microversion: 2.1 time: 0.108073 Mar 12 20:59:09.569550 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2083/2851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:09 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:09.577824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0bddd89c-dcb6-47a7-8aa8-fb983d53acbe tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:09.589965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0bddd89c-dcb6-47a7-8aa8-fb983d53acbe tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:09.591050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0bddd89c-dcb6-47a7-8aa8-fb983d53acbe tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:09.669349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bddd89c-dcb6-47a7-8aa8-fb983d53acbe tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.670253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bddd89c-dcb6-47a7-8aa8-fb983d53acbe tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.671193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bddd89c-dcb6-47a7-8aa8-fb983d53acbe tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.671730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bddd89c-dcb6-47a7-8aa8-fb983d53acbe tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.703854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-0bddd89c-dcb6-47a7-8aa8-fb983d53acbe tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:59:09.738373 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0bddd89c-dcb6-47a7-8aa8-fb983d53acbe tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.167479 Mar 12 20:59:09.738982 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2084/2852] 10.222.0.30 () {58 vars in 1149 bytes} [Sat Mar 12 20:59:09 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:09.743821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c0cb3563-57fa-4654-bbc4-6b7bf5206f18 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '.version_select at 0x7f6e48e10ca0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:09.762541 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c0cb3563-57fa-4654-bbc4-6b7bf5206f18 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530783224" status: 204 len: 0 microversion: 2.20 time: 0.022506 Mar 12 20:59:09.763143 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2085/2853] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Mar 12 20:59:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530783224 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:59:09.770747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bfc8f143-6d09-42e1-86c8-6c02594b6efe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:09.771593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bfc8f143-6d09-42e1-86c8-6c02594b6efe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 44289ad3-751a-4eee-ba1a-9637a3696864] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:09.779173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfc8f143-6d09-42e1-86c8-6c02594b6efe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.779634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfc8f143-6d09-42e1-86c8-6c02594b6efe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.780623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfc8f143-6d09-42e1-86c8-6c02594b6efe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.781089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfc8f143-6d09-42e1-86c8-6c02594b6efe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.796608 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bfc8f143-6d09-42e1-86c8-6c02594b6efe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] HTTP exception thrown: Instance 44289ad3-751a-4eee-ba1a-9637a3696864 could not be found. Mar 12 20:59:09.797238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bfc8f143-6d09-42e1-86c8-6c02594b6efe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Returning 404 to user: Instance 44289ad3-751a-4eee-ba1a-9637a3696864 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:09.798140 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bfc8f143-6d09-42e1-86c8-6c02594b6efe tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864" status: 404 len: 111 microversion: 2.1 time: 0.031284 Mar 12 20:59:09.798722 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2086/2854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:09 2022] GET /compute/v2.1/servers/44289ad3-751a-4eee-ba1a-9637a3696864 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:09.803767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e017b7b2-7208-4458-adbf-2e9ace38cdb4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:09.804583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e017b7b2-7208-4458-adbf-2e9ace38cdb4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:09.811558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e017b7b2-7208-4458-adbf-2e9ace38cdb4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.812096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e017b7b2-7208-4458-adbf-2e9ace38cdb4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.813066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e017b7b2-7208-4458-adbf-2e9ace38cdb4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:09.813672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e017b7b2-7208-4458-adbf-2e9ace38cdb4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:09.829215 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e017b7b2-7208-4458-adbf-2e9ace38cdb4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] HTTP exception thrown: Instance 3de07409-369a-4686-9c06-7627d6f500fd could not be found. Mar 12 20:59:09.829857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e017b7b2-7208-4458-adbf-2e9ace38cdb4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Returning 404 to user: Instance 3de07409-369a-4686-9c06-7627d6f500fd could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:09.830715 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e017b7b2-7208-4458-adbf-2e9ace38cdb4 tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 404 len: 111 microversion: 2.1 time: 0.031012 Mar 12 20:59:09.831294 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2087/2855] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:09 2022] DELETE /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:09.840223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-340884699", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:09.893972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] validate_networks() for [('76841087-8bda-4836-86df-2560f83fb5d6', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:59:10.415613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:59:10.417112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:59:10.417828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:59:10.419543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:59:10.420153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:59:10.432803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:10.433261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:10.434125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:10.434581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:10.458076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Getting quotas for project 3570c0185b7b4af9954a67a763797f37. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:59:10.468231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Getting quotas for user 21f6deda19914710bccc01abf47935f5 and project 3570c0185b7b4af9954a67a763797f37. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:59:10.487310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:59:10.490043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:59:10.587961 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1c527696-6027-4fa9-b451-c0b2ee211350 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.752377 Mar 12 20:59:10.588848 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2088/2856] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:59:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:59:10.594234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f454356-8d60-4c69-93fb-78064d5a5248 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:10.598603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8f454356-8d60-4c69-93fb-78064d5a5248 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:10.599519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f454356-8d60-4c69-93fb-78064d5a5248 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:10.606010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f454356-8d60-4c69-93fb-78064d5a5248 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:10.606657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f454356-8d60-4c69-93fb-78064d5a5248 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:10.607611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f454356-8d60-4c69-93fb-78064d5a5248 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:10.608188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f454356-8d60-4c69-93fb-78064d5a5248 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:10.721525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-8f454356-8d60-4c69-93fb-78064d5a5248 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:59:10.824460 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f454356-8d60-4c69-93fb-78064d5a5248 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.233615 Mar 12 20:59:10.825091 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2089/2857] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Mar 12 20:59:10 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:10.836903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69669df2-a5a8-4e78-baad-eb4212830b69 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:10.879143 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-69669df2-a5a8-4e78-baad-eb4212830b69 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/92042547-d653-45b7-b21a-c88bdb8985a1" status: 204 len: 0 microversion: 2.1 time: 0.052888 Mar 12 20:59:10.880583 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2090/2858] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 20:59:10 2022] DELETE /compute/v2.1/os-server-groups/92042547-d653-45b7-b21a-c88bdb8985a1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:59:10.893681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-63cbc501-b683-478f-a11e-5221d844506e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:10.894356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-63cbc501-b683-478f-a11e-5221d844506e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 3de07409-369a-4686-9c06-7627d6f500fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:10.903207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63cbc501-b683-478f-a11e-5221d844506e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:10.903679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63cbc501-b683-478f-a11e-5221d844506e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:10.904478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63cbc501-b683-478f-a11e-5221d844506e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:10.905333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63cbc501-b683-478f-a11e-5221d844506e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:10.929345 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-63cbc501-b683-478f-a11e-5221d844506e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] HTTP exception thrown: Instance 3de07409-369a-4686-9c06-7627d6f500fd could not be found. Mar 12 20:59:10.930022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-63cbc501-b683-478f-a11e-5221d844506e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Returning 404 to user: Instance 3de07409-369a-4686-9c06-7627d6f500fd could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:10.930929 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-63cbc501-b683-478f-a11e-5221d844506e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd" status: 404 len: 111 microversion: 2.1 time: 0.042332 Mar 12 20:59:10.933911 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2091/2859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:10 2022] GET /compute/v2.1/servers/3de07409-369a-4686-9c06-7627d6f500fd => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:10.938205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-367abf93-8f2f-47e8-8562-140d41117645 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:10.938839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-367abf93-8f2f-47e8-8562-140d41117645 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:10.946320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-367abf93-8f2f-47e8-8562-140d41117645 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:10.946785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-367abf93-8f2f-47e8-8562-140d41117645 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:10.947639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-367abf93-8f2f-47e8-8562-140d41117645 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:10.948090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-367abf93-8f2f-47e8-8562-140d41117645 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.032011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-367abf93-8f2f-47e8-8562-140d41117645 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:11.054987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-367abf93-8f2f-47e8-8562-140d41117645 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:11.057052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-367abf93-8f2f-47e8-8562-140d41117645 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:11.058420 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-367abf93-8f2f-47e8-8562-140d41117645 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.125938 Mar 12 20:59:11.060765 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2092/2860] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:10 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:11.066714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-87d7077d-dc1e-45b2-951b-3f106fa0f15f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:11.067652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-87d7077d-dc1e-45b2-951b-3f106fa0f15f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:11.150361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-87d7077d-dc1e-45b2-951b-3f106fa0f15f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:11.159014 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-87d7077d-dc1e-45b2-951b-3f106fa0f15f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1221 microversion: 2.1 time: 0.097043 Mar 12 20:59:11.159816 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2093/2861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:11 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:11.174140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0164f91c-a938-4c3c-a2cc-d711d72a8588 req-c6c880fa-8788-4db3-af7e-5056768d2c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ed298c-3e5a-4f2c-930f-7d7feb65126c", "name": "network-vif-deleted", "tag": "9ff3e2ff-a91c-42c5-ab98-b9c1d789e350"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:11.188427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0164f91c-a938-4c3c-a2cc-d711d72a8588 req-c6c880fa-8788-4db3-af7e-5056768d2c0b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:11.188895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0164f91c-a938-4c3c-a2cc-d711d72a8588 req-c6c880fa-8788-4db3-af7e-5056768d2c0b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.203993 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0164f91c-a938-4c3c-a2cc-d711d72a8588 req-c6c880fa-8788-4db3-af7e-5056768d2c0b service nova] Creating event network-vif-deleted:9ff3e2ff-a91c-42c5-ab98-b9c1d789e350 for instance 49ed298c-3e5a-4f2c-930f-7d7feb65126c on nch1-master-1 Mar 12 20:59:11.214832 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0164f91c-a938-4c3c-a2cc-d711d72a8588 req-c6c880fa-8788-4db3-af7e-5056768d2c0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052999 Mar 12 20:59:11.221163 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2094/2862] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:11.228051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-becacc1a-39d7-49fb-b68f-2e4b7c7bf1e9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:11.234027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-becacc1a-39d7-49fb-b68f-2e4b7c7bf1e9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:11.235074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-becacc1a-39d7-49fb-b68f-2e4b7c7bf1e9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:11.243180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-becacc1a-39d7-49fb-b68f-2e4b7c7bf1e9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:11.243571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-becacc1a-39d7-49fb-b68f-2e4b7c7bf1e9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.244519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-becacc1a-39d7-49fb-b68f-2e4b7c7bf1e9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:11.245182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-becacc1a-39d7-49fb-b68f-2e4b7c7bf1e9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.363481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-becacc1a-39d7-49fb-b68f-2e4b7c7bf1e9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:59:11.425454 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-becacc1a-39d7-49fb-b68f-2e4b7c7bf1e9 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.202861 Mar 12 20:59:11.426404 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2095/2863] 10.222.0.30 () {58 vars in 1195 bytes} [Sat Mar 12 20:59:11 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:11.432236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af7597ea-a210-45c9-9ed3-3c27594e1804 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:11.432885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af7597ea-a210-45c9-9ed3-3c27594e1804 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: f5af603d-9610-4c9e-bf45-9df1de0504e1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:11.440143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af7597ea-a210-45c9-9ed3-3c27594e1804 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:11.440659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af7597ea-a210-45c9-9ed3-3c27594e1804 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.441806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af7597ea-a210-45c9-9ed3-3c27594e1804 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:11.442354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af7597ea-a210-45c9-9ed3-3c27594e1804 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.472480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af7597ea-a210-45c9-9ed3-3c27594e1804 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: f5af603d-9610-4c9e-bf45-9df1de0504e1] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:11.579701 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af7597ea-a210-45c9-9ed3-3c27594e1804 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1" status: 204 len: 0 microversion: 2.1 time: 0.151338 Mar 12 20:59:11.580702 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2096/2864] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:11 2022] DELETE /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:59:11.592293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75ad2808-d5ae-404b-bcdd-d87e14d2953b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:11.593003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75ad2808-d5ae-404b-bcdd-d87e14d2953b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:11.599845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75ad2808-d5ae-404b-bcdd-d87e14d2953b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:11.600295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75ad2808-d5ae-404b-bcdd-d87e14d2953b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.601637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75ad2808-d5ae-404b-bcdd-d87e14d2953b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:11.602137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75ad2808-d5ae-404b-bcdd-d87e14d2953b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.615518 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-75ad2808-d5ae-404b-bcdd-d87e14d2953b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] HTTP exception thrown: Instance 85242d3f-d68b-418e-8788-978e8b8e1a57 could not be found. Mar 12 20:59:11.616108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75ad2808-d5ae-404b-bcdd-d87e14d2953b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Returning 404 to user: Instance 85242d3f-d68b-418e-8788-978e8b8e1a57 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:11.617579 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75ad2808-d5ae-404b-bcdd-d87e14d2953b tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 404 len: 111 microversion: 2.1 time: 0.034795 Mar 12 20:59:11.621049 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2097/2865] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:11 2022] DELETE /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:11.625183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2207d3d7-af9f-4ab8-8586-621a22277434 req-f7a7dbc5-00da-4100-a112-cb5c93efa6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44289ad3-751a-4eee-ba1a-9637a3696864", "name": "network-vif-deleted", "tag": "b31eaefc-fcf6-426a-be94-19a6c528b552"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:11.634665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2207d3d7-af9f-4ab8-8586-621a22277434 req-f7a7dbc5-00da-4100-a112-cb5c93efa6db service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:11.635256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2207d3d7-af9f-4ab8-8586-621a22277434 req-f7a7dbc5-00da-4100-a112-cb5c93efa6db service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.649192 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2207d3d7-af9f-4ab8-8586-621a22277434 req-f7a7dbc5-00da-4100-a112-cb5c93efa6db service nova] Creating event network-vif-deleted:b31eaefc-fcf6-426a-be94-19a6c528b552 for instance 44289ad3-751a-4eee-ba1a-9637a3696864 on nch2-master-1 Mar 12 20:59:11.655425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2207d3d7-af9f-4ab8-8586-621a22277434 req-f7a7dbc5-00da-4100-a112-cb5c93efa6db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035545 Mar 12 20:59:11.656349 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2098/2866] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:11.662327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-075d38d1-6723-4773-9c9c-2b5536cb8284 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:11.666360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-075d38d1-6723-4773-9c9c-2b5536cb8284 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:11.667102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-075d38d1-6723-4773-9c9c-2b5536cb8284 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'name': '1793297865', 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:11.672451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-075d38d1-6723-4773-9c9c-2b5536cb8284 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:11.673024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-075d38d1-6723-4773-9c9c-2b5536cb8284 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.674092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-075d38d1-6723-4773-9c9c-2b5536cb8284 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:11.674452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-075d38d1-6723-4773-9c9c-2b5536cb8284 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.794563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-075d38d1-6723-4773-9c9c-2b5536cb8284 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:59:11.859728 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-075d38d1-6723-4773-9c9c-2b5536cb8284 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?name=1793297865" status: 200 len: 346 microversion: 2.1 time: 0.202181 Mar 12 20:59:11.860320 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2099/2867] 10.222.0.30 () {58 vars in 1155 bytes} [Sat Mar 12 20:59:11 2022] GET /compute/v2.1/servers?name=1793297865 => generated 346 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:11.866198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-961e9f65-c179-489d-8ef0-253d782adef5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:11.866198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-961e9f65-c179-489d-8ef0-253d782adef5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: a861691b-98dc-49c0-9a22-ecc3a4d67534] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:11.874812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-961e9f65-c179-489d-8ef0-253d782adef5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:11.875265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-961e9f65-c179-489d-8ef0-253d782adef5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.876054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-961e9f65-c179-489d-8ef0-253d782adef5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:11.877436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-961e9f65-c179-489d-8ef0-253d782adef5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:11.903954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-961e9f65-c179-489d-8ef0-253d782adef5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: a861691b-98dc-49c0-9a22-ecc3a4d67534] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:12.000909 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-961e9f65-c179-489d-8ef0-253d782adef5 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534" status: 204 len: 0 microversion: 2.1 time: 0.138418 Mar 12 20:59:12.002121 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2100/2868] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:11 2022] DELETE /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:59:12.009259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c2322f28-1ab7-4d57-9349-6c174456781e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:12.010920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c2322f28-1ab7-4d57-9349-6c174456781e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] [instance: 85242d3f-d68b-418e-8788-978e8b8e1a57] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:12.017324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2322f28-1ab7-4d57-9349-6c174456781e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:12.017813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2322f28-1ab7-4d57-9349-6c174456781e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:12.018615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2322f28-1ab7-4d57-9349-6c174456781e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:12.019705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2322f28-1ab7-4d57-9349-6c174456781e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:12.039343 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c2322f28-1ab7-4d57-9349-6c174456781e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] HTTP exception thrown: Instance 85242d3f-d68b-418e-8788-978e8b8e1a57 could not be found. Mar 12 20:59:12.040162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c2322f28-1ab7-4d57-9349-6c174456781e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] Returning 404 to user: Instance 85242d3f-d68b-418e-8788-978e8b8e1a57 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:12.041189 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c2322f28-1ab7-4d57-9349-6c174456781e tempest-ServerDiskConfigTestJSON-983862641 tempest-ServerDiskConfigTestJSON-983862641-project] 10.222.0.30 "GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57" status: 404 len: 111 microversion: 2.1 time: 0.037225 Mar 12 20:59:12.042254 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2101/2869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:12 2022] GET /compute/v2.1/servers/85242d3f-d68b-418e-8788-978e8b8e1a57 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:12.048594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ff09b6e-c026-42ba-ad3c-82aeebfde159 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:12.055048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ff09b6e-c026-42ba-ad3c-82aeebfde159 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:12.056017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ff09b6e-c026-42ba-ad3c-82aeebfde159 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:12.071376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ff09b6e-c026-42ba-ad3c-82aeebfde159 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:12.071837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ff09b6e-c026-42ba-ad3c-82aeebfde159 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:12.072920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ff09b6e-c026-42ba-ad3c-82aeebfde159 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:12.073368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ff09b6e-c026-42ba-ad3c-82aeebfde159 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:12.169048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-3ff09b6e-c026-42ba-ad3c-82aeebfde159 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:59:12.231167 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ff09b6e-c026-42ba-ad3c-82aeebfde159 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.187470 Mar 12 20:59:12.232588 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2102/2870] 10.222.0.30 () {58 vars in 1153 bytes} [Sat Mar 12 20:59:12 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:12.240575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94c3897c-1401-48ec-a090-4eaeeda273a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:12.241259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94c3897c-1401-48ec-a090-4eaeeda273a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: f5af603d-9610-4c9e-bf45-9df1de0504e1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:12.250265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94c3897c-1401-48ec-a090-4eaeeda273a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:12.251311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94c3897c-1401-48ec-a090-4eaeeda273a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:12.252169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94c3897c-1401-48ec-a090-4eaeeda273a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:12.253062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94c3897c-1401-48ec-a090-4eaeeda273a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:12.598494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-94c3897c-1401-48ec-a090-4eaeeda273a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:12.613591 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94c3897c-1401-48ec-a090-4eaeeda273a3 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1" status: 200 len: 1474 microversion: 2.1 time: 0.379307 Mar 12 20:59:12.615815 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2103/2871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:12 2022] GET /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1 => generated 1474 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:12.623086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ae3f66f8-e133-4041-97b6-ca27777014e2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:12.623892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ae3f66f8-e133-4041-97b6-ca27777014e2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:12.634978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae3f66f8-e133-4041-97b6-ca27777014e2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:12.635954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae3f66f8-e133-4041-97b6-ca27777014e2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:12.637530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae3f66f8-e133-4041-97b6-ca27777014e2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:12.640737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae3f66f8-e133-4041-97b6-ca27777014e2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:12.718696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ae3f66f8-e133-4041-97b6-ca27777014e2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:12.728275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ae3f66f8-e133-4041-97b6-ca27777014e2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:12.729916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ae3f66f8-e133-4041-97b6-ca27777014e2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:12.731505 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ae3f66f8-e133-4041-97b6-ca27777014e2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.114479 Mar 12 20:59:12.733007 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2104/2872] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:12 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:12.737717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39b88a58-b619-42c7-a33d-3460f6856951 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:12.738415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39b88a58-b619-42c7-a33d-3460f6856951 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:12.744613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39b88a58-b619-42c7-a33d-3460f6856951 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:12.745161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39b88a58-b619-42c7-a33d-3460f6856951 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:12.746087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39b88a58-b619-42c7-a33d-3460f6856951 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:12.746661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39b88a58-b619-42c7-a33d-3460f6856951 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:12.824139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39b88a58-b619-42c7-a33d-3460f6856951 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:12.833689 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39b88a58-b619-42c7-a33d-3460f6856951 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1279 microversion: 2.1 time: 0.099538 Mar 12 20:59:12.834554 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2105/2873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:12 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1279 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:12.839599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dcce07e4-9fc7-4028-a8b7-be56bba8444c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:12.843523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dcce07e4-9fc7-4028-a8b7-be56bba8444c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:12.844525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dcce07e4-9fc7-4028-a8b7-be56bba8444c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-179329786', 'deleted': False, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:12.849288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcce07e4-9fc7-4028-a8b7-be56bba8444c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:12.849743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcce07e4-9fc7-4028-a8b7-be56bba8444c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:12.850579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcce07e4-9fc7-4028-a8b7-be56bba8444c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:12.851717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcce07e4-9fc7-4028-a8b7-be56bba8444c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:12.961461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-dcce07e4-9fc7-4028-a8b7-be56bba8444c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:59:13.028231 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dcce07e4-9fc7-4028-a8b7-be56bba8444c tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-179329786" status: 200 len: 346 microversion: 2.1 time: 0.192488 Mar 12 20:59:13.029175 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2106/2874] 10.222.0.30 () {58 vars in 1227 bytes} [Sat Mar 12 20:59:12 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-179329786 => generated 346 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:13.035030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-98ed48d6-3622-4c13-8e8c-96c3c427429f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:13.035552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-98ed48d6-3622-4c13-8e8c-96c3c427429f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:13.041299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98ed48d6-3622-4c13-8e8c-96c3c427429f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:13.041749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98ed48d6-3622-4c13-8e8c-96c3c427429f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:13.042551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98ed48d6-3622-4c13-8e8c-96c3c427429f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:13.042987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98ed48d6-3622-4c13-8e8c-96c3c427429f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:13.056727 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-98ed48d6-3622-4c13-8e8c-96c3c427429f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] HTTP exception thrown: Instance f27f34eb-a809-408c-9262-cec7223eee56 could not be found. Mar 12 20:59:13.058231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-98ed48d6-3622-4c13-8e8c-96c3c427429f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Returning 404 to user: Instance f27f34eb-a809-408c-9262-cec7223eee56 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:13.058231 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-98ed48d6-3622-4c13-8e8c-96c3c427429f tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 404 len: 111 microversion: 2.20 time: 0.028017 Mar 12 20:59:13.058948 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2107/2875] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:59:13 2022] DELETE /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:59:13.065233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8a0caef-b42e-4f0a-a3cb-4bc0d2a5597a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:13.065731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8a0caef-b42e-4f0a-a3cb-4bc0d2a5597a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:13.072709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a0caef-b42e-4f0a-a3cb-4bc0d2a5597a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:13.072856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a0caef-b42e-4f0a-a3cb-4bc0d2a5597a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:13.073731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a0caef-b42e-4f0a-a3cb-4bc0d2a5597a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:13.073969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a0caef-b42e-4f0a-a3cb-4bc0d2a5597a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:13.099179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8a0caef-b42e-4f0a-a3cb-4bc0d2a5597a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:13.183412 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8a0caef-b42e-4f0a-a3cb-4bc0d2a5597a tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 204 len: 0 microversion: 2.1 time: 0.123291 Mar 12 20:59:13.186790 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2108/2876] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:13 2022] DELETE /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:59:13.192700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6bbeea3c-fb85-43f4-b446-b8781d0d7bb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:13.193413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6bbeea3c-fb85-43f4-b446-b8781d0d7bb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: f27f34eb-a809-408c-9262-cec7223eee56] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:13.199977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bbeea3c-fb85-43f4-b446-b8781d0d7bb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:13.200433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bbeea3c-fb85-43f4-b446-b8781d0d7bb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:13.201217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bbeea3c-fb85-43f4-b446-b8781d0d7bb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:13.201713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bbeea3c-fb85-43f4-b446-b8781d0d7bb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:13.215779 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-6bbeea3c-fb85-43f4-b446-b8781d0d7bb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] HTTP exception thrown: Instance f27f34eb-a809-408c-9262-cec7223eee56 could not be found. Mar 12 20:59:13.216387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6bbeea3c-fb85-43f4-b446-b8781d0d7bb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Returning 404 to user: Instance f27f34eb-a809-408c-9262-cec7223eee56 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:13.217231 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6bbeea3c-fb85-43f4-b446-b8781d0d7bb2 tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56" status: 404 len: 111 microversion: 2.20 time: 0.029215 Mar 12 20:59:13.217847 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2109/2877] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:13 2022] GET /compute/v2.1/servers/f27f34eb-a809-408c-9262-cec7223eee56 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:59:13.223082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-01586cfa-d3d6-4afe-93d7-83700686186f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:13.223276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-01586cfa-d3d6-4afe-93d7-83700686186f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:13.229062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01586cfa-d3d6-4afe-93d7-83700686186f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:13.229524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01586cfa-d3d6-4afe-93d7-83700686186f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:13.230335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01586cfa-d3d6-4afe-93d7-83700686186f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:13.230778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01586cfa-d3d6-4afe-93d7-83700686186f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:13.565309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-01586cfa-d3d6-4afe-93d7-83700686186f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:13.575590 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-01586cfa-d3d6-4afe-93d7-83700686186f tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1518 microversion: 2.1 time: 0.356692 Mar 12 20:59:13.576201 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2110/2878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:13 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1518 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:13.633330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cbc317ba-1af4-462f-ab41-c21f1c829744 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:13.634854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cbc317ba-1af4-462f-ab41-c21f1c829744 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: f5af603d-9610-4c9e-bf45-9df1de0504e1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:13.646558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbc317ba-1af4-462f-ab41-c21f1c829744 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:13.648310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbc317ba-1af4-462f-ab41-c21f1c829744 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:13.650385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbc317ba-1af4-462f-ab41-c21f1c829744 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:13.655132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbc317ba-1af4-462f-ab41-c21f1c829744 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:13.977921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cbc317ba-1af4-462f-ab41-c21f1c829744 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:13.990766 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cbc317ba-1af4-462f-ab41-c21f1c829744 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1" status: 200 len: 1474 microversion: 2.1 time: 0.360983 Mar 12 20:59:13.993872 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2111/2879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:13 2022] GET /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1 => generated 1474 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:13.998772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-85a532c7-a77c-4341-b41a-abd56744551a req-8fafe083-f69e-4662-a58f-26af79d62865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3b9fa34-2929-4ab9-b2d8-47c9949331e3", "tag": "0a7a0ba6-2990-4f5b-88b1-1cb759ef9585"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:14.015458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-85a532c7-a77c-4341-b41a-abd56744551a req-8fafe083-f69e-4662-a58f-26af79d62865 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:14.015908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-85a532c7-a77c-4341-b41a-abd56744551a req-8fafe083-f69e-4662-a58f-26af79d62865 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:14.041574 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-85a532c7-a77c-4341-b41a-abd56744551a req-8fafe083-f69e-4662-a58f-26af79d62865 service nova] Creating event network-changed:0a7a0ba6-2990-4f5b-88b1-1cb759ef9585 for instance b3b9fa34-2929-4ab9-b2d8-47c9949331e3 on nch2-master-1 Mar 12 20:59:14.047432 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-85a532c7-a77c-4341-b41a-abd56744551a req-8fafe083-f69e-4662-a58f-26af79d62865 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052086 Mar 12 20:59:14.049246 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2112/2880] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:14.057072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59f8853f-206c-49f5-85f4-4eafaaad8c1f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:14.058190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59f8853f-206c-49f5-85f4-4eafaaad8c1f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:14.066608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59f8853f-206c-49f5-85f4-4eafaaad8c1f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:14.067376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59f8853f-206c-49f5-85f4-4eafaaad8c1f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:14.068466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59f8853f-206c-49f5-85f4-4eafaaad8c1f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:14.070292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59f8853f-206c-49f5-85f4-4eafaaad8c1f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:14.220848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-59f8853f-206c-49f5-85f4-4eafaaad8c1f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:14.229892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-59f8853f-206c-49f5-85f4-4eafaaad8c1f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:14.231343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-59f8853f-206c-49f5-85f4-4eafaaad8c1f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:14.232600 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59f8853f-206c-49f5-85f4-4eafaaad8c1f tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1409 microversion: 2.54 time: 0.181603 Mar 12 20:59:14.241872 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2113/2881] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:14 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1409 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:14.241872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-705a598e-f9b0-4629-b19b-a5545ccebe30 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:14.241872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-705a598e-f9b0-4629-b19b-a5545ccebe30 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:14.247848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-705a598e-f9b0-4629-b19b-a5545ccebe30 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:14.248578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-705a598e-f9b0-4629-b19b-a5545ccebe30 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:14.249527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-705a598e-f9b0-4629-b19b-a5545ccebe30 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:14.250264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-705a598e-f9b0-4629-b19b-a5545ccebe30 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:14.704119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-705a598e-f9b0-4629-b19b-a5545ccebe30 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:14.714843 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-705a598e-f9b0-4629-b19b-a5545ccebe30 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1321 microversion: 2.1 time: 0.479682 Mar 12 20:59:14.725853 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2114/2882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:14 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1321 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:14.734165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7c18a762-d9f7-4273-ad3a-db72ae6ebea9 req-abcf7cfb-496e-4746-b21b-35f17cf84984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd233007-740a-4bd4-b786-eb46e987f98a", "tag": "30f641b5-fdf0-46de-90c3-cd66179d2e9e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:14.773325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7c18a762-d9f7-4273-ad3a-db72ae6ebea9 req-abcf7cfb-496e-4746-b21b-35f17cf84984 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:14.774138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7c18a762-d9f7-4273-ad3a-db72ae6ebea9 req-abcf7cfb-496e-4746-b21b-35f17cf84984 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:14.794149 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7c18a762-d9f7-4273-ad3a-db72ae6ebea9 req-abcf7cfb-496e-4746-b21b-35f17cf84984 service nova] Creating event network-changed:30f641b5-fdf0-46de-90c3-cd66179d2e9e for instance dd233007-740a-4bd4-b786-eb46e987f98a on nch1-master-1 Mar 12 20:59:14.803138 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7c18a762-d9f7-4273-ad3a-db72ae6ebea9 req-abcf7cfb-496e-4746-b21b-35f17cf84984 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075101 Mar 12 20:59:14.804487 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2115/2883] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:14.812655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a3c274a4-9ab4-4673-8c45-1987ded58a5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:14.813472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a3c274a4-9ab4-4673-8c45-1987ded58a5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:14.871746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3c274a4-9ab4-4673-8c45-1987ded58a5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:14.880913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3c274a4-9ab4-4673-8c45-1987ded58a5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:14.882903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3c274a4-9ab4-4673-8c45-1987ded58a5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:14.891494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3c274a4-9ab4-4673-8c45-1987ded58a5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:14.936726 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a3c274a4-9ab4-4673-8c45-1987ded58a5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] HTTP exception thrown: Instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 could not be found. Mar 12 20:59:14.942220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a3c274a4-9ab4-4673-8c45-1987ded58a5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Returning 404 to user: Instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:14.947623 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a3c274a4-9ab4-4673-8c45-1987ded58a5e tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 404 len: 111 microversion: 2.20 time: 0.141210 Mar 12 20:59:14.952949 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2116/2884] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:59:14 2022] DELETE /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:59:14.985564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cc124fed-0eeb-4ef9-9059-db0e29506775 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:14.988198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc124fed-0eeb-4ef9-9059-db0e29506775 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:15.000838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc124fed-0eeb-4ef9-9059-db0e29506775 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:15.001836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc124fed-0eeb-4ef9-9059-db0e29506775 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:15.004347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc124fed-0eeb-4ef9-9059-db0e29506775 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:15.008809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc124fed-0eeb-4ef9-9059-db0e29506775 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:15.502781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cc124fed-0eeb-4ef9-9059-db0e29506775 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:15.518905 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cc124fed-0eeb-4ef9-9059-db0e29506775 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 200 len: 1518 microversion: 2.1 time: 0.557703 Mar 12 20:59:15.519916 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2117/2885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:14 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 1518 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:15.553847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d0cc372e-8c4b-4e95-a4a0-12c8aaeaaa2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:15.554339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d0cc372e-8c4b-4e95-a4a0-12c8aaeaaa2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] [instance: 5ae82842-58a0-4d5e-a522-a1c83c53e101] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:15.566430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0cc372e-8c4b-4e95-a4a0-12c8aaeaaa2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:15.566887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0cc372e-8c4b-4e95-a4a0-12c8aaeaaa2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:15.568096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0cc372e-8c4b-4e95-a4a0-12c8aaeaaa2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:15.572127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0cc372e-8c4b-4e95-a4a0-12c8aaeaaa2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:15.604513 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d0cc372e-8c4b-4e95-a4a0-12c8aaeaaa2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] HTTP exception thrown: Instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 could not be found. Mar 12 20:59:15.605430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d0cc372e-8c4b-4e95-a4a0-12c8aaeaaa2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] Returning 404 to user: Instance 5ae82842-58a0-4d5e-a522-a1c83c53e101 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:15.606420 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d0cc372e-8c4b-4e95-a4a0-12c8aaeaaa2b tempest-AttachVolumeShelveTestJSON-13164227 tempest-AttachVolumeShelveTestJSON-13164227-project] 10.222.0.30 "GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101" status: 404 len: 111 microversion: 2.20 time: 0.068466 Mar 12 20:59:15.607209 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2118/2886] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:15 2022] GET /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:59:15.614500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d01aae39-eae7-42d1-9878-4ce8b74e1935 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:15.615556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d01aae39-eae7-42d1-9878-4ce8b74e1935 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: f5af603d-9610-4c9e-bf45-9df1de0504e1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:15.630432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d01aae39-eae7-42d1-9878-4ce8b74e1935 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:15.630941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d01aae39-eae7-42d1-9878-4ce8b74e1935 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:15.635787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d01aae39-eae7-42d1-9878-4ce8b74e1935 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:15.635787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d01aae39-eae7-42d1-9878-4ce8b74e1935 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:15.668457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d01aae39-eae7-42d1-9878-4ce8b74e1935 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] HTTP exception thrown: Instance f5af603d-9610-4c9e-bf45-9df1de0504e1 could not be found. Mar 12 20:59:15.669080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d01aae39-eae7-42d1-9878-4ce8b74e1935 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Returning 404 to user: Instance f5af603d-9610-4c9e-bf45-9df1de0504e1 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:15.672578 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d01aae39-eae7-42d1-9878-4ce8b74e1935 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1" status: 404 len: 111 microversion: 2.1 time: 0.061993 Mar 12 20:59:15.673481 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2119/2887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:15 2022] GET /compute/v2.1/servers/f5af603d-9610-4c9e-bf45-9df1de0504e1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:15.695088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8fc84ebc-df76-4bd0-819b-469ea6147635 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:15.696171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8fc84ebc-df76-4bd0-819b-469ea6147635 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:15.706828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fc84ebc-df76-4bd0-819b-469ea6147635 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:15.712143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fc84ebc-df76-4bd0-819b-469ea6147635 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:15.716081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fc84ebc-df76-4bd0-819b-469ea6147635 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:15.719666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fc84ebc-df76-4bd0-819b-469ea6147635 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:15.837409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8fc84ebc-df76-4bd0-819b-469ea6147635 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:15.849240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8fc84ebc-df76-4bd0-819b-469ea6147635 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:15.850995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8fc84ebc-df76-4bd0-819b-469ea6147635 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:15.852256 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8fc84ebc-df76-4bd0-819b-469ea6147635 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1415 microversion: 2.54 time: 0.175941 Mar 12 20:59:15.854636 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2120/2888] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:15 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1415 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:15.864261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ffbfb77a-35e3-43ee-929a-2e6f5e841107 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:15.875023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ffbfb77a-35e3-43ee-929a-2e6f5e841107 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: a861691b-98dc-49c0-9a22-ecc3a4d67534] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:15.881572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffbfb77a-35e3-43ee-929a-2e6f5e841107 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:15.882644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffbfb77a-35e3-43ee-929a-2e6f5e841107 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:15.883454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffbfb77a-35e3-43ee-929a-2e6f5e841107 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:15.883896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffbfb77a-35e3-43ee-929a-2e6f5e841107 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:15.899798 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ffbfb77a-35e3-43ee-929a-2e6f5e841107 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] HTTP exception thrown: Instance a861691b-98dc-49c0-9a22-ecc3a4d67534 could not be found. Mar 12 20:59:15.900837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ffbfb77a-35e3-43ee-929a-2e6f5e841107 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Returning 404 to user: Instance a861691b-98dc-49c0-9a22-ecc3a4d67534 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:15.902077 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ffbfb77a-35e3-43ee-929a-2e6f5e841107 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534" status: 404 len: 111 microversion: 2.1 time: 0.046201 Mar 12 20:59:15.903123 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2121/2889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:15 2022] GET /compute/v2.1/servers/a861691b-98dc-49c0-9a22-ecc3a4d67534 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:15.908588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b498198-8c13-45db-a57b-f8094857762c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:15.909565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b498198-8c13-45db-a57b-f8094857762c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:15.918468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b498198-8c13-45db-a57b-f8094857762c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:15.919175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b498198-8c13-45db-a57b-f8094857762c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:15.920304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b498198-8c13-45db-a57b-f8094857762c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:15.921172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b498198-8c13-45db-a57b-f8094857762c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:16.814076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b498198-8c13-45db-a57b-f8094857762c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:16.823036 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b498198-8c13-45db-a57b-f8094857762c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1321 microversion: 2.1 time: 0.918562 Mar 12 20:59:16.823783 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2122/2890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:15 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1321 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:16.830127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-995a5541-6114-4a82-b2e0-4fdac9937d7a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:16.875690 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-995a5541-6114-4a82-b2e0-4fdac9937d7a tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/0d258fbc-c769-4150-a109-d47a8ca6d4fa" status: 204 len: 0 microversion: 2.1 time: 0.050617 Mar 12 20:59:16.876503 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2123/2891] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 20:59:16 2022] DELETE /compute/v2.1/os-server-groups/0d258fbc-c769-4150-a109-d47a8ca6d4fa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:59:16.882730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a99f3309-9a57-4605-8a5b-b0af1e51f989 req-3d0af7e7-6808-411f-8935-12a694f8a15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5af603d-9610-4c9e-bf45-9df1de0504e1", "name": "network-vif-deleted", "tag": "cdf7109b-2b24-4768-9c41-d98c340ad31a"}, {"server_uuid": "a861691b-98dc-49c0-9a22-ecc3a4d67534", "name": "network-vif-deleted", "tag": "d454d31e-14e7-42aa-82d6-43badb4a25f3"}, {"server_uuid": "09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089", "name": "network-vif-deleted", "tag": "f228fcf1-33a8-4130-bbcd-d7790e0ed18e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:16.893896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a99f3309-9a57-4605-8a5b-b0af1e51f989 req-3d0af7e7-6808-411f-8935-12a694f8a15e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:16.894800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a99f3309-9a57-4605-8a5b-b0af1e51f989 req-3d0af7e7-6808-411f-8935-12a694f8a15e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:16.909346 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a99f3309-9a57-4605-8a5b-b0af1e51f989 req-3d0af7e7-6808-411f-8935-12a694f8a15e service nova] Creating event network-vif-deleted:cdf7109b-2b24-4768-9c41-d98c340ad31a for instance f5af603d-9610-4c9e-bf45-9df1de0504e1 on nch2-master-1 Mar 12 20:59:16.909891 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a99f3309-9a57-4605-8a5b-b0af1e51f989 req-3d0af7e7-6808-411f-8935-12a694f8a15e service nova] Creating event network-vif-deleted:d454d31e-14e7-42aa-82d6-43badb4a25f3 for instance a861691b-98dc-49c0-9a22-ecc3a4d67534 on nch2-master-1 Mar 12 20:59:16.910394 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a99f3309-9a57-4605-8a5b-b0af1e51f989 req-3d0af7e7-6808-411f-8935-12a694f8a15e service nova] Creating event network-vif-deleted:f228fcf1-33a8-4130-bbcd-d7790e0ed18e for instance 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 on nch1-master-1 Mar 12 20:59:16.920613 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a99f3309-9a57-4605-8a5b-b0af1e51f989 req-3d0af7e7-6808-411f-8935-12a694f8a15e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042533 Mar 12 20:59:16.921222 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2124/2892] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:16.926495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2049ce5-35c6-4962-beb1-b5a1abed2cfd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:16.927366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2049ce5-35c6-4962-beb1-b5a1abed2cfd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:16.934387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2049ce5-35c6-4962-beb1-b5a1abed2cfd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:16.934846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2049ce5-35c6-4962-beb1-b5a1abed2cfd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:16.935629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2049ce5-35c6-4962-beb1-b5a1abed2cfd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:16.936067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2049ce5-35c6-4962-beb1-b5a1abed2cfd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:16.949607 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e2049ce5-35c6-4962-beb1-b5a1abed2cfd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] HTTP exception thrown: Instance 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 could not be found. Mar 12 20:59:16.950237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2049ce5-35c6-4962-beb1-b5a1abed2cfd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Returning 404 to user: Instance 09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:16.951071 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2049ce5-35c6-4962-beb1-b5a1abed2cfd tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089" status: 404 len: 111 microversion: 2.1 time: 0.028748 Mar 12 20:59:16.951622 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2125/2893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:16 2022] GET /compute/v2.1/servers/09e79ccc-1fb1-4aa6-a4e7-31f3e15a9089 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:16.956427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6bc4a34d-3fac-401b-b34a-ecc0ec8bf8c1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:16.957116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6bc4a34d-3fac-401b-b34a-ecc0ec8bf8c1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:16.963080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bc4a34d-3fac-401b-b34a-ecc0ec8bf8c1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:16.963602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bc4a34d-3fac-401b-b34a-ecc0ec8bf8c1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:16.964558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bc4a34d-3fac-401b-b34a-ecc0ec8bf8c1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:16.965162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bc4a34d-3fac-401b-b34a-ecc0ec8bf8c1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:16.990242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6bc4a34d-3fac-401b-b34a-ecc0ec8bf8c1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/ips" status: 200 len: 146 microversion: 2.1 time: 0.037375 Mar 12 20:59:16.991159 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2126/2894] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 20:59:16 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:16.996207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25efc206-5154-4718-ae7a-9e673d5c8a09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:16.996823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-25efc206-5154-4718-ae7a-9e673d5c8a09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:17.003023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25efc206-5154-4718-ae7a-9e673d5c8a09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:17.003656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25efc206-5154-4718-ae7a-9e673d5c8a09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:17.004613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25efc206-5154-4718-ae7a-9e673d5c8a09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:17.005197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25efc206-5154-4718-ae7a-9e673d5c8a09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:17.097475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-25efc206-5154-4718-ae7a-9e673d5c8a09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:17.106720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-25efc206-5154-4718-ae7a-9e673d5c8a09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:17.108223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-25efc206-5154-4718-ae7a-9e673d5c8a09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:17.109310 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-25efc206-5154-4718-ae7a-9e673d5c8a09 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1415 microversion: 2.54 time: 0.116658 Mar 12 20:59:17.120667 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2127/2895] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:16 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1415 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:17.120667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fc5788e7-5e7e-4190-a17f-b9ccca34f662 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:17.120667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fc5788e7-5e7e-4190-a17f-b9ccca34f662 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 4979bdb6-1c95-4d29-909c-194f16259f42] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:17.122105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc5788e7-5e7e-4190-a17f-b9ccca34f662 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:17.122557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc5788e7-5e7e-4190-a17f-b9ccca34f662 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:17.123363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc5788e7-5e7e-4190-a17f-b9ccca34f662 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:17.123819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc5788e7-5e7e-4190-a17f-b9ccca34f662 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:17.149261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fc5788e7-5e7e-4190-a17f-b9ccca34f662 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 4979bdb6-1c95-4d29-909c-194f16259f42] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:17.265006 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fc5788e7-5e7e-4190-a17f-b9ccca34f662 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42" status: 204 len: 0 microversion: 2.1 time: 0.152201 Mar 12 20:59:17.269629 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2128/2896] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:17 2022] DELETE /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:59:17.275266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8157b1e-ac3b-4021-8583-5fac74ead3d2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:17.275863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8157b1e-ac3b-4021-8583-5fac74ead3d2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 326ae42b-a952-4626-b027-90afe2eed7af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:17.284705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8157b1e-ac3b-4021-8583-5fac74ead3d2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:17.285157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8157b1e-ac3b-4021-8583-5fac74ead3d2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:17.285975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8157b1e-ac3b-4021-8583-5fac74ead3d2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:17.286415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8157b1e-ac3b-4021-8583-5fac74ead3d2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:17.329454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8157b1e-ac3b-4021-8583-5fac74ead3d2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 326ae42b-a952-4626-b027-90afe2eed7af] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:17.473411 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8157b1e-ac3b-4021-8583-5fac74ead3d2 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af" status: 204 len: 0 microversion: 2.1 time: 0.204779 Mar 12 20:59:17.485544 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2129/2897] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:17 2022] DELETE /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:59:17.492913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1bc4186-7182-46b7-8ee9-5e7fb76b1ab2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:17.494579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1bc4186-7182-46b7-8ee9-5e7fb76b1ab2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 4979bdb6-1c95-4d29-909c-194f16259f42] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:17.508556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1bc4186-7182-46b7-8ee9-5e7fb76b1ab2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:17.509041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1bc4186-7182-46b7-8ee9-5e7fb76b1ab2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:17.509863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1bc4186-7182-46b7-8ee9-5e7fb76b1ab2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:17.510307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1bc4186-7182-46b7-8ee9-5e7fb76b1ab2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:17.676958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1bc4186-7182-46b7-8ee9-5e7fb76b1ab2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:17.685169 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1bc4186-7182-46b7-8ee9-5e7fb76b1ab2 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42" status: 200 len: 1472 microversion: 2.1 time: 0.197477 Mar 12 20:59:17.690277 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2130/2898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:17 2022] GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42 => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:17.826533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1361184963", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "130a8b72-a72f-4d54-af52-13b23a1250ac"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:17.890532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] validate_networks() for [('130a8b72-a72f-4d54-af52-13b23a1250ac', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:59:18.343112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:59:18.343835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:59:18.344512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:59:18.345294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:59:18.345924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:59:18.360944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:18.361800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:18.362242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:18.362678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:18.409641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Getting quotas for project 0c4d74d4abde4a1980632c4260fe2834. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:59:18.417046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Getting quotas for user cb028ec905dc42279c10c3dd9ce8ae34 and project 0c4d74d4abde4a1980632c4260fe2834. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:59:18.444921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Going to run 3 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:59:18.452375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:59:18.489884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 0af92fc6-c1fa-4a32-a0e9-124941433e1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:59:18.540573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=0af92fc6-c1fa-4a32-a0e9-124941433e1b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:59:18.634567 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-57add915-d178-4b44-a2d1-a6c93a8a3239 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947031 Mar 12 20:59:18.635480 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2131/2899] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:59:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:59:18.645751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1a7bba2-7936-47ec-be34-9623ee616691 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:18.646492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a1a7bba2-7936-47ec-be34-9623ee616691 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 326ae42b-a952-4626-b027-90afe2eed7af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:18.659283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1a7bba2-7936-47ec-be34-9623ee616691 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:18.659766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1a7bba2-7936-47ec-be34-9623ee616691 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:18.660766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1a7bba2-7936-47ec-be34-9623ee616691 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:18.661281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1a7bba2-7936-47ec-be34-9623ee616691 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:18.954188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a1a7bba2-7936-47ec-be34-9623ee616691 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:18.967027 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1a7bba2-7936-47ec-be34-9623ee616691 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af" status: 200 len: 1517 microversion: 2.1 time: 0.325320 Mar 12 20:59:18.968013 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2132/2900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:18 2022] GET /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af => generated 1517 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:18.982912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5c388862-439c-43e4-9ff3-b9dc74c8fe87 req-22686411-a3ad-4cd8-b055-9cb51a4b20a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b9fa34-2929-4ab9-b2d8-47c9949331e3", "name": "network-vif-plugged", "status": "completed", "tag": "0a7a0ba6-2990-4f5b-88b1-1cb759ef9585"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:18.993667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5c388862-439c-43e4-9ff3-b9dc74c8fe87 req-22686411-a3ad-4cd8-b055-9cb51a4b20a3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:18.994985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5c388862-439c-43e4-9ff3-b9dc74c8fe87 req-22686411-a3ad-4cd8-b055-9cb51a4b20a3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:19.006658 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5c388862-439c-43e4-9ff3-b9dc74c8fe87 req-22686411-a3ad-4cd8-b055-9cb51a4b20a3 service nova] Creating event network-vif-plugged:0a7a0ba6-2990-4f5b-88b1-1cb759ef9585 for instance b3b9fa34-2929-4ab9-b2d8-47c9949331e3 on nch2-master-1 Mar 12 20:59:19.015598 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5c388862-439c-43e4-9ff3-b9dc74c8fe87 req-22686411-a3ad-4cd8-b055-9cb51a4b20a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042957 Mar 12 20:59:19.016409 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2133/2901] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:19.035952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b2d86464-f5d0-4e9b-8be4-fc2d65361b79 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:19.036921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b2d86464-f5d0-4e9b-8be4-fc2d65361b79 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:19.061881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2d86464-f5d0-4e9b-8be4-fc2d65361b79 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:19.062396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2d86464-f5d0-4e9b-8be4-fc2d65361b79 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:19.063232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2d86464-f5d0-4e9b-8be4-fc2d65361b79 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:19.063820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2d86464-f5d0-4e9b-8be4-fc2d65361b79 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:19.402742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b2d86464-f5d0-4e9b-8be4-fc2d65361b79 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:19.442216 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b2d86464-f5d0-4e9b-8be4-fc2d65361b79 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1321 microversion: 2.1 time: 0.418391 Mar 12 20:59:19.443237 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2134/2902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:19 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:19.459523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fc2bf622-125c-4007-9404-562ffc718295 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:19.460872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fc2bf622-125c-4007-9404-562ffc718295 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:19.468518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc2bf622-125c-4007-9404-562ffc718295 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:19.468946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc2bf622-125c-4007-9404-562ffc718295 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:19.469943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc2bf622-125c-4007-9404-562ffc718295 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:19.470892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc2bf622-125c-4007-9404-562ffc718295 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:19.624543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fc2bf622-125c-4007-9404-562ffc718295 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:19.640082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fc2bf622-125c-4007-9404-562ffc718295 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:19.642619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fc2bf622-125c-4007-9404-562ffc718295 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:19.644965 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fc2bf622-125c-4007-9404-562ffc718295 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1415 microversion: 2.54 time: 0.196694 Mar 12 20:59:19.646170 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2135/2903] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:19 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1415 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:19.651731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71a59dbe-1aa6-4b5a-b10d-e4c7daffedb9 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:19.664875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-71a59dbe-1aa6-4b5a-b10d-e4c7daffedb9 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:19.666527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71a59dbe-1aa6-4b5a-b10d-e4c7daffedb9 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Searching by: {'deleted': False, 'project_id': '0c4d74d4abde4a1980632c4260fe2834'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:19.703330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71a59dbe-1aa6-4b5a-b10d-e4c7daffedb9 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:19.704055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71a59dbe-1aa6-4b5a-b10d-e4c7daffedb9 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:19.705222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71a59dbe-1aa6-4b5a-b10d-e4c7daffedb9 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:19.705940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71a59dbe-1aa6-4b5a-b10d-e4c7daffedb9 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:19.745954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-71a59dbe-1aa6-4b5a-b10d-e4c7daffedb9 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Listed batch of 3 results from cell out of 997 limit. Returned 3 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:59:19.807864 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71a59dbe-1aa6-4b5a-b10d-e4c7daffedb9 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.160213 Mar 12 20:59:19.815275 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2136/2904] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 20:59:19 2022] GET /compute/v2.1/servers => generated 1018 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:19.825209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-494a676d-d7d0-4a61-bc35-46badafd967b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:19.836678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-494a676d-d7d0-4a61-bc35-46badafd967b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 4979bdb6-1c95-4d29-909c-194f16259f42] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:19.855576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-494a676d-d7d0-4a61-bc35-46badafd967b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:19.859508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-494a676d-d7d0-4a61-bc35-46badafd967b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:19.863338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-494a676d-d7d0-4a61-bc35-46badafd967b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:19.864979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-494a676d-d7d0-4a61-bc35-46badafd967b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:19.952111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-494a676d-d7d0-4a61-bc35-46badafd967b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:19.954273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-494a676d-d7d0-4a61-bc35-46badafd967b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:19.955460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-494a676d-d7d0-4a61-bc35-46badafd967b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lazy-loading 'fault' on Instance uuid 4979bdb6-1c95-4d29-909c-194f16259f42 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:59:20.271091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-494a676d-d7d0-4a61-bc35-46badafd967b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3be19bf3aba47d39a3163d43de57c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '642ce33a722143ba8acb0bbbc4d0b46a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:20.286425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-494a676d-d7d0-4a61-bc35-46badafd967b tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42" status: 200 len: 1306 microversion: 2.1 time: 0.469803 Mar 12 20:59:20.288079 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2137/2905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:19 2022] GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42 => generated 1306 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:20.296962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-65b81053-bce0-479b-ae2b-718218b638a5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95a67390-c847-4eb9-8783-620ee1d3b1ae"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:20.299802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-65b81053-bce0-479b-ae2b-718218b638a5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:20.319673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65b81053-bce0-479b-ae2b-718218b638a5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:20.321471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65b81053-bce0-479b-ae2b-718218b638a5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:20.324019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65b81053-bce0-479b-ae2b-718218b638a5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:20.325886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65b81053-bce0-479b-ae2b-718218b638a5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:20.746514 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-65b81053-bce0-479b-ae2b-718218b638a5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "POST /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.455751 Mar 12 20:59:20.773588 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2138/2906] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 20:59:20 2022] POST /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:20.786530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-66f1256f-b2e5-450e-8897-c5bf8e4830da req-d93171e3-8b8f-4188-a137-ca2e71ee7b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4979bdb6-1c95-4d29-909c-194f16259f42", "name": "network-vif-deleted", "tag": "c5c00d27-1c29-43a3-9105-95a81311c350"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:20.818697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-66f1256f-b2e5-450e-8897-c5bf8e4830da req-d93171e3-8b8f-4188-a137-ca2e71ee7b36 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:20.821074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-66f1256f-b2e5-450e-8897-c5bf8e4830da req-d93171e3-8b8f-4188-a137-ca2e71ee7b36 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:20.882949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-66f1256f-b2e5-450e-8897-c5bf8e4830da req-d93171e3-8b8f-4188-a137-ca2e71ee7b36 service nova] Creating event network-vif-deleted:c5c00d27-1c29-43a3-9105-95a81311c350 for instance 4979bdb6-1c95-4d29-909c-194f16259f42 on nch2-master-1 Mar 12 20:59:20.895804 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-66f1256f-b2e5-450e-8897-c5bf8e4830da req-d93171e3-8b8f-4188-a137-ca2e71ee7b36 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117211 Mar 12 20:59:20.898098 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2139/2907] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:20.918535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-74dff52d-32a8-4342-8192-868fa95a0a29 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:20.919478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-74dff52d-32a8-4342-8192-868fa95a0a29 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:20.926291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74dff52d-32a8-4342-8192-868fa95a0a29 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:20.927110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74dff52d-32a8-4342-8192-868fa95a0a29 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:20.931868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74dff52d-32a8-4342-8192-868fa95a0a29 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:20.932791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74dff52d-32a8-4342-8192-868fa95a0a29 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:21.127485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-74dff52d-32a8-4342-8192-868fa95a0a29 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:21.149586 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-74dff52d-32a8-4342-8192-868fa95a0a29 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 200 len: 1275 microversion: 2.1 time: 0.248445 Mar 12 20:59:21.165092 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2140/2908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:20 2022] GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:21.197110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7b0f274-0c81-47e2-a2a7-f61401038fe1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:21.199790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a7b0f274-0c81-47e2-a2a7-f61401038fe1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 326ae42b-a952-4626-b027-90afe2eed7af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:21.226317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7b0f274-0c81-47e2-a2a7-f61401038fe1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:21.226847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7b0f274-0c81-47e2-a2a7-f61401038fe1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:21.228889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7b0f274-0c81-47e2-a2a7-f61401038fe1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:21.229344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7b0f274-0c81-47e2-a2a7-f61401038fe1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:21.361404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7b0f274-0c81-47e2-a2a7-f61401038fe1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:21.363932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7b0f274-0c81-47e2-a2a7-f61401038fe1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:21.364469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-a7b0f274-0c81-47e2-a2a7-f61401038fe1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lazy-loading 'fault' on Instance uuid 326ae42b-a952-4626-b027-90afe2eed7af {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:59:21.489645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a7b0f274-0c81-47e2-a2a7-f61401038fe1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:21.516434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7b0f274-0c81-47e2-a2a7-f61401038fe1 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af" status: 200 len: 1310 microversion: 2.1 time: 0.349600 Mar 12 20:59:21.528236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2141/2909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:21 2022] GET /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af => generated 1310 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:21.536051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dabae295-ac7c-44d2-a430-ef68958bae8d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:21.538823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dabae295-ac7c-44d2-a430-ef68958bae8d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:21.548535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dabae295-ac7c-44d2-a430-ef68958bae8d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:21.550026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dabae295-ac7c-44d2-a430-ef68958bae8d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:21.550143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dabae295-ac7c-44d2-a430-ef68958bae8d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:21.551821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dabae295-ac7c-44d2-a430-ef68958bae8d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:21.863611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dabae295-ac7c-44d2-a430-ef68958bae8d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:21.872383 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dabae295-ac7c-44d2-a430-ef68958bae8d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1321 microversion: 2.1 time: 0.343521 Mar 12 20:59:21.873356 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2142/2910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:21 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:21.878144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5fb082f3-4ce5-4588-94f4-bd44f7962fc2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:21.878941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5fb082f3-4ce5-4588-94f4-bd44f7962fc2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:21.886582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fb082f3-4ce5-4588-94f4-bd44f7962fc2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:21.887325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fb082f3-4ce5-4588-94f4-bd44f7962fc2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:21.888101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fb082f3-4ce5-4588-94f4-bd44f7962fc2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:21.888697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fb082f3-4ce5-4588-94f4-bd44f7962fc2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:21.971309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5fb082f3-4ce5-4588-94f4-bd44f7962fc2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:21.982121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5fb082f3-4ce5-4588-94f4-bd44f7962fc2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:21.984784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5fb082f3-4ce5-4588-94f4-bd44f7962fc2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:21.986232 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5fb082f3-4ce5-4588-94f4-bd44f7962fc2 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1400 microversion: 2.54 time: 0.111604 Mar 12 20:59:21.993419 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2143/2911] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:21 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1400 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:21.999041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca591692-a718-47b0-b416-2ca6e8d8d2a1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:22.000893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ca591692-a718-47b0-b416-2ca6e8d8d2a1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] [instance: 4979bdb6-1c95-4d29-909c-194f16259f42] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:22.008369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca591692-a718-47b0-b416-2ca6e8d8d2a1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.008990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca591692-a718-47b0-b416-2ca6e8d8d2a1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.010353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca591692-a718-47b0-b416-2ca6e8d8d2a1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.010935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca591692-a718-47b0-b416-2ca6e8d8d2a1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.025392 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ca591692-a718-47b0-b416-2ca6e8d8d2a1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] HTTP exception thrown: Instance 4979bdb6-1c95-4d29-909c-194f16259f42 could not be found. Mar 12 20:59:22.026265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca591692-a718-47b0-b416-2ca6e8d8d2a1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] Returning 404 to user: Instance 4979bdb6-1c95-4d29-909c-194f16259f42 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:22.027257 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca591692-a718-47b0-b416-2ca6e8d8d2a1 tempest-ServersOnMultiNodesTest-1757887912 tempest-ServersOnMultiNodesTest-1757887912-project] 10.222.0.30 "GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42" status: 404 len: 111 microversion: 2.1 time: 0.039153 Mar 12 20:59:22.028264 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2144/2912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:21 2022] GET /compute/v2.1/servers/4979bdb6-1c95-4d29-909c-194f16259f42 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:22.040373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c6b8d776-29cb-430c-8d35-da1433f05203 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '.version_select at 0x7f6e37384940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:22.063057 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c6b8d776-29cb-430c-8d35-da1433f05203 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1658138823" status: 204 len: 0 microversion: 2.54 time: 0.033378 Mar 12 20:59:22.064669 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2145/2913] 10.222.0.30 () {60 vars in 1318 bytes} [Sat Mar 12 20:59:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1658138823 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:59:22.082554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-986d38ce-f8fa-461f-a264-e8b25e1bb60c tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:22.083371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-986d38ce-f8fa-461f-a264-e8b25e1bb60c tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:22.098205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-986d38ce-f8fa-461f-a264-e8b25e1bb60c tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.099485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-986d38ce-f8fa-461f-a264-e8b25e1bb60c tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.101008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-986d38ce-f8fa-461f-a264-e8b25e1bb60c tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.101945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-986d38ce-f8fa-461f-a264-e8b25e1bb60c tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.135838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-986d38ce-f8fa-461f-a264-e8b25e1bb60c tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:22.254266 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-986d38ce-f8fa-461f-a264-e8b25e1bb60c tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 204 len: 0 microversion: 2.54 time: 0.177086 Mar 12 20:59:22.255087 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2146/2914] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 20:59:22 2022] DELETE /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 20:59:22.262811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33f9f89a-b9ba-415a-b701-590dc5b298f8 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:22.263665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-33f9f89a-b9ba-415a-b701-590dc5b298f8 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:22.274942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33f9f89a-b9ba-415a-b701-590dc5b298f8 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.275533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33f9f89a-b9ba-415a-b701-590dc5b298f8 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.276362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33f9f89a-b9ba-415a-b701-590dc5b298f8 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.276803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33f9f89a-b9ba-415a-b701-590dc5b298f8 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.386712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-33f9f89a-b9ba-415a-b701-590dc5b298f8 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:22.405215 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-33f9f89a-b9ba-415a-b701-590dc5b298f8 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 200 len: 1281 microversion: 2.1 time: 0.148209 Mar 12 20:59:22.408423 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2147/2915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:22 2022] GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 1281 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:22.434725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3dfb13bc-79d9-446e-ae2e-7f25c017b055 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:22.435292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3dfb13bc-79d9-446e-ae2e-7f25c017b055 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:22.453466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3dfb13bc-79d9-446e-ae2e-7f25c017b055 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.454245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3dfb13bc-79d9-446e-ae2e-7f25c017b055 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.455171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3dfb13bc-79d9-446e-ae2e-7f25c017b055 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.456298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3dfb13bc-79d9-446e-ae2e-7f25c017b055 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.586501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3dfb13bc-79d9-446e-ae2e-7f25c017b055 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:22.604874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3dfb13bc-79d9-446e-ae2e-7f25c017b055 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:22.614287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3dfb13bc-79d9-446e-ae2e-7f25c017b055 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '985be91b88ee41e89276a53862cc9608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c51d49e3d6042e7b611423e7253c48d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:22.615335 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3dfb13bc-79d9-446e-ae2e-7f25c017b055 tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 200 len: 1406 microversion: 2.54 time: 0.205341 Mar 12 20:59:22.615609 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2148/2916] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:22 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 20:59:22.632153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-528f54e5-e864-41cb-bda9-4f557cdea153 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:22.633932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-528f54e5-e864-41cb-bda9-4f557cdea153 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 326ae42b-a952-4626-b027-90afe2eed7af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:22.650856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-528f54e5-e864-41cb-bda9-4f557cdea153 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.651564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-528f54e5-e864-41cb-bda9-4f557cdea153 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.652608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-528f54e5-e864-41cb-bda9-4f557cdea153 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.653441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-528f54e5-e864-41cb-bda9-4f557cdea153 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.670920 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-528f54e5-e864-41cb-bda9-4f557cdea153 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] HTTP exception thrown: Instance 326ae42b-a952-4626-b027-90afe2eed7af could not be found. Mar 12 20:59:22.671721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-528f54e5-e864-41cb-bda9-4f557cdea153 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Returning 404 to user: Instance 326ae42b-a952-4626-b027-90afe2eed7af could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:22.672824 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-528f54e5-e864-41cb-bda9-4f557cdea153 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af" status: 404 len: 111 microversion: 2.1 time: 0.054239 Mar 12 20:59:22.673841 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2149/2917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:22 2022] GET /compute/v2.1/servers/326ae42b-a952-4626-b027-90afe2eed7af => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:22.683078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1e347e36-a637-4e65-a01c-249f437badef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:22.683725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1e347e36-a637-4e65-a01c-249f437badef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:22.692021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e347e36-a637-4e65-a01c-249f437badef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.692547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e347e36-a637-4e65-a01c-249f437badef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.693448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e347e36-a637-4e65-a01c-249f437badef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.694383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e347e36-a637-4e65-a01c-249f437badef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.730279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1e347e36-a637-4e65-a01c-249f437badef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:22.865097 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1e347e36-a637-4e65-a01c-249f437badef tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 204 len: 0 microversion: 2.1 time: 0.186820 Mar 12 20:59:22.866842 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2150/2918] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:22 2022] DELETE /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 20:59:22.876750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-067e05f9-627b-4efb-bc49-e2d294848f40 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:22.878051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-067e05f9-627b-4efb-bc49-e2d294848f40 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:22.889017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-067e05f9-627b-4efb-bc49-e2d294848f40 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.889610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-067e05f9-627b-4efb-bc49-e2d294848f40 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:22.890780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-067e05f9-627b-4efb-bc49-e2d294848f40 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:22.891527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-067e05f9-627b-4efb-bc49-e2d294848f40 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:23.265899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-067e05f9-627b-4efb-bc49-e2d294848f40 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:23.273685 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-067e05f9-627b-4efb-bc49-e2d294848f40 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1518 microversion: 2.1 time: 0.401870 Mar 12 20:59:23.274308 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2151/2919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:22 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1518 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:23.285091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ccb10991-6084-4d60-90bd-beda113722f4 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:23.285711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ccb10991-6084-4d60-90bd-beda113722f4 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:23.293980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccb10991-6084-4d60-90bd-beda113722f4 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:23.294536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccb10991-6084-4d60-90bd-beda113722f4 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:23.296392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccb10991-6084-4d60-90bd-beda113722f4 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:23.296970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccb10991-6084-4d60-90bd-beda113722f4 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:23.915326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ccb10991-6084-4d60-90bd-beda113722f4 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:23.924149 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ccb10991-6084-4d60-90bd-beda113722f4 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1321 microversion: 2.1 time: 0.648795 Mar 12 20:59:23.936023 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2152/2920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:23 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1321 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:23.940863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5c709c44-8285-4fd6-95cd-5c43602f408f req-95e3333c-13d9-4ce0-b02c-55c0ef3402a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "326ae42b-a952-4626-b027-90afe2eed7af", "name": "network-vif-deleted", "tag": "fa889e48-e7a7-41ed-8296-e78010afb112"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:23.949262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5c709c44-8285-4fd6-95cd-5c43602f408f req-95e3333c-13d9-4ce0-b02c-55c0ef3402a6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:23.950004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5c709c44-8285-4fd6-95cd-5c43602f408f req-95e3333c-13d9-4ce0-b02c-55c0ef3402a6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:23.961924 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5c709c44-8285-4fd6-95cd-5c43602f408f req-95e3333c-13d9-4ce0-b02c-55c0ef3402a6 service nova] Creating event network-vif-deleted:fa889e48-e7a7-41ed-8296-e78010afb112 for instance 326ae42b-a952-4626-b027-90afe2eed7af on nch1-master-1 Mar 12 20:59:23.967344 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5c709c44-8285-4fd6-95cd-5c43602f408f req-95e3333c-13d9-4ce0-b02c-55c0ef3402a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029972 Mar 12 20:59:23.968392 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2153/2921] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:23.973908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aad5db9f-4c62-40f8-ab1d-1067295e6433 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:23.974968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aad5db9f-4c62-40f8-ab1d-1067295e6433 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:23.983103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aad5db9f-4c62-40f8-ab1d-1067295e6433 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:23.983555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aad5db9f-4c62-40f8-ab1d-1067295e6433 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:23.984328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aad5db9f-4c62-40f8-ab1d-1067295e6433 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:23.985101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aad5db9f-4c62-40f8-ab1d-1067295e6433 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:24.385036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aad5db9f-4c62-40f8-ab1d-1067295e6433 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:24.394801 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aad5db9f-4c62-40f8-ab1d-1067295e6433 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 200 len: 1323 microversion: 2.1 time: 0.425011 Mar 12 20:59:24.398815 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2154/2922] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:23 2022] GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 1323 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:24.807614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7ae216a0-fd39-451e-8de4-942459ba243a tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Action: 'create', calling method: .version_select at 0x7f6e3716fca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1915648721"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:25.228217 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7ae216a0-fd39-451e-8de4-942459ba243a tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.827862 Mar 12 20:59:25.229046 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2155/2923] 10.222.0.30 () {60 vars in 1154 bytes} [Sat Mar 12 20:59:24 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 830 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 12 20:59:25.235754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e52739ca-121e-4bd5-8184-e8f99ebbdbdc tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:25.236534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e52739ca-121e-4bd5-8184-e8f99ebbdbdc tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] [instance: b9eed3cd-8249-45ad-86df-f2346dcb496e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:25.244466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e52739ca-121e-4bd5-8184-e8f99ebbdbdc tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:25.245203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e52739ca-121e-4bd5-8184-e8f99ebbdbdc tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:25.246341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e52739ca-121e-4bd5-8184-e8f99ebbdbdc tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:25.247280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e52739ca-121e-4bd5-8184-e8f99ebbdbdc tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:25.265229 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e52739ca-121e-4bd5-8184-e8f99ebbdbdc tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] HTTP exception thrown: Instance b9eed3cd-8249-45ad-86df-f2346dcb496e could not be found. Mar 12 20:59:25.265878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e52739ca-121e-4bd5-8184-e8f99ebbdbdc tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] Returning 404 to user: Instance b9eed3cd-8249-45ad-86df-f2346dcb496e could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:25.266779 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e52739ca-121e-4bd5-8184-e8f99ebbdbdc tempest-ServerShowV254Test-2058219214 tempest-ServerShowV254Test-2058219214-project] 10.222.0.30 "GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e" status: 404 len: 111 microversion: 2.54 time: 0.036789 Mar 12 20:59:25.270593 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2156/2924] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 20:59:25 2022] GET /compute/v2.1/servers/b9eed3cd-8249-45ad-86df-f2346dcb496e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:59:25.276911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-439568d2-b58d-4dac-9ef2-647b9d6ab1b5 req-4e3dd067-86e5-4664-a731-ed8aefbdc78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af92fc6-c1fa-4a32-a0e9-124941433e1b", "tag": "4db3d0df-df75-4593-bf71-d04925ab9a0f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:25.290879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-439568d2-b58d-4dac-9ef2-647b9d6ab1b5 req-4e3dd067-86e5-4664-a731-ed8aefbdc78e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:25.292430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-439568d2-b58d-4dac-9ef2-647b9d6ab1b5 req-4e3dd067-86e5-4664-a731-ed8aefbdc78e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:25.319871 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-439568d2-b58d-4dac-9ef2-647b9d6ab1b5 req-4e3dd067-86e5-4664-a731-ed8aefbdc78e service nova] Creating event network-changed:4db3d0df-df75-4593-bf71-d04925ab9a0f for instance 0af92fc6-c1fa-4a32-a0e9-124941433e1b on nch1-master-1 Mar 12 20:59:25.335725 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-439568d2-b58d-4dac-9ef2-647b9d6ab1b5 req-4e3dd067-86e5-4664-a731-ed8aefbdc78e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063268 Mar 12 20:59:25.336421 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2157/2925] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:25.353712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dae15345-7662-4908-a7de-9ddc9cf81bf6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:25.368167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dae15345-7662-4908-a7de-9ddc9cf81bf6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:25.368624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dae15345-7662-4908-a7de-9ddc9cf81bf6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:25.426986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dae15345-7662-4908-a7de-9ddc9cf81bf6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Going to try to stop instance {{(pid=136302) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 12 20:59:25.494307 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dae15345-7662-4908-a7de-9ddc9cf81bf6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "POST /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/action" status: 202 len: 0 microversion: 2.1 time: 0.155511 Mar 12 20:59:25.496827 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2158/2926] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:59:25 2022] POST /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:59:25.520884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5d9a7ded-44c8-4e70-b863-abda70357ffe req-2e388994-8c74-4d9f-8810-1f001063703a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd233007-740a-4bd4-b786-eb46e987f98a", "name": "network-vif-plugged", "status": "completed", "tag": "30f641b5-fdf0-46de-90c3-cd66179d2e9e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:25.541222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5d9a7ded-44c8-4e70-b863-abda70357ffe req-2e388994-8c74-4d9f-8810-1f001063703a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:25.543323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5d9a7ded-44c8-4e70-b863-abda70357ffe req-2e388994-8c74-4d9f-8810-1f001063703a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:25.564821 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5d9a7ded-44c8-4e70-b863-abda70357ffe req-2e388994-8c74-4d9f-8810-1f001063703a service nova] Creating event network-vif-plugged:30f641b5-fdf0-46de-90c3-cd66179d2e9e for instance dd233007-740a-4bd4-b786-eb46e987f98a on nch1-master-1 Mar 12 20:59:25.575073 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5d9a7ded-44c8-4e70-b863-abda70357ffe req-2e388994-8c74-4d9f-8810-1f001063703a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063744 Mar 12 20:59:25.579442 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2159/2927] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:25.589339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-48eca9da-a9d8-432a-bf91-d34796582001 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:25.593889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-48eca9da-a9d8-432a-bf91-d34796582001 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:25.604605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48eca9da-a9d8-432a-bf91-d34796582001 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:25.605270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48eca9da-a9d8-432a-bf91-d34796582001 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:25.606585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48eca9da-a9d8-432a-bf91-d34796582001 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:25.607951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48eca9da-a9d8-432a-bf91-d34796582001 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:25.870952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-48eca9da-a9d8-432a-bf91-d34796582001 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4be5e0b42c345288554763a59b7a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ff5395a6a5454a8ea72a2746c2b196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:25.879817 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-48eca9da-a9d8-432a-bf91-d34796582001 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 200 len: 1518 microversion: 2.1 time: 0.299161 Mar 12 20:59:25.881223 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2160/2928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:25 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 1518 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:25.886211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d71338c-c0f6-43cc-bb15-028cca859651 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:25.887683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8d71338c-c0f6-43cc-bb15-028cca859651 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:25.898096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d71338c-c0f6-43cc-bb15-028cca859651 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:25.898993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d71338c-c0f6-43cc-bb15-028cca859651 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:25.899992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d71338c-c0f6-43cc-bb15-028cca859651 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:25.900708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d71338c-c0f6-43cc-bb15-028cca859651 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:26.150005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d71338c-c0f6-43cc-bb15-028cca859651 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:26.161127 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d71338c-c0f6-43cc-bb15-028cca859651 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1321 microversion: 2.1 time: 0.278077 Mar 12 20:59:26.162889 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2161/2929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:25 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:26.171408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-15d0bdfd-a2f5-4e84-b884-f2ef4457bb28 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Calling method '.version_select at 0x7f6e370934c0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:26.247316 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-15d0bdfd-a2f5-4e84-b884-f2ef4457bb28 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4ab8a844-ffba-4215-bb18-002b14927dd6" status: 200 len: 339 microversion: 2.1 time: 0.083189 Mar 12 20:59:26.247899 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2162/2930] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 20:59:26 2022] GET /compute/v2.1/os-volumes/4ab8a844-ffba-4215-bb18-002b14927dd6 => generated 339 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:26.252805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a077e640-1bb2-4725-ae02-9f6ffb9cfb0d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:26.253574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a077e640-1bb2-4725-ae02-9f6ffb9cfb0d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:26.267593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a077e640-1bb2-4725-ae02-9f6ffb9cfb0d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:26.268041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a077e640-1bb2-4725-ae02-9f6ffb9cfb0d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:26.268823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a077e640-1bb2-4725-ae02-9f6ffb9cfb0d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:26.269260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a077e640-1bb2-4725-ae02-9f6ffb9cfb0d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:26.595793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a077e640-1bb2-4725-ae02-9f6ffb9cfb0d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:26.606570 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a077e640-1bb2-4725-ae02-9f6ffb9cfb0d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 200 len: 1323 microversion: 2.1 time: 0.357233 Mar 12 20:59:26.607639 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2163/2931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:26 2022] GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 1323 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:26.612685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-06f0dc52-1913-4d93-9123-b356962daa17 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:26.613507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-06f0dc52-1913-4d93-9123-b356962daa17 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:26.620204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06f0dc52-1913-4d93-9123-b356962daa17 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:26.620775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06f0dc52-1913-4d93-9123-b356962daa17 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:26.621686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06f0dc52-1913-4d93-9123-b356962daa17 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:26.622260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06f0dc52-1913-4d93-9123-b356962daa17 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:26.890329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-06f0dc52-1913-4d93-9123-b356962daa17 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:26.907286 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-06f0dc52-1913-4d93-9123-b356962daa17 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1724 microversion: 2.1 time: 0.298203 Mar 12 20:59:26.908550 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2164/2932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:26 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:26.916806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e8962e04-840c-44fa-8449-79438ce2e107 req-87964852-8fc2-442d-b7ca-6a025b529bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9", "tag": "8bddb0f5-9be4-42c4-8bec-0437f01a5ecc"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:26.929591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e8962e04-840c-44fa-8449-79438ce2e107 req-87964852-8fc2-442d-b7ca-6a025b529bba service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:26.931247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e8962e04-840c-44fa-8449-79438ce2e107 req-87964852-8fc2-442d-b7ca-6a025b529bba service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:26.945315 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e8962e04-840c-44fa-8449-79438ce2e107 req-87964852-8fc2-442d-b7ca-6a025b529bba service nova] Creating event network-changed:8bddb0f5-9be4-42c4-8bec-0437f01a5ecc for instance c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 on nch2-master-1 Mar 12 20:59:26.952074 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e8962e04-840c-44fa-8449-79438ce2e107 req-87964852-8fc2-442d-b7ca-6a025b529bba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040059 Mar 12 20:59:26.960551 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2165/2933] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:26.968543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a5f2c12f-9632-4afd-8dee-001cc0d49820 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Action: 'create', calling method: .version_select at 0x7f6e373653a0>, body: {"snapshot": {"volume_id": "4ab8a844-ffba-4215-bb18-002b14927dd6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-574060697"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:27.229471 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a5f2c12f-9632-4afd-8dee-001cc0d49820 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.267590 Mar 12 20:59:27.236140 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2166/2934] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Mar 12 20:59:26 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:27.244581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-465afc21-06b0-459e-a4a4-48371f36cb32 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:27.247764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-465afc21-06b0-459e-a4a4-48371f36cb32 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] [instance: 460d935d-1340-4a97-8a3f-16a589c5d9c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:27.264517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-465afc21-06b0-459e-a4a4-48371f36cb32 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:27.265290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-465afc21-06b0-459e-a4a4-48371f36cb32 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:27.268501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-465afc21-06b0-459e-a4a4-48371f36cb32 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:27.269897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-465afc21-06b0-459e-a4a4-48371f36cb32 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:27.303479 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-465afc21-06b0-459e-a4a4-48371f36cb32 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] HTTP exception thrown: Instance 460d935d-1340-4a97-8a3f-16a589c5d9c2 could not be found. Mar 12 20:59:27.305222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-465afc21-06b0-459e-a4a4-48371f36cb32 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] Returning 404 to user: Instance 460d935d-1340-4a97-8a3f-16a589c5d9c2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:27.307151 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-465afc21-06b0-459e-a4a4-48371f36cb32 tempest-ListServerFiltersTestJSON-976159740 tempest-ListServerFiltersTestJSON-976159740-project] 10.222.0.30 "GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2" status: 404 len: 111 microversion: 2.1 time: 0.069286 Mar 12 20:59:27.308949 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2167/2935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:27 2022] GET /compute/v2.1/servers/460d935d-1340-4a97-8a3f-16a589c5d9c2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:27.331369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc5e0317-fb03-45ed-94d9-8e1ef99272bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:27.333804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc5e0317-fb03-45ed-94d9-8e1ef99272bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:27.352124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc5e0317-fb03-45ed-94d9-8e1ef99272bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:27.354145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc5e0317-fb03-45ed-94d9-8e1ef99272bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:27.357077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc5e0317-fb03-45ed-94d9-8e1ef99272bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:27.357353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc5e0317-fb03-45ed-94d9-8e1ef99272bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:27.788207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dc5e0317-fb03-45ed-94d9-8e1ef99272bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:27.798998 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc5e0317-fb03-45ed-94d9-8e1ef99272bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1321 microversion: 2.1 time: 0.487954 Mar 12 20:59:27.800002 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2168/2936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:27 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:27.807239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6353a857-acca-40b4-929b-0ed309ef7492 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Calling method '.version_select at 0x7f6e370d9b80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:27.922882 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6353a857-acca-40b4-929b-0ed309ef7492 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5947feaa-49fb-417e-9482-6b71436149c3" status: 200 len: 287 microversion: 2.1 time: 0.121519 Mar 12 20:59:27.923694 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2169/2937] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Mar 12 20:59:27 2022] GET /compute/v2.1/os-snapshots/5947feaa-49fb-417e-9482-6b71436149c3 => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:27.929729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f7fefdf4-1efc-4f6a-890e-f7dacbbbc1ec req-f81dcebd-cdfc-4de3-9245-3d6a29d03c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3", "tag": "e65503ae-b942-4b25-bf05-a2df74b1e90c"}, {"server_uuid": "460d935d-1340-4a97-8a3f-16a589c5d9c2", "name": "network-vif-deleted", "tag": "6c4c4034-d1c8-4fc0-a67f-2c2cc7c8495b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:27.954307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f7fefdf4-1efc-4f6a-890e-f7dacbbbc1ec req-f81dcebd-cdfc-4de3-9245-3d6a29d03c13 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:27.954766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f7fefdf4-1efc-4f6a-890e-f7dacbbbc1ec req-f81dcebd-cdfc-4de3-9245-3d6a29d03c13 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:27.968018 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f7fefdf4-1efc-4f6a-890e-f7dacbbbc1ec req-f81dcebd-cdfc-4de3-9245-3d6a29d03c13 service nova] Creating event network-changed:e65503ae-b942-4b25-bf05-a2df74b1e90c for instance 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 on nch2-master-1 Mar 12 20:59:27.968539 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f7fefdf4-1efc-4f6a-890e-f7dacbbbc1ec req-f81dcebd-cdfc-4de3-9245-3d6a29d03c13 service nova] Creating event network-vif-deleted:6c4c4034-d1c8-4fc0-a67f-2c2cc7c8495b for instance 460d935d-1340-4a97-8a3f-16a589c5d9c2 on nch2-master-1 Mar 12 20:59:27.994161 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f7fefdf4-1efc-4f6a-890e-f7dacbbbc1ec req-f81dcebd-cdfc-4de3-9245-3d6a29d03c13 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.068642 Mar 12 20:59:27.995399 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2170/2938] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:28.000777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c13a81bb-4c66-41ee-a03e-71723b4ef4dd tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:28.005378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c13a81bb-4c66-41ee-a03e-71723b4ef4dd tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:28.021658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c13a81bb-4c66-41ee-a03e-71723b4ef4dd tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:28.022209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c13a81bb-4c66-41ee-a03e-71723b4ef4dd tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:28.022999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c13a81bb-4c66-41ee-a03e-71723b4ef4dd tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:28.023449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c13a81bb-4c66-41ee-a03e-71723b4ef4dd tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:28.300626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c13a81bb-4c66-41ee-a03e-71723b4ef4dd tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:28.310726 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c13a81bb-4c66-41ee-a03e-71723b4ef4dd tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 200 len: 1323 microversion: 2.1 time: 0.313938 Mar 12 20:59:28.317177 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2171/2939] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:27 2022] GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 1323 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:28.327036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-17730e98-9fe2-4ea6-9019-66a39629f4d9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:28.327613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-17730e98-9fe2-4ea6-9019-66a39629f4d9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:28.336490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17730e98-9fe2-4ea6-9019-66a39629f4d9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:28.336940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17730e98-9fe2-4ea6-9019-66a39629f4d9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:28.337721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17730e98-9fe2-4ea6-9019-66a39629f4d9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:28.338213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17730e98-9fe2-4ea6-9019-66a39629f4d9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:28.709264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-17730e98-9fe2-4ea6-9019-66a39629f4d9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:28.722816 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-17730e98-9fe2-4ea6-9019-66a39629f4d9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1724 microversion: 2.1 time: 0.401588 Mar 12 20:59:28.726387 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2172/2940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:28 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:28.735537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4e95fa96-772d-480d-8484-271cee8f1fbd tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Calling method '.version_select at 0x7f6e44020670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:28.870614 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4e95fa96-772d-480d-8484-271cee8f1fbd tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.142942 Mar 12 20:59:28.871404 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2173/2941] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Mar 12 20:59:28 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:28.880313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-921dfc0d-224a-4ed5-b815-87c579a4377c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:28.880903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-921dfc0d-224a-4ed5-b815-87c579a4377c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:28.907227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-921dfc0d-224a-4ed5-b815-87c579a4377c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:28.907775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-921dfc0d-224a-4ed5-b815-87c579a4377c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:28.908617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-921dfc0d-224a-4ed5-b815-87c579a4377c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:28.909059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-921dfc0d-224a-4ed5-b815-87c579a4377c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:29.199422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-921dfc0d-224a-4ed5-b815-87c579a4377c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:29.206852 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-921dfc0d-224a-4ed5-b815-87c579a4377c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1515 microversion: 2.1 time: 0.334373 Mar 12 20:59:29.207430 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2174/2942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:28 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1515 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:29.218922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25118d76-dbbb-415c-84ea-95bcc7f71c5b tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Calling method '.version_select at 0x7f6e376cf670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:29.259977 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-25118d76-dbbb-415c-84ea-95bcc7f71c5b tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5947feaa-49fb-417e-9482-6b71436149c3" status: 200 len: 287 microversion: 2.1 time: 0.044692 Mar 12 20:59:29.261839 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2175/2943] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Mar 12 20:59:29 2022] GET /compute/v2.1/os-snapshots/5947feaa-49fb-417e-9482-6b71436149c3 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:29.267010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-64b244bb-8881-4127-ab8c-3e1119f4b696 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:29.268020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-64b244bb-8881-4127-ab8c-3e1119f4b696 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:29.274779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64b244bb-8881-4127-ab8c-3e1119f4b696 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:29.275379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64b244bb-8881-4127-ab8c-3e1119f4b696 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:29.276166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64b244bb-8881-4127-ab8c-3e1119f4b696 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:29.284354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64b244bb-8881-4127-ab8c-3e1119f4b696 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:29.334122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-64b244bb-8881-4127-ab8c-3e1119f4b696 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lazy-loading 'flavor' on Instance uuid dd233007-740a-4bd4-b786-eb46e987f98a {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 20:59:29.479240 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-64b244bb-8881-4127-ab8c-3e1119f4b696 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a/action" status: 200 len: 32 microversion: 2.1 time: 0.215543 Mar 12 20:59:29.480471 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2176/2944] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:59:29 2022] POST /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:59:29.489826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6bc20bb4-fe8a-451b-8498-d95de8210a47 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Calling method '.version_select at 0x7f6e37688f70>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:29.599070 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6bc20bb4-fe8a-451b-8498-d95de8210a47 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/5947feaa-49fb-417e-9482-6b71436149c3" status: 202 len: 0 microversion: 2.1 time: 0.116884 Mar 12 20:59:29.599898 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2177/2945] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Mar 12 20:59:29 2022] DELETE /compute/v2.1/os-snapshots/5947feaa-49fb-417e-9482-6b71436149c3 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:59:29.605729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4d650b05-da46-400f-a000-283678277522 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:29.607138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4d650b05-da46-400f-a000-283678277522 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:29.623384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d650b05-da46-400f-a000-283678277522 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:29.624131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d650b05-da46-400f-a000-283678277522 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:29.625253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d650b05-da46-400f-a000-283678277522 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:29.625913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d650b05-da46-400f-a000-283678277522 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:29.889462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4d650b05-da46-400f-a000-283678277522 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:29.899696 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4d650b05-da46-400f-a000-283678277522 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 200 len: 1323 microversion: 2.1 time: 0.297532 Mar 12 20:59:29.902255 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2178/2946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:29 2022] GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 1323 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:29.915304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f1c8199-631e-4b1a-a0e4-4edb675a189e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:29.918772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f1c8199-631e-4b1a-a0e4-4edb675a189e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:29.940252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f1c8199-631e-4b1a-a0e4-4edb675a189e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:29.941382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f1c8199-631e-4b1a-a0e4-4edb675a189e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:29.944039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f1c8199-631e-4b1a-a0e4-4edb675a189e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:29.944658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f1c8199-631e-4b1a-a0e4-4edb675a189e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:30.195227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8f1c8199-631e-4b1a-a0e4-4edb675a189e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:30.203838 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f1c8199-631e-4b1a-a0e4-4edb675a189e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.299590 Mar 12 20:59:30.204618 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2179/2947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:29 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:30.220830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-384ac429-2187-49f3-bfde-fe334cd42f1c tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Calling method '.version_select at 0x7f6e441a3e50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:30.261417 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-384ac429-2187-49f3-bfde-fe334cd42f1c tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5947feaa-49fb-417e-9482-6b71436149c3" status: 200 len: 286 microversion: 2.1 time: 0.054419 Mar 12 20:59:30.262316 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2180/2948] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Mar 12 20:59:30 2022] GET /compute/v2.1/os-snapshots/5947feaa-49fb-417e-9482-6b71436149c3 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:30.267465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c90c25f3-0b02-4873-bc4d-f699ffe715e2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:30.268292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c90c25f3-0b02-4873-bc4d-f699ffe715e2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:30.279201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c90c25f3-0b02-4873-bc4d-f699ffe715e2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:30.286330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c90c25f3-0b02-4873-bc4d-f699ffe715e2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:30.288405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c90c25f3-0b02-4873-bc4d-f699ffe715e2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:30.288894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c90c25f3-0b02-4873-bc4d-f699ffe715e2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:30.627398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c90c25f3-0b02-4873-bc4d-f699ffe715e2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:30.640507 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c90c25f3-0b02-4873-bc4d-f699ffe715e2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1724 microversion: 2.1 time: 0.376901 Mar 12 20:59:30.655652 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2181/2949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:30 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1724 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:30.920426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc3cb8a0-53fc-42f2-a914-6e339d288f9d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:30.921051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc3cb8a0-53fc-42f2-a914-6e339d288f9d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:30.928115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc3cb8a0-53fc-42f2-a914-6e339d288f9d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:30.929028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc3cb8a0-53fc-42f2-a914-6e339d288f9d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:30.930016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc3cb8a0-53fc-42f2-a914-6e339d288f9d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:30.930609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc3cb8a0-53fc-42f2-a914-6e339d288f9d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:31.150662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc3cb8a0-53fc-42f2-a914-6e339d288f9d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:31.159551 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc3cb8a0-53fc-42f2-a914-6e339d288f9d tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 200 len: 1323 microversion: 2.1 time: 0.243284 Mar 12 20:59:31.164106 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2182/2950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:30 2022] GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 1323 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:31.227005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b7766be-4aa2-47a8-a272-064d606d1d54 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:31.228672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b7766be-4aa2-47a8-a272-064d606d1d54 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:31.245857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b7766be-4aa2-47a8-a272-064d606d1d54 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:31.247671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b7766be-4aa2-47a8-a272-064d606d1d54 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:31.249174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b7766be-4aa2-47a8-a272-064d606d1d54 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:31.251790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b7766be-4aa2-47a8-a272-064d606d1d54 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:31.534504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b7766be-4aa2-47a8-a272-064d606d1d54 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:31.546106 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b7766be-4aa2-47a8-a272-064d606d1d54 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.325617 Mar 12 20:59:31.549367 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2183/2951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:31 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 20:59:31.562214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e07aebb-f2c7-4144-9ff0-1d950d19eeb3 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Calling method '.version_select at 0x7f6e3731a430>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:31.596381 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-5e07aebb-f2c7-4144-9ff0-1d950d19eeb3 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] HTTP exception thrown: Snapshot 5947feaa-49fb-417e-9482-6b71436149c3 could not be found. Mar 12 20:59:31.596986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e07aebb-f2c7-4144-9ff0-1d950d19eeb3 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Returning 404 to user: Snapshot 5947feaa-49fb-417e-9482-6b71436149c3 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:31.598331 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e07aebb-f2c7-4144-9ff0-1d950d19eeb3 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5947feaa-49fb-417e-9482-6b71436149c3" status: 404 len: 111 microversion: 2.1 time: 0.047306 Mar 12 20:59:31.599811 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2184/2952] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Mar 12 20:59:31 2022] GET /compute/v2.1/os-snapshots/5947feaa-49fb-417e-9482-6b71436149c3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:31.607606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f600522c-af14-4d5c-b778-d85b5ef09b9d tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Calling method '.version_select at 0x7f6e37487e50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:31.710949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f600522c-af14-4d5c-b778-d85b5ef09b9d tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/4ab8a844-ffba-4215-bb18-002b14927dd6" status: 202 len: 0 microversion: 2.1 time: 0.107554 Mar 12 20:59:31.712180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2185/2953] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 20:59:31 2022] DELETE /compute/v2.1/os-volumes/4ab8a844-ffba-4215-bb18-002b14927dd6 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 20:59:32.070618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99a752dd-7da2-4ee2-aa42-361e09c49bce tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-953350847", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:32.075346 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-99a752dd-7da2-4ee2-aa42-361e09c49bce tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] HTTP exception thrown: min_count must be <= max_count Mar 12 20:59:32.076334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99a752dd-7da2-4ee2-aa42-361e09c49bce tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] Returning 400 to user: min_count must be <= max_count {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:32.077317 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99a752dd-7da2-4ee2-aa42-361e09c49bce tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.362616 Mar 12 20:59:32.078428 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2186/2954] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:59:31 2022] POST /compute/v2.1/servers => generated 74 bytes in 365 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 12 20:59:32.088890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da767513-a4e0-40a3-b7ed-c7cbd292f6a6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:32.090311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da767513-a4e0-40a3-b7ed-c7cbd292f6a6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:32.102528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da767513-a4e0-40a3-b7ed-c7cbd292f6a6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:32.102998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da767513-a4e0-40a3-b7ed-c7cbd292f6a6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:32.104213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da767513-a4e0-40a3-b7ed-c7cbd292f6a6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:32.104877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da767513-a4e0-40a3-b7ed-c7cbd292f6a6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:32.308752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da767513-a4e0-40a3-b7ed-c7cbd292f6a6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:32.317506 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da767513-a4e0-40a3-b7ed-c7cbd292f6a6 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1724 microversion: 2.1 time: 0.237005 Mar 12 20:59:32.324193 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2187/2955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:32 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:32.331988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-221898e7-5906-4748-830f-e0db7dd135b1 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Calling method '.version_select at 0x7f6e3716f1f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:32.431692 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-221898e7-5906-4748-830f-e0db7dd135b1 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] HTTP exception thrown: Volume 4ab8a844-ffba-4215-bb18-002b14927dd6 could not be found. Mar 12 20:59:32.432361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-221898e7-5906-4748-830f-e0db7dd135b1 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Returning 404 to user: Volume 4ab8a844-ffba-4215-bb18-002b14927dd6 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:32.433245 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-221898e7-5906-4748-830f-e0db7dd135b1 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4ab8a844-ffba-4215-bb18-002b14927dd6" status: 404 len: 109 microversion: 2.1 time: 0.106665 Mar 12 20:59:32.433845 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2188/2956] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 20:59:32 2022] GET /compute/v2.1/os-volumes/4ab8a844-ffba-4215-bb18-002b14927dd6 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:32.441142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0236644-3b5a-4e80-8d14-f2dd99f1b8ac tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-531494819", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "max_count": 0}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:32.444824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0236644-3b5a-4e80-8d14-f2dd99f1b8ac tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:32.447183 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0236644-3b5a-4e80-8d14-f2dd99f1b8ac tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.011580 Mar 12 20:59:32.450437 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2189/2957] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:59:32 2022] POST /compute/v2.1/servers => generated 130 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:59:32.462649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b7eecefd-9087-45bd-aaac-901e20c0e35a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:32.468495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b7eecefd-9087-45bd-aaac-901e20c0e35a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:32.479916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7eecefd-9087-45bd-aaac-901e20c0e35a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:32.487576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7eecefd-9087-45bd-aaac-901e20c0e35a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:32.488633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7eecefd-9087-45bd-aaac-901e20c0e35a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:32.489228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7eecefd-9087-45bd-aaac-901e20c0e35a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:32.725016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b7eecefd-9087-45bd-aaac-901e20c0e35a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:32.742754 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b7eecefd-9087-45bd-aaac-901e20c0e35a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 200 len: 1323 microversion: 2.1 time: 0.290165 Mar 12 20:59:32.743832 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2190/2958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:32 2022] GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 1323 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:32.757597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-efa83643-a4b0-4df0-9a0d-7fd7325fc557 req-5de2c2e0-83f6-48ff-bd29-60919ca5747c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9", "name": "network-vif-plugged", "status": "completed", "tag": "8bddb0f5-9be4-42c4-8bec-0437f01a5ecc"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:32.781635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-efa83643-a4b0-4df0-9a0d-7fd7325fc557 req-5de2c2e0-83f6-48ff-bd29-60919ca5747c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:32.782126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-efa83643-a4b0-4df0-9a0d-7fd7325fc557 req-5de2c2e0-83f6-48ff-bd29-60919ca5747c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:32.804438 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-efa83643-a4b0-4df0-9a0d-7fd7325fc557 req-5de2c2e0-83f6-48ff-bd29-60919ca5747c service nova] Creating event network-vif-plugged:8bddb0f5-9be4-42c4-8bec-0437f01a5ecc for instance c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 on nch2-master-1 Mar 12 20:59:32.808287 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-efa83643-a4b0-4df0-9a0d-7fd7325fc557 req-5de2c2e0-83f6-48ff-bd29-60919ca5747c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059523 Mar 12 20:59:32.809185 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2191/2959] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:32.815757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eb2e054a-74f2-4647-ace5-0084cea91352 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Calling method '.version_select at 0x7f6e36fa4550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:32.867368 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-eb2e054a-74f2-4647-ace5-0084cea91352 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] HTTP exception thrown: Volume 4ab8a844-ffba-4215-bb18-002b14927dd6 could not be found. Mar 12 20:59:32.868260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eb2e054a-74f2-4647-ace5-0084cea91352 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Returning 404 to user: Volume 4ab8a844-ffba-4215-bb18-002b14927dd6 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:32.869558 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eb2e054a-74f2-4647-ace5-0084cea91352 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/4ab8a844-ffba-4215-bb18-002b14927dd6" status: 404 len: 109 microversion: 2.1 time: 0.059064 Mar 12 20:59:32.870542 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2192/2960] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 20:59:32 2022] DELETE /compute/v2.1/os-volumes/4ab8a844-ffba-4215-bb18-002b14927dd6 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:32.877352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-05661c63-6764-4f48-a5f8-c8f2a2548cac tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:32.878393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-05661c63-6764-4f48-a5f8-c8f2a2548cac tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:32.887424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05661c63-6764-4f48-a5f8-c8f2a2548cac tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:32.888128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05661c63-6764-4f48-a5f8-c8f2a2548cac tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:32.889115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05661c63-6764-4f48-a5f8-c8f2a2548cac tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:32.889959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05661c63-6764-4f48-a5f8-c8f2a2548cac tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:33.098516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-05661c63-6764-4f48-a5f8-c8f2a2548cac tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:33.107122 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-05661c63-6764-4f48-a5f8-c8f2a2548cac tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.235435 Mar 12 20:59:33.117995 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2193/2961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:32 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:33.133808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1657986-4b67-411e-af01-9602aac4f556 tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-363443596", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "max_count": 2.5}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:33.138560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1657986-4b67-411e-af01-9602aac4f556 tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:33.142487 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1657986-4b67-411e-af01-9602aac4f556 tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020467 Mar 12 20:59:33.154826 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2194/2962] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:59:33 2022] POST /compute/v2.1/servers => generated 139 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:59:33.163986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aba18965-42e5-4a58-8386-a1c26ac3ac93 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Calling method '.version_select at 0x7f6e37365550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:33.202644 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-aba18965-42e5-4a58-8386-a1c26ac3ac93 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] HTTP exception thrown: Volume 4ab8a844-ffba-4215-bb18-002b14927dd6 could not be found. Mar 12 20:59:33.204627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aba18965-42e5-4a58-8386-a1c26ac3ac93 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] Returning 404 to user: Volume 4ab8a844-ffba-4215-bb18-002b14927dd6 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:33.204853 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aba18965-42e5-4a58-8386-a1c26ac3ac93 tempest-VolumesSnapshotsTestJSON-2093236484 tempest-VolumesSnapshotsTestJSON-2093236484-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/4ab8a844-ffba-4215-bb18-002b14927dd6" status: 404 len: 109 microversion: 2.1 time: 0.045927 Mar 12 20:59:33.205409 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2195/2963] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 20:59:33 2022] GET /compute/v2.1/os-volumes/4ab8a844-ffba-4215-bb18-002b14927dd6 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:33.300321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1a29fea-bc41-48ca-8ee0-30f0ce8381bf tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1013007834", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "min_count": 0}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:33.302256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1a29fea-bc41-48ca-8ee0-30f0ce8381bf tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:33.304140 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1a29fea-bc41-48ca-8ee0-30f0ce8381bf tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.008519 Mar 12 20:59:33.315048 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2196/2964] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:59:33 2022] POST /compute/v2.1/servers => generated 130 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:59:33.334967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-212cf8d4-fe9e-4590-bf56-3ff3f2a67839 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:33.335588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-212cf8d4-fe9e-4590-bf56-3ff3f2a67839 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:33.349134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-212cf8d4-fe9e-4590-bf56-3ff3f2a67839 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:33.349605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-212cf8d4-fe9e-4590-bf56-3ff3f2a67839 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:33.350985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-212cf8d4-fe9e-4590-bf56-3ff3f2a67839 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:33.351433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-212cf8d4-fe9e-4590-bf56-3ff3f2a67839 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:33.564549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-212cf8d4-fe9e-4590-bf56-3ff3f2a67839 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:33.574793 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-212cf8d4-fe9e-4590-bf56-3ff3f2a67839 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1724 microversion: 2.1 time: 0.243522 Mar 12 20:59:33.577068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2197/2965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:33 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:33.618848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da9a8a85-8345-49d1-b83d-3fad07df34de tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-529303124", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "min_count": 2.5}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:33.620346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da9a8a85-8345-49d1-b83d-3fad07df34de tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:33.621210 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da9a8a85-8345-49d1-b83d-3fad07df34de tempest-MultipleCreateNegativeTestJSON-1492054301 tempest-MultipleCreateNegativeTestJSON-1492054301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006559 Mar 12 20:59:33.622322 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2198/2966] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:59:33 2022] POST /compute/v2.1/servers => generated 139 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 12 20:59:33.760845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad307fbb-6d1c-41a0-97af-9130eefbd34a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:33.761609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad307fbb-6d1c-41a0-97af-9130eefbd34a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:33.773320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad307fbb-6d1c-41a0-97af-9130eefbd34a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:33.775051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad307fbb-6d1c-41a0-97af-9130eefbd34a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:33.777939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad307fbb-6d1c-41a0-97af-9130eefbd34a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:33.778832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad307fbb-6d1c-41a0-97af-9130eefbd34a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:34.015168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad307fbb-6d1c-41a0-97af-9130eefbd34a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:34.029596 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad307fbb-6d1c-41a0-97af-9130eefbd34a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 200 len: 1323 microversion: 2.1 time: 0.271163 Mar 12 20:59:34.030366 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2199/2967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:33 2022] GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:34.515790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3d5f41f-10b0-4629-a126-6da99927eb5c tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] Action: 'create', calling method: .version_select at 0x7f6e3728d700>, body: {"pool": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:36.266943 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3d5f41f-10b0-4629-a126-6da99927eb5c tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.180393 Mar 12 20:59:36.273223 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2200/2968] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Mar 12 20:59:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 20:59:36.273660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7f3cd57-f361-4962-8968-d377f276ba69 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:36.274257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f7f3cd57-f361-4962-8968-d377f276ba69 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:36.282606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7f3cd57-f361-4962-8968-d377f276ba69 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:36.283066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7f3cd57-f361-4962-8968-d377f276ba69 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:36.283837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7f3cd57-f361-4962-8968-d377f276ba69 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:36.284438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7f3cd57-f361-4962-8968-d377f276ba69 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:36.500082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f7f3cd57-f361-4962-8968-d377f276ba69 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:36.509091 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f7f3cd57-f361-4962-8968-d377f276ba69 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.239609 Mar 12 20:59:36.510103 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2201/2969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:36 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:36.515841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a5b0e07c-9622-4e43-8da5-5f3b51cd19de tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:36.516629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a5b0e07c-9622-4e43-8da5-5f3b51cd19de tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:36.524876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5b0e07c-9622-4e43-8da5-5f3b51cd19de tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:36.530653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5b0e07c-9622-4e43-8da5-5f3b51cd19de tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:36.531773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5b0e07c-9622-4e43-8da5-5f3b51cd19de tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:36.532213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5b0e07c-9622-4e43-8da5-5f3b51cd19de tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:36.726627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a5b0e07c-9622-4e43-8da5-5f3b51cd19de tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:36.737708 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a5b0e07c-9622-4e43-8da5-5f3b51cd19de tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1724 microversion: 2.1 time: 0.225217 Mar 12 20:59:36.739154 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2202/2970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:36 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:36.744094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-04ca496e-cbde-43a9-b743-8757f45ba4d9 req-d0264eb0-0b4f-4509-9a7b-ff0472f09ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af92fc6-c1fa-4a32-a0e9-124941433e1b", "name": "network-vif-plugged", "status": "completed", "tag": "4db3d0df-df75-4593-bf71-d04925ab9a0f"}, {"server_uuid": "5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3", "name": "network-vif-plugged", "status": "completed", "tag": "e65503ae-b942-4b25-bf05-a2df74b1e90c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:36.754719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-04ca496e-cbde-43a9-b743-8757f45ba4d9 req-d0264eb0-0b4f-4509-9a7b-ff0472f09ef4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:36.755728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-04ca496e-cbde-43a9-b743-8757f45ba4d9 req-d0264eb0-0b4f-4509-9a7b-ff0472f09ef4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:36.775428 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-04ca496e-cbde-43a9-b743-8757f45ba4d9 req-d0264eb0-0b4f-4509-9a7b-ff0472f09ef4 service nova] Creating event network-vif-plugged:4db3d0df-df75-4593-bf71-d04925ab9a0f for instance 0af92fc6-c1fa-4a32-a0e9-124941433e1b on nch1-master-1 Mar 12 20:59:36.776418 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-04ca496e-cbde-43a9-b743-8757f45ba4d9 req-d0264eb0-0b4f-4509-9a7b-ff0472f09ef4 service nova] Creating event network-vif-plugged:e65503ae-b942-4b25-bf05-a2df74b1e90c for instance 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 on nch2-master-1 Mar 12 20:59:36.785927 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-04ca496e-cbde-43a9-b743-8757f45ba4d9 req-d0264eb0-0b4f-4509-9a7b-ff0472f09ef4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044974 Mar 12 20:59:36.787098 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2203/2971] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:36.802679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b014e02f-e26b-4ae2-8da7-bd3dc8ca5d5b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:36.808760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b014e02f-e26b-4ae2-8da7-bd3dc8ca5d5b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:36.826501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b014e02f-e26b-4ae2-8da7-bd3dc8ca5d5b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:36.829937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b014e02f-e26b-4ae2-8da7-bd3dc8ca5d5b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:36.831490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b014e02f-e26b-4ae2-8da7-bd3dc8ca5d5b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:36.833949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b014e02f-e26b-4ae2-8da7-bd3dc8ca5d5b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:37.353089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b014e02f-e26b-4ae2-8da7-bd3dc8ca5d5b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:37.363312 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b014e02f-e26b-4ae2-8da7-bd3dc8ca5d5b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 200 len: 1323 microversion: 2.1 time: 0.573051 Mar 12 20:59:37.364162 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2204/2972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:36 2022] GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 1323 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:37.380823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-97b8d309-6771-4b0e-990b-a32b3e491c6a tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] Action: 'create', calling method: .version_select at 0x7f6e3708a1f0>, body: {"pool": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:39.517314 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-97b8d309-6771-4b0e-990b-a32b3e491c6a tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.141746 Mar 12 20:59:39.518381 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2205/2973] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Mar 12 20:59:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:39.524362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2acece98-6b87-4487-a73b-794090212e90 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:39.529161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2acece98-6b87-4487-a73b-794090212e90 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:39.552813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2acece98-6b87-4487-a73b-794090212e90 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:39.553922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2acece98-6b87-4487-a73b-794090212e90 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:39.561931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2acece98-6b87-4487-a73b-794090212e90 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:39.562454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2acece98-6b87-4487-a73b-794090212e90 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:39.809415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2acece98-6b87-4487-a73b-794090212e90 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:39.832058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2acece98-6b87-4487-a73b-794090212e90 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.312421 Mar 12 20:59:39.842768 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2206/2974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:39 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:39.849379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-960e3951-02d6-4f34-8a99-68a177b695ae tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:39.863184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-960e3951-02d6-4f34-8a99-68a177b695ae tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:39.890813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-960e3951-02d6-4f34-8a99-68a177b695ae tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:39.891489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-960e3951-02d6-4f34-8a99-68a177b695ae tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:39.893038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-960e3951-02d6-4f34-8a99-68a177b695ae tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:39.895052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-960e3951-02d6-4f34-8a99-68a177b695ae tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:40.271858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-960e3951-02d6-4f34-8a99-68a177b695ae tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:40.286457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-960e3951-02d6-4f34-8a99-68a177b695ae tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1724 microversion: 2.1 time: 0.440768 Mar 12 20:59:40.288266 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2207/2975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:39 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1724 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:40.293543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1b8de0d9-7828-429b-b367-1264429fcdc1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:40.294612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1b8de0d9-7828-429b-b367-1264429fcdc1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:40.302169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b8de0d9-7828-429b-b367-1264429fcdc1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:40.303190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b8de0d9-7828-429b-b367-1264429fcdc1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:40.307278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b8de0d9-7828-429b-b367-1264429fcdc1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:40.308003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b8de0d9-7828-429b-b367-1264429fcdc1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:40.620149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1b8de0d9-7828-429b-b367-1264429fcdc1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:40.632730 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1b8de0d9-7828-429b-b367-1264429fcdc1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 200 len: 1516 microversion: 2.1 time: 0.340144 Mar 12 20:59:40.634374 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2208/2976] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:40 2022] GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 1516 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:40.656318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb997e43-95c1-4897-8a06-0d1bc072a5f8 tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] Action: 'create', calling method: .version_select at 0x7f6e36f2e430>, body: {"pool": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:42.935024 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb997e43-95c1-4897-8a06-0d1bc072a5f8 tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.299344 Mar 12 20:59:42.937002 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2209/2977] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Mar 12 20:59:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:42.942956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb55d48f-3e5e-46f4-8d8b-478fbbd30ecc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:42.943651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb55d48f-3e5e-46f4-8d8b-478fbbd30ecc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 0af92fc6-c1fa-4a32-a0e9-124941433e1b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:42.971970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb55d48f-3e5e-46f4-8d8b-478fbbd30ecc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:42.972430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb55d48f-3e5e-46f4-8d8b-478fbbd30ecc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:42.973224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb55d48f-3e5e-46f4-8d8b-478fbbd30ecc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:42.973667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb55d48f-3e5e-46f4-8d8b-478fbbd30ecc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:43.431936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bb55d48f-3e5e-46f4-8d8b-478fbbd30ecc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:43.450509 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb55d48f-3e5e-46f4-8d8b-478fbbd30ecc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/0af92fc6-c1fa-4a32-a0e9-124941433e1b" status: 200 len: 1516 microversion: 2.1 time: 0.512026 Mar 12 20:59:43.463397 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2210/2978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:42 2022] GET /compute/v2.1/servers/0af92fc6-c1fa-4a32-a0e9-124941433e1b => generated 1516 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:43.473860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dfc0179b-dac4-4439-8573-884c70d41756 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:43.474716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dfc0179b-dac4-4439-8573-884c70d41756 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:43.482119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfc0179b-dac4-4439-8573-884c70d41756 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:43.483170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfc0179b-dac4-4439-8573-884c70d41756 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:43.484411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfc0179b-dac4-4439-8573-884c70d41756 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:43.485090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfc0179b-dac4-4439-8573-884c70d41756 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:43.789266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dfc0179b-dac4-4439-8573-884c70d41756 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:43.800095 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dfc0179b-dac4-4439-8573-884c70d41756 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.334894 Mar 12 20:59:43.802586 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2211/2979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:43 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:43.802586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52c54fc3-cb02-4fda-af23-72173e810dcb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:43.802586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-52c54fc3-cb02-4fda-af23-72173e810dcb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:43.818690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52c54fc3-cb02-4fda-af23-72173e810dcb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:43.819313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52c54fc3-cb02-4fda-af23-72173e810dcb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:43.820514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52c54fc3-cb02-4fda-af23-72173e810dcb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:43.821145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52c54fc3-cb02-4fda-af23-72173e810dcb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:44.180621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-52c54fc3-cb02-4fda-af23-72173e810dcb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:44.199111 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-52c54fc3-cb02-4fda-af23-72173e810dcb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1724 microversion: 2.1 time: 0.394717 Mar 12 20:59:44.207270 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2212/2980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:43 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:44.221948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1dfc827c-203e-4353-947a-aa3d4ddee0d1 tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] Action: 'create', calling method: .version_select at 0x7f6e36d781f0>, body: {"pool": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:46.328179 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1dfc827c-203e-4353-947a-aa3d4ddee0d1 tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.119215 Mar 12 20:59:46.329183 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2213/2981] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Mar 12 20:59:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:46.336039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abfe5a88-138b-452f-a662-e7340a333f4e tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:46.336844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-abfe5a88-138b-452f-a662-e7340a333f4e tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:46.350643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abfe5a88-138b-452f-a662-e7340a333f4e tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:46.351467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abfe5a88-138b-452f-a662-e7340a333f4e tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:46.352957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abfe5a88-138b-452f-a662-e7340a333f4e tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:46.353620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abfe5a88-138b-452f-a662-e7340a333f4e tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:46.602905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-abfe5a88-138b-452f-a662-e7340a333f4e tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:46.612960 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-abfe5a88-138b-452f-a662-e7340a333f4e tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9" status: 200 len: 1515 microversion: 2.1 time: 0.282286 Mar 12 20:59:46.618420 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2214/2982] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:46 2022] GET /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 => generated 1515 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:46.634013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2843b6bf-aa97-4a4f-bc16-3d481d1502bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:46.634013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2843b6bf-aa97-4a4f-bc16-3d481d1502bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:46.651903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2843b6bf-aa97-4a4f-bc16-3d481d1502bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:46.652385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2843b6bf-aa97-4a4f-bc16-3d481d1502bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:46.653465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2843b6bf-aa97-4a4f-bc16-3d481d1502bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:46.653934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2843b6bf-aa97-4a4f-bc16-3d481d1502bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:46.837873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2843b6bf-aa97-4a4f-bc16-3d481d1502bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:46.847432 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2843b6bf-aa97-4a4f-bc16-3d481d1502bd tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.226588 Mar 12 20:59:46.848436 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2215/2983] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:46 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:46.861483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5fead030-9b10-410b-a099-676f999e5452 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:46.862921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5fead030-9b10-410b-a099-676f999e5452 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:46.872510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fead030-9b10-410b-a099-676f999e5452 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:46.873240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fead030-9b10-410b-a099-676f999e5452 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:46.875537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fead030-9b10-410b-a099-676f999e5452 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:46.876454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5fead030-9b10-410b-a099-676f999e5452 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:47.090676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5fead030-9b10-410b-a099-676f999e5452 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:47.109545 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5fead030-9b10-410b-a099-676f999e5452 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1701 microversion: 2.1 time: 0.259111 Mar 12 20:59:47.116465 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2216/2984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:46 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1701 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:47.516478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7209091-06b5-4d40-9e1d-4151a28cdd5f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'create', calling method: .version_select at 0x7f6e36df63a0>, body: {"keypair": {"name": "tempest-keypair-786093672"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:47.539336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a7209091-06b5-4d40-9e1d-4151a28cdd5f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:59:47.547053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a7209091-06b5-4d40-9e1d-4151a28cdd5f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for user 178b9752b5d44f9abb4df56c54e28c48 and project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:59:47.769607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a7209091-06b5-4d40-9e1d-4151a28cdd5f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:59:47.777365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a7209091-06b5-4d40-9e1d-4151a28cdd5f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for user 178b9752b5d44f9abb4df56c54e28c48 and project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:59:47.804813 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7209091-06b5-4d40-9e1d-4151a28cdd5f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.686980 Mar 12 20:59:47.807029 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2217/2985] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 20:59:47 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:47.821379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-53dcd36a-374a-4891-8630-84ed39def44d tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] Calling method '.version_select at 0x7f6e36f469d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:48.131937 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-53dcd36a-374a-4891-8630-84ed39def44d tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/cce1e65a-9ce5-48a1-9150-a8761b597695" status: 200 len: 142 microversion: 2.1 time: 0.318632 Mar 12 20:59:48.132529 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2218/2986] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Mar 12 20:59:47 2022] GET /compute/v2.1/os-floating-ips/cce1e65a-9ce5-48a1-9150-a8761b597695 => generated 142 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:48.137127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-139d8c71-c2b1-432b-9cd4-fd5c7d559767 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:48.137623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-139d8c71-c2b1-432b-9cd4-fd5c7d559767 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:48.144678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-139d8c71-c2b1-432b-9cd4-fd5c7d559767 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:48.145243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-139d8c71-c2b1-432b-9cd4-fd5c7d559767 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:48.146294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-139d8c71-c2b1-432b-9cd4-fd5c7d559767 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:48.147354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-139d8c71-c2b1-432b-9cd4-fd5c7d559767 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:48.178794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-139d8c71-c2b1-432b-9cd4-fd5c7d559767 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 20:59:48.296050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-139d8c71-c2b1-432b-9cd4-fd5c7d559767 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9" status: 204 len: 0 microversion: 2.1 time: 0.161117 Mar 12 20:59:48.301332 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2219/2987] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 20:59:48 2022] DELETE /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 20:59:48.313759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ddd8c97-a467-4a81-b332-c2ffa8acc5a3 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:48.322544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ddd8c97-a467-4a81-b332-c2ffa8acc5a3 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:48.323190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ddd8c97-a467-4a81-b332-c2ffa8acc5a3 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:48.374768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ddd8c97-a467-4a81-b332-c2ffa8acc5a3 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Going to try to start instance {{(pid=136302) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 12 20:59:48.474267 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ddd8c97-a467-4a81-b332-c2ffa8acc5a3 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "POST /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/action" status: 202 len: 0 microversion: 2.1 time: 0.165458 Mar 12 20:59:48.477155 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2220/2988] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 20:59:48 2022] POST /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:59:48.491394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-358dd72a-5b9d-4273-8990-1f66a064fd1e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:48.493533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-358dd72a-5b9d-4273-8990-1f66a064fd1e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:48.527891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-358dd72a-5b9d-4273-8990-1f66a064fd1e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:48.528619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-358dd72a-5b9d-4273-8990-1f66a064fd1e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:48.529136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-358dd72a-5b9d-4273-8990-1f66a064fd1e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:48.529580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-358dd72a-5b9d-4273-8990-1f66a064fd1e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:48.960652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-358dd72a-5b9d-4273-8990-1f66a064fd1e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:48.970929 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-358dd72a-5b9d-4273-8990-1f66a064fd1e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.491924 Mar 12 20:59:48.971723 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2221/2989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:48 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:48.977091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee195ec5-4edb-42ec-8d25-7a5db827a869 tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] Calling method '.version_select at 0x7f6e3725eaf0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:50.284086 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee195ec5-4edb-42ec-8d25-7a5db827a869 tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/cce1e65a-9ce5-48a1-9150-a8761b597695" status: 202 len: 0 microversion: 2.1 time: 1.311045 Mar 12 20:59:50.284840 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2222/2990] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:59:48 2022] DELETE /compute/v2.1/os-floating-ips/cce1e65a-9ce5-48a1-9150-a8761b597695 => generated 0 bytes in 1312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:59:50.293907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80b391bb-a748-48ed-8f2c-9c07e19956af tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:50.294863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80b391bb-a748-48ed-8f2c-9c07e19956af tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:50.305150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80b391bb-a748-48ed-8f2c-9c07e19956af tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:50.306344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80b391bb-a748-48ed-8f2c-9c07e19956af tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:50.307527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80b391bb-a748-48ed-8f2c-9c07e19956af tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:50.308099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80b391bb-a748-48ed-8f2c-9c07e19956af tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:50.560215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80b391bb-a748-48ed-8f2c-9c07e19956af tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:50.578528 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80b391bb-a748-48ed-8f2c-9c07e19956af tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9" status: 200 len: 1521 microversion: 2.1 time: 0.292291 Mar 12 20:59:50.579944 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2223/2991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:50 2022] GET /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:50.585976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5beacf3b-65d2-4443-ad0f-894ccce3ce4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:50.586857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5beacf3b-65d2-4443-ad0f-894ccce3ce4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:50.597408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5beacf3b-65d2-4443-ad0f-894ccce3ce4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:50.598187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5beacf3b-65d2-4443-ad0f-894ccce3ce4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:50.601069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5beacf3b-65d2-4443-ad0f-894ccce3ce4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:50.601853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5beacf3b-65d2-4443-ad0f-894ccce3ce4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:50.818803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5beacf3b-65d2-4443-ad0f-894ccce3ce4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:50.832281 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5beacf3b-65d2-4443-ad0f-894ccce3ce4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1710 microversion: 2.1 time: 0.248405 Mar 12 20:59:50.845639 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2224/2992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:50 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1710 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:50.853846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d35d04d2-2f1e-4482-a9f0-905f0d071167 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:50.854466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d35d04d2-2f1e-4482-a9f0-905f0d071167 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:50.872680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d35d04d2-2f1e-4482-a9f0-905f0d071167 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:50.873309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d35d04d2-2f1e-4482-a9f0-905f0d071167 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:50.874331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d35d04d2-2f1e-4482-a9f0-905f0d071167 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:50.876370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d35d04d2-2f1e-4482-a9f0-905f0d071167 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:51.216696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d35d04d2-2f1e-4482-a9f0-905f0d071167 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:51.232032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d35d04d2-2f1e-4482-a9f0-905f0d071167 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.382455 Mar 12 20:59:51.232684 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2225/2993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:50 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:51.264768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56740616-b02c-441f-8e4a-c2fa6a023690 tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] Calling method '.version_select at 0x7f6e37487af0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:51.883662 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56740616-b02c-441f-8e4a-c2fa6a023690 tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.649919 Mar 12 20:59:51.885820 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2226/2994] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Mar 12 20:59:51 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:59:51.890115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c71b6fb-4810-4cca-8dd9-bd80ee6ee4db tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:51.890922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c71b6fb-4810-4cca-8dd9-bd80ee6ee4db tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:51.901458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c71b6fb-4810-4cca-8dd9-bd80ee6ee4db tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:51.906294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c71b6fb-4810-4cca-8dd9-bd80ee6ee4db tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:51.907215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c71b6fb-4810-4cca-8dd9-bd80ee6ee4db tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:51.907742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c71b6fb-4810-4cca-8dd9-bd80ee6ee4db tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:52.005015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0c71b6fb-4810-4cca-8dd9-bd80ee6ee4db tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:52.013740 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c71b6fb-4810-4cca-8dd9-bd80ee6ee4db tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9" status: 200 len: 1479 microversion: 2.1 time: 0.126704 Mar 12 20:59:52.014844 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2227/2995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:51 2022] GET /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 => generated 1479 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:52.019900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fccfab55-a78f-4b24-bf4e-c3012014e5ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:52.020611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fccfab55-a78f-4b24-bf4e-c3012014e5ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:52.031733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fccfab55-a78f-4b24-bf4e-c3012014e5ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:52.032209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fccfab55-a78f-4b24-bf4e-c3012014e5ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:52.034045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fccfab55-a78f-4b24-bf4e-c3012014e5ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:52.034498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fccfab55-a78f-4b24-bf4e-c3012014e5ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:52.248740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fccfab55-a78f-4b24-bf4e-c3012014e5ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:52.266750 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fccfab55-a78f-4b24-bf4e-c3012014e5ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1714 microversion: 2.1 time: 0.250118 Mar 12 20:59:52.269974 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2228/2996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:52 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1714 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:52.286978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90560177-86c2-4db2-aebe-b864794ee71f tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] Calling method '.version_select at 0x7f6e36cf1940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:52.666281 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90560177-86c2-4db2-aebe-b864794ee71f tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.394183 Mar 12 20:59:52.674180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2229/2997] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Mar 12 20:59:52 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:52.679508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4167faa2-ac72-475d-8ada-056e8be254a6 req-d485edb1-03c7-442f-9e61-986da3b3fdb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9", "name": "network-vif-deleted", "tag": "8bddb0f5-9be4-42c4-8bec-0437f01a5ecc"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:52.694522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4167faa2-ac72-475d-8ada-056e8be254a6 req-d485edb1-03c7-442f-9e61-986da3b3fdb2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:52.695283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4167faa2-ac72-475d-8ada-056e8be254a6 req-d485edb1-03c7-442f-9e61-986da3b3fdb2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:52.708321 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4167faa2-ac72-475d-8ada-056e8be254a6 req-d485edb1-03c7-442f-9e61-986da3b3fdb2 service nova] Creating event network-vif-deleted:8bddb0f5-9be4-42c4-8bec-0437f01a5ecc for instance c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 on nch2-master-1 Mar 12 20:59:52.715144 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4167faa2-ac72-475d-8ada-056e8be254a6 req-d485edb1-03c7-442f-9e61-986da3b3fdb2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039667 Mar 12 20:59:52.716265 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2230/2998] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:52.723524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c65d533d-cb95-461a-87a9-9d629cd23f06 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:52.724397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c65d533d-cb95-461a-87a9-9d629cd23f06 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:52.743474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65d533d-cb95-461a-87a9-9d629cd23f06 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:52.745338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65d533d-cb95-461a-87a9-9d629cd23f06 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:52.746656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65d533d-cb95-461a-87a9-9d629cd23f06 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:52.749221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65d533d-cb95-461a-87a9-9d629cd23f06 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:52.922705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c65d533d-cb95-461a-87a9-9d629cd23f06 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:52.931709 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c65d533d-cb95-461a-87a9-9d629cd23f06 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.213762 Mar 12 20:59:52.932298 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2231/2999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:52 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:52.946608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8d7b1de-c44e-4d72-a882-9d4566875440 tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] Calling method '.version_select at 0x7f6e373659d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:53.790519 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8d7b1de-c44e-4d72-a882-9d4566875440 tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/4f2ccc76-8d57-4db5-9821-f30af2b45408" status: 202 len: 0 microversion: 2.1 time: 0.847539 Mar 12 20:59:53.791796 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2232/3000] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:59:52 2022] DELETE /compute/v2.1/os-floating-ips/4f2ccc76-8d57-4db5-9821-f30af2b45408 => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:59:53.798525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1873383399", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1df08e9-a7c0-43fc-8fad-e4c91b24f5ac"}], "security_groups": [{"name": "tempest-securitygroup--1285366895"}], "key_name": "tempest-keypair-786093672", "user_data": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:53.925379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] validate_networks() for [('a1df08e9-a7c0-43fc-8fad-e4c91b24f5ac', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 20:59:54.377253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 20:59:54.378241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 20:59:54.378704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 20:59:54.379498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 20:59:54.379961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 20:59:54.390826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:54.392669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:54.394796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:54.395927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:54.419316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 20:59:54.427009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for user 178b9752b5d44f9abb4df56c54e28c48 and project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 20:59:54.439993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 20:59:54.442647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 20:59:54.491830 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6d06cbdc-ec49-41d9-9415-0b9d67f02637 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.698749 Mar 12 20:59:54.493612 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2233/3001] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 20:59:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 20:59:54.500630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ac86cee-d70a-46d4-960b-af1b2ec367fc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:54.501558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ac86cee-d70a-46d4-960b-af1b2ec367fc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:54.509435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ac86cee-d70a-46d4-960b-af1b2ec367fc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:54.510396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ac86cee-d70a-46d4-960b-af1b2ec367fc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:54.511381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ac86cee-d70a-46d4-960b-af1b2ec367fc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:54.512141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ac86cee-d70a-46d4-960b-af1b2ec367fc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:54.530875 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9ac86cee-d70a-46d4-960b-af1b2ec367fc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] HTTP exception thrown: Instance c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 could not be found. Mar 12 20:59:54.531677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ac86cee-d70a-46d4-960b-af1b2ec367fc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Returning 404 to user: Instance c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:54.533392 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ac86cee-d70a-46d4-960b-af1b2ec367fc tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9" status: 404 len: 111 microversion: 2.1 time: 0.037988 Mar 12 20:59:54.535382 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2234/3002] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:54 2022] GET /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 20:59:54.543649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1a7486ae-819d-4a71-af93-d8c83da0895a tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] Calling method '.version_select at 0x7f6e36f46b80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:55.611682 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1a7486ae-819d-4a71-af93-d8c83da0895a tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/8e7f6172-6d78-4066-b41c-cceec14225da" status: 202 len: 0 microversion: 2.1 time: 1.073166 Mar 12 20:59:55.614839 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2235/3003] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:59:54 2022] DELETE /compute/v2.1/os-floating-ips/8e7f6172-6d78-4066-b41c-cceec14225da => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:59:55.620566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0de1804e-698d-41a9-8b52-2737a9510531 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:55.621912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0de1804e-698d-41a9-8b52-2737a9510531 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:55.629913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0de1804e-698d-41a9-8b52-2737a9510531 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:55.630829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0de1804e-698d-41a9-8b52-2737a9510531 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:55.634024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0de1804e-698d-41a9-8b52-2737a9510531 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:55.634588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0de1804e-698d-41a9-8b52-2737a9510531 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:55.795229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0de1804e-698d-41a9-8b52-2737a9510531 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:55.805127 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0de1804e-698d-41a9-8b52-2737a9510531 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.188209 Mar 12 20:59:55.806293 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2236/3004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:55 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:55.815064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16565871-e693-46ef-b121-f39e920fc7c3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:55.816310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16565871-e693-46ef-b121-f39e920fc7c3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:55.846776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16565871-e693-46ef-b121-f39e920fc7c3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:55.857238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16565871-e693-46ef-b121-f39e920fc7c3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:55.858183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16565871-e693-46ef-b121-f39e920fc7c3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:55.858733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16565871-e693-46ef-b121-f39e920fc7c3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:55.926638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16565871-e693-46ef-b121-f39e920fc7c3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:55.935280 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16565871-e693-46ef-b121-f39e920fc7c3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1298 microversion: 2.1 time: 0.127720 Mar 12 20:59:55.936450 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2237/3005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:55 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1298 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:55.941449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5de8fb8-3614-4906-8f42-6d7f41036bea tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:55.945621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c5de8fb8-3614-4906-8f42-6d7f41036bea tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:55.946713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c5de8fb8-3614-4906-8f42-6d7f41036bea tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '0c4d74d4abde4a1980632c4260fe2834'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:55.952946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5de8fb8-3614-4906-8f42-6d7f41036bea tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:55.953640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5de8fb8-3614-4906-8f42-6d7f41036bea tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:55.954755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5de8fb8-3614-4906-8f42-6d7f41036bea tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:55.955289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5de8fb8-3614-4906-8f42-6d7f41036bea tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:56.072657 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c5de8fb8-3614-4906-8f42-6d7f41036bea tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.134686 Mar 12 20:59:56.074261 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2238/3006] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Mar 12 20:59:55 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:59:56.080166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e575df91-b138-40a3-a1ad-3640d970559e tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] Calling method '.version_select at 0x7f6e377995e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:57.051096 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e575df91-b138-40a3-a1ad-3640d970559e tempest-FloatingIPDetailsTestJSON-1712799241 tempest-FloatingIPDetailsTestJSON-1712799241-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/1b76389e-a6b8-4c99-9f30-fbc8e7d8768c" status: 202 len: 0 microversion: 2.1 time: 0.975415 Mar 12 20:59:57.051693 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2239/3007] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 20:59:56 2022] DELETE /compute/v2.1/os-floating-ips/1b76389e-a6b8-4c99-9f30-fbc8e7d8768c => generated 0 bytes in 977 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 20:59:57.056858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-06a300e3-7d5b-4c2b-92e5-4a89a4aac283 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:57.058234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-06a300e3-7d5b-4c2b-92e5-4a89a4aac283 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:57.059072 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-06a300e3-7d5b-4c2b-92e5-4a89a4aac283 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.006400 Mar 12 20:59:57.059584 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2240/3008] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Mar 12 20:59:57 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:59:57.070155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-05f7f74b-3ee8-4a6f-85a7-36af574e1807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:57.071051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-05f7f74b-3ee8-4a6f-85a7-36af574e1807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:57.077396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05f7f74b-3ee8-4a6f-85a7-36af574e1807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:57.077884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05f7f74b-3ee8-4a6f-85a7-36af574e1807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:57.078886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05f7f74b-3ee8-4a6f-85a7-36af574e1807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:57.079343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05f7f74b-3ee8-4a6f-85a7-36af574e1807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:57.383258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-05f7f74b-3ee8-4a6f-85a7-36af574e1807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:57.393497 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-05f7f74b-3ee8-4a6f-85a7-36af574e1807 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.332259 Mar 12 20:59:57.395077 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2241/3009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:57 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:57.401566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7bd35663-fc8b-47d1-9a83-9c93c0c6f530 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:57.402539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7bd35663-fc8b-47d1-9a83-9c93c0c6f530 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:57.433290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7bd35663-fc8b-47d1-9a83-9c93c0c6f530 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:57.441585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7bd35663-fc8b-47d1-9a83-9c93c0c6f530 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:57.443877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7bd35663-fc8b-47d1-9a83-9c93c0c6f530 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:57.445702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7bd35663-fc8b-47d1-9a83-9c93c0c6f530 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:57.813596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7bd35663-fc8b-47d1-9a83-9c93c0c6f530 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:57.827396 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7bd35663-fc8b-47d1-9a83-9c93c0c6f530 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1364 microversion: 2.1 time: 0.430335 Mar 12 20:59:57.828228 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2242/3010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:57 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1364 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:57.880734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-892572fe-0f96-4893-a0ab-0c79e10363ac tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:57.886831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-892572fe-0f96-4893-a0ab-0c79e10363ac tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:57.888069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-892572fe-0f96-4893-a0ab-0c79e10363ac tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Searching by: {'deleted': False, 'project_id': '0c4d74d4abde4a1980632c4260fe2834'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:57.895367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-892572fe-0f96-4893-a0ab-0c79e10363ac tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:57.896687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-892572fe-0f96-4893-a0ab-0c79e10363ac tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:57.898259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-892572fe-0f96-4893-a0ab-0c79e10363ac tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:57.899963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-892572fe-0f96-4893-a0ab-0c79e10363ac tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:57.991512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-892572fe-0f96-4893-a0ab-0c79e10363ac tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:59:58.047626 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-892572fe-0f96-4893-a0ab-0c79e10363ac tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.218042 Mar 12 20:59:58.053926 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2243/3011] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 20:59:57 2022] GET /compute/v2.1/servers => generated 683 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:58.063917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e40b6efb-4b8c-4de3-8fe8-c363fabdc0a5 req-91d926a7-0710-4e01-b13d-3078c877e0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e537d16d-478d-4375-a61a-c28f8a785539", "tag": "e0808d11-4cd5-4e52-88b4-c9eaec2126e6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 20:59:58.092197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e40b6efb-4b8c-4de3-8fe8-c363fabdc0a5 req-91d926a7-0710-4e01-b13d-3078c877e0ba service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:58.093881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e40b6efb-4b8c-4de3-8fe8-c363fabdc0a5 req-91d926a7-0710-4e01-b13d-3078c877e0ba service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:58.128320 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e40b6efb-4b8c-4de3-8fe8-c363fabdc0a5 req-91d926a7-0710-4e01-b13d-3078c877e0ba service nova] Creating event network-changed:e0808d11-4cd5-4e52-88b4-c9eaec2126e6 for instance e537d16d-478d-4375-a61a-c28f8a785539 on nch2-master-1 Mar 12 20:59:58.142121 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e40b6efb-4b8c-4de3-8fe8-c363fabdc0a5 req-91d926a7-0710-4e01-b13d-3078c877e0ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089407 Mar 12 20:59:58.143116 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2244/3012] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:58.154705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a05ce492-8271-4b7c-ae48-900db37b0a24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:58.163819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a05ce492-8271-4b7c-ae48-900db37b0a24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:58.164291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.compute.servers [None req-a05ce492-8271-4b7c-ae48-900db37b0a24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Removing options 'limit' from query {{(pid=136302) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Mar 12 20:59:58.165082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a05ce492-8271-4b7c-ae48-900db37b0a24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Searching by: {'deleted': False, 'project_id': '0c4d74d4abde4a1980632c4260fe2834'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:58.185871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a05ce492-8271-4b7c-ae48-900db37b0a24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:58.185999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a05ce492-8271-4b7c-ae48-900db37b0a24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:58.188200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a05ce492-8271-4b7c-ae48-900db37b0a24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:58.189250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a05ce492-8271-4b7c-ae48-900db37b0a24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:58.257625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-a05ce492-8271-4b7c-ae48-900db37b0a24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:59:58.306564 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a05ce492-8271-4b7c-ae48-900db37b0a24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.157588 Mar 12 20:59:58.308536 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2245/3013] 10.222.0.30 () {58 vars in 1143 bytes} [Sat Mar 12 20:59:58 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 20:59:58.320798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3eab6239-ed09-4481-9b09-a51007807177 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:58.327375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3eab6239-ed09-4481-9b09-a51007807177 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:58.328206 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3eab6239-ed09-4481-9b09-a51007807177 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.013362 Mar 12 20:59:58.328743 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2246/3014] 10.222.0.30 () {58 vars in 1141 bytes} [Sat Mar 12 20:59:58 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:59:58.342118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd6f99b2-759f-480a-b9b4-2a0724cc1a3a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:58.348156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd6f99b2-759f-480a-b9b4-2a0724cc1a3a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 20:59:58.349153 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd6f99b2-759f-480a-b9b4-2a0724cc1a3a tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.014227 Mar 12 20:59:58.351157 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2247/3015] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 20:59:58 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 20:59:58.361531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c701f21b-8eba-4a73-9287-4fbca349bbd7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:58.366069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c701f21b-8eba-4a73-9287-4fbca349bbd7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:58.367155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c701f21b-8eba-4a73-9287-4fbca349bbd7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '0c4d74d4abde4a1980632c4260fe2834'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:58.373848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.compute.servers [None req-c701f21b-8eba-4a73-9287-4fbca349bbd7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Flavor 'non_existing_flavor' could not be found {{(pid=136302) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Mar 12 20:59:58.375340 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c701f21b-8eba-4a73-9287-4fbca349bbd7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.018942 Mar 12 20:59:58.376492 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2248/3016] 10.222.0.30 () {58 vars in 1177 bytes} [Sat Mar 12 20:59:58 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:59:58.390784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-664d0849-5862-43b9-865a-b095dc18bd24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:58.397238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-664d0849-5862-43b9-865a-b095dc18bd24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:58.398389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-664d0849-5862-43b9-865a-b095dc18bd24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '0c4d74d4abde4a1980632c4260fe2834'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:58.405673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-664d0849-5862-43b9-865a-b095dc18bd24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:58.406565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-664d0849-5862-43b9-865a-b095dc18bd24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:58.407854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-664d0849-5862-43b9-865a-b095dc18bd24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:58.408500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-664d0849-5862-43b9-865a-b095dc18bd24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:58.554536 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-664d0849-5862-43b9-865a-b095dc18bd24 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.170873 Mar 12 20:59:58.555445 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2249/3017] 10.222.0.30 () {58 vars in 1173 bytes} [Sat Mar 12 20:59:58 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:59:58.561078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-611e8387-b617-4fdd-a055-f89510eea92f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:58.562408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-611e8387-b617-4fdd-a055-f89510eea92f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:58.569762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-611e8387-b617-4fdd-a055-f89510eea92f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:58.570245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-611e8387-b617-4fdd-a055-f89510eea92f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:58.571213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-611e8387-b617-4fdd-a055-f89510eea92f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:58.571809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-611e8387-b617-4fdd-a055-f89510eea92f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:59.133078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-611e8387-b617-4fdd-a055-f89510eea92f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:59.142686 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-611e8387-b617-4fdd-a055-f89510eea92f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1521 microversion: 2.1 time: 0.585896 Mar 12 20:59:59.145198 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2250/3018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:58 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1521 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:59.151630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21ce4043-c0ee-4958-8b4d-a96f472661c6 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:59.161053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21ce4043-c0ee-4958-8b4d-a96f472661c6 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:59.162678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-21ce4043-c0ee-4958-8b4d-a96f472661c6 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '0c4d74d4abde4a1980632c4260fe2834'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:59.176598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21ce4043-c0ee-4958-8b4d-a96f472661c6 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:59.178582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21ce4043-c0ee-4958-8b4d-a96f472661c6 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:59.180072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21ce4043-c0ee-4958-8b4d-a96f472661c6 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:59.180772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21ce4043-c0ee-4958-8b4d-a96f472661c6 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:59.277476 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21ce4043-c0ee-4958-8b4d-a96f472661c6 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.129399 Mar 12 20:59:59.278246 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2251/3019] 10.222.0.30 () {58 vars in 1183 bytes} [Sat Mar 12 20:59:59 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 20:59:59.290640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1ea078b4-5ffa-4097-bb48-f1be73e7d374 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:59.291359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1ea078b4-5ffa-4097-bb48-f1be73e7d374 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 20:59:59.298521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ea078b4-5ffa-4097-bb48-f1be73e7d374 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:59.299073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ea078b4-5ffa-4097-bb48-f1be73e7d374 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:59.300194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ea078b4-5ffa-4097-bb48-f1be73e7d374 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:59.300708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ea078b4-5ffa-4097-bb48-f1be73e7d374 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:59.712310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1ea078b4-5ffa-4097-bb48-f1be73e7d374 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:59.725744 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1ea078b4-5ffa-4097-bb48-f1be73e7d374 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1364 microversion: 2.1 time: 0.439188 Mar 12 20:59:59.727247 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2252/3020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 20:59:59 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1364 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 20:59:59.736852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-48be4ed8-2468-4cfd-b217-4a717bfc4db1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 20:59:59.743481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-48be4ed8-2468-4cfd-b217-4a717bfc4db1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:59.746607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-48be4ed8-2468-4cfd-b217-4a717bfc4db1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Searching by: {'deleted': False, 'project_id': '0c4d74d4abde4a1980632c4260fe2834'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 20:59:59.755405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48be4ed8-2468-4cfd-b217-4a717bfc4db1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:59.761095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48be4ed8-2468-4cfd-b217-4a717bfc4db1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:59.762185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48be4ed8-2468-4cfd-b217-4a717bfc4db1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:59.763221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48be4ed8-2468-4cfd-b217-4a717bfc4db1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 20:59:59.845929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-48be4ed8-2468-4cfd-b217-4a717bfc4db1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 20:59:59.947458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-48be4ed8-2468-4cfd-b217-4a717bfc4db1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 20:59:59.955737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48be4ed8-2468-4cfd-b217-4a717bfc4db1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 20:59:59.956666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48be4ed8-2468-4cfd-b217-4a717bfc4db1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:00.226312 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-48be4ed8-2468-4cfd-b217-4a717bfc4db1 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.497675 Mar 12 21:00:00.240631 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2253/3021] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 20:59:59 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:00.245704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c43d3900-d6b1-4aa6-9598-94778a14f015 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:00.246601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c43d3900-d6b1-4aa6-9598-94778a14f015 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:00.252725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c43d3900-d6b1-4aa6-9598-94778a14f015 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:00.253240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c43d3900-d6b1-4aa6-9598-94778a14f015 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:00.254250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c43d3900-d6b1-4aa6-9598-94778a14f015 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:00.254695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c43d3900-d6b1-4aa6-9598-94778a14f015 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:00.477865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c43d3900-d6b1-4aa6-9598-94778a14f015 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:00.496716 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c43d3900-d6b1-4aa6-9598-94778a14f015 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1501 microversion: 2.1 time: 0.254709 Mar 12 21:00:00.497863 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2254/3022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:00 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1501 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:00.504012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf4ab1b2-8968-4b3f-b238-2b49748c1c78 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:00.509272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bf4ab1b2-8968-4b3f-b238-2b49748c1c78 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:00.510539 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bf4ab1b2-8968-4b3f-b238-2b49748c1c78 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011412 Mar 12 21:00:00.513066 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2255/3023] 10.222.0.30 () {58 vars in 1177 bytes} [Sat Mar 12 21:00:00 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:00:00.517880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6d4f2d28-398c-449b-b630-3186473322f6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:00.518774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6d4f2d28-398c-449b-b630-3186473322f6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:00.527143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d4f2d28-398c-449b-b630-3186473322f6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:00.527796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d4f2d28-398c-449b-b630-3186473322f6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:00.528835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d4f2d28-398c-449b-b630-3186473322f6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:00.529598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d4f2d28-398c-449b-b630-3186473322f6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:00.741026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6d4f2d28-398c-449b-b630-3186473322f6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:00.749113 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6d4f2d28-398c-449b-b630-3186473322f6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1514 microversion: 2.1 time: 0.234693 Mar 12 21:00:00.750198 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2256/3024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:00 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:00.768098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30915d36-a6b3-47ed-83d9-e9d7af12af1c tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:00.771633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-30915d36-a6b3-47ed-83d9-e9d7af12af1c tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:00.772300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-30915d36-a6b3-47ed-83d9-e9d7af12af1c tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Searching by: {'deleted': False, 'project_id': '0c4d74d4abde4a1980632c4260fe2834'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 21:00:00.785393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30915d36-a6b3-47ed-83d9-e9d7af12af1c tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:00.785879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30915d36-a6b3-47ed-83d9-e9d7af12af1c tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:00.786687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30915d36-a6b3-47ed-83d9-e9d7af12af1c tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:00.787170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30915d36-a6b3-47ed-83d9-e9d7af12af1c tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:00.816988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-30915d36-a6b3-47ed-83d9-e9d7af12af1c tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 21:00:00.857329 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30915d36-a6b3-47ed-83d9-e9d7af12af1c tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.100288 Mar 12 21:00:00.864848 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2257/3025] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 21:00:00 2022] GET /compute/v2.1/servers => generated 683 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:00.871454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5739907c-fd09-4b2c-a673-59a4e94da946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:00.872314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5739907c-fd09-4b2c-a673-59a4e94da946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:00.879281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5739907c-fd09-4b2c-a673-59a4e94da946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:00.880389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5739907c-fd09-4b2c-a673-59a4e94da946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:00.882138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5739907c-fd09-4b2c-a673-59a4e94da946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:00.882868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5739907c-fd09-4b2c-a673-59a4e94da946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:01.077881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5739907c-fd09-4b2c-a673-59a4e94da946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:01.085554 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5739907c-fd09-4b2c-a673-59a4e94da946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1364 microversion: 2.1 time: 0.218850 Mar 12 21:00:01.086159 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2258/3026] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:00 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:01.096344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e08f736-6167-462d-9e8f-b9991f8c0800 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:01.097543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e08f736-6167-462d-9e8f-b9991f8c0800 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: 3f83fec2-4aa3-4ef6-bba6-60c5005dbe10] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:01.109958 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8e08f736-6167-462d-9e8f-b9991f8c0800 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] HTTP exception thrown: Instance 3f83fec2-4aa3-4ef6-bba6-60c5005dbe10 could not be found. Mar 12 21:00:01.110370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e08f736-6167-462d-9e8f-b9991f8c0800 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Returning 404 to user: Instance 3f83fec2-4aa3-4ef6-bba6-60c5005dbe10 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:00:01.112640 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8e08f736-6167-462d-9e8f-b9991f8c0800 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/3f83fec2-4aa3-4ef6-bba6-60c5005dbe10/action" status: 404 len: 111 microversion: 2.1 time: 0.025549 Mar 12 21:00:01.120009 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2259/3027] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:00:01 2022] POST /compute/v2.1/servers/3f83fec2-4aa3-4ef6-bba6-60c5005dbe10/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:00:01.126379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6c78ac71-74b2-4d59-866d-4e2fa74cb535 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:01.128143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6c78ac71-74b2-4d59-866d-4e2fa74cb535 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:01.150049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c78ac71-74b2-4d59-866d-4e2fa74cb535 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:01.150049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c78ac71-74b2-4d59-866d-4e2fa74cb535 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:01.150049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c78ac71-74b2-4d59-866d-4e2fa74cb535 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:01.150049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c78ac71-74b2-4d59-866d-4e2fa74cb535 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:01.168526 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-6c78ac71-74b2-4d59-866d-4e2fa74cb535 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] HTTP exception thrown: Instance c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 could not be found. Mar 12 21:00:01.169470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6c78ac71-74b2-4d59-866d-4e2fa74cb535 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Returning 404 to user: Instance c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:00:01.171069 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6c78ac71-74b2-4d59-866d-4e2fa74cb535 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9" status: 404 len: 111 microversion: 2.1 time: 0.049438 Mar 12 21:00:01.172170 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2260/3028] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:00:01 2022] DELETE /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:00:01.179141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ab54c9b-b270-4c56-8933-afd06801cb44 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:01.179960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ab54c9b-b270-4c56-8933-afd06801cb44 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:01.187279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ab54c9b-b270-4c56-8933-afd06801cb44 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:01.188179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ab54c9b-b270-4c56-8933-afd06801cb44 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:01.189491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ab54c9b-b270-4c56-8933-afd06801cb44 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:01.190220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ab54c9b-b270-4c56-8933-afd06801cb44 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:01.284624 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ab54c9b-b270-4c56-8933-afd06801cb44 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action" status: 202 len: 0 microversion: 2.1 time: 0.110992 Mar 12 21:00:01.285682 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2261/3029] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:00:01 2022] POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:00:01.301679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-188818e0-3a77-4858-ab71-7f947eb59360 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:01.302453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-188818e0-3a77-4858-ab71-7f947eb59360 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 0af92fc6-c1fa-4a32-a0e9-124941433e1b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:01.319386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-188818e0-3a77-4858-ab71-7f947eb59360 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:01.319909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-188818e0-3a77-4858-ab71-7f947eb59360 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:01.320750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-188818e0-3a77-4858-ab71-7f947eb59360 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:01.321922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-188818e0-3a77-4858-ab71-7f947eb59360 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:01.370046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-188818e0-3a77-4858-ab71-7f947eb59360 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 0af92fc6-c1fa-4a32-a0e9-124941433e1b] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:00:01.544567 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-188818e0-3a77-4858-ab71-7f947eb59360 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0af92fc6-c1fa-4a32-a0e9-124941433e1b" status: 204 len: 0 microversion: 2.1 time: 0.253078 Mar 12 21:00:01.545761 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2262/3030] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:00:01 2022] DELETE /compute/v2.1/servers/0af92fc6-c1fa-4a32-a0e9-124941433e1b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:00:01.567063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b2208a36-9f7a-4497-864a-10f89255d19f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:01.568712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b2208a36-9f7a-4497-864a-10f89255d19f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:01.585257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2208a36-9f7a-4497-864a-10f89255d19f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:01.586344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2208a36-9f7a-4497-864a-10f89255d19f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:01.587616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2208a36-9f7a-4497-864a-10f89255d19f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:01.588129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2208a36-9f7a-4497-864a-10f89255d19f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:01.907987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b2208a36-9f7a-4497-864a-10f89255d19f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:01.915850 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b2208a36-9f7a-4497-864a-10f89255d19f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1499 microversion: 2.1 time: 0.364654 Mar 12 21:00:01.916430 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2263/3031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:01 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1499 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:01.928033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c647a1f-b06e-437a-8cec-ea539e4bcfba tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:01.928542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c647a1f-b06e-437a-8cec-ea539e4bcfba tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:01.936921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c647a1f-b06e-437a-8cec-ea539e4bcfba tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:01.937551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c647a1f-b06e-437a-8cec-ea539e4bcfba tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:01.938441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c647a1f-b06e-437a-8cec-ea539e4bcfba tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:01.939525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c647a1f-b06e-437a-8cec-ea539e4bcfba tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:01.972255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c647a1f-b06e-437a-8cec-ea539e4bcfba tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:00:02.078223 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c647a1f-b06e-437a-8cec-ea539e4bcfba tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 204 len: 0 microversion: 2.1 time: 0.160517 Mar 12 21:00:02.079274 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2264/3032] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:00:01 2022] DELETE /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:00:02.092287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1aa24fc0-8634-45f0-9152-6557e0d93d2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:02.093659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1aa24fc0-8634-45f0-9152-6557e0d93d2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:02.101583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1aa24fc0-8634-45f0-9152-6557e0d93d2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:02.102773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1aa24fc0-8634-45f0-9152-6557e0d93d2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:02.103960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1aa24fc0-8634-45f0-9152-6557e0d93d2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:02.104633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1aa24fc0-8634-45f0-9152-6557e0d93d2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:02.134720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-1aa24fc0-8634-45f0-9152-6557e0d93d2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lazy-loading 'flavor' on Instance uuid b3b9fa34-2929-4ab9-b2d8-47c9949331e3 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:00:02.147862 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-1aa24fc0-8634-45f0-9152-6557e0d93d2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] HTTP exception thrown: Cannot 'rescue' instance b3b9fa34-2929-4ab9-b2d8-47c9949331e3 while it is in vm_state paused Mar 12 21:00:02.148591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1aa24fc0-8634-45f0-9152-6557e0d93d2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Returning 409 to user: Cannot 'rescue' instance b3b9fa34-2929-4ab9-b2d8-47c9949331e3 while it is in vm_state paused {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:00:02.149488 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1aa24fc0-8634-45f0-9152-6557e0d93d2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action" status: 409 len: 144 microversion: 2.1 time: 0.062036 Mar 12 21:00:02.150459 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2265/3033] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:00:02 2022] POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action => generated 144 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 21:00:02.155351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a90b844b-286b-44be-8d44-0efb2724c852 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:02.156034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a90b844b-286b-44be-8d44-0efb2724c852 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:02.162241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a90b844b-286b-44be-8d44-0efb2724c852 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:02.162765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a90b844b-286b-44be-8d44-0efb2724c852 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:02.163665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a90b844b-286b-44be-8d44-0efb2724c852 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:02.164233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a90b844b-286b-44be-8d44-0efb2724c852 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:02.178949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a90b844b-286b-44be-8d44-0efb2724c852 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] HTTP exception thrown: Instance c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 could not be found. Mar 12 21:00:02.179604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a90b844b-286b-44be-8d44-0efb2724c852 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Returning 404 to user: Instance c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:00:02.180431 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a90b844b-286b-44be-8d44-0efb2724c852 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9" status: 404 len: 111 microversion: 2.1 time: 0.029015 Mar 12 21:00:02.184214 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2266/3034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:02 2022] GET /compute/v2.1/servers/c8b3cd75-5b57-485c-ab3f-fb3c6c879fa9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:00:02.189031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c87238f-3323-4d65-b795-2132d8af8e13 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:02.189701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c87238f-3323-4d65-b795-2132d8af8e13 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:02.196479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c87238f-3323-4d65-b795-2132d8af8e13 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:02.197034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c87238f-3323-4d65-b795-2132d8af8e13 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:02.197719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c87238f-3323-4d65-b795-2132d8af8e13 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:02.198177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c87238f-3323-4d65-b795-2132d8af8e13 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:02.510947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9c87238f-3323-4d65-b795-2132d8af8e13 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:02.520686 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c87238f-3323-4d65-b795-2132d8af8e13 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1364 microversion: 2.1 time: 0.335371 Mar 12 21:00:02.525011 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2267/3035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:02 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1364 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:02.538679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-54759c16-5b43-4e17-a5b6-6e36d420a31e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:02.540166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-54759c16-5b43-4e17-a5b6-6e36d420a31e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:02.559833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54759c16-5b43-4e17-a5b6-6e36d420a31e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:02.560297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54759c16-5b43-4e17-a5b6-6e36d420a31e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:02.561918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54759c16-5b43-4e17-a5b6-6e36d420a31e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:02.562442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54759c16-5b43-4e17-a5b6-6e36d420a31e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:02.705376 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-54759c16-5b43-4e17-a5b6-6e36d420a31e tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action" status: 202 len: 0 microversion: 2.1 time: 0.178655 Mar 12 21:00:02.718843 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2268/3036] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:00:02 2022] POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:00:02.746700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ea1852e-5666-4af4-9cc0-23de5b869421 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:02.753149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ea1852e-5666-4af4-9cc0-23de5b869421 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 0af92fc6-c1fa-4a32-a0e9-124941433e1b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:02.765905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ea1852e-5666-4af4-9cc0-23de5b869421 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:02.768683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ea1852e-5666-4af4-9cc0-23de5b869421 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:02.771699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ea1852e-5666-4af4-9cc0-23de5b869421 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:02.772175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ea1852e-5666-4af4-9cc0-23de5b869421 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:03.148070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ea1852e-5666-4af4-9cc0-23de5b869421 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:03.159670 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ea1852e-5666-4af4-9cc0-23de5b869421 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/0af92fc6-c1fa-4a32-a0e9-124941433e1b" status: 200 len: 1522 microversion: 2.1 time: 0.435421 Mar 12 21:00:03.160573 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2269/3037] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:02 2022] GET /compute/v2.1/servers/0af92fc6-c1fa-4a32-a0e9-124941433e1b => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:03.165703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-888b369c-261e-473f-9ee6-7dc71e6fd58c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:03.166351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-888b369c-261e-473f-9ee6-7dc71e6fd58c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:03.179969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-888b369c-261e-473f-9ee6-7dc71e6fd58c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:03.180665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-888b369c-261e-473f-9ee6-7dc71e6fd58c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:03.181657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-888b369c-261e-473f-9ee6-7dc71e6fd58c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:03.189752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-888b369c-261e-473f-9ee6-7dc71e6fd58c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:03.461242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-888b369c-261e-473f-9ee6-7dc71e6fd58c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:03.472836 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-888b369c-261e-473f-9ee6-7dc71e6fd58c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1514 microversion: 2.1 time: 0.311073 Mar 12 21:00:03.473833 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2270/3038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:03 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1514 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:03.539736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c407a92b-205f-4085-83b1-18450456fc78 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:03.540556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c407a92b-205f-4085-83b1-18450456fc78 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:03.547569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c407a92b-205f-4085-83b1-18450456fc78 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:03.548030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c407a92b-205f-4085-83b1-18450456fc78 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:03.548814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c407a92b-205f-4085-83b1-18450456fc78 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:03.549294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c407a92b-205f-4085-83b1-18450456fc78 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:04.034810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c407a92b-205f-4085-83b1-18450456fc78 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:04.044425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c407a92b-205f-4085-83b1-18450456fc78 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1364 microversion: 2.1 time: 0.509671 Mar 12 21:00:04.046287 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2271/3039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:03 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1364 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:04.068129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f4d3b6d3-a118-4b77-ae20-9891e33742c3 req-87bc66ca-5475-4b7c-b7c9-a4c7d2087515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af92fc6-c1fa-4a32-a0e9-124941433e1b", "name": "network-vif-deleted", "tag": "4db3d0df-df75-4593-bf71-d04925ab9a0f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:04.099107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f4d3b6d3-a118-4b77-ae20-9891e33742c3 req-87bc66ca-5475-4b7c-b7c9-a4c7d2087515 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:04.101185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f4d3b6d3-a118-4b77-ae20-9891e33742c3 req-87bc66ca-5475-4b7c-b7c9-a4c7d2087515 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:04.139354 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f4d3b6d3-a118-4b77-ae20-9891e33742c3 req-87bc66ca-5475-4b7c-b7c9-a4c7d2087515 service nova] Creating event network-vif-deleted:4db3d0df-df75-4593-bf71-d04925ab9a0f for instance 0af92fc6-c1fa-4a32-a0e9-124941433e1b on nch1-master-1 Mar 12 21:00:04.159420 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f4d3b6d3-a118-4b77-ae20-9891e33742c3 req-87bc66ca-5475-4b7c-b7c9-a4c7d2087515 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111441 Mar 12 21:00:04.160029 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2272/3040] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:04.176843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4732a2c5-b9e9-46a0-932f-5ebe2183c3b7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:04.184913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4732a2c5-b9e9-46a0-932f-5ebe2183c3b7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 0af92fc6-c1fa-4a32-a0e9-124941433e1b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:04.192147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4732a2c5-b9e9-46a0-932f-5ebe2183c3b7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:04.192911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4732a2c5-b9e9-46a0-932f-5ebe2183c3b7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:04.215731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4732a2c5-b9e9-46a0-932f-5ebe2183c3b7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:04.221864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4732a2c5-b9e9-46a0-932f-5ebe2183c3b7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:04.260106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4732a2c5-b9e9-46a0-932f-5ebe2183c3b7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:04.260561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4732a2c5-b9e9-46a0-932f-5ebe2183c3b7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:04.261141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-4732a2c5-b9e9-46a0-932f-5ebe2183c3b7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lazy-loading 'fault' on Instance uuid 0af92fc6-c1fa-4a32-a0e9-124941433e1b {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:00:04.316163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4732a2c5-b9e9-46a0-932f-5ebe2183c3b7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb028ec905dc42279c10c3dd9ce8ae34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c4d74d4abde4a1980632c4260fe2834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:04.324685 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4732a2c5-b9e9-46a0-932f-5ebe2183c3b7 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/0af92fc6-c1fa-4a32-a0e9-124941433e1b" status: 200 len: 1313 microversion: 2.1 time: 0.151950 Mar 12 21:00:04.335778 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2273/3041] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:04 2022] GET /compute/v2.1/servers/0af92fc6-c1fa-4a32-a0e9-124941433e1b => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:04.989208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fbb954d3-166c-41d5-8540-c313225496eb req-f97d9d77-4df5-47fc-8a89-d947ee8c5bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3", "name": "network-vif-deleted", "tag": "e65503ae-b942-4b25-bf05-a2df74b1e90c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:05.000108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fbb954d3-166c-41d5-8540-c313225496eb req-f97d9d77-4df5-47fc-8a89-d947ee8c5bc3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:05.000108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fbb954d3-166c-41d5-8540-c313225496eb req-f97d9d77-4df5-47fc-8a89-d947ee8c5bc3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:05.026671 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fbb954d3-166c-41d5-8540-c313225496eb req-f97d9d77-4df5-47fc-8a89-d947ee8c5bc3 service nova] Creating event network-vif-deleted:e65503ae-b942-4b25-bf05-a2df74b1e90c for instance 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 on nch2-master-1 Mar 12 21:00:05.032258 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fbb954d3-166c-41d5-8540-c313225496eb req-f97d9d77-4df5-47fc-8a89-d947ee8c5bc3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046581 Mar 12 21:00:05.033183 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2274/3042] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:00:05.065180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7c02b276-68ec-4552-b139-a68f4898f907 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:05.066636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7c02b276-68ec-4552-b139-a68f4898f907 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:05.073757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c02b276-68ec-4552-b139-a68f4898f907 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:05.074528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c02b276-68ec-4552-b139-a68f4898f907 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:05.075610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c02b276-68ec-4552-b139-a68f4898f907 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:05.076558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c02b276-68ec-4552-b139-a68f4898f907 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:05.638727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7c02b276-68ec-4552-b139-a68f4898f907 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:05.648808 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7c02b276-68ec-4552-b139-a68f4898f907 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1364 microversion: 2.1 time: 0.587709 Mar 12 21:00:05.650811 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2275/3043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:05 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1364 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:00:05.658007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cba7756c-b025-44f8-8ea2-53823f68951b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:05.659205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cba7756c-b025-44f8-8ea2-53823f68951b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:05.673002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cba7756c-b025-44f8-8ea2-53823f68951b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:05.673705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cba7756c-b025-44f8-8ea2-53823f68951b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:05.674842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cba7756c-b025-44f8-8ea2-53823f68951b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:05.675648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cba7756c-b025-44f8-8ea2-53823f68951b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:05.705977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-cba7756c-b025-44f8-8ea2-53823f68951b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lazy-loading 'flavor' on Instance uuid b3b9fa34-2929-4ab9-b2d8-47c9949331e3 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:00:05.824526 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cba7756c-b025-44f8-8ea2-53823f68951b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action" status: 200 len: 32 microversion: 2.1 time: 0.170802 Mar 12 21:00:05.838180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2276/3044] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:00:05 2022] POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:00:05.856728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f990a582-2cfb-4bb0-82d2-b7334b600208 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:05.856728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f990a582-2cfb-4bb0-82d2-b7334b600208 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 0af92fc6-c1fa-4a32-a0e9-124941433e1b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:05.882021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f990a582-2cfb-4bb0-82d2-b7334b600208 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:05.884120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f990a582-2cfb-4bb0-82d2-b7334b600208 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:05.884985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f990a582-2cfb-4bb0-82d2-b7334b600208 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:05.886351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f990a582-2cfb-4bb0-82d2-b7334b600208 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:05.924644 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f990a582-2cfb-4bb0-82d2-b7334b600208 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] HTTP exception thrown: Instance 0af92fc6-c1fa-4a32-a0e9-124941433e1b could not be found. Mar 12 21:00:05.925423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f990a582-2cfb-4bb0-82d2-b7334b600208 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Returning 404 to user: Instance 0af92fc6-c1fa-4a32-a0e9-124941433e1b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:00:05.926294 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f990a582-2cfb-4bb0-82d2-b7334b600208 tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/0af92fc6-c1fa-4a32-a0e9-124941433e1b" status: 404 len: 111 microversion: 2.1 time: 0.084126 Mar 12 21:00:05.926856 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2277/3045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:05 2022] GET /compute/v2.1/servers/0af92fc6-c1fa-4a32-a0e9-124941433e1b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:00:05.941649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5da4d7eb-faf3-45f4-84c0-2a36bf9c41a1 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:05.942496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5da4d7eb-faf3-45f4-84c0-2a36bf9c41a1 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:05.953688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5da4d7eb-faf3-45f4-84c0-2a36bf9c41a1 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:05.958108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5da4d7eb-faf3-45f4-84c0-2a36bf9c41a1 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:05.961655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5da4d7eb-faf3-45f4-84c0-2a36bf9c41a1 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:05.962345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5da4d7eb-faf3-45f4-84c0-2a36bf9c41a1 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:06.163231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5da4d7eb-faf3-45f4-84c0-2a36bf9c41a1 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:06.176444 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5da4d7eb-faf3-45f4-84c0-2a36bf9c41a1 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1520 microversion: 2.1 time: 0.243573 Mar 12 21:00:06.186580 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2278/3046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:05 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:06.192839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3e5f434e-6538-40a0-ad55-3cc1827a024b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:06.193500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3e5f434e-6538-40a0-ad55-3cc1827a024b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] [instance: 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:06.201217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e5f434e-6538-40a0-ad55-3cc1827a024b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:06.201688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e5f434e-6538-40a0-ad55-3cc1827a024b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:06.202540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e5f434e-6538-40a0-ad55-3cc1827a024b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:06.202986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e5f434e-6538-40a0-ad55-3cc1827a024b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:06.217725 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3e5f434e-6538-40a0-ad55-3cc1827a024b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] HTTP exception thrown: Instance 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 could not be found. Mar 12 21:00:06.218699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3e5f434e-6538-40a0-ad55-3cc1827a024b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] Returning 404 to user: Instance 5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:00:06.219538 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3e5f434e-6538-40a0-ad55-3cc1827a024b tempest-ListServersNegativeTestJSON-417221502 tempest-ListServersNegativeTestJSON-417221502-project] 10.222.0.30 "GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3" status: 404 len: 111 microversion: 2.1 time: 0.031659 Mar 12 21:00:06.221000 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2279/3047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:06 2022] GET /compute/v2.1/servers/5b3ec71e-0e57-4b30-bd2d-2e89aa3056d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:00:06.236823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bc32d481-80ab-4c33-9d3d-76f15d75a638 req-e777e45c-69e0-4da3-ac04-6de1da97cf2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e537d16d-478d-4375-a61a-c28f8a785539", "name": "network-vif-plugged", "status": "completed", "tag": "e0808d11-4cd5-4e52-88b4-c9eaec2126e6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:06.247044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bc32d481-80ab-4c33-9d3d-76f15d75a638 req-e777e45c-69e0-4da3-ac04-6de1da97cf2c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:06.247767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bc32d481-80ab-4c33-9d3d-76f15d75a638 req-e777e45c-69e0-4da3-ac04-6de1da97cf2c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:06.262887 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bc32d481-80ab-4c33-9d3d-76f15d75a638 req-e777e45c-69e0-4da3-ac04-6de1da97cf2c service nova] Creating event network-vif-plugged:e0808d11-4cd5-4e52-88b4-c9eaec2126e6 for instance e537d16d-478d-4375-a61a-c28f8a785539 on nch2-master-1 Mar 12 21:00:06.272976 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bc32d481-80ab-4c33-9d3d-76f15d75a638 req-e777e45c-69e0-4da3-ac04-6de1da97cf2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050375 Mar 12 21:00:06.274881 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2280/3048] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:06.670490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b59dd1b-2573-4364-9615-0a0874f237f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:06.671454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b59dd1b-2573-4364-9615-0a0874f237f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:06.682046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b59dd1b-2573-4364-9615-0a0874f237f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:06.682791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b59dd1b-2573-4364-9615-0a0874f237f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:06.683782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b59dd1b-2573-4364-9615-0a0874f237f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:06.684418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b59dd1b-2573-4364-9615-0a0874f237f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:06.978006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b59dd1b-2573-4364-9615-0a0874f237f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:06.987355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b59dd1b-2573-4364-9615-0a0874f237f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1364 microversion: 2.1 time: 0.323721 Mar 12 21:00:06.997532 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2281/3049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:06 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1364 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:07.194613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1fe8e8b1-ef20-46f9-96cc-3646340815de tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:07.195059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1fe8e8b1-ef20-46f9-96cc-3646340815de tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:07.201216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fe8e8b1-ef20-46f9-96cc-3646340815de tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:07.201704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fe8e8b1-ef20-46f9-96cc-3646340815de tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:07.206204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fe8e8b1-ef20-46f9-96cc-3646340815de tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:07.206204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fe8e8b1-ef20-46f9-96cc-3646340815de tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:07.324137 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:00:07.325138 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:00:07.385559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1fe8e8b1-ef20-46f9-96cc-3646340815de tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:07.394242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1fe8e8b1-ef20-46f9-96cc-3646340815de tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1520 microversion: 2.1 time: 0.204738 Mar 12 21:00:07.395437 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2282/3050] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:07 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:07.582484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c4bc683-1d37-484f-8004-5ad4520c1b82 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e36f00790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:07.662542 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c4bc683-1d37-484f-8004-5ad4520c1b82 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/1387d1dc-a1f8-4058-b1f0-52d9acd1be3c" status: 200 len: 661 microversion: 2.1 time: 0.084912 Mar 12 21:00:07.663182 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2283/3051] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:00:07 2022] GET /compute/v2.1/images/1387d1dc-a1f8-4058-b1f0-52d9acd1be3c => generated 661 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:00:07.682908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-018d4d4b-971b-475f-84fc-bf41c7276327 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e36cf1b80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:07.830924 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-018d4d4b-971b-475f-84fc-bf41c7276327 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/1387d1dc-a1f8-4058-b1f0-52d9acd1be3c" status: 200 len: 661 microversion: 2.1 time: 0.158351 Mar 12 21:00:07.831583 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2284/3052] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:00:07 2022] GET /compute/v2.1/images/1387d1dc-a1f8-4058-b1f0-52d9acd1be3c => generated 661 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:08.004901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-797e51de-0924-4482-9156-1640b3d23617 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:08.006166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-797e51de-0924-4482-9156-1640b3d23617 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:08.016125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-797e51de-0924-4482-9156-1640b3d23617 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:08.016828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-797e51de-0924-4482-9156-1640b3d23617 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:08.019804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-797e51de-0924-4482-9156-1640b3d23617 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:08.020509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-797e51de-0924-4482-9156-1640b3d23617 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:08.188946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-797e51de-0924-4482-9156-1640b3d23617 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:08.199472 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-797e51de-0924-4482-9156-1640b3d23617 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1551 microversion: 2.1 time: 0.199033 Mar 12 21:00:08.200113 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2285/3053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:07 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1551 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:00:08.216521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e81abb7d-acc7-4fa3-af80-411274a921ba tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:08.217542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e81abb7d-acc7-4fa3-af80-411274a921ba tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:08.230106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e81abb7d-acc7-4fa3-af80-411274a921ba tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:08.230561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e81abb7d-acc7-4fa3-af80-411274a921ba tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:08.231588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e81abb7d-acc7-4fa3-af80-411274a921ba tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:08.231960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e81abb7d-acc7-4fa3-af80-411274a921ba tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:08.338630 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e81abb7d-acc7-4fa3-af80-411274a921ba tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125883 Mar 12 21:00:08.339262 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2286/3054] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 21:00:08 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:00:08.414340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-11ffbd44-19ae-47f8-bd15-8c9c5140c107 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:08.414976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-11ffbd44-19ae-47f8-bd15-8c9c5140c107 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:08.424166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11ffbd44-19ae-47f8-bd15-8c9c5140c107 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:08.425360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11ffbd44-19ae-47f8-bd15-8c9c5140c107 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:08.426698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11ffbd44-19ae-47f8-bd15-8c9c5140c107 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:08.427958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11ffbd44-19ae-47f8-bd15-8c9c5140c107 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:08.652744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-11ffbd44-19ae-47f8-bd15-8c9c5140c107 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:08.662730 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-11ffbd44-19ae-47f8-bd15-8c9c5140c107 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1520 microversion: 2.1 time: 0.253053 Mar 12 21:00:08.673449 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2287/3055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:08 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:00:09.256361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f88a988f-fe7a-4cbc-818d-3fc114fbf747 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e36cf1b80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:09.306028 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f88a988f-fe7a-4cbc-818d-3fc114fbf747 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/7a1b7cf6-6ca8-49d5-babb-4099bb61b286" status: 200 len: 661 microversion: 2.1 time: 0.054561 Mar 12 21:00:09.306700 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2288/3056] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:00:09 2022] GET /compute/v2.1/images/7a1b7cf6-6ca8-49d5-babb-4099bb61b286 => generated 661 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:09.319002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d5717d61-59bf-43dc-9856-00dff2356baf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e36253160>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:09.377977 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d5717d61-59bf-43dc-9856-00dff2356baf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/7a1b7cf6-6ca8-49d5-babb-4099bb61b286" status: 200 len: 661 microversion: 2.1 time: 0.063995 Mar 12 21:00:09.379303 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2289/3057] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:00:09 2022] GET /compute/v2.1/images/7a1b7cf6-6ca8-49d5-babb-4099bb61b286 => generated 661 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:09.681248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-040330ec-2b40-49ce-bb01-345c41e1214d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:09.682175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-040330ec-2b40-49ce-bb01-345c41e1214d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:09.690936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-040330ec-2b40-49ce-bb01-345c41e1214d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:09.691136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-040330ec-2b40-49ce-bb01-345c41e1214d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:09.692151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-040330ec-2b40-49ce-bb01-345c41e1214d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:09.692803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-040330ec-2b40-49ce-bb01-345c41e1214d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:10.034261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-040330ec-2b40-49ce-bb01-345c41e1214d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:10.045813 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-040330ec-2b40-49ce-bb01-345c41e1214d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1520 microversion: 2.1 time: 0.369248 Mar 12 21:00:10.046799 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2290/3058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:09 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:00:10.058726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cc77e14f-4af6-4aa6-a480-914f505ba67c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:10.060716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc77e14f-4af6-4aa6-a480-914f505ba67c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:10.078229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc77e14f-4af6-4aa6-a480-914f505ba67c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:10.078948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc77e14f-4af6-4aa6-a480-914f505ba67c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:10.080846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc77e14f-4af6-4aa6-a480-914f505ba67c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:10.081501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc77e14f-4af6-4aa6-a480-914f505ba67c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:10.259802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cc77e14f-4af6-4aa6-a480-914f505ba67c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:10.268431 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cc77e14f-4af6-4aa6-a480-914f505ba67c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1551 microversion: 2.1 time: 0.219705 Mar 12 21:00:10.269025 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2291/3059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:10 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1551 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:10.275284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b9a07670-8fbe-4524-b059-3cda925b1d0a req-16f2ee57-7ead-45df-a8c5-5a9f47e219bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e537d16d-478d-4375-a61a-c28f8a785539", "tag": "e0808d11-4cd5-4e52-88b4-c9eaec2126e6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:10.285541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b9a07670-8fbe-4524-b059-3cda925b1d0a req-16f2ee57-7ead-45df-a8c5-5a9f47e219bb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:10.286235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b9a07670-8fbe-4524-b059-3cda925b1d0a req-16f2ee57-7ead-45df-a8c5-5a9f47e219bb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:10.299786 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b9a07670-8fbe-4524-b059-3cda925b1d0a req-16f2ee57-7ead-45df-a8c5-5a9f47e219bb service nova] Creating event network-changed:e0808d11-4cd5-4e52-88b4-c9eaec2126e6 for instance e537d16d-478d-4375-a61a-c28f8a785539 on nch2-master-1 Mar 12 21:00:10.306378 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b9a07670-8fbe-4524-b059-3cda925b1d0a req-16f2ee57-7ead-45df-a8c5-5a9f47e219bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034524 Mar 12 21:00:10.307534 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2292/3060] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:10.605051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-139103864", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "7e041378-aab7-4757-ac84-a57d7bff85ab"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:10.665158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] validate_networks() for [('7e041378-aab7-4757-ac84-a57d7bff85ab', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:00:11.097827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:00:11.098353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:00:11.098981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:00:11.099502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:00:11.100597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:00:11.110713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:11.111256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:11.112433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:11.112986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:11.146931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Getting quotas for project f8a66fc7389649178ee00d3759c89637. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:00:11.155511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Getting quotas for user 23a911ec76994984ae25c5648825d6a4 and project f8a66fc7389649178ee00d3759c89637. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:00:11.176885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:00:11.180577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:00:11.272041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1cb1e87-05e1-42a5-9b5a-7e54ab70e264 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961742 Mar 12 21:00:11.273259 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2293/3061] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:00:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:00:11.285399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-77139e25-6010-47da-a2e7-df87b49b690b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:11.286103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-77139e25-6010-47da-a2e7-df87b49b690b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:11.301526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77139e25-6010-47da-a2e7-df87b49b690b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:11.303002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77139e25-6010-47da-a2e7-df87b49b690b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:11.304112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77139e25-6010-47da-a2e7-df87b49b690b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:11.305058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77139e25-6010-47da-a2e7-df87b49b690b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:11.510374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-77139e25-6010-47da-a2e7-df87b49b690b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:11.521637 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-77139e25-6010-47da-a2e7-df87b49b690b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.245096 Mar 12 21:00:11.522525 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2294/3062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:11 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:11.532328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd8ad39a-a311-4864-87c2-701630d9c1d0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:11.533222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dd8ad39a-a311-4864-87c2-701630d9c1d0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:11.543555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd8ad39a-a311-4864-87c2-701630d9c1d0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:11.544372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd8ad39a-a311-4864-87c2-701630d9c1d0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:11.545912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd8ad39a-a311-4864-87c2-701630d9c1d0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:11.546630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd8ad39a-a311-4864-87c2-701630d9c1d0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:11.745789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dd8ad39a-a311-4864-87c2-701630d9c1d0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:11.754440 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd8ad39a-a311-4864-87c2-701630d9c1d0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1520 microversion: 2.1 time: 0.226493 Mar 12 21:00:11.756275 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2295/3063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:11 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:11.761116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a6485751-370c-4696-950a-c32ce7b0f458 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:11.761938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a6485751-370c-4696-950a-c32ce7b0f458 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:11.819140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a6485751-370c-4696-950a-c32ce7b0f458 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:11.826539 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a6485751-370c-4696-950a-c32ce7b0f458 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1224 microversion: 2.1 time: 0.068977 Mar 12 21:00:11.838971 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2296/3064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:11 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:11.844049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b807d046-6472-4416-b574-110232a81a3b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e366f7940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:11.893566 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b807d046-6472-4416-b574-110232a81a3b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/e71b20ad-bce8-4da5-9a81-2038867e1de0" status: 200 len: 661 microversion: 2.1 time: 0.053421 Mar 12 21:00:11.894659 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2297/3065] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:00:11 2022] GET /compute/v2.1/images/e71b20ad-bce8-4da5-9a81-2038867e1de0 => generated 661 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:11.906769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb96f58b-55c1-4695-b36c-e96a32de332d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:11.910132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb96f58b-55c1-4695-b36c-e96a32de332d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:11.920299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb96f58b-55c1-4695-b36c-e96a32de332d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:11.920960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb96f58b-55c1-4695-b36c-e96a32de332d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:11.921966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb96f58b-55c1-4695-b36c-e96a32de332d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:11.922817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb96f58b-55c1-4695-b36c-e96a32de332d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:12.126906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bb96f58b-55c1-4695-b36c-e96a32de332d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:12.134555 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb96f58b-55c1-4695-b36c-e96a32de332d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.238566 Mar 12 21:00:12.135155 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2298/3066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:11 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:12.139858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b744144f-e408-4657-97db-7674da339f7f tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e36253310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:12.183968 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b744144f-e408-4657-97db-7674da339f7f tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/e71b20ad-bce8-4da5-9a81-2038867e1de0" status: 200 len: 661 microversion: 2.1 time: 0.047781 Mar 12 21:00:12.184889 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2299/3067] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:00:12 2022] GET /compute/v2.1/images/e71b20ad-bce8-4da5-9a81-2038867e1de0 => generated 661 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:12.190056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f83a5373-779f-4f7a-bb5b-8bde0bab7903 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-619399765"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:12.191886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f83a5373-779f-4f7a-bb5b-8bde0bab7903 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:12.198594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f83a5373-779f-4f7a-bb5b-8bde0bab7903 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:12.199373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f83a5373-779f-4f7a-bb5b-8bde0bab7903 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:12.200735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f83a5373-779f-4f7a-bb5b-8bde0bab7903 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:12.201649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f83a5373-779f-4f7a-bb5b-8bde0bab7903 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:12.510979 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f83a5373-779f-4f7a-bb5b-8bde0bab7903 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.324653 Mar 12 21:00:12.511987 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2300/3068] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:00:12 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Mar 12 21:00:12.517535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-119019197", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:12.582260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:00:13.072917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:00:13.073571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:00:13.074132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:00:13.074818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:00:13.075749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:00:13.088690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:13.089398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:13.090577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:13.092362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:13.119030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Getting quotas for project 2d942347b8f249009a27f50edb0d1531. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:00:13.126070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Getting quotas for user 17564478f6fd4b00bcaca106cedebb61 and project 2d942347b8f249009a27f50edb0d1531. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:00:13.141743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:00:13.144607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 8d0b657b-019a-495b-bf10-0b27962e3880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:00:13.202443 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-723f8fe3-dd45-4e1f-ac0b-244b298d0965 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688622 Mar 12 21:00:13.203693 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2301/3069] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:00:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:00:13.209472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c7bf7e9-36e2-4bda-a649-726f06b3c0a6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:13.210373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c7bf7e9-36e2-4bda-a649-726f06b3c0a6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:13.231784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c7bf7e9-36e2-4bda-a649-726f06b3c0a6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:13.234661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c7bf7e9-36e2-4bda-a649-726f06b3c0a6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:13.235332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c7bf7e9-36e2-4bda-a649-726f06b3c0a6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:13.235778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c7bf7e9-36e2-4bda-a649-726f06b3c0a6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:13.646648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c7bf7e9-36e2-4bda-a649-726f06b3c0a6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:13.659254 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c7bf7e9-36e2-4bda-a649-726f06b3c0a6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1520 microversion: 2.1 time: 0.454051 Mar 12 21:00:13.660145 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2302/3070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:13 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1520 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:13.677102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1ea2164a-f687-4b32-9179-c3ed321d05e5 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:13.677957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1ea2164a-f687-4b32-9179-c3ed321d05e5 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:13.687232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ea2164a-f687-4b32-9179-c3ed321d05e5 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:13.688464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ea2164a-f687-4b32-9179-c3ed321d05e5 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:13.690955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ea2164a-f687-4b32-9179-c3ed321d05e5 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:13.692067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ea2164a-f687-4b32-9179-c3ed321d05e5 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:14.222150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1ea2164a-f687-4b32-9179-c3ed321d05e5 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:14.230745 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1ea2164a-f687-4b32-9179-c3ed321d05e5 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1324 microversion: 2.1 time: 0.569533 Mar 12 21:00:14.231343 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2303/3071] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:13 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1324 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:14.236294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-821787362", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:14.301306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:00:15.240442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:00:15.241020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:00:15.241433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:00:15.243507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:00:15.243507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:00:15.254296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:15.254844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:15.256493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:15.257261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:15.280864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Getting quotas for project 2d942347b8f249009a27f50edb0d1531. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:00:15.291543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Getting quotas for user 17564478f6fd4b00bcaca106cedebb61 and project 2d942347b8f249009a27f50edb0d1531. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:00:15.316635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:00:15.319458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:00:15.403516 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51aaaca1-820e-4285-8500-d038375d1d8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170828 Mar 12 21:00:15.409071 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2304/3072] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:00:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:00:15.423596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2061d0e2-7cea-4f83-bf90-c26e174aaf78 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:15.425516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2061d0e2-7cea-4f83-bf90-c26e174aaf78 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:15.451866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2061d0e2-7cea-4f83-bf90-c26e174aaf78 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:15.452344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2061d0e2-7cea-4f83-bf90-c26e174aaf78 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:15.453162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2061d0e2-7cea-4f83-bf90-c26e174aaf78 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:15.453637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2061d0e2-7cea-4f83-bf90-c26e174aaf78 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:15.966031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2061d0e2-7cea-4f83-bf90-c26e174aaf78 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:15.981152 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2061d0e2-7cea-4f83-bf90-c26e174aaf78 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1520 microversion: 2.1 time: 0.569435 Mar 12 21:00:15.983240 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2305/3073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:15 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1520 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:15.997731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-db5e6d56-de7c-4898-aea3-f9b2df3b4d5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:16.000016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-db5e6d56-de7c-4898-aea3-f9b2df3b4d5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:16.015812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db5e6d56-de7c-4898-aea3-f9b2df3b4d5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:16.016418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db5e6d56-de7c-4898-aea3-f9b2df3b4d5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:16.017458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db5e6d56-de7c-4898-aea3-f9b2df3b4d5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:16.019866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db5e6d56-de7c-4898-aea3-f9b2df3b4d5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:16.468646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-db5e6d56-de7c-4898-aea3-f9b2df3b4d5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:16.477450 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-db5e6d56-de7c-4898-aea3-f9b2df3b4d5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1324 microversion: 2.1 time: 0.491557 Mar 12 21:00:16.486632 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2306/3074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:15 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1324 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:16.491720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dee9e87e-faa7-4418-af75-bc0ae3b36663 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:16.492991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dee9e87e-faa7-4418-af75-bc0ae3b36663 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:16.505152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dee9e87e-faa7-4418-af75-bc0ae3b36663 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:16.505636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dee9e87e-faa7-4418-af75-bc0ae3b36663 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:16.506451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dee9e87e-faa7-4418-af75-bc0ae3b36663 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:16.510881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dee9e87e-faa7-4418-af75-bc0ae3b36663 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:16.675833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dee9e87e-faa7-4418-af75-bc0ae3b36663 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:16.683425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dee9e87e-faa7-4418-af75-bc0ae3b36663 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1269 microversion: 2.1 time: 0.195462 Mar 12 21:00:16.684078 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2307/3075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:16 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1269 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:16.696788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0d4dca74-0fc6-4220-a70d-3ec0b3f4b724 req-976ed69f-1dae-49f7-8b59-f844dfa6f3bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04aee892-bcd6-408c-a6c5-4b066963804b", "tag": "9d0e0d96-36eb-4c58-879f-b88dbfb25a50"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:16.728002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0d4dca74-0fc6-4220-a70d-3ec0b3f4b724 req-976ed69f-1dae-49f7-8b59-f844dfa6f3bd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:16.728490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0d4dca74-0fc6-4220-a70d-3ec0b3f4b724 req-976ed69f-1dae-49f7-8b59-f844dfa6f3bd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:16.760952 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0d4dca74-0fc6-4220-a70d-3ec0b3f4b724 req-976ed69f-1dae-49f7-8b59-f844dfa6f3bd service nova] Creating event network-changed:9d0e0d96-36eb-4c58-879f-b88dbfb25a50 for instance 04aee892-bcd6-408c-a6c5-4b066963804b on nch1-master-1 Mar 12 21:00:16.773759 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0d4dca74-0fc6-4220-a70d-3ec0b3f4b724 req-976ed69f-1dae-49f7-8b59-f844dfa6f3bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087842 Mar 12 21:00:16.775257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2308/3076] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:17.004909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6e3aca8d-5ff2-4bab-ba42-5d891d5dccc0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:17.006979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6e3aca8d-5ff2-4bab-ba42-5d891d5dccc0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:17.014287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e3aca8d-5ff2-4bab-ba42-5d891d5dccc0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:17.015184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e3aca8d-5ff2-4bab-ba42-5d891d5dccc0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:17.016822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e3aca8d-5ff2-4bab-ba42-5d891d5dccc0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:17.017522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e3aca8d-5ff2-4bab-ba42-5d891d5dccc0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:17.411936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6e3aca8d-5ff2-4bab-ba42-5d891d5dccc0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:17.426779 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6e3aca8d-5ff2-4bab-ba42-5d891d5dccc0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1520 microversion: 2.1 time: 0.430019 Mar 12 21:00:17.440719 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2309/3077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:16 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:00:17.505075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a52fc7c-e775-47ae-bccb-2b6f59b2d4ad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:17.506589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a52fc7c-e775-47ae-bccb-2b6f59b2d4ad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:17.524890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a52fc7c-e775-47ae-bccb-2b6f59b2d4ad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:17.528138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a52fc7c-e775-47ae-bccb-2b6f59b2d4ad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:17.532685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a52fc7c-e775-47ae-bccb-2b6f59b2d4ad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:17.536023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a52fc7c-e775-47ae-bccb-2b6f59b2d4ad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:17.955023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9a52fc7c-e775-47ae-bccb-2b6f59b2d4ad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:17.969817 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a52fc7c-e775-47ae-bccb-2b6f59b2d4ad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1324 microversion: 2.1 time: 0.470339 Mar 12 21:00:17.987796 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2310/3078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:17 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1324 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:17.994178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-210a75c4-9994-4938-b1e9-142b6e7db6d4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:18.002080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-210a75c4-9994-4938-b1e9-142b6e7db6d4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:18.017587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-210a75c4-9994-4938-b1e9-142b6e7db6d4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:18.020230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-210a75c4-9994-4938-b1e9-142b6e7db6d4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:18.021287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-210a75c4-9994-4938-b1e9-142b6e7db6d4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:18.040210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-210a75c4-9994-4938-b1e9-142b6e7db6d4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:18.190995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-210a75c4-9994-4938-b1e9-142b6e7db6d4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:18.205582 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-210a75c4-9994-4938-b1e9-142b6e7db6d4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1275 microversion: 2.1 time: 0.216242 Mar 12 21:00:18.206216 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2311/3079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:17 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:18.219232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fac7e8be-23f1-490a-b971-3923adcd6452 req-790c87fd-43d9-4c2b-b551-a8744187f65a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0b657b-019a-495b-bf10-0b27962e3880", "tag": "ea6450b5-34ee-4f9d-8b0d-7a507ad2499d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:18.229698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fac7e8be-23f1-490a-b971-3923adcd6452 req-790c87fd-43d9-4c2b-b551-a8744187f65a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:18.233859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fac7e8be-23f1-490a-b971-3923adcd6452 req-790c87fd-43d9-4c2b-b551-a8744187f65a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:18.260226 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fac7e8be-23f1-490a-b971-3923adcd6452 req-790c87fd-43d9-4c2b-b551-a8744187f65a service nova] Creating event network-changed:ea6450b5-34ee-4f9d-8b0d-7a507ad2499d for instance 8d0b657b-019a-495b-bf10-0b27962e3880 on nch2-master-1 Mar 12 21:00:18.270384 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fac7e8be-23f1-490a-b971-3923adcd6452 req-790c87fd-43d9-4c2b-b551-a8744187f65a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062198 Mar 12 21:00:18.271858 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2312/3080] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:18.353066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-dd0723a9-30b7-4b50-9cb1-3eb4f2c98274 req-55cc8a9a-a48c-4b92-95ac-3a287a47e4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e537d16d-478d-4375-a61a-c28f8a785539", "name": "network-vif-plugged", "status": "completed", "tag": "e0808d11-4cd5-4e52-88b4-c9eaec2126e6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:18.371604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-dd0723a9-30b7-4b50-9cb1-3eb4f2c98274 req-55cc8a9a-a48c-4b92-95ac-3a287a47e4d2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:18.372420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-dd0723a9-30b7-4b50-9cb1-3eb4f2c98274 req-55cc8a9a-a48c-4b92-95ac-3a287a47e4d2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:18.391604 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-dd0723a9-30b7-4b50-9cb1-3eb4f2c98274 req-55cc8a9a-a48c-4b92-95ac-3a287a47e4d2 service nova] Creating event network-vif-plugged:e0808d11-4cd5-4e52-88b4-c9eaec2126e6 for instance e537d16d-478d-4375-a61a-c28f8a785539 on nch2-master-1 Mar 12 21:00:18.403707 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-dd0723a9-30b7-4b50-9cb1-3eb4f2c98274 req-55cc8a9a-a48c-4b92-95ac-3a287a47e4d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055130 Mar 12 21:00:18.408903 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2313/3081] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:18.447929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e4de4b35-67a3-495e-a881-e5d35f72aa21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:18.449212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e4de4b35-67a3-495e-a881-e5d35f72aa21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:18.463122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4de4b35-67a3-495e-a881-e5d35f72aa21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:18.466483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4de4b35-67a3-495e-a881-e5d35f72aa21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:18.467578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4de4b35-67a3-495e-a881-e5d35f72aa21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:18.469848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4de4b35-67a3-495e-a881-e5d35f72aa21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:18.917085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e4de4b35-67a3-495e-a881-e5d35f72aa21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:18.932718 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e4de4b35-67a3-495e-a881-e5d35f72aa21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1520 microversion: 2.1 time: 0.487697 Mar 12 21:00:18.945032 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2314/3082] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:18 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1520 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:18.990707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c1b68aa2-e363-4b00-9a1a-3426253ba55d tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:18.991696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c1b68aa2-e363-4b00-9a1a-3426253ba55d tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:19.002429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1b68aa2-e363-4b00-9a1a-3426253ba55d tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:19.003068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1b68aa2-e363-4b00-9a1a-3426253ba55d tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:19.010880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1b68aa2-e363-4b00-9a1a-3426253ba55d tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:19.011450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1b68aa2-e363-4b00-9a1a-3426253ba55d tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:19.425599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c1b68aa2-e363-4b00-9a1a-3426253ba55d tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:19.439662 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c1b68aa2-e363-4b00-9a1a-3426253ba55d tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1324 microversion: 2.1 time: 0.452685 Mar 12 21:00:19.440269 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2315/3083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:18 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1324 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:19.466605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-db683c9e-f504-4e9f-94d9-2a001d4b55a7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:19.468561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-db683c9e-f504-4e9f-94d9-2a001d4b55a7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:19.486275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db683c9e-f504-4e9f-94d9-2a001d4b55a7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:19.488483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db683c9e-f504-4e9f-94d9-2a001d4b55a7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:19.498881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db683c9e-f504-4e9f-94d9-2a001d4b55a7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:19.499603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db683c9e-f504-4e9f-94d9-2a001d4b55a7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:20.159484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-db683c9e-f504-4e9f-94d9-2a001d4b55a7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:20.170546 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-db683c9e-f504-4e9f-94d9-2a001d4b55a7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1317 microversion: 2.1 time: 0.716589 Mar 12 21:00:20.185003 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2316/3084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:19 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1317 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:20.201704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a8df620-b350-4d4c-a444-999fff9ba22f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:20.202862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0a8df620-b350-4d4c-a444-999fff9ba22f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:20.216610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a8df620-b350-4d4c-a444-999fff9ba22f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:20.217455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a8df620-b350-4d4c-a444-999fff9ba22f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:20.218538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a8df620-b350-4d4c-a444-999fff9ba22f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:20.219232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a8df620-b350-4d4c-a444-999fff9ba22f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:20.430813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0a8df620-b350-4d4c-a444-999fff9ba22f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:20.441920 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0a8df620-b350-4d4c-a444-999fff9ba22f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1520 microversion: 2.1 time: 0.255413 Mar 12 21:00:20.442523 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2317/3085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:20 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:20.457008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4afa5fc0-1647-4bed-9023-b399c69f7429 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:20.457614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4afa5fc0-1647-4bed-9023-b399c69f7429 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:20.469815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4afa5fc0-1647-4bed-9023-b399c69f7429 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:20.470284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4afa5fc0-1647-4bed-9023-b399c69f7429 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:20.473279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4afa5fc0-1647-4bed-9023-b399c69f7429 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:20.473740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4afa5fc0-1647-4bed-9023-b399c69f7429 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:20.754755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4afa5fc0-1647-4bed-9023-b399c69f7429 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:20.770678 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4afa5fc0-1647-4bed-9023-b399c69f7429 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1324 microversion: 2.1 time: 0.317740 Mar 12 21:00:20.772548 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2318/3086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:20 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:21.188436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2690f6fb-dabc-4cb1-8c15-819352f2e085 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:21.189945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2690f6fb-dabc-4cb1-8c15-819352f2e085 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:21.200151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2690f6fb-dabc-4cb1-8c15-819352f2e085 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:21.208070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2690f6fb-dabc-4cb1-8c15-819352f2e085 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:21.209220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2690f6fb-dabc-4cb1-8c15-819352f2e085 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:21.209863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2690f6fb-dabc-4cb1-8c15-819352f2e085 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:21.461967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2690f6fb-dabc-4cb1-8c15-819352f2e085 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:21.471973 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2690f6fb-dabc-4cb1-8c15-819352f2e085 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1317 microversion: 2.1 time: 0.288336 Mar 12 21:00:21.475732 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2319/3087] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:21 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:21.490369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e8f831aa-cfd2-4085-82d4-f989d65e0998 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:21.491277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e8f831aa-cfd2-4085-82d4-f989d65e0998 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:21.506392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8f831aa-cfd2-4085-82d4-f989d65e0998 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:21.506974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8f831aa-cfd2-4085-82d4-f989d65e0998 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:21.509585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8f831aa-cfd2-4085-82d4-f989d65e0998 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:21.510145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8f831aa-cfd2-4085-82d4-f989d65e0998 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:21.778871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8f831aa-cfd2-4085-82d4-f989d65e0998 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:21.789913 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e8f831aa-cfd2-4085-82d4-f989d65e0998 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1500 microversion: 2.1 time: 0.312862 Mar 12 21:00:21.790828 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2320/3088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:21 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1500 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:21.806801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-66ee55a0-fe3c-4c14-95c1-466cad3ad9ae tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:21.808050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-66ee55a0-fe3c-4c14-95c1-466cad3ad9ae tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:21.823139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66ee55a0-fe3c-4c14-95c1-466cad3ad9ae tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:21.823902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66ee55a0-fe3c-4c14-95c1-466cad3ad9ae tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:21.825164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66ee55a0-fe3c-4c14-95c1-466cad3ad9ae tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:21.825764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66ee55a0-fe3c-4c14-95c1-466cad3ad9ae tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:22.093142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-66ee55a0-fe3c-4c14-95c1-466cad3ad9ae tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:22.110129 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-66ee55a0-fe3c-4c14-95c1-466cad3ad9ae tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1324 microversion: 2.1 time: 0.313732 Mar 12 21:00:22.111503 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2321/3089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:21 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:22.118057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3bae87f-4d0e-45a9-bc9d-0a8f036e3a3b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2b4ff35-6d46-4d5b-896a-625a1abdc7b1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:22.119417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c3bae87f-4d0e-45a9-bc9d-0a8f036e3a3b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:22.126891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3bae87f-4d0e-45a9-bc9d-0a8f036e3a3b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:22.127588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3bae87f-4d0e-45a9-bc9d-0a8f036e3a3b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:22.128572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3bae87f-4d0e-45a9-bc9d-0a8f036e3a3b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:22.129210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3bae87f-4d0e-45a9-bc9d-0a8f036e3a3b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:22.159209 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c3bae87f-4d0e-45a9-bc9d-0a8f036e3a3b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] HTTP exception thrown: Cannot 'attach_volume' instance b3b9fa34-2929-4ab9-b2d8-47c9949331e3 while it is in vm_state rescued Mar 12 21:00:22.159810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3bae87f-4d0e-45a9-bc9d-0a8f036e3a3b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Returning 409 to user: Cannot 'attach_volume' instance b3b9fa34-2929-4ab9-b2d8-47c9949331e3 while it is in vm_state rescued {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:00:22.160813 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3bae87f-4d0e-45a9-bc9d-0a8f036e3a3b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048029 Mar 12 21:00:22.162606 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2322/3090] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:00:22 2022] POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 21:00:22.170329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d7c9f234-b247-4fa2-a681-99c0c2a1bf97 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:22.171094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d7c9f234-b247-4fa2-a681-99c0c2a1bf97 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:22.181402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7c9f234-b247-4fa2-a681-99c0c2a1bf97 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:22.181985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7c9f234-b247-4fa2-a681-99c0c2a1bf97 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:22.182840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7c9f234-b247-4fa2-a681-99c0c2a1bf97 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:22.183353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7c9f234-b247-4fa2-a681-99c0c2a1bf97 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:22.290308 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d7c9f234-b247-4fa2-a681-99c0c2a1bf97 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action" status: 202 len: 0 microversion: 2.1 time: 0.123571 Mar 12 21:00:22.295617 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2323/3091] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:00:22 2022] POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:00:22.303573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4e8674d8-f6f6-406f-adeb-5a5b21770af0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:22.304588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4e8674d8-f6f6-406f-adeb-5a5b21770af0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:22.320983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e8674d8-f6f6-406f-adeb-5a5b21770af0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:22.325694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e8674d8-f6f6-406f-adeb-5a5b21770af0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:22.327039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e8674d8-f6f6-406f-adeb-5a5b21770af0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:22.327526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e8674d8-f6f6-406f-adeb-5a5b21770af0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:22.535559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4e8674d8-f6f6-406f-adeb-5a5b21770af0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:22.551257 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4e8674d8-f6f6-406f-adeb-5a5b21770af0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1508 microversion: 2.1 time: 0.247455 Mar 12 21:00:22.562207 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2324/3092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:22 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:22.567718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ecc326f-6a14-4409-96fd-f1cc610007b7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:22.568676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ecc326f-6a14-4409-96fd-f1cc610007b7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:22.575556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ecc326f-6a14-4409-96fd-f1cc610007b7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:22.576387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ecc326f-6a14-4409-96fd-f1cc610007b7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:22.577618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ecc326f-6a14-4409-96fd-f1cc610007b7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:22.578482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ecc326f-6a14-4409-96fd-f1cc610007b7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:22.771548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ecc326f-6a14-4409-96fd-f1cc610007b7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:22.779806 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ecc326f-6a14-4409-96fd-f1cc610007b7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1317 microversion: 2.1 time: 0.216118 Mar 12 21:00:22.783216 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2325/3093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:22 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:22.985423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-945c6efb-ef21-461d-aee9-10889b2e7004 req-c1b1c0d2-04fd-4537-9eda-9c288a1e872f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04aee892-bcd6-408c-a6c5-4b066963804b", "name": "network-vif-plugged", "status": "completed", "tag": "9d0e0d96-36eb-4c58-879f-b88dbfb25a50"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:23.009361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-945c6efb-ef21-461d-aee9-10889b2e7004 req-c1b1c0d2-04fd-4537-9eda-9c288a1e872f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:23.009841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-945c6efb-ef21-461d-aee9-10889b2e7004 req-c1b1c0d2-04fd-4537-9eda-9c288a1e872f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:23.045106 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-945c6efb-ef21-461d-aee9-10889b2e7004 req-c1b1c0d2-04fd-4537-9eda-9c288a1e872f service nova] Creating event network-vif-plugged:9d0e0d96-36eb-4c58-879f-b88dbfb25a50 for instance 04aee892-bcd6-408c-a6c5-4b066963804b on nch1-master-1 Mar 12 21:00:23.059851 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-945c6efb-ef21-461d-aee9-10889b2e7004 req-c1b1c0d2-04fd-4537-9eda-9c288a1e872f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078584 Mar 12 21:00:23.060867 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2326/3094] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:00:23.132729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f60da898-4cc2-4f56-b912-e3b40ef183cc tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:23.133472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f60da898-4cc2-4f56-b912-e3b40ef183cc tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:23.145495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f60da898-4cc2-4f56-b912-e3b40ef183cc tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:23.146760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f60da898-4cc2-4f56-b912-e3b40ef183cc tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:23.147588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f60da898-4cc2-4f56-b912-e3b40ef183cc tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:23.150713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f60da898-4cc2-4f56-b912-e3b40ef183cc tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:23.394771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f60da898-4cc2-4f56-b912-e3b40ef183cc tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:23.405152 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f60da898-4cc2-4f56-b912-e3b40ef183cc tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1324 microversion: 2.1 time: 0.280365 Mar 12 21:00:23.406107 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2327/3095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:23 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:00:23.430462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bb321701-953b-4672-9b35-2268475ee3e5 req-9e8199f9-c2bb-440b-bbb4-1599e0e03e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c44039-6c03-403b-8828-046bf508b27f", "tag": "891b1bf1-7d7e-4f05-9c62-d7d4abaf05db"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:23.440746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bb321701-953b-4672-9b35-2268475ee3e5 req-9e8199f9-c2bb-440b-bbb4-1599e0e03e66 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:23.441947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bb321701-953b-4672-9b35-2268475ee3e5 req-9e8199f9-c2bb-440b-bbb4-1599e0e03e66 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:23.456189 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bb321701-953b-4672-9b35-2268475ee3e5 req-9e8199f9-c2bb-440b-bbb4-1599e0e03e66 service nova] Creating event network-changed:891b1bf1-7d7e-4f05-9c62-d7d4abaf05db for instance 63c44039-6c03-403b-8828-046bf508b27f on nch1-master-1 Mar 12 21:00:23.462574 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bb321701-953b-4672-9b35-2268475ee3e5 req-9e8199f9-c2bb-440b-bbb4-1599e0e03e66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036674 Mar 12 21:00:23.465891 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2328/3096] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:23.588708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b1f7e492-55a0-49f9-824b-64b6955ade20 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:23.591191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b1f7e492-55a0-49f9-824b-64b6955ade20 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:23.607576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1f7e492-55a0-49f9-824b-64b6955ade20 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:23.608733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1f7e492-55a0-49f9-824b-64b6955ade20 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:23.611508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1f7e492-55a0-49f9-824b-64b6955ade20 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:23.612209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1f7e492-55a0-49f9-824b-64b6955ade20 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:23.811542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b1f7e492-55a0-49f9-824b-64b6955ade20 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:23.821469 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b1f7e492-55a0-49f9-824b-64b6955ade20 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1508 microversion: 2.1 time: 0.256558 Mar 12 21:00:23.835366 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2329/3097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:23 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:23.840762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e1c8b27a-38df-4433-8846-675935f08563 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:23.841726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e1c8b27a-38df-4433-8846-675935f08563 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:23.848631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1c8b27a-38df-4433-8846-675935f08563 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:23.849438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1c8b27a-38df-4433-8846-675935f08563 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:23.850551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1c8b27a-38df-4433-8846-675935f08563 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:23.851208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1c8b27a-38df-4433-8846-675935f08563 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:24.080434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e1c8b27a-38df-4433-8846-675935f08563 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:24.089226 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e1c8b27a-38df-4433-8846-675935f08563 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1317 microversion: 2.1 time: 0.252368 Mar 12 21:00:24.091790 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2330/3098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:23 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:24.424074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7705934f-5f10-4ec5-870c-b67fd367258b tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:24.424963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7705934f-5f10-4ec5-870c-b67fd367258b tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:24.433183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7705934f-5f10-4ec5-870c-b67fd367258b tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:24.434118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7705934f-5f10-4ec5-870c-b67fd367258b tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:24.434954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7705934f-5f10-4ec5-870c-b67fd367258b tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:24.435396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7705934f-5f10-4ec5-870c-b67fd367258b tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:24.687358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7705934f-5f10-4ec5-870c-b67fd367258b tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:24.706424 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7705934f-5f10-4ec5-870c-b67fd367258b tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1324 microversion: 2.1 time: 0.281739 Mar 12 21:00:24.708761 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2331/3099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:24 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:24.841997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1c21715f-768b-4d7b-afa7-f79ed725d5d9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:24.842611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1c21715f-768b-4d7b-afa7-f79ed725d5d9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:24.850184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c21715f-768b-4d7b-afa7-f79ed725d5d9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:24.850918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c21715f-768b-4d7b-afa7-f79ed725d5d9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:24.851898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c21715f-768b-4d7b-afa7-f79ed725d5d9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:24.852496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c21715f-768b-4d7b-afa7-f79ed725d5d9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:25.020806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1c21715f-768b-4d7b-afa7-f79ed725d5d9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:25.029455 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1c21715f-768b-4d7b-afa7-f79ed725d5d9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1508 microversion: 2.1 time: 0.191225 Mar 12 21:00:25.040863 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2332/3100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:24 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:25.108219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-44178f19-d162-493b-b039-c42a0883f73a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:25.108834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-44178f19-d162-493b-b039-c42a0883f73a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:25.115691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44178f19-d162-493b-b039-c42a0883f73a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:25.117821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44178f19-d162-493b-b039-c42a0883f73a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:25.117997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44178f19-d162-493b-b039-c42a0883f73a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:25.118856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44178f19-d162-493b-b039-c42a0883f73a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:25.315858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-44178f19-d162-493b-b039-c42a0883f73a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:25.332030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-44178f19-d162-493b-b039-c42a0883f73a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1317 microversion: 2.1 time: 0.226950 Mar 12 21:00:25.332030 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2333/3101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:25 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:25.725329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94dda78d-dd5b-4653-8d5d-a98cb0a54675 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:25.726781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94dda78d-dd5b-4653-8d5d-a98cb0a54675 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:25.742275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94dda78d-dd5b-4653-8d5d-a98cb0a54675 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:25.745505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94dda78d-dd5b-4653-8d5d-a98cb0a54675 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:25.751400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94dda78d-dd5b-4653-8d5d-a98cb0a54675 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:25.754219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94dda78d-dd5b-4653-8d5d-a98cb0a54675 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:26.070804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-94dda78d-dd5b-4653-8d5d-a98cb0a54675 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:26.082238 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94dda78d-dd5b-4653-8d5d-a98cb0a54675 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1521 microversion: 2.1 time: 0.362110 Mar 12 21:00:26.083901 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2334/3102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:25 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:00:26.093958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-61168f66-37bd-48df-91c7-69cb7f29c303 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:26.097120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-61168f66-37bd-48df-91c7-69cb7f29c303 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:26.104922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61168f66-37bd-48df-91c7-69cb7f29c303 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:26.105518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61168f66-37bd-48df-91c7-69cb7f29c303 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:26.111622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61168f66-37bd-48df-91c7-69cb7f29c303 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:26.112180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61168f66-37bd-48df-91c7-69cb7f29c303 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:26.953819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-61168f66-37bd-48df-91c7-69cb7f29c303 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:26.963784 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-61168f66-37bd-48df-91c7-69cb7f29c303 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1508 microversion: 2.1 time: 0.878651 Mar 12 21:00:26.964398 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2335/3103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:26 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1508 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:26.977529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c296b4e0-9b34-4edd-82be-6a45145f31af tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:26.978082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c296b4e0-9b34-4edd-82be-6a45145f31af tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:26.987563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c296b4e0-9b34-4edd-82be-6a45145f31af tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:26.990350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c296b4e0-9b34-4edd-82be-6a45145f31af tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:26.992522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c296b4e0-9b34-4edd-82be-6a45145f31af tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:26.994900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c296b4e0-9b34-4edd-82be-6a45145f31af tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:27.023340 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c296b4e0-9b34-4edd-82be-6a45145f31af tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] HTTP exception thrown: Instance is not a member of specified network Mar 12 21:00:27.024232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c296b4e0-9b34-4edd-82be-6a45145f31af tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Returning 404 to user: Instance is not a member of specified network {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:00:27.025289 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c296b4e0-9b34-4edd-82be-6a45145f31af tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.055295 Mar 12 21:00:27.026397 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2336/3104] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 21:00:26 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b/ips/invalid => generated 91 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 21:00:27.031177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-150e499d-4d35-4a7d-b8f1-4879df8cde4d req-98dd7ff9-24ad-421e-81c8-1d481e980792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0b657b-019a-495b-bf10-0b27962e3880", "name": "network-vif-plugged", "status": "completed", "tag": "ea6450b5-34ee-4f9d-8b0d-7a507ad2499d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:27.041856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-150e499d-4d35-4a7d-b8f1-4879df8cde4d req-98dd7ff9-24ad-421e-81c8-1d481e980792 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:27.042640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-150e499d-4d35-4a7d-b8f1-4879df8cde4d req-98dd7ff9-24ad-421e-81c8-1d481e980792 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:27.058864 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-150e499d-4d35-4a7d-b8f1-4879df8cde4d req-98dd7ff9-24ad-421e-81c8-1d481e980792 service nova] Creating event network-vif-plugged:ea6450b5-34ee-4f9d-8b0d-7a507ad2499d for instance 8d0b657b-019a-495b-bf10-0b27962e3880 on nch2-master-1 Mar 12 21:00:27.071018 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-150e499d-4d35-4a7d-b8f1-4879df8cde4d req-98dd7ff9-24ad-421e-81c8-1d481e980792 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043058 Mar 12 21:00:27.071826 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2337/3105] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:27.086585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4fd5517c-6fea-45c4-bbcf-bc86d7a8dd8a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:27.087535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4fd5517c-6fea-45c4-bbcf-bc86d7a8dd8a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:27.094277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fd5517c-6fea-45c4-bbcf-bc86d7a8dd8a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:27.095049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fd5517c-6fea-45c4-bbcf-bc86d7a8dd8a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:27.096187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fd5517c-6fea-45c4-bbcf-bc86d7a8dd8a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:27.096849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fd5517c-6fea-45c4-bbcf-bc86d7a8dd8a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:27.449379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4fd5517c-6fea-45c4-bbcf-bc86d7a8dd8a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:27.459084 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4fd5517c-6fea-45c4-bbcf-bc86d7a8dd8a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1317 microversion: 2.1 time: 0.382982 Mar 12 21:00:27.459698 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2338/3106] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:27 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:27.475505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4da543ef-fc63-4ef4-a5f5-74dd1696641a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:27.476852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4da543ef-fc63-4ef4-a5f5-74dd1696641a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Failed to fetch instance by id 999 {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 12 21:00:27.477536 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-4da543ef-fc63-4ef4-a5f5-74dd1696641a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] HTTP exception thrown: Instance 999 could not be found. Mar 12 21:00:27.481491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4da543ef-fc63-4ef4-a5f5-74dd1696641a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Returning 404 to user: Instance 999 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:00:27.486498 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4da543ef-fc63-4ef4-a5f5-74dd1696641a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.025810 Mar 12 21:00:27.488258 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2339/3107] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Mar 12 21:00:27 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 21:00:27.501533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aeba7bdb-b26f-437f-b341-7ab30c140d7a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:27.502361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aeba7bdb-b26f-437f-b341-7ab30c140d7a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:27.510072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aeba7bdb-b26f-437f-b341-7ab30c140d7a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:27.510751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aeba7bdb-b26f-437f-b341-7ab30c140d7a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:27.511745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aeba7bdb-b26f-437f-b341-7ab30c140d7a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:27.512195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aeba7bdb-b26f-437f-b341-7ab30c140d7a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:27.545280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aeba7bdb-b26f-437f-b341-7ab30c140d7a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:00:27.713704 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aeba7bdb-b26f-437f-b341-7ab30c140d7a tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "DELETE /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 204 len: 0 microversion: 2.1 time: 0.218670 Mar 12 21:00:27.720779 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2340/3108] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:00:27 2022] DELETE /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:00:27.729442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7a9820a3-3c08-4b49-adb4-41c8a858ecad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:27.730232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7a9820a3-3c08-4b49-adb4-41c8a858ecad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:27.746425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a9820a3-3c08-4b49-adb4-41c8a858ecad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:27.746918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a9820a3-3c08-4b49-adb4-41c8a858ecad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:27.747722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a9820a3-3c08-4b49-adb4-41c8a858ecad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:27.748167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a9820a3-3c08-4b49-adb4-41c8a858ecad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:28.004592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7a9820a3-3c08-4b49-adb4-41c8a858ecad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:28.014148 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7a9820a3-3c08-4b49-adb4-41c8a858ecad tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1527 microversion: 2.1 time: 0.289121 Mar 12 21:00:28.026692 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2341/3109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:27 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1527 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:28.032294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cdceda6d-5352-497b-993d-858cdebcf04c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:28.033183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cdceda6d-5352-497b-993d-858cdebcf04c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:28.060902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdceda6d-5352-497b-993d-858cdebcf04c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:28.064100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdceda6d-5352-497b-993d-858cdebcf04c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:28.065081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdceda6d-5352-497b-993d-858cdebcf04c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:28.066289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdceda6d-5352-497b-993d-858cdebcf04c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:28.496749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cdceda6d-5352-497b-993d-858cdebcf04c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:28.509295 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cdceda6d-5352-497b-993d-858cdebcf04c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1514 microversion: 2.1 time: 0.481194 Mar 12 21:00:28.526046 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2342/3110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:28 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1514 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:28.535203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cac5e1a0-d466-4895-b785-8f4c1c9b3054 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:28.535820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cac5e1a0-d466-4895-b785-8f4c1c9b3054 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:28.567992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cac5e1a0-d466-4895-b785-8f4c1c9b3054 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:28.568438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cac5e1a0-d466-4895-b785-8f4c1c9b3054 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:28.578933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cac5e1a0-d466-4895-b785-8f4c1c9b3054 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:28.582743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cac5e1a0-d466-4895-b785-8f4c1c9b3054 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:28.961146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cac5e1a0-d466-4895-b785-8f4c1c9b3054 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:28.972942 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cac5e1a0-d466-4895-b785-8f4c1c9b3054 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1317 microversion: 2.1 time: 0.457991 Mar 12 21:00:28.974465 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2343/3111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:28 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:29.036085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7dbfe3d8-4308-4bc0-8618-62fbb6834b5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:29.036776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7dbfe3d8-4308-4bc0-8618-62fbb6834b5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:29.063162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7dbfe3d8-4308-4bc0-8618-62fbb6834b5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:29.069246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7dbfe3d8-4308-4bc0-8618-62fbb6834b5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:29.086390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7dbfe3d8-4308-4bc0-8618-62fbb6834b5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:29.086854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7dbfe3d8-4308-4bc0-8618-62fbb6834b5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:29.399493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7dbfe3d8-4308-4bc0-8618-62fbb6834b5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:29.412309 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7dbfe3d8-4308-4bc0-8618-62fbb6834b5f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1527 microversion: 2.1 time: 0.383520 Mar 12 21:00:29.413855 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2344/3112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:29 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1527 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:00:30.005671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd7eab6d-6cc9-49da-a87f-4c84265963e3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:30.010711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd7eab6d-6cc9-49da-a87f-4c84265963e3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:30.045579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd7eab6d-6cc9-49da-a87f-4c84265963e3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:30.046792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd7eab6d-6cc9-49da-a87f-4c84265963e3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:30.048394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd7eab6d-6cc9-49da-a87f-4c84265963e3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:30.048800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd7eab6d-6cc9-49da-a87f-4c84265963e3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:30.370736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bd7eab6d-6cc9-49da-a87f-4c84265963e3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:30.378245 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd7eab6d-6cc9-49da-a87f-4c84265963e3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1317 microversion: 2.1 time: 0.386898 Mar 12 21:00:30.378843 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2345/3113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:29 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:30.383922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-58ff832b-407e-48db-bb5c-57494fb651cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:30.384577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-58ff832b-407e-48db-bb5c-57494fb651cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:30.416083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58ff832b-407e-48db-bb5c-57494fb651cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:30.417280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58ff832b-407e-48db-bb5c-57494fb651cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:30.420582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58ff832b-407e-48db-bb5c-57494fb651cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:30.422326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58ff832b-407e-48db-bb5c-57494fb651cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:30.688805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-58ff832b-407e-48db-bb5c-57494fb651cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:30.699184 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-58ff832b-407e-48db-bb5c-57494fb651cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1514 microversion: 2.1 time: 0.319141 Mar 12 21:00:30.700002 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2346/3114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:30 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1514 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:30.705259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0893718d-68b8-4049-b04d-7dd845eea007 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:30.706057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0893718d-68b8-4049-b04d-7dd845eea007 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:30.714119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0893718d-68b8-4049-b04d-7dd845eea007 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:30.715159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0893718d-68b8-4049-b04d-7dd845eea007 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:30.716099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0893718d-68b8-4049-b04d-7dd845eea007 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:30.716753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0893718d-68b8-4049-b04d-7dd845eea007 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:30.912747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0893718d-68b8-4049-b04d-7dd845eea007 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a911ec76994984ae25c5648825d6a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a66fc7389649178ee00d3759c89637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:30.922846 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0893718d-68b8-4049-b04d-7dd845eea007 tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 200 len: 1527 microversion: 2.1 time: 0.220310 Mar 12 21:00:30.934349 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2347/3115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:30 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 1527 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:30.939947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ac5d0d0-a486-4b3f-ad09-7385c4a3a301 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd57576e-68d3-4a4b-af68-9b423f85de28"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:30.941692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ac5d0d0-a486-4b3f-ad09-7385c4a3a301 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:30.950522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ac5d0d0-a486-4b3f-ad09-7385c4a3a301 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:30.952053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ac5d0d0-a486-4b3f-ad09-7385c4a3a301 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:30.953295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ac5d0d0-a486-4b3f-ad09-7385c4a3a301 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:30.954003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ac5d0d0-a486-4b3f-ad09-7385c4a3a301 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:31.473548 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ac5d0d0-a486-4b3f-ad09-7385c4a3a301 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.537365 Mar 12 21:00:31.475543 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2348/3116] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:00:30 2022] POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:31.482726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e9fa582d-bc0c-4272-b1e8-9780c656daae req-adb8b535-7d75-42fb-ad08-5bcf96ffd094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04aee892-bcd6-408c-a6c5-4b066963804b", "name": "network-vif-deleted", "tag": "9d0e0d96-36eb-4c58-879f-b88dbfb25a50"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:31.499038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e9fa582d-bc0c-4272-b1e8-9780c656daae req-adb8b535-7d75-42fb-ad08-5bcf96ffd094 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:31.499973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e9fa582d-bc0c-4272-b1e8-9780c656daae req-adb8b535-7d75-42fb-ad08-5bcf96ffd094 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:31.526477 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e9fa582d-bc0c-4272-b1e8-9780c656daae req-adb8b535-7d75-42fb-ad08-5bcf96ffd094 service nova] Creating event network-vif-deleted:9d0e0d96-36eb-4c58-879f-b88dbfb25a50 for instance 04aee892-bcd6-408c-a6c5-4b066963804b on nch1-master-1 Mar 12 21:00:31.539876 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e9fa582d-bc0c-4272-b1e8-9780c656daae req-adb8b535-7d75-42fb-ad08-5bcf96ffd094 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061442 Mar 12 21:00:31.541887 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2349/3117] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:31.555753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1fc3e218-43e6-491c-aa5b-4e7412255f4e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:31.558058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1fc3e218-43e6-491c-aa5b-4e7412255f4e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:31.571266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fc3e218-43e6-491c-aa5b-4e7412255f4e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:31.571730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fc3e218-43e6-491c-aa5b-4e7412255f4e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:31.572536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fc3e218-43e6-491c-aa5b-4e7412255f4e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:31.576653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fc3e218-43e6-491c-aa5b-4e7412255f4e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:32.043126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1fc3e218-43e6-491c-aa5b-4e7412255f4e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:32.076200 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1fc3e218-43e6-491c-aa5b-4e7412255f4e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1317 microversion: 2.1 time: 0.532014 Mar 12 21:00:32.079172 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2350/3118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:31 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:32.091272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e761e173-17bd-46bf-ab29-aa89ea2b8f5c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:32.091833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e761e173-17bd-46bf-ab29-aa89ea2b8f5c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:32.107559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e761e173-17bd-46bf-ab29-aa89ea2b8f5c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:32.108017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e761e173-17bd-46bf-ab29-aa89ea2b8f5c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:32.108821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e761e173-17bd-46bf-ab29-aa89ea2b8f5c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:32.109268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e761e173-17bd-46bf-ab29-aa89ea2b8f5c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:32.333321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-e761e173-17bd-46bf-ab29-aa89ea2b8f5c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lazy-loading 'services' on Instance uuid 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:00:32.575632 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e761e173-17bd-46bf-ab29-aa89ea2b8f5c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/os-volume_attachments/95a67390-c847-4eb9-8783-620ee1d3b1ae" status: 202 len: 0 microversion: 2.1 time: 0.494025 Mar 12 21:00:32.576341 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2351/3119] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:00:32 2022] DELETE /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/os-volume_attachments/95a67390-c847-4eb9-8783-620ee1d3b1ae => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:00:32.609272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f6afb94-b4c6-455b-9f59-621e2e57ab8f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:32.613014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f6afb94-b4c6-455b-9f59-621e2e57ab8f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] [instance: 04aee892-bcd6-408c-a6c5-4b066963804b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:32.630099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f6afb94-b4c6-455b-9f59-621e2e57ab8f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:32.630784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f6afb94-b4c6-455b-9f59-621e2e57ab8f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:32.634849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f6afb94-b4c6-455b-9f59-621e2e57ab8f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:32.638702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f6afb94-b4c6-455b-9f59-621e2e57ab8f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:32.685029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-1f6afb94-b4c6-455b-9f59-621e2e57ab8f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] HTTP exception thrown: Instance 04aee892-bcd6-408c-a6c5-4b066963804b could not be found. Mar 12 21:00:32.685649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f6afb94-b4c6-455b-9f59-621e2e57ab8f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] Returning 404 to user: Instance 04aee892-bcd6-408c-a6c5-4b066963804b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:00:32.686533 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f6afb94-b4c6-455b-9f59-621e2e57ab8f tempest-ServerAddressesNegativeTestJSON-1724788968 tempest-ServerAddressesNegativeTestJSON-1724788968-project] 10.222.0.30 "GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b" status: 404 len: 111 microversion: 2.1 time: 0.107435 Mar 12 21:00:32.707974 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2352/3120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:32 2022] GET /compute/v2.1/servers/04aee892-bcd6-408c-a6c5-4b066963804b => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:00:32.933266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b400aa00-c500-4bfd-a089-57508305dea7 req-0b9a9017-ca22-40c2-95b5-e48e230b3090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c44039-6c03-403b-8828-046bf508b27f", "name": "network-vif-plugged", "status": "completed", "tag": "891b1bf1-7d7e-4f05-9c62-d7d4abaf05db"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:32.951139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b400aa00-c500-4bfd-a089-57508305dea7 req-0b9a9017-ca22-40c2-95b5-e48e230b3090 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:32.952333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b400aa00-c500-4bfd-a089-57508305dea7 req-0b9a9017-ca22-40c2-95b5-e48e230b3090 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:32.989315 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b400aa00-c500-4bfd-a089-57508305dea7 req-0b9a9017-ca22-40c2-95b5-e48e230b3090 service nova] Creating event network-vif-plugged:891b1bf1-7d7e-4f05-9c62-d7d4abaf05db for instance 63c44039-6c03-403b-8828-046bf508b27f on nch1-master-1 Mar 12 21:00:33.005147 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b400aa00-c500-4bfd-a089-57508305dea7 req-0b9a9017-ca22-40c2-95b5-e48e230b3090 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072597 Mar 12 21:00:33.007734 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2353/3121] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:33.093863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d70cf540-03f2-47b2-8e44-2a115ca109e4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:33.094514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d70cf540-03f2-47b2-8e44-2a115ca109e4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:33.114835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d70cf540-03f2-47b2-8e44-2a115ca109e4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:33.116082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d70cf540-03f2-47b2-8e44-2a115ca109e4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:33.119471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d70cf540-03f2-47b2-8e44-2a115ca109e4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:33.119961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d70cf540-03f2-47b2-8e44-2a115ca109e4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:33.571280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d70cf540-03f2-47b2-8e44-2a115ca109e4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:33.579309 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d70cf540-03f2-47b2-8e44-2a115ca109e4 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1317 microversion: 2.1 time: 0.490508 Mar 12 21:00:33.591952 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2354/3122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:33 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:00:34.481182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c2042b37-5152-45f5-ae42-199b4ee8411f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:34.481907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c2042b37-5152-45f5-ae42-199b4ee8411f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:34.488924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2042b37-5152-45f5-ae42-199b4ee8411f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:34.489431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2042b37-5152-45f5-ae42-199b4ee8411f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:34.490261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2042b37-5152-45f5-ae42-199b4ee8411f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:34.490714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2042b37-5152-45f5-ae42-199b4ee8411f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:34.773940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c2042b37-5152-45f5-ae42-199b4ee8411f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:34.783489 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c2042b37-5152-45f5-ae42-199b4ee8411f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1683 microversion: 2.1 time: 0.306125 Mar 12 21:00:34.785607 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2355/3123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:34 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1683 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:00:34.791074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ebdc353-49d2-4f98-8294-e806bf2436e1 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:34.791903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8ebdc353-49d2-4f98-8294-e806bf2436e1 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:34.798225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ebdc353-49d2-4f98-8294-e806bf2436e1 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:34.798920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ebdc353-49d2-4f98-8294-e806bf2436e1 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:34.799864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ebdc353-49d2-4f98-8294-e806bf2436e1 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:34.800461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ebdc353-49d2-4f98-8294-e806bf2436e1 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:35.423974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ebdc353-49d2-4f98-8294-e806bf2436e1 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:35.431750 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ebdc353-49d2-4f98-8294-e806bf2436e1 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1467 microversion: 2.1 time: 0.644269 Mar 12 21:00:35.434158 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2356/3124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:34 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1467 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:35.438921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86303263-fdfa-4e0d-8629-b3cee2aff5bf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:35.445933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86303263-fdfa-4e0d-8629-b3cee2aff5bf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:35.446401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86303263-fdfa-4e0d-8629-b3cee2aff5bf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:35.480900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86303263-fdfa-4e0d-8629-b3cee2aff5bf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Going to try to stop instance {{(pid=136302) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 12 21:00:35.540080 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86303263-fdfa-4e0d-8629-b3cee2aff5bf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "POST /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/action" status: 202 len: 0 microversion: 2.1 time: 0.104528 Mar 12 21:00:35.541931 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2357/3125] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:00:35 2022] POST /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:00:35.550139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7c39ab2-2a00-4c70-96ea-d4774d58ff6d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:35.551716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a7c39ab2-2a00-4c70-96ea-d4774d58ff6d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:35.562800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7c39ab2-2a00-4c70-96ea-d4774d58ff6d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:35.563998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7c39ab2-2a00-4c70-96ea-d4774d58ff6d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:35.564817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7c39ab2-2a00-4c70-96ea-d4774d58ff6d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:35.565617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7c39ab2-2a00-4c70-96ea-d4774d58ff6d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:35.598138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-a7c39ab2-2a00-4c70-96ea-d4774d58ff6d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lazy-loading 'flavor' on Instance uuid b3b9fa34-2929-4ab9-b2d8-47c9949331e3 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:00:35.774590 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7c39ab2-2a00-4c70-96ea-d4774d58ff6d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action" status: 200 len: 32 microversion: 2.1 time: 0.230701 Mar 12 21:00:35.776128 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2358/3126] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:00:35 2022] POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:00:35.795075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-896c41a5-fc5f-4ffa-a8f8-389f11685983 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:35.797478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-896c41a5-fc5f-4ffa-a8f8-389f11685983 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 8d0b657b-019a-495b-bf10-0b27962e3880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:35.806897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-896c41a5-fc5f-4ffa-a8f8-389f11685983 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:35.807839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-896c41a5-fc5f-4ffa-a8f8-389f11685983 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:35.808782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-896c41a5-fc5f-4ffa-a8f8-389f11685983 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:35.809239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-896c41a5-fc5f-4ffa-a8f8-389f11685983 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:36.100547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-896c41a5-fc5f-4ffa-a8f8-389f11685983 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:36.116845 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-896c41a5-fc5f-4ffa-a8f8-389f11685983 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880" status: 200 len: 1467 microversion: 2.1 time: 0.339202 Mar 12 21:00:36.117448 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2359/3127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:35 2022] GET /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880 => generated 1467 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:36.131320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3d251078-cd98-4093-894b-02a1bc6c618b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:36.132301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3d251078-cd98-4093-894b-02a1bc6c618b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:36.138881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d251078-cd98-4093-894b-02a1bc6c618b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:36.139534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d251078-cd98-4093-894b-02a1bc6c618b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:36.140558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d251078-cd98-4093-894b-02a1bc6c618b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:36.141198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d251078-cd98-4093-894b-02a1bc6c618b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:36.437554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3d251078-cd98-4093-894b-02a1bc6c618b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:36.448648 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3d251078-cd98-4093-894b-02a1bc6c618b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1678 microversion: 2.1 time: 0.328984 Mar 12 21:00:36.449095 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2360/3128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:36 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1678 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:36.465744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-87f2f38f-1be6-44de-b77c-89c99691ba6c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:36.466635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-87f2f38f-1be6-44de-b77c-89c99691ba6c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:36.476259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87f2f38f-1be6-44de-b77c-89c99691ba6c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:36.476959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87f2f38f-1be6-44de-b77c-89c99691ba6c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:36.477979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87f2f38f-1be6-44de-b77c-89c99691ba6c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:36.478715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87f2f38f-1be6-44de-b77c-89c99691ba6c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:36.763955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-87f2f38f-1be6-44de-b77c-89c99691ba6c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:36.781475 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-87f2f38f-1be6-44de-b77c-89c99691ba6c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1566 microversion: 2.1 time: 0.331342 Mar 12 21:00:36.782244 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2361/3129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:36 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1566 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:36.796373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ea8288f-ffb7-459c-9993-b1d569df6edc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:36.796998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8ea8288f-ffb7-459c-9993-b1d569df6edc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:36.804987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ea8288f-ffb7-459c-9993-b1d569df6edc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:36.805449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ea8288f-ffb7-459c-9993-b1d569df6edc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:36.806259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ea8288f-ffb7-459c-9993-b1d569df6edc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:36.806701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ea8288f-ffb7-459c-9993-b1d569df6edc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:37.197092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ea8288f-ffb7-459c-9993-b1d569df6edc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:37.205079 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ea8288f-ffb7-459c-9993-b1d569df6edc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.421775 Mar 12 21:00:37.205925 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2362/3130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:36 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:37.217001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f86e48db-f098-4d11-9aa6-f5badec38567 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1607330546"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:37.219247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f86e48db-f098-4d11-9aa6-f5badec38567 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 8d0b657b-019a-495b-bf10-0b27962e3880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:37.225618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f86e48db-f098-4d11-9aa6-f5badec38567 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:37.226153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f86e48db-f098-4d11-9aa6-f5badec38567 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:37.226955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f86e48db-f098-4d11-9aa6-f5badec38567 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:37.227390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f86e48db-f098-4d11-9aa6-f5badec38567 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:37.516283 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f86e48db-f098-4d11-9aa6-f5badec38567 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "POST /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880/action" status: 202 len: 0 microversion: 2.1 time: 0.308995 Mar 12 21:00:37.516948 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2363/3131] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:00:37 2022] POST /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 12 21:00:37.522547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-439fe86c-cace-4eeb-bc79-cfefa3ed2b5d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1835651244"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:37.523938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-439fe86c-cace-4eeb-bc79-cfefa3ed2b5d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:37.530368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-439fe86c-cace-4eeb-bc79-cfefa3ed2b5d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:37.530841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-439fe86c-cace-4eeb-bc79-cfefa3ed2b5d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:37.531627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-439fe86c-cace-4eeb-bc79-cfefa3ed2b5d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:37.532271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-439fe86c-cace-4eeb-bc79-cfefa3ed2b5d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:37.851825 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-439fe86c-cace-4eeb-bc79-cfefa3ed2b5d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.325778 Mar 12 21:00:37.856668 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2364/3132] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:00:37 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Mar 12 21:00:37.862721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a3715c5c-0a8c-4544-8693-4e6571da8679 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:37.863704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a3715c5c-0a8c-4544-8693-4e6571da8679 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:37.873978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3715c5c-0a8c-4544-8693-4e6571da8679 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:37.874446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3715c5c-0a8c-4544-8693-4e6571da8679 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:37.875247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3715c5c-0a8c-4544-8693-4e6571da8679 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:37.875863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3715c5c-0a8c-4544-8693-4e6571da8679 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:38.248845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a3715c5c-0a8c-4544-8693-4e6571da8679 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:38.271563 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a3715c5c-0a8c-4544-8693-4e6571da8679 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1678 microversion: 2.1 time: 0.415945 Mar 12 21:00:38.282711 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2365/3133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:37 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1678 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:38.282711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fdcf6e0a-a1fd-4f71-b193-a6791e106f59 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356db8b0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:38.338229 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fdcf6e0a-a1fd-4f71-b193-a6791e106f59 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/90859586-d6e1-424d-afef-9fa8914fc130" status: 200 len: 1453 microversion: 2.1 time: 0.064346 Mar 12 21:00:38.339098 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2366/3134] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:00:38 2022] GET /compute/v2.1/images/90859586-d6e1-424d-afef-9fa8914fc130 => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:38.345753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-76a167d6-6833-4fb0-89ab-44eafaac06ab tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:38.346639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-76a167d6-6833-4fb0-89ab-44eafaac06ab tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:38.354166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76a167d6-6833-4fb0-89ab-44eafaac06ab tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:38.354962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76a167d6-6833-4fb0-89ab-44eafaac06ab tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:38.355877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76a167d6-6833-4fb0-89ab-44eafaac06ab tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:38.356431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76a167d6-6833-4fb0-89ab-44eafaac06ab tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:39.050048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-76a167d6-6833-4fb0-89ab-44eafaac06ab tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:39.060825 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-76a167d6-6833-4fb0-89ab-44eafaac06ab tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1566 microversion: 2.1 time: 0.719426 Mar 12 21:00:39.061645 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2367/3135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:38 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1566 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:39.066638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7a4874a6-830a-4002-952d-da8fa731520b req-21542b67-9e95-4560-a819-b8e633c45aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e537d16d-478d-4375-a61a-c28f8a785539", "name": "network-vif-unplugged", "status": "completed", "tag": "e0808d11-4cd5-4e52-88b4-c9eaec2126e6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:39.075197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7a4874a6-830a-4002-952d-da8fa731520b req-21542b67-9e95-4560-a819-b8e633c45aa1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:39.075892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7a4874a6-830a-4002-952d-da8fa731520b req-21542b67-9e95-4560-a819-b8e633c45aa1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:39.087741 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7a4874a6-830a-4002-952d-da8fa731520b req-21542b67-9e95-4560-a819-b8e633c45aa1 service nova] Creating event network-vif-unplugged:e0808d11-4cd5-4e52-88b4-c9eaec2126e6 for instance e537d16d-478d-4375-a61a-c28f8a785539 on nch2-master-1 Mar 12 21:00:39.093271 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7a4874a6-830a-4002-952d-da8fa731520b req-21542b67-9e95-4560-a819-b8e633c45aa1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030157 Mar 12 21:00:39.094708 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2368/3136] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:00:39.101397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-18c122c6-b05f-4773-bdfd-bf3f4849d10b tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:39.102291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-18c122c6-b05f-4773-bdfd-bf3f4849d10b tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:39.109744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18c122c6-b05f-4773-bdfd-bf3f4849d10b tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:39.110267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18c122c6-b05f-4773-bdfd-bf3f4849d10b tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:39.111123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18c122c6-b05f-4773-bdfd-bf3f4849d10b tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:39.111567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18c122c6-b05f-4773-bdfd-bf3f4849d10b tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:39.138963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-18c122c6-b05f-4773-bdfd-bf3f4849d10b tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:00:39.264023 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-18c122c6-b05f-4773-bdfd-bf3f4849d10b tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 204 len: 0 microversion: 2.42 time: 0.165881 Mar 12 21:00:39.266076 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2369/3137] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 21:00:39 2022] DELETE /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:00:39.287899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0efb3265-3cbb-4196-8936-40325979bcf2 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:39.289840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0efb3265-3cbb-4196-8936-40325979bcf2 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:39.310266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0efb3265-3cbb-4196-8936-40325979bcf2 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:39.310878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0efb3265-3cbb-4196-8936-40325979bcf2 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:39.311819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0efb3265-3cbb-4196-8936-40325979bcf2 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:39.312420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0efb3265-3cbb-4196-8936-40325979bcf2 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:39.762345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0efb3265-3cbb-4196-8936-40325979bcf2 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:39.780135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0efb3265-3cbb-4196-8936-40325979bcf2 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:39.781660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0efb3265-3cbb-4196-8936-40325979bcf2 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:39.782952 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0efb3265-3cbb-4196-8936-40325979bcf2 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 2957 microversion: 2.42 time: 0.511089 Mar 12 21:00:39.783523 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2370/3138] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:00:39 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 2957 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:00:39.787921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59e7e86e-c478-4727-a57b-da91247646ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:39.788530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59e7e86e-c478-4727-a57b-da91247646ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:39.806243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59e7e86e-c478-4727-a57b-da91247646ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:39.806709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59e7e86e-c478-4727-a57b-da91247646ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:39.807499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59e7e86e-c478-4727-a57b-da91247646ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:39.808556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59e7e86e-c478-4727-a57b-da91247646ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:40.135748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-59e7e86e-c478-4727-a57b-da91247646ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:40.152910 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59e7e86e-c478-4727-a57b-da91247646ed tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1678 microversion: 2.1 time: 0.368126 Mar 12 21:00:40.155637 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2371/3139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:39 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1678 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:40.181517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94a5ebfa-13e0-4c54-9811-0e3d424498f9 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356f91f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:40.266986 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94a5ebfa-13e0-4c54-9811-0e3d424498f9 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/90859586-d6e1-424d-afef-9fa8914fc130" status: 200 len: 1453 microversion: 2.1 time: 0.109413 Mar 12 21:00:40.267990 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2372/3140] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:00:40 2022] GET /compute/v2.1/images/90859586-d6e1-424d-afef-9fa8914fc130 => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:40.275627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-681739be-9e1c-4188-b3ba-c44fb6d7fc4d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:40.276409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-681739be-9e1c-4188-b3ba-c44fb6d7fc4d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:40.287900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-681739be-9e1c-4188-b3ba-c44fb6d7fc4d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:40.288689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-681739be-9e1c-4188-b3ba-c44fb6d7fc4d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:40.290210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-681739be-9e1c-4188-b3ba-c44fb6d7fc4d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:40.290538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-681739be-9e1c-4188-b3ba-c44fb6d7fc4d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:40.563704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-681739be-9e1c-4188-b3ba-c44fb6d7fc4d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:40.572939 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-681739be-9e1c-4188-b3ba-c44fb6d7fc4d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1566 microversion: 2.1 time: 0.303466 Mar 12 21:00:40.583739 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2373/3141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:40 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1566 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:40.803839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e3511d9b-5b46-4f08-8452-c899556f0027 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:40.805042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e3511d9b-5b46-4f08-8452-c899556f0027 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:40.810482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3511d9b-5b46-4f08-8452-c899556f0027 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:40.810947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3511d9b-5b46-4f08-8452-c899556f0027 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:40.812066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3511d9b-5b46-4f08-8452-c899556f0027 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:40.812525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3511d9b-5b46-4f08-8452-c899556f0027 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:41.158509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e3511d9b-5b46-4f08-8452-c899556f0027 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:41.174419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e3511d9b-5b46-4f08-8452-c899556f0027 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:41.176918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e3511d9b-5b46-4f08-8452-c899556f0027 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:41.178409 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e3511d9b-5b46-4f08-8452-c899556f0027 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 2957 microversion: 2.42 time: 0.379380 Mar 12 21:00:41.179270 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2374/3142] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:00:40 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 2957 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:00:41.197734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-55cebe88-494e-4168-8f25-cf9cbe0fba2c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:41.198718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-55cebe88-494e-4168-8f25-cf9cbe0fba2c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:41.205882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55cebe88-494e-4168-8f25-cf9cbe0fba2c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:41.206595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55cebe88-494e-4168-8f25-cf9cbe0fba2c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:41.207553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55cebe88-494e-4168-8f25-cf9cbe0fba2c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:41.208685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55cebe88-494e-4168-8f25-cf9cbe0fba2c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:41.444914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-55cebe88-494e-4168-8f25-cf9cbe0fba2c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:41.455847 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-55cebe88-494e-4168-8f25-cf9cbe0fba2c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1678 microversion: 2.1 time: 0.263506 Mar 12 21:00:41.469031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2375/3143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:41 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1678 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:41.476116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d5cda91-3fe3-4f24-9ccc-b86ce803b47c tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e36d781f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:41.537622 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5d5cda91-3fe3-4f24-9ccc-b86ce803b47c tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/90859586-d6e1-424d-afef-9fa8914fc130" status: 200 len: 1453 microversion: 2.1 time: 0.067171 Mar 12 21:00:41.538726 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2376/3144] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:00:41 2022] GET /compute/v2.1/images/90859586-d6e1-424d-afef-9fa8914fc130 => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:41.596998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9bc54329-4af9-4cdd-bcaf-1e9447633b2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:41.597419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9bc54329-4af9-4cdd-bcaf-1e9447633b2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:41.610978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bc54329-4af9-4cdd-bcaf-1e9447633b2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:41.611674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bc54329-4af9-4cdd-bcaf-1e9447633b2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:41.612636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bc54329-4af9-4cdd-bcaf-1e9447633b2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:41.618706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bc54329-4af9-4cdd-bcaf-1e9447633b2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:41.974276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9bc54329-4af9-4cdd-bcaf-1e9447633b2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:41.985238 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9bc54329-4af9-4cdd-bcaf-1e9447633b2c tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1566 microversion: 2.1 time: 0.391510 Mar 12 21:00:41.986403 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2377/3145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:41 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1566 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:42.334477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-236026699", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:00:42.479401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] validate_networks() for [('c0500286-40a5-45cc-a74a-e1c149b703e6', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:00:43.865176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:00:43.866222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:00:43.866912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:00:43.867495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:00:43.868068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:00:43.890815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:43.898409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:43.903613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:43.907776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:43.986871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Getting quotas for project 96ac94c961644bb5b54ca63306080337. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:00:43.998751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Getting quotas for user cffef7a2961a48c582a965a68607ba7b and project 96ac94c961644bb5b54ca63306080337. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:00:44.060257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:00:44.068936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:00:44.187974 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-61e35aa9-caf1-41fa-81ce-db0a6098aa39 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.170116 Mar 12 21:00:44.191427 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2378/3146] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:00:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 2174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:00:44.208757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9799f01d-ec84-488d-8566-93f1e07c6be4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:44.209716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9799f01d-ec84-488d-8566-93f1e07c6be4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:44.225549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9799f01d-ec84-488d-8566-93f1e07c6be4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:44.230945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9799f01d-ec84-488d-8566-93f1e07c6be4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:44.245956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9799f01d-ec84-488d-8566-93f1e07c6be4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:44.250049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9799f01d-ec84-488d-8566-93f1e07c6be4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:45.263059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9799f01d-ec84-488d-8566-93f1e07c6be4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:45.283171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9799f01d-ec84-488d-8566-93f1e07c6be4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:45.290384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9799f01d-ec84-488d-8566-93f1e07c6be4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:45.292699 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9799f01d-ec84-488d-8566-93f1e07c6be4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 2957 microversion: 2.42 time: 1.098794 Mar 12 21:00:45.294818 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2379/3147] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:00:44 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 2957 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:00:45.301078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-597e2113-8048-45c9-902a-0f2c75162ad9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:00:45.302125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-597e2113-8048-45c9-902a-0f2c75162ad9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:00:45.309420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-597e2113-8048-45c9-902a-0f2c75162ad9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:45.310373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-597e2113-8048-45c9-902a-0f2c75162ad9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:45.311438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-597e2113-8048-45c9-902a-0f2c75162ad9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:00:45.312092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-597e2113-8048-45c9-902a-0f2c75162ad9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:00:46.263449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-597e2113-8048-45c9-902a-0f2c75162ad9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:00:46.272722 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-597e2113-8048-45c9-902a-0f2c75162ad9 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1678 microversion: 2.1 time: 0.976510 Mar 12 21:00:46.284616 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2380/3148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:00:45 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1678 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:00:46.290258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-02c34556-5e81-46a5-8c37-67a4c4129b2a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356f0790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:02.249085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-02c34556-5e81-46a5-8c37-67a4c4129b2a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/90859586-d6e1-424d-afef-9fa8914fc130" status: 200 len: 1462 microversion: 2.1 time: 15.963303 Mar 12 21:01:02.256155 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2381/3149] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:00:46 2022] GET /compute/v2.1/images/90859586-d6e1-424d-afef-9fa8914fc130 => generated 1462 bytes in 15971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:02.265360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ae826d75-a163-4b58-8f38-abcd93061c89 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:02.270770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ae826d75-a163-4b58-8f38-abcd93061c89 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:02.280036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae826d75-a163-4b58-8f38-abcd93061c89 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:02.280036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae826d75-a163-4b58-8f38-abcd93061c89 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:02.282576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae826d75-a163-4b58-8f38-abcd93061c89 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:02.283037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae826d75-a163-4b58-8f38-abcd93061c89 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:02.612009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ae826d75-a163-4b58-8f38-abcd93061c89 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:02.626534 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ae826d75-a163-4b58-8f38-abcd93061c89 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1566 microversion: 2.1 time: 0.366708 Mar 12 21:01:02.627440 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2382/3150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:02 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1566 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:02.634675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-591ee14b-de37-42e3-a431-f47f96abe304 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:02.635709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-591ee14b-de37-42e3-a431-f47f96abe304 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:02.645342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-591ee14b-de37-42e3-a431-f47f96abe304 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:02.646385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-591ee14b-de37-42e3-a431-f47f96abe304 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:02.649039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-591ee14b-de37-42e3-a431-f47f96abe304 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:02.651175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-591ee14b-de37-42e3-a431-f47f96abe304 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:02.919790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-591ee14b-de37-42e3-a431-f47f96abe304 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:02.930924 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-591ee14b-de37-42e3-a431-f47f96abe304 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1322 microversion: 2.1 time: 0.301792 Mar 12 21:01:02.932519 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2383/3151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:02 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:02.939860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-39177951-3e24-4a37-aa85-9539a510c56e req-9a50806f-d7df-4f80-a30e-4b332288d1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-unplugged", "status": "completed", "tag": "0468882e-03df-441e-9049-75f95b5e3334"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:02.951070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-39177951-3e24-4a37-aa85-9539a510c56e req-9a50806f-d7df-4f80-a30e-4b332288d1e5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:02.951718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-39177951-3e24-4a37-aa85-9539a510c56e req-9a50806f-d7df-4f80-a30e-4b332288d1e5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:02.964636 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-39177951-3e24-4a37-aa85-9539a510c56e req-9a50806f-d7df-4f80-a30e-4b332288d1e5 service nova] Creating event network-vif-unplugged:0468882e-03df-441e-9049-75f95b5e3334 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 21:01:02.970001 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-39177951-3e24-4a37-aa85-9539a510c56e req-9a50806f-d7df-4f80-a30e-4b332288d1e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035125 Mar 12 21:01:02.970936 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2384/3152] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:02.976379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:02.977083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:02.983803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:02.984625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:02.985422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:02.985905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:03.023645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:03.024139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:03.025026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lazy-loading 'fault' on Instance uuid a6f9574d-f898-4511-b23a-72aad24f9065 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:01:03.083226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:03.095411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:03.097164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32fae6060ad1458891c8c19554a03582', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2b785d4ebf43779d20d8d18d4ef5af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:03.098647 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-181a6f75-d474-4693-b5cd-7e3327c569ad tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 200 len: 1608 microversion: 2.42 time: 0.126610 Mar 12 21:01:03.099629 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2385/3153] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:01:02 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 1608 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:01:03.104207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-57d8f138-178f-4634-8b17-645ed332c69d tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:03.104919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-57d8f138-178f-4634-8b17-645ed332c69d tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:03.110832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57d8f138-178f-4634-8b17-645ed332c69d tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:03.111394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57d8f138-178f-4634-8b17-645ed332c69d tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:03.112258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57d8f138-178f-4634-8b17-645ed332c69d tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:03.112916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57d8f138-178f-4634-8b17-645ed332c69d tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:03.328676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-57d8f138-178f-4634-8b17-645ed332c69d tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:03.339846 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-57d8f138-178f-4634-8b17-645ed332c69d tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1655 microversion: 2.1 time: 0.239039 Mar 12 21:01:03.352639 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2386/3154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:03 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1655 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:03.358150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-646b88bc-779a-4ee8-a92a-5bf538a5820e req-e23c9fbb-6cba-41c6-a903-1cee14f3d102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-deleted", "tag": "0015b623-5a0c-4812-a5b5-eb6d23db47f1"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:03.368410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-646b88bc-779a-4ee8-a92a-5bf538a5820e req-e23c9fbb-6cba-41c6-a903-1cee14f3d102 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:03.369086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-646b88bc-779a-4ee8-a92a-5bf538a5820e req-e23c9fbb-6cba-41c6-a903-1cee14f3d102 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:03.383901 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-646b88bc-779a-4ee8-a92a-5bf538a5820e req-e23c9fbb-6cba-41c6-a903-1cee14f3d102 service nova] Creating event network-vif-deleted:0015b623-5a0c-4812-a5b5-eb6d23db47f1 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 21:01:03.389447 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-646b88bc-779a-4ee8-a92a-5bf538a5820e req-e23c9fbb-6cba-41c6-a903-1cee14f3d102 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035338 Mar 12 21:01:03.390572 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2387/3155] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:03.397088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0586ece-f57a-4a81-9cf7-e1cac4440d17 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356f31f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:03.448882 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0586ece-f57a-4a81-9cf7-e1cac4440d17 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/90859586-d6e1-424d-afef-9fa8914fc130" status: 200 len: 1462 microversion: 2.1 time: 0.056949 Mar 12 21:01:03.449475 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2388/3156] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:03 2022] GET /compute/v2.1/images/90859586-d6e1-424d-afef-9fa8914fc130 => generated 1462 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:03.454143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1bf58ea-134a-4b84-bc00-1a344e0cae88 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:03.454860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f1bf58ea-134a-4b84-bc00-1a344e0cae88 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:03.462363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1bf58ea-134a-4b84-bc00-1a344e0cae88 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:03.463037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1bf58ea-134a-4b84-bc00-1a344e0cae88 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:03.463888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1bf58ea-134a-4b84-bc00-1a344e0cae88 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:03.464339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1bf58ea-134a-4b84-bc00-1a344e0cae88 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:03.606941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f1bf58ea-134a-4b84-bc00-1a344e0cae88 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:03.617044 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1bf58ea-134a-4b84-bc00-1a344e0cae88 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.166350 Mar 12 21:01:03.617657 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2389/3157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:03 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:03.624208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-79112596-ecff-4a30-a4ef-6d6acc0da4d8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:03.630988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79112596-ecff-4a30-a4ef-6d6acc0da4d8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:03.631443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79112596-ecff-4a30-a4ef-6d6acc0da4d8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:03.658842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-79112596-ecff-4a30-a4ef-6d6acc0da4d8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Going to try to start instance {{(pid=136302) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 12 21:01:03.713060 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-79112596-ecff-4a30-a4ef-6d6acc0da4d8 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "POST /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/action" status: 202 len: 0 microversion: 2.1 time: 0.092844 Mar 12 21:01:03.719835 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2390/3158] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:03 2022] POST /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:01:03.720308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3743b974-e4bd-4a8e-8dac-9e86392c6e2a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:03.720904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3743b974-e4bd-4a8e-8dac-9e86392c6e2a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 8d0b657b-019a-495b-bf10-0b27962e3880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:03.729296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3743b974-e4bd-4a8e-8dac-9e86392c6e2a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:03.730100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3743b974-e4bd-4a8e-8dac-9e86392c6e2a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:03.731298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3743b974-e4bd-4a8e-8dac-9e86392c6e2a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:03.732259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3743b974-e4bd-4a8e-8dac-9e86392c6e2a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:03.909856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3743b974-e4bd-4a8e-8dac-9e86392c6e2a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:03.919745 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3743b974-e4bd-4a8e-8dac-9e86392c6e2a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880" status: 200 len: 1467 microversion: 2.1 time: 0.204620 Mar 12 21:01:03.920509 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2391/3159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:03 2022] GET /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880 => generated 1467 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:03.925627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16c4c9df-3e5a-4219-92c0-1cd90291d8fd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-241969747"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:03.927157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16c4c9df-3e5a-4219-92c0-1cd90291d8fd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:03.936516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16c4c9df-3e5a-4219-92c0-1cd90291d8fd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:03.937165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16c4c9df-3e5a-4219-92c0-1cd90291d8fd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:03.937992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16c4c9df-3e5a-4219-92c0-1cd90291d8fd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:03.938469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16c4c9df-3e5a-4219-92c0-1cd90291d8fd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:04.268718 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16c4c9df-3e5a-4219-92c0-1cd90291d8fd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.346518 Mar 12 21:01:04.269671 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2392/3160] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:03 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Mar 12 21:01:04.279277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39d530cf-9f8a-4016-84b3-063cddf4d3c5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:04.280258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39d530cf-9f8a-4016-84b3-063cddf4d3c5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:04.288003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39d530cf-9f8a-4016-84b3-063cddf4d3c5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:04.288723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39d530cf-9f8a-4016-84b3-063cddf4d3c5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:04.290046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39d530cf-9f8a-4016-84b3-063cddf4d3c5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:04.290693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39d530cf-9f8a-4016-84b3-063cddf4d3c5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:04.445759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39d530cf-9f8a-4016-84b3-063cddf4d3c5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:04.453682 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39d530cf-9f8a-4016-84b3-063cddf4d3c5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1566 microversion: 2.1 time: 0.178810 Mar 12 21:01:04.455533 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2393/3161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:04 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:04.460958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-856f829f-bb93-470c-8ebe-344711dd6d31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:04.461571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-856f829f-bb93-470c-8ebe-344711dd6d31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:04.467407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-856f829f-bb93-470c-8ebe-344711dd6d31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:04.467873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-856f829f-bb93-470c-8ebe-344711dd6d31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:04.468656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-856f829f-bb93-470c-8ebe-344711dd6d31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:04.469101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-856f829f-bb93-470c-8ebe-344711dd6d31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:04.675470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-856f829f-bb93-470c-8ebe-344711dd6d31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:04.684880 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-856f829f-bb93-470c-8ebe-344711dd6d31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1664 microversion: 2.1 time: 0.228244 Mar 12 21:01:04.685821 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2394/3162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:04 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1664 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:04.690933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2f12fb3-b725-486c-a7ff-388a6ff2c95e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1019714720"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:04.692851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2f12fb3-b725-486c-a7ff-388a6ff2c95e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:04.699607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2f12fb3-b725-486c-a7ff-388a6ff2c95e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:04.700161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2f12fb3-b725-486c-a7ff-388a6ff2c95e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:04.701030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2f12fb3-b725-486c-a7ff-388a6ff2c95e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:04.701612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2f12fb3-b725-486c-a7ff-388a6ff2c95e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.056493 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2f12fb3-b725-486c-a7ff-388a6ff2c95e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "POST /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f/action" status: 202 len: 0 microversion: 2.1 time: 0.369204 Mar 12 21:01:05.058643 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2395/3163] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:04 2022] POST /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 12 21:01:05.066511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cfa5109f-6174-41bc-9990-33da730d85d9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:05.068044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cfa5109f-6174-41bc-9990-33da730d85d9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:05.079784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfa5109f-6174-41bc-9990-33da730d85d9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.080624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfa5109f-6174-41bc-9990-33da730d85d9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.082956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfa5109f-6174-41bc-9990-33da730d85d9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.084318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfa5109f-6174-41bc-9990-33da730d85d9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.284417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cfa5109f-6174-41bc-9990-33da730d85d9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:05.292536 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cfa5109f-6174-41bc-9990-33da730d85d9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1322 microversion: 2.1 time: 0.232496 Mar 12 21:01:05.293228 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2396/3164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:05 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:05.297906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d7daff68-e435-4179-9054-0776d9677f4f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:05.298817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d7daff68-e435-4179-9054-0776d9677f4f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:05.304725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7daff68-e435-4179-9054-0776d9677f4f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.305184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7daff68-e435-4179-9054-0776d9677f4f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.305993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7daff68-e435-4179-9054-0776d9677f4f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.306443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7daff68-e435-4179-9054-0776d9677f4f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.320428 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d7daff68-e435-4179-9054-0776d9677f4f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] HTTP exception thrown: Instance a6f9574d-f898-4511-b23a-72aad24f9065 could not be found. Mar 12 21:01:05.321033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d7daff68-e435-4179-9054-0776d9677f4f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Returning 404 to user: Instance a6f9574d-f898-4511-b23a-72aad24f9065 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:01:05.321896 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d7daff68-e435-4179-9054-0776d9677f4f tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 404 len: 111 microversion: 2.42 time: 0.027591 Mar 12 21:01:05.322453 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2397/3165] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:01:05 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:01:05.328295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-efb0cd94-668c-40dc-89d2-ca2f27f11d60 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:05.329076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-efb0cd94-668c-40dc-89d2-ca2f27f11d60 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:05.335869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb0cd94-668c-40dc-89d2-ca2f27f11d60 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.336400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb0cd94-668c-40dc-89d2-ca2f27f11d60 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.337252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb0cd94-668c-40dc-89d2-ca2f27f11d60 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.337694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb0cd94-668c-40dc-89d2-ca2f27f11d60 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.477366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-efb0cd94-668c-40dc-89d2-ca2f27f11d60 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:05.485601 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-efb0cd94-668c-40dc-89d2-ca2f27f11d60 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 0.162152 Mar 12 21:01:05.486227 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2398/3166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:05 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:05.490932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8c58e18d-c1ec-49ae-a77a-20dfa82764ba req-ce73bbdc-eb54-4add-9dc1-91984693e53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-unplugged", "status": "completed", "tag": "5117c932-be7d-489d-a963-7d04449bc8e8"}, {"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-unplugged", "status": "completed", "tag": "0015b623-5a0c-4812-a5b5-eb6d23db47f1"}, {"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-unplugged", "status": "completed", "tag": "42ca35d6-c5fd-420f-a20f-a4b2b0e1afa2"}, {"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-unplugged", "status": "completed", "tag": "d9049983-2bce-4893-98d7-264a9e284203"}, {"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-unplugged", "status": "completed", "tag": "053e3ca3-8105-4491-a39b-6cdfdf4aee9c"}, {"server_uuid": "8d0b657b-019a-495b-bf10-0b27962e3880", "name": "network-vif-plugged", "status": "completed", "tag": "ea6450b5-34ee-4f9d-8b0d-7a507ad2499d"}, {"server_uuid": "e537d16d-478d-4375-a61a-c28f8a785539", "name": "network-vif-plugged", "status": "completed", "tag": "e0808d11-4cd5-4e52-88b4-c9eaec2126e6"}, {"server_uuid": "4236dcbc-d67f-483e-ae3d-1b3613b35181", "name": "network-vif-plugged", "status": "completed", "tag": "670a32c0-8906-4816-8ad8-a19dd87c3c18"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:05.502408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8c58e18d-c1ec-49ae-a77a-20dfa82764ba req-ce73bbdc-eb54-4add-9dc1-91984693e53e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.502958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8c58e18d-c1ec-49ae-a77a-20dfa82764ba req-ce73bbdc-eb54-4add-9dc1-91984693e53e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.519530 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8c58e18d-c1ec-49ae-a77a-20dfa82764ba req-ce73bbdc-eb54-4add-9dc1-91984693e53e service nova] Creating event network-vif-unplugged:5117c932-be7d-489d-a963-7d04449bc8e8 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 21:01:05.520631 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8c58e18d-c1ec-49ae-a77a-20dfa82764ba req-ce73bbdc-eb54-4add-9dc1-91984693e53e service nova] Creating event network-vif-unplugged:0015b623-5a0c-4812-a5b5-eb6d23db47f1 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 21:01:05.521132 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8c58e18d-c1ec-49ae-a77a-20dfa82764ba req-ce73bbdc-eb54-4add-9dc1-91984693e53e service nova] Creating event network-vif-unplugged:42ca35d6-c5fd-420f-a20f-a4b2b0e1afa2 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 21:01:05.521629 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8c58e18d-c1ec-49ae-a77a-20dfa82764ba req-ce73bbdc-eb54-4add-9dc1-91984693e53e service nova] Creating event network-vif-unplugged:d9049983-2bce-4893-98d7-264a9e284203 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 21:01:05.522153 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8c58e18d-c1ec-49ae-a77a-20dfa82764ba req-ce73bbdc-eb54-4add-9dc1-91984693e53e service nova] Creating event network-vif-unplugged:053e3ca3-8105-4491-a39b-6cdfdf4aee9c for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 21:01:05.522719 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8c58e18d-c1ec-49ae-a77a-20dfa82764ba req-ce73bbdc-eb54-4add-9dc1-91984693e53e service nova] Creating event network-vif-plugged:ea6450b5-34ee-4f9d-8b0d-7a507ad2499d for instance 8d0b657b-019a-495b-bf10-0b27962e3880 on nch2-master-1 Mar 12 21:01:05.523219 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8c58e18d-c1ec-49ae-a77a-20dfa82764ba req-ce73bbdc-eb54-4add-9dc1-91984693e53e service nova] Creating event network-vif-plugged:e0808d11-4cd5-4e52-88b4-c9eaec2126e6 for instance e537d16d-478d-4375-a61a-c28f8a785539 on nch2-master-1 Mar 12 21:01:05.523706 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8c58e18d-c1ec-49ae-a77a-20dfa82764ba req-ce73bbdc-eb54-4add-9dc1-91984693e53e service nova] Creating event network-vif-plugged:670a32c0-8906-4816-8ad8-a19dd87c3c18 for instance 4236dcbc-d67f-483e-ae3d-1b3613b35181 on nch1-master-1 Mar 12 21:01:05.535356 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8c58e18d-c1ec-49ae-a77a-20dfa82764ba req-ce73bbdc-eb54-4add-9dc1-91984693e53e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1390 microversion: 2.1 time: 0.047847 Mar 12 21:01:05.535956 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2399/3167] 10.222.0.30 () {64 vars in 1318 bytes} [Sat Mar 12 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 1390 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:05.541121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-92682983-9939-4740-8c9f-bad9ce779371 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356d4820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:05.592009 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-92682983-9939-4740-8c9f-bad9ce779371 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1453 microversion: 2.1 time: 0.054702 Mar 12 21:01:05.592614 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2400/3168] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:05 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1453 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:05.785291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8a02d0b-a1a8-41ec-aa14-d68c0a4015a1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130-project-admin] Calling method '.version_select at 0x7f6e356cbd30>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:05.786326 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:01:05.786326 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:01:05.787463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a02d0b-a1a8-41ec-aa14-d68c0a4015a1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.787918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a02d0b-a1a8-41ec-aa14-d68c0a4015a1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.806821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a02d0b-a1a8-41ec-aa14-d68c0a4015a1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.807279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a02d0b-a1a8-41ec-aa14-d68c0a4015a1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.818569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a02d0b-a1a8-41ec-aa14-d68c0a4015a1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.819029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a02d0b-a1a8-41ec-aa14-d68c0a4015a1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.824739 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8a02d0b-a1a8-41ec-aa14-d68c0a4015a1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1643599130-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.230862 Mar 12 21:01:05.825318 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2401/3169] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 21:01:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:05.829796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b5ae2e31-35a1-4ded-b0c0-b64cd824ca18 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '.version_select at 0x7f6e356d4af0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:05.854514 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b5ae2e31-35a1-4ded-b0c0-b64cd824ca18 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-328788283" status: 204 len: 0 microversion: 2.42 time: 0.027999 Mar 12 21:01:05.856115 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2402/3170] 10.222.0.30 () {60 vars in 1258 bytes} [Sat Mar 12 21:01:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-328788283 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:01:05.862285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-46907a3a-8b42-4e8d-be31-a82ea252b416 req-22f863aa-b518-49cf-820b-b48c6e81694c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-deleted", "tag": "42ca35d6-c5fd-420f-a20f-a4b2b0e1afa2"}, {"name": "network-changed", "server_uuid": "4236dcbc-d67f-483e-ae3d-1b3613b35181", "tag": "670a32c0-8906-4816-8ad8-a19dd87c3c18"}, {"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-deleted", "tag": "053e3ca3-8105-4491-a39b-6cdfdf4aee9c"}, {"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-deleted", "tag": "d9049983-2bce-4893-98d7-264a9e284203"}, {"server_uuid": "a6f9574d-f898-4511-b23a-72aad24f9065", "name": "network-vif-deleted", "tag": "0468882e-03df-441e-9049-75f95b5e3334"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:05.874808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-46907a3a-8b42-4e8d-be31-a82ea252b416 req-22f863aa-b518-49cf-820b-b48c6e81694c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.875441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-46907a3a-8b42-4e8d-be31-a82ea252b416 req-22f863aa-b518-49cf-820b-b48c6e81694c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.890549 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-46907a3a-8b42-4e8d-be31-a82ea252b416 req-22f863aa-b518-49cf-820b-b48c6e81694c service nova] Creating event network-vif-deleted:42ca35d6-c5fd-420f-a20f-a4b2b0e1afa2 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 21:01:05.891335 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-46907a3a-8b42-4e8d-be31-a82ea252b416 req-22f863aa-b518-49cf-820b-b48c6e81694c service nova] Creating event network-changed:670a32c0-8906-4816-8ad8-a19dd87c3c18 for instance 4236dcbc-d67f-483e-ae3d-1b3613b35181 on nch1-master-1 Mar 12 21:01:05.891916 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-46907a3a-8b42-4e8d-be31-a82ea252b416 req-22f863aa-b518-49cf-820b-b48c6e81694c service nova] Creating event network-vif-deleted:053e3ca3-8105-4491-a39b-6cdfdf4aee9c for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 21:01:05.892492 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-46907a3a-8b42-4e8d-be31-a82ea252b416 req-22f863aa-b518-49cf-820b-b48c6e81694c service nova] Creating event network-vif-deleted:d9049983-2bce-4893-98d7-264a9e284203 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 21:01:05.893110 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-46907a3a-8b42-4e8d-be31-a82ea252b416 req-22f863aa-b518-49cf-820b-b48c6e81694c service nova] Creating event network-vif-deleted:0468882e-03df-441e-9049-75f95b5e3334 for instance a6f9574d-f898-4511-b23a-72aad24f9065 on nch2-master-1 Mar 12 21:01:05.902907 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-46907a3a-8b42-4e8d-be31-a82ea252b416 req-22f863aa-b518-49cf-820b-b48c6e81694c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 863 microversion: 2.1 time: 0.045796 Mar 12 21:01:05.903990 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2403/3171] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 863 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:05.910507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3088ff0a-0efa-4deb-837a-f84ea1f5102f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:05.911281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3088ff0a-0efa-4deb-837a-f84ea1f5102f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:05.920038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3088ff0a-0efa-4deb-837a-f84ea1f5102f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.920584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3088ff0a-0efa-4deb-837a-f84ea1f5102f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:05.921842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3088ff0a-0efa-4deb-837a-f84ea1f5102f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:05.922456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3088ff0a-0efa-4deb-837a-f84ea1f5102f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:06.348652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3088ff0a-0efa-4deb-837a-f84ea1f5102f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:06.356719 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3088ff0a-0efa-4deb-837a-f84ea1f5102f tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1566 microversion: 2.1 time: 0.450959 Mar 12 21:01:06.367204 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2404/3172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:05 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1566 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:06.372479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b1d5ba3-75ac-4b5e-96c4-18d7cc2218fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:06.373332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b1d5ba3-75ac-4b5e-96c4-18d7cc2218fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:06.380077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b1d5ba3-75ac-4b5e-96c4-18d7cc2218fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:06.380762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b1d5ba3-75ac-4b5e-96c4-18d7cc2218fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:06.381941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b1d5ba3-75ac-4b5e-96c4-18d7cc2218fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:06.382650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b1d5ba3-75ac-4b5e-96c4-18d7cc2218fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:07.058947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b1d5ba3-75ac-4b5e-96c4-18d7cc2218fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:07.085983 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b1d5ba3-75ac-4b5e-96c4-18d7cc2218fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1668 microversion: 2.1 time: 0.716962 Mar 12 21:01:07.099330 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2405/3173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:06 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1668 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:07.106985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eb8c8409-3fe8-4048-a2fa-963ce1147246 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:07.107724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eb8c8409-3fe8-4048-a2fa-963ce1147246 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:07.116047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb8c8409-3fe8-4048-a2fa-963ce1147246 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:07.116730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb8c8409-3fe8-4048-a2fa-963ce1147246 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:07.117756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb8c8409-3fe8-4048-a2fa-963ce1147246 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:07.118514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb8c8409-3fe8-4048-a2fa-963ce1147246 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:07.518166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eb8c8409-3fe8-4048-a2fa-963ce1147246 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:07.527049 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eb8c8409-3fe8-4048-a2fa-963ce1147246 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1322 microversion: 2.1 time: 0.426228 Mar 12 21:01:07.529458 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2406/3174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:07 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:07.533067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-147c914a-e11b-4d48-8a7b-ab08e650dd8d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:07.533845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-147c914a-e11b-4d48-8a7b-ab08e650dd8d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:07.544749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-147c914a-e11b-4d48-8a7b-ab08e650dd8d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:07.545587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-147c914a-e11b-4d48-8a7b-ab08e650dd8d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:07.546596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-147c914a-e11b-4d48-8a7b-ab08e650dd8d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:07.548012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-147c914a-e11b-4d48-8a7b-ab08e650dd8d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:07.869900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-147c914a-e11b-4d48-8a7b-ab08e650dd8d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:07.880903 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-147c914a-e11b-4d48-8a7b-ab08e650dd8d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1688 microversion: 2.1 time: 0.351400 Mar 12 21:01:07.892084 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2407/3175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:07 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1688 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:07.896440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2bc44839-0706-4af4-b0bf-d046f435012b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3568e940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:07.953853 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2bc44839-0706-4af4-b0bf-d046f435012b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1453 microversion: 2.1 time: 0.066613 Mar 12 21:01:07.954274 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2408/3176] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:07 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:07.958923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ee7d269-3928-4f97-9c7a-1e424971074b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:07.959545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ee7d269-3928-4f97-9c7a-1e424971074b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:07.966416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee7d269-3928-4f97-9c7a-1e424971074b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:07.966887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee7d269-3928-4f97-9c7a-1e424971074b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:07.967687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee7d269-3928-4f97-9c7a-1e424971074b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:07.968138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee7d269-3928-4f97-9c7a-1e424971074b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:08.300252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ee7d269-3928-4f97-9c7a-1e424971074b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:08.310633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ee7d269-3928-4f97-9c7a-1e424971074b tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1566 microversion: 2.1 time: 0.355297 Mar 12 21:01:08.321070 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2409/3177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:07 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1566 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:08.327242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-96f872f7-d5a3-4f49-8d2c-a55086f6417d req-8d07e59b-331d-496f-9a79-4a3cf810101c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0b657b-019a-495b-bf10-0b27962e3880", "name": "network-vif-unplugged", "status": "completed", "tag": "ea6450b5-34ee-4f9d-8b0d-7a507ad2499d"}, {"server_uuid": "e537d16d-478d-4375-a61a-c28f8a785539", "name": "network-vif-unplugged", "status": "completed", "tag": "e0808d11-4cd5-4e52-88b4-c9eaec2126e6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:08.339445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-96f872f7-d5a3-4f49-8d2c-a55086f6417d req-8d07e59b-331d-496f-9a79-4a3cf810101c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:08.339909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-96f872f7-d5a3-4f49-8d2c-a55086f6417d req-8d07e59b-331d-496f-9a79-4a3cf810101c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:08.355358 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-96f872f7-d5a3-4f49-8d2c-a55086f6417d req-8d07e59b-331d-496f-9a79-4a3cf810101c service nova] Creating event network-vif-unplugged:ea6450b5-34ee-4f9d-8b0d-7a507ad2499d for instance 8d0b657b-019a-495b-bf10-0b27962e3880 on nch2-master-1 Mar 12 21:01:08.356176 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-96f872f7-d5a3-4f49-8d2c-a55086f6417d req-8d07e59b-331d-496f-9a79-4a3cf810101c service nova] Creating event network-vif-unplugged:e0808d11-4cd5-4e52-88b4-c9eaec2126e6 for instance e537d16d-478d-4375-a61a-c28f8a785539 on nch2-master-1 Mar 12 21:01:08.366617 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-96f872f7-d5a3-4f49-8d2c-a55086f6417d req-8d07e59b-331d-496f-9a79-4a3cf810101c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.043852 Mar 12 21:01:08.367294 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2410/3178] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:08.546500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-352cb65e-873a-4084-8c17-5b9a5e5496c3 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:08.547230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-352cb65e-873a-4084-8c17-5b9a5e5496c3 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:08.558660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-352cb65e-873a-4084-8c17-5b9a5e5496c3 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:08.559135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-352cb65e-873a-4084-8c17-5b9a5e5496c3 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:08.560068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-352cb65e-873a-4084-8c17-5b9a5e5496c3 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:08.560379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-352cb65e-873a-4084-8c17-5b9a5e5496c3 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:08.970619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-352cb65e-873a-4084-8c17-5b9a5e5496c3 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:08.986294 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-352cb65e-873a-4084-8c17-5b9a5e5496c3 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1517 microversion: 2.1 time: 0.445418 Mar 12 21:01:08.989285 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2411/3179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:08 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1517 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:01:09.008290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-97e96846-1bc3-420f-b1e8-423074bd1865 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:09.008917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-97e96846-1bc3-420f-b1e8-423074bd1865 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:09.034690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97e96846-1bc3-420f-b1e8-423074bd1865 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:09.036094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97e96846-1bc3-420f-b1e8-423074bd1865 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:09.037087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97e96846-1bc3-420f-b1e8-423074bd1865 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:09.038114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97e96846-1bc3-420f-b1e8-423074bd1865 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:09.458904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-97e96846-1bc3-420f-b1e8-423074bd1865 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:09.472593 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-97e96846-1bc3-420f-b1e8-423074bd1865 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1683 microversion: 2.1 time: 0.479333 Mar 12 21:01:09.474335 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2412/3180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:08 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1683 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:09.490183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8861d2e9-755f-4848-8eae-73ba791e270b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356f7790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:09.598843 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8861d2e9-755f-4848-8eae-73ba791e270b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1453 microversion: 2.1 time: 0.120958 Mar 12 21:01:09.599462 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2413/3181] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:09 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:09.610737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20619b7c-b41a-4360-9eab-037cdd160dd4 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:09.611758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20619b7c-b41a-4360-9eab-037cdd160dd4 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:09.643370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20619b7c-b41a-4360-9eab-037cdd160dd4 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:09.645630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20619b7c-b41a-4360-9eab-037cdd160dd4 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:09.652896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20619b7c-b41a-4360-9eab-037cdd160dd4 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:09.655387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20619b7c-b41a-4360-9eab-037cdd160dd4 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:09.713890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-20619b7c-b41a-4360-9eab-037cdd160dd4 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lazy-loading 'flavor' on Instance uuid 4236dcbc-d67f-483e-ae3d-1b3613b35181 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:01:09.945688 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20619b7c-b41a-4360-9eab-037cdd160dd4 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "POST /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181/action" status: 200 len: 32 microversion: 2.1 time: 0.343575 Mar 12 21:01:09.952250 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2414/3182] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:09 2022] POST /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181/action => generated 32 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:01:09.959928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d33b013-6e63-4cfa-8c3a-ea342aa74672 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:09.960806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2d33b013-6e63-4cfa-8c3a-ea342aa74672 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:09.968446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d33b013-6e63-4cfa-8c3a-ea342aa74672 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:09.970041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d33b013-6e63-4cfa-8c3a-ea342aa74672 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:09.971515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d33b013-6e63-4cfa-8c3a-ea342aa74672 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:09.973502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d33b013-6e63-4cfa-8c3a-ea342aa74672 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:10.471973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2d33b013-6e63-4cfa-8c3a-ea342aa74672 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:10.484233 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d33b013-6e63-4cfa-8c3a-ea342aa74672 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1566 microversion: 2.1 time: 0.528480 Mar 12 21:01:10.485996 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2415/3183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:09 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1566 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:10.496666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1467d14e-4130-4cda-98fe-644610ca7a71 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:10.501155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1467d14e-4130-4cda-98fe-644610ca7a71 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:10.514859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1467d14e-4130-4cda-98fe-644610ca7a71 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:10.518379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1467d14e-4130-4cda-98fe-644610ca7a71 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:10.520008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1467d14e-4130-4cda-98fe-644610ca7a71 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:10.520674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1467d14e-4130-4cda-98fe-644610ca7a71 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:11.169621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1467d14e-4130-4cda-98fe-644610ca7a71 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:11.187426 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1467d14e-4130-4cda-98fe-644610ca7a71 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1523 microversion: 2.1 time: 0.696440 Mar 12 21:01:11.188829 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2416/3184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:10 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1523 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:11.205225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a89e7a56-dce3-4d53-bbe5-89add4a8f158 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:11.206545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a89e7a56-dce3-4d53-bbe5-89add4a8f158 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:11.219191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a89e7a56-dce3-4d53-bbe5-89add4a8f158 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:11.219851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a89e7a56-dce3-4d53-bbe5-89add4a8f158 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:11.220808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a89e7a56-dce3-4d53-bbe5-89add4a8f158 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:11.223810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a89e7a56-dce3-4d53-bbe5-89add4a8f158 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:11.890236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a89e7a56-dce3-4d53-bbe5-89add4a8f158 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:11.903812 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a89e7a56-dce3-4d53-bbe5-89add4a8f158 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1683 microversion: 2.1 time: 0.710289 Mar 12 21:01:11.905004 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2417/3185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:11 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1683 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:11.918701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7cc1013f-5871-48c8-8a93-3314cf9dad82 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3568e790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:11.996103 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7cc1013f-5871-48c8-8a93-3314cf9dad82 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1453 microversion: 2.1 time: 0.089043 Mar 12 21:01:11.997180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2418/3186] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:11 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:12.006179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ab3b97a5-d58c-43c3-9e12-cc6e1cb40dc3 req-c48369d0-20c6-4851-acf8-baf37be69ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e537d16d-478d-4375-a61a-c28f8a785539", "name": "network-vif-plugged", "status": "completed", "tag": "e0808d11-4cd5-4e52-88b4-c9eaec2126e6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:12.020757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ab3b97a5-d58c-43c3-9e12-cc6e1cb40dc3 req-c48369d0-20c6-4851-acf8-baf37be69ac5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:12.030862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ab3b97a5-d58c-43c3-9e12-cc6e1cb40dc3 req-c48369d0-20c6-4851-acf8-baf37be69ac5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:12.046224 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ab3b97a5-d58c-43c3-9e12-cc6e1cb40dc3 req-c48369d0-20c6-4851-acf8-baf37be69ac5 service nova] Creating event network-vif-plugged:e0808d11-4cd5-4e52-88b4-c9eaec2126e6 for instance e537d16d-478d-4375-a61a-c28f8a785539 on nch2-master-1 Mar 12 21:01:12.066866 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ab3b97a5-d58c-43c3-9e12-cc6e1cb40dc3 req-c48369d0-20c6-4851-acf8-baf37be69ac5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067948 Mar 12 21:01:12.068206 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2419/3187] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:12.073670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04832108-74ee-43c2-8eb3-b464e339a07d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:12.080003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04832108-74ee-43c2-8eb3-b464e339a07d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:12.087518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04832108-74ee-43c2-8eb3-b464e339a07d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:12.089094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04832108-74ee-43c2-8eb3-b464e339a07d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:12.090183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04832108-74ee-43c2-8eb3-b464e339a07d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:12.090867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04832108-74ee-43c2-8eb3-b464e339a07d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:13.547108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04832108-74ee-43c2-8eb3-b464e339a07d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:13.557656 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04832108-74ee-43c2-8eb3-b464e339a07d tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1546 microversion: 2.1 time: 1.487986 Mar 12 21:01:13.558892 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2420/3188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:12 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1546 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:13.563772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a70a33c4-0170-40e3-b174-76b215a98699 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:13.564646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a70a33c4-0170-40e3-b174-76b215a98699 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:13.573564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a70a33c4-0170-40e3-b174-76b215a98699 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:13.574728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a70a33c4-0170-40e3-b174-76b215a98699 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:13.575886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a70a33c4-0170-40e3-b174-76b215a98699 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:13.576524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a70a33c4-0170-40e3-b174-76b215a98699 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:13.937069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a70a33c4-0170-40e3-b174-76b215a98699 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:13.948766 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a70a33c4-0170-40e3-b174-76b215a98699 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1523 microversion: 2.1 time: 0.388555 Mar 12 21:01:13.949376 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2421/3189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:13 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:13.954358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4456d7c4-07e7-4882-912a-614e4a56eec3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:13.955151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4456d7c4-07e7-4882-912a-614e4a56eec3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:13.978723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4456d7c4-07e7-4882-912a-614e4a56eec3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:13.979470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4456d7c4-07e7-4882-912a-614e4a56eec3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:13.983093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4456d7c4-07e7-4882-912a-614e4a56eec3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:13.983800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4456d7c4-07e7-4882-912a-614e4a56eec3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:14.306101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4456d7c4-07e7-4882-912a-614e4a56eec3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:14.313790 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4456d7c4-07e7-4882-912a-614e4a56eec3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1683 microversion: 2.1 time: 0.362886 Mar 12 21:01:14.327467 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2422/3190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:13 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1683 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:14.332750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26b85bfd-e940-46aa-bd88-a6f9a5b9947f tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356c99d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:14.391122 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-26b85bfd-e940-46aa-bd88-a6f9a5b9947f tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1453 microversion: 2.1 time: 0.062076 Mar 12 21:01:14.392324 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2423/3191] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:14 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:14.397451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-65f3242e-ed79-4152-98bf-de47416eb450 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:14.398226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-65f3242e-ed79-4152-98bf-de47416eb450 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:14.404826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65f3242e-ed79-4152-98bf-de47416eb450 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:14.405656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65f3242e-ed79-4152-98bf-de47416eb450 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:14.406747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65f3242e-ed79-4152-98bf-de47416eb450 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:14.407345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65f3242e-ed79-4152-98bf-de47416eb450 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:14.524437 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-65f3242e-ed79-4152-98bf-de47416eb450 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] HTTP exception thrown: Cannot 'detach_volume' instance b3b9fa34-2929-4ab9-b2d8-47c9949331e3 while it is in vm_state rescued Mar 12 21:01:14.526545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-65f3242e-ed79-4152-98bf-de47416eb450 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Returning 409 to user: Cannot 'detach_volume' instance b3b9fa34-2929-4ab9-b2d8-47c9949331e3 while it is in vm_state rescued {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:01:14.533901 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-65f3242e-ed79-4152-98bf-de47416eb450 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/os-volume_attachments/fd57576e-68d3-4a4b-af68-9b423f85de28" status: 409 len: 152 microversion: 2.1 time: 0.134233 Mar 12 21:01:14.534851 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2424/3192] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:01:14 2022] DELETE /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/os-volume_attachments/fd57576e-68d3-4a4b-af68-9b423f85de28 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 21:01:14.546070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f51f469-35fc-4dad-8af1-00d300d57ce4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:14.546995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f51f469-35fc-4dad-8af1-00d300d57ce4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:14.563304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f51f469-35fc-4dad-8af1-00d300d57ce4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:14.563869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f51f469-35fc-4dad-8af1-00d300d57ce4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:14.564466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f51f469-35fc-4dad-8af1-00d300d57ce4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:14.565179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f51f469-35fc-4dad-8af1-00d300d57ce4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:14.584712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-0f51f469-35fc-4dad-8af1-00d300d57ce4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] HTTP exception thrown: Instance a6f9574d-f898-4511-b23a-72aad24f9065 could not be found. Mar 12 21:01:14.585327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f51f469-35fc-4dad-8af1-00d300d57ce4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Returning 404 to user: Instance a6f9574d-f898-4511-b23a-72aad24f9065 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:01:14.586219 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f51f469-35fc-4dad-8af1-00d300d57ce4 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 404 len: 111 microversion: 2.42 time: 0.049688 Mar 12 21:01:14.607180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2425/3193] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 21:01:14 2022] DELETE /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:01:14.614568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d184a6f4-55a8-4849-8ce1-56c976034559 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:14.614903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d184a6f4-55a8-4849-8ce1-56c976034559 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:14.621642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d184a6f4-55a8-4849-8ce1-56c976034559 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:14.622385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d184a6f4-55a8-4849-8ce1-56c976034559 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:14.623374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d184a6f4-55a8-4849-8ce1-56c976034559 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:14.623989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d184a6f4-55a8-4849-8ce1-56c976034559 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:14.750167 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d184a6f4-55a8-4849-8ce1-56c976034559 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action" status: 202 len: 0 microversion: 2.1 time: 0.141604 Mar 12 21:01:14.754619 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2426/3194] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:14 2022] POST /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:01:14.778654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-15de62bc-4b98-4350-a839-1e9bba8ba054 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:14.779511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-15de62bc-4b98-4350-a839-1e9bba8ba054 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] [instance: a6f9574d-f898-4511-b23a-72aad24f9065] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:14.791021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15de62bc-4b98-4350-a839-1e9bba8ba054 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:14.792085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15de62bc-4b98-4350-a839-1e9bba8ba054 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:14.796408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15de62bc-4b98-4350-a839-1e9bba8ba054 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:14.797839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15de62bc-4b98-4350-a839-1e9bba8ba054 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:14.825605 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-15de62bc-4b98-4350-a839-1e9bba8ba054 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] HTTP exception thrown: Instance a6f9574d-f898-4511-b23a-72aad24f9065 could not be found. Mar 12 21:01:14.827213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-15de62bc-4b98-4350-a839-1e9bba8ba054 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] Returning 404 to user: Instance a6f9574d-f898-4511-b23a-72aad24f9065 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:01:14.828497 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-15de62bc-4b98-4350-a839-1e9bba8ba054 tempest-TaggedBootDevicesTest_v242-514267230 tempest-TaggedBootDevicesTest_v242-514267230-project] 10.222.0.30 "GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065" status: 404 len: 111 microversion: 2.42 time: 0.075599 Mar 12 21:01:14.847258 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2427/3195] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:01:14 2022] GET /compute/v2.1/servers/a6f9574d-f898-4511-b23a-72aad24f9065 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:01:14.857588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5de83a6a-9878-431a-8b39-d709fc1b2ca9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:14.873529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5de83a6a-9878-431a-8b39-d709fc1b2ca9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:14.888177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5de83a6a-9878-431a-8b39-d709fc1b2ca9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:14.892305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5de83a6a-9878-431a-8b39-d709fc1b2ca9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:14.900685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5de83a6a-9878-431a-8b39-d709fc1b2ca9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:14.902061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5de83a6a-9878-431a-8b39-d709fc1b2ca9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:15.481455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5de83a6a-9878-431a-8b39-d709fc1b2ca9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:15.481455 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5de83a6a-9878-431a-8b39-d709fc1b2ca9 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1554 microversion: 2.1 time: 0.627438 Mar 12 21:01:15.481455 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2428/3196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:14 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1554 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:15.505564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1971cd80-d480-486e-b303-7d1b3d2f9382 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:15.506318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1971cd80-d480-486e-b303-7d1b3d2f9382 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:15.516508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1971cd80-d480-486e-b303-7d1b3d2f9382 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:15.517621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1971cd80-d480-486e-b303-7d1b3d2f9382 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:15.520771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1971cd80-d480-486e-b303-7d1b3d2f9382 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:15.522522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1971cd80-d480-486e-b303-7d1b3d2f9382 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:15.924640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1971cd80-d480-486e-b303-7d1b3d2f9382 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:15.940448 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1971cd80-d480-486e-b303-7d1b3d2f9382 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1523 microversion: 2.1 time: 0.461143 Mar 12 21:01:15.942013 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2429/3197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:15 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1523 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:15.947658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-cd15a622-d344-4f6e-94a2-a620ec2a9e15 req-8fc4b8af-03b3-441a-95f2-cb03f0f1325e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c44039-6c03-403b-8828-046bf508b27f", "name": "network-vif-plugged", "status": "completed", "tag": "891b1bf1-7d7e-4f05-9c62-d7d4abaf05db"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:15.958731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cd15a622-d344-4f6e-94a2-a620ec2a9e15 req-8fc4b8af-03b3-441a-95f2-cb03f0f1325e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:15.959557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cd15a622-d344-4f6e-94a2-a620ec2a9e15 req-8fc4b8af-03b3-441a-95f2-cb03f0f1325e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:15.973002 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-cd15a622-d344-4f6e-94a2-a620ec2a9e15 req-8fc4b8af-03b3-441a-95f2-cb03f0f1325e service nova] Creating event network-vif-plugged:891b1bf1-7d7e-4f05-9c62-d7d4abaf05db for instance 63c44039-6c03-403b-8828-046bf508b27f on nch1-master-1 Mar 12 21:01:15.982742 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-cd15a622-d344-4f6e-94a2-a620ec2a9e15 req-8fc4b8af-03b3-441a-95f2-cb03f0f1325e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039235 Mar 12 21:01:15.987175 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2430/3198] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:16.001009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb371b3d-6672-4eee-a1ad-9eff3c8d9800 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:16.002540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb371b3d-6672-4eee-a1ad-9eff3c8d9800 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:16.011415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb371b3d-6672-4eee-a1ad-9eff3c8d9800 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:16.020789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb371b3d-6672-4eee-a1ad-9eff3c8d9800 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:16.022438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb371b3d-6672-4eee-a1ad-9eff3c8d9800 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:16.024652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb371b3d-6672-4eee-a1ad-9eff3c8d9800 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:16.445258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bb371b3d-6672-4eee-a1ad-9eff3c8d9800 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:16.459589 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb371b3d-6672-4eee-a1ad-9eff3c8d9800 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1683 microversion: 2.1 time: 0.466615 Mar 12 21:01:16.469858 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2431/3199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:15 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1683 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:16.482318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-13a0556b-8d0b-413e-8816-4a56f09db88d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3568ef70>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:16.568267 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-13a0556b-8d0b-413e-8816-4a56f09db88d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1453 microversion: 2.1 time: 0.096333 Mar 12 21:01:16.569638 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2432/3200] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:16 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:16.579915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f4374a3e-a1ae-4af9-8917-d19a0f09fff7 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:16.581017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f4374a3e-a1ae-4af9-8917-d19a0f09fff7 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:16.591086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4374a3e-a1ae-4af9-8917-d19a0f09fff7 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:16.591847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4374a3e-a1ae-4af9-8917-d19a0f09fff7 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:16.592862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4374a3e-a1ae-4af9-8917-d19a0f09fff7 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:16.593725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4374a3e-a1ae-4af9-8917-d19a0f09fff7 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:16.879206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f4374a3e-a1ae-4af9-8917-d19a0f09fff7 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:16.892666 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f4374a3e-a1ae-4af9-8917-d19a0f09fff7 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1554 microversion: 2.1 time: 0.321163 Mar 12 21:01:16.910335 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2433/3201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:16 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1554 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:16.960973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b15e3d81-6d48-4400-b1c4-c83faa9e0c2c tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:16.961615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b15e3d81-6d48-4400-b1c4-c83faa9e0c2c tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:16.970906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b15e3d81-6d48-4400-b1c4-c83faa9e0c2c tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:16.971360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b15e3d81-6d48-4400-b1c4-c83faa9e0c2c tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:16.972168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b15e3d81-6d48-4400-b1c4-c83faa9e0c2c tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:16.972638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b15e3d81-6d48-4400-b1c4-c83faa9e0c2c tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:17.339219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b15e3d81-6d48-4400-b1c4-c83faa9e0c2c tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:17.351156 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b15e3d81-6d48-4400-b1c4-c83faa9e0c2c tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1523 microversion: 2.1 time: 0.394432 Mar 12 21:01:17.351996 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2434/3202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:16 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1523 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:17.476467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-df576c67-0991-4521-ac19-0c5a52f83f46 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:17.479222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-df576c67-0991-4521-ac19-0c5a52f83f46 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:17.488188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df576c67-0991-4521-ac19-0c5a52f83f46 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:17.488657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df576c67-0991-4521-ac19-0c5a52f83f46 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:17.491367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df576c67-0991-4521-ac19-0c5a52f83f46 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:17.493561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df576c67-0991-4521-ac19-0c5a52f83f46 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:17.860020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-df576c67-0991-4521-ac19-0c5a52f83f46 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:17.871569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-df576c67-0991-4521-ac19-0c5a52f83f46 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1683 microversion: 2.1 time: 0.398910 Mar 12 21:01:17.877311 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2435/3203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:17 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1683 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:01:17.890985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30f2fd66-e387-4d5b-b0db-e06775534265 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356f7940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:17.984331 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30f2fd66-e387-4d5b-b0db-e06775534265 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1453 microversion: 2.1 time: 0.105220 Mar 12 21:01:17.985074 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2436/3204] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:17 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:17.991744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b338456-7b26-431b-ad4e-0ce2f9dd8f49 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:17.995975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b338456-7b26-431b-ad4e-0ce2f9dd8f49 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:18.012371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b338456-7b26-431b-ad4e-0ce2f9dd8f49 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:18.014930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b338456-7b26-431b-ad4e-0ce2f9dd8f49 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:18.015862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b338456-7b26-431b-ad4e-0ce2f9dd8f49 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:18.016520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b338456-7b26-431b-ad4e-0ce2f9dd8f49 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:18.281139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b338456-7b26-431b-ad4e-0ce2f9dd8f49 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:18.293892 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b338456-7b26-431b-ad4e-0ce2f9dd8f49 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1554 microversion: 2.1 time: 0.307551 Mar 12 21:01:18.297590 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2437/3205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:17 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1554 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:18.379907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d3568b25-857c-494f-9e05-41b420aebd0f tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:18.380609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d3568b25-857c-494f-9e05-41b420aebd0f tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:18.394981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3568b25-857c-494f-9e05-41b420aebd0f tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:18.396179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3568b25-857c-494f-9e05-41b420aebd0f tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:18.398053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3568b25-857c-494f-9e05-41b420aebd0f tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:18.402833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3568b25-857c-494f-9e05-41b420aebd0f tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:18.896203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d3568b25-857c-494f-9e05-41b420aebd0f tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:18.914764 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d3568b25-857c-494f-9e05-41b420aebd0f tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1523 microversion: 2.1 time: 0.549396 Mar 12 21:01:18.921147 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2438/3206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:18 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1523 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:18.930170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1e62de8c-c944-434e-9023-10f08f4e5581 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:18.932141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1e62de8c-c944-434e-9023-10f08f4e5581 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:18.947439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e62de8c-c944-434e-9023-10f08f4e5581 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:18.948742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e62de8c-c944-434e-9023-10f08f4e5581 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:18.952607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e62de8c-c944-434e-9023-10f08f4e5581 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:18.953098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e62de8c-c944-434e-9023-10f08f4e5581 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:19.204966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1e62de8c-c944-434e-9023-10f08f4e5581 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:19.226627 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1e62de8c-c944-434e-9023-10f08f4e5581 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1683 microversion: 2.1 time: 0.303326 Mar 12 21:01:19.227983 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2439/3207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:18 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1683 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:19.245733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-065e31ae-c864-4f2f-bfbc-b327203c3e5c tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3568e940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:28.930241 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-065e31ae-c864-4f2f-bfbc-b327203c3e5c tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1453 microversion: 2.1 time: 9.700823 Mar 12 21:01:28.931726 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2440/3208] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:19 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1453 bytes in 9703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:28.952624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a17e9769-9da2-488f-ba8e-4e8b7b5c78cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:28.953254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a17e9769-9da2-488f-ba8e-4e8b7b5c78cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:28.971760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a17e9769-9da2-488f-ba8e-4e8b7b5c78cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:28.972445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a17e9769-9da2-488f-ba8e-4e8b7b5c78cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:28.973262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a17e9769-9da2-488f-ba8e-4e8b7b5c78cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:28.973705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a17e9769-9da2-488f-ba8e-4e8b7b5c78cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:29.325256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a17e9769-9da2-488f-ba8e-4e8b7b5c78cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:29.341442 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a17e9769-9da2-488f-ba8e-4e8b7b5c78cf tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1560 microversion: 2.1 time: 0.408632 Mar 12 21:01:29.345393 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2441/3209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:28 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1560 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:29.354421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-668a4f39-51f7-47ee-9dd4-ab64ebe1e73e tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:29.355041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-668a4f39-51f7-47ee-9dd4-ab64ebe1e73e tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:29.393751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-668a4f39-51f7-47ee-9dd4-ab64ebe1e73e tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:29.402695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-668a4f39-51f7-47ee-9dd4-ab64ebe1e73e tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:29.407403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-668a4f39-51f7-47ee-9dd4-ab64ebe1e73e tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:29.408143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-668a4f39-51f7-47ee-9dd4-ab64ebe1e73e tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:29.986706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-668a4f39-51f7-47ee-9dd4-ab64ebe1e73e tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:30.027196 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-668a4f39-51f7-47ee-9dd4-ab64ebe1e73e tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1523 microversion: 2.1 time: 0.679105 Mar 12 21:01:30.031704 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2442/3210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:29 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1523 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:30.040114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ffc0d4b-5f72-4b48-af60-8323a086d209 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:30.041357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ffc0d4b-5f72-4b48-af60-8323a086d209 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:30.054068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ffc0d4b-5f72-4b48-af60-8323a086d209 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:30.055052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ffc0d4b-5f72-4b48-af60-8323a086d209 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:30.056878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ffc0d4b-5f72-4b48-af60-8323a086d209 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:30.057969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ffc0d4b-5f72-4b48-af60-8323a086d209 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:31.229888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ffc0d4b-5f72-4b48-af60-8323a086d209 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:31.244952 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ffc0d4b-5f72-4b48-af60-8323a086d209 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 1.211526 Mar 12 21:01:31.246396 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2443/3211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:30 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:31.260308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0500fa20-b9d9-4343-971b-b9b7cdbe31f0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:31.261143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0500fa20-b9d9-4343-971b-b9b7cdbe31f0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:31.268512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0500fa20-b9d9-4343-971b-b9b7cdbe31f0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:31.269297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0500fa20-b9d9-4343-971b-b9b7cdbe31f0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:31.270333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0500fa20-b9d9-4343-971b-b9b7cdbe31f0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:31.270972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0500fa20-b9d9-4343-971b-b9b7cdbe31f0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:31.415861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-0500fa20-b9d9-4343-971b-b9b7cdbe31f0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lazy-loading 'services' on Instance uuid b3b9fa34-2929-4ab9-b2d8-47c9949331e3 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:01:31.523695 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0500fa20-b9d9-4343-971b-b9b7cdbe31f0 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/os-volume_attachments/fd57576e-68d3-4a4b-af68-9b423f85de28" status: 202 len: 0 microversion: 2.1 time: 0.273618 Mar 12 21:01:31.524324 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2444/3212] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:01:31 2022] DELETE /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/os-volume_attachments/fd57576e-68d3-4a4b-af68-9b423f85de28 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:01:31.535172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa62d75b-d877-4614-ba46-271abd700ed6 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3569eaf0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:31.619709 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aa62d75b-d877-4614-ba46-271abd700ed6 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1453 microversion: 2.1 time: 0.090651 Mar 12 21:01:31.635395 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2445/3213] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:31 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:31.652578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be52be0f-8bce-4270-9bfc-2cabbe64db02 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:31.656969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-be52be0f-8bce-4270-9bfc-2cabbe64db02 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:31.673787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be52be0f-8bce-4270-9bfc-2cabbe64db02 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:31.674704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be52be0f-8bce-4270-9bfc-2cabbe64db02 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:31.678112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be52be0f-8bce-4270-9bfc-2cabbe64db02 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:31.680337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be52be0f-8bce-4270-9bfc-2cabbe64db02 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:31.889979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be52be0f-8bce-4270-9bfc-2cabbe64db02 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:31.898611 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be52be0f-8bce-4270-9bfc-2cabbe64db02 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1523 microversion: 2.1 time: 0.257988 Mar 12 21:01:31.914947 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2446/3214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:31 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:31.923411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd830b90-eba0-48e8-8e77-b7875e049639 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:31.924106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd830b90-eba0-48e8-8e77-b7875e049639 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:31.931304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd830b90-eba0-48e8-8e77-b7875e049639 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:31.931890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd830b90-eba0-48e8-8e77-b7875e049639 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:31.932837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd830b90-eba0-48e8-8e77-b7875e049639 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:31.934360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd830b90-eba0-48e8-8e77-b7875e049639 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:32.189436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fd830b90-eba0-48e8-8e77-b7875e049639 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:32.199624 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd830b90-eba0-48e8-8e77-b7875e049639 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.282796 Mar 12 21:01:32.210022 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2447/3215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:31 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:32.210022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ebd8b6b6-22a3-4e97-b9bb-8d46d5e5fc9a tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:32.210022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ebd8b6b6-22a3-4e97-b9bb-8d46d5e5fc9a tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:32.228293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebd8b6b6-22a3-4e97-b9bb-8d46d5e5fc9a tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:32.230901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebd8b6b6-22a3-4e97-b9bb-8d46d5e5fc9a tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:32.231738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebd8b6b6-22a3-4e97-b9bb-8d46d5e5fc9a tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:32.232182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebd8b6b6-22a3-4e97-b9bb-8d46d5e5fc9a tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:32.322087 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ebd8b6b6-22a3-4e97-b9bb-8d46d5e5fc9a tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120395 Mar 12 21:01:32.324269 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2448/3216] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:01:32 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:32.641324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a93047d-c3e3-43b8-bb47-df0e8bff12d7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3572fd30>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:34.855113 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a93047d-c3e3-43b8-bb47-df0e8bff12d7 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1453 microversion: 2.1 time: 2.218313 Mar 12 21:01:34.856617 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2449/3217] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:32 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1453 bytes in 2220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:34.865348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-74479424-cad7-4562-a8c4-c754dc288cb6 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:34.866357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-74479424-cad7-4562-a8c4-c754dc288cb6 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:34.873118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74479424-cad7-4562-a8c4-c754dc288cb6 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:34.874027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74479424-cad7-4562-a8c4-c754dc288cb6 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:34.875134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74479424-cad7-4562-a8c4-c754dc288cb6 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:34.875805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74479424-cad7-4562-a8c4-c754dc288cb6 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:35.617011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-74479424-cad7-4562-a8c4-c754dc288cb6 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:35.628921 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-74479424-cad7-4562-a8c4-c754dc288cb6 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1523 microversion: 2.1 time: 0.770875 Mar 12 21:01:35.629431 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2450/3218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:34 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1523 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:35.642393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-50a2a09f-e52a-4dc0-82e9-cd2e4ad47103 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:35.643422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-50a2a09f-e52a-4dc0-82e9-cd2e4ad47103 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:35.670525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50a2a09f-e52a-4dc0-82e9-cd2e4ad47103 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:35.670987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50a2a09f-e52a-4dc0-82e9-cd2e4ad47103 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:35.671796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50a2a09f-e52a-4dc0-82e9-cd2e4ad47103 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:35.672249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50a2a09f-e52a-4dc0-82e9-cd2e4ad47103 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:35.757272 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-50a2a09f-e52a-4dc0-82e9-cd2e4ad47103 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122697 Mar 12 21:01:35.763216 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2451/3219] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:01:35 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:01:35.783729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9f451338-9890-4dac-b94e-74d72790f788 req-503f2471-1971-4429-b513-c9ac9a255ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e537d16d-478d-4375-a61a-c28f8a785539", "name": "network-vif-unplugged", "status": "completed", "tag": "e0808d11-4cd5-4e52-88b4-c9eaec2126e6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:35.807816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9f451338-9890-4dac-b94e-74d72790f788 req-503f2471-1971-4429-b513-c9ac9a255ea2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:35.808507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9f451338-9890-4dac-b94e-74d72790f788 req-503f2471-1971-4429-b513-c9ac9a255ea2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:35.828867 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9f451338-9890-4dac-b94e-74d72790f788 req-503f2471-1971-4429-b513-c9ac9a255ea2 service nova] Creating event network-vif-unplugged:e0808d11-4cd5-4e52-88b4-c9eaec2126e6 for instance e537d16d-478d-4375-a61a-c28f8a785539 on nch2-master-1 Mar 12 21:01:35.839887 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9f451338-9890-4dac-b94e-74d72790f788 req-503f2471-1971-4429-b513-c9ac9a255ea2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071391 Mar 12 21:01:35.842844 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2452/3220] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:35.860137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-686f66dd-79e6-4048-a80c-f2b278b80cdc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:35.860862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-686f66dd-79e6-4048-a80c-f2b278b80cdc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:35.877946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-686f66dd-79e6-4048-a80c-f2b278b80cdc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:35.878789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-686f66dd-79e6-4048-a80c-f2b278b80cdc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:35.882257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-686f66dd-79e6-4048-a80c-f2b278b80cdc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:35.884474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-686f66dd-79e6-4048-a80c-f2b278b80cdc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:36.476739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-686f66dd-79e6-4048-a80c-f2b278b80cdc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:36.501013 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-686f66dd-79e6-4048-a80c-f2b278b80cdc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.656506 Mar 12 21:01:36.501616 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2453/3221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:35 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:36.533752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b75fd4ce-2072-466c-b3b1-531869d1b48e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356a84c0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:36.645822 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b75fd4ce-2072-466c-b3b1-531869d1b48e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1453 microversion: 2.1 time: 0.125052 Mar 12 21:01:36.646837 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2454/3222] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:36 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:36.655225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-48ea7c36-aaa7-4247-b77c-49b163741c21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:36.656259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-48ea7c36-aaa7-4247-b77c-49b163741c21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:36.676794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48ea7c36-aaa7-4247-b77c-49b163741c21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:36.677272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48ea7c36-aaa7-4247-b77c-49b163741c21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:36.687778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48ea7c36-aaa7-4247-b77c-49b163741c21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:36.692691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48ea7c36-aaa7-4247-b77c-49b163741c21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:36.750942 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-48ea7c36-aaa7-4247-b77c-49b163741c21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] HTTP exception thrown: Cannot 'reboot' instance dd233007-740a-4bd4-b786-eb46e987f98a while it is in vm_state rescued Mar 12 21:01:36.752964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-48ea7c36-aaa7-4247-b77c-49b163741c21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Returning 409 to user: Cannot 'reboot' instance dd233007-740a-4bd4-b786-eb46e987f98a while it is in vm_state rescued {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:01:36.755212 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-48ea7c36-aaa7-4247-b77c-49b163741c21 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a/action" status: 409 len: 145 microversion: 2.1 time: 0.107504 Mar 12 21:01:36.760469 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2455/3223] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:36 2022] POST /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a/action => generated 145 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 21:01:36.774443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2bb753a-ccea-448c-b15b-ab99c2056f34 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:36.775347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2bb753a-ccea-448c-b15b-ab99c2056f34 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:36.787092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2bb753a-ccea-448c-b15b-ab99c2056f34 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:36.787890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2bb753a-ccea-448c-b15b-ab99c2056f34 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:36.790601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2bb753a-ccea-448c-b15b-ab99c2056f34 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:36.791728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2bb753a-ccea-448c-b15b-ab99c2056f34 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:37.278602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e2bb753a-ccea-448c-b15b-ab99c2056f34 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:37.287202 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2bb753a-ccea-448c-b15b-ab99c2056f34 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.525456 Mar 12 21:01:37.294652 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2456/3224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:36 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:37.306818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a445631-2279-46f0-a011-55a52acacb74 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:37.307772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a445631-2279-46f0-a011-55a52acacb74 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:37.318431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a445631-2279-46f0-a011-55a52acacb74 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:37.320194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a445631-2279-46f0-a011-55a52acacb74 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:37.322097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a445631-2279-46f0-a011-55a52acacb74 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:37.324845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a445631-2279-46f0-a011-55a52acacb74 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:37.746941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5a445631-2279-46f0-a011-55a52acacb74 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:37.758088 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a445631-2279-46f0-a011-55a52acacb74 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1523 microversion: 2.1 time: 0.462081 Mar 12 21:01:37.762228 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2457/3225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:37 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1523 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:37.767309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c304072-5858-4e05-a3fa-9d83e36ce9aa tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:37.779541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c304072-5858-4e05-a3fa-9d83e36ce9aa tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:37.795847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c304072-5858-4e05-a3fa-9d83e36ce9aa tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:37.796318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c304072-5858-4e05-a3fa-9d83e36ce9aa tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:37.797124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c304072-5858-4e05-a3fa-9d83e36ce9aa tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:37.797574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c304072-5858-4e05-a3fa-9d83e36ce9aa tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:37.865057 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3c304072-5858-4e05-a3fa-9d83e36ce9aa tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] HTTP exception thrown: Cannot 'rebuild' instance dd233007-740a-4bd4-b786-eb46e987f98a while it is in vm_state rescued Mar 12 21:01:37.868231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c304072-5858-4e05-a3fa-9d83e36ce9aa tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Returning 409 to user: Cannot 'rebuild' instance dd233007-740a-4bd4-b786-eb46e987f98a while it is in vm_state rescued {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:01:37.869311 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c304072-5858-4e05-a3fa-9d83e36ce9aa tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "POST /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a/action" status: 409 len: 146 microversion: 2.1 time: 0.105790 Mar 12 21:01:37.870113 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2458/3226] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:37 2022] POST /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a/action => generated 146 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 21:01:37.884746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d28732ec-7274-4047-964b-1519a5567020 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:37.885441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d28732ec-7274-4047-964b-1519a5567020 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:37.906837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d28732ec-7274-4047-964b-1519a5567020 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:37.907342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d28732ec-7274-4047-964b-1519a5567020 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:37.912595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d28732ec-7274-4047-964b-1519a5567020 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:37.913240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d28732ec-7274-4047-964b-1519a5567020 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:38.284474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d28732ec-7274-4047-964b-1519a5567020 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:38.305290 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d28732ec-7274-4047-964b-1519a5567020 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.433255 Mar 12 21:01:38.308917 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2459/3227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:37 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:38.323918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9812beb0-b8d6-4904-ad28-da759e9c5eaf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356c9430>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:38.447551 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9812beb0-b8d6-4904-ad28-da759e9c5eaf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1462 microversion: 2.1 time: 0.134710 Mar 12 21:01:38.448394 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2460/3228] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:38 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1462 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:38.462346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-83d6769f-1ffc-4b86-8dc8-f904f665641a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:38.465030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-83d6769f-1ffc-4b86-8dc8-f904f665641a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:38.500229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83d6769f-1ffc-4b86-8dc8-f904f665641a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:38.502384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83d6769f-1ffc-4b86-8dc8-f904f665641a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:38.507651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83d6769f-1ffc-4b86-8dc8-f904f665641a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:38.509200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83d6769f-1ffc-4b86-8dc8-f904f665641a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:38.700287 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-83d6769f-1ffc-4b86-8dc8-f904f665641a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.246596 Mar 12 21:01:38.702081 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2461/3229] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:38 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:01:38.707733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec3d74ce-78e9-448d-bd91-cb63afd5367a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356d43a0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:38.766673 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec3d74ce-78e9-448d-bd91-cb63afd5367a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 200 len: 1462 microversion: 2.1 time: 0.063194 Mar 12 21:01:38.767456 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2462/3230] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:38 2022] GET /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 1462 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:38.772371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7ad257c8-3292-4f58-97e9-983097212f5e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:38.773290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7ad257c8-3292-4f58-97e9-983097212f5e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:38.786427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ad257c8-3292-4f58-97e9-983097212f5e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:38.787748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ad257c8-3292-4f58-97e9-983097212f5e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:38.788743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ad257c8-3292-4f58-97e9-983097212f5e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:38.790017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ad257c8-3292-4f58-97e9-983097212f5e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:39.025019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7ad257c8-3292-4f58-97e9-983097212f5e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:39.036108 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7ad257c8-3292-4f58-97e9-983097212f5e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1672 microversion: 2.1 time: 0.267451 Mar 12 21:01:39.036702 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2463/3231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:38 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1672 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:39.045251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-55455e5f-c2fb-4f7b-8289-2dad6cf3dbd3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:39.048575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-55455e5f-c2fb-4f7b-8289-2dad6cf3dbd3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:39.062916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55455e5f-c2fb-4f7b-8289-2dad6cf3dbd3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:39.063424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55455e5f-c2fb-4f7b-8289-2dad6cf3dbd3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:39.064256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55455e5f-c2fb-4f7b-8289-2dad6cf3dbd3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:39.064971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55455e5f-c2fb-4f7b-8289-2dad6cf3dbd3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:39.419404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-55455e5f-c2fb-4f7b-8289-2dad6cf3dbd3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:39.433633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-55455e5f-c2fb-4f7b-8289-2dad6cf3dbd3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1467 microversion: 2.1 time: 0.394081 Mar 12 21:01:39.442769 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2464/3232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:39 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1467 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:39.467009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-44cf3702-27fb-4dc3-96cb-a433ac3c6ba5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:39.468363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-44cf3702-27fb-4dc3-96cb-a433ac3c6ba5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:39.498666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44cf3702-27fb-4dc3-96cb-a433ac3c6ba5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:39.504833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44cf3702-27fb-4dc3-96cb-a433ac3c6ba5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:39.506157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44cf3702-27fb-4dc3-96cb-a433ac3c6ba5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:39.506971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44cf3702-27fb-4dc3-96cb-a433ac3c6ba5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:39.956712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-44cf3702-27fb-4dc3-96cb-a433ac3c6ba5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:39.968685 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-44cf3702-27fb-4dc3-96cb-a433ac3c6ba5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1523 microversion: 2.1 time: 0.520364 Mar 12 21:01:39.972813 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2465/3233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:39 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1523 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:39.984724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-38a5c7c6-4767-4554-932f-140ca5e8da8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1779905773"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:39.994904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-38a5c7c6-4767-4554-932f-140ca5e8da8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 8d0b657b-019a-495b-bf10-0b27962e3880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:40.008525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38a5c7c6-4767-4554-932f-140ca5e8da8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:40.009280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38a5c7c6-4767-4554-932f-140ca5e8da8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:40.014778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38a5c7c6-4767-4554-932f-140ca5e8da8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:40.015434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38a5c7c6-4767-4554-932f-140ca5e8da8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:40.490533 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-38a5c7c6-4767-4554-932f-140ca5e8da8b tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "POST /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880/action" status: 202 len: 0 microversion: 2.1 time: 0.516034 Mar 12 21:01:40.492800 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2466/3234] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:39 2022] POST /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 12 21:01:40.499339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e58c47fa-82bd-4f4d-8a36-f736cd27e12b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:40.500394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e58c47fa-82bd-4f4d-8a36-f736cd27e12b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:40.509671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e58c47fa-82bd-4f4d-8a36-f736cd27e12b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:40.510264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e58c47fa-82bd-4f4d-8a36-f736cd27e12b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:40.511132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e58c47fa-82bd-4f4d-8a36-f736cd27e12b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:40.511853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e58c47fa-82bd-4f4d-8a36-f736cd27e12b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:40.857844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e58c47fa-82bd-4f4d-8a36-f736cd27e12b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:40.872316 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e58c47fa-82bd-4f4d-8a36-f736cd27e12b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1672 microversion: 2.1 time: 0.377985 Mar 12 21:01:40.885465 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2467/3235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:40 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1672 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:40.893676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1984777-f593-4720-b5ca-14aa075234a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:40.896335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f1984777-f593-4720-b5ca-14aa075234a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:40.903975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1984777-f593-4720-b5ca-14aa075234a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:40.904689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1984777-f593-4720-b5ca-14aa075234a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:40.906561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1984777-f593-4720-b5ca-14aa075234a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:40.907167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1984777-f593-4720-b5ca-14aa075234a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:40.948754 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1984777-f593-4720-b5ca-14aa075234a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061867 Mar 12 21:01:40.949711 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2468/3236] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:01:40 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:01:40.955015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d203130f-a359-463c-9a9b-5e573c712895 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:40.955521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d203130f-a359-463c-9a9b-5e573c712895 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:40.977586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d203130f-a359-463c-9a9b-5e573c712895 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:40.978169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d203130f-a359-463c-9a9b-5e573c712895 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:40.979146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d203130f-a359-463c-9a9b-5e573c712895 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:40.979763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d203130f-a359-463c-9a9b-5e573c712895 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:41.041643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d203130f-a359-463c-9a9b-5e573c712895 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:01:41.209577 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d203130f-a359-463c-9a9b-5e573c712895 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 204 len: 0 microversion: 2.1 time: 0.258151 Mar 12 21:01:41.210256 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2469/3237] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:01:40 2022] DELETE /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:01:41.218896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a346f160-08e2-49ba-9dfc-fd0def1e576c tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356b9ca0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:41.301022 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a346f160-08e2-49ba-9dfc-fd0def1e576c tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5" status: 200 len: 1453 microversion: 2.1 time: 0.089689 Mar 12 21:01:41.301640 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2470/3238] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:41 2022] GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:41.310520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-afc22ad7-b160-4e08-9345-289809787535 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:41.311258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-afc22ad7-b160-4e08-9345-289809787535 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:41.328801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afc22ad7-b160-4e08-9345-289809787535 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:41.329243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afc22ad7-b160-4e08-9345-289809787535 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:41.336320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afc22ad7-b160-4e08-9345-289809787535 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:41.337208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afc22ad7-b160-4e08-9345-289809787535 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:41.641235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-afc22ad7-b160-4e08-9345-289809787535 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:41.664636 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-afc22ad7-b160-4e08-9345-289809787535 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1503 microversion: 2.1 time: 0.361848 Mar 12 21:01:41.667312 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2471/3239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:41 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1503 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:41.673109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0388712e-aac4-43ff-93eb-2e6338990af0 req-7722bd59-5db5-47f2-b630-6b0abafbdf0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c44039-6c03-403b-8828-046bf508b27f", "name": "network-vif-unplugged", "status": "completed", "tag": "891b1bf1-7d7e-4f05-9c62-d7d4abaf05db"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:41.689195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0388712e-aac4-43ff-93eb-2e6338990af0 req-7722bd59-5db5-47f2-b630-6b0abafbdf0f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:41.690272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0388712e-aac4-43ff-93eb-2e6338990af0 req-7722bd59-5db5-47f2-b630-6b0abafbdf0f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:41.723573 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0388712e-aac4-43ff-93eb-2e6338990af0 req-7722bd59-5db5-47f2-b630-6b0abafbdf0f service nova] Creating event network-vif-unplugged:891b1bf1-7d7e-4f05-9c62-d7d4abaf05db for instance 63c44039-6c03-403b-8828-046bf508b27f on nch1-master-1 Mar 12 21:01:41.733079 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0388712e-aac4-43ff-93eb-2e6338990af0 req-7722bd59-5db5-47f2-b630-6b0abafbdf0f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062624 Mar 12 21:01:41.734034 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2472/3240] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:41.744619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b5cb37b-894c-4e8a-b0da-a955c5d9b810 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:41.745441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b5cb37b-894c-4e8a-b0da-a955c5d9b810 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:41.753551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b5cb37b-894c-4e8a-b0da-a955c5d9b810 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:41.754315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b5cb37b-894c-4e8a-b0da-a955c5d9b810 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:41.755993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b5cb37b-894c-4e8a-b0da-a955c5d9b810 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:41.757239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b5cb37b-894c-4e8a-b0da-a955c5d9b810 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:41.791250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b5cb37b-894c-4e8a-b0da-a955c5d9b810 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:01:41.976659 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b5cb37b-894c-4e8a-b0da-a955c5d9b810 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 204 len: 0 microversion: 2.1 time: 0.239208 Mar 12 21:01:41.977274 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2473/3241] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:01:41 2022] DELETE /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:01:41.984769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5abdc86b-2b6d-4708-a299-b6d423c859ae tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:41.985410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5abdc86b-2b6d-4708-a299-b6d423c859ae tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:41.993811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5abdc86b-2b6d-4708-a299-b6d423c859ae tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:41.994293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5abdc86b-2b6d-4708-a299-b6d423c859ae tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:41.995099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5abdc86b-2b6d-4708-a299-b6d423c859ae tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:41.996131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5abdc86b-2b6d-4708-a299-b6d423c859ae tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:42.296584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5abdc86b-2b6d-4708-a299-b6d423c859ae tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:42.304658 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5abdc86b-2b6d-4708-a299-b6d423c859ae tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1507 microversion: 2.1 time: 0.326159 Mar 12 21:01:42.323894 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2474/3242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:41 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:42.329155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09063ad1-d876-4e0c-aa11-92586cea8da4 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Action: 'create', calling method: .version_select at 0x7f6e356d4af0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1786626991", "description": "tempest-description-637193495"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:42.629671 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09063ad1-d876-4e0c-aa11-92586cea8da4 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.304597 Mar 12 21:01:42.630750 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2475/3243] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Mar 12 21:01:42 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:42.640471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-112b69f3-06c6-4198-93d1-39e779319ec1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:42.642230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-112b69f3-06c6-4198-93d1-39e779319ec1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:42.652105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-112b69f3-06c6-4198-93d1-39e779319ec1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:42.653839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-112b69f3-06c6-4198-93d1-39e779319ec1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:42.656730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-112b69f3-06c6-4198-93d1-39e779319ec1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:42.657097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-112b69f3-06c6-4198-93d1-39e779319ec1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:42.933805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-112b69f3-06c6-4198-93d1-39e779319ec1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:42.944391 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-112b69f3-06c6-4198-93d1-39e779319ec1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.312410 Mar 12 21:01:42.944983 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2476/3244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:42 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:42.959152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4ae595fc-74dc-4537-be50-54cee06b7928 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:42.959835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4ae595fc-74dc-4537-be50-54cee06b7928 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:42.967053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ae595fc-74dc-4537-be50-54cee06b7928 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:42.967687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ae595fc-74dc-4537-be50-54cee06b7928 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:42.968789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ae595fc-74dc-4537-be50-54cee06b7928 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:42.969496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ae595fc-74dc-4537-be50-54cee06b7928 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:43.291793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4ae595fc-74dc-4537-be50-54cee06b7928 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:43.307642 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4ae595fc-74dc-4537-be50-54cee06b7928 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1674 microversion: 2.1 time: 0.356250 Mar 12 21:01:43.308462 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2477/3245] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:42 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1674 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:43.326179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ef109ac0-bd91-477e-b824-0ffdc79d6cdd tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3565c040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:43.403418 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ef109ac0-bd91-477e-b824-0ffdc79d6cdd tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5" status: 200 len: 1453 microversion: 2.1 time: 0.092323 Mar 12 21:01:43.405095 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2478/3246] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:43 2022] GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:43.413514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d35b434b-45b8-4414-aa43-202ea64be5e9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1786626991"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:43.414418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d35b434b-45b8-4414-aa43-202ea64be5e9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:43.423231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d35b434b-45b8-4414-aa43-202ea64be5e9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:43.423945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d35b434b-45b8-4414-aa43-202ea64be5e9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:43.425705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d35b434b-45b8-4414-aa43-202ea64be5e9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:43.426185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d35b434b-45b8-4414-aa43-202ea64be5e9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:43.662509 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.network.security_group_api [None req-d35b434b-45b8-4414-aa43-202ea64be5e9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Adding security group 0035b58e-d4ac-4faf-a314-4caa113cd8d2 to port 670a32c0-8906-4816-8ad8-a19dd87c3c18 Mar 12 21:01:44.147421 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d35b434b-45b8-4414-aa43-202ea64be5e9 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "POST /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181/action" status: 202 len: 0 microversion: 2.1 time: 0.740585 Mar 12 21:01:44.148061 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2479/3247] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:43 2022] POST /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181/action => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:01:44.155681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-220e25bd-f7d7-4010-90a9-557568a6bca7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:44.157082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-220e25bd-f7d7-4010-90a9-557568a6bca7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:44.163476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-220e25bd-f7d7-4010-90a9-557568a6bca7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:44.168839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-220e25bd-f7d7-4010-90a9-557568a6bca7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:44.175710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-220e25bd-f7d7-4010-90a9-557568a6bca7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:44.176409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-220e25bd-f7d7-4010-90a9-557568a6bca7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:44.255901 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-220e25bd-f7d7-4010-90a9-557568a6bca7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 200 len: 145 microversion: 2.1 time: 0.106438 Mar 12 21:01:44.256920 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2480/3248] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:44 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 145 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:44.262608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c4da11ee-70e3-4d69-8558-7a2eb83fdb60 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:44.263674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c4da11ee-70e3-4d69-8558-7a2eb83fdb60 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:44.271739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4da11ee-70e3-4d69-8558-7a2eb83fdb60 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:44.272543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4da11ee-70e3-4d69-8558-7a2eb83fdb60 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:44.273627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4da11ee-70e3-4d69-8558-7a2eb83fdb60 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:44.274354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4da11ee-70e3-4d69-8558-7a2eb83fdb60 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:44.472523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c4da11ee-70e3-4d69-8558-7a2eb83fdb60 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:44.486891 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c4da11ee-70e3-4d69-8558-7a2eb83fdb60 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1507 microversion: 2.1 time: 0.228463 Mar 12 21:01:44.488680 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2481/3249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:44 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:44.506992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bab4c4b5-c341-43f5-aa5c-a46020edbac7 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1786626991"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:44.507993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bab4c4b5-c341-43f5-aa5c-a46020edbac7 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:44.514367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bab4c4b5-c341-43f5-aa5c-a46020edbac7 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:44.515072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bab4c4b5-c341-43f5-aa5c-a46020edbac7 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:44.515870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bab4c4b5-c341-43f5-aa5c-a46020edbac7 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:44.516316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bab4c4b5-c341-43f5-aa5c-a46020edbac7 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:44.702844 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.network.security_group_api [None req-bab4c4b5-c341-43f5-aa5c-a46020edbac7 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Removing security group 0035b58e-d4ac-4faf-a314-4caa113cd8d2 from port 670a32c0-8906-4816-8ad8-a19dd87c3c18 Mar 12 21:01:45.575144 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bab4c4b5-c341-43f5-aa5c-a46020edbac7 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "POST /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181/action" status: 202 len: 0 microversion: 2.1 time: 1.073945 Mar 12 21:01:45.576663 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2482/3250] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:44 2022] POST /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181/action => generated 0 bytes in 1076 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:01:45.583962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b41d700e-eb92-4414-9b23-bd42c692684e req-a39e1d97-0461-4344-9960-2fbea8905f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4236dcbc-d67f-483e-ae3d-1b3613b35181", "tag": "670a32c0-8906-4816-8ad8-a19dd87c3c18"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:45.613327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b41d700e-eb92-4414-9b23-bd42c692684e req-a39e1d97-0461-4344-9960-2fbea8905f7b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:45.614089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b41d700e-eb92-4414-9b23-bd42c692684e req-a39e1d97-0461-4344-9960-2fbea8905f7b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:45.671357 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b41d700e-eb92-4414-9b23-bd42c692684e req-a39e1d97-0461-4344-9960-2fbea8905f7b service nova] Creating event network-changed:670a32c0-8906-4816-8ad8-a19dd87c3c18 for instance 4236dcbc-d67f-483e-ae3d-1b3613b35181 on nch1-master-1 Mar 12 21:01:45.681247 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b41d700e-eb92-4414-9b23-bd42c692684e req-a39e1d97-0461-4344-9960-2fbea8905f7b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102200 Mar 12 21:01:45.683894 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2483/3251] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:45.699869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8eba676-98d8-4053-a9c7-e18042419fef tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:45.703553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8eba676-98d8-4053-a9c7-e18042419fef tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:45.720316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8eba676-98d8-4053-a9c7-e18042419fef tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:45.723567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8eba676-98d8-4053-a9c7-e18042419fef tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:45.727042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8eba676-98d8-4053-a9c7-e18042419fef tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:45.727768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8eba676-98d8-4053-a9c7-e18042419fef tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:46.371181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c8eba676-98d8-4053-a9c7-e18042419fef tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:46.384412 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8eba676-98d8-4053-a9c7-e18042419fef tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.696595 Mar 12 21:01:46.388015 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2484/3252] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:45 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:46.398787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7f6ef1c4-e800-45ef-b082-000993fdf47a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:46.402579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7f6ef1c4-e800-45ef-b082-000993fdf47a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:46.420857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f6ef1c4-e800-45ef-b082-000993fdf47a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:46.421475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f6ef1c4-e800-45ef-b082-000993fdf47a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:46.422424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f6ef1c4-e800-45ef-b082-000993fdf47a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:46.422988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f6ef1c4-e800-45ef-b082-000993fdf47a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:46.796032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7f6ef1c4-e800-45ef-b082-000993fdf47a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:46.808227 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7f6ef1c4-e800-45ef-b082-000993fdf47a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 200 len: 1674 microversion: 2.1 time: 0.418850 Mar 12 21:01:46.818664 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2485/3253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:46 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 1674 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:46.823728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fa2b790a-6ab9-403d-abff-b016777a8351 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3567bca0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:46.923070 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fa2b790a-6ab9-403d-abff-b016777a8351 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5" status: 200 len: 1453 microversion: 2.1 time: 0.097916 Mar 12 21:01:46.923952 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2486/3254] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:46 2022] GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5 => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:46.947114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4003f4de-2280-4af7-b13f-668bde829c61 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:46.948052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4003f4de-2280-4af7-b13f-668bde829c61 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:46.959231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4003f4de-2280-4af7-b13f-668bde829c61 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:46.959687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4003f4de-2280-4af7-b13f-668bde829c61 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:46.961191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4003f4de-2280-4af7-b13f-668bde829c61 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:46.961825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4003f4de-2280-4af7-b13f-668bde829c61 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:47.050621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4003f4de-2280-4af7-b13f-668bde829c61 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:47.054950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4003f4de-2280-4af7-b13f-668bde829c61 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:47.055536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-4003f4de-2280-4af7-b13f-668bde829c61 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lazy-loading 'fault' on Instance uuid dd233007-740a-4bd4-b786-eb46e987f98a {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:01:47.121331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4003f4de-2280-4af7-b13f-668bde829c61 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:47.130237 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4003f4de-2280-4af7-b13f-668bde829c61 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 200 len: 1311 microversion: 2.1 time: 0.203368 Mar 12 21:01:47.141035 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2487/3255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:46 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 1311 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:47.150093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b38b7ec5-18b1-47e0-b621-fa17f7049f82 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Action: 'create', calling method: .version_select at 0x7f6e356b9ca0>, body: {"pool": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:49.289975 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b38b7ec5-18b1-47e0-b621-fa17f7049f82 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.153325 Mar 12 21:01:49.295068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2488/3256] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Mar 12 21:01:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:49.532134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9563b93b-7ca9-4d32-8458-04e52f8724a8 tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] Action: 'create', calling method: .version_select at 0x7f6e35671940>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:49.574665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9563b93b-7ca9-4d32-8458-04e52f8724a8 tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] Getting quotas for project 7a8d609fdd34464986e3d778bc88f8e6. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:01:49.582837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9563b93b-7ca9-4d32-8458-04e52f8724a8 tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] Getting quotas for user 574059351b9d44b792a99937ba12f917 and project 7a8d609fdd34464986e3d778bc88f8e6. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:01:49.670818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9563b93b-7ca9-4d32-8458-04e52f8724a8 tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] Getting quotas for project 7a8d609fdd34464986e3d778bc88f8e6. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:01:49.679585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9563b93b-7ca9-4d32-8458-04e52f8724a8 tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] Getting quotas for user 574059351b9d44b792a99937ba12f917 and project 7a8d609fdd34464986e3d778bc88f8e6. Resources: {'server_groups'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:01:49.701722 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9563b93b-7ca9-4d32-8458-04e52f8724a8 tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.405350 Mar 12 21:01:49.703187 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2489/3257] 10.222.0.30 () {62 vars in 1213 bytes} [Sat Mar 12 21:01:49 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 21:01:49.708741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a427e220-6062-4373-ad2c-81d740627531 req-edb5ad6b-e526-4ae9-8b3b-2bb0e6fbbd97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd233007-740a-4bd4-b786-eb46e987f98a", "name": "network-vif-deleted", "tag": "30f641b5-fdf0-46de-90c3-cd66179d2e9e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:49.724738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a427e220-6062-4373-ad2c-81d740627531 req-edb5ad6b-e526-4ae9-8b3b-2bb0e6fbbd97 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:49.726449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a427e220-6062-4373-ad2c-81d740627531 req-edb5ad6b-e526-4ae9-8b3b-2bb0e6fbbd97 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:49.750604 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a427e220-6062-4373-ad2c-81d740627531 req-edb5ad6b-e526-4ae9-8b3b-2bb0e6fbbd97 service nova] Creating event network-vif-deleted:30f641b5-fdf0-46de-90c3-cd66179d2e9e for instance dd233007-740a-4bd4-b786-eb46e987f98a on nch1-master-1 Mar 12 21:01:49.772370 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a427e220-6062-4373-ad2c-81d740627531 req-edb5ad6b-e526-4ae9-8b3b-2bb0e6fbbd97 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067626 Mar 12 21:01:49.774446 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2490/3258] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:49.782641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16024bea-c125-493e-ac82-4e0ca7cbd5cf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:49.783574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16024bea-c125-493e-ac82-4e0ca7cbd5cf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:49.792374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16024bea-c125-493e-ac82-4e0ca7cbd5cf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:49.793148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16024bea-c125-493e-ac82-4e0ca7cbd5cf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:49.794206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16024bea-c125-493e-ac82-4e0ca7cbd5cf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:49.794975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16024bea-c125-493e-ac82-4e0ca7cbd5cf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:50.105729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16024bea-c125-493e-ac82-4e0ca7cbd5cf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:50.124520 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16024bea-c125-493e-ac82-4e0ca7cbd5cf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.348576 Mar 12 21:01:50.127135 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2491/3259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:49 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:50.151113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9f168831-c913-46c7-be3b-044c3eb22cdc req-99458aad-5c3a-4e0a-9554-544566452b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0b657b-019a-495b-bf10-0b27962e3880", "name": "network-vif-plugged", "status": "completed", "tag": "ea6450b5-34ee-4f9d-8b0d-7a507ad2499d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:50.182051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9f168831-c913-46c7-be3b-044c3eb22cdc req-99458aad-5c3a-4e0a-9554-544566452b94 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:50.188230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9f168831-c913-46c7-be3b-044c3eb22cdc req-99458aad-5c3a-4e0a-9554-544566452b94 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:50.213079 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9f168831-c913-46c7-be3b-044c3eb22cdc req-99458aad-5c3a-4e0a-9554-544566452b94 service nova] Creating event network-vif-plugged:ea6450b5-34ee-4f9d-8b0d-7a507ad2499d for instance 8d0b657b-019a-495b-bf10-0b27962e3880 on nch2-master-1 Mar 12 21:01:50.233179 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9f168831-c913-46c7-be3b-044c3eb22cdc req-99458aad-5c3a-4e0a-9554-544566452b94 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104386 Mar 12 21:01:50.234049 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2492/3260] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:50.245467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cfb04a4f-a92d-4945-ba8d-3b92f7d6d688 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:50.247078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cfb04a4f-a92d-4945-ba8d-3b92f7d6d688 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:50.255741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfb04a4f-a92d-4945-ba8d-3b92f7d6d688 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:50.256225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfb04a4f-a92d-4945-ba8d-3b92f7d6d688 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:50.257005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfb04a4f-a92d-4945-ba8d-3b92f7d6d688 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:50.257439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfb04a4f-a92d-4945-ba8d-3b92f7d6d688 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:50.273726 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-cfb04a4f-a92d-4945-ba8d-3b92f7d6d688 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] HTTP exception thrown: Instance 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 could not be found. Mar 12 21:01:50.274431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cfb04a4f-a92d-4945-ba8d-3b92f7d6d688 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Returning 404 to user: Instance 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:01:50.275386 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cfb04a4f-a92d-4945-ba8d-3b92f7d6d688 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 404 len: 111 microversion: 2.1 time: 0.035859 Mar 12 21:01:50.276295 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2493/3261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:50 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:01:50.280612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de384c05-67ad-4040-a477-4b38616998ce tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356a0700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:50.330536 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de384c05-67ad-4040-a477-4b38616998ce tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5" status: 200 len: 1453 microversion: 2.1 time: 0.053462 Mar 12 21:01:50.333366 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2494/3262] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:50 2022] GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5 => generated 1453 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:50.339351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c9bd842b-4104-4ffb-b823-3e7def5572be req-6fb367e1-54d6-4184-b2cc-7c3b002e1b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4236dcbc-d67f-483e-ae3d-1b3613b35181", "tag": "670a32c0-8906-4816-8ad8-a19dd87c3c18"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:50.351498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c9bd842b-4104-4ffb-b823-3e7def5572be req-6fb367e1-54d6-4184-b2cc-7c3b002e1b5b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:50.352171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c9bd842b-4104-4ffb-b823-3e7def5572be req-6fb367e1-54d6-4184-b2cc-7c3b002e1b5b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:50.370938 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c9bd842b-4104-4ffb-b823-3e7def5572be req-6fb367e1-54d6-4184-b2cc-7c3b002e1b5b service nova] Creating event network-changed:670a32c0-8906-4816-8ad8-a19dd87c3c18 for instance 4236dcbc-d67f-483e-ae3d-1b3613b35181 on nch1-master-1 Mar 12 21:01:50.386296 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c9bd842b-4104-4ffb-b823-3e7def5572be req-6fb367e1-54d6-4184-b2cc-7c3b002e1b5b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047666 Mar 12 21:01:50.386296 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2495/3263] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:50.391937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f974b8ca-62fe-485a-a8c2-e6f2c54633f5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:50.392794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f974b8ca-62fe-485a-a8c2-e6f2c54633f5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: dd233007-740a-4bd4-b786-eb46e987f98a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:50.401214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f974b8ca-62fe-485a-a8c2-e6f2c54633f5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:50.401675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f974b8ca-62fe-485a-a8c2-e6f2c54633f5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:50.402690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f974b8ca-62fe-485a-a8c2-e6f2c54633f5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:50.403158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f974b8ca-62fe-485a-a8c2-e6f2c54633f5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:50.428786 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f974b8ca-62fe-485a-a8c2-e6f2c54633f5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] HTTP exception thrown: Instance dd233007-740a-4bd4-b786-eb46e987f98a could not be found. Mar 12 21:01:50.429387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f974b8ca-62fe-485a-a8c2-e6f2c54633f5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Returning 404 to user: Instance dd233007-740a-4bd4-b786-eb46e987f98a could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:01:50.430259 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f974b8ca-62fe-485a-a8c2-e6f2c54633f5 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a" status: 404 len: 111 microversion: 2.1 time: 0.045557 Mar 12 21:01:50.434423 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2496/3264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:50 2022] GET /compute/v2.1/servers/dd233007-740a-4bd4-b786-eb46e987f98a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:01:50.437041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1ce97a9-038d-44c3-a126-297db9fd7dc5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.0.191"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:50.438167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f1ce97a9-038d-44c3-a126-297db9fd7dc5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:50.444588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1ce97a9-038d-44c3-a126-297db9fd7dc5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:50.445053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1ce97a9-038d-44c3-a126-297db9fd7dc5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:50.446351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1ce97a9-038d-44c3-a126-297db9fd7dc5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:50.446483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1ce97a9-038d-44c3-a126-297db9fd7dc5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:50.495464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1ce97a9-038d-44c3-a126-297db9fd7dc5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Acquired lock "refresh_cache-4236dcbc-d67f-483e-ae3d-1b3613b35181" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 21:01:53.070498 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:01:53.071082 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:01:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:01:55.512992 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:01:55.513871 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:01:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:01:55.774366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-f1ce97a9-038d-44c3-a126-297db9fd7dc5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Building network info cache for instance {{(pid=136302) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 12 21:01:58.257823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-f1ce97a9-038d-44c3-a126-297db9fd7dc5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Updating instance_info_cache with network_info: [{"id": "670a32c0-8906-4816-8ad8-a19dd87c3c18", "address": "fa:16:3e:92:5a:a5", "network": {"id": "c0500286-40a5-45cc-a74a-e1c149b703e6", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1351559159-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.0.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "96ac94c961644bb5b54ca63306080337", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap670a32c0-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136302) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 12 21:01:58.276309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1ce97a9-038d-44c3-a126-297db9fd7dc5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Releasing lock "refresh_cache-4236dcbc-d67f-483e-ae3d-1b3613b35181" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 21:01:58.278732 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1ce97a9-038d-44c3-a126-297db9fd7dc5 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "POST /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181/action" status: 202 len: 0 microversion: 2.1 time: 7.845363 Mar 12 21:01:58.279521 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2497/3265] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:50 2022] POST /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181/action => generated 0 bytes in 7848 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 12 21:01:58.291657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80c828ec-730a-4c58-bc06-8b1b50a02b96 tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:58.314877 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80c828ec-730a-4c58-bc06-8b1b50a02b96 tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.032085 Mar 12 21:01:58.317225 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2498/3266] 10.222.0.30 () {60 vars in 1192 bytes} [Sat Mar 12 21:01:58 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 21:01:58.328676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-243b6711-c867-413d-bd01-78269d429eb3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:58.332396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-243b6711-c867-413d-bd01-78269d429eb3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:58.345937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-243b6711-c867-413d-bd01-78269d429eb3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:58.348845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-243b6711-c867-413d-bd01-78269d429eb3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:58.349996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-243b6711-c867-413d-bd01-78269d429eb3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:58.352516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-243b6711-c867-413d-bd01-78269d429eb3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:58.804782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-243b6711-c867-413d-bd01-78269d429eb3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:01:58.812243 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-243b6711-c867-413d-bd01-78269d429eb3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.493022 Mar 12 21:01:58.816430 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2499/3267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:01:58 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:58.826352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20128013-608d-445c-8b7e-5a9d813d527c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '.version_select at 0x7f6e35690b80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:58.879424 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20128013-608d-445c-8b7e-5a9d813d527c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103388820" status: 202 len: 0 microversion: 2.1 time: 0.061722 Mar 12 21:01:58.880642 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2500/3268] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Mar 12 21:01:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103388820 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:01:58.888010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-64b83a25-3fdc-48df-8e5b-8fe40c4275bb tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:58.890432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-64b83a25-3fdc-48df-8e5b-8fe40c4275bb tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:01:58.904377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64b83a25-3fdc-48df-8e5b-8fe40c4275bb tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:58.907607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64b83a25-3fdc-48df-8e5b-8fe40c4275bb tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:58.908623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64b83a25-3fdc-48df-8e5b-8fe40c4275bb tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:58.911986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64b83a25-3fdc-48df-8e5b-8fe40c4275bb tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:58.965388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-64b83a25-3fdc-48df-8e5b-8fe40c4275bb tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:01:59.145343 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-64b83a25-3fdc-48df-8e5b-8fe40c4275bb tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 204 len: 0 microversion: 2.1 time: 0.263120 Mar 12 21:01:59.146719 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2501/3269] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:01:58 2022] DELETE /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:01:59.153510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b6ba783-c46e-4381-9af1-342f39137606 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356f7160>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:01:59.206539 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b6ba783-c46e-4381-9af1-342f39137606 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5" status: 200 len: 1453 microversion: 2.1 time: 0.057787 Mar 12 21:01:59.208234 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2502/3270] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:01:59 2022] GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5 => generated 1453 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:01:59.218808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e9da52ee-429e-47e9-b699-f1a829234f08 req-e5efa0a8-cf92-4b19-bd90-9a736328863a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f2e6c22-dc3b-4733-ba22-ab6fe0f70069", "name": "network-vif-deleted", "tag": "2237d806-1e27-4862-a4ba-b751d1cb1c1d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:59.253953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e9da52ee-429e-47e9-b699-f1a829234f08 req-e5efa0a8-cf92-4b19-bd90-9a736328863a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:59.254531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e9da52ee-429e-47e9-b699-f1a829234f08 req-e5efa0a8-cf92-4b19-bd90-9a736328863a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:59.276528 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e9da52ee-429e-47e9-b699-f1a829234f08 req-e5efa0a8-cf92-4b19-bd90-9a736328863a service nova] Creating event network-vif-deleted:2237d806-1e27-4862-a4ba-b751d1cb1c1d for instance 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 on nch2-master-1 Mar 12 21:01:59.286298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e9da52ee-429e-47e9-b699-f1a829234f08 req-e5efa0a8-cf92-4b19-bd90-9a736328863a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076574 Mar 12 21:01:59.287611 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2503/3271] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:59.300089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c3e59f6e-81fc-499d-87d9-a1026de97dfa req-62cf1c6a-cb49-472e-95c7-6026be829df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4236dcbc-d67f-483e-ae3d-1b3613b35181", "tag": "670a32c0-8906-4816-8ad8-a19dd87c3c18"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:01:59.331342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c3e59f6e-81fc-499d-87d9-a1026de97dfa req-62cf1c6a-cb49-472e-95c7-6026be829df5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:01:59.343547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c3e59f6e-81fc-499d-87d9-a1026de97dfa req-62cf1c6a-cb49-472e-95c7-6026be829df5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:01:59.360501 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c3e59f6e-81fc-499d-87d9-a1026de97dfa req-62cf1c6a-cb49-472e-95c7-6026be829df5 service nova] Creating event network-changed:670a32c0-8906-4816-8ad8-a19dd87c3c18 for instance 4236dcbc-d67f-483e-ae3d-1b3613b35181 on nch1-master-1 Mar 12 21:01:59.377646 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c3e59f6e-81fc-499d-87d9-a1026de97dfa req-62cf1c6a-cb49-472e-95c7-6026be829df5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087844 Mar 12 21:01:59.378614 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2504/3272] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:01:59.384048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-283366c0-e69e-4e65-b6ab-b285b6cdeb12 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.0.191"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:00.078012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-283366c0-e69e-4e65-b6ab-b285b6cdeb12 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:00.085132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-283366c0-e69e-4e65-b6ab-b285b6cdeb12 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:00.085576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-283366c0-e69e-4e65-b6ab-b285b6cdeb12 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:00.086398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-283366c0-e69e-4e65-b6ab-b285b6cdeb12 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:00.087183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-283366c0-e69e-4e65-b6ab-b285b6cdeb12 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:00.603072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-283366c0-e69e-4e65-b6ab-b285b6cdeb12 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Acquired lock "refresh_cache-4236dcbc-d67f-483e-ae3d-1b3613b35181" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 12 21:02:03.370116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-283366c0-e69e-4e65-b6ab-b285b6cdeb12 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Building network info cache for instance {{(pid=136302) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Mar 12 21:02:05.171011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-283366c0-e69e-4e65-b6ab-b285b6cdeb12 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Updating instance_info_cache with network_info: [{"id": "670a32c0-8906-4816-8ad8-a19dd87c3c18", "address": "fa:16:3e:92:5a:a5", "network": {"id": "c0500286-40a5-45cc-a74a-e1c149b703e6", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1351559159-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "96ac94c961644bb5b54ca63306080337", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap670a32c0-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136302) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 12 21:02:05.202246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-283366c0-e69e-4e65-b6ab-b285b6cdeb12 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Releasing lock "refresh_cache-4236dcbc-d67f-483e-ae3d-1b3613b35181" {{(pid=136302) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 12 21:02:05.203692 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-283366c0-e69e-4e65-b6ab-b285b6cdeb12 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "POST /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181/action" status: 202 len: 0 microversion: 2.1 time: 5.823712 Mar 12 21:02:05.205058 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2505/3273] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:01:59 2022] POST /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181/action => generated 0 bytes in 5826 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 12 21:02:05.213222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f6c8ac58-452f-40e1-9557-4599defa2ece tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:05.227099 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f6c8ac58-452f-40e1-9557-4599defa2ece tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/ee9cf92b-ef0b-4b84-aa7b-e60badb50e93" status: 200 len: 235 microversion: 2.64 time: 0.019381 Mar 12 21:02:05.227910 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2506/3274] 10.222.0.30 () {60 vars in 1303 bytes} [Sat Mar 12 21:02:05 2022] GET /compute/v2.1/os-server-groups/ee9cf92b-ef0b-4b84-aa7b-e60badb50e93 => generated 235 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 21:02:05.232659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e2a03ce-91ab-473f-b453-529e2e006db5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:05.233548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5e2a03ce-91ab-473f-b453-529e2e006db5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:05.240589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e2a03ce-91ab-473f-b453-529e2e006db5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:05.241832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e2a03ce-91ab-473f-b453-529e2e006db5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:05.242996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e2a03ce-91ab-473f-b453-529e2e006db5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:05.243650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e2a03ce-91ab-473f-b453-529e2e006db5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:05.610762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5e2a03ce-91ab-473f-b453-529e2e006db5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:05.618586 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e2a03ce-91ab-473f-b453-529e2e006db5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.389437 Mar 12 21:02:05.625508 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2507/3275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:05 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:05.639553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a37c5b88-780b-4e47-a383-728035fd9f34 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:05.640610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a37c5b88-780b-4e47-a383-728035fd9f34 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:05.661177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a37c5b88-780b-4e47-a383-728035fd9f34 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:05.663366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a37c5b88-780b-4e47-a383-728035fd9f34 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:05.666666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a37c5b88-780b-4e47-a383-728035fd9f34 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:05.667137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a37c5b88-780b-4e47-a383-728035fd9f34 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:06.017453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a37c5b88-780b-4e47-a383-728035fd9f34 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21f6deda19914710bccc01abf47935f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3570c0185b7b4af9954a67a763797f37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:06.030084 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a37c5b88-780b-4e47-a383-728035fd9f34 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 200 len: 1478 microversion: 2.1 time: 0.402835 Mar 12 21:02:06.032605 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2508/3276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:05 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 1478 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:06.038723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ef44e277-0733-4180-bbe0-fd5a17cbec31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Action: 'create', calling method: .version_select at 0x7f6e35673ee0>, body: {"keypair": {"name": "tempest-keypair-1301130332"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:06.066108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ef44e277-0733-4180-bbe0-fd5a17cbec31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Getting quotas for project b4da7920d54243cd8381e283021d7745. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:02:06.082061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ef44e277-0733-4180-bbe0-fd5a17cbec31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Getting quotas for user ec384ea1fe344a08a8b9491f10f3b211 and project b4da7920d54243cd8381e283021d7745. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:02:06.226182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ef44e277-0733-4180-bbe0-fd5a17cbec31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Getting quotas for project b4da7920d54243cd8381e283021d7745. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:02:06.236360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ef44e277-0733-4180-bbe0-fd5a17cbec31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Getting quotas for user ec384ea1fe344a08a8b9491f10f3b211 and project b4da7920d54243cd8381e283021d7745. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:02:06.279497 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ef44e277-0733-4180-bbe0-fd5a17cbec31 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.245473 Mar 12 21:02:06.280587 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2509/3277] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:02:06 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:06.291001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a84239c2-2d52-4dec-ac0f-f744386fb553 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e35671dc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:06.369848 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a84239c2-2d52-4dec-ac0f-f744386fb553 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5" status: 200 len: 1453 microversion: 2.1 time: 0.085695 Mar 12 21:02:06.370397 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2510/3278] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:02:06 2022] GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:06.379395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ce5147c4-e18b-4cb5-9358-4ceeb78f76bc req-857aec28-0f73-4093-89bc-e621a874e61b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4236dcbc-d67f-483e-ae3d-1b3613b35181", "tag": "670a32c0-8906-4816-8ad8-a19dd87c3c18"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:06.946368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ce5147c4-e18b-4cb5-9358-4ceeb78f76bc req-857aec28-0f73-4093-89bc-e621a874e61b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:06.946927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ce5147c4-e18b-4cb5-9358-4ceeb78f76bc req-857aec28-0f73-4093-89bc-e621a874e61b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:06.961098 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ce5147c4-e18b-4cb5-9358-4ceeb78f76bc req-857aec28-0f73-4093-89bc-e621a874e61b service nova] Creating event network-changed:670a32c0-8906-4816-8ad8-a19dd87c3c18 for instance 4236dcbc-d67f-483e-ae3d-1b3613b35181 on nch1-master-1 Mar 12 21:02:06.966815 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ce5147c4-e18b-4cb5-9358-4ceeb78f76bc req-857aec28-0f73-4093-89bc-e621a874e61b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.594993 Mar 12 21:02:06.967432 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2511/3279] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:06.973217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-01955399-f44a-4813-a961-c65d03877213 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '.version_select at 0x7f6e356710d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:09.516567 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-01955399-f44a-4813-a961-c65d03877213 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/3b7c3494-2b39-43d1-9cd8-5bc43a326ce2" status: 202 len: 0 microversion: 2.1 time: 2.545433 Mar 12 21:02:09.518404 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2512/3280] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 21:02:06 2022] DELETE /compute/v2.1/os-floating-ips/3b7c3494-2b39-43d1-9cd8-5bc43a326ce2 => generated 0 bytes in 2550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:02:09.532858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d4df9f46-2df8-4535-b981-0dad23259fac tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:09.563462 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d4df9f46-2df8-4535-b981-0dad23259fac tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/ee9cf92b-ef0b-4b84-aa7b-e60badb50e93" status: 204 len: 0 microversion: 2.64 time: 0.043805 Mar 12 21:02:09.564381 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2513/3281] 10.222.0.30 () {60 vars in 1306 bytes} [Sat Mar 12 21:02:09 2022] DELETE /compute/v2.1/os-server-groups/ee9cf92b-ef0b-4b84-aa7b-e60badb50e93 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:02:09.572029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-554688025", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "a1df08e9-a7c0-43fc-8fad-e4c91b24f5ac"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:09.635868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] validate_networks() for [('a1df08e9-a7c0-43fc-8fad-e4c91b24f5ac', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:02:10.662249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:02:10.670533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:02:10.672260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:02:10.672922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:02:10.675854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:02:10.698659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:10.699059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:10.699883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:10.700330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:10.763941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:02:10.777968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for user 178b9752b5d44f9abb4df56c54e28c48 and project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:02:10.806109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:02:10.808757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:02:10.869750 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a08024c5-d8b6-46da-b6a0-3127bdce6f67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303149 Mar 12 21:02:10.877380 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2514/3282] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:02:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:02:10.882666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e59b371b-a4d4-4c1f-bcb7-dc22d31ac4bf req-22389af6-99bc-4c80-b8ba-c9007eb22aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b9fa34-2929-4ab9-b2d8-47c9949331e3", "name": "network-vif-deleted", "tag": "0a7a0ba6-2990-4f5b-88b1-1cb759ef9585"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:10.892163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e59b371b-a4d4-4c1f-bcb7-dc22d31ac4bf req-22389af6-99bc-4c80-b8ba-c9007eb22aed service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:10.892993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e59b371b-a4d4-4c1f-bcb7-dc22d31ac4bf req-22389af6-99bc-4c80-b8ba-c9007eb22aed service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:10.907024 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e59b371b-a4d4-4c1f-bcb7-dc22d31ac4bf req-22389af6-99bc-4c80-b8ba-c9007eb22aed service nova] Creating event network-vif-deleted:0a7a0ba6-2990-4f5b-88b1-1cb759ef9585 for instance b3b9fa34-2929-4ab9-b2d8-47c9949331e3 on nch2-master-1 Mar 12 21:02:10.934866 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e59b371b-a4d4-4c1f-bcb7-dc22d31ac4bf req-22389af6-99bc-4c80-b8ba-c9007eb22aed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055661 Mar 12 21:02:10.935969 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2515/3283] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:10.943443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a352bc56-6701-430a-b7f9-d8818c9bc4e6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:10.949449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a352bc56-6701-430a-b7f9-d8818c9bc4e6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] [instance: b3b9fa34-2929-4ab9-b2d8-47c9949331e3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:10.967093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a352bc56-6701-430a-b7f9-d8818c9bc4e6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:10.967851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a352bc56-6701-430a-b7f9-d8818c9bc4e6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:10.990359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a352bc56-6701-430a-b7f9-d8818c9bc4e6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:10.994955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a352bc56-6701-430a-b7f9-d8818c9bc4e6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:11.025030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a352bc56-6701-430a-b7f9-d8818c9bc4e6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] HTTP exception thrown: Instance b3b9fa34-2929-4ab9-b2d8-47c9949331e3 could not be found. Mar 12 21:02:11.025848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a352bc56-6701-430a-b7f9-d8818c9bc4e6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] Returning 404 to user: Instance b3b9fa34-2929-4ab9-b2d8-47c9949331e3 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:02:11.027046 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a352bc56-6701-430a-b7f9-d8818c9bc4e6 tempest-ServerRescueNegativeTestJSON-1387184555 tempest-ServerRescueNegativeTestJSON-1387184555-project] 10.222.0.30 "GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3" status: 404 len: 111 microversion: 2.1 time: 0.089733 Mar 12 21:02:11.031531 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2516/3284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:10 2022] GET /compute/v2.1/servers/b3b9fa34-2929-4ab9-b2d8-47c9949331e3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:02:11.038253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-32e75583-8b0a-4f38-8df9-0c645082bfca tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3704f790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:11.112895 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-32e75583-8b0a-4f38-8df9-0c645082bfca tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5" status: 200 len: 1462 microversion: 2.1 time: 0.079762 Mar 12 21:02:11.113564 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2517/3285] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:02:11 2022] GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5 => generated 1462 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:11.125691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-58e72ae2-4ce5-4a10-8d2c-b623eea433da req-04f9ce05-ddb8-4e68-a9b6-5e093476896b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0b657b-019a-495b-bf10-0b27962e3880", "name": "network-vif-unplugged", "status": "completed", "tag": "ea6450b5-34ee-4f9d-8b0d-7a507ad2499d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:11.140508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-58e72ae2-4ce5-4a10-8d2c-b623eea433da req-04f9ce05-ddb8-4e68-a9b6-5e093476896b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:11.141864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-58e72ae2-4ce5-4a10-8d2c-b623eea433da req-04f9ce05-ddb8-4e68-a9b6-5e093476896b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:11.156820 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-58e72ae2-4ce5-4a10-8d2c-b623eea433da req-04f9ce05-ddb8-4e68-a9b6-5e093476896b service nova] Creating event network-vif-unplugged:ea6450b5-34ee-4f9d-8b0d-7a507ad2499d for instance 8d0b657b-019a-495b-bf10-0b27962e3880 on nch2-master-1 Mar 12 21:02:11.165827 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-58e72ae2-4ce5-4a10-8d2c-b623eea433da req-04f9ce05-ddb8-4e68-a9b6-5e093476896b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049875 Mar 12 21:02:11.167482 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2518/3286] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:11.174449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5147369-2c74-4c39-95c7-4a9b91343479 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '.version_select at 0x7f6e3704fa60>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:12.067696 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5147369-2c74-4c39-95c7-4a9b91343479 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/0035b58e-d4ac-4faf-a314-4caa113cd8d2" status: 202 len: 0 microversion: 2.1 time: 0.898723 Mar 12 21:02:12.068661 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2519/3287] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Mar 12 21:02:11 2022] DELETE /compute/v2.1/os-security-groups/0035b58e-d4ac-4faf-a314-4caa113cd8d2 => generated 0 bytes in 900 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:02:12.073685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-497dbd86-5369-4a97-a261-52d7952b6eb8 tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:12.083880 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-497dbd86-5369-4a97-a261-52d7952b6eb8 tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] HTTP exception thrown: Instance group ee9cf92b-ef0b-4b84-aa7b-e60badb50e93 could not be found. Mar 12 21:02:12.089425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-497dbd86-5369-4a97-a261-52d7952b6eb8 tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] Returning 404 to user: Instance group ee9cf92b-ef0b-4b84-aa7b-e60badb50e93 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:02:12.090522 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-497dbd86-5369-4a97-a261-52d7952b6eb8 tempest-ServerGroup264TestJSON-1093724470 tempest-ServerGroup264TestJSON-1093724470-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/ee9cf92b-ef0b-4b84-aa7b-e60badb50e93" status: 404 len: 117 microversion: 2.64 time: 0.020739 Mar 12 21:02:12.093663 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2520/3288] 10.222.0.30 () {60 vars in 1306 bytes} [Sat Mar 12 21:02:12 2022] DELETE /compute/v2.1/os-server-groups/ee9cf92b-ef0b-4b84-aa7b-e60badb50e93 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:02:12.103607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a1c882d-cb8c-4450-b1e3-8089f18a3c87 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:12.105577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0a1c882d-cb8c-4450-b1e3-8089f18a3c87 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:12.122942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a1c882d-cb8c-4450-b1e3-8089f18a3c87 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:12.123660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a1c882d-cb8c-4450-b1e3-8089f18a3c87 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:12.124728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a1c882d-cb8c-4450-b1e3-8089f18a3c87 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:12.127699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a1c882d-cb8c-4450-b1e3-8089f18a3c87 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:12.305381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0a1c882d-cb8c-4450-b1e3-8089f18a3c87 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:12.316925 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0a1c882d-cb8c-4450-b1e3-8089f18a3c87 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1274 microversion: 2.1 time: 0.221893 Mar 12 21:02:12.317844 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2521/3289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:12 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:12.328214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e0939b6c-dbeb-44d5-89ef-ba8d6e1c903d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e44182ee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:12.384425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e0939b6c-dbeb-44d5-89ef-ba8d6e1c903d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5" status: 200 len: 1462 microversion: 2.1 time: 0.064831 Mar 12 21:02:12.385502 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2522/3290] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:02:12 2022] GET /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5 => generated 1462 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:12.390753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-565146346", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fca288f-5c1f-4dae-b9c3-eaca1253f073"}], "security_groups": [{"name": "tempest-securitygroup--1862868177"}], "key_name": "tempest-keypair-1301130332", "user_data": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:12.719792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] validate_networks() for [('2fca288f-5c1f-4dae-b9c3-eaca1253f073', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:02:14.312986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:02:14.317345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:02:14.318147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:02:14.319004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:02:14.319593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:02:14.362832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:14.363331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:14.364369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:14.365004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:14.450502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Getting quotas for project b4da7920d54243cd8381e283021d7745. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:02:14.464845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Getting quotas for user ec384ea1fe344a08a8b9491f10f3b211 and project b4da7920d54243cd8381e283021d7745. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:02:14.495901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:02:14.498759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:02:14.615751 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f61a7a8-e42d-4c5c-8ded-736e0c0aa6fa tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.228871 Mar 12 21:02:14.626135 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2523/3291] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:02:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:02:14.632154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-82a93144-5c1f-45e0-ad1b-0c05482a950b tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:14.632903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-82a93144-5c1f-45e0-ad1b-0c05482a950b tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:14.653718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82a93144-5c1f-45e0-ad1b-0c05482a950b tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:14.654488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82a93144-5c1f-45e0-ad1b-0c05482a950b tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:14.656614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82a93144-5c1f-45e0-ad1b-0c05482a950b tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:14.657164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82a93144-5c1f-45e0-ad1b-0c05482a950b tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:14.757000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-82a93144-5c1f-45e0-ad1b-0c05482a950b tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:02:14.990383 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-82a93144-5c1f-45e0-ad1b-0c05482a950b tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 204 len: 0 microversion: 2.1 time: 0.362396 Mar 12 21:02:14.993357 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2524/3292] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:02:14 2022] DELETE /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:02:15.003977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-481d7079-a272-4549-ad38-16484921e2fa tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:15.004777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-481d7079-a272-4549-ad38-16484921e2fa tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 8d0b657b-019a-495b-bf10-0b27962e3880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:15.012247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-481d7079-a272-4549-ad38-16484921e2fa tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:15.012914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-481d7079-a272-4549-ad38-16484921e2fa tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:15.014588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-481d7079-a272-4549-ad38-16484921e2fa tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:15.015266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-481d7079-a272-4549-ad38-16484921e2fa tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:16.145735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-481d7079-a272-4549-ad38-16484921e2fa tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:16.154114 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-481d7079-a272-4549-ad38-16484921e2fa tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880" status: 200 len: 1467 microversion: 2.1 time: 1.159422 Mar 12 21:02:16.159413 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2525/3293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:14 2022] GET /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880 => generated 1467 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:16.174856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-799b9e69-23d5-4ab1-ae82-4ade182869c2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:16.175734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-799b9e69-23d5-4ab1-ae82-4ade182869c2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:16.185980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-799b9e69-23d5-4ab1-ae82-4ade182869c2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:16.186732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-799b9e69-23d5-4ab1-ae82-4ade182869c2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:16.187702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-799b9e69-23d5-4ab1-ae82-4ade182869c2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:16.198542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-799b9e69-23d5-4ab1-ae82-4ade182869c2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:17.076197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-799b9e69-23d5-4ab1-ae82-4ade182869c2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:17.090452 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-799b9e69-23d5-4ab1-ae82-4ade182869c2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1314 microversion: 2.1 time: 0.929697 Mar 12 21:02:17.092818 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2526/3294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:16 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1314 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:17.135436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-762b0fe3-b242-4a23-ba7a-bbb37bf403c4 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:17.139164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-762b0fe3-b242-4a23-ba7a-bbb37bf403c4 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:17.156539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-762b0fe3-b242-4a23-ba7a-bbb37bf403c4 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:17.157177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-762b0fe3-b242-4a23-ba7a-bbb37bf403c4 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:17.162029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-762b0fe3-b242-4a23-ba7a-bbb37bf403c4 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:17.163713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-762b0fe3-b242-4a23-ba7a-bbb37bf403c4 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:17.320821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-762b0fe3-b242-4a23-ba7a-bbb37bf403c4 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:17.331460 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-762b0fe3-b242-4a23-ba7a-bbb37bf403c4 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 200 len: 1295 microversion: 2.1 time: 0.237378 Mar 12 21:02:17.332051 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2527/3295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:17 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 1295 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:17.372150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-15651849-ef37-4f42-91f2-af103029e596 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:17.375894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-15651849-ef37-4f42-91f2-af103029e596 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:17.383874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15651849-ef37-4f42-91f2-af103029e596 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:17.384560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15651849-ef37-4f42-91f2-af103029e596 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:17.385573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15651849-ef37-4f42-91f2-af103029e596 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:17.389145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15651849-ef37-4f42-91f2-af103029e596 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:17.856583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-15651849-ef37-4f42-91f2-af103029e596 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:17.866285 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-15651849-ef37-4f42-91f2-af103029e596 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1509 microversion: 2.1 time: 0.524619 Mar 12 21:02:17.866850 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2528/3296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:17 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1509 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:17.902634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2cbdcaa-ebf4-4cca-8b66-8ed4845ae464 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e44182d30>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:18.159600 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2cbdcaa-ebf4-4cca-8b66-8ed4845ae464 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images?changes-since=2022-03-12T21%3A00%3A09Z" status: 200 len: 2375 microversion: 2.1 time: 0.278049 Mar 12 21:02:18.165854 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2529/3297] 10.222.0.30 () {58 vars in 1198 bytes} [Sat Mar 12 21:02:17 2022] GET /compute/v2.1/images?changes-since=2022-03-12T21%3A00%3A09Z => generated 2375 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:18.178273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5bd6a19c-769f-4169-9985-a61b1de0f0a9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:18.179367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5bd6a19c-769f-4169-9985-a61b1de0f0a9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:18.205840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bd6a19c-769f-4169-9985-a61b1de0f0a9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:18.206699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bd6a19c-769f-4169-9985-a61b1de0f0a9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:18.207728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bd6a19c-769f-4169-9985-a61b1de0f0a9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:18.208401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bd6a19c-769f-4169-9985-a61b1de0f0a9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:19.031975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5bd6a19c-769f-4169-9985-a61b1de0f0a9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:19.064553 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5bd6a19c-769f-4169-9985-a61b1de0f0a9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1314 microversion: 2.1 time: 0.893980 Mar 12 21:02:19.066227 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2530/3298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:18 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1314 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:19.082820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-70398239-8c97-4c77-8d07-43cd4719874d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e44182ee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:19.247073 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-70398239-8c97-4c77-8d07-43cd4719874d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-611188760" status: 200 len: 484 microversion: 2.1 time: 0.179424 Mar 12 21:02:19.259646 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2531/3299] 10.222.0.30 () {58 vars in 1228 bytes} [Sat Mar 12 21:02:19 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-611188760 => generated 484 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:19.272710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-098a0881-aa16-4536-8eab-fb686eae6d42 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:19.276320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-098a0881-aa16-4536-8eab-fb686eae6d42 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:19.291570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-098a0881-aa16-4536-8eab-fb686eae6d42 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:19.292209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-098a0881-aa16-4536-8eab-fb686eae6d42 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:19.293113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-098a0881-aa16-4536-8eab-fb686eae6d42 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:19.293664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-098a0881-aa16-4536-8eab-fb686eae6d42 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:19.447898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-098a0881-aa16-4536-8eab-fb686eae6d42 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:19.462378 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-098a0881-aa16-4536-8eab-fb686eae6d42 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 200 len: 1295 microversion: 2.1 time: 0.194678 Mar 12 21:02:19.463850 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2532/3300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:19 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 1295 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:19.476017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8c7fc061-7ba9-4861-9491-2aac7319c50f req-afb088dd-0f5e-4d1f-bda5-8c6998f584d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b", "tag": "9167fcbc-ffb3-4af2-849d-77833a794562"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:19.491057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8c7fc061-7ba9-4861-9491-2aac7319c50f req-afb088dd-0f5e-4d1f-bda5-8c6998f584d9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:19.491861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8c7fc061-7ba9-4861-9491-2aac7319c50f req-afb088dd-0f5e-4d1f-bda5-8c6998f584d9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:19.512710 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8c7fc061-7ba9-4861-9491-2aac7319c50f req-afb088dd-0f5e-4d1f-bda5-8c6998f584d9 service nova] Creating event network-changed:9167fcbc-ffb3-4af2-849d-77833a794562 for instance 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b on nch1-master-1 Mar 12 21:02:19.529595 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8c7fc061-7ba9-4861-9491-2aac7319c50f req-afb088dd-0f5e-4d1f-bda5-8c6998f584d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064198 Mar 12 21:02:19.530432 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2533/3301] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:19.540363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21c7dd1a-c672-45c0-a54d-b9c9742a6d27 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:19.546821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-21c7dd1a-c672-45c0-a54d-b9c9742a6d27 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:19.560309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21c7dd1a-c672-45c0-a54d-b9c9742a6d27 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:19.561146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21c7dd1a-c672-45c0-a54d-b9c9742a6d27 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:19.562231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21c7dd1a-c672-45c0-a54d-b9c9742a6d27 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:19.562905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21c7dd1a-c672-45c0-a54d-b9c9742a6d27 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:19.858385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21c7dd1a-c672-45c0-a54d-b9c9742a6d27 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cffef7a2961a48c582a965a68607ba7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ac94c961644bb5b54ca63306080337', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:19.871020 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21c7dd1a-c672-45c0-a54d-b9c9742a6d27 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 200 len: 1509 microversion: 2.1 time: 0.337959 Mar 12 21:02:19.872556 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2534/3302] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:19 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 1509 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:19.881808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ed77418-ff3b-4481-92c6-09157a2d54d0 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356b9d30>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:19.995507 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ed77418-ff3b-4481-92c6-09157a2d54d0 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images?server=8d0b657b-019a-495b-bf10-0b27962e3880" status: 200 len: 958 microversion: 2.1 time: 0.121169 Mar 12 21:02:20.003517 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2535/3303] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Mar 12 21:02:19 2022] GET /compute/v2.1/images?server=8d0b657b-019a-495b-bf10-0b27962e3880 => generated 958 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:20.009333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1e4acdc-5c0d-4d4a-a91b-2895c923fb65 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356a3dc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:20.065371 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1e4acdc-5c0d-4d4a-a91b-2895c923fb65 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 485 microversion: 2.1 time: 0.058928 Mar 12 21:02:20.066217 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2536/3304] 10.222.0.30 () {58 vars in 1316 bytes} [Sat Mar 12 21:02:20 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F63c44039-6c03-403b-8828-046bf508b27f => generated 485 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:20.077145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b591c360-cd37-40ca-967c-0a41e86dc1d0 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3622f310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:20.166225 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b591c360-cd37-40ca-967c-0a41e86dc1d0 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 485 microversion: 2.1 time: 0.093248 Mar 12 21:02:20.174911 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2537/3305] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Mar 12 21:02:20 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F63c44039-6c03-403b-8828-046bf508b27f => generated 485 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:20.181950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f425379a-c496-4094-a8b7-4f8727b532f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:20.184006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f425379a-c496-4094-a8b7-4f8727b532f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:20.192028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f425379a-c496-4094-a8b7-4f8727b532f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:20.192879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f425379a-c496-4094-a8b7-4f8727b532f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:20.194361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f425379a-c496-4094-a8b7-4f8727b532f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:20.195480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f425379a-c496-4094-a8b7-4f8727b532f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:20.520405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f425379a-c496-4094-a8b7-4f8727b532f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:20.529691 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f425379a-c496-4094-a8b7-4f8727b532f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1314 microversion: 2.1 time: 0.353121 Mar 12 21:02:20.532373 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2538/3306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:20 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:20.547275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99118248-d041-4a62-932d-01e51ccc0bec tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356a8040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:20.767001 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99118248-d041-4a62-932d-01e51ccc0bec tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.232751 Mar 12 21:02:20.776683 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2539/3307] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Mar 12 21:02:20 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:20.782447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b766196e-43dd-4918-ade3-f75f7b5cac83 req-8cc45c8b-c367-440b-ac60-4904e777fe42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4236dcbc-d67f-483e-ae3d-1b3613b35181", "name": "network-vif-deleted", "tag": "670a32c0-8906-4816-8ad8-a19dd87c3c18"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:20.794154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b766196e-43dd-4918-ade3-f75f7b5cac83 req-8cc45c8b-c367-440b-ac60-4904e777fe42 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:20.795209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b766196e-43dd-4918-ade3-f75f7b5cac83 req-8cc45c8b-c367-440b-ac60-4904e777fe42 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:20.832091 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b766196e-43dd-4918-ade3-f75f7b5cac83 req-8cc45c8b-c367-440b-ac60-4904e777fe42 service nova] Creating event network-vif-deleted:670a32c0-8906-4816-8ad8-a19dd87c3c18 for instance 4236dcbc-d67f-483e-ae3d-1b3613b35181 on nch1-master-1 Mar 12 21:02:20.844492 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b766196e-43dd-4918-ade3-f75f7b5cac83 req-8cc45c8b-c367-440b-ac60-4904e777fe42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065599 Mar 12 21:02:20.844833 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2540/3308] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:20.850588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c769a64-ae6e-458b-b4a8-70942ddecb4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:20.851355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c769a64-ae6e-458b-b4a8-70942ddecb4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:20.858827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c769a64-ae6e-458b-b4a8-70942ddecb4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:20.859330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c769a64-ae6e-458b-b4a8-70942ddecb4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:20.860065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c769a64-ae6e-458b-b4a8-70942ddecb4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:20.860505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c769a64-ae6e-458b-b4a8-70942ddecb4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:21.048206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9c769a64-ae6e-458b-b4a8-70942ddecb4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:21.063152 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c769a64-ae6e-458b-b4a8-70942ddecb4f tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 200 len: 1363 microversion: 2.1 time: 0.217045 Mar 12 21:02:21.064337 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2541/3309] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:20 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:21.086645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-98cdc65f-c190-4c6c-9fe9-5985b2c23def tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e362539d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:21.175254 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-98cdc65f-c190-4c6c-9fe9-5985b2c23def tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.108644 Mar 12 21:02:21.175936 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2542/3310] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Mar 12 21:02:21 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:21.188457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b34ef08-30cb-4c83-a6af-fa6f9e3fc540 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:21.189392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b34ef08-30cb-4c83-a6af-fa6f9e3fc540 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] [instance: 4236dcbc-d67f-483e-ae3d-1b3613b35181] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:21.195905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b34ef08-30cb-4c83-a6af-fa6f9e3fc540 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:21.196362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b34ef08-30cb-4c83-a6af-fa6f9e3fc540 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:21.197151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b34ef08-30cb-4c83-a6af-fa6f9e3fc540 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:21.197597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b34ef08-30cb-4c83-a6af-fa6f9e3fc540 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:21.214629 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-7b34ef08-30cb-4c83-a6af-fa6f9e3fc540 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] HTTP exception thrown: Instance 4236dcbc-d67f-483e-ae3d-1b3613b35181 could not be found. Mar 12 21:02:21.215257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b34ef08-30cb-4c83-a6af-fa6f9e3fc540 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] Returning 404 to user: Instance 4236dcbc-d67f-483e-ae3d-1b3613b35181 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:02:21.216280 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b34ef08-30cb-4c83-a6af-fa6f9e3fc540 tempest-ServerRescueTestJSONUnderV235-1942357487 tempest-ServerRescueTestJSONUnderV235-1942357487-project] 10.222.0.30 "GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181" status: 404 len: 111 microversion: 2.1 time: 0.032666 Mar 12 21:02:21.216870 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2543/3311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:21 2022] GET /compute/v2.1/servers/4236dcbc-d67f-483e-ae3d-1b3613b35181 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:02:21.377976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-398810720", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "037c7cd4-360b-4bb5-b3a5-c49e302a54d4"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:21.445247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] validate_networks() for [('037c7cd4-360b-4bb5-b3a5-c49e302a54d4', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:02:22.040654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:02:22.041331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:02:22.041599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:02:22.041994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:02:22.042416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:02:22.056148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:22.057856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:22.059017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:22.062996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:22.087427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Getting quotas for project 734b75bbb7ab42e49c2ae070e9fd66e9. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:02:22.095080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Getting quotas for user 41434befaa464ddbafdb567271a4e916 and project 734b75bbb7ab42e49c2ae070e9fd66e9. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:02:22.109511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:02:22.112966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:02:22.193505 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7ad46c68-ea34-4647-9876-fdf58f904958 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975224 Mar 12 21:02:22.196079 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2544/3312] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:02:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:02:22.223998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-18c8c3dd-70f6-46b4-a022-e8280effe646 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e37170040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:22.307991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-18c8c3dd-70f6-46b4-a022-e8280effe646 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.109345 Mar 12 21:02:22.308881 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2545/3313] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 21:02:22 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:22.315580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-44a165ab-d897-4628-b287-901af836c850 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:22.317005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-44a165ab-d897-4628-b287-901af836c850 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:22.324907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44a165ab-d897-4628-b287-901af836c850 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:22.325375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44a165ab-d897-4628-b287-901af836c850 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:22.326251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44a165ab-d897-4628-b287-901af836c850 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:22.326691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44a165ab-d897-4628-b287-901af836c850 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:22.642064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-44a165ab-d897-4628-b287-901af836c850 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:22.650879 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-44a165ab-d897-4628-b287-901af836c850 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1314 microversion: 2.1 time: 0.340591 Mar 12 21:02:22.654529 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2546/3314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:22 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:22.662483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-100ed26d-6844-40ae-afc5-c687270351bb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:22.664830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-100ed26d-6844-40ae-afc5-c687270351bb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:22.677631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-100ed26d-6844-40ae-afc5-c687270351bb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:22.678832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-100ed26d-6844-40ae-afc5-c687270351bb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:22.680284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-100ed26d-6844-40ae-afc5-c687270351bb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:22.681330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-100ed26d-6844-40ae-afc5-c687270351bb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:23.033345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-100ed26d-6844-40ae-afc5-c687270351bb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:23.044366 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-100ed26d-6844-40ae-afc5-c687270351bb tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 200 len: 1363 microversion: 2.1 time: 0.386319 Mar 12 21:02:23.046150 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2547/3315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:22 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 1363 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:23.051019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3215e62d-0fc8-49e3-9919-b695f28ca75d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:23.054569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3215e62d-0fc8-49e3-9919-b695f28ca75d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:23.071564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3215e62d-0fc8-49e3-9919-b695f28ca75d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:23.073536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3215e62d-0fc8-49e3-9919-b695f28ca75d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:23.074552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3215e62d-0fc8-49e3-9919-b695f28ca75d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:23.077149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3215e62d-0fc8-49e3-9919-b695f28ca75d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:23.289373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3215e62d-0fc8-49e3-9919-b695f28ca75d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41434befaa464ddbafdb567271a4e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734b75bbb7ab42e49c2ae070e9fd66e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:23.301517 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3215e62d-0fc8-49e3-9919-b695f28ca75d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553" status: 200 len: 1211 microversion: 2.1 time: 0.254226 Mar 12 21:02:23.302156 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2548/3316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:23 2022] GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553 => generated 1211 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:23.316455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-79829c71-2268-4065-a0fd-ea8718a5e7e3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e36253550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:23.430379 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-79829c71-2268-4065-a0fd-ea8718a5e7e3 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/detail?changes-since=2022-03-12T21%3A00%3A06Z" status: 200 len: 6327 microversion: 2.1 time: 0.123811 Mar 12 21:02:23.442409 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2549/3317] 10.222.0.30 () {58 vars in 1219 bytes} [Sat Mar 12 21:02:23 2022] GET /compute/v2.1/images/detail?changes-since=2022-03-12T21%3A00%3A06Z => generated 6327 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:23.448410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5acbca6-d1ac-46cc-9927-7d0a96049a22 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e35671ee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:23.549413 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5acbca6-d1ac-46cc-9927-7d0a96049a22 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-611188760" status: 200 len: 664 microversion: 2.1 time: 0.100224 Mar 12 21:02:23.562559 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2550/3318] 10.222.0.30 () {58 vars in 1249 bytes} [Sat Mar 12 21:02:23 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-611188760 => generated 664 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:23.576376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ade523b-c9e4-4b03-ba99-08a6e59825bf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3565c940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:23.682373 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ade523b-c9e4-4b03-ba99-08a6e59825bf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1465 microversion: 2.1 time: 0.118187 Mar 12 21:02:23.685505 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2551/3319] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Mar 12 21:02:23 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F63c44039-6c03-403b-8828-046bf508b27f => generated 1465 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:23.704664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2956bd33-d463-48a5-88e5-02c8e3c44fa3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:23.710492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2956bd33-d463-48a5-88e5-02c8e3c44fa3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:23.722810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2956bd33-d463-48a5-88e5-02c8e3c44fa3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:23.725021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2956bd33-d463-48a5-88e5-02c8e3c44fa3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:23.726742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2956bd33-d463-48a5-88e5-02c8e3c44fa3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:23.729059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2956bd33-d463-48a5-88e5-02c8e3c44fa3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:24.337440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2956bd33-d463-48a5-88e5-02c8e3c44fa3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:24.366527 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2956bd33-d463-48a5-88e5-02c8e3c44fa3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1314 microversion: 2.1 time: 0.670935 Mar 12 21:02:24.380015 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2552/3320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:23 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:24.394328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cdbcb46f-534a-4067-868e-54ac0a70f69a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e37378310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:24.476139 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cdbcb46f-534a-4067-868e-54ac0a70f69a tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1465 microversion: 2.1 time: 0.094521 Mar 12 21:02:24.477497 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2553/3321] 10.222.0.30 () {58 vars in 1323 bytes} [Sat Mar 12 21:02:24 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F63c44039-6c03-403b-8828-046bf508b27f => generated 1465 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:24.493922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e40e4561-7cd2-438f-969d-040487ac21a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:24.495722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e40e4561-7cd2-438f-969d-040487ac21a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:24.512071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e40e4561-7cd2-438f-969d-040487ac21a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:24.513689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e40e4561-7cd2-438f-969d-040487ac21a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:24.515695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e40e4561-7cd2-438f-969d-040487ac21a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:24.516159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e40e4561-7cd2-438f-969d-040487ac21a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:24.934455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e40e4561-7cd2-438f-969d-040487ac21a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:24.964108 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e40e4561-7cd2-438f-969d-040487ac21a7 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 200 len: 1363 microversion: 2.1 time: 0.480996 Mar 12 21:02:24.968581 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2554/3322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:24 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 1363 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:24.994122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d3a4fe11-3718-419f-a9de-57da87c4951a tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:24.994796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d3a4fe11-3718-419f-a9de-57da87c4951a tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:25.001202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3a4fe11-3718-419f-a9de-57da87c4951a tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:25.004601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3a4fe11-3718-419f-a9de-57da87c4951a tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:25.004601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3a4fe11-3718-419f-a9de-57da87c4951a tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:25.008160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3a4fe11-3718-419f-a9de-57da87c4951a tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:25.120057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d3a4fe11-3718-419f-a9de-57da87c4951a tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41434befaa464ddbafdb567271a4e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734b75bbb7ab42e49c2ae070e9fd66e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:25.129309 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d3a4fe11-3718-419f-a9de-57da87c4951a tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553" status: 200 len: 1273 microversion: 2.1 time: 0.157021 Mar 12 21:02:25.138057 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2555/3323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:24 2022] GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:25.143483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-127b0924-9be8-4da9-b8a1-268055788743 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3622fdc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:25.288931 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-127b0924-9be8-4da9-b8a1-268055788743 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.149656 Mar 12 21:02:25.289550 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2556/3324] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Mar 12 21:02:25 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:25.304986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9a5a38e5-6f5e-4bb8-9939-87f6b8e70293 req-3f49ed58-f461-42cc-8cbd-b913c0cd02a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b", "name": "network-vif-plugged", "status": "completed", "tag": "9167fcbc-ffb3-4af2-849d-77833a794562"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:25.329283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9a5a38e5-6f5e-4bb8-9939-87f6b8e70293 req-3f49ed58-f461-42cc-8cbd-b913c0cd02a2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:25.331309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9a5a38e5-6f5e-4bb8-9939-87f6b8e70293 req-3f49ed58-f461-42cc-8cbd-b913c0cd02a2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:25.368415 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9a5a38e5-6f5e-4bb8-9939-87f6b8e70293 req-3f49ed58-f461-42cc-8cbd-b913c0cd02a2 service nova] Creating event network-vif-plugged:9167fcbc-ffb3-4af2-849d-77833a794562 for instance 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b on nch1-master-1 Mar 12 21:02:25.384023 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9a5a38e5-6f5e-4bb8-9939-87f6b8e70293 req-3f49ed58-f461-42cc-8cbd-b913c0cd02a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088362 Mar 12 21:02:25.385128 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2557/3325] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:25.394513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ba367210-3910-445a-8142-a84f9bb30a1e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e37378040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:25.514957 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ba367210-3910-445a-8142-a84f9bb30a1e tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4371 microversion: 2.1 time: 0.127102 Mar 12 21:02:25.520227 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2558/3326] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Mar 12 21:02:25 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:25.525709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8fbf0fa7-cdac-4a19-aca3-a0bf3c539489 req-8931cf9e-1d86-4061-ba49-a2d86bb80fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5a70e8-3738-4058-94d8-a41af23a25af", "tag": "d8e3021e-2148-4e62-8ee0-5ffe41a6253c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:25.537555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8fbf0fa7-cdac-4a19-aca3-a0bf3c539489 req-8931cf9e-1d86-4061-ba49-a2d86bb80fb7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:25.538425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8fbf0fa7-cdac-4a19-aca3-a0bf3c539489 req-8931cf9e-1d86-4061-ba49-a2d86bb80fb7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:25.552439 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8fbf0fa7-cdac-4a19-aca3-a0bf3c539489 req-8931cf9e-1d86-4061-ba49-a2d86bb80fb7 service nova] Creating event network-changed:d8e3021e-2148-4e62-8ee0-5ffe41a6253c for instance ed5a70e8-3738-4058-94d8-a41af23a25af on nch2-master-1 Mar 12 21:02:25.558048 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8fbf0fa7-cdac-4a19-aca3-a0bf3c539489 req-8931cf9e-1d86-4061-ba49-a2d86bb80fb7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036044 Mar 12 21:02:25.559669 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2559/3327] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:25.566765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-702fec6a-7563-4bce-b4a8-b594a7671696 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:25.567831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-702fec6a-7563-4bce-b4a8-b594a7671696 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:25.574888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-702fec6a-7563-4bce-b4a8-b594a7671696 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:25.575838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-702fec6a-7563-4bce-b4a8-b594a7671696 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:25.576922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-702fec6a-7563-4bce-b4a8-b594a7671696 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:25.577589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-702fec6a-7563-4bce-b4a8-b594a7671696 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:25.959586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-702fec6a-7563-4bce-b4a8-b594a7671696 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:25.968239 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-702fec6a-7563-4bce-b4a8-b594a7671696 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1314 microversion: 2.1 time: 0.406198 Mar 12 21:02:25.970317 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2560/3328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:25 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:25.978691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8515e4d0-469f-4882-a9e5-bdcd86936768 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e366f7d30>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:26.064651 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8515e4d0-469f-4882-a9e5-bdcd86936768 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/539171db-0bd3-4f16-95fd-a7cd5530137d" status: 200 len: 784 microversion: 2.1 time: 0.092116 Mar 12 21:02:26.065373 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2561/3329] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Mar 12 21:02:25 2022] GET /compute/v2.1/images/539171db-0bd3-4f16-95fd-a7cd5530137d => generated 784 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:26.082031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3af3f419-aa10-4af0-a136-ee2bf6777d1c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:26.082743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3af3f419-aa10-4af0-a136-ee2bf6777d1c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:26.091113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3af3f419-aa10-4af0-a136-ee2bf6777d1c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:26.091672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3af3f419-aa10-4af0-a136-ee2bf6777d1c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:26.092730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3af3f419-aa10-4af0-a136-ee2bf6777d1c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:26.093417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3af3f419-aa10-4af0-a136-ee2bf6777d1c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:26.646442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3af3f419-aa10-4af0-a136-ee2bf6777d1c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:26.653943 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3af3f419-aa10-4af0-a136-ee2bf6777d1c tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 200 len: 1363 microversion: 2.1 time: 0.576327 Mar 12 21:02:26.654540 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2562/3330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:26 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 1363 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:26.671881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c93d8b8e-51ed-4431-bf66-14344d1b47a1 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e37378670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:26.754797 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c93d8b8e-51ed-4431-bf66-14344d1b47a1 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.094983 Mar 12 21:02:26.764177 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2563/3331] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 21:02:26 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:26.778259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c81f4f30-7416-4a4f-b5af-fbeede146476 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:26.790308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c81f4f30-7416-4a4f-b5af-fbeede146476 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:26.797194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c81f4f30-7416-4a4f-b5af-fbeede146476 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:26.797996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c81f4f30-7416-4a4f-b5af-fbeede146476 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:26.800820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c81f4f30-7416-4a4f-b5af-fbeede146476 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:26.801286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c81f4f30-7416-4a4f-b5af-fbeede146476 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:27.721059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c81f4f30-7416-4a4f-b5af-fbeede146476 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41434befaa464ddbafdb567271a4e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734b75bbb7ab42e49c2ae070e9fd66e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:27.737258 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c81f4f30-7416-4a4f-b5af-fbeede146476 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553" status: 200 len: 1315 microversion: 2.1 time: 0.971493 Mar 12 21:02:27.737924 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2564/3332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:26 2022] GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553 => generated 1315 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:27.754429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b8da8661-72c3-425d-babe-e1f5fd9782e6 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e356a80d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:28.868496 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b8da8661-72c3-425d-babe-e1f5fd9782e6 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "DELETE /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5" status: 204 len: 0 microversion: 2.1 time: 1.129482 Mar 12 21:02:28.869323 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2565/3333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:27 2022] DELETE /compute/v2.1/images/64f75c20-da9d-40f7-9352-80e45d41d2a5 => generated 0 bytes in 1131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:02:28.875934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f3b41a24-8b80-432d-8e94-6445e468bf4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:28.876800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f3b41a24-8b80-432d-8e94-6445e468bf4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:28.895394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3b41a24-8b80-432d-8e94-6445e468bf4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:28.897393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3b41a24-8b80-432d-8e94-6445e468bf4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:28.900913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3b41a24-8b80-432d-8e94-6445e468bf4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:28.901360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3b41a24-8b80-432d-8e94-6445e468bf4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:29.650366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f3b41a24-8b80-432d-8e94-6445e468bf4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:29.686151 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f3b41a24-8b80-432d-8e94-6445e468bf4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1502 microversion: 2.1 time: 0.815487 Mar 12 21:02:29.687015 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2566/3334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:28 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1502 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:29.693805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d02549c-a393-43d8-8e55-e140cfbe4a72 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:29.694263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d02549c-a393-43d8-8e55-e140cfbe4a72 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:29.703813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d02549c-a393-43d8-8e55-e140cfbe4a72 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:29.703990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d02549c-a393-43d8-8e55-e140cfbe4a72 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:29.705530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d02549c-a393-43d8-8e55-e140cfbe4a72 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:29.706183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d02549c-a393-43d8-8e55-e140cfbe4a72 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:30.103281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d02549c-a393-43d8-8e55-e140cfbe4a72 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:30.117055 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d02549c-a393-43d8-8e55-e140cfbe4a72 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 200 len: 1363 microversion: 2.1 time: 0.427894 Mar 12 21:02:30.124555 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2567/3335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:29 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 1363 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:30.135098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-14a231c8-2b87-42ec-91c1-4f26f565dd88 req-ebbfc01a-d9ad-4998-b2fd-48c449fe8b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c556d7b-e8e8-4855-b69b-f169613dc553", "tag": "4f5b8612-f343-4de5-a91d-584c3c30d79e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:30.145459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-14a231c8-2b87-42ec-91c1-4f26f565dd88 req-ebbfc01a-d9ad-4998-b2fd-48c449fe8b2c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:30.145860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-14a231c8-2b87-42ec-91c1-4f26f565dd88 req-ebbfc01a-d9ad-4998-b2fd-48c449fe8b2c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:30.172961 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-14a231c8-2b87-42ec-91c1-4f26f565dd88 req-ebbfc01a-d9ad-4998-b2fd-48c449fe8b2c service nova] Creating event network-changed:4f5b8612-f343-4de5-a91d-584c3c30d79e for instance 3c556d7b-e8e8-4855-b69b-f169613dc553 on nch1-master-1 Mar 12 21:02:30.182025 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-14a231c8-2b87-42ec-91c1-4f26f565dd88 req-ebbfc01a-d9ad-4998-b2fd-48c449fe8b2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055964 Mar 12 21:02:30.182651 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2568/3336] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:30.195993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2551a3bb-b948-463a-968d-c46431d6b921 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:30.196929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2551a3bb-b948-463a-968d-c46431d6b921 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:30.205644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2551a3bb-b948-463a-968d-c46431d6b921 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:30.210432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2551a3bb-b948-463a-968d-c46431d6b921 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:30.212455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2551a3bb-b948-463a-968d-c46431d6b921 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:30.213257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2551a3bb-b948-463a-968d-c46431d6b921 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:31.027457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2551a3bb-b948-463a-968d-c46431d6b921 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41434befaa464ddbafdb567271a4e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734b75bbb7ab42e49c2ae070e9fd66e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:31.036220 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2551a3bb-b948-463a-968d-c46431d6b921 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553" status: 200 len: 1315 microversion: 2.1 time: 0.844339 Mar 12 21:02:31.036823 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2569/3337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:30 2022] GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553 => generated 1315 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:31.051283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b31c5a6-1bd8-4815-917a-c2f0618965ce tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e36d46dc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:31.672081 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b31c5a6-1bd8-4815-917a-c2f0618965ce tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "DELETE /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78" status: 204 len: 0 microversion: 2.1 time: 0.624762 Mar 12 21:02:31.673279 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2570/3338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:31 2022] DELETE /compute/v2.1/images/fc98c7bb-64ee-4af0-9de1-4b028f5bbe78 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:02:31.679017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f59b6010-8b50-4c44-8de5-c605a05b5f37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:31.690857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f59b6010-8b50-4c44-8de5-c605a05b5f37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:31.691497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f59b6010-8b50-4c44-8de5-c605a05b5f37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:31.722575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f59b6010-8b50-4c44-8de5-c605a05b5f37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Going to try to stop instance {{(pid=136302) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 12 21:02:31.768252 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f59b6010-8b50-4c44-8de5-c605a05b5f37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b/action" status: 202 len: 0 microversion: 2.1 time: 0.092613 Mar 12 21:02:31.769188 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2571/3339] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:02:31 2022] POST /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:02:31.925759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1188965445", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "8601f061-d4a9-43e6-b201-7525a34f7f8c"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:31.981210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] validate_networks() for [('8601f061-d4a9-43e6-b201-7525a34f7f8c', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:02:33.296109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:02:33.296655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:02:33.296976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:02:33.297397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:02:33.297970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:02:33.320032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:33.320748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:33.322150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:33.322767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:33.376613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Getting quotas for project 2779b6e9dc324239be5fde35642407a0. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:02:33.404251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Getting quotas for user d291cca3e44a43e49083371f38632d7d and project 2779b6e9dc324239be5fde35642407a0. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:02:33.460374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:02:33.466393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:02:33.550189 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cc6a5591-4287-4936-a083-b30e8f5aae3c tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.776960 Mar 12 21:02:33.554335 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2572/3340] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 21:02:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 21:02:33.656520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-683862351", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": "none"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:33.748860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:02:33.749307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:02:33.749789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:02:33.750230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:02:33.750646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:02:33.769946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:33.770410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:33.771350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:33.771956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:33.798318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Getting quotas for project 79f0629679d143289f5bc0c3e6961504. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:02:33.805129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Getting quotas for user 1357dc80ed9d4d1b8dc7871160ffa4a1 and project 79f0629679d143289f5bc0c3e6961504. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:02:33.820094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:02:33.823866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:02:33.880516 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ff91c79b-c226-44ec-96df-04263fac98dd tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.321421 Mar 12 21:02:33.881533 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2573/3341] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 21:02:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 323 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 21:02:33.893926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7cab3707-c755-4347-9ad5-5c695095a4dc tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:33.894816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7cab3707-c755-4347-9ad5-5c695095a4dc tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:33.902154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cab3707-c755-4347-9ad5-5c695095a4dc tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:33.902911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cab3707-c755-4347-9ad5-5c695095a4dc tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:33.903875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cab3707-c755-4347-9ad5-5c695095a4dc tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:33.904465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cab3707-c755-4347-9ad5-5c695095a4dc tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:34.492383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7cab3707-c755-4347-9ad5-5c695095a4dc tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:34.504305 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7cab3707-c755-4347-9ad5-5c695095a4dc tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 200 len: 1363 microversion: 2.1 time: 0.620131 Mar 12 21:02:34.506369 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2574/3342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:33 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 1363 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:34.528812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c222d50-1d1f-4732-803d-7ceb6f3b39c1 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e36ebc700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:35.279997 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c222d50-1d1f-4732-803d-7ceb6f3b39c1 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "DELETE /compute/v2.1/images/90859586-d6e1-424d-afef-9fa8914fc130" status: 204 len: 0 microversion: 2.1 time: 0.762433 Mar 12 21:02:35.283001 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2575/3343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:34 2022] DELETE /compute/v2.1/images/90859586-d6e1-424d-afef-9fa8914fc130 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:02:35.295901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-66f50dcd-ecf3-47e3-9e7b-0c1faf0bde1f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:35.297093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-66f50dcd-ecf3-47e3-9e7b-0c1faf0bde1f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:35.319716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f50dcd-ecf3-47e3-9e7b-0c1faf0bde1f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:35.321169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f50dcd-ecf3-47e3-9e7b-0c1faf0bde1f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:35.323367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f50dcd-ecf3-47e3-9e7b-0c1faf0bde1f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:35.331783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66f50dcd-ecf3-47e3-9e7b-0c1faf0bde1f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:35.707246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-66f50dcd-ecf3-47e3-9e7b-0c1faf0bde1f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:35.715717 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-66f50dcd-ecf3-47e3-9e7b-0c1faf0bde1f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1512 microversion: 2.1 time: 0.428694 Mar 12 21:02:35.722367 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2576/3344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:35 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:35.730516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96b8249a-74f6-4da0-8f11-ec29e9196fcc tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:35.738251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96b8249a-74f6-4da0-8f11-ec29e9196fcc tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:35.745757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96b8249a-74f6-4da0-8f11-ec29e9196fcc tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:35.746786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96b8249a-74f6-4da0-8f11-ec29e9196fcc tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:35.748432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96b8249a-74f6-4da0-8f11-ec29e9196fcc tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:35.748894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96b8249a-74f6-4da0-8f11-ec29e9196fcc tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:36.136691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96b8249a-74f6-4da0-8f11-ec29e9196fcc tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41434befaa464ddbafdb567271a4e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734b75bbb7ab42e49c2ae070e9fd66e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:36.149469 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96b8249a-74f6-4da0-8f11-ec29e9196fcc tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553" status: 200 len: 1315 microversion: 2.1 time: 0.425428 Mar 12 21:02:36.150173 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2577/3345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:35 2022] GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:36.156995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1e610a9d-a597-4cfc-a47b-b921093955d3 req-5c45dd36-993c-462e-861f-7efaa7d8ba42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5a70e8-3738-4058-94d8-a41af23a25af", "name": "network-vif-plugged", "status": "completed", "tag": "d8e3021e-2148-4e62-8ee0-5ffe41a6253c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:36.168687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1e610a9d-a597-4cfc-a47b-b921093955d3 req-5c45dd36-993c-462e-861f-7efaa7d8ba42 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:36.169276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1e610a9d-a597-4cfc-a47b-b921093955d3 req-5c45dd36-993c-462e-861f-7efaa7d8ba42 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:36.180542 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1e610a9d-a597-4cfc-a47b-b921093955d3 req-5c45dd36-993c-462e-861f-7efaa7d8ba42 service nova] Creating event network-vif-plugged:d8e3021e-2148-4e62-8ee0-5ffe41a6253c for instance ed5a70e8-3738-4058-94d8-a41af23a25af on nch2-master-1 Mar 12 21:02:36.186400 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1e610a9d-a597-4cfc-a47b-b921093955d3 req-5c45dd36-993c-462e-861f-7efaa7d8ba42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034745 Mar 12 21:02:36.187613 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2578/3346] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:36.193562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dbc9edf1-e442-4355-8b23-40d813492a6a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:36.194686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dbc9edf1-e442-4355-8b23-40d813492a6a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:36.201165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbc9edf1-e442-4355-8b23-40d813492a6a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:36.201990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbc9edf1-e442-4355-8b23-40d813492a6a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:36.202976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbc9edf1-e442-4355-8b23-40d813492a6a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:36.203873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbc9edf1-e442-4355-8b23-40d813492a6a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:36.312897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dbc9edf1-e442-4355-8b23-40d813492a6a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:36.333468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dbc9edf1-e442-4355-8b23-40d813492a6a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:36.335336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dbc9edf1-e442-4355-8b23-40d813492a6a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:36.337326 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dbc9edf1-e442-4355-8b23-40d813492a6a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372" status: 200 len: 1320 microversion: 2.26 time: 0.148092 Mar 12 21:02:36.338365 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2579/3347] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:36 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372 => generated 1320 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:36.352611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-064a819b-348b-4f86-84c6-95fbbe9bc46c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:36.353563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-064a819b-348b-4f86-84c6-95fbbe9bc46c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:36.364068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-064a819b-348b-4f86-84c6-95fbbe9bc46c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:36.365166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-064a819b-348b-4f86-84c6-95fbbe9bc46c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:36.366389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-064a819b-348b-4f86-84c6-95fbbe9bc46c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:36.367232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-064a819b-348b-4f86-84c6-95fbbe9bc46c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:36.491840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-064a819b-348b-4f86-84c6-95fbbe9bc46c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:36.502745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-064a819b-348b-4f86-84c6-95fbbe9bc46c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:36.505380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-064a819b-348b-4f86-84c6-95fbbe9bc46c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:36.506698 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-064a819b-348b-4f86-84c6-95fbbe9bc46c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112" status: 200 len: 1335 microversion: 2.47 time: 0.167407 Mar 12 21:02:36.508551 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2580/3348] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:36 2022] GET /compute/v2.1/servers/3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112 => generated 1335 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:36.513665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b3fd3c48-4afc-485f-b595-3f41866d09bf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:36.514378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b3fd3c48-4afc-485f-b595-3f41866d09bf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:36.525078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3fd3c48-4afc-485f-b595-3f41866d09bf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:36.526060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3fd3c48-4afc-485f-b595-3f41866d09bf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:36.527280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3fd3c48-4afc-485f-b595-3f41866d09bf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:36.528082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3fd3c48-4afc-485f-b595-3f41866d09bf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:36.570637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b3fd3c48-4afc-485f-b595-3f41866d09bf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:02:36.696968 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b3fd3c48-4afc-485f-b595-3f41866d09bf tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "DELETE /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 204 len: 0 microversion: 2.1 time: 0.186813 Mar 12 21:02:36.699076 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2581/3349] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:02:36 2022] DELETE /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:02:36.705443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abf4a31f-21f3-48ec-a8b6-d0faf4c76364 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:36.706228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-abf4a31f-21f3-48ec-a8b6-d0faf4c76364 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:36.712658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abf4a31f-21f3-48ec-a8b6-d0faf4c76364 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:36.713235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abf4a31f-21f3-48ec-a8b6-d0faf4c76364 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:36.713918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abf4a31f-21f3-48ec-a8b6-d0faf4c76364 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:36.714535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abf4a31f-21f3-48ec-a8b6-d0faf4c76364 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:36.973291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-abf4a31f-21f3-48ec-a8b6-d0faf4c76364 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:36.982479 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-abf4a31f-21f3-48ec-a8b6-d0faf4c76364 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 200 len: 1363 microversion: 2.1 time: 0.282041 Mar 12 21:02:36.983294 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2582/3350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:36 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:36.990145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1844284083", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": "none"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:37.075420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:02:37.076067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:02:37.076552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:02:37.076987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:02:37.077393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:02:37.086743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:37.087191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:37.088013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:37.088448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:37.110368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Getting quotas for project 79f0629679d143289f5bc0c3e6961504. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:02:37.117439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Getting quotas for user 1357dc80ed9d4d1b8dc7871160ffa4a1 and project 79f0629679d143289f5bc0c3e6961504. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:02:37.132568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:02:37.135064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:02:37.184940 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f528b04f-a49a-40ae-bbf6-cdd66d35bfde tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.200361 Mar 12 21:02:37.185821 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2583/3351] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 21:02:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 202 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 21:02:37.191629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9d54eb3f-d07c-4713-a568-d26b6cc1f9ea tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:37.192546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9d54eb3f-d07c-4713-a568-d26b6cc1f9ea tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:37.200607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d54eb3f-d07c-4713-a568-d26b6cc1f9ea tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:37.200607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d54eb3f-d07c-4713-a568-d26b6cc1f9ea tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:37.201552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d54eb3f-d07c-4713-a568-d26b6cc1f9ea tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:37.202130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d54eb3f-d07c-4713-a568-d26b6cc1f9ea tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:37.441037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9d54eb3f-d07c-4713-a568-d26b6cc1f9ea tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:37.449699 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9d54eb3f-d07c-4713-a568-d26b6cc1f9ea tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1473 microversion: 2.1 time: 0.262481 Mar 12 21:02:37.450830 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2584/3352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:37 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1473 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:37.457214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-208eea39-3878-4dee-86ec-bb99e21f7235 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:37.457852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-208eea39-3878-4dee-86ec-bb99e21f7235 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:37.464313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-208eea39-3878-4dee-86ec-bb99e21f7235 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:37.464982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-208eea39-3878-4dee-86ec-bb99e21f7235 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:37.466582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-208eea39-3878-4dee-86ec-bb99e21f7235 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:37.467180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-208eea39-3878-4dee-86ec-bb99e21f7235 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:37.656973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-208eea39-3878-4dee-86ec-bb99e21f7235 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:37.666802 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-208eea39-3878-4dee-86ec-bb99e21f7235 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1512 microversion: 2.1 time: 0.213619 Mar 12 21:02:37.668805 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2585/3353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:37 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:37.689906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4ab9d24f-41c4-44a4-8bcb-65f417977cd6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:37.690806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4ab9d24f-41c4-44a4-8bcb-65f417977cd6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:37.698970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ab9d24f-41c4-44a4-8bcb-65f417977cd6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:37.699916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ab9d24f-41c4-44a4-8bcb-65f417977cd6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:37.700900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ab9d24f-41c4-44a4-8bcb-65f417977cd6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:37.701708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ab9d24f-41c4-44a4-8bcb-65f417977cd6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:37.915195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4ab9d24f-41c4-44a4-8bcb-65f417977cd6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41434befaa464ddbafdb567271a4e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734b75bbb7ab42e49c2ae070e9fd66e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:37.929004 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4ab9d24f-41c4-44a4-8bcb-65f417977cd6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553" status: 200 len: 1315 microversion: 2.1 time: 0.257909 Mar 12 21:02:37.930950 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2586/3354] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:37 2022] GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:37.944018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-00c6796b-9d60-4abc-bb53-a81ffd435f1e tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:37.945350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-00c6796b-9d60-4abc-bb53-a81ffd435f1e tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:37.952180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-00c6796b-9d60-4abc-bb53-a81ffd435f1e tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:37.952845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-00c6796b-9d60-4abc-bb53-a81ffd435f1e tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:37.953821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-00c6796b-9d60-4abc-bb53-a81ffd435f1e tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:37.954615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-00c6796b-9d60-4abc-bb53-a81ffd435f1e tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:38.044035 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-00c6796b-9d60-4abc-bb53-a81ffd435f1e tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "PUT /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 992 microversion: 2.47 time: 0.111387 Mar 12 21:02:38.044239 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2587/3355] 10.222.0.30 () {62 vars in 1296 bytes} [Sat Mar 12 21:02:37 2022] PUT /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 992 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 21:02:38.049713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d86b0d8a-41bd-44f7-aaac-3fb7b6dfed93 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:38.050362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d86b0d8a-41bd-44f7-aaac-3fb7b6dfed93 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:38.058081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d86b0d8a-41bd-44f7-aaac-3fb7b6dfed93 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:38.058615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d86b0d8a-41bd-44f7-aaac-3fb7b6dfed93 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:38.059428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d86b0d8a-41bd-44f7-aaac-3fb7b6dfed93 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:38.060175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d86b0d8a-41bd-44f7-aaac-3fb7b6dfed93 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:38.583267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d86b0d8a-41bd-44f7-aaac-3fb7b6dfed93 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:38.598415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d86b0d8a-41bd-44f7-aaac-3fb7b6dfed93 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:38.600302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d86b0d8a-41bd-44f7-aaac-3fb7b6dfed93 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:38.603230 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d86b0d8a-41bd-44f7-aaac-3fb7b6dfed93 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372" status: 200 len: 1362 microversion: 2.26 time: 0.558075 Mar 12 21:02:38.608697 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2588/3356] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:38 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372 => generated 1362 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:38.613798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-673f62ca-1da1-4ddf-ab42-8a7e91a80946 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:38.619850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-673f62ca-1da1-4ddf-ab42-8a7e91a80946 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:38.650870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-673f62ca-1da1-4ddf-ab42-8a7e91a80946 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:38.652495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-673f62ca-1da1-4ddf-ab42-8a7e91a80946 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:38.655312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-673f62ca-1da1-4ddf-ab42-8a7e91a80946 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:38.657360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-673f62ca-1da1-4ddf-ab42-8a7e91a80946 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:38.996874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-673f62ca-1da1-4ddf-ab42-8a7e91a80946 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:39.006663 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-673f62ca-1da1-4ddf-ab42-8a7e91a80946 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 200 len: 1549 microversion: 2.1 time: 0.396608 Mar 12 21:02:39.009275 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2589/3357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:38 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 1549 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:39.020530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e8e40f77-ebe9-4aa0-b452-d8dadda21fc4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:39.020530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e8e40f77-ebe9-4aa0-b452-d8dadda21fc4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:39.022889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8e40f77-ebe9-4aa0-b452-d8dadda21fc4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:39.023349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8e40f77-ebe9-4aa0-b452-d8dadda21fc4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:39.024135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8e40f77-ebe9-4aa0-b452-d8dadda21fc4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:39.024577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8e40f77-ebe9-4aa0-b452-d8dadda21fc4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:39.510891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8e40f77-ebe9-4aa0-b452-d8dadda21fc4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:39.522988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8e40f77-ebe9-4aa0-b452-d8dadda21fc4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:39.524984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8e40f77-ebe9-4aa0-b452-d8dadda21fc4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:39.526871 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e8e40f77-ebe9-4aa0-b452-d8dadda21fc4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1336 microversion: 2.47 time: 0.516063 Mar 12 21:02:39.527985 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2590/3358] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:39 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1336 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:39.547315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-47e5bc9f-9993-43bb-beb9-8d6e109bd38a req-5e7cc3b2-e294-4fa0-8b5b-5c7a086131f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c556d7b-e8e8-4855-b69b-f169613dc553", "name": "network-vif-plugged", "status": "completed", "tag": "4f5b8612-f343-4de5-a91d-584c3c30d79e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:39.561568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-47e5bc9f-9993-43bb-beb9-8d6e109bd38a req-5e7cc3b2-e294-4fa0-8b5b-5c7a086131f8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:39.562167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-47e5bc9f-9993-43bb-beb9-8d6e109bd38a req-5e7cc3b2-e294-4fa0-8b5b-5c7a086131f8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:39.575526 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-47e5bc9f-9993-43bb-beb9-8d6e109bd38a req-5e7cc3b2-e294-4fa0-8b5b-5c7a086131f8 service nova] Creating event network-vif-plugged:4f5b8612-f343-4de5-a91d-584c3c30d79e for instance 3c556d7b-e8e8-4855-b69b-f169613dc553 on nch1-master-1 Mar 12 21:02:39.581912 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-47e5bc9f-9993-43bb-beb9-8d6e109bd38a req-5e7cc3b2-e294-4fa0-8b5b-5c7a086131f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052161 Mar 12 21:02:39.582674 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2591/3359] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:39.590231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-efb2030b-ab71-4a69-a74c-45a7e82779d8 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:39.591305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-efb2030b-ab71-4a69-a74c-45a7e82779d8 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:39.598635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb2030b-ab71-4a69-a74c-45a7e82779d8 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:39.599456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb2030b-ab71-4a69-a74c-45a7e82779d8 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:39.601011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb2030b-ab71-4a69-a74c-45a7e82779d8 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:39.601678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb2030b-ab71-4a69-a74c-45a7e82779d8 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:40.020700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-efb2030b-ab71-4a69-a74c-45a7e82779d8 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:40.030334 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-efb2030b-ab71-4a69-a74c-45a7e82779d8 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 200 len: 1473 microversion: 2.1 time: 0.446110 Mar 12 21:02:40.041668 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2592/3360] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:39 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 1473 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:40.050131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23d222f5-b086-4128-bee8-17ce708bfcc5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:40.051046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-23d222f5-b086-4128-bee8-17ce708bfcc5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:40.058830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23d222f5-b086-4128-bee8-17ce708bfcc5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:40.059578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23d222f5-b086-4128-bee8-17ce708bfcc5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:40.061340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23d222f5-b086-4128-bee8-17ce708bfcc5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:40.062013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23d222f5-b086-4128-bee8-17ce708bfcc5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:40.408551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-23d222f5-b086-4128-bee8-17ce708bfcc5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:40.425806 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-23d222f5-b086-4128-bee8-17ce708bfcc5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1512 microversion: 2.1 time: 0.381680 Mar 12 21:02:40.428464 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2593/3361] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:40 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1512 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:40.436946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-58272eed-5245-4d3d-9db8-7e6d943086d2 req-47d7e4c2-f0d2-4374-b61a-17b77320ee85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a7c3505-989f-4f59-b060-11e2ce22b372", "tag": "63ab797e-dfe9-4b71-80bf-e1b91d9518a0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:40.447897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-58272eed-5245-4d3d-9db8-7e6d943086d2 req-47d7e4c2-f0d2-4374-b61a-17b77320ee85 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:40.448357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-58272eed-5245-4d3d-9db8-7e6d943086d2 req-47d7e4c2-f0d2-4374-b61a-17b77320ee85 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:40.468272 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-58272eed-5245-4d3d-9db8-7e6d943086d2 req-47d7e4c2-f0d2-4374-b61a-17b77320ee85 service nova] Creating event network-changed:63ab797e-dfe9-4b71-80bf-e1b91d9518a0 for instance 2a7c3505-989f-4f59-b060-11e2ce22b372 on nch2-master-1 Mar 12 21:02:40.483802 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-58272eed-5245-4d3d-9db8-7e6d943086d2 req-47d7e4c2-f0d2-4374-b61a-17b77320ee85 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054056 Mar 12 21:02:40.485525 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2594/3362] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:40.491601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-93ebae42-57e3-4de4-aaaa-71c98ab3f50d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:40.492717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-93ebae42-57e3-4de4-aaaa-71c98ab3f50d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:40.500811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93ebae42-57e3-4de4-aaaa-71c98ab3f50d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:40.501635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93ebae42-57e3-4de4-aaaa-71c98ab3f50d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:40.502654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93ebae42-57e3-4de4-aaaa-71c98ab3f50d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:40.503262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93ebae42-57e3-4de4-aaaa-71c98ab3f50d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:40.884452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-93ebae42-57e3-4de4-aaaa-71c98ab3f50d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41434befaa464ddbafdb567271a4e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734b75bbb7ab42e49c2ae070e9fd66e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:40.896658 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-93ebae42-57e3-4de4-aaaa-71c98ab3f50d tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553" status: 200 len: 1315 microversion: 2.1 time: 0.409422 Mar 12 21:02:40.898597 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2595/3363] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:40 2022] GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:40.914551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7971d500-4cbd-41b6-b646-add4dc5d54e1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:40.916934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7971d500-4cbd-41b6-b646-add4dc5d54e1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:40.926134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7971d500-4cbd-41b6-b646-add4dc5d54e1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:40.927963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7971d500-4cbd-41b6-b646-add4dc5d54e1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:40.928928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7971d500-4cbd-41b6-b646-add4dc5d54e1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:40.929527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7971d500-4cbd-41b6-b646-add4dc5d54e1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:41.107817 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7971d500-4cbd-41b6-b646-add4dc5d54e1 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.207028 Mar 12 21:02:41.109236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2596/3364] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 21:02:40 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:41.117686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ba7c2476-3c8d-41ab-aa85-57566236d012 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:41.118803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ba7c2476-3c8d-41ab-aa85-57566236d012 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:41.138260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba7c2476-3c8d-41ab-aa85-57566236d012 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:41.138742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba7c2476-3c8d-41ab-aa85-57566236d012 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:41.140012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba7c2476-3c8d-41ab-aa85-57566236d012 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:41.140655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba7c2476-3c8d-41ab-aa85-57566236d012 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:41.751855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ba7c2476-3c8d-41ab-aa85-57566236d012 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:41.761059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ba7c2476-3c8d-41ab-aa85-57566236d012 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:41.764000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ba7c2476-3c8d-41ab-aa85-57566236d012 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:41.773350 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ba7c2476-3c8d-41ab-aa85-57566236d012 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372" status: 200 len: 1362 microversion: 2.26 time: 0.662622 Mar 12 21:02:41.785419 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2597/3365] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:41 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372 => generated 1362 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:41.795511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-cdbc295a-e34d-4636-a104-fa6f6d271cb7 req-b4da19de-676a-4504-8976-0e24fcb07e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c44039-6c03-403b-8828-046bf508b27f", "name": "network-vif-deleted", "tag": "891b1bf1-7d7e-4f05-9c62-d7d4abaf05db"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:41.807175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cdbc295a-e34d-4636-a104-fa6f6d271cb7 req-b4da19de-676a-4504-8976-0e24fcb07e11 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:41.807893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cdbc295a-e34d-4636-a104-fa6f6d271cb7 req-b4da19de-676a-4504-8976-0e24fcb07e11 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:41.822486 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-cdbc295a-e34d-4636-a104-fa6f6d271cb7 req-b4da19de-676a-4504-8976-0e24fcb07e11 service nova] Creating event network-vif-deleted:891b1bf1-7d7e-4f05-9c62-d7d4abaf05db for instance 63c44039-6c03-403b-8828-046bf508b27f on nch1-master-1 Mar 12 21:02:41.828910 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-cdbc295a-e34d-4636-a104-fa6f6d271cb7 req-b4da19de-676a-4504-8976-0e24fcb07e11 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052657 Mar 12 21:02:41.830345 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2598/3366] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:41.837185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bfb7f89d-8ce3-45c4-b035-7080fed2a367 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:41.838312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bfb7f89d-8ce3-45c4-b035-7080fed2a367 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:41.846849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfb7f89d-8ce3-45c4-b035-7080fed2a367 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:41.847575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfb7f89d-8ce3-45c4-b035-7080fed2a367 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:41.848705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfb7f89d-8ce3-45c4-b035-7080fed2a367 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:41.849321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bfb7f89d-8ce3-45c4-b035-7080fed2a367 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:41.953681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bfb7f89d-8ce3-45c4-b035-7080fed2a367 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:41.963682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bfb7f89d-8ce3-45c4-b035-7080fed2a367 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:41.965195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bfb7f89d-8ce3-45c4-b035-7080fed2a367 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:41.966407 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bfb7f89d-8ce3-45c4-b035-7080fed2a367 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1336 microversion: 2.47 time: 0.134798 Mar 12 21:02:41.969211 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2599/3367] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:41 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1336 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:41.975823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9bf23060-90e2-45b5-9650-3534b0ff7b4d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:41.976622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9bf23060-90e2-45b5-9650-3534b0ff7b4d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 63c44039-6c03-403b-8828-046bf508b27f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:41.983550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bf23060-90e2-45b5-9650-3534b0ff7b4d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:41.984240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bf23060-90e2-45b5-9650-3534b0ff7b4d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:41.985198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bf23060-90e2-45b5-9650-3534b0ff7b4d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:41.985872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bf23060-90e2-45b5-9650-3534b0ff7b4d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:42.000928 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9bf23060-90e2-45b5-9650-3534b0ff7b4d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] HTTP exception thrown: Instance 63c44039-6c03-403b-8828-046bf508b27f could not be found. Mar 12 21:02:42.006753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9bf23060-90e2-45b5-9650-3534b0ff7b4d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Returning 404 to user: Instance 63c44039-6c03-403b-8828-046bf508b27f could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:02:42.009047 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9bf23060-90e2-45b5-9650-3534b0ff7b4d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f" status: 404 len: 111 microversion: 2.1 time: 0.036423 Mar 12 21:02:42.010194 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2600/3368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:41 2022] GET /compute/v2.1/servers/63c44039-6c03-403b-8828-046bf508b27f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:02:42.018390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5506ab2e-126f-4fc0-8b48-37370b45f056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:42.021339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5506ab2e-126f-4fc0-8b48-37370b45f056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:42.032332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5506ab2e-126f-4fc0-8b48-37370b45f056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:42.033382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5506ab2e-126f-4fc0-8b48-37370b45f056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:42.036238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5506ab2e-126f-4fc0-8b48-37370b45f056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:42.036699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5506ab2e-126f-4fc0-8b48-37370b45f056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:42.879941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5506ab2e-126f-4fc0-8b48-37370b45f056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:42.887580 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5506ab2e-126f-4fc0-8b48-37370b45f056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1512 microversion: 2.1 time: 0.875469 Mar 12 21:02:42.897413 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2601/3369] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:42 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1512 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:42.902832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1baa706a-d1e5-42f9-9c41-196d0a7065e9 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:42.903654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1baa706a-d1e5-42f9-9c41-196d0a7065e9 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:42.910014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1baa706a-d1e5-42f9-9c41-196d0a7065e9 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:42.910689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1baa706a-d1e5-42f9-9c41-196d0a7065e9 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:42.911651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1baa706a-d1e5-42f9-9c41-196d0a7065e9 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:42.912262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1baa706a-d1e5-42f9-9c41-196d0a7065e9 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:43.322608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1baa706a-d1e5-42f9-9c41-196d0a7065e9 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41434befaa464ddbafdb567271a4e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734b75bbb7ab42e49c2ae070e9fd66e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:43.331474 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1baa706a-d1e5-42f9-9c41-196d0a7065e9 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553" status: 200 len: 1503 microversion: 2.1 time: 0.432418 Mar 12 21:02:43.332734 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2602/3370] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:42 2022] GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553 => generated 1503 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:43.337993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7e84b53e-4358-4a33-83c7-2f2109637fed tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:43.338740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7e84b53e-4358-4a33-83c7-2f2109637fed tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 8d0b657b-019a-495b-bf10-0b27962e3880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:43.348172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e84b53e-4358-4a33-83c7-2f2109637fed tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:43.348875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e84b53e-4358-4a33-83c7-2f2109637fed tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:43.349900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e84b53e-4358-4a33-83c7-2f2109637fed tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:43.350549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e84b53e-4358-4a33-83c7-2f2109637fed tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:43.405908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7e84b53e-4358-4a33-83c7-2f2109637fed tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 8d0b657b-019a-495b-bf10-0b27962e3880] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:02:43.544145 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7e84b53e-4358-4a33-83c7-2f2109637fed tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880" status: 204 len: 0 microversion: 2.1 time: 0.209919 Mar 12 21:02:43.544714 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2603/3371] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:02:43 2022] DELETE /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:02:43.557291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f6cb212-6969-4f74-9aa1-5a9b4194dd37 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:43.558164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f6cb212-6969-4f74-9aa1-5a9b4194dd37 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:43.566647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f6cb212-6969-4f74-9aa1-5a9b4194dd37 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:43.567116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f6cb212-6969-4f74-9aa1-5a9b4194dd37 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:43.567973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f6cb212-6969-4f74-9aa1-5a9b4194dd37 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:43.568422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f6cb212-6969-4f74-9aa1-5a9b4194dd37 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:43.897500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f6cb212-6969-4f74-9aa1-5a9b4194dd37 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:43.910827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f6cb212-6969-4f74-9aa1-5a9b4194dd37 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:43.916103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f6cb212-6969-4f74-9aa1-5a9b4194dd37 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:43.917826 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f6cb212-6969-4f74-9aa1-5a9b4194dd37 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372" status: 200 len: 1362 microversion: 2.26 time: 0.371788 Mar 12 21:02:43.926135 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2604/3372] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:43 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372 => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:43.932029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-50a7fdd5-1628-4b81-942a-84370c538d6c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:43.932894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-50a7fdd5-1628-4b81-942a-84370c538d6c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:43.942120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50a7fdd5-1628-4b81-942a-84370c538d6c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:43.942845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50a7fdd5-1628-4b81-942a-84370c538d6c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:43.943886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50a7fdd5-1628-4b81-942a-84370c538d6c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:43.944551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50a7fdd5-1628-4b81-942a-84370c538d6c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:44.036297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-50a7fdd5-1628-4b81-942a-84370c538d6c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:44.050551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-50a7fdd5-1628-4b81-942a-84370c538d6c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:44.052111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-50a7fdd5-1628-4b81-942a-84370c538d6c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:44.053337 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-50a7fdd5-1628-4b81-942a-84370c538d6c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1357 microversion: 2.47 time: 0.125922 Mar 12 21:02:44.066841 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2605/3373] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:43 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1357 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:44.066841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab3ec5b9-edc9-41ee-a911-faa15a5b6efe tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:44.066841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ab3ec5b9-edc9-41ee-a911-faa15a5b6efe tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:44.066841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab3ec5b9-edc9-41ee-a911-faa15a5b6efe tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:44.066841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab3ec5b9-edc9-41ee-a911-faa15a5b6efe tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:44.066841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab3ec5b9-edc9-41ee-a911-faa15a5b6efe tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:44.066841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab3ec5b9-edc9-41ee-a911-faa15a5b6efe tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:44.176081 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ab3ec5b9-edc9-41ee-a911-faa15a5b6efe tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.120397 Mar 12 21:02:44.177208 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2606/3374] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Mar 12 21:02:44 2022] DELETE /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553/os-server-password => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:02:44.185391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-deda493c-80ab-42a1-be68-57da44a7b4c5 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:44.186703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-deda493c-80ab-42a1-be68-57da44a7b4c5 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 8d0b657b-019a-495b-bf10-0b27962e3880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:44.197906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-deda493c-80ab-42a1-be68-57da44a7b4c5 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:44.198815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-deda493c-80ab-42a1-be68-57da44a7b4c5 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:44.200353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-deda493c-80ab-42a1-be68-57da44a7b4c5 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:44.201110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-deda493c-80ab-42a1-be68-57da44a7b4c5 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:44.433587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-deda493c-80ab-42a1-be68-57da44a7b4c5 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:44.442234 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-deda493c-80ab-42a1-be68-57da44a7b4c5 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880" status: 200 len: 1473 microversion: 2.1 time: 0.263518 Mar 12 21:02:44.442758 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2607/3375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:44 2022] GET /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880 => generated 1473 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:44.457331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4caf3bb9-e1e0-4e84-ad1f-3db37818bf2a req-7946a21a-e042-48fe-a8b5-4aa238385bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5a70e8-3738-4058-94d8-a41af23a25af", "tag": "d8e3021e-2148-4e62-8ee0-5ffe41a6253c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:44.466081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4caf3bb9-e1e0-4e84-ad1f-3db37818bf2a req-7946a21a-e042-48fe-a8b5-4aa238385bd6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:44.466547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4caf3bb9-e1e0-4e84-ad1f-3db37818bf2a req-7946a21a-e042-48fe-a8b5-4aa238385bd6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:44.479961 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4caf3bb9-e1e0-4e84-ad1f-3db37818bf2a req-7946a21a-e042-48fe-a8b5-4aa238385bd6 service nova] Creating event network-changed:d8e3021e-2148-4e62-8ee0-5ffe41a6253c for instance ed5a70e8-3738-4058-94d8-a41af23a25af on nch2-master-1 Mar 12 21:02:44.495505 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4caf3bb9-e1e0-4e84-ad1f-3db37818bf2a req-7946a21a-e042-48fe-a8b5-4aa238385bd6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046948 Mar 12 21:02:44.497110 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2608/3376] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:44.517639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-816c7397-86de-414f-ae98-21235bf53133 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:44.518443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-816c7397-86de-414f-ae98-21235bf53133 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:44.526841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-816c7397-86de-414f-ae98-21235bf53133 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:44.527307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-816c7397-86de-414f-ae98-21235bf53133 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:44.528103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-816c7397-86de-414f-ae98-21235bf53133 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:44.528561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-816c7397-86de-414f-ae98-21235bf53133 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:44.908915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-816c7397-86de-414f-ae98-21235bf53133 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:44.917416 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-816c7397-86de-414f-ae98-21235bf53133 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1512 microversion: 2.1 time: 0.419612 Mar 12 21:02:44.932443 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2609/3377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:44 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:44.940644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:44.942143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:44.956107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:44.956791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:44.957755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:44.958384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:45.080192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:02:45.080686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:02:45.081676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:02:45.081981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:02:45.082469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:02:45.154697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:45.162322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:45.162964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:45.164001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:45.164705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:45.204858 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-391f9bd5-adb5-4387-90fd-2c6a18d8c398 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "POST /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c/action" status: 202 len: 1079 microversion: 2.47 time: 0.268800 Mar 12 21:02:45.216968 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2610/3378] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Mar 12 21:02:44 2022] POST /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c/action => generated 1079 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 12 21:02:45.222017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7588d21e-dd5a-49db-9a08-c72849c8061e tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:45.222642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7588d21e-dd5a-49db-9a08-c72849c8061e tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:45.229120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7588d21e-dd5a-49db-9a08-c72849c8061e tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:45.229711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7588d21e-dd5a-49db-9a08-c72849c8061e tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:45.230649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7588d21e-dd5a-49db-9a08-c72849c8061e tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:45.231185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7588d21e-dd5a-49db-9a08-c72849c8061e tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:45.274228 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7588d21e-dd5a-49db-9a08-c72849c8061e tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.056922 Mar 12 21:02:45.275295 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2611/3379] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Mar 12 21:02:45 2022] GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553/os-server-password => generated 16 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:02:45.281981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-66d5eabc-7a35-4bbd-b846-240b1adecbff tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:45.283425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-66d5eabc-7a35-4bbd-b846-240b1adecbff tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:45.290207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66d5eabc-7a35-4bbd-b846-240b1adecbff tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:45.290852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66d5eabc-7a35-4bbd-b846-240b1adecbff tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:45.291741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66d5eabc-7a35-4bbd-b846-240b1adecbff tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:45.292367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66d5eabc-7a35-4bbd-b846-240b1adecbff tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:45.544050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-66d5eabc-7a35-4bbd-b846-240b1adecbff tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:45.555761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-66d5eabc-7a35-4bbd-b846-240b1adecbff tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:45.561495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-66d5eabc-7a35-4bbd-b846-240b1adecbff tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:45.562795 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-66d5eabc-7a35-4bbd-b846-240b1adecbff tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372" status: 200 len: 1362 microversion: 2.26 time: 0.286293 Mar 12 21:02:45.566090 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2612/3380] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:45 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:45.574378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-55a15ef1-153e-4d5f-ab30-dd7540a35c5c req-9f02e872-99ef-420b-b97b-8d513fad30ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a7c3505-989f-4f59-b060-11e2ce22b372", "name": "network-vif-plugged", "status": "completed", "tag": "63ab797e-dfe9-4b71-80bf-e1b91d9518a0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:45.593529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-55a15ef1-153e-4d5f-ab30-dd7540a35c5c req-9f02e872-99ef-420b-b97b-8d513fad30ea service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:45.596059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-55a15ef1-153e-4d5f-ab30-dd7540a35c5c req-9f02e872-99ef-420b-b97b-8d513fad30ea service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:45.629326 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-55a15ef1-153e-4d5f-ab30-dd7540a35c5c req-9f02e872-99ef-420b-b97b-8d513fad30ea service nova] Creating event network-vif-plugged:63ab797e-dfe9-4b71-80bf-e1b91d9518a0 for instance 2a7c3505-989f-4f59-b060-11e2ce22b372 on nch2-master-1 Mar 12 21:02:45.638106 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-55a15ef1-153e-4d5f-ab30-dd7540a35c5c req-9f02e872-99ef-420b-b97b-8d513fad30ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070563 Mar 12 21:02:45.639203 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2613/3381] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:45.645311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0b1d7b9c-1b54-429d-962f-a21477ef6974 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:45.645311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0b1d7b9c-1b54-429d-962f-a21477ef6974 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:45.661107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b1d7b9c-1b54-429d-962f-a21477ef6974 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:45.668620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b1d7b9c-1b54-429d-962f-a21477ef6974 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:45.669454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b1d7b9c-1b54-429d-962f-a21477ef6974 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:45.669454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b1d7b9c-1b54-429d-962f-a21477ef6974 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:45.776731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0b1d7b9c-1b54-429d-962f-a21477ef6974 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:45.795141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0b1d7b9c-1b54-429d-962f-a21477ef6974 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:45.797688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0b1d7b9c-1b54-429d-962f-a21477ef6974 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:45.799725 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0b1d7b9c-1b54-429d-962f-a21477ef6974 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.159366 Mar 12 21:02:45.800713 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2614/3382] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:45 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:45.807613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8261fbc8-acb0-43fa-b226-0dc62602ab87 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:45.808339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8261fbc8-acb0-43fa-b226-0dc62602ab87 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:45.819411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8261fbc8-acb0-43fa-b226-0dc62602ab87 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:45.820887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8261fbc8-acb0-43fa-b226-0dc62602ab87 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:45.821916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8261fbc8-acb0-43fa-b226-0dc62602ab87 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:45.823120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8261fbc8-acb0-43fa-b226-0dc62602ab87 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:45.895240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8261fbc8-acb0-43fa-b226-0dc62602ab87 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:02:46.053441 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8261fbc8-acb0-43fa-b226-0dc62602ab87 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553" status: 204 len: 0 microversion: 2.1 time: 0.251294 Mar 12 21:02:46.057347 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2615/3383] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:02:45 2022] DELETE /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:02:46.062892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-374d9f95-97e8-4a59-9ccf-21328ea47210 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:46.064171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-374d9f95-97e8-4a59-9ccf-21328ea47210 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 8d0b657b-019a-495b-bf10-0b27962e3880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:46.081063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-374d9f95-97e8-4a59-9ccf-21328ea47210 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:46.081063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-374d9f95-97e8-4a59-9ccf-21328ea47210 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:46.089185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-374d9f95-97e8-4a59-9ccf-21328ea47210 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:46.089700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-374d9f95-97e8-4a59-9ccf-21328ea47210 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:46.822868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-374d9f95-97e8-4a59-9ccf-21328ea47210 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17564478f6fd4b00bcaca106cedebb61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d942347b8f249009a27f50edb0d1531', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:46.839964 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-374d9f95-97e8-4a59-9ccf-21328ea47210 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880" status: 200 len: 1473 microversion: 2.1 time: 0.781194 Mar 12 21:02:46.841516 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2616/3384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:46 2022] GET /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880 => generated 1473 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:46.848098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9adfb228-48ae-4f2b-984b-825153332a20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:46.848791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9adfb228-48ae-4f2b-984b-825153332a20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:46.855765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9adfb228-48ae-4f2b-984b-825153332a20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:46.856287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9adfb228-48ae-4f2b-984b-825153332a20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:46.857137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9adfb228-48ae-4f2b-984b-825153332a20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:46.857636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9adfb228-48ae-4f2b-984b-825153332a20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:47.350538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9adfb228-48ae-4f2b-984b-825153332a20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:47.358369 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9adfb228-48ae-4f2b-984b-825153332a20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1512 microversion: 2.1 time: 0.515715 Mar 12 21:02:47.359158 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2617/3385] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:46 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1512 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:47.364346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3e63a306-7254-4484-816b-36458d854b98 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:47.364959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3e63a306-7254-4484-816b-36458d854b98 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:47.370847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e63a306-7254-4484-816b-36458d854b98 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:47.371304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e63a306-7254-4484-816b-36458d854b98 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:47.372079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e63a306-7254-4484-816b-36458d854b98 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:47.372522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e63a306-7254-4484-816b-36458d854b98 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:47.781260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3e63a306-7254-4484-816b-36458d854b98 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41434befaa464ddbafdb567271a4e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '734b75bbb7ab42e49c2ae070e9fd66e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:47.789441 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3e63a306-7254-4484-816b-36458d854b98 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553" status: 200 len: 1509 microversion: 2.1 time: 0.429164 Mar 12 21:02:47.797681 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2618/3386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:47 2022] GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553 => generated 1509 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:47.802438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e7cb2820-c42b-4ab6-a800-f198fc907b40 req-59cad02b-e722-4bce-bfd1-1660f850f309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0b657b-019a-495b-bf10-0b27962e3880", "name": "network-vif-deleted", "tag": "ea6450b5-34ee-4f9d-8b0d-7a507ad2499d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:47.812239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e7cb2820-c42b-4ab6-a800-f198fc907b40 req-59cad02b-e722-4bce-bfd1-1660f850f309 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:47.812801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e7cb2820-c42b-4ab6-a800-f198fc907b40 req-59cad02b-e722-4bce-bfd1-1660f850f309 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:47.825739 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e7cb2820-c42b-4ab6-a800-f198fc907b40 req-59cad02b-e722-4bce-bfd1-1660f850f309 service nova] Creating event network-vif-deleted:ea6450b5-34ee-4f9d-8b0d-7a507ad2499d for instance 8d0b657b-019a-495b-bf10-0b27962e3880 on nch2-master-1 Mar 12 21:02:47.837106 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e7cb2820-c42b-4ab6-a800-f198fc907b40 req-59cad02b-e722-4bce-bfd1-1660f850f309 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045704 Mar 12 21:02:47.838171 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2619/3387] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:47.844087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b83108a-1807-4c52-8c37-5472d81563ed tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:47.845514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b83108a-1807-4c52-8c37-5472d81563ed tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:47.853191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b83108a-1807-4c52-8c37-5472d81563ed tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:47.854153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b83108a-1807-4c52-8c37-5472d81563ed tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:47.855001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b83108a-1807-4c52-8c37-5472d81563ed tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:47.855620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b83108a-1807-4c52-8c37-5472d81563ed tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:48.185494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b83108a-1807-4c52-8c37-5472d81563ed tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:48.197015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b83108a-1807-4c52-8c37-5472d81563ed tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:48.198771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b83108a-1807-4c52-8c37-5472d81563ed tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:48.200376 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b83108a-1807-4c52-8c37-5472d81563ed tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372" status: 200 len: 1545 microversion: 2.26 time: 0.360706 Mar 12 21:02:48.201151 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2620/3388] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:47 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372 => generated 1545 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:48.206556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90041861-c026-4741-ace0-975e64c9c2d9 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:48.207360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90041861-c026-4741-ace0-975e64c9c2d9 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:48.213647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90041861-c026-4741-ace0-975e64c9c2d9 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:48.214157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90041861-c026-4741-ace0-975e64c9c2d9 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:48.215220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90041861-c026-4741-ace0-975e64c9c2d9 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:48.215833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90041861-c026-4741-ace0-975e64c9c2d9 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:48.303266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90041861-c026-4741-ace0-975e64c9c2d9 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:48.319745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90041861-c026-4741-ace0-975e64c9c2d9 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:48.322392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90041861-c026-4741-ace0-975e64c9c2d9 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:48.325273 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90041861-c026-4741-ace0-975e64c9c2d9 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.122068 Mar 12 21:02:48.325461 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2621/3389] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:48 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:48.331276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-122d8d29-e53e-4b87-8bd6-6664197d4a37 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:48.332147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-122d8d29-e53e-4b87-8bd6-6664197d4a37 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] [instance: 8d0b657b-019a-495b-bf10-0b27962e3880] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:48.350888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-122d8d29-e53e-4b87-8bd6-6664197d4a37 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:48.351556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-122d8d29-e53e-4b87-8bd6-6664197d4a37 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:48.352445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-122d8d29-e53e-4b87-8bd6-6664197d4a37 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:48.353103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-122d8d29-e53e-4b87-8bd6-6664197d4a37 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:48.371221 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-122d8d29-e53e-4b87-8bd6-6664197d4a37 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] HTTP exception thrown: Instance 8d0b657b-019a-495b-bf10-0b27962e3880 could not be found. Mar 12 21:02:48.371472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-122d8d29-e53e-4b87-8bd6-6664197d4a37 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Returning 404 to user: Instance 8d0b657b-019a-495b-bf10-0b27962e3880 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:02:48.372569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-122d8d29-e53e-4b87-8bd6-6664197d4a37 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "GET /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880" status: 404 len: 111 microversion: 2.1 time: 0.046120 Mar 12 21:02:48.374009 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2622/3390] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:48 2022] GET /compute/v2.1/servers/8d0b657b-019a-495b-bf10-0b27962e3880 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:02:48.381359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e36cf1940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:48.397063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:48.398029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:48.398549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:48.406217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:48.406924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:48.407865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:48.408299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:48.442326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:48.442702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:48.470137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:48.470543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:48.522754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:48.558333 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c2e284c-d4d5-46e3-ba14-12793bf6dc49 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-1284332424" status: 201 len: 0 microversion: 2.26 time: 0.182642 Mar 12 21:02:48.559556 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2623/3391] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Mar 12 21:02:48 2022] PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-1284332424 => generated 0 bytes in 185 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Mar 12 21:02:48.565368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12dabe40-569a-4049-9fe0-011f0f80ff43 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:48.566172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-12dabe40-569a-4049-9fe0-011f0f80ff43 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:48.575478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12dabe40-569a-4049-9fe0-011f0f80ff43 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:48.576062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12dabe40-569a-4049-9fe0-011f0f80ff43 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:48.576947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12dabe40-569a-4049-9fe0-011f0f80ff43 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:48.581951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12dabe40-569a-4049-9fe0-011f0f80ff43 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:48.993225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-12dabe40-569a-4049-9fe0-011f0f80ff43 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:49.006096 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-12dabe40-569a-4049-9fe0-011f0f80ff43 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1512 microversion: 2.1 time: 0.445220 Mar 12 21:02:49.006699 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2624/3392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:48 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:49.025502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3d94be59-4680-4597-b518-652351d03f09 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e3725ec10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:49.398274 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3d94be59-4680-4597-b518-652351d03f09 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "DELETE /compute/v2.1/images/e71b20ad-bce8-4da5-9a81-2038867e1de0" status: 204 len: 0 microversion: 2.1 time: 0.381126 Mar 12 21:02:49.398876 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2625/3393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:49 2022] DELETE /compute/v2.1/images/e71b20ad-bce8-4da5-9a81-2038867e1de0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:02:49.405594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b8298c0-2c7b-4aea-aa8e-19fcbd3f11eb tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e36cafd30>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:49.421507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b8298c0-2c7b-4aea-aa8e-19fcbd3f11eb tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:49.431149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b8298c0-2c7b-4aea-aa8e-19fcbd3f11eb tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:49.458707 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b8298c0-2c7b-4aea-aa8e-19fcbd3f11eb tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-1284332424" status: 204 len: 0 microversion: 2.26 time: 0.058478 Mar 12 21:02:49.459358 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2626/3394] 10.222.0.30 () {60 vars in 1360 bytes} [Sat Mar 12 21:02:49 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-1284332424 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:02:49.466917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-88af2ba4-bd47-453d-8fd5-4db9f724c5e6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:49.467776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-88af2ba4-bd47-453d-8fd5-4db9f724c5e6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] [instance: 3c556d7b-e8e8-4855-b69b-f169613dc553] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:49.474685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88af2ba4-bd47-453d-8fd5-4db9f724c5e6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:49.475354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88af2ba4-bd47-453d-8fd5-4db9f724c5e6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:49.476346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88af2ba4-bd47-453d-8fd5-4db9f724c5e6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:49.477306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88af2ba4-bd47-453d-8fd5-4db9f724c5e6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:49.494595 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-88af2ba4-bd47-453d-8fd5-4db9f724c5e6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] HTTP exception thrown: Instance 3c556d7b-e8e8-4855-b69b-f169613dc553 could not be found. Mar 12 21:02:49.495494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-88af2ba4-bd47-453d-8fd5-4db9f724c5e6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] Returning 404 to user: Instance 3c556d7b-e8e8-4855-b69b-f169613dc553 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:02:49.496522 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-88af2ba4-bd47-453d-8fd5-4db9f724c5e6 tempest-ServerPasswordTestJSON-2105037099 tempest-ServerPasswordTestJSON-2105037099-project] 10.222.0.30 "GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553" status: 404 len: 111 microversion: 2.1 time: 0.033921 Mar 12 21:02:49.497881 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2627/3395] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:49 2022] GET /compute/v2.1/servers/3c556d7b-e8e8-4855-b69b-f169613dc553 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:02:49.503200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d01f4bce-f3c2-42d1-b9f5-8f0a025ebe1e req-9cea4586-9f30-491e-91fd-ed0dad7d6df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c556d7b-e8e8-4855-b69b-f169613dc553", "name": "network-vif-deleted", "tag": "4f5b8612-f343-4de5-a91d-584c3c30d79e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:49.512179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d01f4bce-f3c2-42d1-b9f5-8f0a025ebe1e req-9cea4586-9f30-491e-91fd-ed0dad7d6df2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:49.512921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d01f4bce-f3c2-42d1-b9f5-8f0a025ebe1e req-9cea4586-9f30-491e-91fd-ed0dad7d6df2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:49.537226 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d01f4bce-f3c2-42d1-b9f5-8f0a025ebe1e req-9cea4586-9f30-491e-91fd-ed0dad7d6df2 service nova] Creating event network-vif-deleted:4f5b8612-f343-4de5-a91d-584c3c30d79e for instance 3c556d7b-e8e8-4855-b69b-f169613dc553 on nch1-master-1 Mar 12 21:02:49.549043 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d01f4bce-f3c2-42d1-b9f5-8f0a025ebe1e req-9cea4586-9f30-491e-91fd-ed0dad7d6df2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049048 Mar 12 21:02:49.550294 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2628/3396] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:49.559040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-474a9d2b-a968-4696-b451-22ee199a6ce7 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:49.561207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-474a9d2b-a968-4696-b451-22ee199a6ce7 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:49.571567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-474a9d2b-a968-4696-b451-22ee199a6ce7 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:49.572078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-474a9d2b-a968-4696-b451-22ee199a6ce7 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:49.572932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-474a9d2b-a968-4696-b451-22ee199a6ce7 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:49.573562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-474a9d2b-a968-4696-b451-22ee199a6ce7 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:49.660510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-474a9d2b-a968-4696-b451-22ee199a6ce7 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:49.678928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-474a9d2b-a968-4696-b451-22ee199a6ce7 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:49.680925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-474a9d2b-a968-4696-b451-22ee199a6ce7 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:49.682856 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-474a9d2b-a968-4696-b451-22ee199a6ce7 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.130031 Mar 12 21:02:49.684071 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2629/3397] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:49 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:49.691538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ac874ffe-9324-479f-825a-7e48a1a36891 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e36f3cc10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:50.027998 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ac874ffe-9324-479f-825a-7e48a1a36891 tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "DELETE /compute/v2.1/images/7a1b7cf6-6ca8-49d5-babb-4099bb61b286" status: 204 len: 0 microversion: 2.1 time: 0.342186 Mar 12 21:02:50.028576 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2630/3398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:49 2022] DELETE /compute/v2.1/images/7a1b7cf6-6ca8-49d5-babb-4099bb61b286 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:02:50.035056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd6a7c21-079c-45a4-9acc-a92cebf05fc3 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e44020790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:50.043690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd6a7c21-079c-45a4-9acc-a92cebf05fc3 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:50.044427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd6a7c21-079c-45a4-9acc-a92cebf05fc3 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:50.045407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd6a7c21-079c-45a4-9acc-a92cebf05fc3 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:50.053210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd6a7c21-079c-45a4-9acc-a92cebf05fc3 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:50.053874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd6a7c21-079c-45a4-9acc-a92cebf05fc3 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:50.055298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd6a7c21-079c-45a4-9acc-a92cebf05fc3 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:50.055902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd6a7c21-079c-45a4-9acc-a92cebf05fc3 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:50.084352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd6a7c21-079c-45a4-9acc-a92cebf05fc3 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:50.085084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd6a7c21-079c-45a4-9acc-a92cebf05fc3 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:50.106693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-fd6a7c21-079c-45a4-9acc-a92cebf05fc3 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:50.122954 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd6a7c21-079c-45a4-9acc-a92cebf05fc3 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags" status: 204 len: 0 microversion: 2.26 time: 0.093108 Mar 12 21:02:50.123808 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2631/3399] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Mar 12 21:02:50 2022] DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:02:50.132661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3efacb0-c595-4324-b683-26a92d30ac9f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:50.133514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c3efacb0-c595-4324-b683-26a92d30ac9f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:50.139825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3efacb0-c595-4324-b683-26a92d30ac9f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:50.140521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3efacb0-c595-4324-b683-26a92d30ac9f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:50.141457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3efacb0-c595-4324-b683-26a92d30ac9f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:50.142618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3efacb0-c595-4324-b683-26a92d30ac9f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:50.832577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c3efacb0-c595-4324-b683-26a92d30ac9f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:50.842397 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3efacb0-c595-4324-b683-26a92d30ac9f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1512 microversion: 2.1 time: 0.717357 Mar 12 21:02:50.844769 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2632/3400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:50 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1512 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:50.849528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ceb6da69-2bec-4ca4-b224-aec49ca14e5d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] Calling method '.version_select at 0x7f6e440baca0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:51.448750 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ceb6da69-2bec-4ca4-b224-aec49ca14e5d tempest-ListImageFiltersTestJSON-146189422 tempest-ListImageFiltersTestJSON-146189422-project] 10.222.0.30 "DELETE /compute/v2.1/images/1387d1dc-a1f8-4058-b1f0-52d9acd1be3c" status: 204 len: 0 microversion: 2.1 time: 0.602687 Mar 12 21:02:51.449343 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2633/3401] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:50 2022] DELETE /compute/v2.1/images/1387d1dc-a1f8-4058-b1f0-52d9acd1be3c => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:02:51.458551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f8e8db92-0a75-4208-a4d0-dbd0633a2ca6 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e36caf040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:51.495777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8e8db92-0a75-4208-a4d0-dbd0633a2ca6 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:51.500600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8e8db92-0a75-4208-a4d0-dbd0633a2ca6 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:51.532732 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f8e8db92-0a75-4208-a4d0-dbd0633a2ca6 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags" status: 200 len: 12 microversion: 2.26 time: 0.078606 Mar 12 21:02:51.539493 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2634/3402] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Mar 12 21:02:51 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags => generated 12 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:51.551678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-02e6e342-2ab2-4b4e-bc43-172d43c18f0c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:51.554040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-02e6e342-2ab2-4b4e-bc43-172d43c18f0c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:51.567530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02e6e342-2ab2-4b4e-bc43-172d43c18f0c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:51.568319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02e6e342-2ab2-4b4e-bc43-172d43c18f0c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:51.569303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02e6e342-2ab2-4b4e-bc43-172d43c18f0c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:51.569993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02e6e342-2ab2-4b4e-bc43-172d43c18f0c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:51.784443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-02e6e342-2ab2-4b4e-bc43-172d43c18f0c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:51.807703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-02e6e342-2ab2-4b4e-bc43-172d43c18f0c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:51.811011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-02e6e342-2ab2-4b4e-bc43-172d43c18f0c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:51.812524 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-02e6e342-2ab2-4b4e-bc43-172d43c18f0c tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.271697 Mar 12 21:02:51.813991 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2635/3403] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:51 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:51.820387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e356a3f70>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:51.861515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:51.862245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:51.862601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:51.869784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:51.870449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:51.871403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:51.872024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:51.912500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:51.912500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:51.937949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:51.938436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:51.981943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:52.004786 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e12d8e3b-2225-454f-8be2-807cd3c4d5e4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-2113225181" status: 201 len: 0 microversion: 2.26 time: 0.189401 Mar 12 21:02:52.009674 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2636/3404] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Mar 12 21:02:51 2022] PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-2113225181 => generated 0 bytes in 191 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Mar 12 21:02:52.015655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16882b85-0745-404e-af94-08e3b54a126f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:52.016384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16882b85-0745-404e-af94-08e3b54a126f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:52.024314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16882b85-0745-404e-af94-08e3b54a126f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.024857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16882b85-0745-404e-af94-08e3b54a126f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.026281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16882b85-0745-404e-af94-08e3b54a126f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.026810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16882b85-0745-404e-af94-08e3b54a126f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.382035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16882b85-0745-404e-af94-08e3b54a126f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:52.392640 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16882b85-0745-404e-af94-08e3b54a126f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1512 microversion: 2.1 time: 0.384888 Mar 12 21:02:52.393257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2637/3405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:52 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1512 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:52.406135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1d8a739a-d6d7-4d0a-868e-7e27a487e543 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e36f9bb80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:52.426932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d8a739a-d6d7-4d0a-868e-7e27a487e543 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.427960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d8a739a-d6d7-4d0a-868e-7e27a487e543 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.451862 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1d8a739a-d6d7-4d0a-868e-7e27a487e543 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags" status: 200 len: 36 microversion: 2.26 time: 0.057487 Mar 12 21:02:52.452493 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2638/3406] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Mar 12 21:02:52 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags => generated 36 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:52.469689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c4e11706-d72e-4670-9ae0-e0c9372f274d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e356a3280>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:52.483239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4e11706-d72e-4670-9ae0-e0c9372f274d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.483701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4e11706-d72e-4670-9ae0-e0c9372f274d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.484188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c4e11706-d72e-4670-9ae0-e0c9372f274d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:52.500700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4e11706-d72e-4670-9ae0-e0c9372f274d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.501727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4e11706-d72e-4670-9ae0-e0c9372f274d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.505809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4e11706-d72e-4670-9ae0-e0c9372f274d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.506017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4e11706-d72e-4670-9ae0-e0c9372f274d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.538671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4e11706-d72e-4670-9ae0-e0c9372f274d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.539500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4e11706-d72e-4670-9ae0-e0c9372f274d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.585335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-c4e11706-d72e-4670-9ae0-e0c9372f274d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:52.609257 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c4e11706-d72e-4670-9ae0-e0c9372f274d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-2113225181" status: 204 len: 0 microversion: 2.26 time: 0.149998 Mar 12 21:02:52.614038 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2639/3407] 10.222.0.30 () {60 vars in 1363 bytes} [Sat Mar 12 21:02:52 2022] DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-2113225181 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:02:52.620237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-61027028-645d-4f91-8055-86659317a9a4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e36ed2ca0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:52.633556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61027028-645d-4f91-8055-86659317a9a4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.634347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61027028-645d-4f91-8055-86659317a9a4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.645313 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-61027028-645d-4f91-8055-86659317a9a4 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags" status: 200 len: 12 microversion: 2.26 time: 0.029832 Mar 12 21:02:52.651823 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2640/3408] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Mar 12 21:02:52 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:52.657673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c1ac99f-e623-404b-b4e5-aed4c2bd0ea0 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e36d46040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:52.666555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1ac99f-e623-404b-b4e5-aed4c2bd0ea0 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.667445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1ac99f-e623-404b-b4e5-aed4c2bd0ea0 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.668161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c1ac99f-e623-404b-b4e5-aed4c2bd0ea0 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:52.676910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1ac99f-e623-404b-b4e5-aed4c2bd0ea0 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.677611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1ac99f-e623-404b-b4e5-aed4c2bd0ea0 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.678917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1ac99f-e623-404b-b4e5-aed4c2bd0ea0 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.679591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1ac99f-e623-404b-b4e5-aed4c2bd0ea0 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.712208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1ac99f-e623-404b-b4e5-aed4c2bd0ea0 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.713153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1ac99f-e623-404b-b4e5-aed4c2bd0ea0 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.726223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-3c1ac99f-e623-404b-b4e5-aed4c2bd0ea0 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:52.743023 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c1ac99f-e623-404b-b4e5-aed4c2bd0ea0 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags" status: 204 len: 0 microversion: 2.26 time: 0.089628 Mar 12 21:02:52.748794 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2641/3409] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Mar 12 21:02:52 2022] DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:02:52.755248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e36fa4820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:52.765870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.766642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.767377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:52.775174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.775962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.777054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.777867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.807574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.808023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.818606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.819144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.854708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:52.876795 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b598aa89-828b-4bfd-87f8-58d6c8012277 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-236042184" status: 201 len: 0 microversion: 2.26 time: 0.126075 Mar 12 21:02:52.878650 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2642/3410] 10.222.0.30 () {62 vars in 1376 bytes} [Sat Mar 12 21:02:52 2022] PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-236042184 => generated 0 bytes in 129 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Mar 12 21:02:52.884724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0b8617ec-0857-4560-b53a-ef826bd4eeaf tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:52.885652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0b8617ec-0857-4560-b53a-ef826bd4eeaf tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:52.896221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b8617ec-0857-4560-b53a-ef826bd4eeaf tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.897009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b8617ec-0857-4560-b53a-ef826bd4eeaf tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:52.898477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b8617ec-0857-4560-b53a-ef826bd4eeaf tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:52.899221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b8617ec-0857-4560-b53a-ef826bd4eeaf tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.041068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0b8617ec-0857-4560-b53a-ef826bd4eeaf tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:53.056960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0b8617ec-0857-4560-b53a-ef826bd4eeaf tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:53.060295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0b8617ec-0857-4560-b53a-ef826bd4eeaf tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:53.066150 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0b8617ec-0857-4560-b53a-ef826bd4eeaf tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.184737 Mar 12 21:02:53.081483 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2643/3411] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:52 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:53.091404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e362539d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:53.105880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:53.106816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.107507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:53.115569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:53.116230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.117231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:53.118610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.169166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:53.169632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.186090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:53.186529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.237281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:53.304313 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d228a5f-6071-4918-9f0b-49e8bd3898be tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-74336516" status: 201 len: 0 microversion: 2.26 time: 0.219841 Mar 12 21:02:53.305048 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2644/3412] 10.222.0.30 () {62 vars in 1373 bytes} [Sat Mar 12 21:02:53 2022] PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-74336516 => generated 0 bytes in 223 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Mar 12 21:02:53.328271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f53728a7-9673-4d92-93ba-40dd79b1a21d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e36f3c160>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:53.338867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f53728a7-9673-4d92-93ba-40dd79b1a21d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:53.339595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f53728a7-9673-4d92-93ba-40dd79b1a21d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.340242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f53728a7-9673-4d92-93ba-40dd79b1a21d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:53.348808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f53728a7-9673-4d92-93ba-40dd79b1a21d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:53.349959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f53728a7-9673-4d92-93ba-40dd79b1a21d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.351456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f53728a7-9673-4d92-93ba-40dd79b1a21d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:53.352272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f53728a7-9673-4d92-93ba-40dd79b1a21d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.385074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f53728a7-9673-4d92-93ba-40dd79b1a21d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:53.386168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f53728a7-9673-4d92-93ba-40dd79b1a21d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.413695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-f53728a7-9673-4d92-93ba-40dd79b1a21d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:53.436182 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f53728a7-9673-4d92-93ba-40dd79b1a21d tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags" status: 204 len: 0 microversion: 2.26 time: 0.118771 Mar 12 21:02:53.441470 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2645/3413] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Mar 12 21:02:53 2022] DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:02:53.449262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc960913-938a-47d5-a032-8f95f68e5040 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:53.450475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc960913-938a-47d5-a032-8f95f68e5040 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:53.468521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc960913-938a-47d5-a032-8f95f68e5040 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:53.468991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc960913-938a-47d5-a032-8f95f68e5040 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.478145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc960913-938a-47d5-a032-8f95f68e5040 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:53.478625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc960913-938a-47d5-a032-8f95f68e5040 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.940496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc960913-938a-47d5-a032-8f95f68e5040 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:53.952577 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc960913-938a-47d5-a032-8f95f68e5040 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1512 microversion: 2.1 time: 0.507427 Mar 12 21:02:53.954523 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2646/3414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:53 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1512 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:53.969184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d7569e18-48b6-473e-9eee-987d3c3a24ec tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e36f3caf0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:53.976894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7569e18-48b6-473e-9eee-987d3c3a24ec tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:53.977615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7569e18-48b6-473e-9eee-987d3c3a24ec tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:53.987524 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d7569e18-48b6-473e-9eee-987d3c3a24ec tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags" status: 200 len: 12 microversion: 2.26 time: 0.027977 Mar 12 21:02:53.993242 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2647/3415] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Mar 12 21:02:53 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:53.998943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4a22e2dd-0f32-49c9-8a82-8abfffea07c9 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e35690160>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:54.010633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a22e2dd-0f32-49c9-8a82-8abfffea07c9 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.011370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a22e2dd-0f32-49c9-8a82-8abfffea07c9 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.012017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4a22e2dd-0f32-49c9-8a82-8abfffea07c9 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:54.017960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a22e2dd-0f32-49c9-8a82-8abfffea07c9 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.018616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a22e2dd-0f32-49c9-8a82-8abfffea07c9 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.019551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a22e2dd-0f32-49c9-8a82-8abfffea07c9 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.020148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a22e2dd-0f32-49c9-8a82-8abfffea07c9 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.048832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a22e2dd-0f32-49c9-8a82-8abfffea07c9 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.049565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a22e2dd-0f32-49c9-8a82-8abfffea07c9 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.063980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-4a22e2dd-0f32-49c9-8a82-8abfffea07c9 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:54.083969 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4a22e2dd-0f32-49c9-8a82-8abfffea07c9 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags" status: 204 len: 0 microversion: 2.26 time: 0.089331 Mar 12 21:02:54.090691 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2648/3416] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Mar 12 21:02:53 2022] DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:02:54.096678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be8ef4c6-78cd-43d7-aa3e-e64a149c78b0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:54.097625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-be8ef4c6-78cd-43d7-aa3e-e64a149c78b0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:54.106216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be8ef4c6-78cd-43d7-aa3e-e64a149c78b0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.106863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be8ef4c6-78cd-43d7-aa3e-e64a149c78b0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.107983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be8ef4c6-78cd-43d7-aa3e-e64a149c78b0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.108677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be8ef4c6-78cd-43d7-aa3e-e64a149c78b0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.201764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be8ef4c6-78cd-43d7-aa3e-e64a149c78b0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:54.227590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be8ef4c6-78cd-43d7-aa3e-e64a149c78b0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:54.231330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be8ef4c6-78cd-43d7-aa3e-e64a149c78b0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:54.233648 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be8ef4c6-78cd-43d7-aa3e-e64a149c78b0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.141551 Mar 12 21:02:54.251342 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2649/3417] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:54 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:54.269148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e36fa4820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:54.286249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.287082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.287829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:54.311158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.312382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.315355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.317298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.359807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.361223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.370580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.371060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.403980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:54.421143 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f930b1ed-0511-4390-99d8-d0c3d364bf56 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-944103074" status: 201 len: 0 microversion: 2.26 time: 0.168399 Mar 12 21:02:54.426265 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2650/3418] 10.222.0.30 () {62 vars in 1376 bytes} [Sat Mar 12 21:02:54 2022] PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-944103074 => generated 0 bytes in 175 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Mar 12 21:02:54.431971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e35690550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:54.442281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.443727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.444473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:54.451301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.452109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.452996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.453553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.478535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.479151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.490134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.490696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.550385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:54.581929 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee65f012-adec-445f-8c4e-d822af153192 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-654690626" status: 201 len: 0 microversion: 2.26 time: 0.153951 Mar 12 21:02:54.583069 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2651/3419] 10.222.0.30 () {62 vars in 1376 bytes} [Sat Mar 12 21:02:54 2022] PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags/tempest-tag-654690626 => generated 0 bytes in 156 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Mar 12 21:02:54.592900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a179910-654e-4779-a923-64c982e4928e tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Action: 'update_all', calling method: .version_select at 0x7f6e37170ca0>, body: {"tags": ["tempest-tag-1005905312", "tempest-tag-629525031"]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:54.606006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a179910-654e-4779-a923-64c982e4928e tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.607149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a179910-654e-4779-a923-64c982e4928e tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.607898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a179910-654e-4779-a923-64c982e4928e tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:54.615649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a179910-654e-4779-a923-64c982e4928e tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.616488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a179910-654e-4779-a923-64c982e4928e tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.617565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a179910-654e-4779-a923-64c982e4928e tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.618279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a179910-654e-4779-a923-64c982e4928e tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.654454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a179910-654e-4779-a923-64c982e4928e tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.655340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a179910-654e-4779-a923-64c982e4928e tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.683084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-9a179910-654e-4779-a923-64c982e4928e tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:54.712393 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a179910-654e-4779-a923-64c982e4928e tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags" status: 200 len: 61 microversion: 2.26 time: 0.121162 Mar 12 21:02:54.721976 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2652/3420] 10.222.0.30 () {62 vars in 1311 bytes} [Sat Mar 12 21:02:54 2022] PUT /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags => generated 61 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:54.733172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-feba791f-5d40-415b-b95b-2dc5b2cca9e8 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e36fa41f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:54.744022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feba791f-5d40-415b-b95b-2dc5b2cca9e8 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.744767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feba791f-5d40-415b-b95b-2dc5b2cca9e8 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.758087 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-feba791f-5d40-415b-b95b-2dc5b2cca9e8 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags" status: 200 len: 61 microversion: 2.26 time: 0.029514 Mar 12 21:02:54.759368 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2653/3421] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Mar 12 21:02:54 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags => generated 61 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:54.770244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23072688-7993-44ff-a0f5-03ef921b6ced tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '.version_select at 0x7f6e36cafa60>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:54.784674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23072688-7993-44ff-a0f5-03ef921b6ced tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.785511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23072688-7993-44ff-a0f5-03ef921b6ced tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.786286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-23072688-7993-44ff-a0f5-03ef921b6ced tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:54.792928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23072688-7993-44ff-a0f5-03ef921b6ced tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.793496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23072688-7993-44ff-a0f5-03ef921b6ced tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.795110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23072688-7993-44ff-a0f5-03ef921b6ced tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.795110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23072688-7993-44ff-a0f5-03ef921b6ced tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.824166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23072688-7993-44ff-a0f5-03ef921b6ced tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.825038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23072688-7993-44ff-a0f5-03ef921b6ced tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.862898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-23072688-7993-44ff-a0f5-03ef921b6ced tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lazy-loading 'flavor' on Instance uuid 2a7c3505-989f-4f59-b060-11e2ce22b372 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:02:54.884709 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-23072688-7993-44ff-a0f5-03ef921b6ced tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags" status: 204 len: 0 microversion: 2.26 time: 0.119755 Mar 12 21:02:54.885897 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2654/3422] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Mar 12 21:02:54 2022] DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372/tags => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:02:54.897719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-31523fae-a3a9-4c3f-b272-18e6c28bb7b1 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:54.898471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-31523fae-a3a9-4c3f-b272-18e6c28bb7b1 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:54.905586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31523fae-a3a9-4c3f-b272-18e6c28bb7b1 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.906079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31523fae-a3a9-4c3f-b272-18e6c28bb7b1 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.908048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31523fae-a3a9-4c3f-b272-18e6c28bb7b1 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:54.908615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31523fae-a3a9-4c3f-b272-18e6c28bb7b1 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:54.991731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-31523fae-a3a9-4c3f-b272-18e6c28bb7b1 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:02:55.154855 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-31523fae-a3a9-4c3f-b272-18e6c28bb7b1 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372" status: 204 len: 0 microversion: 2.26 time: 0.261428 Mar 12 21:02:55.156635 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2655/3423] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 21:02:54 2022] DELETE /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:02:55.171413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ae3beec3-aff3-4986-a3fb-a1c979ff2ce8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:55.172335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ae3beec3-aff3-4986-a3fb-a1c979ff2ce8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:55.184524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae3beec3-aff3-4986-a3fb-a1c979ff2ce8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:55.184990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae3beec3-aff3-4986-a3fb-a1c979ff2ce8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:55.185880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae3beec3-aff3-4986-a3fb-a1c979ff2ce8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:55.186327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae3beec3-aff3-4986-a3fb-a1c979ff2ce8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:55.445527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ae3beec3-aff3-4986-a3fb-a1c979ff2ce8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:55.453960 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ae3beec3-aff3-4986-a3fb-a1c979ff2ce8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1512 microversion: 2.1 time: 0.295004 Mar 12 21:02:55.463829 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2656/3424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:55 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:55.469106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75606651-262c-4d7e-8870-840bcc6f5856 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:55.469800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75606651-262c-4d7e-8870-840bcc6f5856 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:55.476395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75606651-262c-4d7e-8870-840bcc6f5856 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:55.477152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75606651-262c-4d7e-8870-840bcc6f5856 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:55.478428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75606651-262c-4d7e-8870-840bcc6f5856 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:55.479045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75606651-262c-4d7e-8870-840bcc6f5856 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:55.895084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-75606651-262c-4d7e-8870-840bcc6f5856 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:55.906445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-75606651-262c-4d7e-8870-840bcc6f5856 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:55.911167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-75606651-262c-4d7e-8870-840bcc6f5856 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:55.913632 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75606651-262c-4d7e-8870-840bcc6f5856 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372" status: 200 len: 1551 microversion: 2.26 time: 0.448107 Mar 12 21:02:55.914595 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2657/3425] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:55 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372 => generated 1551 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:55.920331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3bdf241a-142a-4e2f-b025-78361d6949b5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:55.921361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3bdf241a-142a-4e2f-b025-78361d6949b5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:55.930500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3bdf241a-142a-4e2f-b025-78361d6949b5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:55.931538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3bdf241a-142a-4e2f-b025-78361d6949b5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:55.933933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3bdf241a-142a-4e2f-b025-78361d6949b5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:55.934777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3bdf241a-142a-4e2f-b025-78361d6949b5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:56.057905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3bdf241a-142a-4e2f-b025-78361d6949b5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:56.068747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3bdf241a-142a-4e2f-b025-78361d6949b5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:56.072378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3bdf241a-142a-4e2f-b025-78361d6949b5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:56.076377 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3bdf241a-142a-4e2f-b025-78361d6949b5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.160405 Mar 12 21:02:56.079887 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2658/3426] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:55 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:56.471880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7a841927-e069-46d2-b67a-a44a679bf52c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:56.471880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7a841927-e069-46d2-b67a-a44a679bf52c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:56.483843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a841927-e069-46d2-b67a-a44a679bf52c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:56.485989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a841927-e069-46d2-b67a-a44a679bf52c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:56.486825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a841927-e069-46d2-b67a-a44a679bf52c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:56.487283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a841927-e069-46d2-b67a-a44a679bf52c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:57.556112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7a841927-e069-46d2-b67a-a44a679bf52c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:57.573362 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7a841927-e069-46d2-b67a-a44a679bf52c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1512 microversion: 2.1 time: 1.106818 Mar 12 21:02:57.610351 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2659/3427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:56 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1512 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:57.618818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-219a16a9-11ab-472c-8359-bc8b600291c2 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:57.620226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-219a16a9-11ab-472c-8359-bc8b600291c2 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:57.627009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-219a16a9-11ab-472c-8359-bc8b600291c2 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:57.628104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-219a16a9-11ab-472c-8359-bc8b600291c2 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:57.630009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-219a16a9-11ab-472c-8359-bc8b600291c2 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:57.630723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-219a16a9-11ab-472c-8359-bc8b600291c2 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:58.305027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-219a16a9-11ab-472c-8359-bc8b600291c2 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:58.318600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-219a16a9-11ab-472c-8359-bc8b600291c2 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:58.325856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-219a16a9-11ab-472c-8359-bc8b600291c2 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd291cca3e44a43e49083371f38632d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2779b6e9dc324239be5fde35642407a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:58.327673 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-219a16a9-11ab-472c-8359-bc8b600291c2 tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372" status: 200 len: 1551 microversion: 2.26 time: 0.716444 Mar 12 21:02:58.328765 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2660/3428] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:57 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372 => generated 1551 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:58.336564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-391ee382-354c-416a-98c0-087292577222 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:58.345396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-391ee382-354c-416a-98c0-087292577222 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:58.356556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-391ee382-354c-416a-98c0-087292577222 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:58.357875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-391ee382-354c-416a-98c0-087292577222 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:58.359294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-391ee382-354c-416a-98c0-087292577222 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:58.359930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-391ee382-354c-416a-98c0-087292577222 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:58.990545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-391ee382-354c-416a-98c0-087292577222 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:59.000406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-391ee382-354c-416a-98c0-087292577222 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:59.009338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-391ee382-354c-416a-98c0-087292577222 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:59.010947 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-391ee382-354c-416a-98c0-087292577222 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.680197 Mar 12 21:02:59.011218 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2661/3429] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:58 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:02:59.021215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-90d5a251-32db-48e9-bd43-92b9ddf566c6 req-80c02aff-ba20-44a0-a2f8-70e5993fd23a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a7c3505-989f-4f59-b060-11e2ce22b372", "name": "network-vif-deleted", "tag": "63ab797e-dfe9-4b71-80bf-e1b91d9518a0"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:02:59.038763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-90d5a251-32db-48e9-bd43-92b9ddf566c6 req-80c02aff-ba20-44a0-a2f8-70e5993fd23a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:59.039123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-90d5a251-32db-48e9-bd43-92b9ddf566c6 req-80c02aff-ba20-44a0-a2f8-70e5993fd23a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:59.081785 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-90d5a251-32db-48e9-bd43-92b9ddf566c6 req-80c02aff-ba20-44a0-a2f8-70e5993fd23a service nova] Creating event network-vif-deleted:63ab797e-dfe9-4b71-80bf-e1b91d9518a0 for instance 2a7c3505-989f-4f59-b060-11e2ce22b372 on nch2-master-1 Mar 12 21:02:59.088819 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-90d5a251-32db-48e9-bd43-92b9ddf566c6 req-80c02aff-ba20-44a0-a2f8-70e5993fd23a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071049 Mar 12 21:02:59.090060 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2662/3430] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:02:59.099336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4ff12315-64e8-4a18-b282-b37ce094aefa tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:02:59.100059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4ff12315-64e8-4a18-b282-b37ce094aefa tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:02:59.120762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ff12315-64e8-4a18-b282-b37ce094aefa tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:59.123439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ff12315-64e8-4a18-b282-b37ce094aefa tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:59.124504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ff12315-64e8-4a18-b282-b37ce094aefa tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:02:59.129375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ff12315-64e8-4a18-b282-b37ce094aefa tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:02:59.975210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4ff12315-64e8-4a18-b282-b37ce094aefa tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:02:59.984781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4ff12315-64e8-4a18-b282-b37ce094aefa tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1489 microversion: 2.1 time: 0.893246 Mar 12 21:02:59.985966 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2663/3431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:02:59 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1489 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:02:59.995482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2a5ede0c-c03c-4d2e-89db-01c85e9cf78a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:00.007124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2a5ede0c-c03c-4d2e-89db-01c85e9cf78a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] [instance: 2a7c3505-989f-4f59-b060-11e2ce22b372] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:00.025814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a5ede0c-c03c-4d2e-89db-01c85e9cf78a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:00.026604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a5ede0c-c03c-4d2e-89db-01c85e9cf78a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:00.027632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a5ede0c-c03c-4d2e-89db-01c85e9cf78a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:00.029734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a5ede0c-c03c-4d2e-89db-01c85e9cf78a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:00.065956 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-2a5ede0c-c03c-4d2e-89db-01c85e9cf78a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] HTTP exception thrown: Instance 2a7c3505-989f-4f59-b060-11e2ce22b372 could not be found. Mar 12 21:03:00.066599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2a5ede0c-c03c-4d2e-89db-01c85e9cf78a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] Returning 404 to user: Instance 2a7c3505-989f-4f59-b060-11e2ce22b372 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:00.067474 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2a5ede0c-c03c-4d2e-89db-01c85e9cf78a tempest-ServerTagsTestJSON-654310651 tempest-ServerTagsTestJSON-654310651-project] 10.222.0.30 "GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372" status: 404 len: 111 microversion: 2.26 time: 0.075918 Mar 12 21:03:00.068065 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2664/3432] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:02:59 2022] GET /compute/v2.1/servers/2a7c3505-989f-4f59-b060-11e2ce22b372 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:03:00.084173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd77c9d6-f2ce-46a8-aaca-ce4cbf2f0c21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:00.090861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dd77c9d6-f2ce-46a8-aaca-ce4cbf2f0c21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:00.103319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd77c9d6-f2ce-46a8-aaca-ce4cbf2f0c21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:00.103974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd77c9d6-f2ce-46a8-aaca-ce4cbf2f0c21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:00.104853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd77c9d6-f2ce-46a8-aaca-ce4cbf2f0c21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:00.105311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd77c9d6-f2ce-46a8-aaca-ce4cbf2f0c21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:00.190048 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd77c9d6-f2ce-46a8-aaca-ce4cbf2f0c21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 200 len: 166 microversion: 2.1 time: 0.110295 Mar 12 21:03:00.195076 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2665/3433] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:03:00 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 166 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:00.201071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2e6bcb09-99f3-4ccb-b24a-e4d107372562 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:00.201826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2e6bcb09-99f3-4ccb-b24a-e4d107372562 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:00.221855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e6bcb09-99f3-4ccb-b24a-e4d107372562 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:00.222343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e6bcb09-99f3-4ccb-b24a-e4d107372562 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:00.223153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e6bcb09-99f3-4ccb-b24a-e4d107372562 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:00.223606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e6bcb09-99f3-4ccb-b24a-e4d107372562 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:00.533163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2e6bcb09-99f3-4ccb-b24a-e4d107372562 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:00.549725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2e6bcb09-99f3-4ccb-b24a-e4d107372562 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:00.555430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2e6bcb09-99f3-4ccb-b24a-e4d107372562 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:00.556938 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2e6bcb09-99f3-4ccb-b24a-e4d107372562 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.360653 Mar 12 21:03:00.566625 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2666/3434] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:00 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:00.568871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c565859-5250-4743-b25d-9fe9d624397d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:00.569490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c565859-5250-4743-b25d-9fe9d624397d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:00.591586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c565859-5250-4743-b25d-9fe9d624397d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:00.591950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c565859-5250-4743-b25d-9fe9d624397d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:00.596207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c565859-5250-4743-b25d-9fe9d624397d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:00.596869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c565859-5250-4743-b25d-9fe9d624397d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:01.308532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c565859-5250-4743-b25d-9fe9d624397d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:01.316633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c565859-5250-4743-b25d-9fe9d624397d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.751462 Mar 12 21:03:01.325949 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2667/3435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:00 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:01.337754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee762939-307f-48f4-a813-237bb474aea5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:01.338411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee762939-307f-48f4-a813-237bb474aea5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:01.355203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee762939-307f-48f4-a813-237bb474aea5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:01.355949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee762939-307f-48f4-a813-237bb474aea5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:01.356914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee762939-307f-48f4-a813-237bb474aea5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:01.357512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee762939-307f-48f4-a813-237bb474aea5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:02.242728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee762939-307f-48f4-a813-237bb474aea5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:02.250282 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee762939-307f-48f4-a813-237bb474aea5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.916381 Mar 12 21:03:02.251533 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2668/3436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:01 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:02.265158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a9fa7091-7e4e-4309-b124-138db815f581 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:02.265794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a9fa7091-7e4e-4309-b124-138db815f581 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:02.284547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9fa7091-7e4e-4309-b124-138db815f581 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:02.285074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9fa7091-7e4e-4309-b124-138db815f581 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:02.291942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9fa7091-7e4e-4309-b124-138db815f581 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:02.292643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9fa7091-7e4e-4309-b124-138db815f581 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:02.502134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a9fa7091-7e4e-4309-b124-138db815f581 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:02.510550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a9fa7091-7e4e-4309-b124-138db815f581 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:02.512081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a9fa7091-7e4e-4309-b124-138db815f581 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:02.513290 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a9fa7091-7e4e-4309-b124-138db815f581 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.252074 Mar 12 21:03:02.513886 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2669/3437] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:02 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:03.068549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-738852055", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:03.176131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] validate_networks() for [('328d099b-eef2-4150-ba25-b254e81e0ddb', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:03:05.650357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:03:05.650980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:03:05.653645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:03:05.654613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:03:05.658313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:03:05.700898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:05.702043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:05.703177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:05.704522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:05.793186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Getting quotas for project 7213b31fd1ef41b4bd07970ba80dfc04. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:03:05.804175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Getting quotas for user bee46ffa14644ea8853ef8b89432c826 and project 7213b31fd1ef41b4bd07970ba80dfc04. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:03:05.849440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:03:05.856413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:03:05.975058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4e770b72-c2a5-4308-981f-475130880293 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.448739 Mar 12 21:03:05.976516 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2670/3438] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:03:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:03:05.981963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ddae86d5-2425-4c22-ba2c-5000879f2e01 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:05.982889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ddae86d5-2425-4c22-ba2c-5000879f2e01 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:05.990308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ddae86d5-2425-4c22-ba2c-5000879f2e01 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:05.991075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ddae86d5-2425-4c22-ba2c-5000879f2e01 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:05.992081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ddae86d5-2425-4c22-ba2c-5000879f2e01 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:05.992742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ddae86d5-2425-4c22-ba2c-5000879f2e01 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:06.607956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ddae86d5-2425-4c22-ba2c-5000879f2e01 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:06.636446 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ddae86d5-2425-4c22-ba2c-5000879f2e01 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.652328 Mar 12 21:03:06.637898 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2671/3439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:05 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:06.654421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5130adb0-0c96-446a-86ef-a55ba0c8c5b2 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:06.655083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5130adb0-0c96-446a-86ef-a55ba0c8c5b2 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:06.665336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5130adb0-0c96-446a-86ef-a55ba0c8c5b2 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:06.680604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5130adb0-0c96-446a-86ef-a55ba0c8c5b2 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:06.682064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5130adb0-0c96-446a-86ef-a55ba0c8c5b2 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:06.690517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5130adb0-0c96-446a-86ef-a55ba0c8c5b2 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:06.932925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5130adb0-0c96-446a-86ef-a55ba0c8c5b2 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:06.950519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5130adb0-0c96-446a-86ef-a55ba0c8c5b2 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:06.960407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5130adb0-0c96-446a-86ef-a55ba0c8c5b2 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:06.963955 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5130adb0-0c96-446a-86ef-a55ba0c8c5b2 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.324836 Mar 12 21:03:06.964549 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2672/3440] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:06 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:07.201780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8625981f-97c7-4909-8d1f-7786154ffd46 tempest-ExtensionsTest-487421875 tempest-ExtensionsTest-487421875-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:07.206011 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8625981f-97c7-4909-8d1f-7786154ffd46 tempest-ExtensionsTest-487421875 tempest-ExtensionsTest-487421875-project] 10.222.0.30 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.239470 Mar 12 21:03:07.206646 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2673/3441] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Mar 12 21:03:06 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:07.238822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-818d9d2b-fd4d-4d49-8816-b38df4d96e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:07.239388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-818d9d2b-fd4d-4d49-8816-b38df4d96e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:07.257133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-818d9d2b-fd4d-4d49-8816-b38df4d96e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:07.257819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-818d9d2b-fd4d-4d49-8816-b38df4d96e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:07.266938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-818d9d2b-fd4d-4d49-8816-b38df4d96e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:07.267716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-818d9d2b-fd4d-4d49-8816-b38df4d96e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:07.681516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-818d9d2b-fd4d-4d49-8816-b38df4d96e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:07.699041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-818d9d2b-fd4d-4d49-8816-b38df4d96e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1265 microversion: 2.1 time: 0.473382 Mar 12 21:03:07.701401 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2674/3442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:07 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1265 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:07.720840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f12169b-4c69-45c2-9a08-1ccf609fc33d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:07.725199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f12169b-4c69-45c2-9a08-1ccf609fc33d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:07.750231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f12169b-4c69-45c2-9a08-1ccf609fc33d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:07.751664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f12169b-4c69-45c2-9a08-1ccf609fc33d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:07.752710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f12169b-4c69-45c2-9a08-1ccf609fc33d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:07.753460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f12169b-4c69-45c2-9a08-1ccf609fc33d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:08.825414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8f12169b-4c69-45c2-9a08-1ccf609fc33d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:08.839523 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f12169b-4c69-45c2-9a08-1ccf609fc33d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 1.136117 Mar 12 21:03:08.840424 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2675/3443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:07 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:08.847457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-08028a96-d35e-412f-8af9-aec9d3e49c37 tempest-ExtensionsTest-487421875 tempest-ExtensionsTest-487421875-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:08.856577 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-08028a96-d35e-412f-8af9-aec9d3e49c37 tempest-ExtensionsTest-487421875 tempest-ExtensionsTest-487421875-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.014288 Mar 12 21:03:08.877758 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2676/3444] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Mar 12 21:03:08 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 21:03:08.908015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca9aa52c-ba6d-4610-a8c4-fc1e3f986aa5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:08.908846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ca9aa52c-ba6d-4610-a8c4-fc1e3f986aa5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:08.915994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca9aa52c-ba6d-4610-a8c4-fc1e3f986aa5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:08.916737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca9aa52c-ba6d-4610-a8c4-fc1e3f986aa5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:08.917640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca9aa52c-ba6d-4610-a8c4-fc1e3f986aa5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:08.918211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca9aa52c-ba6d-4610-a8c4-fc1e3f986aa5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:09.147225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca9aa52c-ba6d-4610-a8c4-fc1e3f986aa5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:09.155849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca9aa52c-ba6d-4610-a8c4-fc1e3f986aa5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:09.158029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca9aa52c-ba6d-4610-a8c4-fc1e3f986aa5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:09.166316 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca9aa52c-ba6d-4610-a8c4-fc1e3f986aa5 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.263348 Mar 12 21:03:09.166919 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2677/3445] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:08 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:09.182481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7ddc39d-3b3a-48be-ae26-aa1cfdd663d6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:09.183105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f7ddc39d-3b3a-48be-ae26-aa1cfdd663d6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:09.198013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7ddc39d-3b3a-48be-ae26-aa1cfdd663d6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:09.198474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7ddc39d-3b3a-48be-ae26-aa1cfdd663d6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:09.199264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7ddc39d-3b3a-48be-ae26-aa1cfdd663d6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:09.199742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7ddc39d-3b3a-48be-ae26-aa1cfdd663d6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:09.785285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f7ddc39d-3b3a-48be-ae26-aa1cfdd663d6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:09.792902 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f7ddc39d-3b3a-48be-ae26-aa1cfdd663d6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1313 microversion: 2.1 time: 0.622088 Mar 12 21:03:09.798876 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2678/3446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:09 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:09.805828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1944248123", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "a1df08e9-a7c0-43fc-8fad-e4c91b24f5ac"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:09.922009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] validate_networks() for [('a1df08e9-a7c0-43fc-8fad-e4c91b24f5ac', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:03:11.544134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:03:11.544695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:03:11.545114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:03:11.545600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:03:11.546125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:03:11.562890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:11.564022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:11.565394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:11.567566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:11.602652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:03:11.612294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for user 178b9752b5d44f9abb4df56c54e28c48 and project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:03:11.663272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:03:11.673936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:03:11.895643 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2e01db81-e788-45ce-809a-5ae7670f2028 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.095399 Mar 12 21:03:11.914162 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2679/3447] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:03:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:03:11.947575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14a4822e-bb28-4bfc-a9b2-072f53608967 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:11.951281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14a4822e-bb28-4bfc-a9b2-072f53608967 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:11.970375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14a4822e-bb28-4bfc-a9b2-072f53608967 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:11.971567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14a4822e-bb28-4bfc-a9b2-072f53608967 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:11.972575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14a4822e-bb28-4bfc-a9b2-072f53608967 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:11.973189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14a4822e-bb28-4bfc-a9b2-072f53608967 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:12.207753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14a4822e-bb28-4bfc-a9b2-072f53608967 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:12.216201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14a4822e-bb28-4bfc-a9b2-072f53608967 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:12.217836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14a4822e-bb28-4bfc-a9b2-072f53608967 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:12.233623 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14a4822e-bb28-4bfc-a9b2-072f53608967 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1366 microversion: 2.47 time: 0.314721 Mar 12 21:03:12.237932 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2680/3448] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:11 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:12.258950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f4eaa19-0052-47d2-9366-5b04c43e1fc6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:12.260193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f4eaa19-0052-47d2-9366-5b04c43e1fc6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:12.287862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f4eaa19-0052-47d2-9366-5b04c43e1fc6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:12.292123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f4eaa19-0052-47d2-9366-5b04c43e1fc6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:12.293155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f4eaa19-0052-47d2-9366-5b04c43e1fc6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:12.293632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f4eaa19-0052-47d2-9366-5b04c43e1fc6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:12.840843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f4eaa19-0052-47d2-9366-5b04c43e1fc6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:12.851286 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f4eaa19-0052-47d2-9366-5b04c43e1fc6 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1313 microversion: 2.1 time: 0.612356 Mar 12 21:03:12.854404 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2681/3449] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:12 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1313 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:12.868529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e6f612ad-ed10-475f-aa83-7f911a745785 req-1ad1b86d-dbe6-4f53-91e6-ad32c0cce19e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6826699-d144-4b11-a12e-7912580e476a", "tag": "b562ed22-9529-482b-972a-06e309459fa8"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:12.888897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e6f612ad-ed10-475f-aa83-7f911a745785 req-1ad1b86d-dbe6-4f53-91e6-ad32c0cce19e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:12.889581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e6f612ad-ed10-475f-aa83-7f911a745785 req-1ad1b86d-dbe6-4f53-91e6-ad32c0cce19e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:12.911491 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e6f612ad-ed10-475f-aa83-7f911a745785 req-1ad1b86d-dbe6-4f53-91e6-ad32c0cce19e service nova] Creating event network-changed:b562ed22-9529-482b-972a-06e309459fa8 for instance f6826699-d144-4b11-a12e-7912580e476a on nch2-master-1 Mar 12 21:03:12.922966 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e6f612ad-ed10-475f-aa83-7f911a745785 req-1ad1b86d-dbe6-4f53-91e6-ad32c0cce19e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067017 Mar 12 21:03:12.924175 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2682/3450] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:12.929580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1c6bdc0a-a25d-41b1-9c5b-57953a6233bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:12.940812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1c6bdc0a-a25d-41b1-9c5b-57953a6233bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:12.958064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c6bdc0a-a25d-41b1-9c5b-57953a6233bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:12.958527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c6bdc0a-a25d-41b1-9c5b-57953a6233bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:12.959324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c6bdc0a-a25d-41b1-9c5b-57953a6233bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:12.959772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c6bdc0a-a25d-41b1-9c5b-57953a6233bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:13.041176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1c6bdc0a-a25d-41b1-9c5b-57953a6233bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:13.053089 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1c6bdc0a-a25d-41b1-9c5b-57953a6233bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 200 len: 1267 microversion: 2.1 time: 0.125017 Mar 12 21:03:13.054068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2683/3451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:12 2022] GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 1267 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:13.256711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ec8db1b-457a-4126-af6f-ff27cc64b8df tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:13.257663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ec8db1b-457a-4126-af6f-ff27cc64b8df tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:13.268103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ec8db1b-457a-4126-af6f-ff27cc64b8df tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:13.268874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ec8db1b-457a-4126-af6f-ff27cc64b8df tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:13.271949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ec8db1b-457a-4126-af6f-ff27cc64b8df tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:13.272406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ec8db1b-457a-4126-af6f-ff27cc64b8df tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:13.687001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6ec8db1b-457a-4126-af6f-ff27cc64b8df tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:13.702789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6ec8db1b-457a-4126-af6f-ff27cc64b8df tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:13.716791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6ec8db1b-457a-4126-af6f-ff27cc64b8df tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:13.730205 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ec8db1b-457a-4126-af6f-ff27cc64b8df tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1372 microversion: 2.47 time: 0.474022 Mar 12 21:03:13.732255 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2684/3452] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:13 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1372 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:13.871329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cecc6260-2ea2-4d38-8755-7b5daf397a7b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:13.872121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cecc6260-2ea2-4d38-8755-7b5daf397a7b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:13.880262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cecc6260-2ea2-4d38-8755-7b5daf397a7b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:13.884593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cecc6260-2ea2-4d38-8755-7b5daf397a7b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:13.889804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cecc6260-2ea2-4d38-8755-7b5daf397a7b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:13.898036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cecc6260-2ea2-4d38-8755-7b5daf397a7b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:14.675311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cecc6260-2ea2-4d38-8755-7b5daf397a7b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:14.685307 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cecc6260-2ea2-4d38-8755-7b5daf397a7b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1313 microversion: 2.1 time: 0.818489 Mar 12 21:03:14.699503 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2685/3453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:13 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1313 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:14.704854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3e7ef079-724b-41ad-9eb6-2223021eab37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:14.710781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3e7ef079-724b-41ad-9eb6-2223021eab37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:14.726598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e7ef079-724b-41ad-9eb6-2223021eab37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:14.730156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e7ef079-724b-41ad-9eb6-2223021eab37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:14.731696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e7ef079-724b-41ad-9eb6-2223021eab37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:14.734397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e7ef079-724b-41ad-9eb6-2223021eab37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:14.916976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3e7ef079-724b-41ad-9eb6-2223021eab37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:14.930830 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3e7ef079-724b-41ad-9eb6-2223021eab37 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 200 len: 1273 microversion: 2.1 time: 0.228450 Mar 12 21:03:14.939558 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2686/3454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:14 2022] GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:14.956146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5f248a0b-a2dc-47bf-a750-0aa91dc09be4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:14.961498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5f248a0b-a2dc-47bf-a750-0aa91dc09be4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:14.984122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f248a0b-a2dc-47bf-a750-0aa91dc09be4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:14.985439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f248a0b-a2dc-47bf-a750-0aa91dc09be4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:14.989586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f248a0b-a2dc-47bf-a750-0aa91dc09be4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:14.993074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f248a0b-a2dc-47bf-a750-0aa91dc09be4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:15.124438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f248a0b-a2dc-47bf-a750-0aa91dc09be4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:15.145510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f248a0b-a2dc-47bf-a750-0aa91dc09be4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:15.147743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f248a0b-a2dc-47bf-a750-0aa91dc09be4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:15.149312 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5f248a0b-a2dc-47bf-a750-0aa91dc09be4 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1372 microversion: 2.47 time: 0.208440 Mar 12 21:03:15.164019 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2687/3455] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:14 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:15.551169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-11335dea-a876-4ddc-93a3-9cfb9d732df3 tempest-ComputeTenantNetworksTest-413377119 tempest-ComputeTenantNetworksTest-413377119-project] Calling method '.version_select at 0x7f6e37322700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:16.531482 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-11335dea-a876-4ddc-93a3-9cfb9d732df3 tempest-ComputeTenantNetworksTest-413377119 tempest-ComputeTenantNetworksTest-413377119-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.365927 Mar 12 21:03:16.533359 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2688/3456] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 21:03:15 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:16.539880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1e9e321-eb78-4058-adbc-5e6d778a2f20 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:16.540844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f1e9e321-eb78-4058-adbc-5e6d778a2f20 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:16.562135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1e9e321-eb78-4058-adbc-5e6d778a2f20 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:16.567359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1e9e321-eb78-4058-adbc-5e6d778a2f20 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:16.568752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1e9e321-eb78-4058-adbc-5e6d778a2f20 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:16.569664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1e9e321-eb78-4058-adbc-5e6d778a2f20 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:17.199570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f1e9e321-eb78-4058-adbc-5e6d778a2f20 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:17.209151 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1e9e321-eb78-4058-adbc-5e6d778a2f20 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1313 microversion: 2.1 time: 0.673701 Mar 12 21:03:17.223910 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2689/3457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:16 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:17.238972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c96c8fb2-c6b9-4aac-9b98-67886a135548 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:17.256195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c96c8fb2-c6b9-4aac-9b98-67886a135548 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:17.306366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c96c8fb2-c6b9-4aac-9b98-67886a135548 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:17.315114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c96c8fb2-c6b9-4aac-9b98-67886a135548 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:17.316251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c96c8fb2-c6b9-4aac-9b98-67886a135548 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:17.316720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c96c8fb2-c6b9-4aac-9b98-67886a135548 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:17.827957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c96c8fb2-c6b9-4aac-9b98-67886a135548 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:17.837187 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c96c8fb2-c6b9-4aac-9b98-67886a135548 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 200 len: 1315 microversion: 2.1 time: 0.608667 Mar 12 21:03:17.840712 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2690/3458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:17 2022] GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:17.855282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a5e74dd6-621c-4604-8897-48cb0bba71e0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:17.856032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a5e74dd6-621c-4604-8897-48cb0bba71e0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:17.868690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5e74dd6-621c-4604-8897-48cb0bba71e0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:17.869401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5e74dd6-621c-4604-8897-48cb0bba71e0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:17.870577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5e74dd6-621c-4604-8897-48cb0bba71e0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:17.871154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5e74dd6-621c-4604-8897-48cb0bba71e0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:18.002758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a5e74dd6-621c-4604-8897-48cb0bba71e0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:18.044893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a5e74dd6-621c-4604-8897-48cb0bba71e0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:18.048792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a5e74dd6-621c-4604-8897-48cb0bba71e0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:18.050697 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a5e74dd6-621c-4604-8897-48cb0bba71e0 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1357 microversion: 2.47 time: 0.207683 Mar 12 21:03:18.052291 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2691/3459] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:17 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:18.066205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca087736-373e-45b6-bbc1-d0b85a0da960 tempest-ComputeTenantNetworksTest-413377119 tempest-ComputeTenantNetworksTest-413377119-project] Calling method '.version_select at 0x7f6e37487ca0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:18.268232 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca087736-373e-45b6-bbc1-d0b85a0da960 tempest-ComputeTenantNetworksTest-413377119 tempest-ComputeTenantNetworksTest-413377119-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks/92017303-8ec7-44ca-a4dd-33265cb4069b" status: 200 len: 139 microversion: 2.1 time: 0.211825 Mar 12 21:03:18.268882 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2692/3460] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 21:03:18 2022] GET /compute/v2.1/os-tenant-networks/92017303-8ec7-44ca-a4dd-33265cb4069b => generated 139 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:18.276402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1413597736", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "f60cb4cf-e3a1-4a08-921c-02200778c896"}, {"uuid": "2d78932a-a6d0-4404-b6dd-19df8c3d2632"}, {"uuid": "f60cb4cf-e3a1-4a08-921c-02200778c896"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:18.368384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] validate_networks() for [('f60cb4cf-e3a1-4a08-921c-02200778c896', None, None, None, None, None), ('2d78932a-a6d0-4404-b6dd-19df8c3d2632', None, None, None, None, None), ('f60cb4cf-e3a1-4a08-921c-02200778c896', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:03:20.142834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:03:20.143418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:03:20.144118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:03:20.144779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:03:20.145806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:03:20.175068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:20.177607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:20.185931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:20.186881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:20.251513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Getting quotas for project 506297c5930140e3b2a54284d502b722. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:03:20.258963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Getting quotas for user d71701480d764e4e8995346f9b464aea and project 506297c5930140e3b2a54284d502b722. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:03:20.277371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:03:20.285093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:03:20.393742 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-02d6abe4-420d-46f9-9b3d-e83573d734bc tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.123370 Mar 12 21:03:20.394714 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2693/3461] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:03:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:03:20.860675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ed5b39e-79e4-4a00-9871-55b8c72426d2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:20.861910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5ed5b39e-79e4-4a00-9871-55b8c72426d2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:20.889812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ed5b39e-79e4-4a00-9871-55b8c72426d2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:20.891229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ed5b39e-79e4-4a00-9871-55b8c72426d2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:20.892566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ed5b39e-79e4-4a00-9871-55b8c72426d2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:20.893488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ed5b39e-79e4-4a00-9871-55b8c72426d2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:20.943087 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ed5b39e-79e4-4a00-9871-55b8c72426d2 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/ips" status: 200 len: 146 microversion: 2.1 time: 0.547266 Mar 12 21:03:20.957340 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2694/3462] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 21:03:20 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/ips => generated 146 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:20.972202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8491561f-0407-455e-b81f-47785e244f00 req-cd3b068d-f989-4227-8e64-f83b17709966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008404bd-cccb-4df6-925f-1b5fd2b25b04", "tag": "51fd0a73-6532-4ffa-b723-fa81d3e3f852"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:20.984748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8491561f-0407-455e-b81f-47785e244f00 req-cd3b068d-f989-4227-8e64-f83b17709966 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:20.985735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8491561f-0407-455e-b81f-47785e244f00 req-cd3b068d-f989-4227-8e64-f83b17709966 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:21.008717 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8491561f-0407-455e-b81f-47785e244f00 req-cd3b068d-f989-4227-8e64-f83b17709966 service nova] Creating event network-changed:51fd0a73-6532-4ffa-b723-fa81d3e3f852 for instance 008404bd-cccb-4df6-925f-1b5fd2b25b04 on nch1-master-1 Mar 12 21:03:21.018599 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8491561f-0407-455e-b81f-47785e244f00 req-cd3b068d-f989-4227-8e64-f83b17709966 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057830 Mar 12 21:03:21.019949 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2695/3463] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:21.031291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:21.037413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:21.039286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Searching by: {'deleted': False, 'project_id': '79f0629679d143289f5bc0c3e6961504'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 21:03:21.046388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:21.047277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:21.048848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:21.049610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:21.447080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 21:03:21.751065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:21.785436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:21.788547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:21.835068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:21.836833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:22.546418 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7adc7966-8be5-4a7b-9680-a582c041725d tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 1.524823 Mar 12 21:03:22.549070 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2696/3464] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Mar 12 21:03:21 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:22.555225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-405a19d4-d961-4079-9751-9277d39fc722 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:22.556512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-405a19d4-d961-4079-9751-9277d39fc722 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:22.587498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-405a19d4-d961-4079-9751-9277d39fc722 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:22.594547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-405a19d4-d961-4079-9751-9277d39fc722 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:22.597144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-405a19d4-d961-4079-9751-9277d39fc722 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:22.601397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-405a19d4-d961-4079-9751-9277d39fc722 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:23.005453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-405a19d4-d961-4079-9751-9277d39fc722 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:23.013168 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-405a19d4-d961-4079-9751-9277d39fc722 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1313 microversion: 2.1 time: 0.462706 Mar 12 21:03:23.014001 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2697/3465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:22 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:23.028573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-76f62f3c-431c-4a87-b9b0-2da7548ebadf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:23.029415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-76f62f3c-431c-4a87-b9b0-2da7548ebadf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:23.037441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76f62f3c-431c-4a87-b9b0-2da7548ebadf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:23.038166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76f62f3c-431c-4a87-b9b0-2da7548ebadf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:23.039156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76f62f3c-431c-4a87-b9b0-2da7548ebadf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:23.039769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76f62f3c-431c-4a87-b9b0-2da7548ebadf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:23.303585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-76f62f3c-431c-4a87-b9b0-2da7548ebadf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:23.312481 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-76f62f3c-431c-4a87-b9b0-2da7548ebadf tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 200 len: 1315 microversion: 2.1 time: 0.287258 Mar 12 21:03:23.312642 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2698/3466] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:23 2022] GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:23.326464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0b77e4f8-4022-42f6-9baa-d81502fe5bcb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:23.327357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0b77e4f8-4022-42f6-9baa-d81502fe5bcb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:23.336614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b77e4f8-4022-42f6-9baa-d81502fe5bcb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:23.337296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b77e4f8-4022-42f6-9baa-d81502fe5bcb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:23.338365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b77e4f8-4022-42f6-9baa-d81502fe5bcb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:23.338970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b77e4f8-4022-42f6-9baa-d81502fe5bcb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:23.440017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0b77e4f8-4022-42f6-9baa-d81502fe5bcb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:23.464596 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0b77e4f8-4022-42f6-9baa-d81502fe5bcb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1271 microversion: 2.1 time: 0.150593 Mar 12 21:03:23.466146 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2699/3467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:23 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:23.735213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1d498f34-2d97-4e20-a4cb-7f76afa959e0 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] Action: 'create', calling method: .version_select at 0x7f6e37053790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1307968970", "metadata": {"Type": "work"}}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:23.737540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1d498f34-2d97-4e20-a4cb-7f76afa959e0 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:23.738796 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1d498f34-2d97-4e20-a4cb-7f76afa959e0 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.271050 Mar 12 21:03:23.740358 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2700/3468] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Mar 12 21:03:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 274 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:03:23.746760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ee42606c-617b-4bd7-ad30-d954090dbe1e req-8df6546b-9264-4c0e-a8e1-607a3285bfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6826699-d144-4b11-a12e-7912580e476a", "name": "network-vif-plugged", "status": "completed", "tag": "b562ed22-9529-482b-972a-06e309459fa8"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:23.764771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ee42606c-617b-4bd7-ad30-d954090dbe1e req-8df6546b-9264-4c0e-a8e1-607a3285bfa9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:23.766639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ee42606c-617b-4bd7-ad30-d954090dbe1e req-8df6546b-9264-4c0e-a8e1-607a3285bfa9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:23.785355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ee42606c-617b-4bd7-ad30-d954090dbe1e req-8df6546b-9264-4c0e-a8e1-607a3285bfa9 service nova] Creating event network-vif-plugged:b562ed22-9529-482b-972a-06e309459fa8 for instance f6826699-d144-4b11-a12e-7912580e476a on nch2-master-1 Mar 12 21:03:23.792646 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ee42606c-617b-4bd7-ad30-d954090dbe1e req-8df6546b-9264-4c0e-a8e1-607a3285bfa9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050894 Mar 12 21:03:23.795436 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2701/3469] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:23.802929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-62e1398a-8552-4c86-8b46-c9b78efcaa06 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:23.803917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-62e1398a-8552-4c86-8b46-c9b78efcaa06 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:23.813402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62e1398a-8552-4c86-8b46-c9b78efcaa06 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:23.814316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62e1398a-8552-4c86-8b46-c9b78efcaa06 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:23.817411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62e1398a-8552-4c86-8b46-c9b78efcaa06 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:23.818101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62e1398a-8552-4c86-8b46-c9b78efcaa06 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:23.859029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-62e1398a-8552-4c86-8b46-c9b78efcaa06 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:03:24.045461 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-62e1398a-8552-4c86-8b46-c9b78efcaa06 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "DELETE /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 204 len: 0 microversion: 2.47 time: 0.248380 Mar 12 21:03:24.050499 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2702/3470] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 21:03:23 2022] DELETE /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:03:24.060101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f148f9cb-74d2-405f-a8f2-99ae5f104054 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f03d07d-1804-458a-9612-e9595afeb76a"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:24.066508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f148f9cb-74d2-405f-a8f2-99ae5f104054 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:24.077329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f148f9cb-74d2-405f-a8f2-99ae5f104054 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:24.078439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f148f9cb-74d2-405f-a8f2-99ae5f104054 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:24.079533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f148f9cb-74d2-405f-a8f2-99ae5f104054 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:24.080958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f148f9cb-74d2-405f-a8f2-99ae5f104054 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:24.574376 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f148f9cb-74d2-405f-a8f2-99ae5f104054 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "POST /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.519878 Mar 12 21:03:24.575370 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2703/3471] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:03:24 2022] POST /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments => generated 194 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:24.589430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-348a8159-1d12-481f-a99f-fe1013c54498 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] Action: 'create', calling method: .version_select at 0x7f6e37688f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1378841103", "metadata": {"Type": "work"}}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:24.593157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-348a8159-1d12-481f-a99f-fe1013c54498 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:24.596823 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-348a8159-1d12-481f-a99f-fe1013c54498 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020014 Mar 12 21:03:24.598759 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2704/3472] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Mar 12 21:03:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:03:24.609110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35533690-e248-4b01-b845-80043fcbc7f8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:24.610510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-35533690-e248-4b01-b845-80043fcbc7f8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:24.633592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35533690-e248-4b01-b845-80043fcbc7f8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:24.639650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35533690-e248-4b01-b845-80043fcbc7f8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:24.641544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35533690-e248-4b01-b845-80043fcbc7f8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:24.644983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35533690-e248-4b01-b845-80043fcbc7f8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:24.947467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-35533690-e248-4b01-b845-80043fcbc7f8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:24.966365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-35533690-e248-4b01-b845-80043fcbc7f8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1313 microversion: 2.1 time: 0.361610 Mar 12 21:03:24.967747 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2705/3473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:24 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:24.974318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d80654d-9045-4839-b547-098231896863 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:24.975544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8d80654d-9045-4839-b547-098231896863 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:24.992667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d80654d-9045-4839-b547-098231896863 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:24.993481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d80654d-9045-4839-b547-098231896863 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:24.994692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d80654d-9045-4839-b547-098231896863 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:24.995602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d80654d-9045-4839-b547-098231896863 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:25.141835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d80654d-9045-4839-b547-098231896863 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:25.154257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d80654d-9045-4839-b547-098231896863 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:25.158059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d80654d-9045-4839-b547-098231896863 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:25.159571 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d80654d-9045-4839-b547-098231896863 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1363 microversion: 2.47 time: 0.190639 Mar 12 21:03:25.162538 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2706/3474] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:24 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:25.185373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7579c40d-e74d-4f20-ab50-42da2957501d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:25.186245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7579c40d-e74d-4f20-ab50-42da2957501d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:25.200226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7579c40d-e74d-4f20-ab50-42da2957501d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:25.200977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7579c40d-e74d-4f20-ab50-42da2957501d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:25.208852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7579c40d-e74d-4f20-ab50-42da2957501d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:25.209686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7579c40d-e74d-4f20-ab50-42da2957501d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:25.503474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7579c40d-e74d-4f20-ab50-42da2957501d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:25.513031 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7579c40d-e74d-4f20-ab50-42da2957501d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 200 len: 1315 microversion: 2.1 time: 0.348021 Mar 12 21:03:25.524419 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2707/3475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:25 2022] GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:25.530655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d23c5a86-4d8e-416e-b424-a15fd8ac2c3f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:25.532310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d23c5a86-4d8e-416e-b424-a15fd8ac2c3f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:25.539178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d23c5a86-4d8e-416e-b424-a15fd8ac2c3f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:25.540184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d23c5a86-4d8e-416e-b424-a15fd8ac2c3f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:25.541237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d23c5a86-4d8e-416e-b424-a15fd8ac2c3f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:25.541933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d23c5a86-4d8e-416e-b424-a15fd8ac2c3f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:25.990064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d23c5a86-4d8e-416e-b424-a15fd8ac2c3f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:25.998793 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d23c5a86-4d8e-416e-b424-a15fd8ac2c3f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1313 microversion: 2.1 time: 0.472717 Mar 12 21:03:26.010859 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2708/3476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:25 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:26.026566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-79dfe077-d459-4511-9b06-851bcd5587c3 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] Action: 'create', calling method: .version_select at 0x7f6e36f85940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2027980317", "metadata": {"Type": "work"}}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:26.030042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-79dfe077-d459-4511-9b06-851bcd5587c3 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:26.036534 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-79dfe077-d459-4511-9b06-851bcd5587c3 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023226 Mar 12 21:03:26.048324 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2709/3477] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Mar 12 21:03:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:03:26.058540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ad7510c-df0a-427a-bc32-c59f1497f59d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:26.059172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ad7510c-df0a-427a-bc32-c59f1497f59d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:26.090881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ad7510c-df0a-427a-bc32-c59f1497f59d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:26.091516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ad7510c-df0a-427a-bc32-c59f1497f59d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:26.092350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ad7510c-df0a-427a-bc32-c59f1497f59d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:26.092865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ad7510c-df0a-427a-bc32-c59f1497f59d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:26.508404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ad7510c-df0a-427a-bc32-c59f1497f59d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:26.521456 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ad7510c-df0a-427a-bc32-c59f1497f59d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1313 microversion: 2.1 time: 0.471213 Mar 12 21:03:26.533390 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2710/3478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:26 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:26.539423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6e753bef-ef92-45f6-b53c-71d922b5bebe tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] Calling method '.version_select at 0x7f6e3709adc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:26.592803 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-6e753bef-ef92-45f6-b53c-71d922b5bebe tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] HTTP exception thrown: Volume tempest-invalid-1849221387 could not be found. Mar 12 21:03:26.595120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6e753bef-ef92-45f6-b53c-71d922b5bebe tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] Returning 404 to user: Volume tempest-invalid-1849221387 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:26.596292 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6e753bef-ef92-45f6-b53c-71d922b5bebe tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1849221387" status: 404 len: 99 microversion: 2.1 time: 0.061455 Mar 12 21:03:26.597118 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2711/3479] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Mar 12 21:03:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1849221387 => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 21:03:26.602659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:26.604170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:26.613784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:26.615880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:26.617021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:26.617715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:26.713713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:26.714245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:26.714805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lazy-loading 'fault' on Instance uuid 778542bb-e748-4ad8-b3ac-19536cb3315c {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:03:26.848035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:26.861440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:26.866529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:26.871446 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7afeef1-8f2f-4a7e-85ff-a1e041650296 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 200 len: 1368 microversion: 2.47 time: 0.273038 Mar 12 21:03:26.879457 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2712/3480] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:26 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:26.891631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d83fb5c6-9e55-42b1-b0f6-f22ebd8ffc26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:26.892258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d83fb5c6-9e55-42b1-b0f6-f22ebd8ffc26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:26.920697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d83fb5c6-9e55-42b1-b0f6-f22ebd8ffc26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:26.925222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d83fb5c6-9e55-42b1-b0f6-f22ebd8ffc26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:26.926111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d83fb5c6-9e55-42b1-b0f6-f22ebd8ffc26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:26.926589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d83fb5c6-9e55-42b1-b0f6-f22ebd8ffc26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:27.336849 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:03:27.337364 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:03:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:03:27.542706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d83fb5c6-9e55-42b1-b0f6-f22ebd8ffc26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:27.558294 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d83fb5c6-9e55-42b1-b0f6-f22ebd8ffc26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 200 len: 1315 microversion: 2.1 time: 0.673184 Mar 12 21:03:27.559187 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2713/3481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:26 2022] GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:27.577735 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb437797-cc7b-4b08-9fa3-51837db9df6a tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006564 Mar 12 21:03:27.583543 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2714/3482] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Mar 12 21:03:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 12 21:03:27.594644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9cc6d184-c3cd-406d-a79e-678f3474c405 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:27.596517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9cc6d184-c3cd-406d-a79e-678f3474c405 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:27.604355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cc6d184-c3cd-406d-a79e-678f3474c405 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:27.605131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cc6d184-c3cd-406d-a79e-678f3474c405 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:27.607670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cc6d184-c3cd-406d-a79e-678f3474c405 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:27.609942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cc6d184-c3cd-406d-a79e-678f3474c405 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:27.905743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9cc6d184-c3cd-406d-a79e-678f3474c405 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:27.916064 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9cc6d184-c3cd-406d-a79e-678f3474c405 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1334 microversion: 2.1 time: 0.329818 Mar 12 21:03:27.918353 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2715/3483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:27 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1334 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:27.942097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d30b58b3-c10f-4fa3-9e17-1706672ab444 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:27.942722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d30b58b3-c10f-4fa3-9e17-1706672ab444 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:27.951723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d30b58b3-c10f-4fa3-9e17-1706672ab444 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:27.952434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d30b58b3-c10f-4fa3-9e17-1706672ab444 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:27.954183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d30b58b3-c10f-4fa3-9e17-1706672ab444 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:27.955410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d30b58b3-c10f-4fa3-9e17-1706672ab444 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:28.519379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d30b58b3-c10f-4fa3-9e17-1706672ab444 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:28.532525 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d30b58b3-c10f-4fa3-9e17-1706672ab444 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1498 microversion: 2.1 time: 0.608555 Mar 12 21:03:28.545405 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2716/3484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:27 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1498 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:28.553981 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b5c4e44-6325-44f5-89cd-8df4190eba6d tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004806 Mar 12 21:03:28.555233 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2717/3485] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 21:03:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 12 21:03:28.560540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1ed037f-a475-4f7a-9b35-1680f5da3dc1 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:28.561333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a1ed037f-a475-4f7a-9b35-1680f5da3dc1 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 778542bb-e748-4ad8-b3ac-19536cb3315c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:28.569214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ed037f-a475-4f7a-9b35-1680f5da3dc1 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:28.570044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ed037f-a475-4f7a-9b35-1680f5da3dc1 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:28.571319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ed037f-a475-4f7a-9b35-1680f5da3dc1 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:28.571934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ed037f-a475-4f7a-9b35-1680f5da3dc1 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:28.594178 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a1ed037f-a475-4f7a-9b35-1680f5da3dc1 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] HTTP exception thrown: Instance 778542bb-e748-4ad8-b3ac-19536cb3315c could not be found. Mar 12 21:03:28.595078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1ed037f-a475-4f7a-9b35-1680f5da3dc1 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Returning 404 to user: Instance 778542bb-e748-4ad8-b3ac-19536cb3315c could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:28.596449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1ed037f-a475-4f7a-9b35-1680f5da3dc1 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c" status: 404 len: 111 microversion: 2.47 time: 0.040055 Mar 12 21:03:28.597494 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2718/3486] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:28 2022] GET /compute/v2.1/servers/778542bb-e748-4ad8-b3ac-19536cb3315c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:03:28.604037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8a4c2fc3-dc41-4b54-a4f4-fb6aa2cef32a req-b1a7a254-4112-4bfa-84fc-ec7e3d668e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008404bd-cccb-4df6-925f-1b5fd2b25b04", "name": "network-vif-plugged", "status": "completed", "tag": "51fd0a73-6532-4ffa-b723-fa81d3e3f852"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:28.619164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8a4c2fc3-dc41-4b54-a4f4-fb6aa2cef32a req-b1a7a254-4112-4bfa-84fc-ec7e3d668e76 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:28.619882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8a4c2fc3-dc41-4b54-a4f4-fb6aa2cef32a req-b1a7a254-4112-4bfa-84fc-ec7e3d668e76 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:28.642024 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8a4c2fc3-dc41-4b54-a4f4-fb6aa2cef32a req-b1a7a254-4112-4bfa-84fc-ec7e3d668e76 service nova] Creating event network-vif-plugged:51fd0a73-6532-4ffa-b723-fa81d3e3f852 for instance 008404bd-cccb-4df6-925f-1b5fd2b25b04 on nch1-master-1 Mar 12 21:03:28.649343 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8a4c2fc3-dc41-4b54-a4f4-fb6aa2cef32a req-b1a7a254-4112-4bfa-84fc-ec7e3d668e76 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050348 Mar 12 21:03:28.650727 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2719/3487] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:28.686491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80d96628-5c4a-4d70-b8e0-7d012d6266e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:28.698011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80d96628-5c4a-4d70-b8e0-7d012d6266e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:28.710801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80d96628-5c4a-4d70-b8e0-7d012d6266e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:28.712147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80d96628-5c4a-4d70-b8e0-7d012d6266e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:28.713595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80d96628-5c4a-4d70-b8e0-7d012d6266e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:28.714408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80d96628-5c4a-4d70-b8e0-7d012d6266e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:28.766330 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80d96628-5c4a-4d70-b8e0-7d012d6266e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107993 Mar 12 21:03:28.768819 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2720/3488] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:03:28 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:28.782007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67f8d3c0-2ad1-4eba-bd56-238bd673e39e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:28.784517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-67f8d3c0-2ad1-4eba-bd56-238bd673e39e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:28.793421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67f8d3c0-2ad1-4eba-bd56-238bd673e39e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:28.794463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67f8d3c0-2ad1-4eba-bd56-238bd673e39e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:28.795602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67f8d3c0-2ad1-4eba-bd56-238bd673e39e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:28.796210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67f8d3c0-2ad1-4eba-bd56-238bd673e39e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:28.841326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-67f8d3c0-2ad1-4eba-bd56-238bd673e39e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lazy-loading 'flavor' on Instance uuid f6826699-d144-4b11-a12e-7912580e476a {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:03:29.007460 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67f8d3c0-2ad1-4eba-bd56-238bd673e39e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "POST /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a/action" status: 200 len: 32 microversion: 2.1 time: 0.235666 Mar 12 21:03:29.010295 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2721/3489] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:03:28 2022] POST /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:03:29.028080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3478e4d-830b-4312-865f-061b5d4822a6 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] Calling method '.version_select at 0x7f6e37322820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:29.086285 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c3478e4d-830b-4312-865f-061b5d4822a6 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] HTTP exception thrown: Volume d875f788-7b70-46a4-abf7-1914810f4e27 could not be found. Mar 12 21:03:29.087257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3478e4d-830b-4312-865f-061b5d4822a6 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] Returning 404 to user: Volume d875f788-7b70-46a4-abf7-1914810f4e27 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:29.088292 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3478e4d-830b-4312-865f-061b5d4822a6 tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/d875f788-7b70-46a4-abf7-1914810f4e27" status: 404 len: 109 microversion: 2.1 time: 0.076690 Mar 12 21:03:29.096343 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2722/3490] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 21:03:29 2022] DELETE /compute/v2.1/os-volumes/d875f788-7b70-46a4-abf7-1914810f4e27 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:03:29.103859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c80694fc-b172-493d-96f4-3957d2620656 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:29.104617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c80694fc-b172-493d-96f4-3957d2620656 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:29.113712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c80694fc-b172-493d-96f4-3957d2620656 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:29.117246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c80694fc-b172-493d-96f4-3957d2620656 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:29.118326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c80694fc-b172-493d-96f4-3957d2620656 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:29.118880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c80694fc-b172-493d-96f4-3957d2620656 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:29.529466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c80694fc-b172-493d-96f4-3957d2620656 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:29.539105 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c80694fc-b172-493d-96f4-3957d2620656 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 200 len: 1315 microversion: 2.1 time: 0.440262 Mar 12 21:03:29.540142 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2723/3491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:29 2022] GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:29.545142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0e07c1e1-0880-48ac-8388-cbbb1a38a04f tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:29.545982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0e07c1e1-0880-48ac-8388-cbbb1a38a04f tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:29.555001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e07c1e1-0880-48ac-8388-cbbb1a38a04f tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:29.555769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e07c1e1-0880-48ac-8388-cbbb1a38a04f tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:29.556788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e07c1e1-0880-48ac-8388-cbbb1a38a04f tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:29.557468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e07c1e1-0880-48ac-8388-cbbb1a38a04f tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:29.588651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0e07c1e1-0880-48ac-8388-cbbb1a38a04f tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:03:29.692284 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0e07c1e1-0880-48ac-8388-cbbb1a38a04f tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112" status: 204 len: 0 microversion: 2.47 time: 0.150298 Mar 12 21:03:29.696144 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2724/3492] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 21:03:29 2022] DELETE /compute/v2.1/servers/3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:03:29.700821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ff2f8d4c-9b95-4b7f-86f7-2d903a1dd932 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:29.701549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ff2f8d4c-9b95-4b7f-86f7-2d903a1dd932 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:29.708803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff2f8d4c-9b95-4b7f-86f7-2d903a1dd932 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:29.709364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff2f8d4c-9b95-4b7f-86f7-2d903a1dd932 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:29.710287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff2f8d4c-9b95-4b7f-86f7-2d903a1dd932 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:29.710872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff2f8d4c-9b95-4b7f-86f7-2d903a1dd932 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:29.752518 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ff2f8d4c-9b95-4b7f-86f7-2d903a1dd932 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments/6f03d07d-1804-458a-9612-e9595afeb76a" status: 200 len: 194 microversion: 2.1 time: 0.057261 Mar 12 21:03:29.753335 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2725/3493] 10.222.0.30 () {58 vars in 1412 bytes} [Sat Mar 12 21:03:29 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments/6f03d07d-1804-458a-9612-e9595afeb76a => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:29.760303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d2e7241-195c-48b1-a6a2-c91c31acace5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:29.760797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d2e7241-195c-48b1-a6a2-c91c31acace5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:29.777944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d2e7241-195c-48b1-a6a2-c91c31acace5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:29.778411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d2e7241-195c-48b1-a6a2-c91c31acace5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:29.779213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d2e7241-195c-48b1-a6a2-c91c31acace5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:29.779667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d2e7241-195c-48b1-a6a2-c91c31acace5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:30.560260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d2e7241-195c-48b1-a6a2-c91c31acace5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:30.569915 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d2e7241-195c-48b1-a6a2-c91c31acace5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.815694 Mar 12 21:03:30.583061 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2726/3494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:29 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:30.588899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ee44ad8-73fb-4bff-8b6f-c156ec767497 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:30.589517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ee44ad8-73fb-4bff-8b6f-c156ec767497 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:30.598047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee44ad8-73fb-4bff-8b6f-c156ec767497 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:30.598496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee44ad8-73fb-4bff-8b6f-c156ec767497 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:30.599534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee44ad8-73fb-4bff-8b6f-c156ec767497 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:30.600129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee44ad8-73fb-4bff-8b6f-c156ec767497 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:30.879040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ee44ad8-73fb-4bff-8b6f-c156ec767497 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:30.891379 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ee44ad8-73fb-4bff-8b6f-c156ec767497 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.305572 Mar 12 21:03:30.895060 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2727/3495] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:30 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:30.904785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f15e6fe6-0804-453f-9ff6-f4d0cbb95d1e tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] Calling method '.version_select at 0x7f6e37322e50>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:30.945492 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f15e6fe6-0804-453f-9ff6-f4d0cbb95d1e tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] HTTP exception thrown: Volume 1f1bd210-0346-4710-88d8-39ec2c596cdf could not be found. Mar 12 21:03:30.946193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f15e6fe6-0804-453f-9ff6-f4d0cbb95d1e tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] Returning 404 to user: Volume 1f1bd210-0346-4710-88d8-39ec2c596cdf could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:30.947463 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f15e6fe6-0804-453f-9ff6-f4d0cbb95d1e tempest-VolumesNegativeTest-234111704 tempest-VolumesNegativeTest-234111704-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/1f1bd210-0346-4710-88d8-39ec2c596cdf" status: 404 len: 109 microversion: 2.1 time: 0.051270 Mar 12 21:03:30.948237 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2728/3496] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 21:03:30 2022] GET /compute/v2.1/os-volumes/1f1bd210-0346-4710-88d8-39ec2c596cdf => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:03:30.953598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f794a7e0-877e-40ef-b962-ba421ca37250 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:30.954828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f794a7e0-877e-40ef-b962-ba421ca37250 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:30.967851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f794a7e0-877e-40ef-b962-ba421ca37250 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:30.970714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f794a7e0-877e-40ef-b962-ba421ca37250 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:30.974674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f794a7e0-877e-40ef-b962-ba421ca37250 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:30.975386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f794a7e0-877e-40ef-b962-ba421ca37250 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:31.147611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f794a7e0-877e-40ef-b962-ba421ca37250 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:31.163501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f794a7e0-877e-40ef-b962-ba421ca37250 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:31.185724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f794a7e0-877e-40ef-b962-ba421ca37250 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1357dc80ed9d4d1b8dc7871160ffa4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f0629679d143289f5bc0c3e6961504', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:31.187937 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f794a7e0-877e-40ef-b962-ba421ca37250 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112" status: 200 len: 1362 microversion: 2.47 time: 0.238051 Mar 12 21:03:31.191683 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2729/3497] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:30 2022] GET /compute/v2.1/servers/3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:31.210270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-83c9c918-9d7f-4bdc-a352-61deff5996f8 req-186b86f7-7549-4891-bf06-5f2ae88accf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c", "tag": "db6d65d6-6889-4d76-ae7c-b38b4d3ffa62"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:31.223944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-83c9c918-9d7f-4bdc-a352-61deff5996f8 req-186b86f7-7549-4891-bf06-5f2ae88accf4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:31.224640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-83c9c918-9d7f-4bdc-a352-61deff5996f8 req-186b86f7-7549-4891-bf06-5f2ae88accf4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:31.260188 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-83c9c918-9d7f-4bdc-a352-61deff5996f8 req-186b86f7-7549-4891-bf06-5f2ae88accf4 service nova] Creating event network-changed:db6d65d6-6889-4d76-ae7c-b38b4d3ffa62 for instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c on nch2-master-1 Mar 12 21:03:31.266684 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-83c9c918-9d7f-4bdc-a352-61deff5996f8 req-186b86f7-7549-4891-bf06-5f2ae88accf4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072200 Mar 12 21:03:31.269405 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2730/3498] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:31.288827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c0f0571-622d-4fae-a17e-b8fdb436aa39 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:31.290870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c0f0571-622d-4fae-a17e-b8fdb436aa39 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:31.307085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c0f0571-622d-4fae-a17e-b8fdb436aa39 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:31.307635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c0f0571-622d-4fae-a17e-b8fdb436aa39 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:31.311660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c0f0571-622d-4fae-a17e-b8fdb436aa39 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:31.313646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c0f0571-622d-4fae-a17e-b8fdb436aa39 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:32.323028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9c0f0571-622d-4fae-a17e-b8fdb436aa39 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:32.331609 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c0f0571-622d-4fae-a17e-b8fdb436aa39 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 200 len: 1502 microversion: 2.1 time: 1.060578 Mar 12 21:03:32.332290 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2731/3499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:31 2022] GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 1502 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:32.337652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d83b1b4b-b95f-4564-8956-ecd276bbaebe tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2b7192d-10f9-48ef-a117-75f8bbc93b0f"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:32.339313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d83b1b4b-b95f-4564-8956-ecd276bbaebe tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:32.347494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d83b1b4b-b95f-4564-8956-ecd276bbaebe tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:32.348210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d83b1b4b-b95f-4564-8956-ecd276bbaebe tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:32.350506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d83b1b4b-b95f-4564-8956-ecd276bbaebe tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:32.351144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d83b1b4b-b95f-4564-8956-ecd276bbaebe tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:32.739016 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d83b1b4b-b95f-4564-8956-ecd276bbaebe tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "POST /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404971 Mar 12 21:03:32.748122 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2732/3500] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:03:32 2022] POST /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:32.764671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8dd7e4aa-bb1d-4db0-bb77-86a3ff787d4d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:32.769896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8dd7e4aa-bb1d-4db0-bb77-86a3ff787d4d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:32.776853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dd7e4aa-bb1d-4db0-bb77-86a3ff787d4d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:32.779424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dd7e4aa-bb1d-4db0-bb77-86a3ff787d4d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:32.782600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dd7e4aa-bb1d-4db0-bb77-86a3ff787d4d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:32.783536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dd7e4aa-bb1d-4db0-bb77-86a3ff787d4d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:33.141540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8dd7e4aa-bb1d-4db0-bb77-86a3ff787d4d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:33.160402 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8dd7e4aa-bb1d-4db0-bb77-86a3ff787d4d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.410345 Mar 12 21:03:33.168500 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2733/3501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:32 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:33.182577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fea23da3-f728-47c2-81ae-7d62e12305aa tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:33.204749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fea23da3-f728-47c2-81ae-7d62e12305aa tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:33.212595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fea23da3-f728-47c2-81ae-7d62e12305aa tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:33.213700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fea23da3-f728-47c2-81ae-7d62e12305aa tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:33.221479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fea23da3-f728-47c2-81ae-7d62e12305aa tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:33.222692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fea23da3-f728-47c2-81ae-7d62e12305aa tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:33.515319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fea23da3-f728-47c2-81ae-7d62e12305aa tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:33.525534 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fea23da3-f728-47c2-81ae-7d62e12305aa tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.346288 Mar 12 21:03:33.528789 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2734/3502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:33 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:33.537082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d604df56-87ec-4cfd-93be-fc0f0cc37c78 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:33.538227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d604df56-87ec-4cfd-93be-fc0f0cc37c78 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] [instance: 3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:33.548853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d604df56-87ec-4cfd-93be-fc0f0cc37c78 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:33.550157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d604df56-87ec-4cfd-93be-fc0f0cc37c78 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:33.551231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d604df56-87ec-4cfd-93be-fc0f0cc37c78 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:33.551839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d604df56-87ec-4cfd-93be-fc0f0cc37c78 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:33.576344 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d604df56-87ec-4cfd-93be-fc0f0cc37c78 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] HTTP exception thrown: Instance 3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112 could not be found. Mar 12 21:03:33.577270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d604df56-87ec-4cfd-93be-fc0f0cc37c78 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] Returning 404 to user: Instance 3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:33.580199 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d604df56-87ec-4cfd-93be-fc0f0cc37c78 tempest-ServerShowV247Test-462707536 tempest-ServerShowV247Test-462707536-project] 10.222.0.30 "GET /compute/v2.1/servers/3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112" status: 404 len: 111 microversion: 2.47 time: 0.048477 Mar 12 21:03:33.580977 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2735/3503] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:33 2022] GET /compute/v2.1/servers/3bdfbe50-fa9d-4051-bdfa-78d5c0ee4112 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:03:33.591191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51c6b159-31ef-4be2-9aa1-7a4ed8737a4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:33.594099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51c6b159-31ef-4be2-9aa1-7a4ed8737a4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:33.603911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51c6b159-31ef-4be2-9aa1-7a4ed8737a4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:33.604893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51c6b159-31ef-4be2-9aa1-7a4ed8737a4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:33.606705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51c6b159-31ef-4be2-9aa1-7a4ed8737a4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:33.607683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51c6b159-31ef-4be2-9aa1-7a4ed8737a4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:33.664958 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51c6b159-31ef-4be2-9aa1-7a4ed8737a4a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04/action" status: 200 len: 14 microversion: 2.1 time: 0.082482 Mar 12 21:03:33.668846 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2736/3504] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:03:33 2022] POST /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:03:33.902831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ae02ea2f-ff98-4d72-b4ec-dc47837e21b1 req-f506c691-3541-4527-8b44-14687486237d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c", "tag": "c090e91e-106e-4003-a4bd-bbeaac8461fb"}, {"name": "network-changed", "server_uuid": "bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c", "tag": "0a132130-86e2-49e7-a4a9-79c91e3d14cb"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:33.928422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ae02ea2f-ff98-4d72-b4ec-dc47837e21b1 req-f506c691-3541-4527-8b44-14687486237d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:33.928882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ae02ea2f-ff98-4d72-b4ec-dc47837e21b1 req-f506c691-3541-4527-8b44-14687486237d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:33.970343 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ae02ea2f-ff98-4d72-b4ec-dc47837e21b1 req-f506c691-3541-4527-8b44-14687486237d service nova] Creating event network-changed:c090e91e-106e-4003-a4bd-bbeaac8461fb for instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c on nch2-master-1 Mar 12 21:03:33.970866 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ae02ea2f-ff98-4d72-b4ec-dc47837e21b1 req-f506c691-3541-4527-8b44-14687486237d service nova] Creating event network-changed:0a132130-86e2-49e7-a4a9-79c91e3d14cb for instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c on nch2-master-1 Mar 12 21:03:33.995266 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ae02ea2f-ff98-4d72-b4ec-dc47837e21b1 req-f506c691-3541-4527-8b44-14687486237d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096574 Mar 12 21:03:33.997373 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2737/3505] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:34.193673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-639ba842-5568-42b2-8e98-b5ef2277e5c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:34.198611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-639ba842-5568-42b2-8e98-b5ef2277e5c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:34.212764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-639ba842-5568-42b2-8e98-b5ef2277e5c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:34.213224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-639ba842-5568-42b2-8e98-b5ef2277e5c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:34.214162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-639ba842-5568-42b2-8e98-b5ef2277e5c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:34.220186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-639ba842-5568-42b2-8e98-b5ef2277e5c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:34.616967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-639ba842-5568-42b2-8e98-b5ef2277e5c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:34.626066 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-639ba842-5568-42b2-8e98-b5ef2277e5c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.441787 Mar 12 21:03:34.626676 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2738/3506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:34 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:03:34.632071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c65a4587-8f51-49be-8a28-e785c5cc823b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:34.632915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c65a4587-8f51-49be-8a28-e785c5cc823b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:34.641834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65a4587-8f51-49be-8a28-e785c5cc823b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:34.642320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65a4587-8f51-49be-8a28-e785c5cc823b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:34.643078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65a4587-8f51-49be-8a28-e785c5cc823b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:34.643613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65a4587-8f51-49be-8a28-e785c5cc823b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:35.103427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c65a4587-8f51-49be-8a28-e785c5cc823b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:35.117409 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c65a4587-8f51-49be-8a28-e785c5cc823b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.486988 Mar 12 21:03:35.119360 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2739/3507] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:34 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:35.140833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1bc5288d-34bf-495d-a59b-c7fadce6537a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:35.141912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1bc5288d-34bf-495d-a59b-c7fadce6537a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:35.150892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bc5288d-34bf-495d-a59b-c7fadce6537a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:35.154749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bc5288d-34bf-495d-a59b-c7fadce6537a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:35.160022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bc5288d-34bf-495d-a59b-c7fadce6537a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:35.160653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bc5288d-34bf-495d-a59b-c7fadce6537a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:35.223771 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1bc5288d-34bf-495d-a59b-c7fadce6537a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04/action" status: 200 len: 14 microversion: 2.1 time: 0.101346 Mar 12 21:03:35.224558 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2740/3508] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:03:35 2022] POST /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:03:35.650612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1b9bcbfd-f29b-4b19-8bd9-984dc3d58b08 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:35.655387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1b9bcbfd-f29b-4b19-8bd9-984dc3d58b08 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:35.671086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b9bcbfd-f29b-4b19-8bd9-984dc3d58b08 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:35.672549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b9bcbfd-f29b-4b19-8bd9-984dc3d58b08 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:35.673568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b9bcbfd-f29b-4b19-8bd9-984dc3d58b08 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:35.674171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b9bcbfd-f29b-4b19-8bd9-984dc3d58b08 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:36.054543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1b9bcbfd-f29b-4b19-8bd9-984dc3d58b08 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:36.064918 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1b9bcbfd-f29b-4b19-8bd9-984dc3d58b08 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.423855 Mar 12 21:03:36.065527 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2741/3509] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:35 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:36.138531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4913ff54-df65-4df2-b986-21beb5f082eb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:36.139293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4913ff54-df65-4df2-b986-21beb5f082eb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:36.150891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4913ff54-df65-4df2-b986-21beb5f082eb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:36.153380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4913ff54-df65-4df2-b986-21beb5f082eb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:36.154224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4913ff54-df65-4df2-b986-21beb5f082eb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:36.154680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4913ff54-df65-4df2-b986-21beb5f082eb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:36.507389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4913ff54-df65-4df2-b986-21beb5f082eb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:36.523127 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4913ff54-df65-4df2-b986-21beb5f082eb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.391063 Mar 12 21:03:36.524920 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2742/3510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:36 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:36.533397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b20e964-3c1e-4a3e-a96f-f777a37828a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:36.535041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b20e964-3c1e-4a3e-a96f-f777a37828a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:36.544692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b20e964-3c1e-4a3e-a96f-f777a37828a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:36.545255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b20e964-3c1e-4a3e-a96f-f777a37828a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:36.546486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b20e964-3c1e-4a3e-a96f-f777a37828a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:36.547684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b20e964-3c1e-4a3e-a96f-f777a37828a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:36.612059 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b20e964-3c1e-4a3e-a96f-f777a37828a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04/action" status: 200 len: 14 microversion: 2.1 time: 0.084057 Mar 12 21:03:36.613000 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2743/3511] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:03:36 2022] POST /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:03:36.624237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d159b4a2-d49f-4951-84b4-2d0647eba884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:36.626405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d159b4a2-d49f-4951-84b4-2d0647eba884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:36.635496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d159b4a2-d49f-4951-84b4-2d0647eba884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:36.636242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d159b4a2-d49f-4951-84b4-2d0647eba884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:36.637306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d159b4a2-d49f-4951-84b4-2d0647eba884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:36.638018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d159b4a2-d49f-4951-84b4-2d0647eba884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:36.705437 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d159b4a2-d49f-4951-84b4-2d0647eba884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.090971 Mar 12 21:03:36.709605 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2744/3512] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:03:36 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:36.867507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2b9b8b69-f5f0-40a9-8a49-6529a9d2887a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:36.869713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2b9b8b69-f5f0-40a9-8a49-6529a9d2887a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:36.892371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b9b8b69-f5f0-40a9-8a49-6529a9d2887a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:36.893289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b9b8b69-f5f0-40a9-8a49-6529a9d2887a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:36.896865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b9b8b69-f5f0-40a9-8a49-6529a9d2887a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:36.897325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b9b8b69-f5f0-40a9-8a49-6529a9d2887a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:36.987791 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2b9b8b69-f5f0-40a9-8a49-6529a9d2887a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments/6f03d07d-1804-458a-9612-e9595afeb76a" status: 200 len: 194 microversion: 2.1 time: 0.136482 Mar 12 21:03:36.994578 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2745/3513] 10.222.0.30 () {58 vars in 1412 bytes} [Sat Mar 12 21:03:36 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments/6f03d07d-1804-458a-9612-e9595afeb76a => generated 194 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:03:37.004548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1652e84e-3abb-45de-bfb9-66fa17b89239 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:37.014328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1652e84e-3abb-45de-bfb9-66fa17b89239 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:37.021379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1652e84e-3abb-45de-bfb9-66fa17b89239 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:37.021862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1652e84e-3abb-45de-bfb9-66fa17b89239 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:37.022654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1652e84e-3abb-45de-bfb9-66fa17b89239 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:37.023096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1652e84e-3abb-45de-bfb9-66fa17b89239 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:37.144650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-1652e84e-3abb-45de-bfb9-66fa17b89239 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lazy-loading 'services' on Instance uuid ed5a70e8-3738-4058-94d8-a41af23a25af {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:03:37.270936 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1652e84e-3abb-45de-bfb9-66fa17b89239 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments/6f03d07d-1804-458a-9612-e9595afeb76a" status: 202 len: 0 microversion: 2.1 time: 0.270796 Mar 12 21:03:37.271797 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2746/3514] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:03:36 2022] DELETE /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments/6f03d07d-1804-458a-9612-e9595afeb76a => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:03:37.301894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-525d33e9-e60a-4381-a093-a15100f111f2 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:37.303179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-525d33e9-e60a-4381-a093-a15100f111f2 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:37.320109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-525d33e9-e60a-4381-a093-a15100f111f2 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:37.321503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-525d33e9-e60a-4381-a093-a15100f111f2 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:37.323316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-525d33e9-e60a-4381-a093-a15100f111f2 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:37.324744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-525d33e9-e60a-4381-a093-a15100f111f2 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:37.619280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-525d33e9-e60a-4381-a093-a15100f111f2 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:37.638986 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-525d33e9-e60a-4381-a093-a15100f111f2 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.352321 Mar 12 21:03:37.641654 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2747/3515] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:37 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:37.824395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-570749196", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": "none"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:37.897679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:03:37.899195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:03:37.912492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:03:37.913560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:03:37.914176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:03:37.944901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:37.945565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:37.946760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:37.947217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:37.990466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Getting quotas for project 69110ed092e14906afc45f97a405bdc1. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:03:38.037432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Getting quotas for user a14a050fc0554b1a8e545248263cc886 and project 69110ed092e14906afc45f97a405bdc1. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:03:38.057885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:03:38.060643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:03:38.152701 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2dc72ef-fd6b-4355-a822-1b1445d9613f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.509439 Mar 12 21:03:38.165201 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2748/3516] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Mar 12 21:03:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 21:03:38.184154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4cecb309-51b1-4b51-985e-eeef44a0f055 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:38.185070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4cecb309-51b1-4b51-985e-eeef44a0f055 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:38.196504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cecb309-51b1-4b51-985e-eeef44a0f055 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:38.197555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cecb309-51b1-4b51-985e-eeef44a0f055 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:38.198673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cecb309-51b1-4b51-985e-eeef44a0f055 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:38.199514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cecb309-51b1-4b51-985e-eeef44a0f055 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:38.601592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4cecb309-51b1-4b51-985e-eeef44a0f055 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:38.612712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4cecb309-51b1-4b51-985e-eeef44a0f055 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.446012 Mar 12 21:03:38.622415 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2749/3517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:38 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:38.622415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59b10b63-bbfc-4d37-8c67-4058c6afb32c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:38.626047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59b10b63-bbfc-4d37-8c67-4058c6afb32c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:38.634258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59b10b63-bbfc-4d37-8c67-4058c6afb32c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:38.634715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59b10b63-bbfc-4d37-8c67-4058c6afb32c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:38.635500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59b10b63-bbfc-4d37-8c67-4058c6afb32c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:38.635943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59b10b63-bbfc-4d37-8c67-4058c6afb32c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:38.722085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59b10b63-bbfc-4d37-8c67-4058c6afb32c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04/action" status: 200 len: 14 microversion: 2.1 time: 0.103071 Mar 12 21:03:38.725665 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2750/3518] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:03:38 2022] POST /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:03:38.732848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-28c874d4-fc85-4fa1-9ad7-0455c0588f8d tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:38.733880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-28c874d4-fc85-4fa1-9ad7-0455c0588f8d tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:38.834333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-28c874d4-fc85-4fa1-9ad7-0455c0588f8d tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:38.844005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-28c874d4-fc85-4fa1-9ad7-0455c0588f8d tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:38.846224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-28c874d4-fc85-4fa1-9ad7-0455c0588f8d tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:38.848256 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-28c874d4-fc85-4fa1-9ad7-0455c0588f8d tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1277 microversion: 2.57 time: 0.123427 Mar 12 21:03:38.849439 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2751/3519] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:38 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:38.862044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e86cd7c6-8e71-45eb-bba7-65ab9bf7fd4b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:38.862549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e86cd7c6-8e71-45eb-bba7-65ab9bf7fd4b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:38.877007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e86cd7c6-8e71-45eb-bba7-65ab9bf7fd4b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:38.877992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e86cd7c6-8e71-45eb-bba7-65ab9bf7fd4b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:38.879626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e86cd7c6-8e71-45eb-bba7-65ab9bf7fd4b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:38.880671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e86cd7c6-8e71-45eb-bba7-65ab9bf7fd4b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:38.942280 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e86cd7c6-8e71-45eb-bba7-65ab9bf7fd4b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments/e2b7192d-10f9-48ef-a117-75f8bbc93b0f" status: 200 len: 194 microversion: 2.1 time: 0.090950 Mar 12 21:03:38.943139 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2752/3520] 10.222.0.30 () {58 vars in 1412 bytes} [Sat Mar 12 21:03:38 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments/e2b7192d-10f9-48ef-a117-75f8bbc93b0f => generated 194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:38.952092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd7062bc-6171-4525-bbac-786f99027840 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:38.954129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dd7062bc-6171-4525-bbac-786f99027840 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:38.960458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd7062bc-6171-4525-bbac-786f99027840 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:38.961118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd7062bc-6171-4525-bbac-786f99027840 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:38.962141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd7062bc-6171-4525-bbac-786f99027840 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:38.962745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd7062bc-6171-4525-bbac-786f99027840 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:39.555651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dd7062bc-6171-4525-bbac-786f99027840 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:39.565346 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd7062bc-6171-4525-bbac-786f99027840 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.620764 Mar 12 21:03:39.580906 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2753/3521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:38 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:39.587839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-78f3d75d-cd71-4eef-81d2-226f73c44538 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:39.588730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-78f3d75d-cd71-4eef-81d2-226f73c44538 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:39.599585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78f3d75d-cd71-4eef-81d2-226f73c44538 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:39.601520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78f3d75d-cd71-4eef-81d2-226f73c44538 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:39.604850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78f3d75d-cd71-4eef-81d2-226f73c44538 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:39.605506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78f3d75d-cd71-4eef-81d2-226f73c44538 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:39.809284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-78f3d75d-cd71-4eef-81d2-226f73c44538 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lazy-loading 'services' on Instance uuid ed5a70e8-3738-4058-94d8-a41af23a25af {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:03:39.961837 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-78f3d75d-cd71-4eef-81d2-226f73c44538 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments/e2b7192d-10f9-48ef-a117-75f8bbc93b0f" status: 202 len: 0 microversion: 2.1 time: 0.378534 Mar 12 21:03:39.962497 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2754/3522] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:03:39 2022] DELETE /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments/e2b7192d-10f9-48ef-a117-75f8bbc93b0f => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:03:39.972975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67d6ed98-f3f6-4017-a4d7-8f9e9099f1ae tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:39.974253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-67d6ed98-f3f6-4017-a4d7-8f9e9099f1ae tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:39.982521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67d6ed98-f3f6-4017-a4d7-8f9e9099f1ae tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:39.983435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67d6ed98-f3f6-4017-a4d7-8f9e9099f1ae tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:39.985973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67d6ed98-f3f6-4017-a4d7-8f9e9099f1ae tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:39.986750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67d6ed98-f3f6-4017-a4d7-8f9e9099f1ae tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:40.735554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-67d6ed98-f3f6-4017-a4d7-8f9e9099f1ae tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:40.750443 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67d6ed98-f3f6-4017-a4d7-8f9e9099f1ae tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.786008 Mar 12 21:03:40.760292 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2755/3523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:39 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:40.765328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9bab8b6-2d6f-423d-97fe-3d177b169b35 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:40.766340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9bab8b6-2d6f-423d-97fe-3d177b169b35 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:40.783438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9bab8b6-2d6f-423d-97fe-3d177b169b35 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:40.784685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9bab8b6-2d6f-423d-97fe-3d177b169b35 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:40.786652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9bab8b6-2d6f-423d-97fe-3d177b169b35 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:40.793269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9bab8b6-2d6f-423d-97fe-3d177b169b35 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:40.871446 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9bab8b6-2d6f-423d-97fe-3d177b169b35 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04/action" status: 200 len: 14 microversion: 2.1 time: 0.109500 Mar 12 21:03:40.873894 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2756/3524] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:03:40 2022] POST /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:03:40.882371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9081d6a-f5eb-49fb-8623-ea40ddc8dce7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:40.883394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9081d6a-f5eb-49fb-8623-ea40ddc8dce7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:40.905379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9081d6a-f5eb-49fb-8623-ea40ddc8dce7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:40.906812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9081d6a-f5eb-49fb-8623-ea40ddc8dce7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:40.908357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9081d6a-f5eb-49fb-8623-ea40ddc8dce7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:40.908864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9081d6a-f5eb-49fb-8623-ea40ddc8dce7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:41.017163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9081d6a-f5eb-49fb-8623-ea40ddc8dce7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:41.026575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9081d6a-f5eb-49fb-8623-ea40ddc8dce7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:41.031795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9081d6a-f5eb-49fb-8623-ea40ddc8dce7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:41.033151 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9081d6a-f5eb-49fb-8623-ea40ddc8dce7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1335 microversion: 2.57 time: 0.158854 Mar 12 21:03:41.041909 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2757/3525] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:40 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1335 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:41.042308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ff520e0c-0c9a-4af3-87b1-672626fbc526 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:41.043073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ff520e0c-0c9a-4af3-87b1-672626fbc526 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:41.058744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff520e0c-0c9a-4af3-87b1-672626fbc526 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:41.060953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff520e0c-0c9a-4af3-87b1-672626fbc526 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:41.061913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff520e0c-0c9a-4af3-87b1-672626fbc526 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:41.063838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff520e0c-0c9a-4af3-87b1-672626fbc526 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:41.326435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ff520e0c-0c9a-4af3-87b1-672626fbc526 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:41.337233 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ff520e0c-0c9a-4af3-87b1-672626fbc526 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.301639 Mar 12 21:03:41.338381 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2758/3526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:41 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:41.350034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-266df64c-0b45-43ca-8887-91d487a3a086 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:41.355069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-266df64c-0b45-43ca-8887-91d487a3a086 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:41.364193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-266df64c-0b45-43ca-8887-91d487a3a086 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:41.365738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-266df64c-0b45-43ca-8887-91d487a3a086 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:41.366818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-266df64c-0b45-43ca-8887-91d487a3a086 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:41.367748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-266df64c-0b45-43ca-8887-91d487a3a086 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:41.415556 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-266df64c-0b45-43ca-8887-91d487a3a086 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075599 Mar 12 21:03:41.416800 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2759/3527] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:03:41 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:03:41.549520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fcec3e6c-d710-40f9-9897-52c2032a0884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:41.550850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fcec3e6c-d710-40f9-9897-52c2032a0884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:41.559415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcec3e6c-d710-40f9-9897-52c2032a0884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:41.560224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcec3e6c-d710-40f9-9897-52c2032a0884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:41.561172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcec3e6c-d710-40f9-9897-52c2032a0884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:41.561816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcec3e6c-d710-40f9-9897-52c2032a0884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:41.602222 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fcec3e6c-d710-40f9-9897-52c2032a0884 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055609 Mar 12 21:03:41.604305 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2760/3528] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:03:41 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 12 21:03:41.686369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4de81758-d449-45d3-b33f-4b4bff6ce41b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:41.686820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4de81758-d449-45d3-b33f-4b4bff6ce41b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:41.696441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4de81758-d449-45d3-b33f-4b4bff6ce41b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:41.696982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4de81758-d449-45d3-b33f-4b4bff6ce41b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:41.698053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4de81758-d449-45d3-b33f-4b4bff6ce41b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:41.698530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4de81758-d449-45d3-b33f-4b4bff6ce41b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:41.736549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4de81758-d449-45d3-b33f-4b4bff6ce41b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:03:41.852156 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4de81758-d449-45d3-b33f-4b4bff6ce41b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 204 len: 0 microversion: 2.1 time: 0.170667 Mar 12 21:03:41.855868 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2761/3529] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:03:41 2022] DELETE /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:03:41.861933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a95f7ec-95cf-42b4-9a10-c3411e2ac6bb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:41.863423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0a95f7ec-95cf-42b4-9a10-c3411e2ac6bb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:41.875222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a95f7ec-95cf-42b4-9a10-c3411e2ac6bb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:41.876678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a95f7ec-95cf-42b4-9a10-c3411e2ac6bb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:41.878576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a95f7ec-95cf-42b4-9a10-c3411e2ac6bb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:41.880227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a95f7ec-95cf-42b4-9a10-c3411e2ac6bb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:42.087751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0a95f7ec-95cf-42b4-9a10-c3411e2ac6bb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:42.100771 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0a95f7ec-95cf-42b4-9a10-c3411e2ac6bb tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.243318 Mar 12 21:03:42.107934 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2762/3530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:41 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:42.112950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-87361a22-6886-47f8-abfd-b96261fe5e7b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:42.113584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-87361a22-6886-47f8-abfd-b96261fe5e7b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:42.120245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87361a22-6886-47f8-abfd-b96261fe5e7b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:42.120701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87361a22-6886-47f8-abfd-b96261fe5e7b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:42.121503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87361a22-6886-47f8-abfd-b96261fe5e7b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:42.122175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87361a22-6886-47f8-abfd-b96261fe5e7b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:42.415189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-87361a22-6886-47f8-abfd-b96261fe5e7b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:42.424665 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-87361a22-6886-47f8-abfd-b96261fe5e7b tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 200 len: 1674 microversion: 2.1 time: 0.315351 Mar 12 21:03:42.431539 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2763/3531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:42 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 1674 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:42.444516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e1cc09b-06aa-422e-ac5d-0048ffa5d2ca tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:42.447948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5e1cc09b-06aa-422e-ac5d-0048ffa5d2ca tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:42.457477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e1cc09b-06aa-422e-ac5d-0048ffa5d2ca tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:42.458022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e1cc09b-06aa-422e-ac5d-0048ffa5d2ca tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:42.458821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e1cc09b-06aa-422e-ac5d-0048ffa5d2ca tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:42.459257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e1cc09b-06aa-422e-ac5d-0048ffa5d2ca tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:42.512565 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e1cc09b-06aa-422e-ac5d-0048ffa5d2ca tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04/action" status: 200 len: 8208 microversion: 2.1 time: 0.079671 Mar 12 21:03:42.513938 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2764/3532] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:03:42 2022] POST /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04/action => generated 8208 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:42.523173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-62f32a7c-59f0-4447-9caa-784eb33a56c3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:42.524938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-62f32a7c-59f0-4447-9caa-784eb33a56c3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:42.544047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62f32a7c-59f0-4447-9caa-784eb33a56c3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:42.544638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62f32a7c-59f0-4447-9caa-784eb33a56c3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:42.545401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62f32a7c-59f0-4447-9caa-784eb33a56c3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:42.550083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62f32a7c-59f0-4447-9caa-784eb33a56c3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:42.702393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-62f32a7c-59f0-4447-9caa-784eb33a56c3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:42.719091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-62f32a7c-59f0-4447-9caa-784eb33a56c3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:42.726123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-62f32a7c-59f0-4447-9caa-784eb33a56c3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:42.732137 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-62f32a7c-59f0-4447-9caa-784eb33a56c3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1335 microversion: 2.57 time: 0.214206 Mar 12 21:03:42.734798 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2765/3533] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:42 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1335 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:42.743772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ed09a617-b8a8-4fee-8eb2-39bbe7a1511d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:42.744899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ed09a617-b8a8-4fee-8eb2-39bbe7a1511d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:42.754534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed09a617-b8a8-4fee-8eb2-39bbe7a1511d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:42.755424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed09a617-b8a8-4fee-8eb2-39bbe7a1511d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:42.756815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed09a617-b8a8-4fee-8eb2-39bbe7a1511d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:42.758629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed09a617-b8a8-4fee-8eb2-39bbe7a1511d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:43.117455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ed09a617-b8a8-4fee-8eb2-39bbe7a1511d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:43.130897 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ed09a617-b8a8-4fee-8eb2-39bbe7a1511d tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.392361 Mar 12 21:03:43.131424 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2766/3534] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:42 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:43.137475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-773aae6b-e2a7-4a03-b3d4-334c103b3359 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:43.142673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-773aae6b-e2a7-4a03-b3d4-334c103b3359 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:43.156089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-773aae6b-e2a7-4a03-b3d4-334c103b3359 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:43.159711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-773aae6b-e2a7-4a03-b3d4-334c103b3359 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:43.160877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-773aae6b-e2a7-4a03-b3d4-334c103b3359 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:43.161972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-773aae6b-e2a7-4a03-b3d4-334c103b3359 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:43.471529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-773aae6b-e2a7-4a03-b3d4-334c103b3359 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:43.484808 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-773aae6b-e2a7-4a03-b3d4-334c103b3359 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.351327 Mar 12 21:03:43.485616 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2767/3535] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:43 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:43.495453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-06e979ac-10b0-450d-aeab-4a03abd71130 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:43.496077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-06e979ac-10b0-450d-aeab-4a03abd71130 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:43.513405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06e979ac-10b0-450d-aeab-4a03abd71130 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:43.516312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06e979ac-10b0-450d-aeab-4a03abd71130 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:43.517361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06e979ac-10b0-450d-aeab-4a03abd71130 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:43.523894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06e979ac-10b0-450d-aeab-4a03abd71130 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:43.966869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-06e979ac-10b0-450d-aeab-4a03abd71130 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:43.987146 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-06e979ac-10b0-450d-aeab-4a03abd71130 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.500355 Mar 12 21:03:43.991082 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2768/3536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:43 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:44.006905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e3e336bb-53cb-44f8-8a61-fa481841aacf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:44.013021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e3e336bb-53cb-44f8-8a61-fa481841aacf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:44.027795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3e336bb-53cb-44f8-8a61-fa481841aacf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:44.044363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3e336bb-53cb-44f8-8a61-fa481841aacf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:44.045568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3e336bb-53cb-44f8-8a61-fa481841aacf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:44.046290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3e336bb-53cb-44f8-8a61-fa481841aacf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:44.501734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e3e336bb-53cb-44f8-8a61-fa481841aacf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec384ea1fe344a08a8b9491f10f3b211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4da7920d54243cd8381e283021d7745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:44.519190 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e3e336bb-53cb-44f8-8a61-fa481841aacf tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 200 len: 1674 microversion: 2.1 time: 0.526319 Mar 12 21:03:44.520427 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2769/3537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:43 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 1674 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:44.525371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0b5cfe7f-49e2-4d4b-9e7e-6ed28b0d6cee tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:44.526197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0b5cfe7f-49e2-4d4b-9e7e-6ed28b0d6cee tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:44.533853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b5cfe7f-49e2-4d4b-9e7e-6ed28b0d6cee tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:44.534525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b5cfe7f-49e2-4d4b-9e7e-6ed28b0d6cee tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:44.535503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b5cfe7f-49e2-4d4b-9e7e-6ed28b0d6cee tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:44.536141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b5cfe7f-49e2-4d4b-9e7e-6ed28b0d6cee tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:44.815992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0b5cfe7f-49e2-4d4b-9e7e-6ed28b0d6cee tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:44.845596 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0b5cfe7f-49e2-4d4b-9e7e-6ed28b0d6cee tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.318475 Mar 12 21:03:44.848997 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2770/3538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:44 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:44.857193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96519504-03a7-49ca-b13a-5d1d64d2dd9f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:44.857831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96519504-03a7-49ca-b13a-5d1d64d2dd9f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:44.875482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96519504-03a7-49ca-b13a-5d1d64d2dd9f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:44.878353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96519504-03a7-49ca-b13a-5d1d64d2dd9f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:44.879577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96519504-03a7-49ca-b13a-5d1d64d2dd9f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:44.885083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96519504-03a7-49ca-b13a-5d1d64d2dd9f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:45.149550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96519504-03a7-49ca-b13a-5d1d64d2dd9f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:45.160432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96519504-03a7-49ca-b13a-5d1d64d2dd9f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:45.166532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96519504-03a7-49ca-b13a-5d1d64d2dd9f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:45.175268 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96519504-03a7-49ca-b13a-5d1d64d2dd9f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1356 microversion: 2.57 time: 0.325114 Mar 12 21:03:45.198837 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2771/3539] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:44 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1356 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:45.215523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-83cba505-3d1f-45b6-a841-9462826245e9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:45.223493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-83cba505-3d1f-45b6-a841-9462826245e9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:45.231060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83cba505-3d1f-45b6-a841-9462826245e9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:45.231721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83cba505-3d1f-45b6-a841-9462826245e9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:45.235183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83cba505-3d1f-45b6-a841-9462826245e9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:45.243001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83cba505-3d1f-45b6-a841-9462826245e9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:45.804630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-83cba505-3d1f-45b6-a841-9462826245e9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:45.813820 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-83cba505-3d1f-45b6-a841-9462826245e9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.613564 Mar 12 21:03:45.819059 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2772/3540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:45 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:45.836755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3aa9b957-6f74-49b9-9fe5-a7377a6d51c4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:45.839829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3aa9b957-6f74-49b9-9fe5-a7377a6d51c4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:45.859462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3aa9b957-6f74-49b9-9fe5-a7377a6d51c4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:45.860317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3aa9b957-6f74-49b9-9fe5-a7377a6d51c4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:45.861541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3aa9b957-6f74-49b9-9fe5-a7377a6d51c4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:45.863293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3aa9b957-6f74-49b9-9fe5-a7377a6d51c4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:46.764764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3aa9b957-6f74-49b9-9fe5-a7377a6d51c4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:46.774136 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3aa9b957-6f74-49b9-9fe5-a7377a6d51c4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.953128 Mar 12 21:03:46.779877 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2773/3541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:45 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:46.787197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59b2f1c8-c6de-402e-945a-f65fc03bd7a0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:46.788175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59b2f1c8-c6de-402e-945a-f65fc03bd7a0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:46.813235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59b2f1c8-c6de-402e-945a-f65fc03bd7a0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:46.814715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59b2f1c8-c6de-402e-945a-f65fc03bd7a0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:46.818594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59b2f1c8-c6de-402e-945a-f65fc03bd7a0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:46.819337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59b2f1c8-c6de-402e-945a-f65fc03bd7a0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:47.267228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-59b2f1c8-c6de-402e-945a-f65fc03bd7a0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:47.276108 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59b2f1c8-c6de-402e-945a-f65fc03bd7a0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.494265 Mar 12 21:03:47.279434 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2774/3542] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:46 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:47.295053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:47.297968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:47.314653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:47.315445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:47.316441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:47.317039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:47.497641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:03:47.498999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:03:47.500953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:03:47.501566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:03:47.503382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:03:47.666952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:47.687384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:47.688123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:47.689182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:47.689803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:47.780105 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-589e83b8-0212-4318-ab9b-f8abfe763a76 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "POST /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c/action" status: 202 len: 1137 microversion: 2.57 time: 0.499351 Mar 12 21:03:47.785845 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2775/3543] 10.222.0.30 () {62 vars in 1319 bytes} [Sat Mar 12 21:03:47 2022] POST /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c/action => generated 1137 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 12 21:03:47.804664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f6fce5c1-1956-4168-bcbd-fc1ab48cb831 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:47.805296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f6fce5c1-1956-4168-bcbd-fc1ab48cb831 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:47.821218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6fce5c1-1956-4168-bcbd-fc1ab48cb831 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:47.821873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6fce5c1-1956-4168-bcbd-fc1ab48cb831 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:47.822522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6fce5c1-1956-4168-bcbd-fc1ab48cb831 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:47.822962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6fce5c1-1956-4168-bcbd-fc1ab48cb831 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:47.885609 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f6fce5c1-1956-4168-bcbd-fc1ab48cb831 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] HTTP exception thrown: Instance ed5a70e8-3738-4058-94d8-a41af23a25af could not be found. Mar 12 21:03:47.886355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f6fce5c1-1956-4168-bcbd-fc1ab48cb831 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Returning 404 to user: Instance ed5a70e8-3738-4058-94d8-a41af23a25af could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:47.889647 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f6fce5c1-1956-4168-bcbd-fc1ab48cb831 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 404 len: 111 microversion: 2.1 time: 0.101785 Mar 12 21:03:47.908002 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2776/3544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:47 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:03:48.374339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-dc690027-7dc9-4a61-bd67-6112280dfc55 req-ec9dc629-41b2-49ab-9b1a-df89df9720f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5a70e8-3738-4058-94d8-a41af23a25af", "name": "network-vif-deleted", "tag": "d8e3021e-2148-4e62-8ee0-5ffe41a6253c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:48.394722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-dc690027-7dc9-4a61-bd67-6112280dfc55 req-ec9dc629-41b2-49ab-9b1a-df89df9720f7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:48.395337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-dc690027-7dc9-4a61-bd67-6112280dfc55 req-ec9dc629-41b2-49ab-9b1a-df89df9720f7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:48.425597 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-dc690027-7dc9-4a61-bd67-6112280dfc55 req-ec9dc629-41b2-49ab-9b1a-df89df9720f7 service nova] Creating event network-vif-deleted:d8e3021e-2148-4e62-8ee0-5ffe41a6253c for instance ed5a70e8-3738-4058-94d8-a41af23a25af on nch2-master-1 Mar 12 21:03:48.433586 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-dc690027-7dc9-4a61-bd67-6112280dfc55 req-ec9dc629-41b2-49ab-9b1a-df89df9720f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.523320 Mar 12 21:03:48.434722 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2777/3545] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:48.630153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-da4ca8d3-759c-4753-a005-3dd26b9404e6 req-493eee97-8357-4381-aa62-1ff4a5b8d068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c", "name": "network-vif-plugged", "status": "completed", "tag": "db6d65d6-6889-4d76-ae7c-b38b4d3ffa62"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:48.644759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-da4ca8d3-759c-4753-a005-3dd26b9404e6 req-493eee97-8357-4381-aa62-1ff4a5b8d068 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:48.645413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-da4ca8d3-759c-4753-a005-3dd26b9404e6 req-493eee97-8357-4381-aa62-1ff4a5b8d068 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:48.660468 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-da4ca8d3-759c-4753-a005-3dd26b9404e6 req-493eee97-8357-4381-aa62-1ff4a5b8d068 service nova] Creating event network-vif-plugged:db6d65d6-6889-4d76-ae7c-b38b4d3ffa62 for instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c on nch2-master-1 Mar 12 21:03:48.666850 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-da4ca8d3-759c-4753-a005-3dd26b9404e6 req-493eee97-8357-4381-aa62-1ff4a5b8d068 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230681 Mar 12 21:03:48.668117 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2778/3546] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:48.676296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-584055af-6d16-44f6-b00a-008b2c8b68a4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:48.677909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-584055af-6d16-44f6-b00a-008b2c8b68a4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:48.688363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-584055af-6d16-44f6-b00a-008b2c8b68a4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:48.689154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-584055af-6d16-44f6-b00a-008b2c8b68a4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:48.690700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-584055af-6d16-44f6-b00a-008b2c8b68a4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:48.691380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-584055af-6d16-44f6-b00a-008b2c8b68a4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:48.943820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-584055af-6d16-44f6-b00a-008b2c8b68a4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:48.953891 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-584055af-6d16-44f6-b00a-008b2c8b68a4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.284177 Mar 12 21:03:48.954919 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2779/3547] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:48 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:48.962613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0234fc9d-d6d0-4172-9852-9f43107f76e3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:48.963938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0234fc9d-d6d0-4172-9852-9f43107f76e3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:48.973478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0234fc9d-d6d0-4172-9852-9f43107f76e3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:48.974436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0234fc9d-d6d0-4172-9852-9f43107f76e3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:48.976419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0234fc9d-d6d0-4172-9852-9f43107f76e3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:48.977158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0234fc9d-d6d0-4172-9852-9f43107f76e3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:49.237323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0234fc9d-d6d0-4172-9852-9f43107f76e3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:49.245724 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0234fc9d-d6d0-4172-9852-9f43107f76e3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.288781 Mar 12 21:03:49.247182 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2780/3548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:48 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:49.252764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4d3a7a68-7235-4442-9bc2-c2ba0117706c tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:49.253374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4d3a7a68-7235-4442-9bc2-c2ba0117706c tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:49.261048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d3a7a68-7235-4442-9bc2-c2ba0117706c tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:49.261905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d3a7a68-7235-4442-9bc2-c2ba0117706c tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:49.263206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d3a7a68-7235-4442-9bc2-c2ba0117706c tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:49.264092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d3a7a68-7235-4442-9bc2-c2ba0117706c tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:49.344414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4d3a7a68-7235-4442-9bc2-c2ba0117706c tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:49.355726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4d3a7a68-7235-4442-9bc2-c2ba0117706c tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:49.358034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4d3a7a68-7235-4442-9bc2-c2ba0117706c tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:49.360247 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4d3a7a68-7235-4442-9bc2-c2ba0117706c tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1365 microversion: 2.57 time: 0.111892 Mar 12 21:03:49.361292 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2781/3549] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:49 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1365 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:49.366574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b4c307e-2228-4f79-86b6-25fe37b6a4e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '.version_select at 0x7f6e37249160>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:49.387831 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b4c307e-2228-4f79-86b6-25fe37b6a4e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301130332" status: 202 len: 0 microversion: 2.1 time: 0.025276 Mar 12 21:03:49.392558 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2782/3550] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Mar 12 21:03:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301130332 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:03:49.398271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ed5b705-0e40-44b8-9fc9-ca2c62caecf9 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:49.398999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ed5b705-0e40-44b8-9fc9-ca2c62caecf9 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:49.406888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ed5b705-0e40-44b8-9fc9-ca2c62caecf9 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:49.407455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ed5b705-0e40-44b8-9fc9-ca2c62caecf9 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:49.408456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ed5b705-0e40-44b8-9fc9-ca2c62caecf9 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:49.408899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ed5b705-0e40-44b8-9fc9-ca2c62caecf9 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:49.724140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6ed5b705-0e40-44b8-9fc9-ca2c62caecf9 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:49.758563 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ed5b705-0e40-44b8-9fc9-ca2c62caecf9 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.362499 Mar 12 21:03:49.760608 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2783/3551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:49 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:49.771615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6d5c08a4-bdb5-4877-82de-29d1a5a91474 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:49.786988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6d5c08a4-bdb5-4877-82de-29d1a5a91474 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:49.801728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d5c08a4-bdb5-4877-82de-29d1a5a91474 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:49.806413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d5c08a4-bdb5-4877-82de-29d1a5a91474 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:49.808095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d5c08a4-bdb5-4877-82de-29d1a5a91474 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:49.808574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d5c08a4-bdb5-4877-82de-29d1a5a91474 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:49.929347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6d5c08a4-bdb5-4877-82de-29d1a5a91474 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Locking {{(pid=136302) lock /opt/stack/nova/nova/compute/api.py:4698}} Mar 12 21:03:50.024970 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6d5c08a4-bdb5-4877-82de-29d1a5a91474 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.261739 Mar 12 21:03:50.028152 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2784/3552] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:03:49 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:03:50.040793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-93ac85fa-94de-4fbd-9ba7-58a804348155 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:50.041749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-93ac85fa-94de-4fbd-9ba7-58a804348155 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:50.051454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93ac85fa-94de-4fbd-9ba7-58a804348155 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:50.052471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93ac85fa-94de-4fbd-9ba7-58a804348155 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:50.053704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93ac85fa-94de-4fbd-9ba7-58a804348155 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:50.055399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93ac85fa-94de-4fbd-9ba7-58a804348155 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:50.433476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-93ac85fa-94de-4fbd-9ba7-58a804348155 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:50.442797 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-93ac85fa-94de-4fbd-9ba7-58a804348155 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.407320 Mar 12 21:03:50.443393 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2785/3553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:50 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:50.462108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-63671c07-e453-46af-8215-8bed2bdefd6a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:50.478346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-63671c07-e453-46af-8215-8bed2bdefd6a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:50.487244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63671c07-e453-46af-8215-8bed2bdefd6a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:50.489324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63671c07-e453-46af-8215-8bed2bdefd6a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:50.491367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63671c07-e453-46af-8215-8bed2bdefd6a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:50.492868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63671c07-e453-46af-8215-8bed2bdefd6a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:51.411473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-63671c07-e453-46af-8215-8bed2bdefd6a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:51.424747 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-63671c07-e453-46af-8215-8bed2bdefd6a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.977618 Mar 12 21:03:51.434353 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2786/3554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:50 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:51.434353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e4422a1a-a098-4e68-9073-875298bed9ba tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:51.434353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e4422a1a-a098-4e68-9073-875298bed9ba tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:51.440998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4422a1a-a098-4e68-9073-875298bed9ba tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:51.441593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4422a1a-a098-4e68-9073-875298bed9ba tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:51.442710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4422a1a-a098-4e68-9073-875298bed9ba tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:51.443439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4422a1a-a098-4e68-9073-875298bed9ba tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:51.620172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e4422a1a-a098-4e68-9073-875298bed9ba tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:51.633802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e4422a1a-a098-4e68-9073-875298bed9ba tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:51.644901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e4422a1a-a098-4e68-9073-875298bed9ba tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:51.679586 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e4422a1a-a098-4e68-9073-875298bed9ba tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1365 microversion: 2.57 time: 0.252328 Mar 12 21:03:51.691992 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2787/3555] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:51 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:51.705597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-92fbf384-bc2e-4d4f-82ac-97316090623c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:51.728251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92fbf384-bc2e-4d4f-82ac-97316090623c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:51.728994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92fbf384-bc2e-4d4f-82ac-97316090623c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:51.764533 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-92fbf384-bc2e-4d4f-82ac-97316090623c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] HTTP exception thrown: Instance e537d16d-478d-4375-a61a-c28f8a785539 is locked Mar 12 21:03:51.766117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-92fbf384-bc2e-4d4f-82ac-97316090623c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Returning 409 to user: Instance e537d16d-478d-4375-a61a-c28f8a785539 is locked {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:51.767080 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-92fbf384-bc2e-4d4f-82ac-97316090623c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 409 len: 107 microversion: 2.1 time: 0.085221 Mar 12 21:03:51.773002 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2788/3556] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:03:51 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 107 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 21:03:51.782644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-41971057-fe1a-41b9-b233-5d905c878c92 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:51.783359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-41971057-fe1a-41b9-b233-5d905c878c92 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:51.794128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41971057-fe1a-41b9-b233-5d905c878c92 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:51.794623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41971057-fe1a-41b9-b233-5d905c878c92 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:51.795422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41971057-fe1a-41b9-b233-5d905c878c92 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:51.796418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41971057-fe1a-41b9-b233-5d905c878c92 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:52.164196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-41971057-fe1a-41b9-b233-5d905c878c92 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:52.171904 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-41971057-fe1a-41b9-b233-5d905c878c92 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.397737 Mar 12 21:03:52.174590 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2789/3557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:51 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:52.179634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4db818d4-e82c-4d9e-8b17-cd788721bd96 req-33811667-df33-4993-a169-064b02384d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c", "name": "network-vif-plugged", "status": "completed", "tag": "c090e91e-106e-4003-a4bd-bbeaac8461fb"}, {"server_uuid": "bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c", "name": "network-vif-plugged", "status": "completed", "tag": "0a132130-86e2-49e7-a4a9-79c91e3d14cb"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:52.190134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4db818d4-e82c-4d9e-8b17-cd788721bd96 req-33811667-df33-4993-a169-064b02384d38 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:52.191002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4db818d4-e82c-4d9e-8b17-cd788721bd96 req-33811667-df33-4993-a169-064b02384d38 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:52.205978 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4db818d4-e82c-4d9e-8b17-cd788721bd96 req-33811667-df33-4993-a169-064b02384d38 service nova] Creating event network-vif-plugged:c090e91e-106e-4003-a4bd-bbeaac8461fb for instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c on nch2-master-1 Mar 12 21:03:52.206496 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4db818d4-e82c-4d9e-8b17-cd788721bd96 req-33811667-df33-4993-a169-064b02384d38 service nova] Creating event network-vif-plugged:0a132130-86e2-49e7-a4a9-79c91e3d14cb for instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c on nch2-master-1 Mar 12 21:03:52.211936 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4db818d4-e82c-4d9e-8b17-cd788721bd96 req-33811667-df33-4993-a169-064b02384d38 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035951 Mar 12 21:03:52.216700 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2790/3558] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:52.222636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-11fd44a8-dc87-45a2-9b60-fb11e7d1d49f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:52.223281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-11fd44a8-dc87-45a2-9b60-fb11e7d1d49f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:52.230663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11fd44a8-dc87-45a2-9b60-fb11e7d1d49f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:52.231131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11fd44a8-dc87-45a2-9b60-fb11e7d1d49f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:52.232176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11fd44a8-dc87-45a2-9b60-fb11e7d1d49f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:52.232782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11fd44a8-dc87-45a2-9b60-fb11e7d1d49f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:52.316068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-11fd44a8-dc87-45a2-9b60-fb11e7d1d49f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Unlocking {{(pid=136302) unlock /opt/stack/nova/nova/compute/api.py:4727}} Mar 12 21:03:52.412555 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-11fd44a8-dc87-45a2-9b60-fb11e7d1d49f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.194314 Mar 12 21:03:52.416859 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2791/3559] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:03:52 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:03:52.432496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-81d41d90-1290-418a-bafa-1bbf4e4662a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:52.443635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81d41d90-1290-418a-bafa-1bbf4e4662a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:52.444103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81d41d90-1290-418a-bafa-1bbf4e4662a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:52.470828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-81d41d90-1290-418a-bafa-1bbf4e4662a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Going to try to stop instance {{(pid=136302) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 12 21:03:52.545983 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-81d41d90-1290-418a-bafa-1bbf4e4662a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.127450 Mar 12 21:03:52.547183 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2792/3560] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:03:52 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:03:52.556032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-10126ec8-afb5-4f95-8453-3b75659d144a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:52.556805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-10126ec8-afb5-4f95-8453-3b75659d144a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:52.564231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10126ec8-afb5-4f95-8453-3b75659d144a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:52.564971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10126ec8-afb5-4f95-8453-3b75659d144a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:52.566042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10126ec8-afb5-4f95-8453-3b75659d144a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:52.566829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10126ec8-afb5-4f95-8453-3b75659d144a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:53.063047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-10126ec8-afb5-4f95-8453-3b75659d144a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:53.084686 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-10126ec8-afb5-4f95-8453-3b75659d144a tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.535645 Mar 12 21:03:53.087432 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2793/3561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:52 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:53.094267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-92cfedaf-3f4b-45b4-8714-1ee16fe55dad tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:53.095400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-92cfedaf-3f4b-45b4-8714-1ee16fe55dad tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:53.118996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92cfedaf-3f4b-45b4-8714-1ee16fe55dad tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:53.119747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92cfedaf-3f4b-45b4-8714-1ee16fe55dad tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:53.121137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92cfedaf-3f4b-45b4-8714-1ee16fe55dad tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:53.122419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92cfedaf-3f4b-45b4-8714-1ee16fe55dad tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:53.486946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-92cfedaf-3f4b-45b4-8714-1ee16fe55dad tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:53.499974 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-92cfedaf-3f4b-45b4-8714-1ee16fe55dad tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 0.410526 Mar 12 21:03:53.504450 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2794/3562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:53 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:53.515516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51e96004-2c6c-4af4-8527-6c35ec595158 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:53.518473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51e96004-2c6c-4af4-8527-6c35ec595158 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:53.530025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51e96004-2c6c-4af4-8527-6c35ec595158 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:53.531894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51e96004-2c6c-4af4-8527-6c35ec595158 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:53.532801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51e96004-2c6c-4af4-8527-6c35ec595158 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:53.533583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51e96004-2c6c-4af4-8527-6c35ec595158 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:53.699886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51e96004-2c6c-4af4-8527-6c35ec595158 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:53.715642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51e96004-2c6c-4af4-8527-6c35ec595158 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:53.719398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51e96004-2c6c-4af4-8527-6c35ec595158 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:53.723128 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51e96004-2c6c-4af4-8527-6c35ec595158 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1365 microversion: 2.57 time: 0.217596 Mar 12 21:03:53.725683 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2795/3563] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:53 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:53.740593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34113c93-2be0-432c-9879-5ad50b6188d0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:53.743497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34113c93-2be0-432c-9879-5ad50b6188d0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:53.751758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34113c93-2be0-432c-9879-5ad50b6188d0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:53.752226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34113c93-2be0-432c-9879-5ad50b6188d0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:53.753060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34113c93-2be0-432c-9879-5ad50b6188d0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:53.754154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34113c93-2be0-432c-9879-5ad50b6188d0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:54.079052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34113c93-2be0-432c-9879-5ad50b6188d0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:54.101941 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34113c93-2be0-432c-9879-5ad50b6188d0 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.372265 Mar 12 21:03:54.102565 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2796/3564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:53 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:54.117324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-104aa14f-92f8-4305-82cb-3772eeb99212 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:54.117880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-104aa14f-92f8-4305-82cb-3772eeb99212 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:54.130858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-104aa14f-92f8-4305-82cb-3772eeb99212 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:54.136729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-104aa14f-92f8-4305-82cb-3772eeb99212 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:54.139544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-104aa14f-92f8-4305-82cb-3772eeb99212 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:54.141831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-104aa14f-92f8-4305-82cb-3772eeb99212 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:54.170476 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-104aa14f-92f8-4305-82cb-3772eeb99212 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] HTTP exception thrown: Instance ed5a70e8-3738-4058-94d8-a41af23a25af could not be found. Mar 12 21:03:54.173691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-104aa14f-92f8-4305-82cb-3772eeb99212 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Returning 404 to user: Instance ed5a70e8-3738-4058-94d8-a41af23a25af could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:54.178677 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-104aa14f-92f8-4305-82cb-3772eeb99212 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 404 len: 111 microversion: 2.1 time: 0.067424 Mar 12 21:03:54.181277 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2797/3565] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:03:54 2022] DELETE /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:03:54.192859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69547cbc-d3a6-43e3-8a13-f493031017a5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:54.198400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-69547cbc-d3a6-43e3-8a13-f493031017a5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:54.215347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69547cbc-d3a6-43e3-8a13-f493031017a5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:54.217152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69547cbc-d3a6-43e3-8a13-f493031017a5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:54.220787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69547cbc-d3a6-43e3-8a13-f493031017a5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:54.222222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69547cbc-d3a6-43e3-8a13-f493031017a5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:54.619521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-69547cbc-d3a6-43e3-8a13-f493031017a5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:54.632222 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-69547cbc-d3a6-43e3-8a13-f493031017a5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1355 microversion: 2.1 time: 0.449815 Mar 12 21:03:54.636077 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2798/3566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:54 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1355 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:54.643394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1b2f6c14-a28e-404f-8552-fbf2e4aa4e45 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:54.649979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1b2f6c14-a28e-404f-8552-fbf2e4aa4e45 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: ed5a70e8-3738-4058-94d8-a41af23a25af] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:54.664574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b2f6c14-a28e-404f-8552-fbf2e4aa4e45 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:54.665270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b2f6c14-a28e-404f-8552-fbf2e4aa4e45 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:54.666655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b2f6c14-a28e-404f-8552-fbf2e4aa4e45 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:54.667317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b2f6c14-a28e-404f-8552-fbf2e4aa4e45 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:54.689058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-1b2f6c14-a28e-404f-8552-fbf2e4aa4e45 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] HTTP exception thrown: Instance ed5a70e8-3738-4058-94d8-a41af23a25af could not be found. Mar 12 21:03:54.690169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1b2f6c14-a28e-404f-8552-fbf2e4aa4e45 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Returning 404 to user: Instance ed5a70e8-3738-4058-94d8-a41af23a25af could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:54.691240 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1b2f6c14-a28e-404f-8552-fbf2e4aa4e45 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af" status: 404 len: 111 microversion: 2.1 time: 0.054017 Mar 12 21:03:54.693742 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2799/3567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:54 2022] GET /compute/v2.1/servers/ed5a70e8-3738-4058-94d8-a41af23a25af => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:03:54.708590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f4f31ed-1975-4274-a7c2-72b95940c84c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:54.710486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4f4f31ed-1975-4274-a7c2-72b95940c84c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:54.729746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f4f31ed-1975-4274-a7c2-72b95940c84c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:54.730226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f4f31ed-1975-4274-a7c2-72b95940c84c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:54.731011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f4f31ed-1975-4274-a7c2-72b95940c84c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:54.732249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f4f31ed-1975-4274-a7c2-72b95940c84c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:55.197131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4f4f31ed-1975-4274-a7c2-72b95940c84c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:55.216103 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4f4f31ed-1975-4274-a7c2-72b95940c84c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 0.521012 Mar 12 21:03:55.216756 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2800/3568] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:54 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:55.229439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9983835-d32d-449f-aef7-db991e2f58b7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:55.230088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9983835-d32d-449f-aef7-db991e2f58b7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:55.259566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9983835-d32d-449f-aef7-db991e2f58b7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:55.260038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9983835-d32d-449f-aef7-db991e2f58b7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:55.260833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9983835-d32d-449f-aef7-db991e2f58b7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:55.261280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9983835-d32d-449f-aef7-db991e2f58b7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:55.428446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9983835-d32d-449f-aef7-db991e2f58b7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:55.456688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9983835-d32d-449f-aef7-db991e2f58b7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:55.458779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9983835-d32d-449f-aef7-db991e2f58b7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:55.460185 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9983835-d32d-449f-aef7-db991e2f58b7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1365 microversion: 2.57 time: 0.242404 Mar 12 21:03:55.465335 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2801/3569] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:55 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:55.487269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cc589525-5572-4962-9819-3d6da4143c6f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:55.487992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc589525-5572-4962-9819-3d6da4143c6f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:55.495414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc589525-5572-4962-9819-3d6da4143c6f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:55.497138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc589525-5572-4962-9819-3d6da4143c6f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:55.500347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc589525-5572-4962-9819-3d6da4143c6f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:55.500887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc589525-5572-4962-9819-3d6da4143c6f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:55.751542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cc589525-5572-4962-9819-3d6da4143c6f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:55.760007 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cc589525-5572-4962-9819-3d6da4143c6f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1504 microversion: 2.1 time: 0.290551 Mar 12 21:03:55.760720 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2802/3570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:55 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:55.766155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-615cd6be-1727-42f7-90e8-bd2e874a6033 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:55.766794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-615cd6be-1727-42f7-90e8-bd2e874a6033 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:55.772925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-615cd6be-1727-42f7-90e8-bd2e874a6033 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:55.773378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-615cd6be-1727-42f7-90e8-bd2e874a6033 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:55.775642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-615cd6be-1727-42f7-90e8-bd2e874a6033 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:55.776627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-615cd6be-1727-42f7-90e8-bd2e874a6033 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:55.993486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-615cd6be-1727-42f7-90e8-bd2e874a6033 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:56.003752 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-615cd6be-1727-42f7-90e8-bd2e874a6033 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1806 microversion: 2.1 time: 0.241907 Mar 12 21:03:56.015733 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2803/3571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:55 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1806 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:56.015733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d26293a-c312-409e-a99b-a176c79697e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:56.015733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8d26293a-c312-409e-a99b-a176c79697e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:56.018184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d26293a-c312-409e-a99b-a176c79697e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:56.018817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d26293a-c312-409e-a99b-a176c79697e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:56.019466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d26293a-c312-409e-a99b-a176c79697e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:56.019913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d26293a-c312-409e-a99b-a176c79697e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:56.038289 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8d26293a-c312-409e-a99b-a176c79697e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] HTTP exception thrown: Instance 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 could not be found. Mar 12 21:03:56.039247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d26293a-c312-409e-a99b-a176c79697e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Returning 404 to user: Instance 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:56.040258 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d26293a-c312-409e-a99b-a176c79697e5 tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 404 len: 111 microversion: 2.1 time: 0.034028 Mar 12 21:03:56.046619 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2804/3572] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:03:56 2022] DELETE /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:03:56.053017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c34d1b0-4578-421e-8ed5-867722ae8485 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:56.053788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c34d1b0-4578-421e-8ed5-867722ae8485 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:56.063812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c34d1b0-4578-421e-8ed5-867722ae8485 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:56.064523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c34d1b0-4578-421e-8ed5-867722ae8485 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:56.067413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c34d1b0-4578-421e-8ed5-867722ae8485 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:56.071309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c34d1b0-4578-421e-8ed5-867722ae8485 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:56.103991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c34d1b0-4578-421e-8ed5-867722ae8485 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c/ips" status: 200 len: 219 microversion: 2.1 time: 0.055884 Mar 12 21:03:56.110674 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2805/3573] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 21:03:56 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c/ips => generated 219 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:03:56.114810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a47cb8b3-190c-4564-8170-22ef0a99884a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:56.115563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a47cb8b3-190c-4564-8170-22ef0a99884a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] [instance: 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:56.123585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a47cb8b3-190c-4564-8170-22ef0a99884a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:56.125059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a47cb8b3-190c-4564-8170-22ef0a99884a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:56.126114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a47cb8b3-190c-4564-8170-22ef0a99884a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:56.127167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a47cb8b3-190c-4564-8170-22ef0a99884a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:56.144451 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a47cb8b3-190c-4564-8170-22ef0a99884a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] HTTP exception thrown: Instance 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 could not be found. Mar 12 21:03:56.145298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a47cb8b3-190c-4564-8170-22ef0a99884a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] Returning 404 to user: Instance 2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:03:56.147133 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a47cb8b3-190c-4564-8170-22ef0a99884a tempest-AttachVolumeTestJSON-704258411 tempest-AttachVolumeTestJSON-704258411-project] 10.222.0.30 "GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069" status: 404 len: 111 microversion: 2.1 time: 0.039216 Mar 12 21:03:56.149974 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2806/3574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:56 2022] GET /compute/v2.1/servers/2f2e6c22-dc3b-4733-ba22-ab6fe0f70069 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:03:56.156952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9fdc5e6e-2a98-4a1b-9ffd-e5ecd389e605 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:56.158044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9fdc5e6e-2a98-4a1b-9ffd-e5ecd389e605 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:56.166928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9fdc5e6e-2a98-4a1b-9ffd-e5ecd389e605 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:56.167504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9fdc5e6e-2a98-4a1b-9ffd-e5ecd389e605 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:56.168837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9fdc5e6e-2a98-4a1b-9ffd-e5ecd389e605 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:56.169503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9fdc5e6e-2a98-4a1b-9ffd-e5ecd389e605 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:56.218036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9fdc5e6e-2a98-4a1b-9ffd-e5ecd389e605 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:03:56.363806 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9fdc5e6e-2a98-4a1b-9ffd-e5ecd389e605 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 204 len: 0 microversion: 2.1 time: 0.210444 Mar 12 21:03:56.368469 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2807/3575] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:03:56 2022] DELETE /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:03:56.372994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f4e7a13c-edc6-47db-8336-bfc04afac59a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:56.373200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f4e7a13c-edc6-47db-8336-bfc04afac59a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:56.383738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4e7a13c-edc6-47db-8336-bfc04afac59a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:56.383738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4e7a13c-edc6-47db-8336-bfc04afac59a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:56.384412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4e7a13c-edc6-47db-8336-bfc04afac59a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:56.384947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4e7a13c-edc6-47db-8336-bfc04afac59a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:56.863447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f4e7a13c-edc6-47db-8336-bfc04afac59a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:56.874430 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f4e7a13c-edc6-47db-8336-bfc04afac59a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 0.507854 Mar 12 21:03:56.877515 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2808/3576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:56 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:56.887660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5bbacaf9-fcfb-448e-8266-33359471ef59 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:56.888739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5bbacaf9-fcfb-448e-8266-33359471ef59 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:56.920088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bbacaf9-fcfb-448e-8266-33359471ef59 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:56.920685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bbacaf9-fcfb-448e-8266-33359471ef59 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:56.935769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bbacaf9-fcfb-448e-8266-33359471ef59 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:56.936313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5bbacaf9-fcfb-448e-8266-33359471ef59 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:57.398494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5bbacaf9-fcfb-448e-8266-33359471ef59 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:57.407752 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5bbacaf9-fcfb-448e-8266-33359471ef59 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1812 microversion: 2.1 time: 0.524318 Mar 12 21:03:57.409611 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2809/3577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:56 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1812 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:57.426483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ed6a8d0f-5f7a-4428-8d66-4e1f3173ce67 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:57.427114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ed6a8d0f-5f7a-4428-8d66-4e1f3173ce67 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:57.444952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed6a8d0f-5f7a-4428-8d66-4e1f3173ce67 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:57.445837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed6a8d0f-5f7a-4428-8d66-4e1f3173ce67 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:57.448160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed6a8d0f-5f7a-4428-8d66-4e1f3173ce67 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:57.451517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed6a8d0f-5f7a-4428-8d66-4e1f3173ce67 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:57.573739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ed6a8d0f-5f7a-4428-8d66-4e1f3173ce67 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:57.586344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ed6a8d0f-5f7a-4428-8d66-4e1f3173ce67 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:57.605798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ed6a8d0f-5f7a-4428-8d66-4e1f3173ce67 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:57.607514 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ed6a8d0f-5f7a-4428-8d66-4e1f3173ce67 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1365 microversion: 2.57 time: 0.195284 Mar 12 21:03:57.613077 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2810/3578] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:57 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:03:57.623062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e1164975-b773-427f-a8f6-d017e0afbb5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:57.626532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e1164975-b773-427f-a8f6-d017e0afbb5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:57.640030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1164975-b773-427f-a8f6-d017e0afbb5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:57.642011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1164975-b773-427f-a8f6-d017e0afbb5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:57.645207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1164975-b773-427f-a8f6-d017e0afbb5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:57.645962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1164975-b773-427f-a8f6-d017e0afbb5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:57.935451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e1164975-b773-427f-a8f6-d017e0afbb5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:57.944990 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e1164975-b773-427f-a8f6-d017e0afbb5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1484 microversion: 2.1 time: 0.330182 Mar 12 21:03:57.950353 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2811/3579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:57 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1484 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:57.959381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67609de8-f0e5-433d-a507-63fa87f3d388 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:57.961606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-67609de8-f0e5-433d-a507-63fa87f3d388 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:57.991976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67609de8-f0e5-433d-a507-63fa87f3d388 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:57.992789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67609de8-f0e5-433d-a507-63fa87f3d388 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:57.993871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67609de8-f0e5-433d-a507-63fa87f3d388 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:58.000202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67609de8-f0e5-433d-a507-63fa87f3d388 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:58.371396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-67609de8-f0e5-433d-a507-63fa87f3d388 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:58.387743 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67609de8-f0e5-433d-a507-63fa87f3d388 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 0.435696 Mar 12 21:03:58.390099 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2812/3580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:57 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:03:58.411441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1984430250", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:03:58.491505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] validate_networks() for [('328d099b-eef2-4150-ba25-b254e81e0ddb', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:03:59.588149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:03:59.588764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:03:59.589095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:03:59.589643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:03:59.590151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:03:59.600441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:59.601092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:59.602202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:59.602804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:59.622813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Getting quotas for project 7213b31fd1ef41b4bd07970ba80dfc04. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:03:59.630585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Getting quotas for user bee46ffa14644ea8853ef8b89432c826 and project 7213b31fd1ef41b4bd07970ba80dfc04. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:03:59.645304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:03:59.648335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:03:59.714948 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-467e4fc0-12c0-439e-af39-7fbd8dd60865 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.321914 Mar 12 21:03:59.716275 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2813/3581] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:03:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:03:59.723292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34e494cd-bac1-480b-a236-88992780fd30 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:03:59.724179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34e494cd-bac1-480b-a236-88992780fd30 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:03:59.738970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34e494cd-bac1-480b-a236-88992780fd30 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:59.739669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34e494cd-bac1-480b-a236-88992780fd30 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:59.740726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34e494cd-bac1-480b-a236-88992780fd30 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:03:59.742988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34e494cd-bac1-480b-a236-88992780fd30 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:03:59.980401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34e494cd-bac1-480b-a236-88992780fd30 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:03:59.995908 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34e494cd-bac1-480b-a236-88992780fd30 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1812 microversion: 2.1 time: 0.276751 Mar 12 21:03:59.997585 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2814/3582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:03:59 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1812 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:00.017108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-06699c6d-1e7d-439c-8e05-6d49fcbdb901 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:00.018813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-06699c6d-1e7d-439c-8e05-6d49fcbdb901 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:00.037568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06699c6d-1e7d-439c-8e05-6d49fcbdb901 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:00.040337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06699c6d-1e7d-439c-8e05-6d49fcbdb901 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:00.042854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06699c6d-1e7d-439c-8e05-6d49fcbdb901 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:00.044168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06699c6d-1e7d-439c-8e05-6d49fcbdb901 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:00.318237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-06699c6d-1e7d-439c-8e05-6d49fcbdb901 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:00.351139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-06699c6d-1e7d-439c-8e05-6d49fcbdb901 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:00.355212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-06699c6d-1e7d-439c-8e05-6d49fcbdb901 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:00.357062 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-06699c6d-1e7d-439c-8e05-6d49fcbdb901 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1365 microversion: 2.57 time: 0.356409 Mar 12 21:04:00.359307 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2815/3583] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:03:59 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:04:00.370524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-50e5a7a9-08ea-4c81-871d-e7bb46a47a26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:00.372213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-50e5a7a9-08ea-4c81-871d-e7bb46a47a26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:00.414515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50e5a7a9-08ea-4c81-871d-e7bb46a47a26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:00.415129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50e5a7a9-08ea-4c81-871d-e7bb46a47a26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:00.416049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50e5a7a9-08ea-4c81-871d-e7bb46a47a26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:00.420305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50e5a7a9-08ea-4c81-871d-e7bb46a47a26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:01.684286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-50e5a7a9-08ea-4c81-871d-e7bb46a47a26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:01.703400 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-50e5a7a9-08ea-4c81-871d-e7bb46a47a26 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 1.342725 Mar 12 21:04:01.704654 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2816/3584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:00 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:01.711385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b5863072-33a7-4d6c-b77d-c0cdc006316e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:01.714589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b5863072-33a7-4d6c-b77d-c0cdc006316e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:01.737253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5863072-33a7-4d6c-b77d-c0cdc006316e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:01.746380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5863072-33a7-4d6c-b77d-c0cdc006316e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:01.752015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5863072-33a7-4d6c-b77d-c0cdc006316e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:01.752373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5863072-33a7-4d6c-b77d-c0cdc006316e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:01.979008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b5863072-33a7-4d6c-b77d-c0cdc006316e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:01.986675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b5863072-33a7-4d6c-b77d-c0cdc006316e tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1284 microversion: 2.1 time: 0.280625 Mar 12 21:04:01.987274 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2817/3585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:01 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1284 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:02.010061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-41fdadb0-33d5-442e-86b6-32236d373be4 req-f88803f9-631f-452f-a062-18e18acad046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c", "name": "network-vif-deleted", "tag": "0a132130-86e2-49e7-a4a9-79c91e3d14cb"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:02.029751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-41fdadb0-33d5-442e-86b6-32236d373be4 req-f88803f9-631f-452f-a062-18e18acad046 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:02.030365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-41fdadb0-33d5-442e-86b6-32236d373be4 req-f88803f9-631f-452f-a062-18e18acad046 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:02.062111 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-41fdadb0-33d5-442e-86b6-32236d373be4 req-f88803f9-631f-452f-a062-18e18acad046 service nova] Creating event network-vif-deleted:0a132130-86e2-49e7-a4a9-79c91e3d14cb for instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c on nch2-master-1 Mar 12 21:04:02.074786 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-41fdadb0-33d5-442e-86b6-32236d373be4 req-f88803f9-631f-452f-a062-18e18acad046 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069596 Mar 12 21:04:02.077973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2818/3586] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:02.111688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9b38389-ad69-4b47-b72f-18d93a3b8fd9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:02.113405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9b38389-ad69-4b47-b72f-18d93a3b8fd9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:02.136019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9b38389-ad69-4b47-b72f-18d93a3b8fd9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:02.136707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9b38389-ad69-4b47-b72f-18d93a3b8fd9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:02.138212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9b38389-ad69-4b47-b72f-18d93a3b8fd9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:02.139141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9b38389-ad69-4b47-b72f-18d93a3b8fd9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:02.790954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9b38389-ad69-4b47-b72f-18d93a3b8fd9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:02.802393 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9b38389-ad69-4b47-b72f-18d93a3b8fd9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1677 microversion: 2.1 time: 0.704200 Mar 12 21:04:02.804499 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2819/3587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:02 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1677 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:02.819392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7de39568-ed34-4d9a-881d-4c801ecb754f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:02.819713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7de39568-ed34-4d9a-881d-4c801ecb754f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:02.826384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7de39568-ed34-4d9a-881d-4c801ecb754f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:02.827931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7de39568-ed34-4d9a-881d-4c801ecb754f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:02.829010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7de39568-ed34-4d9a-881d-4c801ecb754f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:02.829662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7de39568-ed34-4d9a-881d-4c801ecb754f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:02.961211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7de39568-ed34-4d9a-881d-4c801ecb754f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:02.984440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7de39568-ed34-4d9a-881d-4c801ecb754f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:02.989522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7de39568-ed34-4d9a-881d-4c801ecb754f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:02.992697 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7de39568-ed34-4d9a-881d-4c801ecb754f tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1365 microversion: 2.57 time: 0.187266 Mar 12 21:04:02.994506 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2820/3588] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:04:02 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:04:02.999750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71d38c14-56fc-4b51-9dc8-9034cfd8c68d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:03.000548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71d38c14-56fc-4b51-9dc8-9034cfd8c68d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:03.008160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71d38c14-56fc-4b51-9dc8-9034cfd8c68d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:03.008903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71d38c14-56fc-4b51-9dc8-9034cfd8c68d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:03.009915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71d38c14-56fc-4b51-9dc8-9034cfd8c68d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:03.010569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71d38c14-56fc-4b51-9dc8-9034cfd8c68d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:03.601550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-71d38c14-56fc-4b51-9dc8-9034cfd8c68d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:03.616332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71d38c14-56fc-4b51-9dc8-9034cfd8c68d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1657 microversion: 2.1 time: 0.620079 Mar 12 21:04:03.616973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2821/3589] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:02 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1657 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:03.640487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-808af8cf-7ea9-466f-89eb-f9dc1c685547 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:03.641400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-808af8cf-7ea9-466f-89eb-f9dc1c685547 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:03.674769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-808af8cf-7ea9-466f-89eb-f9dc1c685547 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:03.675309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-808af8cf-7ea9-466f-89eb-f9dc1c685547 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:03.676837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-808af8cf-7ea9-466f-89eb-f9dc1c685547 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:03.682873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-808af8cf-7ea9-466f-89eb-f9dc1c685547 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:04.021967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-808af8cf-7ea9-466f-89eb-f9dc1c685547 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:04.033497 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-808af8cf-7ea9-466f-89eb-f9dc1c685547 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1314 microversion: 2.1 time: 0.413926 Mar 12 21:04:04.040718 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2822/3590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:03 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:04.047045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d012e7c4-395e-49d9-8622-e1b121c17a19 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:04.068506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d012e7c4-395e-49d9-8622-e1b121c17a19 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:04.069265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d012e7c4-395e-49d9-8622-e1b121c17a19 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:04.122073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d012e7c4-395e-49d9-8622-e1b121c17a19 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Going to try to start instance {{(pid=136302) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 12 21:04:04.213092 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d012e7c4-395e-49d9-8622-e1b121c17a19 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.170141 Mar 12 21:04:04.222734 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2823/3591] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:04:04 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:04:04.238248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-efe0e7fe-66c8-4395-b978-e8b55311afb5 req-48ccd497-fac2-4573-a1c3-8984e0b80e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c", "name": "network-vif-unplugged", "status": "completed", "tag": "db6d65d6-6889-4d76-ae7c-b38b4d3ffa62"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:04.274466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-efe0e7fe-66c8-4395-b978-e8b55311afb5 req-48ccd497-fac2-4573-a1c3-8984e0b80e16 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:04.277988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-efe0e7fe-66c8-4395-b978-e8b55311afb5 req-48ccd497-fac2-4573-a1c3-8984e0b80e16 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:04.312235 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-efe0e7fe-66c8-4395-b978-e8b55311afb5 req-48ccd497-fac2-4573-a1c3-8984e0b80e16 service nova] Creating event network-vif-unplugged:db6d65d6-6889-4d76-ae7c-b38b4d3ffa62 for instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c on nch2-master-1 Mar 12 21:04:04.328569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-efe0e7fe-66c8-4395-b978-e8b55311afb5 req-48ccd497-fac2-4573-a1c3-8984e0b80e16 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103822 Mar 12 21:04:04.330712 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2824/3592] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:04.345350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51549e1e-8ef5-46eb-b665-8f8dcda9fc35 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:04.346295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51549e1e-8ef5-46eb-b665-8f8dcda9fc35 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:04.372888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51549e1e-8ef5-46eb-b665-8f8dcda9fc35 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:04.373340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51549e1e-8ef5-46eb-b665-8f8dcda9fc35 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:04.380807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51549e1e-8ef5-46eb-b665-8f8dcda9fc35 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:04.381763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51549e1e-8ef5-46eb-b665-8f8dcda9fc35 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:04.750641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51549e1e-8ef5-46eb-b665-8f8dcda9fc35 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:04.760537 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51549e1e-8ef5-46eb-b665-8f8dcda9fc35 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 200 len: 1614 microversion: 2.1 time: 0.427566 Mar 12 21:04:04.761164 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2825/3593] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:04 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 1614 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:04.776959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4547c49c-d25c-417f-a279-7923df912403 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:04.777931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4547c49c-d25c-417f-a279-7923df912403 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:04.789676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4547c49c-d25c-417f-a279-7923df912403 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:04.790496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4547c49c-d25c-417f-a279-7923df912403 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:04.796250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4547c49c-d25c-417f-a279-7923df912403 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:04.797186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4547c49c-d25c-417f-a279-7923df912403 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:05.011762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4547c49c-d25c-417f-a279-7923df912403 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:05.027896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4547c49c-d25c-417f-a279-7923df912403 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:05.042458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4547c49c-d25c-417f-a279-7923df912403 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:05.047769 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4547c49c-d25c-417f-a279-7923df912403 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1365 microversion: 2.57 time: 0.281813 Mar 12 21:04:05.048365 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2826/3594] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:04:04 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:04:05.062792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0076a8b6-9e24-4cbf-8a8b-e7c7ec714ad4 req-9e415426-09c0-4bec-9b0f-9bd60b82781f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c", "name": "network-vif-deleted", "tag": "c090e91e-106e-4003-a4bd-bbeaac8461fb"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:05.080109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0076a8b6-9e24-4cbf-8a8b-e7c7ec714ad4 req-9e415426-09c0-4bec-9b0f-9bd60b82781f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:05.083584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0076a8b6-9e24-4cbf-8a8b-e7c7ec714ad4 req-9e415426-09c0-4bec-9b0f-9bd60b82781f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:05.125968 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0076a8b6-9e24-4cbf-8a8b-e7c7ec714ad4 req-9e415426-09c0-4bec-9b0f-9bd60b82781f service nova] Creating event network-vif-deleted:c090e91e-106e-4003-a4bd-bbeaac8461fb for instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c on nch2-master-1 Mar 12 21:04:05.141377 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0076a8b6-9e24-4cbf-8a8b-e7c7ec714ad4 req-9e415426-09c0-4bec-9b0f-9bd60b82781f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088983 Mar 12 21:04:05.144857 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2827/3595] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:05.179997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7ec40026-bcfd-40d1-9a48-601035d1646d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:05.181247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7ec40026-bcfd-40d1-9a48-601035d1646d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:05.193975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ec40026-bcfd-40d1-9a48-601035d1646d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:05.194913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ec40026-bcfd-40d1-9a48-601035d1646d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:05.196969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ec40026-bcfd-40d1-9a48-601035d1646d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:05.197664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ec40026-bcfd-40d1-9a48-601035d1646d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:06.359946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7ec40026-bcfd-40d1-9a48-601035d1646d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:06.372886 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7ec40026-bcfd-40d1-9a48-601035d1646d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1666 microversion: 2.1 time: 1.226446 Mar 12 21:04:06.374325 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2828/3596] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:05 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1666 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:06.397519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-160a8ff0-3fcd-4364-8d4e-f1fde444c57d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:06.398364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-160a8ff0-3fcd-4364-8d4e-f1fde444c57d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:06.411863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-160a8ff0-3fcd-4364-8d4e-f1fde444c57d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:06.412547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-160a8ff0-3fcd-4364-8d4e-f1fde444c57d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:06.413524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-160a8ff0-3fcd-4364-8d4e-f1fde444c57d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:06.415387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-160a8ff0-3fcd-4364-8d4e-f1fde444c57d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:07.393289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-160a8ff0-3fcd-4364-8d4e-f1fde444c57d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:07.428690 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-160a8ff0-3fcd-4364-8d4e-f1fde444c57d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1314 microversion: 2.1 time: 1.035433 Mar 12 21:04:07.433118 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2829/3597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:06 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1314 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:07.438538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-24d4bdd6-12a1-40ea-8650-4578872fa0b5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:07.443647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-24d4bdd6-12a1-40ea-8650-4578872fa0b5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:07.456048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24d4bdd6-12a1-40ea-8650-4578872fa0b5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:07.461561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24d4bdd6-12a1-40ea-8650-4578872fa0b5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:07.462676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24d4bdd6-12a1-40ea-8650-4578872fa0b5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:07.463601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24d4bdd6-12a1-40ea-8650-4578872fa0b5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:07.512425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-24d4bdd6-12a1-40ea-8650-4578872fa0b5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] HTTP exception thrown: Instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c could not be found. Mar 12 21:04:07.515311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-24d4bdd6-12a1-40ea-8650-4578872fa0b5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Returning 404 to user: Instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:04:07.518708 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-24d4bdd6-12a1-40ea-8650-4578872fa0b5 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 404 len: 111 microversion: 2.1 time: 0.083984 Mar 12 21:04:07.523343 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2830/3598] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:07 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:04:07.539527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b53b653b-48a7-4cb7-8742-c4a52be42531 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:07.542313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b53b653b-48a7-4cb7-8742-c4a52be42531 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:07.554204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b53b653b-48a7-4cb7-8742-c4a52be42531 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:07.555140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b53b653b-48a7-4cb7-8742-c4a52be42531 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:07.556430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b53b653b-48a7-4cb7-8742-c4a52be42531 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:07.557159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b53b653b-48a7-4cb7-8742-c4a52be42531 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:07.726900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b53b653b-48a7-4cb7-8742-c4a52be42531 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:07.736981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b53b653b-48a7-4cb7-8742-c4a52be42531 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:07.738960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b53b653b-48a7-4cb7-8742-c4a52be42531 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:07.745099 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b53b653b-48a7-4cb7-8742-c4a52be42531 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1365 microversion: 2.57 time: 0.218948 Mar 12 21:04:07.747777 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2831/3599] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:04:07 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:04:07.760199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-09fca62e-d0e0-4bba-9095-add336848936 req-f98c84c6-8de6-4f65-abf8-ba69d6ac930d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c", "name": "network-vif-deleted", "tag": "db6d65d6-6889-4d76-ae7c-b38b4d3ffa62"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:07.782423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-09fca62e-d0e0-4bba-9095-add336848936 req-f98c84c6-8de6-4f65-abf8-ba69d6ac930d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:07.783300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-09fca62e-d0e0-4bba-9095-add336848936 req-f98c84c6-8de6-4f65-abf8-ba69d6ac930d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:07.820905 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-09fca62e-d0e0-4bba-9095-add336848936 req-f98c84c6-8de6-4f65-abf8-ba69d6ac930d service nova] Creating event network-vif-deleted:db6d65d6-6889-4d76-ae7c-b38b4d3ffa62 for instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c on nch2-master-1 Mar 12 21:04:07.826259 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-09fca62e-d0e0-4bba-9095-add336848936 req-f98c84c6-8de6-4f65-abf8-ba69d6ac930d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076365 Mar 12 21:04:07.827197 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2832/3600] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:07.832597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6cd55f53-d0c9-4bf9-968e-cbc51a9c5946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:07.833590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6cd55f53-d0c9-4bf9-968e-cbc51a9c5946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:07.840217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cd55f53-d0c9-4bf9-968e-cbc51a9c5946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:07.840798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cd55f53-d0c9-4bf9-968e-cbc51a9c5946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:07.841832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cd55f53-d0c9-4bf9-968e-cbc51a9c5946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:07.843170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cd55f53-d0c9-4bf9-968e-cbc51a9c5946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:08.616655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6cd55f53-d0c9-4bf9-968e-cbc51a9c5946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:08.640152 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6cd55f53-d0c9-4bf9-968e-cbc51a9c5946 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1666 microversion: 2.1 time: 0.801487 Mar 12 21:04:08.650425 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2833/3601] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:07 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1666 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:09.008356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9fa46902-e1f3-4485-852a-ac01325403e8 req-9369c6ba-f583-4c02-8524-691ab63b02e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606d3cae-7b25-47f1-aa0e-fa2ef65a7191", "tag": "b004f947-4fd0-4512-b2de-019a6f47759d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:09.017675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9fa46902-e1f3-4485-852a-ac01325403e8 req-9369c6ba-f583-4c02-8524-691ab63b02e6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:09.023325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9fa46902-e1f3-4485-852a-ac01325403e8 req-9369c6ba-f583-4c02-8524-691ab63b02e6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:09.046250 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9fa46902-e1f3-4485-852a-ac01325403e8 req-9369c6ba-f583-4c02-8524-691ab63b02e6 service nova] Creating event network-changed:b004f947-4fd0-4512-b2de-019a6f47759d for instance 606d3cae-7b25-47f1-aa0e-fa2ef65a7191 on nch1-master-1 Mar 12 21:04:09.055880 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9fa46902-e1f3-4485-852a-ac01325403e8 req-9369c6ba-f583-4c02-8524-691ab63b02e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413301 Mar 12 21:04:09.059091 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2834/3602] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:09.067187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-892a0c44-3d65-403b-b24b-dcf8d0e1e503 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:09.068425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-892a0c44-3d65-403b-b24b-dcf8d0e1e503 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:09.076851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-892a0c44-3d65-403b-b24b-dcf8d0e1e503 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:09.077669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-892a0c44-3d65-403b-b24b-dcf8d0e1e503 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:09.078750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-892a0c44-3d65-403b-b24b-dcf8d0e1e503 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:09.079419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-892a0c44-3d65-403b-b24b-dcf8d0e1e503 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:09.860437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-892a0c44-3d65-403b-b24b-dcf8d0e1e503 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:09.865653 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-892a0c44-3d65-403b-b24b-dcf8d0e1e503 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1314 microversion: 2.1 time: 0.805070 Mar 12 21:04:09.866389 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2835/3603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:09 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1314 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:09.877840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8cb402e5-3299-429d-ba2c-1b1d580deefd tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:09.887922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8cb402e5-3299-429d-ba2c-1b1d580deefd tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:09.907307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cb402e5-3299-429d-ba2c-1b1d580deefd tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:09.909734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cb402e5-3299-429d-ba2c-1b1d580deefd tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:09.910744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cb402e5-3299-429d-ba2c-1b1d580deefd tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:09.915450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cb402e5-3299-429d-ba2c-1b1d580deefd tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:10.157857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8cb402e5-3299-429d-ba2c-1b1d580deefd tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:10.168450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8cb402e5-3299-429d-ba2c-1b1d580deefd tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:10.170010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8cb402e5-3299-429d-ba2c-1b1d580deefd tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:10.172043 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8cb402e5-3299-429d-ba2c-1b1d580deefd tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1365 microversion: 2.57 time: 0.304726 Mar 12 21:04:10.173713 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2836/3604] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:04:09 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:04:10.188736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0dcd7d46-9170-42f9-b601-2d3848d1f45e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:10.195135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0dcd7d46-9170-42f9-b601-2d3848d1f45e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:10.210967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0dcd7d46-9170-42f9-b601-2d3848d1f45e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:10.212467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0dcd7d46-9170-42f9-b601-2d3848d1f45e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:10.213988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0dcd7d46-9170-42f9-b601-2d3848d1f45e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:10.215944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0dcd7d46-9170-42f9-b601-2d3848d1f45e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:10.987174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0dcd7d46-9170-42f9-b601-2d3848d1f45e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:10.994750 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0dcd7d46-9170-42f9-b601-2d3848d1f45e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.819235 Mar 12 21:04:10.995348 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2837/3605] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:10 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:11.000432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-250cd696-998d-4faf-8132-e02d0d129200 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:11.001047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-250cd696-998d-4faf-8132-e02d0d129200 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:11.031730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-250cd696-998d-4faf-8132-e02d0d129200 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:11.032349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-250cd696-998d-4faf-8132-e02d0d129200 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:11.033560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-250cd696-998d-4faf-8132-e02d0d129200 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:11.034225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-250cd696-998d-4faf-8132-e02d0d129200 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:12.545163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-250cd696-998d-4faf-8132-e02d0d129200 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:12.553119 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-250cd696-998d-4faf-8132-e02d0d129200 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1314 microversion: 2.1 time: 1.556723 Mar 12 21:04:12.560792 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2838/3606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:10 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1314 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:12.566832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cb4df3b0-c776-425a-be5a-3d41e498c8f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:12.570322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cb4df3b0-c776-425a-be5a-3d41e498c8f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:12.581886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb4df3b0-c776-425a-be5a-3d41e498c8f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:12.582348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb4df3b0-c776-425a-be5a-3d41e498c8f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:12.585278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb4df3b0-c776-425a-be5a-3d41e498c8f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:12.589008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb4df3b0-c776-425a-be5a-3d41e498c8f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:13.046330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cb4df3b0-c776-425a-be5a-3d41e498c8f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:13.057231 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cb4df3b0-c776-425a-be5a-3d41e498c8f7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.494550 Mar 12 21:04:13.071139 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2839/3607] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:12 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:13.083260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-846feefa-a683-4709-bb28-005d8d42a649 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:13.084273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-846feefa-a683-4709-bb28-005d8d42a649 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:13.101638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-846feefa-a683-4709-bb28-005d8d42a649 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:13.102463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-846feefa-a683-4709-bb28-005d8d42a649 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:13.103477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-846feefa-a683-4709-bb28-005d8d42a649 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:13.104123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-846feefa-a683-4709-bb28-005d8d42a649 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:13.245480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-846feefa-a683-4709-bb28-005d8d42a649 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:13.258930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-846feefa-a683-4709-bb28-005d8d42a649 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:13.260811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-846feefa-a683-4709-bb28-005d8d42a649 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:13.265275 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-846feefa-a683-4709-bb28-005d8d42a649 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1365 microversion: 2.57 time: 0.192869 Mar 12 21:04:13.267876 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2840/3608] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:04:13 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:04:13.288488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f11de66e-c6df-4029-a7d1-6138678b4a91 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:13.289054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f11de66e-c6df-4029-a7d1-6138678b4a91 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:13.305624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f11de66e-c6df-4029-a7d1-6138678b4a91 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:13.306805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f11de66e-c6df-4029-a7d1-6138678b4a91 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:13.309864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f11de66e-c6df-4029-a7d1-6138678b4a91 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:13.313051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f11de66e-c6df-4029-a7d1-6138678b4a91 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:13.424227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f11de66e-c6df-4029-a7d1-6138678b4a91 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Unlocking {{(pid=136302) unlock /opt/stack/nova/nova/compute/api.py:4727}} Mar 12 21:04:13.529062 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f11de66e-c6df-4029-a7d1-6138678b4a91 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.259216 Mar 12 21:04:13.533246 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2841/3609] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:04:13 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:04:13.549119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e7db3a7-d8ab-45f2-b6cb-a30c9bdca1e5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:13.550676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e7db3a7-d8ab-45f2-b6cb-a30c9bdca1e5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:13.565293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e7db3a7-d8ab-45f2-b6cb-a30c9bdca1e5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:13.565892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e7db3a7-d8ab-45f2-b6cb-a30c9bdca1e5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:13.566945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e7db3a7-d8ab-45f2-b6cb-a30c9bdca1e5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:13.567411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e7db3a7-d8ab-45f2-b6cb-a30c9bdca1e5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:13.865966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8e7db3a7-d8ab-45f2-b6cb-a30c9bdca1e5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:13.876909 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8e7db3a7-d8ab-45f2-b6cb-a30c9bdca1e5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.332061 Mar 12 21:04:13.879704 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2842/3610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:13 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:13.894136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7e1de53e-d5bb-48c4-8fc4-d6d625c10bdd tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:13.896993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7e1de53e-d5bb-48c4-8fc4-d6d625c10bdd tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:13.912006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e1de53e-d5bb-48c4-8fc4-d6d625c10bdd tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:13.913056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e1de53e-d5bb-48c4-8fc4-d6d625c10bdd tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:13.914412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e1de53e-d5bb-48c4-8fc4-d6d625c10bdd tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:13.914859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e1de53e-d5bb-48c4-8fc4-d6d625c10bdd tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:14.418780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7e1de53e-d5bb-48c4-8fc4-d6d625c10bdd tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:14.429629 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7e1de53e-d5bb-48c4-8fc4-d6d625c10bdd tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1314 microversion: 2.1 time: 0.548333 Mar 12 21:04:14.449540 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2843/3611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:13 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:14.449540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cb5aa763-cd21-4aea-b2db-7abfe2fa4679 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:14.450861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cb5aa763-cd21-4aea-b2db-7abfe2fa4679 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:14.471772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb5aa763-cd21-4aea-b2db-7abfe2fa4679 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:14.472517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb5aa763-cd21-4aea-b2db-7abfe2fa4679 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:14.473472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb5aa763-cd21-4aea-b2db-7abfe2fa4679 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:14.474094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb5aa763-cd21-4aea-b2db-7abfe2fa4679 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:15.204429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cb5aa763-cd21-4aea-b2db-7abfe2fa4679 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:15.227575 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cb5aa763-cd21-4aea-b2db-7abfe2fa4679 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.791687 Mar 12 21:04:15.228498 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2844/3612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:14 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:15.234663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e9f5d0fe-bff0-49fb-8893-9191c5db2410 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:15.235534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e9f5d0fe-bff0-49fb-8893-9191c5db2410 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:15.251791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9f5d0fe-bff0-49fb-8893-9191c5db2410 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:15.252256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9f5d0fe-bff0-49fb-8893-9191c5db2410 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:15.253066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9f5d0fe-bff0-49fb-8893-9191c5db2410 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:15.262283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9f5d0fe-bff0-49fb-8893-9191c5db2410 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:15.362545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e9f5d0fe-bff0-49fb-8893-9191c5db2410 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:15.372938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e9f5d0fe-bff0-49fb-8893-9191c5db2410 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:15.374721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e9f5d0fe-bff0-49fb-8893-9191c5db2410 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:15.376044 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e9f5d0fe-bff0-49fb-8893-9191c5db2410 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1371 microversion: 2.57 time: 0.146314 Mar 12 21:04:15.377730 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2845/3613] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:04:15 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:04:15.393218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ba7fd0f2-78cf-49ce-a01a-6b257e34fca8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:15.393884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ba7fd0f2-78cf-49ce-a01a-6b257e34fca8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:15.400715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba7fd0f2-78cf-49ce-a01a-6b257e34fca8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:15.401464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba7fd0f2-78cf-49ce-a01a-6b257e34fca8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:15.402470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba7fd0f2-78cf-49ce-a01a-6b257e34fca8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:15.403086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba7fd0f2-78cf-49ce-a01a-6b257e34fca8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:15.786640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ba7fd0f2-78cf-49ce-a01a-6b257e34fca8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:15.794617 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ba7fd0f2-78cf-49ce-a01a-6b257e34fca8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.415636 Mar 12 21:04:15.799756 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2846/3614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:15 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:15.811848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f60a551f-1630-4e3a-a68a-9460a5e2d8ab tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:15.815031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f60a551f-1630-4e3a-a68a-9460a5e2d8ab tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:15.831435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f60a551f-1630-4e3a-a68a-9460a5e2d8ab tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:15.835481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f60a551f-1630-4e3a-a68a-9460a5e2d8ab tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:15.836508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f60a551f-1630-4e3a-a68a-9460a5e2d8ab tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:15.843041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f60a551f-1630-4e3a-a68a-9460a5e2d8ab tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:16.564059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f60a551f-1630-4e3a-a68a-9460a5e2d8ab tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:16.575739 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f60a551f-1630-4e3a-a68a-9460a5e2d8ab tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1314 microversion: 2.1 time: 0.773385 Mar 12 21:04:16.577956 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2847/3615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:15 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:16.585108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-89866bf2-4ad6-4c05-b0d4-45bf65f6f0e9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:16.586062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89866bf2-4ad6-4c05-b0d4-45bf65f6f0e9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:16.599301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89866bf2-4ad6-4c05-b0d4-45bf65f6f0e9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:16.599915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89866bf2-4ad6-4c05-b0d4-45bf65f6f0e9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:16.600806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89866bf2-4ad6-4c05-b0d4-45bf65f6f0e9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:16.601350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89866bf2-4ad6-4c05-b0d4-45bf65f6f0e9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:16.765671 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-89866bf2-4ad6-4c05-b0d4-45bf65f6f0e9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.183295 Mar 12 21:04:16.769662 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2848/3616] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:04:16 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:04:16.780813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6712bd46-6409-4c9e-a974-f869a67ffea3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:16.781966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6712bd46-6409-4c9e-a974-f869a67ffea3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:16.813601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6712bd46-6409-4c9e-a974-f869a67ffea3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:16.816725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6712bd46-6409-4c9e-a974-f869a67ffea3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:16.823706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6712bd46-6409-4c9e-a974-f869a67ffea3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:16.824525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6712bd46-6409-4c9e-a974-f869a67ffea3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:17.497042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6712bd46-6409-4c9e-a974-f869a67ffea3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:17.507144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6712bd46-6409-4c9e-a974-f869a67ffea3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:17.513501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6712bd46-6409-4c9e-a974-f869a67ffea3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:17.515136 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6712bd46-6409-4c9e-a974-f869a67ffea3 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1371 microversion: 2.57 time: 0.743494 Mar 12 21:04:17.516284 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2849/3617] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:04:16 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1371 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:04:17.521250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c5fa1e9-4ede-4995-823c-57d090af05dd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:17.522150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c5fa1e9-4ede-4995-823c-57d090af05dd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:17.528592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c5fa1e9-4ede-4995-823c-57d090af05dd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:17.529163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c5fa1e9-4ede-4995-823c-57d090af05dd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:17.530757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c5fa1e9-4ede-4995-823c-57d090af05dd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:17.531417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c5fa1e9-4ede-4995-823c-57d090af05dd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:18.135602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9c5fa1e9-4ede-4995-823c-57d090af05dd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:18.147540 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c5fa1e9-4ede-4995-823c-57d090af05dd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1655 microversion: 2.1 time: 0.629806 Mar 12 21:04:18.162333 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2850/3618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:17 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1655 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:18.162566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e0c39493-d239-4886-9fee-5cec1918a229 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:18.176098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e0c39493-d239-4886-9fee-5cec1918a229 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:18.199442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0c39493-d239-4886-9fee-5cec1918a229 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:18.202841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0c39493-d239-4886-9fee-5cec1918a229 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:18.206528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0c39493-d239-4886-9fee-5cec1918a229 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:18.207432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0c39493-d239-4886-9fee-5cec1918a229 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:18.822282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e0c39493-d239-4886-9fee-5cec1918a229 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:18.837068 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e0c39493-d239-4886-9fee-5cec1918a229 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1314 microversion: 2.1 time: 0.682869 Mar 12 21:04:18.837971 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2851/3619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:18 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:18.860358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4bac583f-1053-4e90-82dd-936311a5a99b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:18.861182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4bac583f-1053-4e90-82dd-936311a5a99b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:18.882575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bac583f-1053-4e90-82dd-936311a5a99b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:18.883458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bac583f-1053-4e90-82dd-936311a5a99b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:18.884427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bac583f-1053-4e90-82dd-936311a5a99b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:18.885592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bac583f-1053-4e90-82dd-936311a5a99b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:19.023215 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4bac583f-1053-4e90-82dd-936311a5a99b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.183804 Mar 12 21:04:19.023873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2852/3620] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:04:18 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:04:19.043577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fcda1900-0a69-4bd5-946b-7a00fc8e4e62 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:19.044488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fcda1900-0a69-4bd5-946b-7a00fc8e4e62 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:19.054693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcda1900-0a69-4bd5-946b-7a00fc8e4e62 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:19.058467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcda1900-0a69-4bd5-946b-7a00fc8e4e62 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:19.062169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcda1900-0a69-4bd5-946b-7a00fc8e4e62 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:19.063079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcda1900-0a69-4bd5-946b-7a00fc8e4e62 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:19.539106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fcda1900-0a69-4bd5-946b-7a00fc8e4e62 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:19.561537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fcda1900-0a69-4bd5-946b-7a00fc8e4e62 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:19.563852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fcda1900-0a69-4bd5-946b-7a00fc8e4e62 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:19.567511 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fcda1900-0a69-4bd5-946b-7a00fc8e4e62 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1356 microversion: 2.57 time: 0.528546 Mar 12 21:04:19.572554 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2853/3621] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:04:19 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1356 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:04:19.591380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ef089a5d-dbdf-4dcb-9a81-faa6d1a46b36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:19.594664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ef089a5d-dbdf-4dcb-9a81-faa6d1a46b36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:19.609171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef089a5d-dbdf-4dcb-9a81-faa6d1a46b36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:19.609645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef089a5d-dbdf-4dcb-9a81-faa6d1a46b36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:19.617826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef089a5d-dbdf-4dcb-9a81-faa6d1a46b36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:19.618140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef089a5d-dbdf-4dcb-9a81-faa6d1a46b36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:20.477501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ef089a5d-dbdf-4dcb-9a81-faa6d1a46b36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:20.495775 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ef089a5d-dbdf-4dcb-9a81-faa6d1a46b36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.921733 Mar 12 21:04:20.497032 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2854/3622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:19 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:20.504041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-18acec91-0581-41a9-b794-8a121575de20 req-5a977ff1-6dee-4429-844e-4ee9c09fe9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606d3cae-7b25-47f1-aa0e-fa2ef65a7191", "name": "network-vif-plugged", "status": "completed", "tag": "b004f947-4fd0-4512-b2de-019a6f47759d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:20.514480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-18acec91-0581-41a9-b794-8a121575de20 req-5a977ff1-6dee-4429-844e-4ee9c09fe9ae service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:20.515211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-18acec91-0581-41a9-b794-8a121575de20 req-5a977ff1-6dee-4429-844e-4ee9c09fe9ae service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:20.538331 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-18acec91-0581-41a9-b794-8a121575de20 req-5a977ff1-6dee-4429-844e-4ee9c09fe9ae service nova] Creating event network-vif-plugged:b004f947-4fd0-4512-b2de-019a6f47759d for instance 606d3cae-7b25-47f1-aa0e-fa2ef65a7191 on nch1-master-1 Mar 12 21:04:20.549257 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-18acec91-0581-41a9-b794-8a121575de20 req-5a977ff1-6dee-4429-844e-4ee9c09fe9ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049626 Mar 12 21:04:20.551210 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2855/3623] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:20.559736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c435103b-feb9-4374-b8a9-13deb38aef25 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:20.560582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c435103b-feb9-4374-b8a9-13deb38aef25 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:20.572432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c435103b-feb9-4374-b8a9-13deb38aef25 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:20.573192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c435103b-feb9-4374-b8a9-13deb38aef25 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:20.576324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c435103b-feb9-4374-b8a9-13deb38aef25 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:20.577019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c435103b-feb9-4374-b8a9-13deb38aef25 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:20.639496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c435103b-feb9-4374-b8a9-13deb38aef25 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:04:20.805208 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c435103b-feb9-4374-b8a9-13deb38aef25 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "DELETE /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 204 len: 0 microversion: 2.57 time: 0.249432 Mar 12 21:04:20.807199 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2856/3624] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 21:04:20 2022] DELETE /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:04:20.817204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3556b189-77ec-4a1f-b252-effb9d47a407 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:20.818612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3556b189-77ec-4a1f-b252-effb9d47a407 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:20.841700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3556b189-77ec-4a1f-b252-effb9d47a407 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:20.846201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3556b189-77ec-4a1f-b252-effb9d47a407 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:20.848640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3556b189-77ec-4a1f-b252-effb9d47a407 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:20.849330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3556b189-77ec-4a1f-b252-effb9d47a407 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:21.724661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3556b189-77ec-4a1f-b252-effb9d47a407 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:21.744399 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3556b189-77ec-4a1f-b252-effb9d47a407 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1314 microversion: 2.1 time: 0.934897 Mar 12 21:04:21.757453 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2857/3625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:20 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:21.763871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-57efa1ab-82ef-47f1-99d5-1d7206e4f505 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:21.765334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-57efa1ab-82ef-47f1-99d5-1d7206e4f505 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:21.774098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57efa1ab-82ef-47f1-99d5-1d7206e4f505 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:21.774792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57efa1ab-82ef-47f1-99d5-1d7206e4f505 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:21.775748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57efa1ab-82ef-47f1-99d5-1d7206e4f505 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:21.776367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57efa1ab-82ef-47f1-99d5-1d7206e4f505 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:22.653556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-57efa1ab-82ef-47f1-99d5-1d7206e4f505 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:22.667662 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-57efa1ab-82ef-47f1-99d5-1d7206e4f505 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.908659 Mar 12 21:04:22.668274 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2858/3626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:21 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:22.678411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7e32d021-01f5-491a-beb2-00267b401af9 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:22.678411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7e32d021-01f5-491a-beb2-00267b401af9 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:22.692822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e32d021-01f5-491a-beb2-00267b401af9 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:22.693699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e32d021-01f5-491a-beb2-00267b401af9 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:22.695872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e32d021-01f5-491a-beb2-00267b401af9 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:22.696681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e32d021-01f5-491a-beb2-00267b401af9 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:22.827972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7e32d021-01f5-491a-beb2-00267b401af9 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:22.840783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7e32d021-01f5-491a-beb2-00267b401af9 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:22.843408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7e32d021-01f5-491a-beb2-00267b401af9 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a14a050fc0554b1a8e545248263cc886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69110ed092e14906afc45f97a405bdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:22.845480 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7e32d021-01f5-491a-beb2-00267b401af9 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 200 len: 1362 microversion: 2.57 time: 0.176005 Mar 12 21:04:22.847258 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2859/3627] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:04:22 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:04:22.853725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1665033524", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "19b71ef4-6bef-4727-bba1-440e3a1c42b3"}, {"uuid": "b51f3653-b166-48a5-bfb2-e8bccaa62979"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:22.944896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] validate_networks() for [('19b71ef4-6bef-4727-bba1-440e3a1c42b3', None, None, None, None, None), ('b51f3653-b166-48a5-bfb2-e8bccaa62979', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:04:24.477723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:04:24.478452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:04:24.478660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:04:24.482976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:04:24.483647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:04:24.500688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:24.504097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:24.505372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:24.506061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:24.550998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Getting quotas for project 506297c5930140e3b2a54284d502b722. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:04:24.564062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Getting quotas for user d71701480d764e4e8995346f9b464aea and project 506297c5930140e3b2a54284d502b722. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:04:24.597192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:04:24.618506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:04:24.734487 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f5a9919-3d6a-45fe-97fa-a62fd31104c7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.885774 Mar 12 21:04:24.735747 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2860/3628] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:04:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:04:24.744063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3305323d-3cf3-4521-aad4-9832186a4742 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:24.744956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3305323d-3cf3-4521-aad4-9832186a4742 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:24.755917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3305323d-3cf3-4521-aad4-9832186a4742 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:24.756690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3305323d-3cf3-4521-aad4-9832186a4742 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:24.765369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3305323d-3cf3-4521-aad4-9832186a4742 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:24.766197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3305323d-3cf3-4521-aad4-9832186a4742 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:25.084697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3305323d-3cf3-4521-aad4-9832186a4742 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:25.102889 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3305323d-3cf3-4521-aad4-9832186a4742 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.364331 Mar 12 21:04:25.105971 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2861/3629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:24 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:25.124751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fe73bd26-464d-4546-8cb8-5711c7fb4af8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:25.126405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fe73bd26-464d-4546-8cb8-5711c7fb4af8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:25.140927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe73bd26-464d-4546-8cb8-5711c7fb4af8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:25.141668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe73bd26-464d-4546-8cb8-5711c7fb4af8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:25.143334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe73bd26-464d-4546-8cb8-5711c7fb4af8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:25.144073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe73bd26-464d-4546-8cb8-5711c7fb4af8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:25.901377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fe73bd26-464d-4546-8cb8-5711c7fb4af8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:25.913032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fe73bd26-464d-4546-8cb8-5711c7fb4af8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1500 microversion: 2.1 time: 0.802737 Mar 12 21:04:25.913873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2862/3630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:25 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1500 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:25.933555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc449b14-c400-4b50-bbc1-90ca5b45efe7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:25.934623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc449b14-c400-4b50-bbc1-90ca5b45efe7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] [instance: 96d49514-46fb-48ac-a611-9455d1c11e8c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:25.942689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc449b14-c400-4b50-bbc1-90ca5b45efe7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:25.943335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc449b14-c400-4b50-bbc1-90ca5b45efe7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:25.944539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc449b14-c400-4b50-bbc1-90ca5b45efe7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:25.945150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc449b14-c400-4b50-bbc1-90ca5b45efe7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:25.966487 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bc449b14-c400-4b50-bbc1-90ca5b45efe7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] HTTP exception thrown: Instance 96d49514-46fb-48ac-a611-9455d1c11e8c could not be found. Mar 12 21:04:25.968435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc449b14-c400-4b50-bbc1-90ca5b45efe7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] Returning 404 to user: Instance 96d49514-46fb-48ac-a611-9455d1c11e8c could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:04:25.972225 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc449b14-c400-4b50-bbc1-90ca5b45efe7 tempest-ServerShowV257Test-1620087022 tempest-ServerShowV257Test-1620087022-project] 10.222.0.30 "GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c" status: 404 len: 111 microversion: 2.57 time: 0.044373 Mar 12 21:04:25.973336 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2863/3631] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:04:25 2022] GET /compute/v2.1/servers/96d49514-46fb-48ac-a611-9455d1c11e8c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:04:25.979805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8526f2dc-65ff-4296-bb7a-1a91f93ed0fd tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:25.980788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8526f2dc-65ff-4296-bb7a-1a91f93ed0fd tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:25.988604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8526f2dc-65ff-4296-bb7a-1a91f93ed0fd tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:25.989330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8526f2dc-65ff-4296-bb7a-1a91f93ed0fd tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:25.990480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8526f2dc-65ff-4296-bb7a-1a91f93ed0fd tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:25.991089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8526f2dc-65ff-4296-bb7a-1a91f93ed0fd tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:26.061569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8526f2dc-65ff-4296-bb7a-1a91f93ed0fd tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:26.071997 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8526f2dc-65ff-4296-bb7a-1a91f93ed0fd tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1265 microversion: 2.1 time: 0.097117 Mar 12 21:04:26.082960 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2864/3632] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:25 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:26.088132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b1d1e944-553c-4e20-ab45-d9fc27b8b31a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:26.089189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b1d1e944-553c-4e20-ab45-d9fc27b8b31a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:26.096899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1d1e944-553c-4e20-ab45-d9fc27b8b31a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:26.097363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1d1e944-553c-4e20-ab45-d9fc27b8b31a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:26.098202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1d1e944-553c-4e20-ab45-d9fc27b8b31a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:26.098650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1d1e944-553c-4e20-ab45-d9fc27b8b31a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:26.531524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b1d1e944-553c-4e20-ab45-d9fc27b8b31a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:26.543762 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b1d1e944-553c-4e20-ab45-d9fc27b8b31a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.459362 Mar 12 21:04:26.545207 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2865/3633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:26 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:26.551763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5acba88-2aad-485f-bb19-969ec6c7a83c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:26.555911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c5acba88-2aad-485f-bb19-969ec6c7a83c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:26.570989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5acba88-2aad-485f-bb19-969ec6c7a83c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:26.573888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5acba88-2aad-485f-bb19-969ec6c7a83c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:26.577857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5acba88-2aad-485f-bb19-969ec6c7a83c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:26.578508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5acba88-2aad-485f-bb19-969ec6c7a83c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:26.632990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-c5acba88-2aad-485f-bb19-969ec6c7a83c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lazy-loading 'flavor' on Instance uuid 606d3cae-7b25-47f1-aa0e-fa2ef65a7191 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:04:26.804020 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c5acba88-2aad-485f-bb19-969ec6c7a83c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "POST /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191/action" status: 200 len: 32 microversion: 2.1 time: 0.252413 Mar 12 21:04:26.807066 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2866/3634] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:04:26 2022] POST /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:04:26.816449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-42e39afe-b970-43cd-81e2-2738d651a595 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:26.828643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-42e39afe-b970-43cd-81e2-2738d651a595 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:26.843604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42e39afe-b970-43cd-81e2-2738d651a595 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:26.844397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42e39afe-b970-43cd-81e2-2738d651a595 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:26.846557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42e39afe-b970-43cd-81e2-2738d651a595 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:26.847532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42e39afe-b970-43cd-81e2-2738d651a595 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:28.175231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-42e39afe-b970-43cd-81e2-2738d651a595 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:28.186431 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-42e39afe-b970-43cd-81e2-2738d651a595 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 1.374472 Mar 12 21:04:28.197383 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2867/3635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:26 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:28.198056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75cdb391-9a6c-4fa3-b78d-29d247adbce2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:28.198839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75cdb391-9a6c-4fa3-b78d-29d247adbce2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:28.213494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75cdb391-9a6c-4fa3-b78d-29d247adbce2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:28.214326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75cdb391-9a6c-4fa3-b78d-29d247adbce2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:28.216076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75cdb391-9a6c-4fa3-b78d-29d247adbce2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:28.217600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75cdb391-9a6c-4fa3-b78d-29d247adbce2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:28.843368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-75cdb391-9a6c-4fa3-b78d-29d247adbce2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:28.853247 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75cdb391-9a6c-4fa3-b78d-29d247adbce2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 0.664458 Mar 12 21:04:28.853880 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2868/3636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:28 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:28.861321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9efe4fc6-f6b1-4348-9796-2215b2e8500c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:28.868164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9efe4fc6-f6b1-4348-9796-2215b2e8500c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:28.881661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9efe4fc6-f6b1-4348-9796-2215b2e8500c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:28.882503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9efe4fc6-f6b1-4348-9796-2215b2e8500c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:28.883478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9efe4fc6-f6b1-4348-9796-2215b2e8500c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:28.886996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9efe4fc6-f6b1-4348-9796-2215b2e8500c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:29.065653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9efe4fc6-f6b1-4348-9796-2215b2e8500c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:29.078717 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9efe4fc6-f6b1-4348-9796-2215b2e8500c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1271 microversion: 2.1 time: 0.223150 Mar 12 21:04:29.090814 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2869/3637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:28 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:29.098667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b1fe753-e8a1-4382-b9a7-a88bd259b2dc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:29.099644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b1fe753-e8a1-4382-b9a7-a88bd259b2dc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:29.111923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b1fe753-e8a1-4382-b9a7-a88bd259b2dc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:29.112560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b1fe753-e8a1-4382-b9a7-a88bd259b2dc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:29.114094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b1fe753-e8a1-4382-b9a7-a88bd259b2dc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:29.114785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b1fe753-e8a1-4382-b9a7-a88bd259b2dc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:29.846389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b1fe753-e8a1-4382-b9a7-a88bd259b2dc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:29.856923 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b1fe753-e8a1-4382-b9a7-a88bd259b2dc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.762701 Mar 12 21:04:29.857602 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2870/3638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:29 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:30.278033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-532638a9-0f8c-484c-9cbd-568a10cc8ee6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: .version_select at 0x7f6e355d6ee0>, body: {"keypair": {"name": "tempest-keypair-982371581"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:30.328017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-532638a9-0f8c-484c-9cbd-568a10cc8ee6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:04:30.338449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-532638a9-0f8c-484c-9cbd-568a10cc8ee6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for user f2c8058e4e8d475c9377a065b4018a2a and project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:04:30.773516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-532638a9-0f8c-484c-9cbd-568a10cc8ee6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:04:30.794578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-532638a9-0f8c-484c-9cbd-568a10cc8ee6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for user f2c8058e4e8d475c9377a065b4018a2a and project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:04:30.839239 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-532638a9-0f8c-484c-9cbd-568a10cc8ee6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.977988 Mar 12 21:04:30.842568 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2871/3639] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:04:29 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:30.852702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59e32671-6b29-47e4-b072-feab4250d5d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:30.854495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59e32671-6b29-47e4-b072-feab4250d5d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:30.875702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59e32671-6b29-47e4-b072-feab4250d5d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:30.877159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59e32671-6b29-47e4-b072-feab4250d5d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:30.879424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59e32671-6b29-47e4-b072-feab4250d5d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:30.881294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59e32671-6b29-47e4-b072-feab4250d5d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:31.484766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-59e32671-6b29-47e4-b072-feab4250d5d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:31.502486 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59e32671-6b29-47e4-b072-feab4250d5d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 0.658812 Mar 12 21:04:31.503375 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2872/3640] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:30 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:31.514127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-41edc810-a662-4d12-8e17-edf0957e7741 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:31.514964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-41edc810-a662-4d12-8e17-edf0957e7741 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:31.530287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41edc810-a662-4d12-8e17-edf0957e7741 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:31.530921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41edc810-a662-4d12-8e17-edf0957e7741 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:31.531905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41edc810-a662-4d12-8e17-edf0957e7741 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:31.533462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41edc810-a662-4d12-8e17-edf0957e7741 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:32.069562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-41edc810-a662-4d12-8e17-edf0957e7741 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:32.081985 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-41edc810-a662-4d12-8e17-edf0957e7741 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1334 microversion: 2.1 time: 0.574923 Mar 12 21:04:32.092513 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2873/3641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:31 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1334 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:32.520609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a55f4282-1165-412f-931d-2a3e403ef072 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:32.521429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a55f4282-1165-412f-931d-2a3e403ef072 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:32.530318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a55f4282-1165-412f-931d-2a3e403ef072 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:32.531088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a55f4282-1165-412f-931d-2a3e403ef072 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:32.532483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a55f4282-1165-412f-931d-2a3e403ef072 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:32.535196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a55f4282-1165-412f-931d-2a3e403ef072 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:33.078051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a55f4282-1165-412f-931d-2a3e403ef072 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:33.106964 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a55f4282-1165-412f-931d-2a3e403ef072 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 0.590969 Mar 12 21:04:33.110932 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2874/3642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:32 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:04:33.120711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-197c12cf-a1a3-4aed-918d-933a78478902 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:33.122554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-197c12cf-a1a3-4aed-918d-933a78478902 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:33.142032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197c12cf-a1a3-4aed-918d-933a78478902 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:33.142032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197c12cf-a1a3-4aed-918d-933a78478902 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:33.144455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197c12cf-a1a3-4aed-918d-933a78478902 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:33.145981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197c12cf-a1a3-4aed-918d-933a78478902 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:34.059531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-197c12cf-a1a3-4aed-918d-933a78478902 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:34.096388 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-197c12cf-a1a3-4aed-918d-933a78478902 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1334 microversion: 2.1 time: 0.983656 Mar 12 21:04:34.102081 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2875/3643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:33 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1334 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:34.106745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-197c12cf-a1a3-4aed-918d-933a78478902 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:34.108539 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-197c12cf-a1a3-4aed-918d-933a78478902 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005306 Mar 12 21:04:34.112623 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2876/3644] 10.222.0.30 () {56 vars in 885 bytes} [Sat Mar 12 21:04:34 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 12 21:04:34.133295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-19803917-a120-4114-866b-23c069b36474 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:34.133974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19803917-a120-4114-866b-23c069b36474 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:34.140619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19803917-a120-4114-866b-23c069b36474 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:34.141117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19803917-a120-4114-866b-23c069b36474 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:34.142125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19803917-a120-4114-866b-23c069b36474 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:34.142722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19803917-a120-4114-866b-23c069b36474 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:35.254075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-19803917-a120-4114-866b-23c069b36474 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:35.277502 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-19803917-a120-4114-866b-23c069b36474 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 1.151000 Mar 12 21:04:35.295272 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2877/3645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:34 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:35.300384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0da00d41-ebe1-4a8d-b2b2-245de1ba3d2e req-bbeb3276-0abd-4125-90f1-5fdad998ebfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0063682b-58f8-4377-a1b9-7c9168894a92", "tag": "780a6356-5da0-4249-801a-c746bd0e1025"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:35.321234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0da00d41-ebe1-4a8d-b2b2-245de1ba3d2e req-bbeb3276-0abd-4125-90f1-5fdad998ebfa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:35.322123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0da00d41-ebe1-4a8d-b2b2-245de1ba3d2e req-bbeb3276-0abd-4125-90f1-5fdad998ebfa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:35.350817 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0da00d41-ebe1-4a8d-b2b2-245de1ba3d2e req-bbeb3276-0abd-4125-90f1-5fdad998ebfa service nova] Creating event network-changed:780a6356-5da0-4249-801a-c746bd0e1025 for instance 0063682b-58f8-4377-a1b9-7c9168894a92 on nch2-master-1 Mar 12 21:04:35.358696 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0da00d41-ebe1-4a8d-b2b2-245de1ba3d2e req-bbeb3276-0abd-4125-90f1-5fdad998ebfa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061949 Mar 12 21:04:35.367147 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2878/3646] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:35.373001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3dfd061c-aa2c-4406-b089-e3a91d0adfdb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:35.375535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3dfd061c-aa2c-4406-b089-e3a91d0adfdb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:35.391550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3dfd061c-aa2c-4406-b089-e3a91d0adfdb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:35.392346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3dfd061c-aa2c-4406-b089-e3a91d0adfdb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:35.396361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3dfd061c-aa2c-4406-b089-e3a91d0adfdb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:35.396911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3dfd061c-aa2c-4406-b089-e3a91d0adfdb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:36.086378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3dfd061c-aa2c-4406-b089-e3a91d0adfdb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:36.101128 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3dfd061c-aa2c-4406-b089-e3a91d0adfdb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1334 microversion: 2.1 time: 0.732362 Mar 12 21:04:36.101726 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2879/3647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:35 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1334 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:36.297659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d13bb0f5-39f5-4139-b16d-9b6392752f4f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:36.306005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d13bb0f5-39f5-4139-b16d-9b6392752f4f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:36.317194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d13bb0f5-39f5-4139-b16d-9b6392752f4f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:36.318051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d13bb0f5-39f5-4139-b16d-9b6392752f4f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:36.319350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d13bb0f5-39f5-4139-b16d-9b6392752f4f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:36.320009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d13bb0f5-39f5-4139-b16d-9b6392752f4f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:37.280358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d13bb0f5-39f5-4139-b16d-9b6392752f4f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:37.288784 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d13bb0f5-39f5-4139-b16d-9b6392752f4f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 0.996357 Mar 12 21:04:37.289399 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2880/3648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:36 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:37.295691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d8b641ca-96c3-42e1-9030-b258f6e40d9f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:37.296535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d8b641ca-96c3-42e1-9030-b258f6e40d9f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:37.302791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8b641ca-96c3-42e1-9030-b258f6e40d9f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:37.304000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8b641ca-96c3-42e1-9030-b258f6e40d9f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:37.304820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8b641ca-96c3-42e1-9030-b258f6e40d9f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:37.305271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8b641ca-96c3-42e1-9030-b258f6e40d9f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:37.962653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d8b641ca-96c3-42e1-9030-b258f6e40d9f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:37.978515 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d8b641ca-96c3-42e1-9030-b258f6e40d9f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1334 microversion: 2.1 time: 0.686155 Mar 12 21:04:37.981663 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2881/3649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:37 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1334 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:37.988209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b5f32fc5-65d8-42ca-8414-4519d586b58a req-728e4e5d-7b3f-49c9-b808-5fcbe4cd61ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0063682b-58f8-4377-a1b9-7c9168894a92", "tag": "3c8e5170-29b4-4da8-b1fd-4e3c766ca7e1"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:38.002451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b5f32fc5-65d8-42ca-8414-4519d586b58a req-728e4e5d-7b3f-49c9-b808-5fcbe4cd61ad service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:38.003020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b5f32fc5-65d8-42ca-8414-4519d586b58a req-728e4e5d-7b3f-49c9-b808-5fcbe4cd61ad service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:38.020121 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b5f32fc5-65d8-42ca-8414-4519d586b58a req-728e4e5d-7b3f-49c9-b808-5fcbe4cd61ad service nova] Creating event network-changed:3c8e5170-29b4-4da8-b1fd-4e3c766ca7e1 for instance 0063682b-58f8-4377-a1b9-7c9168894a92 on nch2-master-1 Mar 12 21:04:38.026140 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b5f32fc5-65d8-42ca-8414-4519d586b58a req-728e4e5d-7b3f-49c9-b808-5fcbe4cd61ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042069 Mar 12 21:04:38.027637 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2882/3650] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:38.196113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b5f32fc5-65d8-42ca-8414-4519d586b58a req-728e4e5d-7b3f-49c9-b808-5fcbe4cd61ad service nova] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:38.197330 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b5f32fc5-65d8-42ca-8414-4519d586b58a req-728e4e5d-7b3f-49c9-b808-5fcbe4cd61ad service nova] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001691 Mar 12 21:04:38.197866 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2883/3651] 10.222.0.30 () {56 vars in 885 bytes} [Sat Mar 12 21:04:38 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Mar 12 21:04:38.313903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5f0098c9-9629-4d45-93ba-d487138c5e5c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:38.316964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5f0098c9-9629-4d45-93ba-d487138c5e5c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:38.328500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f0098c9-9629-4d45-93ba-d487138c5e5c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:38.329398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f0098c9-9629-4d45-93ba-d487138c5e5c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:38.330506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f0098c9-9629-4d45-93ba-d487138c5e5c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:38.332013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f0098c9-9629-4d45-93ba-d487138c5e5c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:38.780391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f0098c9-9629-4d45-93ba-d487138c5e5c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:38.787909 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5f0098c9-9629-4d45-93ba-d487138c5e5c tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 0.485967 Mar 12 21:04:38.797974 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2884/3652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:38 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:04:38.864632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-638765357", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94a25897-3a88-44fe-b618-77b90965f553"}], "security_groups": [{"name": "tempest-securitygroup--126212916"}], "key_name": "tempest-keypair-982371581", "user_data": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:39.012075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] validate_networks() for [('94a25897-3a88-44fe-b618-77b90965f553', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:04:40.571206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:04:40.571805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:04:40.572378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:04:40.572794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:04:40.573298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:04:40.586357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:40.586883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:40.588041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:40.588733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:40.636066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for project 2f427010b06749289b20e8b776a8b8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:04:40.643592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for user f2c8058e4e8d475c9377a065b4018a2a and project 2f427010b06749289b20e8b776a8b8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:04:40.659808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:04:40.662973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:04:40.721090 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b7f7310b-46ed-4f49-bcad-40095c135c57 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.867346 Mar 12 21:04:40.723156 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2885/3653] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:04:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:04:40.729341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b95020f8-14ad-4196-931e-8a15cd41d725 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:40.730484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b95020f8-14ad-4196-931e-8a15cd41d725 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:40.741428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b95020f8-14ad-4196-931e-8a15cd41d725 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:40.742134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b95020f8-14ad-4196-931e-8a15cd41d725 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:40.743679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b95020f8-14ad-4196-931e-8a15cd41d725 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:40.744359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b95020f8-14ad-4196-931e-8a15cd41d725 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:41.088298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b95020f8-14ad-4196-931e-8a15cd41d725 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:41.096273 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b95020f8-14ad-4196-931e-8a15cd41d725 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1334 microversion: 2.1 time: 0.371420 Mar 12 21:04:41.105915 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2886/3654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:40 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1334 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:41.106744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21ceb053-3cb2-4c33-88b2-0b98f3cdef65 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:41.107373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-21ceb053-3cb2-4c33-88b2-0b98f3cdef65 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:41.114407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21ceb053-3cb2-4c33-88b2-0b98f3cdef65 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:41.114800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21ceb053-3cb2-4c33-88b2-0b98f3cdef65 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:41.115818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21ceb053-3cb2-4c33-88b2-0b98f3cdef65 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:41.116324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21ceb053-3cb2-4c33-88b2-0b98f3cdef65 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:41.405312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21ceb053-3cb2-4c33-88b2-0b98f3cdef65 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:41.414549 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21ceb053-3cb2-4c33-88b2-0b98f3cdef65 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 0.311663 Mar 12 21:04:41.415161 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2887/3655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:41 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:41.420181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21ceb053-3cb2-4c33-88b2-0b98f3cdef65 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:41.423328 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21ceb053-3cb2-4c33-88b2-0b98f3cdef65 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002243 Mar 12 21:04:41.424279 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2888/3656] 10.222.0.30 () {56 vars in 885 bytes} [Sat Mar 12 21:04:41 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 12 21:04:41.439819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43d12d6a-2eaf-42db-a815-59a98701abf4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:41.446715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-43d12d6a-2eaf-42db-a815-59a98701abf4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:41.551574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-43d12d6a-2eaf-42db-a815-59a98701abf4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:41.561088 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-43d12d6a-2eaf-42db-a815-59a98701abf4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1240 microversion: 2.1 time: 0.133416 Mar 12 21:04:41.561704 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2889/3657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:41 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:41.564405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43d12d6a-2eaf-42db-a815-59a98701abf4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:41.565455 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-43d12d6a-2eaf-42db-a815-59a98701abf4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001918 Mar 12 21:04:41.565874 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2890/3658] 10.222.0.30 () {54 vars in 1034 bytes} [Sat Mar 12 21:04:41 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Mar 12 21:04:41.580121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43d12d6a-2eaf-42db-a815-59a98701abf4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:41.587143 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-43d12d6a-2eaf-42db-a815-59a98701abf4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.007224 Mar 12 21:04:41.587887 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2891/3659] 10.222.0.30 () {54 vars in 1040 bytes} [Sat Mar 12 21:04:41 2022] GET /compute/v2.1/ => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:41.595526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43d12d6a-2eaf-42db-a815-59a98701abf4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:41.596644 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-43d12d6a-2eaf-42db-a815-59a98701abf4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001377 Mar 12 21:04:41.597052 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2892/3660] 10.222.0.30 () {56 vars in 885 bytes} [Sat Mar 12 21:04:41 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 12 21:04:42.114820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d482b99-8bca-4522-92b0-d9e514e01527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:42.115622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d482b99-8bca-4522-92b0-d9e514e01527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:42.130692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d482b99-8bca-4522-92b0-d9e514e01527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:42.135290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d482b99-8bca-4522-92b0-d9e514e01527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:42.136333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d482b99-8bca-4522-92b0-d9e514e01527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:42.137612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d482b99-8bca-4522-92b0-d9e514e01527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:42.721260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d482b99-8bca-4522-92b0-d9e514e01527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:42.728885 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d482b99-8bca-4522-92b0-d9e514e01527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1334 microversion: 2.1 time: 0.619560 Mar 12 21:04:42.731564 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2893/3661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:42 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1334 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:42.740575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0efb6390-38de-4ce2-8ef9-34141b7e90d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:42.741713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0efb6390-38de-4ce2-8ef9-34141b7e90d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:42.748671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0efb6390-38de-4ce2-8ef9-34141b7e90d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:42.749366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0efb6390-38de-4ce2-8ef9-34141b7e90d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:42.750702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0efb6390-38de-4ce2-8ef9-34141b7e90d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:42.751760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0efb6390-38de-4ce2-8ef9-34141b7e90d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:43.114378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0efb6390-38de-4ce2-8ef9-34141b7e90d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:43.128312 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0efb6390-38de-4ce2-8ef9-34141b7e90d2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 0.395872 Mar 12 21:04:43.139340 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2894/3662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:42 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:43.145482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd35bba8-2717-4bc6-9893-aa309bb0d4ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:43.146454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd35bba8-2717-4bc6-9893-aa309bb0d4ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:43.155974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd35bba8-2717-4bc6-9893-aa309bb0d4ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:43.162329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd35bba8-2717-4bc6-9893-aa309bb0d4ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:43.163658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd35bba8-2717-4bc6-9893-aa309bb0d4ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:43.164480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd35bba8-2717-4bc6-9893-aa309bb0d4ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:43.262774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bd35bba8-2717-4bc6-9893-aa309bb0d4ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:43.273693 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd35bba8-2717-4bc6-9893-aa309bb0d4ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1298 microversion: 2.1 time: 0.132974 Mar 12 21:04:43.285852 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2895/3663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:43 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:43.750645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5551191f-f676-483f-a4a2-0d8c6b9b0ef7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:43.752071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5551191f-f676-483f-a4a2-0d8c6b9b0ef7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:43.766055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5551191f-f676-483f-a4a2-0d8c6b9b0ef7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:43.766547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5551191f-f676-483f-a4a2-0d8c6b9b0ef7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:43.769363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5551191f-f676-483f-a4a2-0d8c6b9b0ef7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:43.771961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5551191f-f676-483f-a4a2-0d8c6b9b0ef7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:44.329607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5551191f-f676-483f-a4a2-0d8c6b9b0ef7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:44.344487 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5551191f-f676-483f-a4a2-0d8c6b9b0ef7 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1334 microversion: 2.1 time: 0.599389 Mar 12 21:04:44.353647 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2896/3664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:43 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1334 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:44.353647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3068f884-9512-4f66-bda8-af0127e0cfa1 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:44.353647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3068f884-9512-4f66-bda8-af0127e0cfa1 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:44.369276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3068f884-9512-4f66-bda8-af0127e0cfa1 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:44.369754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3068f884-9512-4f66-bda8-af0127e0cfa1 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:44.373166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3068f884-9512-4f66-bda8-af0127e0cfa1 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:44.374235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3068f884-9512-4f66-bda8-af0127e0cfa1 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:45.222984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3068f884-9512-4f66-bda8-af0127e0cfa1 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:45.230717 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3068f884-9512-4f66-bda8-af0127e0cfa1 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 0.884227 Mar 12 21:04:45.231316 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2897/3665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:44 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:45.242151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a68f031-a370-411b-96e8-8b38105a4377 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:45.242151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a68f031-a370-411b-96e8-8b38105a4377 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:45.252671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a68f031-a370-411b-96e8-8b38105a4377 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:45.253138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a68f031-a370-411b-96e8-8b38105a4377 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:45.260153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a68f031-a370-411b-96e8-8b38105a4377 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:45.260153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a68f031-a370-411b-96e8-8b38105a4377 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:45.784154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5a68f031-a370-411b-96e8-8b38105a4377 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:45.795200 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a68f031-a370-411b-96e8-8b38105a4377 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1365 microversion: 2.1 time: 0.558859 Mar 12 21:04:45.806210 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2898/3666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:45 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1365 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:45.817229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-87dd08cd-5f3a-4d7b-9e25-f84941154d72 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:45.823019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-87dd08cd-5f3a-4d7b-9e25-f84941154d72 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:45.834248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87dd08cd-5f3a-4d7b-9e25-f84941154d72 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:45.834711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87dd08cd-5f3a-4d7b-9e25-f84941154d72 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:45.835512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87dd08cd-5f3a-4d7b-9e25-f84941154d72 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:45.835962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87dd08cd-5f3a-4d7b-9e25-f84941154d72 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:46.330380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-87dd08cd-5f3a-4d7b-9e25-f84941154d72 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:46.342650 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-87dd08cd-5f3a-4d7b-9e25-f84941154d72 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1334 microversion: 2.1 time: 0.534877 Mar 12 21:04:46.343571 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2899/3667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:45 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1334 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:46.349050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-cf918bcd-f258-42af-90f6-dfb00edd5eb8 req-433554aa-a6be-4059-a4cf-3505e7bb2feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0063682b-58f8-4377-a1b9-7c9168894a92", "name": "network-vif-plugged", "status": "completed", "tag": "3c8e5170-29b4-4da8-b1fd-4e3c766ca7e1"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:46.361810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cf918bcd-f258-42af-90f6-dfb00edd5eb8 req-433554aa-a6be-4059-a4cf-3505e7bb2feb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:46.362262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cf918bcd-f258-42af-90f6-dfb00edd5eb8 req-433554aa-a6be-4059-a4cf-3505e7bb2feb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:46.381402 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-cf918bcd-f258-42af-90f6-dfb00edd5eb8 req-433554aa-a6be-4059-a4cf-3505e7bb2feb service nova] Creating event network-vif-plugged:3c8e5170-29b4-4da8-b1fd-4e3c766ca7e1 for instance 0063682b-58f8-4377-a1b9-7c9168894a92 on nch2-master-1 Mar 12 21:04:46.390228 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-cf918bcd-f258-42af-90f6-dfb00edd5eb8 req-433554aa-a6be-4059-a4cf-3505e7bb2feb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042386 Mar 12 21:04:46.391359 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2900/3668] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:46.400129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6cf9a92e-174b-4a75-b4e2-337d59f946cc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:46.402311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6cf9a92e-174b-4a75-b4e2-337d59f946cc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:46.411299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cf9a92e-174b-4a75-b4e2-337d59f946cc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:46.413038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cf9a92e-174b-4a75-b4e2-337d59f946cc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:46.414788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cf9a92e-174b-4a75-b4e2-337d59f946cc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:46.415905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6cf9a92e-174b-4a75-b4e2-337d59f946cc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:46.566552 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6cf9a92e-174b-4a75-b4e2-337d59f946cc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.171941 Mar 12 21:04:46.568226 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2901/3669] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:04:46 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:04:46.589101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a4b6fb14-dac3-4209-8460-4137e4794f79 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:46.593417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a4b6fb14-dac3-4209-8460-4137e4794f79 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:46.608831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4b6fb14-dac3-4209-8460-4137e4794f79 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:46.609590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4b6fb14-dac3-4209-8460-4137e4794f79 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:46.610937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4b6fb14-dac3-4209-8460-4137e4794f79 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:46.611565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4b6fb14-dac3-4209-8460-4137e4794f79 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:47.247776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a4b6fb14-dac3-4209-8460-4137e4794f79 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:47.257032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a4b6fb14-dac3-4209-8460-4137e4794f79 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 0.687375 Mar 12 21:04:47.259086 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2902/3670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:46 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:47.277299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-76b8cdfd-638e-4d65-8e69-3b3c87aa1345 req-ec10233e-5dfd-4448-b838-20d46c94998e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b45740c-54fc-46b5-80d2-634e8f8ec3d2", "tag": "408ebe63-d619-429a-851a-97ee01a4db89"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:47.287505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-76b8cdfd-638e-4d65-8e69-3b3c87aa1345 req-ec10233e-5dfd-4448-b838-20d46c94998e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:47.288261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-76b8cdfd-638e-4d65-8e69-3b3c87aa1345 req-ec10233e-5dfd-4448-b838-20d46c94998e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:47.302406 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-76b8cdfd-638e-4d65-8e69-3b3c87aa1345 req-ec10233e-5dfd-4448-b838-20d46c94998e service nova] Creating event network-changed:408ebe63-d619-429a-851a-97ee01a4db89 for instance 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 on nch1-master-1 Mar 12 21:04:47.307777 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-76b8cdfd-638e-4d65-8e69-3b3c87aa1345 req-ec10233e-5dfd-4448-b838-20d46c94998e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036743 Mar 12 21:04:47.308772 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2903/3671] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:47.315245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-18656949-476b-4c58-834f-f06b50b1127e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:47.315994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-18656949-476b-4c58-834f-f06b50b1127e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:47.322396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18656949-476b-4c58-834f-f06b50b1127e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:47.322909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18656949-476b-4c58-834f-f06b50b1127e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:47.323905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18656949-476b-4c58-834f-f06b50b1127e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:47.324418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18656949-476b-4c58-834f-f06b50b1127e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:48.959348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-18656949-476b-4c58-834f-f06b50b1127e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:48.967478 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-18656949-476b-4c58-834f-f06b50b1127e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1672 microversion: 2.1 time: 1.657430 Mar 12 21:04:48.978131 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2904/3672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:47 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1672 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:48.983155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b573f596-0149-43b5-82a0-3c375bb88f81 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:48.983778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b573f596-0149-43b5-82a0-3c375bb88f81 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:48.998839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b573f596-0149-43b5-82a0-3c375bb88f81 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:48.999292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b573f596-0149-43b5-82a0-3c375bb88f81 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:49.000075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b573f596-0149-43b5-82a0-3c375bb88f81 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:49.000513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b573f596-0149-43b5-82a0-3c375bb88f81 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:49.702146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b573f596-0149-43b5-82a0-3c375bb88f81 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:49.712122 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b573f596-0149-43b5-82a0-3c375bb88f81 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1365 microversion: 2.1 time: 0.732723 Mar 12 21:04:49.714686 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2905/3673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:48 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1365 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:49.728021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-930af4c0-3493-4352-8c75-5a75aed69a2f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:49.728863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-930af4c0-3493-4352-8c75-5a75aed69a2f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:49.745527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-930af4c0-3493-4352-8c75-5a75aed69a2f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:49.750438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-930af4c0-3493-4352-8c75-5a75aed69a2f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:49.751460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-930af4c0-3493-4352-8c75-5a75aed69a2f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:49.752182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-930af4c0-3493-4352-8c75-5a75aed69a2f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:50.136265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-930af4c0-3493-4352-8c75-5a75aed69a2f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:50.145619 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-930af4c0-3493-4352-8c75-5a75aed69a2f tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1334 microversion: 2.1 time: 0.429357 Mar 12 21:04:50.146634 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2906/3674] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:49 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1334 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:50.163066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4da888fd-f47d-4a77-b8da-d5d33e079f22 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:50.163901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4da888fd-f47d-4a77-b8da-d5d33e079f22 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:50.170985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da888fd-f47d-4a77-b8da-d5d33e079f22 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:50.171624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da888fd-f47d-4a77-b8da-d5d33e079f22 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:50.172557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da888fd-f47d-4a77-b8da-d5d33e079f22 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:50.173144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da888fd-f47d-4a77-b8da-d5d33e079f22 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:50.511393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4da888fd-f47d-4a77-b8da-d5d33e079f22 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:50.522688 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4da888fd-f47d-4a77-b8da-d5d33e079f22 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1486 microversion: 2.1 time: 0.363884 Mar 12 21:04:50.523587 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2907/3675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:50 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1486 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:50.530031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8c6c1192-afee-4270-9c8d-98a0f77f3002 req-6715d13a-e5fc-470a-b7ec-622245614d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0063682b-58f8-4377-a1b9-7c9168894a92", "name": "network-vif-plugged", "status": "completed", "tag": "780a6356-5da0-4249-801a-c746bd0e1025"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:50.540511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8c6c1192-afee-4270-9c8d-98a0f77f3002 req-6715d13a-e5fc-470a-b7ec-622245614d28 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:50.541656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8c6c1192-afee-4270-9c8d-98a0f77f3002 req-6715d13a-e5fc-470a-b7ec-622245614d28 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:50.588590 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8c6c1192-afee-4270-9c8d-98a0f77f3002 req-6715d13a-e5fc-470a-b7ec-622245614d28 service nova] Creating event network-vif-plugged:780a6356-5da0-4249-801a-c746bd0e1025 for instance 0063682b-58f8-4377-a1b9-7c9168894a92 on nch2-master-1 Mar 12 21:04:50.600691 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8c6c1192-afee-4270-9c8d-98a0f77f3002 req-6715d13a-e5fc-470a-b7ec-622245614d28 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075414 Mar 12 21:04:50.601312 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2908/3676] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:50.614555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c29e59f-35f9-47b4-9f3e-6cb6f9c140fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:50.615569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2c29e59f-35f9-47b4-9f3e-6cb6f9c140fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:50.625169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c29e59f-35f9-47b4-9f3e-6cb6f9c140fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:50.626114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c29e59f-35f9-47b4-9f3e-6cb6f9c140fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:50.628052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c29e59f-35f9-47b4-9f3e-6cb6f9c140fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:50.629183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c29e59f-35f9-47b4-9f3e-6cb6f9c140fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:50.899452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c29e59f-35f9-47b4-9f3e-6cb6f9c140fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:50.910188 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c29e59f-35f9-47b4-9f3e-6cb6f9c140fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.307323 Mar 12 21:04:50.911367 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2909/3677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:50 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:50.917149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a86f8185-7897-48a9-ad52-597e5674f2ad tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:50.917755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a86f8185-7897-48a9-ad52-597e5674f2ad tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:50.938795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a86f8185-7897-48a9-ad52-597e5674f2ad tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:50.941073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a86f8185-7897-48a9-ad52-597e5674f2ad tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:50.942103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a86f8185-7897-48a9-ad52-597e5674f2ad tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:50.942604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a86f8185-7897-48a9-ad52-597e5674f2ad tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:51.056882 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a86f8185-7897-48a9-ad52-597e5674f2ad tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "POST /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191/action" status: 202 len: 0 microversion: 2.1 time: 0.143826 Mar 12 21:04:51.064180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2910/3678] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:04:50 2022] POST /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:04:51.079334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a12f2a39-e4a7-4001-a6bb-268ca0ad590c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:51.082228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a12f2a39-e4a7-4001-a6bb-268ca0ad590c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:51.098074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a12f2a39-e4a7-4001-a6bb-268ca0ad590c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:51.099768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a12f2a39-e4a7-4001-a6bb-268ca0ad590c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:51.102157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a12f2a39-e4a7-4001-a6bb-268ca0ad590c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:51.104226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a12f2a39-e4a7-4001-a6bb-268ca0ad590c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:51.626819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a12f2a39-e4a7-4001-a6bb-268ca0ad590c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:51.636964 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a12f2a39-e4a7-4001-a6bb-268ca0ad590c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1365 microversion: 2.1 time: 0.569744 Mar 12 21:04:51.637571 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2911/3679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:51 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1365 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:51.649407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3905a95f-1cbf-4c61-8d33-0041db35ecc8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:51.657057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3905a95f-1cbf-4c61-8d33-0041db35ecc8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:51.672070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3905a95f-1cbf-4c61-8d33-0041db35ecc8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:51.672972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3905a95f-1cbf-4c61-8d33-0041db35ecc8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:51.675391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3905a95f-1cbf-4c61-8d33-0041db35ecc8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:51.676616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3905a95f-1cbf-4c61-8d33-0041db35ecc8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:52.258776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3905a95f-1cbf-4c61-8d33-0041db35ecc8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:52.274827 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3905a95f-1cbf-4c61-8d33-0041db35ecc8 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1494 microversion: 2.1 time: 0.634700 Mar 12 21:04:52.276911 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2912/3680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:51 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1494 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:52.286071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34b2d9e1-44a6-47e2-be14-9d5876dc8b73 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:52.286723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34b2d9e1-44a6-47e2-be14-9d5876dc8b73 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:52.300782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34b2d9e1-44a6-47e2-be14-9d5876dc8b73 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:52.302523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34b2d9e1-44a6-47e2-be14-9d5876dc8b73 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:52.303512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34b2d9e1-44a6-47e2-be14-9d5876dc8b73 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:52.310483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34b2d9e1-44a6-47e2-be14-9d5876dc8b73 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:53.162908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34b2d9e1-44a6-47e2-be14-9d5876dc8b73 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:53.175065 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34b2d9e1-44a6-47e2-be14-9d5876dc8b73 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1670 microversion: 2.1 time: 0.895902 Mar 12 21:04:53.189916 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2913/3681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:52 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1670 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:53.195209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d449f34-129f-48bc-bb88-729c7b61fce1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:53.196082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8d449f34-129f-48bc-bb88-729c7b61fce1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:53.204627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d449f34-129f-48bc-bb88-729c7b61fce1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:53.205420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d449f34-129f-48bc-bb88-729c7b61fce1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:53.206585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d449f34-129f-48bc-bb88-729c7b61fce1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:53.207259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d449f34-129f-48bc-bb88-729c7b61fce1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:53.405984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d449f34-129f-48bc-bb88-729c7b61fce1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:53.413360 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d449f34-129f-48bc-bb88-729c7b61fce1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1365 microversion: 2.1 time: 0.222158 Mar 12 21:04:53.413975 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2914/3682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:53 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:53.426606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a168d8ff-3e79-4314-83a6-0457b7d5c9d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:53.427105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a168d8ff-3e79-4314-83a6-0457b7d5c9d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:53.438564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a168d8ff-3e79-4314-83a6-0457b7d5c9d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:53.439381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a168d8ff-3e79-4314-83a6-0457b7d5c9d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:53.440509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a168d8ff-3e79-4314-83a6-0457b7d5c9d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:53.441118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a168d8ff-3e79-4314-83a6-0457b7d5c9d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:53.476758 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a168d8ff-3e79-4314-83a6-0457b7d5c9d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92/ips" status: 200 len: 180 microversion: 2.1 time: 0.056288 Mar 12 21:04:53.477613 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2915/3683] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 21:04:53 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92/ips => generated 180 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:53.482966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dae6658b-10ba-48a3-80cd-9ba90f615a5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:53.483583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dae6658b-10ba-48a3-80cd-9ba90f615a5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:53.489650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dae6658b-10ba-48a3-80cd-9ba90f615a5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:53.490429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dae6658b-10ba-48a3-80cd-9ba90f615a5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:53.491460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dae6658b-10ba-48a3-80cd-9ba90f615a5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:53.492125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dae6658b-10ba-48a3-80cd-9ba90f615a5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:53.878583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dae6658b-10ba-48a3-80cd-9ba90f615a5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:53.899563 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dae6658b-10ba-48a3-80cd-9ba90f615a5f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1494 microversion: 2.1 time: 0.420598 Mar 12 21:04:53.900617 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2916/3684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:53 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1494 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:53.905710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-19a3f09f-c305-428a-96ed-6bf86b1baf84 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:53.906338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19a3f09f-c305-428a-96ed-6bf86b1baf84 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:53.913193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19a3f09f-c305-428a-96ed-6bf86b1baf84 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:53.913588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19a3f09f-c305-428a-96ed-6bf86b1baf84 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:53.914402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19a3f09f-c305-428a-96ed-6bf86b1baf84 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:53.921914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19a3f09f-c305-428a-96ed-6bf86b1baf84 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:53.959602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19a3f09f-c305-428a-96ed-6bf86b1baf84 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:04:54.076909 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-19a3f09f-c305-428a-96ed-6bf86b1baf84 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 204 len: 0 microversion: 2.1 time: 0.172729 Mar 12 21:04:54.078098 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2917/3685] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:04:53 2022] DELETE /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:04:54.093038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ee6a0c7-13b1-4314-91a6-b85ed737c49c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:54.118950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ee6a0c7-13b1-4314-91a6-b85ed737c49c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:54.156373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ee6a0c7-13b1-4314-91a6-b85ed737c49c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:54.158898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ee6a0c7-13b1-4314-91a6-b85ed737c49c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:54.160435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ee6a0c7-13b1-4314-91a6-b85ed737c49c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:54.161148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ee6a0c7-13b1-4314-91a6-b85ed737c49c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:54.495920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6ee6a0c7-13b1-4314-91a6-b85ed737c49c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:54.504076 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ee6a0c7-13b1-4314-91a6-b85ed737c49c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1676 microversion: 2.1 time: 0.421276 Mar 12 21:04:54.521463 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2918/3686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:54 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1676 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:04:54.527015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4fad70a7-92af-49ca-bb75-701b403ca56d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:54.529202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4fad70a7-92af-49ca-bb75-701b403ca56d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:54.543267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fad70a7-92af-49ca-bb75-701b403ca56d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:54.544001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fad70a7-92af-49ca-bb75-701b403ca56d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:54.545117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fad70a7-92af-49ca-bb75-701b403ca56d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:54.546697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fad70a7-92af-49ca-bb75-701b403ca56d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:54.964992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4fad70a7-92af-49ca-bb75-701b403ca56d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:54.973532 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4fad70a7-92af-49ca-bb75-701b403ca56d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1365 microversion: 2.1 time: 0.450815 Mar 12 21:04:54.981167 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2919/3687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:54 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1365 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:54.989985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39b70539-1870-4112-91f4-5e26ee72447d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:54.991308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39b70539-1870-4112-91f4-5e26ee72447d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:55.006443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39b70539-1870-4112-91f4-5e26ee72447d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:55.007726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39b70539-1870-4112-91f4-5e26ee72447d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:55.009194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39b70539-1870-4112-91f4-5e26ee72447d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:55.011394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39b70539-1870-4112-91f4-5e26ee72447d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:55.653430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39b70539-1870-4112-91f4-5e26ee72447d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:55.672464 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39b70539-1870-4112-91f4-5e26ee72447d tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1494 microversion: 2.1 time: 0.689603 Mar 12 21:04:55.673674 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2920/3688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:54 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1494 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:55.702495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cb898a46-24a3-4e70-83fe-82b144667a94 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:55.703734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cb898a46-24a3-4e70-83fe-82b144667a94 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:55.723028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb898a46-24a3-4e70-83fe-82b144667a94 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:55.726604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb898a46-24a3-4e70-83fe-82b144667a94 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:55.732703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb898a46-24a3-4e70-83fe-82b144667a94 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:55.733196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb898a46-24a3-4e70-83fe-82b144667a94 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:56.532893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cb898a46-24a3-4e70-83fe-82b144667a94 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:56.541067 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cb898a46-24a3-4e70-83fe-82b144667a94 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1676 microversion: 2.1 time: 0.866126 Mar 12 21:04:56.552339 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2921/3689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:55 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1676 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:56.563774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b1d1bbc7-02c6-455e-a02a-c70b4c485dc2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:56.569390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b1d1bbc7-02c6-455e-a02a-c70b4c485dc2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:56.583411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1d1bbc7-02c6-455e-a02a-c70b4c485dc2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:56.584248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1d1bbc7-02c6-455e-a02a-c70b4c485dc2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:56.585487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1d1bbc7-02c6-455e-a02a-c70b4c485dc2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:56.586591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1d1bbc7-02c6-455e-a02a-c70b4c485dc2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:57.029958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b1d1bbc7-02c6-455e-a02a-c70b4c485dc2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:57.039443 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b1d1bbc7-02c6-455e-a02a-c70b4c485dc2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1365 microversion: 2.1 time: 0.485513 Mar 12 21:04:57.050376 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2922/3690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:56 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1365 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:57.055913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6e914e92-7ff9-46b2-be67-8fdfbada0a63 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:57.061472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6e914e92-7ff9-46b2-be67-8fdfbada0a63 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:57.096212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e914e92-7ff9-46b2-be67-8fdfbada0a63 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:57.097028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e914e92-7ff9-46b2-be67-8fdfbada0a63 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:57.102344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e914e92-7ff9-46b2-be67-8fdfbada0a63 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:57.103112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e914e92-7ff9-46b2-be67-8fdfbada0a63 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:58.302045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6e914e92-7ff9-46b2-be67-8fdfbada0a63 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:58.320563 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6e914e92-7ff9-46b2-be67-8fdfbada0a63 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1500 microversion: 2.1 time: 1.268349 Mar 12 21:04:58.322118 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2923/3691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:57 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1500 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:58.349248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-06d39566-1d6e-4c96-aaea-386a214de6bb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:58.350492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-06d39566-1d6e-4c96-aaea-386a214de6bb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:58.360381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06d39566-1d6e-4c96-aaea-386a214de6bb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:58.361258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06d39566-1d6e-4c96-aaea-386a214de6bb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:58.364737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06d39566-1d6e-4c96-aaea-386a214de6bb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:58.369149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06d39566-1d6e-4c96-aaea-386a214de6bb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:59.160635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-06d39566-1d6e-4c96-aaea-386a214de6bb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd71701480d764e4e8995346f9b464aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506297c5930140e3b2a54284d502b722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:59.175393 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-06d39566-1d6e-4c96-aaea-386a214de6bb tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 200 len: 1655 microversion: 2.1 time: 0.850884 Mar 12 21:04:59.176031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2924/3692] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:58 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 1655 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:59.180566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9c92d71c-7e59-449b-b2d0-325bb39f8c35 req-61ca8fb6-f5a9-477f-8719-277f26cdbe8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0063682b-58f8-4377-a1b9-7c9168894a92", "name": "network-vif-deleted", "tag": "3c8e5170-29b4-4da8-b1fd-4e3c766ca7e1"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:04:59.201711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9c92d71c-7e59-449b-b2d0-325bb39f8c35 req-61ca8fb6-f5a9-477f-8719-277f26cdbe8d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:59.202192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9c92d71c-7e59-449b-b2d0-325bb39f8c35 req-61ca8fb6-f5a9-477f-8719-277f26cdbe8d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:59.230343 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9c92d71c-7e59-449b-b2d0-325bb39f8c35 req-61ca8fb6-f5a9-477f-8719-277f26cdbe8d service nova] Creating event network-vif-deleted:3c8e5170-29b4-4da8-b1fd-4e3c766ca7e1 for instance 0063682b-58f8-4377-a1b9-7c9168894a92 on nch2-master-1 Mar 12 21:04:59.244004 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9c92d71c-7e59-449b-b2d0-325bb39f8c35 req-61ca8fb6-f5a9-477f-8719-277f26cdbe8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066736 Mar 12 21:04:59.246149 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2925/3693] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:04:59.262028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-24bf2d7b-ee66-4af7-bc3b-229be7238bd2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:59.263643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-24bf2d7b-ee66-4af7-bc3b-229be7238bd2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:59.281197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24bf2d7b-ee66-4af7-bc3b-229be7238bd2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:59.281676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24bf2d7b-ee66-4af7-bc3b-229be7238bd2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:59.284426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24bf2d7b-ee66-4af7-bc3b-229be7238bd2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:59.284943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24bf2d7b-ee66-4af7-bc3b-229be7238bd2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:59.714173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-24bf2d7b-ee66-4af7-bc3b-229be7238bd2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:04:59.726202 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-24bf2d7b-ee66-4af7-bc3b-229be7238bd2 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1365 microversion: 2.1 time: 0.474792 Mar 12 21:04:59.730287 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2926/3694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:04:59 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1365 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:04:59.757714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-81b4012d-293f-46d3-a105-dedb77c2ae17 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:04:59.762184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-81b4012d-293f-46d3-a105-dedb77c2ae17 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:04:59.775914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81b4012d-293f-46d3-a105-dedb77c2ae17 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:59.777534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81b4012d-293f-46d3-a105-dedb77c2ae17 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:59.780740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81b4012d-293f-46d3-a105-dedb77c2ae17 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:04:59.786466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81b4012d-293f-46d3-a105-dedb77c2ae17 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:04:59.838981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-81b4012d-293f-46d3-a105-dedb77c2ae17 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:05:00.017280 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-81b4012d-293f-46d3-a105-dedb77c2ae17 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "DELETE /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 204 len: 0 microversion: 2.1 time: 0.283746 Mar 12 21:05:00.019209 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2927/3695] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:04:59 2022] DELETE /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:05:00.033336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e4deea2b-5d47-49c1-a3c1-5bac2246b4a3 req-ed06c164-cdbc-4ef2-8bda-9757a8b51c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b45740c-54fc-46b5-80d2-634e8f8ec3d2", "name": "network-vif-plugged", "status": "completed", "tag": "408ebe63-d619-429a-851a-97ee01a4db89"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:00.051087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e4deea2b-5d47-49c1-a3c1-5bac2246b4a3 req-ed06c164-cdbc-4ef2-8bda-9757a8b51c0b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:00.051671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e4deea2b-5d47-49c1-a3c1-5bac2246b4a3 req-ed06c164-cdbc-4ef2-8bda-9757a8b51c0b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:00.071855 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e4deea2b-5d47-49c1-a3c1-5bac2246b4a3 req-ed06c164-cdbc-4ef2-8bda-9757a8b51c0b service nova] Creating event network-vif-plugged:408ebe63-d619-429a-851a-97ee01a4db89 for instance 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 on nch1-master-1 Mar 12 21:05:00.077949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e4deea2b-5d47-49c1-a3c1-5bac2246b4a3 req-ed06c164-cdbc-4ef2-8bda-9757a8b51c0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057101 Mar 12 21:05:00.079426 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2928/3696] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:00.085100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-128b9a3e-5a49-4952-8450-efee7c147f57 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:00.086116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-128b9a3e-5a49-4952-8450-efee7c147f57 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:00.094073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-128b9a3e-5a49-4952-8450-efee7c147f57 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:00.094849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-128b9a3e-5a49-4952-8450-efee7c147f57 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:00.095960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-128b9a3e-5a49-4952-8450-efee7c147f57 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:00.096811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-128b9a3e-5a49-4952-8450-efee7c147f57 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:00.661687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-128b9a3e-5a49-4952-8450-efee7c147f57 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:00.671299 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-128b9a3e-5a49-4952-8450-efee7c147f57 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 0.590421 Mar 12 21:05:00.679789 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2929/3697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:00 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:00.697444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-60dfc80c-5349-48b0-8dd0-40eaf132f527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:00.700236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-60dfc80c-5349-48b0-8dd0-40eaf132f527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:00.713100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60dfc80c-5349-48b0-8dd0-40eaf132f527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:00.714943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60dfc80c-5349-48b0-8dd0-40eaf132f527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:00.724404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60dfc80c-5349-48b0-8dd0-40eaf132f527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:00.727365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60dfc80c-5349-48b0-8dd0-40eaf132f527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:00.750220 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-60dfc80c-5349-48b0-8dd0-40eaf132f527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] HTTP exception thrown: Instance 0063682b-58f8-4377-a1b9-7c9168894a92 could not be found. Mar 12 21:05:00.750849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-60dfc80c-5349-48b0-8dd0-40eaf132f527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Returning 404 to user: Instance 0063682b-58f8-4377-a1b9-7c9168894a92 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:05:00.751703 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-60dfc80c-5349-48b0-8dd0-40eaf132f527 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 404 len: 111 microversion: 2.1 time: 0.070586 Mar 12 21:05:00.761092 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2930/3698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:00 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:05:00.768882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fe3de188-d74d-4d33-b4c2-e80d2d0cce3d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:00.773248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fe3de188-d74d-4d33-b4c2-e80d2d0cce3d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:00.788417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe3de188-d74d-4d33-b4c2-e80d2d0cce3d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:00.788826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe3de188-d74d-4d33-b4c2-e80d2d0cce3d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:00.789631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe3de188-d74d-4d33-b4c2-e80d2d0cce3d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:00.790116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe3de188-d74d-4d33-b4c2-e80d2d0cce3d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:01.178918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fe3de188-d74d-4d33-b4c2-e80d2d0cce3d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:01.188032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fe3de188-d74d-4d33-b4c2-e80d2d0cce3d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1365 microversion: 2.1 time: 0.422877 Mar 12 21:05:01.189346 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2931/3699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:00 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1365 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:01.298785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-41188bb3-cf58-4f48-8c79-d2027157b4b7 req-462e50aa-aabe-48f4-a608-447666af946b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0063682b-58f8-4377-a1b9-7c9168894a92", "name": "network-vif-deleted", "tag": "780a6356-5da0-4249-801a-c746bd0e1025"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:01.319646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-41188bb3-cf58-4f48-8c79-d2027157b4b7 req-462e50aa-aabe-48f4-a608-447666af946b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:01.320494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-41188bb3-cf58-4f48-8c79-d2027157b4b7 req-462e50aa-aabe-48f4-a608-447666af946b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:01.346595 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-41188bb3-cf58-4f48-8c79-d2027157b4b7 req-462e50aa-aabe-48f4-a608-447666af946b service nova] Creating event network-vif-deleted:780a6356-5da0-4249-801a-c746bd0e1025 for instance 0063682b-58f8-4377-a1b9-7c9168894a92 on nch2-master-1 Mar 12 21:05:01.364142 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-41188bb3-cf58-4f48-8c79-d2027157b4b7 req-462e50aa-aabe-48f4-a608-447666af946b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065404 Mar 12 21:05:01.364142 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2932/3700] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:01.698691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ffcb50f-aed6-4a0c-a160-89334cfabda2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:01.699863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ffcb50f-aed6-4a0c-a160-89334cfabda2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:01.711341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ffcb50f-aed6-4a0c-a160-89334cfabda2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:01.712080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ffcb50f-aed6-4a0c-a160-89334cfabda2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:01.713136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ffcb50f-aed6-4a0c-a160-89334cfabda2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:01.713806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ffcb50f-aed6-4a0c-a160-89334cfabda2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:02.248594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ffcb50f-aed6-4a0c-a160-89334cfabda2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:02.259082 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ffcb50f-aed6-4a0c-a160-89334cfabda2 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 0.565920 Mar 12 21:05:02.260561 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2933/3701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:01 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:05:02.271016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-181b9808-5f28-4ad3-bd6f-e25ba73406e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:02.272040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-181b9808-5f28-4ad3-bd6f-e25ba73406e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:02.287504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-181b9808-5f28-4ad3-bd6f-e25ba73406e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:02.288325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-181b9808-5f28-4ad3-bd6f-e25ba73406e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:02.289324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-181b9808-5f28-4ad3-bd6f-e25ba73406e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:02.292172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-181b9808-5f28-4ad3-bd6f-e25ba73406e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:03.473217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-181b9808-5f28-4ad3-bd6f-e25ba73406e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:03.481023 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-181b9808-5f28-4ad3-bd6f-e25ba73406e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1555 microversion: 2.1 time: 1.217444 Mar 12 21:05:03.484913 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2934/3702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:02 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1555 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:03.498114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fff1ff5e-864f-4ba6-9296-3037d6b518fc tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:03.499434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fff1ff5e-864f-4ba6-9296-3037d6b518fc tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:03.526527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fff1ff5e-864f-4ba6-9296-3037d6b518fc tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:03.534304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fff1ff5e-864f-4ba6-9296-3037d6b518fc tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:03.537741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fff1ff5e-864f-4ba6-9296-3037d6b518fc tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:03.539851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fff1ff5e-864f-4ba6-9296-3037d6b518fc tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:04.146390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fff1ff5e-864f-4ba6-9296-3037d6b518fc tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:04.154826 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fff1ff5e-864f-4ba6-9296-3037d6b518fc tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1506 microversion: 2.1 time: 0.668655 Mar 12 21:05:04.165897 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2935/3703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:03 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1506 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:04.172652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-03c47e46-38b0-43ba-8ed7-612823901ebd tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:04.173355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-03c47e46-38b0-43ba-8ed7-612823901ebd tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:04.180190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03c47e46-38b0-43ba-8ed7-612823901ebd tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:04.180897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03c47e46-38b0-43ba-8ed7-612823901ebd tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:04.181894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03c47e46-38b0-43ba-8ed7-612823901ebd tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:04.182504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03c47e46-38b0-43ba-8ed7-612823901ebd tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:04.417069 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-03c47e46-38b0-43ba-8ed7-612823901ebd tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.249277 Mar 12 21:05:04.418125 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2936/3704] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 21:05:04 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2/os-interface => generated 284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:05.173241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc3db497-076a-416c-b763-c9e77a3e8380 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:05.174902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc3db497-076a-416c-b763-c9e77a3e8380 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:05.193593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc3db497-076a-416c-b763-c9e77a3e8380 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:05.198607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc3db497-076a-416c-b763-c9e77a3e8380 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:05.203424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc3db497-076a-416c-b763-c9e77a3e8380 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:05.204935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc3db497-076a-416c-b763-c9e77a3e8380 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:05.488360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dc3db497-076a-416c-b763-c9e77a3e8380 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:05.499490 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc3db497-076a-416c-b763-c9e77a3e8380 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 200 len: 1464 microversion: 2.1 time: 0.330937 Mar 12 21:05:05.501010 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2937/3705] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:05 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 1464 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:05:05.510302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-74010f1d-03c6-4b0e-aea6-fb5cb799443b req-7598fe81-c37d-4541-9b2c-4c3de268797d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606d3cae-7b25-47f1-aa0e-fa2ef65a7191", "name": "network-vif-deleted", "tag": "b004f947-4fd0-4512-b2de-019a6f47759d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:05.525868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-74010f1d-03c6-4b0e-aea6-fb5cb799443b req-7598fe81-c37d-4541-9b2c-4c3de268797d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:05.526620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-74010f1d-03c6-4b0e-aea6-fb5cb799443b req-7598fe81-c37d-4541-9b2c-4c3de268797d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:05.540128 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-74010f1d-03c6-4b0e-aea6-fb5cb799443b req-7598fe81-c37d-4541-9b2c-4c3de268797d service nova] Creating event network-vif-deleted:b004f947-4fd0-4512-b2de-019a6f47759d for instance 606d3cae-7b25-47f1-aa0e-fa2ef65a7191 on nch1-master-1 Mar 12 21:05:05.547172 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-74010f1d-03c6-4b0e-aea6-fb5cb799443b req-7598fe81-c37d-4541-9b2c-4c3de268797d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041144 Mar 12 21:05:05.548191 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2938/3706] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:06.428528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7e9d8add-2ea4-469e-9249-bcf25b48c0d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:06.430057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7e9d8add-2ea4-469e-9249-bcf25b48c0d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:06.450207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e9d8add-2ea4-469e-9249-bcf25b48c0d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.451090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e9d8add-2ea4-469e-9249-bcf25b48c0d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.452559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e9d8add-2ea4-469e-9249-bcf25b48c0d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.453169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e9d8add-2ea4-469e-9249-bcf25b48c0d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.480761 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-7e9d8add-2ea4-469e-9249-bcf25b48c0d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] HTTP exception thrown: Instance 0063682b-58f8-4377-a1b9-7c9168894a92 could not be found. Mar 12 21:05:06.483006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7e9d8add-2ea4-469e-9249-bcf25b48c0d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Returning 404 to user: Instance 0063682b-58f8-4377-a1b9-7c9168894a92 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:05:06.484450 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7e9d8add-2ea4-469e-9249-bcf25b48c0d9 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 404 len: 111 microversion: 2.1 time: 0.060006 Mar 12 21:05:06.486254 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2939/3707] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:05:06 2022] DELETE /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:05:06.498443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abc4b198-3935-4da9-afe2-6fb08026caa3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:06.499802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-abc4b198-3935-4da9-afe2-6fb08026caa3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: 0063682b-58f8-4377-a1b9-7c9168894a92] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:06.508172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abc4b198-3935-4da9-afe2-6fb08026caa3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.508877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abc4b198-3935-4da9-afe2-6fb08026caa3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.509978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abc4b198-3935-4da9-afe2-6fb08026caa3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.510609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abc4b198-3935-4da9-afe2-6fb08026caa3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.527503 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-abc4b198-3935-4da9-afe2-6fb08026caa3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] HTTP exception thrown: Instance 0063682b-58f8-4377-a1b9-7c9168894a92 could not be found. Mar 12 21:05:06.528444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abc4b198-3935-4da9-afe2-6fb08026caa3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Returning 404 to user: Instance 0063682b-58f8-4377-a1b9-7c9168894a92 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:05:06.529402 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-abc4b198-3935-4da9-afe2-6fb08026caa3 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92" status: 404 len: 111 microversion: 2.1 time: 0.040215 Mar 12 21:05:06.530238 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2940/3708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:06 2022] GET /compute/v2.1/servers/0063682b-58f8-4377-a1b9-7c9168894a92 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:05:06.536974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cee0676a-64a1-422e-8f41-2747df46bdde tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:06.538094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cee0676a-64a1-422e-8f41-2747df46bdde tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: 606d3cae-7b25-47f1-aa0e-fa2ef65a7191] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:06.547086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cee0676a-64a1-422e-8f41-2747df46bdde tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.547908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cee0676a-64a1-422e-8f41-2747df46bdde tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.548773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cee0676a-64a1-422e-8f41-2747df46bdde tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.549450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cee0676a-64a1-422e-8f41-2747df46bdde tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.569069 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-cee0676a-64a1-422e-8f41-2747df46bdde tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] HTTP exception thrown: Instance 606d3cae-7b25-47f1-aa0e-fa2ef65a7191 could not be found. Mar 12 21:05:06.569931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cee0676a-64a1-422e-8f41-2747df46bdde tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Returning 404 to user: Instance 606d3cae-7b25-47f1-aa0e-fa2ef65a7191 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:05:06.571444 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cee0676a-64a1-422e-8f41-2747df46bdde tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191" status: 404 len: 111 microversion: 2.1 time: 0.039456 Mar 12 21:05:06.573199 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2941/3709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:06 2022] GET /compute/v2.1/servers/606d3cae-7b25-47f1-aa0e-fa2ef65a7191 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:05:06.582156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49cc7c69-9222-408e-b403-9752bcb7b2a1 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:06.582761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-49cc7c69-9222-408e-b403-9752bcb7b2a1 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:06.589946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49cc7c69-9222-408e-b403-9752bcb7b2a1 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.590459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49cc7c69-9222-408e-b403-9752bcb7b2a1 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.591262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49cc7c69-9222-408e-b403-9752bcb7b2a1 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.591904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49cc7c69-9222-408e-b403-9752bcb7b2a1 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.609151 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-49cc7c69-9222-408e-b403-9752bcb7b2a1 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] HTTP exception thrown: Instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c could not be found. Mar 12 21:05:06.610084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49cc7c69-9222-408e-b403-9752bcb7b2a1 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Returning 404 to user: Instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:05:06.611193 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-49cc7c69-9222-408e-b403-9752bcb7b2a1 tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 404 len: 111 microversion: 2.1 time: 0.036714 Mar 12 21:05:06.611869 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2942/3710] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:05:06 2022] DELETE /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:05:06.616757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b0a6e1e-61a5-4153-8a53-947e9810933f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:06.617600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b0a6e1e-61a5-4153-8a53-947e9810933f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:06.624489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b0a6e1e-61a5-4153-8a53-947e9810933f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.625260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b0a6e1e-61a5-4153-8a53-947e9810933f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.626094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b0a6e1e-61a5-4153-8a53-947e9810933f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.626548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b0a6e1e-61a5-4153-8a53-947e9810933f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.651301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b0a6e1e-61a5-4153-8a53-947e9810933f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:05:06.769807 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b0a6e1e-61a5-4153-8a53-947e9810933f tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 204 len: 0 microversion: 2.1 time: 0.156420 Mar 12 21:05:06.770440 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2943/3711] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:05:06 2022] DELETE /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:05:06.780226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9bddd773-d60b-4672-b03a-fb33643aeb3c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:06.780949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9bddd773-d60b-4672-b03a-fb33643aeb3c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] [instance: bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:06.786975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bddd773-d60b-4672-b03a-fb33643aeb3c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.787422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bddd773-d60b-4672-b03a-fb33643aeb3c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.788306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bddd773-d60b-4672-b03a-fb33643aeb3c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.788758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bddd773-d60b-4672-b03a-fb33643aeb3c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.805041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9bddd773-d60b-4672-b03a-fb33643aeb3c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] HTTP exception thrown: Instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c could not be found. Mar 12 21:05:06.805664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9bddd773-d60b-4672-b03a-fb33643aeb3c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] Returning 404 to user: Instance bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:05:06.806542 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9bddd773-d60b-4672-b03a-fb33643aeb3c tempest-ServersTestMultiNic-1588857784 tempest-ServersTestMultiNic-1588857784-project] 10.222.0.30 "GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c" status: 404 len: 111 microversion: 2.1 time: 0.034938 Mar 12 21:05:06.810194 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2944/3712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:06 2022] GET /compute/v2.1/servers/bf0cb3e7-7f8f-4e19-ae81-3cd26d78bb3c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:05:06.817027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1b37ca99-db62-4082-bf15-dd0e7a816e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:06.817658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1b37ca99-db62-4082-bf15-dd0e7a816e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:06.826126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b37ca99-db62-4082-bf15-dd0e7a816e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.826893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b37ca99-db62-4082-bf15-dd0e7a816e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:06.828433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b37ca99-db62-4082-bf15-dd0e7a816e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:06.829112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b37ca99-db62-4082-bf15-dd0e7a816e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:07.535167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1b37ca99-db62-4082-bf15-dd0e7a816e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:07.542568 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1b37ca99-db62-4082-bf15-dd0e7a816e19 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1490 microversion: 2.1 time: 0.731075 Mar 12 21:05:07.543378 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2945/3713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:06 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1490 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:07.668742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d3209102-ffe8-4776-9bc3-3f08a6ec736d req-dbb80848-54b8-4495-9a98-70d0887f4c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b45740c-54fc-46b5-80d2-634e8f8ec3d2", "tag": "408ebe63-d619-429a-851a-97ee01a4db89"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:07.691601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d3209102-ffe8-4776-9bc3-3f08a6ec736d req-dbb80848-54b8-4495-9a98-70d0887f4c39 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:07.693800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d3209102-ffe8-4776-9bc3-3f08a6ec736d req-dbb80848-54b8-4495-9a98-70d0887f4c39 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:07.713329 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d3209102-ffe8-4776-9bc3-3f08a6ec736d req-dbb80848-54b8-4495-9a98-70d0887f4c39 service nova] Creating event network-changed:408ebe63-d619-429a-851a-97ee01a4db89 for instance 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 on nch1-master-1 Mar 12 21:05:07.721026 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d3209102-ffe8-4776-9bc3-3f08a6ec736d req-dbb80848-54b8-4495-9a98-70d0887f4c39 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058972 Mar 12 21:05:07.721473 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2946/3714] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:05:08.561250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6da5b59-f90e-45c4-9f3e-7e96f0cc809b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:08.562395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d6da5b59-f90e-45c4-9f3e-7e96f0cc809b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:08.577614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6da5b59-f90e-45c4-9f3e-7e96f0cc809b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:08.578236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6da5b59-f90e-45c4-9f3e-7e96f0cc809b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:08.579142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6da5b59-f90e-45c4-9f3e-7e96f0cc809b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:08.579884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6da5b59-f90e-45c4-9f3e-7e96f0cc809b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:09.132846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d6da5b59-f90e-45c4-9f3e-7e96f0cc809b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:09.150675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d6da5b59-f90e-45c4-9f3e-7e96f0cc809b tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1490 microversion: 2.1 time: 0.594461 Mar 12 21:05:09.151349 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2947/3715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:08 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1490 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:10.000006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-46b73f2c-fd4e-40ff-8fb1-94f089d73b96 req-f6c46d1a-8cb7-482b-a2a4-71c2fbefb066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6826699-d144-4b11-a12e-7912580e476a", "name": "network-vif-deleted", "tag": "b562ed22-9529-482b-972a-06e309459fa8"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:10.030227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-46b73f2c-fd4e-40ff-8fb1-94f089d73b96 req-f6c46d1a-8cb7-482b-a2a4-71c2fbefb066 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:10.049662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-46b73f2c-fd4e-40ff-8fb1-94f089d73b96 req-f6c46d1a-8cb7-482b-a2a4-71c2fbefb066 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:10.088153 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-46b73f2c-fd4e-40ff-8fb1-94f089d73b96 req-f6c46d1a-8cb7-482b-a2a4-71c2fbefb066 service nova] Creating event network-vif-deleted:b562ed22-9529-482b-972a-06e309459fa8 for instance f6826699-d144-4b11-a12e-7912580e476a on nch2-master-1 Mar 12 21:05:10.095064 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-46b73f2c-fd4e-40ff-8fb1-94f089d73b96 req-f6c46d1a-8cb7-482b-a2a4-71c2fbefb066 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101223 Mar 12 21:05:10.096500 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2948/3716] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:05:10.170938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-238226a6-2e5e-49d5-a3df-a1b36bb56dea tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:10.171641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-238226a6-2e5e-49d5-a3df-a1b36bb56dea tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:10.188885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-238226a6-2e5e-49d5-a3df-a1b36bb56dea tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:10.191338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-238226a6-2e5e-49d5-a3df-a1b36bb56dea tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:10.192206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-238226a6-2e5e-49d5-a3df-a1b36bb56dea tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:10.192672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-238226a6-2e5e-49d5-a3df-a1b36bb56dea tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:10.299184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-238226a6-2e5e-49d5-a3df-a1b36bb56dea tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:10.308638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-238226a6-2e5e-49d5-a3df-a1b36bb56dea tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:10.310325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-238226a6-2e5e-49d5-a3df-a1b36bb56dea tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lazy-loading 'fault' on Instance uuid f6826699-d144-4b11-a12e-7912580e476a {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:05:10.370838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-238226a6-2e5e-49d5-a3df-a1b36bb56dea tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee46ffa14644ea8853ef8b89432c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7213b31fd1ef41b4bd07970ba80dfc04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:10.380354 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-238226a6-2e5e-49d5-a3df-a1b36bb56dea tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 200 len: 1303 microversion: 2.1 time: 0.215363 Mar 12 21:05:10.384286 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2949/3717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:10 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 1303 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:11.400524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d60cb61-a36b-4823-931a-918e372de780 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:11.402047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d60cb61-a36b-4823-931a-918e372de780 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] [instance: f6826699-d144-4b11-a12e-7912580e476a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:11.411219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d60cb61-a36b-4823-931a-918e372de780 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:11.411884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d60cb61-a36b-4823-931a-918e372de780 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:11.412863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d60cb61-a36b-4823-931a-918e372de780 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:11.413658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d60cb61-a36b-4823-931a-918e372de780 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:11.431774 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-7d60cb61-a36b-4823-931a-918e372de780 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] HTTP exception thrown: Instance f6826699-d144-4b11-a12e-7912580e476a could not be found. Mar 12 21:05:11.432597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d60cb61-a36b-4823-931a-918e372de780 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] Returning 404 to user: Instance f6826699-d144-4b11-a12e-7912580e476a could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:05:11.433734 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d60cb61-a36b-4823-931a-918e372de780 tempest-ServerRescueTestJSON-1572933104 tempest-ServerRescueTestJSON-1572933104-project] 10.222.0.30 "GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a" status: 404 len: 111 microversion: 2.1 time: 0.037765 Mar 12 21:05:11.434999 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2950/3718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:11 2022] GET /compute/v2.1/servers/f6826699-d144-4b11-a12e-7912580e476a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:05:13.081751 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:05:13.082416 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:05:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:05:15.527356 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:05:15.527985 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:05:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:05:21.235449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-917044692", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "3bc356e1-2fe7-4340-aecb-f85636b06883"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:21.335369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] validate_networks() for [('3bc356e1-2fe7-4340-aecb-f85636b06883', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:05:22.524591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:05:22.525744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:05:22.527016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:05:22.527646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:05:22.528379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:05:22.539171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:22.539914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:22.540903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:22.541803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:22.589395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:05:22.600604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for user 10e1e3bae5b94b5589b47488329ad756 and project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:05:22.630988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:05:22.634333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:05:22.705712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eba4a0c5-4716-4346-8d89-72d60a123ce3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.920031 Mar 12 21:05:22.706411 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2951/3719] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:05:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:05:22.888770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] Action: 'create', calling method: .version_select at 0x7f6e3558ddc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-984486755", "metadata": {"Type": "work"}}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:23.553190 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a4015660-bcb6-4a9e-beb0-ef60a44da7ff tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.845364 Mar 12 21:05:23.555014 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2952/3720] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Mar 12 21:05:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 848 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 12 21:05:23.560486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec54bcb2-6674-41b1-9f6d-6f282fba4ed8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:23.562708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec54bcb2-6674-41b1-9f6d-6f282fba4ed8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:23.951547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ec54bcb2-6674-41b1-9f6d-6f282fba4ed8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:23.960436 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec54bcb2-6674-41b1-9f6d-6f282fba4ed8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 200 len: 1214 microversion: 2.1 time: 0.404164 Mar 12 21:05:23.965111 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2953/3721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:23 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 1214 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:23.976521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-529bb204-15cf-4b86-a5e3-8f9e065098d7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:23.983313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-529bb204-15cf-4b86-a5e3-8f9e065098d7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:24.020959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-529bb204-15cf-4b86-a5e3-8f9e065098d7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:24.022518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-529bb204-15cf-4b86-a5e3-8f9e065098d7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:24.026807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-529bb204-15cf-4b86-a5e3-8f9e065098d7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:24.027741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-529bb204-15cf-4b86-a5e3-8f9e065098d7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:24.519784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-529bb204-15cf-4b86-a5e3-8f9e065098d7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:24.528723 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-529bb204-15cf-4b86-a5e3-8f9e065098d7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.558598 Mar 12 21:05:24.532249 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2954/3722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:23 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:24.546510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-64faae49-8d0f-4171-9baf-1d724b4199eb tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] Calling method '.version_select at 0x7f6e3558dd30>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:24.645719 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-64faae49-8d0f-4171-9baf-1d724b4199eb tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7489ff1a-97c7-403d-81cf-f73f3c2317d1" status: 200 len: 346 microversion: 2.1 time: 0.109027 Mar 12 21:05:24.647085 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2955/3723] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 21:05:24 2022] GET /compute/v2.1/os-volumes/7489ff1a-97c7-403d-81cf-f73f3c2317d1 => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:24.654594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-61496135-a821-4e12-98f2-ff1736eda5fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:24.655967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-61496135-a821-4e12-98f2-ff1736eda5fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:24.662847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61496135-a821-4e12-98f2-ff1736eda5fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:24.663686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61496135-a821-4e12-98f2-ff1736eda5fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:24.664643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61496135-a821-4e12-98f2-ff1736eda5fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:24.665256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61496135-a821-4e12-98f2-ff1736eda5fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:24.970173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-61496135-a821-4e12-98f2-ff1736eda5fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:24.982931 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-61496135-a821-4e12-98f2-ff1736eda5fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.334501 Mar 12 21:05:24.984605 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2956/3724] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:24 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:24.990550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8121aa31-ce1a-400e-a17b-75d89f6f611a tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] Calling method '.version_select at 0x7f6e3559aaf0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:25.055749 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8121aa31-ce1a-400e-a17b-75d89f6f611a tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7489ff1a-97c7-403d-81cf-f73f3c2317d1" status: 200 len: 346 microversion: 2.1 time: 0.069597 Mar 12 21:05:25.057266 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2957/3725] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 21:05:24 2022] GET /compute/v2.1/os-volumes/7489ff1a-97c7-403d-81cf-f73f3c2317d1 => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:25.062543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30af8ac2-b0e0-4acc-b60f-fedfaa8094ff tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:25.063328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-30af8ac2-b0e0-4acc-b60f-fedfaa8094ff tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:25.071836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30af8ac2-b0e0-4acc-b60f-fedfaa8094ff tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:25.072457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30af8ac2-b0e0-4acc-b60f-fedfaa8094ff tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:25.073406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30af8ac2-b0e0-4acc-b60f-fedfaa8094ff tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:25.074025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30af8ac2-b0e0-4acc-b60f-fedfaa8094ff tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:25.219662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-30af8ac2-b0e0-4acc-b60f-fedfaa8094ff tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:25.241140 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30af8ac2-b0e0-4acc-b60f-fedfaa8094ff tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 200 len: 1272 microversion: 2.1 time: 0.181690 Mar 12 21:05:25.242600 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2958/3726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:25 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:25.252987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-160fcc4e-8838-4348-983c-6cab15d656f4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:25.258529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-160fcc4e-8838-4348-983c-6cab15d656f4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:25.272773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-160fcc4e-8838-4348-983c-6cab15d656f4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:25.273393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-160fcc4e-8838-4348-983c-6cab15d656f4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:25.274727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-160fcc4e-8838-4348-983c-6cab15d656f4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:25.274862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-160fcc4e-8838-4348-983c-6cab15d656f4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:25.579440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-160fcc4e-8838-4348-983c-6cab15d656f4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:25.588321 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-160fcc4e-8838-4348-983c-6cab15d656f4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.343972 Mar 12 21:05:25.592898 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2959/3727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:25 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:25.608399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] Calling method '.version_select at 0x7f6e355a10d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:25.752788 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eaa0ffef-34a5-4ce9-8529-f85a3b6c40b6 tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/7489ff1a-97c7-403d-81cf-f73f3c2317d1" status: 202 len: 0 microversion: 2.1 time: 0.158169 Mar 12 21:05:25.753666 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2960/3728] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 21:05:25 2022] DELETE /compute/v2.1/os-volumes/7489ff1a-97c7-403d-81cf-f73f3c2317d1 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:05:25.759773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-07453388-019c-4a1e-a221-382624f0cb69 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:25.760601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-07453388-019c-4a1e-a221-382624f0cb69 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:25.775711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07453388-019c-4a1e-a221-382624f0cb69 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:25.776423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07453388-019c-4a1e-a221-382624f0cb69 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:25.778858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07453388-019c-4a1e-a221-382624f0cb69 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:25.779323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07453388-019c-4a1e-a221-382624f0cb69 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:26.306645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-07453388-019c-4a1e-a221-382624f0cb69 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:26.317695 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-07453388-019c-4a1e-a221-382624f0cb69 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.562648 Mar 12 21:05:26.318780 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2961/3729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:25 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:26.327753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4922a826-79e7-42c2-bfbe-a3cc1fe1a282 tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] Calling method '.version_select at 0x7f6e355a18b0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:26.426578 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4922a826-79e7-42c2-bfbe-a3cc1fe1a282 tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7489ff1a-97c7-403d-81cf-f73f3c2317d1" status: 200 len: 345 microversion: 2.1 time: 0.105352 Mar 12 21:05:26.428672 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2962/3730] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 21:05:26 2022] GET /compute/v2.1/os-volumes/7489ff1a-97c7-403d-81cf-f73f3c2317d1 => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:26.435916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a6dcd1d7-cd76-49b5-8c3d-23c619808712 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:26.438296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a6dcd1d7-cd76-49b5-8c3d-23c619808712 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:26.450940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6dcd1d7-cd76-49b5-8c3d-23c619808712 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:26.451807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6dcd1d7-cd76-49b5-8c3d-23c619808712 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:26.453201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6dcd1d7-cd76-49b5-8c3d-23c619808712 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:26.454060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a6dcd1d7-cd76-49b5-8c3d-23c619808712 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:26.877206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a6dcd1d7-cd76-49b5-8c3d-23c619808712 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:26.895386 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a6dcd1d7-cd76-49b5-8c3d-23c619808712 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 200 len: 1314 microversion: 2.1 time: 0.464947 Mar 12 21:05:26.907583 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2963/3731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:26 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:26.913816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2109477959", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "a1df08e9-a7c0-43fc-8fad-e4c91b24f5ac"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:26.975724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] validate_networks() for [('a1df08e9-a7c0-43fc-8fad-e4c91b24f5ac', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:05:28.644143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:05:28.647979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:05:28.648947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:05:28.650415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:05:28.650951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:05:28.674536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:28.676325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:28.677341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:28.679631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:28.711501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:05:28.720424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for user 178b9752b5d44f9abb4df56c54e28c48 and project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:05:28.735227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:05:28.737585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:05:28.794494 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-918e06d9-65f5-4c87-84dd-b50fbb1dc4a3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.883319 Mar 12 21:05:28.803980 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2964/3732] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:05:28.814850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a23a8173-a0a1-41c2-858c-fcc18e25e840 tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] Calling method '.version_select at 0x7f6e355df700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:28.870242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a23a8173-a0a1-41c2-858c-fcc18e25e840 tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] HTTP exception thrown: Volume 7489ff1a-97c7-403d-81cf-f73f3c2317d1 could not be found. Mar 12 21:05:28.871970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a23a8173-a0a1-41c2-858c-fcc18e25e840 tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] Returning 404 to user: Volume 7489ff1a-97c7-403d-81cf-f73f3c2317d1 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:05:28.873679 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a23a8173-a0a1-41c2-858c-fcc18e25e840 tempest-VolumesGetTestJSON-276097430 tempest-VolumesGetTestJSON-276097430-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/7489ff1a-97c7-403d-81cf-f73f3c2317d1" status: 404 len: 109 microversion: 2.1 time: 0.067286 Mar 12 21:05:28.879879 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2965/3733] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 21:05:28 2022] GET /compute/v2.1/os-volumes/7489ff1a-97c7-403d-81cf-f73f3c2317d1 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:05:28.891688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69c3ae28-5129-4c85-accd-bfd682038444 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:28.894096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-69c3ae28-5129-4c85-accd-bfd682038444 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:28.910581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69c3ae28-5129-4c85-accd-bfd682038444 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:28.911496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69c3ae28-5129-4c85-accd-bfd682038444 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:28.914028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69c3ae28-5129-4c85-accd-bfd682038444 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:28.914778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69c3ae28-5129-4c85-accd-bfd682038444 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:29.288420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-69c3ae28-5129-4c85-accd-bfd682038444 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:29.304716 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-69c3ae28-5129-4c85-accd-bfd682038444 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 200 len: 1314 microversion: 2.1 time: 0.423161 Mar 12 21:05:29.316385 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2966/3734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:28 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:29.333906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c901d837-2a42-4d0b-8ad2-ce004421d833 req-5373b4a1-66f4-49d6-b78f-a2c995852d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5283d2-af12-4324-9eae-886a7ba6d2a5", "tag": "f33c4435-a4cc-46b1-8726-3e955a620222"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:29.353587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c901d837-2a42-4d0b-8ad2-ce004421d833 req-5373b4a1-66f4-49d6-b78f-a2c995852d63 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:29.356807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c901d837-2a42-4d0b-8ad2-ce004421d833 req-5373b4a1-66f4-49d6-b78f-a2c995852d63 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:29.373584 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c901d837-2a42-4d0b-8ad2-ce004421d833 req-5373b4a1-66f4-49d6-b78f-a2c995852d63 service nova] Creating event network-changed:f33c4435-a4cc-46b1-8726-3e955a620222 for instance 9f5283d2-af12-4324-9eae-886a7ba6d2a5 on nch2-master-1 Mar 12 21:05:29.380931 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c901d837-2a42-4d0b-8ad2-ce004421d833 req-5373b4a1-66f4-49d6-b78f-a2c995852d63 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062643 Mar 12 21:05:29.381801 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2967/3735] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:29.392223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2dea5e5f-8764-4352-a0f6-3de0f63e2513 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:29.394100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2dea5e5f-8764-4352-a0f6-3de0f63e2513 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:29.517642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2dea5e5f-8764-4352-a0f6-3de0f63e2513 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:29.530468 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2dea5e5f-8764-4352-a0f6-3de0f63e2513 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1215 microversion: 2.1 time: 0.146707 Mar 12 21:05:29.541733 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2968/3736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:29 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:30.331285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc071cde-73ae-4da0-bed0-6eca8462e2e5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:30.332021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc071cde-73ae-4da0-bed0-6eca8462e2e5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:30.344364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc071cde-73ae-4da0-bed0-6eca8462e2e5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:30.351965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc071cde-73ae-4da0-bed0-6eca8462e2e5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:30.353097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc071cde-73ae-4da0-bed0-6eca8462e2e5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:30.355001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc071cde-73ae-4da0-bed0-6eca8462e2e5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:30.942235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc071cde-73ae-4da0-bed0-6eca8462e2e5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:30.954333 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc071cde-73ae-4da0-bed0-6eca8462e2e5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 200 len: 1314 microversion: 2.1 time: 0.626822 Mar 12 21:05:30.956037 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2969/3737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:30 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:30.966474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5000bd72-cda7-41ad-89b0-4798204e5056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:30.969092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5000bd72-cda7-41ad-89b0-4798204e5056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:30.979955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5000bd72-cda7-41ad-89b0-4798204e5056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:30.981685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5000bd72-cda7-41ad-89b0-4798204e5056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:30.983828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5000bd72-cda7-41ad-89b0-4798204e5056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:30.988920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5000bd72-cda7-41ad-89b0-4798204e5056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:31.119331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5000bd72-cda7-41ad-89b0-4798204e5056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:31.131784 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5000bd72-cda7-41ad-89b0-4798204e5056 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1273 microversion: 2.1 time: 0.172715 Mar 12 21:05:31.133858 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2970/3738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:30 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:31.974039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a4374fe1-5fdb-47d4-9a52-444ee2fcbea2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:31.974952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a4374fe1-5fdb-47d4-9a52-444ee2fcbea2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:31.998003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4374fe1-5fdb-47d4-9a52-444ee2fcbea2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:32.000461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4374fe1-5fdb-47d4-9a52-444ee2fcbea2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:32.001460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4374fe1-5fdb-47d4-9a52-444ee2fcbea2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:32.002102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4374fe1-5fdb-47d4-9a52-444ee2fcbea2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:33.271911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a4374fe1-5fdb-47d4-9a52-444ee2fcbea2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:33.289782 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a4374fe1-5fdb-47d4-9a52-444ee2fcbea2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 200 len: 1314 microversion: 2.1 time: 1.320730 Mar 12 21:05:33.294231 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2971/3739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:31 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 1314 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:33.307487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-756da30c-b78c-4fcd-94fc-4ea9b07f8a14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:33.308110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-756da30c-b78c-4fcd-94fc-4ea9b07f8a14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:33.320463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-756da30c-b78c-4fcd-94fc-4ea9b07f8a14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:33.320951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-756da30c-b78c-4fcd-94fc-4ea9b07f8a14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:33.321862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-756da30c-b78c-4fcd-94fc-4ea9b07f8a14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:33.324980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-756da30c-b78c-4fcd-94fc-4ea9b07f8a14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:33.860836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-756da30c-b78c-4fcd-94fc-4ea9b07f8a14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:33.875914 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-756da30c-b78c-4fcd-94fc-4ea9b07f8a14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1315 microversion: 2.1 time: 0.578383 Mar 12 21:05:33.877068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2972/3740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:33 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:33.884464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67dcb302-cc5b-438a-aab7-64b24fa21e5c tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] Calling method '.version_select at 0x7f6e3558f5e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:33.969364 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67dcb302-cc5b-438a-aab7-64b24fa21e5c tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/74d3515f-fbf5-4ec1-a8fc-b152f24929df" status: 200 len: 344 microversion: 2.1 time: 0.090450 Mar 12 21:05:33.970659 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2973/3741] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 21:05:33 2022] GET /compute/v2.1/os-volumes/74d3515f-fbf5-4ec1-a8fc-b152f24929df => generated 344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:33.987411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d8cb95db-1f32-4159-b194-51464aca82bb req-73273a94-0da6-4cd3-a4d1-78c2ff80a8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b2f963-92f2-4be3-ae29-aabc42f1ad7f", "tag": "e0f8a6c5-ee4e-4058-8488-fbe4df28822f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:34.011147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d8cb95db-1f32-4159-b194-51464aca82bb req-73273a94-0da6-4cd3-a4d1-78c2ff80a8e3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:34.012065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d8cb95db-1f32-4159-b194-51464aca82bb req-73273a94-0da6-4cd3-a4d1-78c2ff80a8e3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:34.033467 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d8cb95db-1f32-4159-b194-51464aca82bb req-73273a94-0da6-4cd3-a4d1-78c2ff80a8e3 service nova] Creating event network-changed:e0f8a6c5-ee4e-4058-8488-fbe4df28822f for instance e5b2f963-92f2-4be3-ae29-aabc42f1ad7f on nch2-master-1 Mar 12 21:05:34.050764 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d8cb95db-1f32-4159-b194-51464aca82bb req-73273a94-0da6-4cd3-a4d1-78c2ff80a8e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067940 Mar 12 21:05:34.052014 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2974/3742] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:34.104478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-dc50cc6b-9686-4c70-9a1c-ef55315b8ad9 req-93c4fb6f-2e2d-4143-9cd1-cd454ebf2a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5283d2-af12-4324-9eae-886a7ba6d2a5", "name": "network-vif-plugged", "status": "completed", "tag": "f33c4435-a4cc-46b1-8726-3e955a620222"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:34.121580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-dc50cc6b-9686-4c70-9a1c-ef55315b8ad9 req-93c4fb6f-2e2d-4143-9cd1-cd454ebf2a3c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:34.123878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-dc50cc6b-9686-4c70-9a1c-ef55315b8ad9 req-93c4fb6f-2e2d-4143-9cd1-cd454ebf2a3c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:34.155916 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-dc50cc6b-9686-4c70-9a1c-ef55315b8ad9 req-93c4fb6f-2e2d-4143-9cd1-cd454ebf2a3c service nova] Creating event network-vif-plugged:f33c4435-a4cc-46b1-8726-3e955a620222 for instance 9f5283d2-af12-4324-9eae-886a7ba6d2a5 on nch2-master-1 Mar 12 21:05:34.174024 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-dc50cc6b-9686-4c70-9a1c-ef55315b8ad9 req-93c4fb6f-2e2d-4143-9cd1-cd454ebf2a3c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068008 Mar 12 21:05:34.178481 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2975/3743] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:05:34.308004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16545840-e5ae-4d91-b932-02b79b0293c5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:34.313234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16545840-e5ae-4d91-b932-02b79b0293c5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:34.336913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16545840-e5ae-4d91-b932-02b79b0293c5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:34.356337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16545840-e5ae-4d91-b932-02b79b0293c5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:34.358235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16545840-e5ae-4d91-b932-02b79b0293c5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:34.363227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16545840-e5ae-4d91-b932-02b79b0293c5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:35.079649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16545840-e5ae-4d91-b932-02b79b0293c5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:35.090858 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16545840-e5ae-4d91-b932-02b79b0293c5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 200 len: 1314 microversion: 2.1 time: 0.788022 Mar 12 21:05:35.102647 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2976/3744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:34 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 1314 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:35.110658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a4ccd83-d5be-472e-8836-255d38311828 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:35.111556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0a4ccd83-d5be-472e-8836-255d38311828 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:35.118535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a4ccd83-d5be-472e-8836-255d38311828 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:35.119331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a4ccd83-d5be-472e-8836-255d38311828 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:35.120540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a4ccd83-d5be-472e-8836-255d38311828 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:35.121802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a4ccd83-d5be-472e-8836-255d38311828 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:35.282518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0a4ccd83-d5be-472e-8836-255d38311828 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:35.289890 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0a4ccd83-d5be-472e-8836-255d38311828 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1315 microversion: 2.1 time: 0.184979 Mar 12 21:05:35.290479 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2977/3745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:35 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:35.779767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-91b76512-86ba-44b9-a05d-8e830fc4e35d tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] Calling method '.version_select at 0x7f6e35cef310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:35.881395 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-91b76512-86ba-44b9-a05d-8e830fc4e35d tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6bac85e2-e94b-4965-9dcc-aed7e738c21f" status: 200 len: 343 microversion: 2.1 time: 0.106242 Mar 12 21:05:35.888366 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2978/3746] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 21:05:35 2022] GET /compute/v2.1/os-volumes/6bac85e2-e94b-4965-9dcc-aed7e738c21f => generated 343 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:36.111434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0144bb65-7d5a-4a6f-ad23-2d003ce24960 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:36.113724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0144bb65-7d5a-4a6f-ad23-2d003ce24960 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:36.130546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0144bb65-7d5a-4a6f-ad23-2d003ce24960 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:36.132685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0144bb65-7d5a-4a6f-ad23-2d003ce24960 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:36.135252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0144bb65-7d5a-4a6f-ad23-2d003ce24960 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:36.137499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0144bb65-7d5a-4a6f-ad23-2d003ce24960 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:36.619481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0144bb65-7d5a-4a6f-ad23-2d003ce24960 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:36.631774 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0144bb65-7d5a-4a6f-ad23-2d003ce24960 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 200 len: 1502 microversion: 2.1 time: 0.526046 Mar 12 21:05:36.642808 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2979/3747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:36 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 1502 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:05:36.655127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3d06f83-aa59-432c-9d03-e7f11214e686 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:36.655816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c3d06f83-aa59-432c-9d03-e7f11214e686 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:36.663959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3d06f83-aa59-432c-9d03-e7f11214e686 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:36.664416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3d06f83-aa59-432c-9d03-e7f11214e686 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:36.665712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3d06f83-aa59-432c-9d03-e7f11214e686 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:36.666433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3d06f83-aa59-432c-9d03-e7f11214e686 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:37.095370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c3d06f83-aa59-432c-9d03-e7f11214e686 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:37.119460 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3d06f83-aa59-432c-9d03-e7f11214e686 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1315 microversion: 2.1 time: 0.471282 Mar 12 21:05:37.122115 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2980/3748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:36 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:37.145226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f9e7fd8-b38d-48ef-9e6e-cfe188e498d4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:37.146377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f9e7fd8-b38d-48ef-9e6e-cfe188e498d4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:37.158396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f9e7fd8-b38d-48ef-9e6e-cfe188e498d4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:37.159353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f9e7fd8-b38d-48ef-9e6e-cfe188e498d4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:37.160332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f9e7fd8-b38d-48ef-9e6e-cfe188e498d4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:37.162692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f9e7fd8-b38d-48ef-9e6e-cfe188e498d4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:37.201896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f9e7fd8-b38d-48ef-9e6e-cfe188e498d4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:05:37.344402 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f9e7fd8-b38d-48ef-9e6e-cfe188e498d4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 204 len: 0 microversion: 2.1 time: 0.220013 Mar 12 21:05:37.345515 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2981/3749] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:05:37 2022] DELETE /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:05:37.357399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e14cb9bd-1e1f-4387-856e-3d69a6d1940b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:37.358335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e14cb9bd-1e1f-4387-856e-3d69a6d1940b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:37.366121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e14cb9bd-1e1f-4387-856e-3d69a6d1940b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:37.366762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e14cb9bd-1e1f-4387-856e-3d69a6d1940b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:37.368294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e14cb9bd-1e1f-4387-856e-3d69a6d1940b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:37.368851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e14cb9bd-1e1f-4387-856e-3d69a6d1940b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:37.717660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e14cb9bd-1e1f-4387-856e-3d69a6d1940b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:37.734232 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e14cb9bd-1e1f-4387-856e-3d69a6d1940b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 200 len: 1508 microversion: 2.1 time: 0.384349 Mar 12 21:05:37.734832 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2982/3750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:37 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 1508 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:37.748705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bfcbd92d-70d7-43bb-b6fd-bc72e712ac5d tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] Calling method '.version_select at 0x7f6e355c65e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:37.837700 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bfcbd92d-70d7-43bb-b6fd-bc72e712ac5d tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef" status: 200 len: 344 microversion: 2.1 time: 0.092716 Mar 12 21:05:37.838430 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2983/3751] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Mar 12 21:05:37 2022] GET /compute/v2.1/os-volumes/8a7b36d2-ee2d-4f1b-a526-9c1c7503b4ef => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:37.865734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af20eb4b-6957-4167-b1d2-9d7707ab2d77 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] Calling method '.version_select at 0x7f6e35626b80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:38.028139 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af20eb4b-6957-4167-b1d2-9d7707ab2d77 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.174814 Mar 12 21:05:38.036183 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2984/3752] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Mar 12 21:05:37 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:38.041152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b847796d-2f80-4990-9dcc-22e19e1a6cf8 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] Calling method '.version_select at 0x7f6e355dfee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:38.206055 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b847796d-2f80-4990-9dcc-22e19e1a6cf8 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.168563 Mar 12 21:05:38.207548 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2985/3753] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Mar 12 21:05:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:38.213833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-287fb6db-bb59-49d0-beea-4a494d6a02f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:38.216346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-287fb6db-bb59-49d0-beea-4a494d6a02f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:38.223972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-287fb6db-bb59-49d0-beea-4a494d6a02f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:38.224863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-287fb6db-bb59-49d0-beea-4a494d6a02f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:38.225939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-287fb6db-bb59-49d0-beea-4a494d6a02f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:38.226917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-287fb6db-bb59-49d0-beea-4a494d6a02f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:38.587896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-287fb6db-bb59-49d0-beea-4a494d6a02f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:38.597923 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-287fb6db-bb59-49d0-beea-4a494d6a02f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1315 microversion: 2.1 time: 0.388680 Mar 12 21:05:38.609029 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2986/3754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:38 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:38.617022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be1f32a0-d009-4f1a-a35f-ffe6d5279ed5 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] Calling method '.version_select at 0x7f6e355a1ee0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:38.822083 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be1f32a0-d009-4f1a-a35f-ffe6d5279ed5 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.210051 Mar 12 21:05:38.843117 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2987/3755] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Mar 12 21:05:38 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:38.851799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2428372d-dad8-4778-a699-f168f63515e0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:38.860986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2428372d-dad8-4778-a699-f168f63515e0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:38.874149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2428372d-dad8-4778-a699-f168f63515e0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:38.877039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2428372d-dad8-4778-a699-f168f63515e0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:38.877934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2428372d-dad8-4778-a699-f168f63515e0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:38.886028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2428372d-dad8-4778-a699-f168f63515e0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:39.355092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2428372d-dad8-4778-a699-f168f63515e0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:39.367626 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2428372d-dad8-4778-a699-f168f63515e0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 200 len: 1508 microversion: 2.1 time: 0.519753 Mar 12 21:05:39.369928 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2988/3756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:38 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 1508 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:39.383440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c630194f-745d-449a-8448-11998c531446 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] Calling method '.version_select at 0x7f6e3563d550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:39.650223 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c630194f-745d-449a-8448-11998c531446 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.272874 Mar 12 21:05:39.658009 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2989/3757] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Mar 12 21:05:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:39.663099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ff0a1e7d-ad99-437d-97e4-fb3b40eb564b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:39.663729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ff0a1e7d-ad99-437d-97e4-fb3b40eb564b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:39.680131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff0a1e7d-ad99-437d-97e4-fb3b40eb564b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:39.680598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff0a1e7d-ad99-437d-97e4-fb3b40eb564b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:39.681398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff0a1e7d-ad99-437d-97e4-fb3b40eb564b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:39.681873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff0a1e7d-ad99-437d-97e4-fb3b40eb564b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:40.583197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ff0a1e7d-ad99-437d-97e4-fb3b40eb564b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:40.591649 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ff0a1e7d-ad99-437d-97e4-fb3b40eb564b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1315 microversion: 2.1 time: 0.939600 Mar 12 21:05:40.595068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2990/3758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:39 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:40.606486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-54d75dfc-4037-4e48-b91e-bde72dcccbb5 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] Calling method '.version_select at 0x7f6e356220d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:40.724021 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-54d75dfc-4037-4e48-b91e-bde72dcccbb5 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.127450 Mar 12 21:05:40.732297 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2991/3759] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Mar 12 21:05:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:40.732297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a975e144-1236-4046-973c-01fd651fc2a0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:40.732641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a975e144-1236-4046-973c-01fd651fc2a0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:40.752900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a975e144-1236-4046-973c-01fd651fc2a0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:40.753366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a975e144-1236-4046-973c-01fd651fc2a0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:40.754198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a975e144-1236-4046-973c-01fd651fc2a0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:40.754647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a975e144-1236-4046-973c-01fd651fc2a0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:41.224468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a975e144-1236-4046-973c-01fd651fc2a0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:41.236962 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a975e144-1236-4046-973c-01fd651fc2a0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 200 len: 1508 microversion: 2.1 time: 0.510374 Mar 12 21:05:41.237565 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2992/3760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:40 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 1508 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:41.251148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-df72a3d6-209b-48ce-a12a-3ff982a29220 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] Calling method '.version_select at 0x7f6e355a15e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:41.417239 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-df72a3d6-209b-48ce-a12a-3ff982a29220 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.178390 Mar 12 21:05:41.418171 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2993/3761] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 21:05:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:41.442838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3547f7bf-6410-4dec-9f7e-23fa973049db tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] Calling method '.version_select at 0x7f6e355ad670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:41.618293 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3547f7bf-6410-4dec-9f7e-23fa973049db tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.192597 Mar 12 21:05:41.622425 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2994/3762] 10.222.0.30 () {58 vars in 1187 bytes} [Sat Mar 12 21:05:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:05:41.631042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-47056e07-9167-4ebf-aa3f-a06602035da6 req-db35ccba-3bd7-4403-ad1b-423aeaba7aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5283d2-af12-4324-9eae-886a7ba6d2a5", "name": "network-vif-deleted", "tag": "f33c4435-a4cc-46b1-8726-3e955a620222"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:41.659105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-47056e07-9167-4ebf-aa3f-a06602035da6 req-db35ccba-3bd7-4403-ad1b-423aeaba7aa9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:41.660457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-47056e07-9167-4ebf-aa3f-a06602035da6 req-db35ccba-3bd7-4403-ad1b-423aeaba7aa9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:41.677552 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-47056e07-9167-4ebf-aa3f-a06602035da6 req-db35ccba-3bd7-4403-ad1b-423aeaba7aa9 service nova] Creating event network-vif-deleted:f33c4435-a4cc-46b1-8726-3e955a620222 for instance 9f5283d2-af12-4324-9eae-886a7ba6d2a5 on nch2-master-1 Mar 12 21:05:41.684140 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-47056e07-9167-4ebf-aa3f-a06602035da6 req-db35ccba-3bd7-4403-ad1b-423aeaba7aa9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058162 Mar 12 21:05:41.685642 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2995/3763] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:41.692349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3abbe236-1d8f-44fd-a3c5-6b90be92dbab tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:41.693863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3abbe236-1d8f-44fd-a3c5-6b90be92dbab tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:41.704330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3abbe236-1d8f-44fd-a3c5-6b90be92dbab tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:41.706060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3abbe236-1d8f-44fd-a3c5-6b90be92dbab tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:41.707415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3abbe236-1d8f-44fd-a3c5-6b90be92dbab tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:41.708190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3abbe236-1d8f-44fd-a3c5-6b90be92dbab tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:42.399027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3abbe236-1d8f-44fd-a3c5-6b90be92dbab tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:42.408535 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3abbe236-1d8f-44fd-a3c5-6b90be92dbab tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1315 microversion: 2.1 time: 0.720978 Mar 12 21:05:42.412803 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2996/3764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:41 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:42.418776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b7a98cf5-2a1d-49d7-a47a-a44e2b233913 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] Calling method '.version_select at 0x7f6e35549160>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:42.533362 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b7a98cf5-2a1d-49d7-a47a-a44e2b233913 tempest-VolumesTestJSON-1218278566 tempest-VolumesTestJSON-1218278566-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.119025 Mar 12 21:05:42.533978 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2997/3765] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 21:05:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:42.539459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-324fdf67-1e0f-4f9f-b071-088e43689da7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:42.540354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-324fdf67-1e0f-4f9f-b071-088e43689da7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:42.557350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-324fdf67-1e0f-4f9f-b071-088e43689da7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:42.557708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-324fdf67-1e0f-4f9f-b071-088e43689da7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:42.558551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-324fdf67-1e0f-4f9f-b071-088e43689da7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:42.558998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-324fdf67-1e0f-4f9f-b071-088e43689da7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:42.587619 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-324fdf67-1e0f-4f9f-b071-088e43689da7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance 9f5283d2-af12-4324-9eae-886a7ba6d2a5 could not be found. Mar 12 21:05:42.588538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-324fdf67-1e0f-4f9f-b071-088e43689da7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance 9f5283d2-af12-4324-9eae-886a7ba6d2a5 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:05:42.590416 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-324fdf67-1e0f-4f9f-b071-088e43689da7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 404 len: 111 microversion: 2.1 time: 0.054402 Mar 12 21:05:42.591183 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2998/3766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:42 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:05:42.596220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5abd8e71-bf0f-4513-b32b-89aa52c62eac req-374d63a4-48b4-48dd-9605-ab888d9a2bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b2f963-92f2-4be3-ae29-aabc42f1ad7f", "name": "network-vif-plugged", "status": "completed", "tag": "e0f8a6c5-ee4e-4058-8488-fbe4df28822f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:42.605083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5abd8e71-bf0f-4513-b32b-89aa52c62eac req-374d63a4-48b4-48dd-9605-ab888d9a2bfd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:42.605756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5abd8e71-bf0f-4513-b32b-89aa52c62eac req-374d63a4-48b4-48dd-9605-ab888d9a2bfd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:42.618694 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5abd8e71-bf0f-4513-b32b-89aa52c62eac req-374d63a4-48b4-48dd-9605-ab888d9a2bfd service nova] Creating event network-vif-plugged:e0f8a6c5-ee4e-4058-8488-fbe4df28822f for instance e5b2f963-92f2-4be3-ae29-aabc42f1ad7f on nch2-master-1 Mar 12 21:05:42.624829 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5abd8e71-bf0f-4513-b32b-89aa52c62eac req-374d63a4-48b4-48dd-9605-ab888d9a2bfd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032312 Mar 12 21:05:42.625675 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 2999/3767] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:42.771534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1937998842", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "3bc356e1-2fe7-4340-aecb-f85636b06883"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:42.847970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] validate_networks() for [('3bc356e1-2fe7-4340-aecb-f85636b06883', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:05:44.244992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:05:44.247286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:05:44.248135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:05:44.248870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:05:44.249799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:05:44.270929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:44.271398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:44.274856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:44.275717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:44.309125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:05:44.315732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for user 10e1e3bae5b94b5589b47488329ad756 and project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:05:44.332086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:05:44.348778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:05:44.436444 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-29ae8478-45a0-418a-80ba-d76cbb1ae92f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.669187 Mar 12 21:05:44.437916 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3000/3768] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:05:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:05:44.443291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cc4f818a-da20-4a3e-bde1-2261b1097d7a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:44.444804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc4f818a-da20-4a3e-bde1-2261b1097d7a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:44.454032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc4f818a-da20-4a3e-bde1-2261b1097d7a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:44.454666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc4f818a-da20-4a3e-bde1-2261b1097d7a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:44.455665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc4f818a-da20-4a3e-bde1-2261b1097d7a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:44.456824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc4f818a-da20-4a3e-bde1-2261b1097d7a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:45.185294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cc4f818a-da20-4a3e-bde1-2261b1097d7a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:45.198286 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cc4f818a-da20-4a3e-bde1-2261b1097d7a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1315 microversion: 2.1 time: 0.758978 Mar 12 21:05:45.199477 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3001/3769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:44 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1315 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:45.204056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-823a3c99-056a-43e2-ba12-18e8fbbe445a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:45.204683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-823a3c99-056a-43e2-ba12-18e8fbbe445a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:45.220831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-823a3c99-056a-43e2-ba12-18e8fbbe445a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:45.221410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-823a3c99-056a-43e2-ba12-18e8fbbe445a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:45.222147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-823a3c99-056a-43e2-ba12-18e8fbbe445a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:45.222604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-823a3c99-056a-43e2-ba12-18e8fbbe445a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:45.341040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-823a3c99-056a-43e2-ba12-18e8fbbe445a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:45.350482 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-823a3c99-056a-43e2-ba12-18e8fbbe445a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 200 len: 1219 microversion: 2.1 time: 0.149946 Mar 12 21:05:45.355776 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3002/3770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:45 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:46.218821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ba92926-edd7-4256-987a-9668b628944f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:46.219843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ba92926-edd7-4256-987a-9668b628944f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:46.227630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ba92926-edd7-4256-987a-9668b628944f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:46.229262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ba92926-edd7-4256-987a-9668b628944f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:46.231230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ba92926-edd7-4256-987a-9668b628944f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:46.232388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ba92926-edd7-4256-987a-9668b628944f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:46.716992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9ba92926-edd7-4256-987a-9668b628944f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:46.753339 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ba92926-edd7-4256-987a-9668b628944f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1502 microversion: 2.1 time: 0.539805 Mar 12 21:05:46.767728 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3003/3771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:46 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1502 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:05:46.770404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0928e7cd-3c70-4365-980c-24fc1e78e873 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:46.771007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0928e7cd-3c70-4365-980c-24fc1e78e873 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:46.779326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0928e7cd-3c70-4365-980c-24fc1e78e873 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:46.780937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0928e7cd-3c70-4365-980c-24fc1e78e873 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:46.781949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0928e7cd-3c70-4365-980c-24fc1e78e873 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:46.782586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0928e7cd-3c70-4365-980c-24fc1e78e873 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:46.900023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0928e7cd-3c70-4365-980c-24fc1e78e873 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:46.915158 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0928e7cd-3c70-4365-980c-24fc1e78e873 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 200 len: 1273 microversion: 2.1 time: 0.149775 Mar 12 21:05:46.916395 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3004/3772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:46 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:46.925579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99d76b91-12ae-475d-ab92-bcd0a9e8ef67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:46.926527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-99d76b91-12ae-475d-ab92-bcd0a9e8ef67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:46.935468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99d76b91-12ae-475d-ab92-bcd0a9e8ef67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:46.935992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99d76b91-12ae-475d-ab92-bcd0a9e8ef67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:46.937049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99d76b91-12ae-475d-ab92-bcd0a9e8ef67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:46.937503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99d76b91-12ae-475d-ab92-bcd0a9e8ef67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:47.277278 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.network.security_group_api [None req-99d76b91-12ae-475d-ab92-bcd0a9e8ef67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Removing security group f2acf419-09ef-4f0e-9f05-7267ebe26fb7 from port e0f8a6c5-ee4e-4058-8488-fbe4df28822f Mar 12 21:05:48.110365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99d76b91-12ae-475d-ab92-bcd0a9e8ef67 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f/action" status: 202 len: 0 microversion: 2.1 time: 1.190480 Mar 12 21:05:48.111036 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3005/3773] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:05:46 2022] POST /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f/action => generated 0 bytes in 1194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:05:48.121082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9e712a8-c329-4199-ac75-24073c9213c3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:48.121719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9e712a8-c329-4199-ac75-24073c9213c3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:48.132278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e712a8-c329-4199-ac75-24073c9213c3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:48.133287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e712a8-c329-4199-ac75-24073c9213c3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:48.134592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e712a8-c329-4199-ac75-24073c9213c3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:48.140424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e712a8-c329-4199-ac75-24073c9213c3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:49.023378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f9e712a8-c329-4199-ac75-24073c9213c3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:49.045683 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9e712a8-c329-4199-ac75-24073c9213c3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 200 len: 1315 microversion: 2.1 time: 0.929919 Mar 12 21:05:49.048976 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3006/3774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:48 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:49.066712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39ec88d4-1104-4967-ab00-530c7af78498 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:49.067900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39ec88d4-1104-4967-ab00-530c7af78498 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:49.075144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39ec88d4-1104-4967-ab00-530c7af78498 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:49.075869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39ec88d4-1104-4967-ab00-530c7af78498 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:49.076932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39ec88d4-1104-4967-ab00-530c7af78498 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:49.077647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39ec88d4-1104-4967-ab00-530c7af78498 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:49.514953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39ec88d4-1104-4967-ab00-530c7af78498 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:49.522986 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39ec88d4-1104-4967-ab00-530c7af78498 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1460 microversion: 2.1 time: 0.471942 Mar 12 21:05:49.532375 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3007/3775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:49 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1460 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:49.536244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7f368a55-a7a5-46fa-aa90-781466846234 req-ee0c3066-1799-4cda-85ac-5730164cd9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b2f963-92f2-4be3-ae29-aabc42f1ad7f", "tag": "e0f8a6c5-ee4e-4058-8488-fbe4df28822f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:49.548649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7f368a55-a7a5-46fa-aa90-781466846234 req-ee0c3066-1799-4cda-85ac-5730164cd9d4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:49.549482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7f368a55-a7a5-46fa-aa90-781466846234 req-ee0c3066-1799-4cda-85ac-5730164cd9d4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:49.562276 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7f368a55-a7a5-46fa-aa90-781466846234 req-ee0c3066-1799-4cda-85ac-5730164cd9d4 service nova] Creating event network-changed:e0f8a6c5-ee4e-4058-8488-fbe4df28822f for instance e5b2f963-92f2-4be3-ae29-aabc42f1ad7f on nch2-master-1 Mar 12 21:05:49.569311 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7f368a55-a7a5-46fa-aa90-781466846234 req-ee0c3066-1799-4cda-85ac-5730164cd9d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036652 Mar 12 21:05:49.570618 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3008/3776] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:49.577683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-008cb1df-a114-4eeb-99ec-13f95054f648 req-23c51e37-9c02-44f7-8b02-d87eb8564f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed1f8df3-57c9-4312-93f5-ab79e215eae7", "tag": "fb8aa364-7adc-4bdc-89e5-c5f79ac0d9fe"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:49.590952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-008cb1df-a114-4eeb-99ec-13f95054f648 req-23c51e37-9c02-44f7-8b02-d87eb8564f57 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:49.591776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-008cb1df-a114-4eeb-99ec-13f95054f648 req-23c51e37-9c02-44f7-8b02-d87eb8564f57 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:49.605763 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-008cb1df-a114-4eeb-99ec-13f95054f648 req-23c51e37-9c02-44f7-8b02-d87eb8564f57 service nova] Creating event network-changed:fb8aa364-7adc-4bdc-89e5-c5f79ac0d9fe for instance ed1f8df3-57c9-4312-93f5-ab79e215eae7 on nch2-master-1 Mar 12 21:05:49.611278 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-008cb1df-a114-4eeb-99ec-13f95054f648 req-23c51e37-9c02-44f7-8b02-d87eb8564f57 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038325 Mar 12 21:05:49.612452 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3009/3777] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:05:49.620798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be79cf97-c1db-44c4-a98a-b4d8933aa87a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:49.624586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-be79cf97-c1db-44c4-a98a-b4d8933aa87a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:49.631362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be79cf97-c1db-44c4-a98a-b4d8933aa87a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:49.632182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be79cf97-c1db-44c4-a98a-b4d8933aa87a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:49.633239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be79cf97-c1db-44c4-a98a-b4d8933aa87a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:49.634439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be79cf97-c1db-44c4-a98a-b4d8933aa87a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:50.211727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be79cf97-c1db-44c4-a98a-b4d8933aa87a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:50.220643 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be79cf97-c1db-44c4-a98a-b4d8933aa87a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.606646 Mar 12 21:05:50.225891 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3010/3778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:49 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:50.231668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e55bd066-deef-4b0f-bdeb-7284970f803d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:50.232720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e55bd066-deef-4b0f-bdeb-7284970f803d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:50.240199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e55bd066-deef-4b0f-bdeb-7284970f803d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:50.241001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e55bd066-deef-4b0f-bdeb-7284970f803d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:50.242091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e55bd066-deef-4b0f-bdeb-7284970f803d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:50.242911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e55bd066-deef-4b0f-bdeb-7284970f803d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:50.673335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e55bd066-deef-4b0f-bdeb-7284970f803d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:50.681702 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e55bd066-deef-4b0f-bdeb-7284970f803d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 200 len: 1315 microversion: 2.1 time: 0.454444 Mar 12 21:05:50.685423 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3011/3779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:50 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:50.690641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e177325-53f4-4d34-bcc4-35975a6c358d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:50.702726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5e177325-53f4-4d34-bcc4-35975a6c358d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:50.711987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e177325-53f4-4d34-bcc4-35975a6c358d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:50.713054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e177325-53f4-4d34-bcc4-35975a6c358d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:50.717193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e177325-53f4-4d34-bcc4-35975a6c358d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:50.719428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e177325-53f4-4d34-bcc4-35975a6c358d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:51.768645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5e177325-53f4-4d34-bcc4-35975a6c358d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:51.782251 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e177325-53f4-4d34-bcc4-35975a6c358d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 1.094747 Mar 12 21:05:51.782869 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3012/3780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:50 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:51.800935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0497492b-aed4-4ef5-a4f7-bfda1f564c52 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:51.801553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0497492b-aed4-4ef5-a4f7-bfda1f564c52 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:51.812459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0497492b-aed4-4ef5-a4f7-bfda1f564c52 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:51.812911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0497492b-aed4-4ef5-a4f7-bfda1f564c52 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:51.818401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0497492b-aed4-4ef5-a4f7-bfda1f564c52 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:51.818863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0497492b-aed4-4ef5-a4f7-bfda1f564c52 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:52.261256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0497492b-aed4-4ef5-a4f7-bfda1f564c52 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:52.269097 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0497492b-aed4-4ef5-a4f7-bfda1f564c52 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 200 len: 1315 microversion: 2.1 time: 0.471965 Mar 12 21:05:52.269700 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3013/3781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:51 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:52.286303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e3e4406-ec49-4002-93ab-420f5d82de21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:52.291581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5e3e4406-ec49-4002-93ab-420f5d82de21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:52.301356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e3e4406-ec49-4002-93ab-420f5d82de21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:52.302152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e3e4406-ec49-4002-93ab-420f5d82de21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:52.303194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e3e4406-ec49-4002-93ab-420f5d82de21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:52.303862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e3e4406-ec49-4002-93ab-420f5d82de21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:52.567076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5e3e4406-ec49-4002-93ab-420f5d82de21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:52.580013 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e3e4406-ec49-4002-93ab-420f5d82de21 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.302342 Mar 12 21:05:52.581236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3014/3782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:52 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:52.609139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3366312a-a033-40cb-8ece-8e43bd343494 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:52.610152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3366312a-a033-40cb-8ece-8e43bd343494 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:52.620447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3366312a-a033-40cb-8ece-8e43bd343494 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:52.622521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3366312a-a033-40cb-8ece-8e43bd343494 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:52.624951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3366312a-a033-40cb-8ece-8e43bd343494 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:52.625581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3366312a-a033-40cb-8ece-8e43bd343494 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:52.936715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3366312a-a033-40cb-8ece-8e43bd343494 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:52.948389 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3366312a-a033-40cb-8ece-8e43bd343494 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.344272 Mar 12 21:05:52.951203 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3015/3783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:52 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:53.106847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1382855290", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "a1df08e9-a7c0-43fc-8fad-e4c91b24f5ac"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:53.198018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] validate_networks() for [('a1df08e9-a7c0-43fc-8fad-e4c91b24f5ac', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:05:54.147569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:05:54.148258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:05:54.148627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:05:54.149098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:05:54.149576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:05:54.166912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:54.168642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:54.169549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:54.170064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:54.197488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:05:54.206403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Getting quotas for user 178b9752b5d44f9abb4df56c54e28c48 and project ab15c0a14a5b4eed97c40c0bf64150ec. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:05:54.224326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:05:54.226929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:05:54.331472 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b1b2b092-d171-4a7a-a86f-62a13e9f9c36 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226763 Mar 12 21:05:54.337277 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3016/3784] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:05:54.344306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de27b370-4e01-4850-a96a-88965104304e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:54.354327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-de27b370-4e01-4850-a96a-88965104304e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:54.374704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de27b370-4e01-4850-a96a-88965104304e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:54.375555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de27b370-4e01-4850-a96a-88965104304e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:54.376658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de27b370-4e01-4850-a96a-88965104304e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:54.377257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de27b370-4e01-4850-a96a-88965104304e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:54.676707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-de27b370-4e01-4850-a96a-88965104304e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:54.689628 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de27b370-4e01-4850-a96a-88965104304e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 200 len: 1315 microversion: 2.1 time: 0.352295 Mar 12 21:05:54.693409 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3017/3785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:54 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:54.703143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-98045843-aaae-4a6f-ac22-6c1f128585b7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:54.704891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-98045843-aaae-4a6f-ac22-6c1f128585b7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:54.801288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-98045843-aaae-4a6f-ac22-6c1f128585b7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:54.808851 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-98045843-aaae-4a6f-ac22-6c1f128585b7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1215 microversion: 2.1 time: 0.115182 Mar 12 21:05:54.818505 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3018/3786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:54 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:55.712800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4eb387f3-f3a4-4d2a-97d4-491d1e7905e3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:55.713550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4eb387f3-f3a4-4d2a-97d4-491d1e7905e3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:55.726039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eb387f3-f3a4-4d2a-97d4-491d1e7905e3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:55.726510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eb387f3-f3a4-4d2a-97d4-491d1e7905e3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:55.730877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eb387f3-f3a4-4d2a-97d4-491d1e7905e3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:55.731346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4eb387f3-f3a4-4d2a-97d4-491d1e7905e3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:56.158782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4eb387f3-f3a4-4d2a-97d4-491d1e7905e3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:56.171177 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4eb387f3-f3a4-4d2a-97d4-491d1e7905e3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 200 len: 1315 microversion: 2.1 time: 0.460733 Mar 12 21:05:56.173172 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3019/3787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:55 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:05:56.189393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-03784dda-ed47-4d6d-9e17-3f0043a73ef7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:56.191062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-03784dda-ed47-4d6d-9e17-3f0043a73ef7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:56.206067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03784dda-ed47-4d6d-9e17-3f0043a73ef7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:56.208640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03784dda-ed47-4d6d-9e17-3f0043a73ef7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:56.209691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03784dda-ed47-4d6d-9e17-3f0043a73ef7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:56.211292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03784dda-ed47-4d6d-9e17-3f0043a73ef7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:56.350522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-03784dda-ed47-4d6d-9e17-3f0043a73ef7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:56.360964 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-03784dda-ed47-4d6d-9e17-3f0043a73ef7 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1273 microversion: 2.1 time: 0.184722 Mar 12 21:05:56.364155 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3020/3788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:56 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1273 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:57.198235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f331dc4c-ac83-4e87-912c-c9cbd25e9947 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:57.200372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f331dc4c-ac83-4e87-912c-c9cbd25e9947 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:57.215854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f331dc4c-ac83-4e87-912c-c9cbd25e9947 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:57.216662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f331dc4c-ac83-4e87-912c-c9cbd25e9947 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:57.217695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f331dc4c-ac83-4e87-912c-c9cbd25e9947 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:57.218695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f331dc4c-ac83-4e87-912c-c9cbd25e9947 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:57.757190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f331dc4c-ac83-4e87-912c-c9cbd25e9947 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:57.779125 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f331dc4c-ac83-4e87-912c-c9cbd25e9947 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 200 len: 1315 microversion: 2.1 time: 0.586457 Mar 12 21:05:57.783024 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3021/3789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:57 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:57.803359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c2fac14-0f17-4bd0-80de-3435d1ec1256 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:57.804604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2c2fac14-0f17-4bd0-80de-3435d1ec1256 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:57.811491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c2fac14-0f17-4bd0-80de-3435d1ec1256 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:57.812193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c2fac14-0f17-4bd0-80de-3435d1ec1256 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:57.813169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c2fac14-0f17-4bd0-80de-3435d1ec1256 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:57.813787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c2fac14-0f17-4bd0-80de-3435d1ec1256 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:57.922887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c2fac14-0f17-4bd0-80de-3435d1ec1256 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:57.949474 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c2fac14-0f17-4bd0-80de-3435d1ec1256 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1273 microversion: 2.1 time: 0.164605 Mar 12 21:05:57.950291 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3022/3790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:57 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:58.753575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-099c9c64-0ae9-4da6-9be9-1f68ba47e62d req-8089263e-cabc-4e12-9b3f-4afc2731a5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1f8df3-57c9-4312-93f5-ab79e215eae7", "name": "network-vif-plugged", "status": "completed", "tag": "fb8aa364-7adc-4bdc-89e5-c5f79ac0d9fe"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:05:58.772365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-099c9c64-0ae9-4da6-9be9-1f68ba47e62d req-8089263e-cabc-4e12-9b3f-4afc2731a5b4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:58.773950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-099c9c64-0ae9-4da6-9be9-1f68ba47e62d req-8089263e-cabc-4e12-9b3f-4afc2731a5b4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:58.805242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-099c9c64-0ae9-4da6-9be9-1f68ba47e62d req-8089263e-cabc-4e12-9b3f-4afc2731a5b4 service nova] Creating event network-vif-plugged:fb8aa364-7adc-4bdc-89e5-c5f79ac0d9fe for instance ed1f8df3-57c9-4312-93f5-ab79e215eae7 on nch2-master-1 Mar 12 21:05:58.819721 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-099c9c64-0ae9-4da6-9be9-1f68ba47e62d req-8089263e-cabc-4e12-9b3f-4afc2731a5b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069419 Mar 12 21:05:58.822416 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3023/3791] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:05:58.834299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc629dae-8c66-4ffd-88b6-5d50af99cb59 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:58.835619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc629dae-8c66-4ffd-88b6-5d50af99cb59 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:58.858695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc629dae-8c66-4ffd-88b6-5d50af99cb59 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:58.860608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc629dae-8c66-4ffd-88b6-5d50af99cb59 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:58.862381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc629dae-8c66-4ffd-88b6-5d50af99cb59 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:58.863257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc629dae-8c66-4ffd-88b6-5d50af99cb59 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:59.799337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dc629dae-8c66-4ffd-88b6-5d50af99cb59 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:05:59.812240 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc629dae-8c66-4ffd-88b6-5d50af99cb59 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 200 len: 1315 microversion: 2.1 time: 0.985683 Mar 12 21:05:59.816048 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3024/3792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:58 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 1315 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:05:59.830608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-83609dd7-c611-47e7-a319-ff1e98f7e034 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:05:59.831909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-83609dd7-c611-47e7-a319-ff1e98f7e034 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:05:59.844290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83609dd7-c611-47e7-a319-ff1e98f7e034 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:59.847053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83609dd7-c611-47e7-a319-ff1e98f7e034 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:05:59.848642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83609dd7-c611-47e7-a319-ff1e98f7e034 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:05:59.850153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-83609dd7-c611-47e7-a319-ff1e98f7e034 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:00.460372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-83609dd7-c611-47e7-a319-ff1e98f7e034 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:00.473044 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-83609dd7-c611-47e7-a319-ff1e98f7e034 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1315 microversion: 2.1 time: 0.653456 Mar 12 21:06:00.474734 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3025/3793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:05:59 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:00.507395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2394e805-dda2-4cf7-927f-1a3a7d0282f9 req-36e1e355-8164-423f-8408-319ddd2bc1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f52f6788-3a66-4ba4-a31a-9aaab1d05ba1", "tag": "7295f7e8-0ece-4f4a-bd06-2446d6571980"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:00.522617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2394e805-dda2-4cf7-927f-1a3a7d0282f9 req-36e1e355-8164-423f-8408-319ddd2bc1b8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:00.524270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2394e805-dda2-4cf7-927f-1a3a7d0282f9 req-36e1e355-8164-423f-8408-319ddd2bc1b8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:00.556256 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2394e805-dda2-4cf7-927f-1a3a7d0282f9 req-36e1e355-8164-423f-8408-319ddd2bc1b8 service nova] Creating event network-changed:7295f7e8-0ece-4f4a-bd06-2446d6571980 for instance f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 on nch1-master-1 Mar 12 21:06:00.562870 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2394e805-dda2-4cf7-927f-1a3a7d0282f9 req-36e1e355-8164-423f-8408-319ddd2bc1b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085535 Mar 12 21:06:00.563960 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3026/3794] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:00.843828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34ac7814-d369-4760-aa30-cc74e6e524fc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:00.844742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34ac7814-d369-4760-aa30-cc74e6e524fc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:00.864303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34ac7814-d369-4760-aa30-cc74e6e524fc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:00.864770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34ac7814-d369-4760-aa30-cc74e6e524fc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:00.869763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34ac7814-d369-4760-aa30-cc74e6e524fc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:00.875810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34ac7814-d369-4760-aa30-cc74e6e524fc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:01.374943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34ac7814-d369-4760-aa30-cc74e6e524fc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:01.382695 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34ac7814-d369-4760-aa30-cc74e6e524fc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 200 len: 1502 microversion: 2.1 time: 0.547918 Mar 12 21:06:01.387721 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3027/3795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:00 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 1502 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:01.493835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4a4430ab-463b-4140-a24f-08f8c6e8f90f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:01.494461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4a4430ab-463b-4140-a24f-08f8c6e8f90f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:01.528276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a4430ab-463b-4140-a24f-08f8c6e8f90f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:01.530076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a4430ab-463b-4140-a24f-08f8c6e8f90f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:01.532865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a4430ab-463b-4140-a24f-08f8c6e8f90f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:01.534782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a4430ab-463b-4140-a24f-08f8c6e8f90f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:02.277892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4a4430ab-463b-4140-a24f-08f8c6e8f90f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:02.288824 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4a4430ab-463b-4140-a24f-08f8c6e8f90f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1315 microversion: 2.1 time: 0.800685 Mar 12 21:06:02.300826 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3028/3796] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:01 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:03.022831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce5c6fec-6561-42c1-885e-91d6c23baf67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99013433-1e4a-4016-bd5e-c6bb6e234b6e"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:03.023930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce5c6fec-6561-42c1-885e-91d6c23baf67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:03.030983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce5c6fec-6561-42c1-885e-91d6c23baf67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:03.031450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce5c6fec-6561-42c1-885e-91d6c23baf67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:03.032247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce5c6fec-6561-42c1-885e-91d6c23baf67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:03.032697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce5c6fec-6561-42c1-885e-91d6c23baf67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:03.386906 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce5c6fec-6561-42c1-885e-91d6c23baf67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "POST /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367996 Mar 12 21:06:03.390638 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3029/3797] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:06:03 2022] POST /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:06:03.415232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce442906-0480-4f81-867e-4f40e58a7105 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:03.418249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce442906-0480-4f81-867e-4f40e58a7105 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:03.443956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce442906-0480-4f81-867e-4f40e58a7105 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:03.445160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce442906-0480-4f81-867e-4f40e58a7105 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:03.446402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce442906-0480-4f81-867e-4f40e58a7105 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:03.448194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce442906-0480-4f81-867e-4f40e58a7105 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:03.848668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce442906-0480-4f81-867e-4f40e58a7105 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:03.865664 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce442906-0480-4f81-867e-4f40e58a7105 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1315 microversion: 2.1 time: 0.476570 Mar 12 21:06:03.866323 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3030/3798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:03 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:04.886899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d002af1d-0e12-4338-9bfd-2bb1777cd589 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:04.887594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d002af1d-0e12-4338-9bfd-2bb1777cd589 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:04.906545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d002af1d-0e12-4338-9bfd-2bb1777cd589 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:04.908190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d002af1d-0e12-4338-9bfd-2bb1777cd589 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:04.909065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d002af1d-0e12-4338-9bfd-2bb1777cd589 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:04.909510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d002af1d-0e12-4338-9bfd-2bb1777cd589 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:05.550834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d002af1d-0e12-4338-9bfd-2bb1777cd589 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:05.567749 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d002af1d-0e12-4338-9bfd-2bb1777cd589 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1315 microversion: 2.1 time: 0.688618 Mar 12 21:06:05.580601 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3031/3799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:04 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:06:06.586220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca55e488-73f8-48d6-a526-128d74cc7cda tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:06.588170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ca55e488-73f8-48d6-a526-128d74cc7cda tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:06.601910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca55e488-73f8-48d6-a526-128d74cc7cda tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:06.607870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca55e488-73f8-48d6-a526-128d74cc7cda tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:06.608948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca55e488-73f8-48d6-a526-128d74cc7cda tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:06.610443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca55e488-73f8-48d6-a526-128d74cc7cda tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:07.318080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca55e488-73f8-48d6-a526-128d74cc7cda tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:07.329080 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca55e488-73f8-48d6-a526-128d74cc7cda tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1315 microversion: 2.1 time: 0.747024 Mar 12 21:06:07.341928 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3032/3800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:06 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:07.349429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4638f00d-d3b9-4546-900a-d8794088f1c4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:07.352602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4638f00d-d3b9-4546-900a-d8794088f1c4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:07.367433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4638f00d-d3b9-4546-900a-d8794088f1c4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:07.370364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4638f00d-d3b9-4546-900a-d8794088f1c4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:07.371380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4638f00d-d3b9-4546-900a-d8794088f1c4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:07.374589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4638f00d-d3b9-4546-900a-d8794088f1c4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:07.496406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4638f00d-d3b9-4546-900a-d8794088f1c4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:06:07.650176 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4638f00d-d3b9-4546-900a-d8794088f1c4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 204 len: 0 microversion: 2.1 time: 0.304651 Mar 12 21:06:07.650901 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3033/3801] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:06:07 2022] DELETE /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:06:07.675023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b2314909-84c9-4e7d-99be-d04c12396e17 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:07.675741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b2314909-84c9-4e7d-99be-d04c12396e17 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:07.694637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2314909-84c9-4e7d-99be-d04c12396e17 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:07.695104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2314909-84c9-4e7d-99be-d04c12396e17 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:07.695907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2314909-84c9-4e7d-99be-d04c12396e17 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:07.696350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2314909-84c9-4e7d-99be-d04c12396e17 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:08.830855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b2314909-84c9-4e7d-99be-d04c12396e17 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:08.844132 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b2314909-84c9-4e7d-99be-d04c12396e17 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 200 len: 1554 microversion: 2.1 time: 1.180802 Mar 12 21:06:08.844715 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3034/3802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:07 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 1554 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:08.861725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2b98f4ce-4f69-45e9-a2a5-50ab4c669500 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:08.862512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2b98f4ce-4f69-45e9-a2a5-50ab4c669500 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:08.872176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b98f4ce-4f69-45e9-a2a5-50ab4c669500 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:08.872832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b98f4ce-4f69-45e9-a2a5-50ab4c669500 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:08.876154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b98f4ce-4f69-45e9-a2a5-50ab4c669500 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:08.876632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b98f4ce-4f69-45e9-a2a5-50ab4c669500 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:09.564020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2b98f4ce-4f69-45e9-a2a5-50ab4c669500 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:09.592374 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2b98f4ce-4f69-45e9-a2a5-50ab4c669500 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1315 microversion: 2.1 time: 0.741195 Mar 12 21:06:09.607353 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3035/3803] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:08 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:09.618101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-88e930a5-3858-4dba-98b8-582a679c6dd8 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:09.618750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-88e930a5-3858-4dba-98b8-582a679c6dd8 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:09.634284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88e930a5-3858-4dba-98b8-582a679c6dd8 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:09.634747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88e930a5-3858-4dba-98b8-582a679c6dd8 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:09.635725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88e930a5-3858-4dba-98b8-582a679c6dd8 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:09.640232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88e930a5-3858-4dba-98b8-582a679c6dd8 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:09.672107 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-88e930a5-3858-4dba-98b8-582a679c6dd8 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2/ips" status: 200 len: 150 microversion: 2.1 time: 0.062186 Mar 12 21:06:09.673448 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3036/3804] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 21:06:09 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2/ips => generated 150 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:09.872050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de0ead09-2662-4cae-9141-f8d9e3769dca tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:09.873402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-de0ead09-2662-4cae-9141-f8d9e3769dca tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:09.881608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de0ead09-2662-4cae-9141-f8d9e3769dca tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:09.882734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de0ead09-2662-4cae-9141-f8d9e3769dca tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:09.884184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de0ead09-2662-4cae-9141-f8d9e3769dca tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:09.884968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de0ead09-2662-4cae-9141-f8d9e3769dca tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:10.600568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-de0ead09-2662-4cae-9141-f8d9e3769dca tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:10.611774 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de0ead09-2662-4cae-9141-f8d9e3769dca tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 200 len: 1554 microversion: 2.1 time: 0.748819 Mar 12 21:06:10.621928 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3037/3805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:09 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 1554 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:10.628319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5d0af065-c0f0-4ee5-aa4f-2579accd86fb req-254b77b9-4cf5-4a5d-8700-8220638d87bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52f6788-3a66-4ba4-a31a-9aaab1d05ba1", "name": "network-vif-plugged", "status": "completed", "tag": "7295f7e8-0ece-4f4a-bd06-2446d6571980"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:10.639775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5d0af065-c0f0-4ee5-aa4f-2579accd86fb req-254b77b9-4cf5-4a5d-8700-8220638d87bb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:10.640629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5d0af065-c0f0-4ee5-aa4f-2579accd86fb req-254b77b9-4cf5-4a5d-8700-8220638d87bb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:10.654266 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5d0af065-c0f0-4ee5-aa4f-2579accd86fb req-254b77b9-4cf5-4a5d-8700-8220638d87bb service nova] Creating event network-vif-plugged:7295f7e8-0ece-4f4a-bd06-2446d6571980 for instance f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 on nch1-master-1 Mar 12 21:06:10.660053 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5d0af065-c0f0-4ee5-aa4f-2579accd86fb req-254b77b9-4cf5-4a5d-8700-8220638d87bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035948 Mar 12 21:06:10.660993 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3038/3806] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:10.668484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ffffbed4-d6d5-4eb3-9c44-49e0fe461a9e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:10.669436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ffffbed4-d6d5-4eb3-9c44-49e0fe461a9e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:10.676462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffffbed4-d6d5-4eb3-9c44-49e0fe461a9e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:10.677271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffffbed4-d6d5-4eb3-9c44-49e0fe461a9e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:10.678369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffffbed4-d6d5-4eb3-9c44-49e0fe461a9e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:10.679132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffffbed4-d6d5-4eb3-9c44-49e0fe461a9e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:11.093386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ffffbed4-d6d5-4eb3-9c44-49e0fe461a9e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:11.105628 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ffffbed4-d6d5-4eb3-9c44-49e0fe461a9e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1315 microversion: 2.1 time: 0.439593 Mar 12 21:06:11.121300 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3039/3807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:10 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:11.133985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bb342b86-ce4d-4b1d-aba4-90df30124b8c req-233716ce-9e0a-4348-ac6d-362036f628f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1f8df3-57c9-4312-93f5-ab79e215eae7", "name": "network-vif-deleted", "tag": "fb8aa364-7adc-4bdc-89e5-c5f79ac0d9fe"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:11.156540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bb342b86-ce4d-4b1d-aba4-90df30124b8c req-233716ce-9e0a-4348-ac6d-362036f628f4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:11.157299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bb342b86-ce4d-4b1d-aba4-90df30124b8c req-233716ce-9e0a-4348-ac6d-362036f628f4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:11.175987 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bb342b86-ce4d-4b1d-aba4-90df30124b8c req-233716ce-9e0a-4348-ac6d-362036f628f4 service nova] Creating event network-vif-deleted:fb8aa364-7adc-4bdc-89e5-c5f79ac0d9fe for instance ed1f8df3-57c9-4312-93f5-ab79e215eae7 on nch2-master-1 Mar 12 21:06:11.181490 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bb342b86-ce4d-4b1d-aba4-90df30124b8c req-233716ce-9e0a-4348-ac6d-362036f628f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058621 Mar 12 21:06:11.182960 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3040/3808] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:11.190183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d66ef3d-4516-4201-ac4f-b8cd1c1741a5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba7d5c32-c844-466a-925a-148040924690"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:11.191653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0d66ef3d-4516-4201-ac4f-b8cd1c1741a5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:11.199135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d66ef3d-4516-4201-ac4f-b8cd1c1741a5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:11.199923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d66ef3d-4516-4201-ac4f-b8cd1c1741a5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:11.201461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d66ef3d-4516-4201-ac4f-b8cd1c1741a5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:11.202196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d66ef3d-4516-4201-ac4f-b8cd1c1741a5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:11.626276 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d66ef3d-4516-4201-ac4f-b8cd1c1741a5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.441604 Mar 12 21:06:11.627263 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3041/3809] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:06:11 2022] POST /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2/os-volume_attachments => generated 194 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:11.632683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0baf3ec4-ce4c-4bab-ba37-350bad32e12a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:11.634062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0baf3ec4-ce4c-4bab-ba37-350bad32e12a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:11.643017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0baf3ec4-ce4c-4bab-ba37-350bad32e12a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:11.643761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0baf3ec4-ce4c-4bab-ba37-350bad32e12a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:11.644652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0baf3ec4-ce4c-4bab-ba37-350bad32e12a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:11.645210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0baf3ec4-ce4c-4bab-ba37-350bad32e12a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:11.661218 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-0baf3ec4-ce4c-4bab-ba37-350bad32e12a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance ed1f8df3-57c9-4312-93f5-ab79e215eae7 could not be found. Mar 12 21:06:11.662140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0baf3ec4-ce4c-4bab-ba37-350bad32e12a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance ed1f8df3-57c9-4312-93f5-ab79e215eae7 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:06:11.663224 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0baf3ec4-ce4c-4bab-ba37-350bad32e12a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 404 len: 111 microversion: 2.1 time: 0.034660 Mar 12 21:06:11.664236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3042/3810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:11 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:06:11.804875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-55da3366-e140-4370-874e-811a4582be92 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:11.805849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-55da3366-e140-4370-874e-811a4582be92 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:11.813133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55da3366-e140-4370-874e-811a4582be92 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:11.814263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55da3366-e140-4370-874e-811a4582be92 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:11.814989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55da3366-e140-4370-874e-811a4582be92 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:11.815446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55da3366-e140-4370-874e-811a4582be92 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:11.839494 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-55da3366-e140-4370-874e-811a4582be92 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance ed1f8df3-57c9-4312-93f5-ab79e215eae7 could not be found. Mar 12 21:06:11.840380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-55da3366-e140-4370-874e-811a4582be92 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance ed1f8df3-57c9-4312-93f5-ab79e215eae7 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:06:11.841419 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-55da3366-e140-4370-874e-811a4582be92 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040549 Mar 12 21:06:11.868369 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3043/3811] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:06:11 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:06:12.017482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1284279768", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "3bc356e1-2fe7-4340-aecb-f85636b06883"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:12.084892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] validate_networks() for [('3bc356e1-2fe7-4340-aecb-f85636b06883', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:06:13.104987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:06:13.105636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:06:13.105755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:06:13.106160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:06:13.106831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:06:13.121753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:13.123547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:13.124405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:13.124859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:13.173554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:06:13.182610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for user 10e1e3bae5b94b5589b47488329ad756 and project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:06:13.234008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:06:13.236347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 64374fa6-f013-4a9d-babb-60e68b81985b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:06:13.315673 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb7db27e-e091-4da4-9d7e-23497f5417f6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303864 Mar 12 21:06:13.321209 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3044/3812] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:06:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:06:13.328024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7edd2dfb-3b33-45bb-bb72-96a7ab590810 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:13.328911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7edd2dfb-3b33-45bb-bb72-96a7ab590810 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:13.337927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7edd2dfb-3b33-45bb-bb72-96a7ab590810 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:13.338763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7edd2dfb-3b33-45bb-bb72-96a7ab590810 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:13.341113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7edd2dfb-3b33-45bb-bb72-96a7ab590810 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:13.341871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7edd2dfb-3b33-45bb-bb72-96a7ab590810 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:14.181098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7edd2dfb-3b33-45bb-bb72-96a7ab590810 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:14.190089 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7edd2dfb-3b33-45bb-bb72-96a7ab590810 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1503 microversion: 2.1 time: 0.866968 Mar 12 21:06:14.205367 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3045/3813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:13 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1503 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:14.205367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc1495e2-9fe4-4e73-9b98-5021421c3d60 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:14.207049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc1495e2-9fe4-4e73-9b98-5021421c3d60 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 64374fa6-f013-4a9d-babb-60e68b81985b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:14.224153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc1495e2-9fe4-4e73-9b98-5021421c3d60 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:14.224727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc1495e2-9fe4-4e73-9b98-5021421c3d60 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:14.225691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc1495e2-9fe4-4e73-9b98-5021421c3d60 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:14.226089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc1495e2-9fe4-4e73-9b98-5021421c3d60 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:14.334663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc1495e2-9fe4-4e73-9b98-5021421c3d60 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:14.363859 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc1495e2-9fe4-4e73-9b98-5021421c3d60 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b" status: 200 len: 1219 microversion: 2.1 time: 0.166097 Mar 12 21:06:14.377890 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3046/3814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:14 2022] GET /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b => generated 1219 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:14.396205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-366c1ffe-7d9a-423b-ba5f-3a33d683aea2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:14.397095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-366c1ffe-7d9a-423b-ba5f-3a33d683aea2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:14.420617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-366c1ffe-7d9a-423b-ba5f-3a33d683aea2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:14.426072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-366c1ffe-7d9a-423b-ba5f-3a33d683aea2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:14.426951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-366c1ffe-7d9a-423b-ba5f-3a33d683aea2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:14.427502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-366c1ffe-7d9a-423b-ba5f-3a33d683aea2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:14.598812 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-366c1ffe-7d9a-423b-ba5f-3a33d683aea2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1/action" status: 202 len: 0 microversion: 2.1 time: 0.218923 Mar 12 21:06:14.600656 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3047/3815] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:06:14 2022] POST /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:06:14.616226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee77938e-4507-4ae0-a269-f13e2649d930 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:14.619030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee77938e-4507-4ae0-a269-f13e2649d930 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 64374fa6-f013-4a9d-babb-60e68b81985b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:14.651244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee77938e-4507-4ae0-a269-f13e2649d930 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:14.654929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee77938e-4507-4ae0-a269-f13e2649d930 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:14.659678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee77938e-4507-4ae0-a269-f13e2649d930 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:14.660474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee77938e-4507-4ae0-a269-f13e2649d930 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:14.764409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee77938e-4507-4ae0-a269-f13e2649d930 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 64374fa6-f013-4a9d-babb-60e68b81985b] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:06:14.996605 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee77938e-4507-4ae0-a269-f13e2649d930 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b" status: 204 len: 0 microversion: 2.1 time: 0.392780 Mar 12 21:06:15.005969 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3048/3816] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:06:14 2022] DELETE /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:06:15.012833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b8afb4b2-1d4e-4f9a-bc77-385065605c08 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:15.014182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b8afb4b2-1d4e-4f9a-bc77-385065605c08 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:15.022277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8afb4b2-1d4e-4f9a-bc77-385065605c08 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:15.023096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8afb4b2-1d4e-4f9a-bc77-385065605c08 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:15.024347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8afb4b2-1d4e-4f9a-bc77-385065605c08 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:15.025037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8afb4b2-1d4e-4f9a-bc77-385065605c08 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:15.372153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b8afb4b2-1d4e-4f9a-bc77-385065605c08 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:15.384859 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b8afb4b2-1d4e-4f9a-bc77-385065605c08 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1488 microversion: 2.1 time: 0.377300 Mar 12 21:06:15.386271 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3049/3817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:15 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1488 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:15.400218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7fe67d6f-1a73-4608-b54e-3a6e5158bc79 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:15.402137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7fe67d6f-1a73-4608-b54e-3a6e5158bc79 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 64374fa6-f013-4a9d-babb-60e68b81985b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:15.409711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7fe67d6f-1a73-4608-b54e-3a6e5158bc79 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:15.410563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7fe67d6f-1a73-4608-b54e-3a6e5158bc79 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:15.411873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7fe67d6f-1a73-4608-b54e-3a6e5158bc79 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:15.412548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7fe67d6f-1a73-4608-b54e-3a6e5158bc79 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:15.530292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7fe67d6f-1a73-4608-b54e-3a6e5158bc79 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:15.543698 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7fe67d6f-1a73-4608-b54e-3a6e5158bc79 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b" status: 200 len: 1273 microversion: 2.1 time: 0.154101 Mar 12 21:06:15.544894 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3050/3818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:15 2022] GET /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:15.552608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-78406c54-df2a-43f9-847c-5e537361494e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: .version_select at 0x7f6e3559a310>, body: {"keypair": {"name": "tempest-keypair-1663527832"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:15.576249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-78406c54-df2a-43f9-847c-5e537361494e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:06:15.583273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-78406c54-df2a-43f9-847c-5e537361494e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for user f2c8058e4e8d475c9377a065b4018a2a and project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:06:15.949889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-78406c54-df2a-43f9-847c-5e537361494e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:06:15.960616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-78406c54-df2a-43f9-847c-5e537361494e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for user f2c8058e4e8d475c9377a065b4018a2a and project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:06:16.029626 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-78406c54-df2a-43f9-847c-5e537361494e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.483214 Mar 12 21:06:16.043487 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3051/3819] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:06:15 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:16.052166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1dc29e85-ef01-4d99-b902-8e91b7146de2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:16.053295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1dc29e85-ef01-4d99-b902-8e91b7146de2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:16.083853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1dc29e85-ef01-4d99-b902-8e91b7146de2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:16.084759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1dc29e85-ef01-4d99-b902-8e91b7146de2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:16.085952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1dc29e85-ef01-4d99-b902-8e91b7146de2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:16.089271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1dc29e85-ef01-4d99-b902-8e91b7146de2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:16.174402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-1dc29e85-ef01-4d99-b902-8e91b7146de2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lazy-loading 'flavor' on Instance uuid f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:06:16.790813 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1dc29e85-ef01-4d99-b902-8e91b7146de2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1/action" status: 202 len: 0 microversion: 2.1 time: 0.745637 Mar 12 21:06:16.793658 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3052/3820] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:06:16 2022] POST /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1/action => generated 0 bytes in 749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:06:16.815139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-db0324aa-08e2-433d-8b69-52e36877019d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:16.816426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-db0324aa-08e2-433d-8b69-52e36877019d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 64374fa6-f013-4a9d-babb-60e68b81985b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:16.851059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db0324aa-08e2-433d-8b69-52e36877019d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:16.852067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db0324aa-08e2-433d-8b69-52e36877019d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:16.853158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db0324aa-08e2-433d-8b69-52e36877019d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:16.855025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db0324aa-08e2-433d-8b69-52e36877019d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:17.014032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-db0324aa-08e2-433d-8b69-52e36877019d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:17.021621 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-db0324aa-08e2-433d-8b69-52e36877019d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b" status: 200 len: 1217 microversion: 2.1 time: 0.226413 Mar 12 21:06:17.022754 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3053/3821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:16 2022] GET /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:17.039838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee8622bf-1315-4ce3-a73a-22b543a667ce tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:17.040986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee8622bf-1315-4ce3-a73a-22b543a667ce tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:17.049050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee8622bf-1315-4ce3-a73a-22b543a667ce tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:17.050041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee8622bf-1315-4ce3-a73a-22b543a667ce tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:17.052041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee8622bf-1315-4ce3-a73a-22b543a667ce tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:17.065475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee8622bf-1315-4ce3-a73a-22b543a667ce tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:17.372368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee8622bf-1315-4ce3-a73a-22b543a667ce tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:17.380923 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee8622bf-1315-4ce3-a73a-22b543a667ce tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1494 microversion: 2.1 time: 0.356870 Mar 12 21:06:17.395696 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3054/3822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:17 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1494 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:18.050694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e1b9309e-b8d1-4308-b375-ac712c8c4fee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:18.052122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e1b9309e-b8d1-4308-b375-ac712c8c4fee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 64374fa6-f013-4a9d-babb-60e68b81985b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:18.063750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1b9309e-b8d1-4308-b375-ac712c8c4fee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:18.064999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1b9309e-b8d1-4308-b375-ac712c8c4fee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:18.070824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1b9309e-b8d1-4308-b375-ac712c8c4fee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:18.071571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1b9309e-b8d1-4308-b375-ac712c8c4fee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:18.246440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e1b9309e-b8d1-4308-b375-ac712c8c4fee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:18.258808 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e1b9309e-b8d1-4308-b375-ac712c8c4fee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b" status: 200 len: 1219 microversion: 2.1 time: 0.222700 Mar 12 21:06:18.261264 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3055/3823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:18 2022] GET /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b => generated 1219 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:18.405251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f4fe0cfc-3cad-4f30-b3c1-8371229837bc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:18.412730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f4fe0cfc-3cad-4f30-b3c1-8371229837bc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:18.426429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4fe0cfc-3cad-4f30-b3c1-8371229837bc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:18.427255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4fe0cfc-3cad-4f30-b3c1-8371229837bc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:18.428764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4fe0cfc-3cad-4f30-b3c1-8371229837bc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:18.429428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4fe0cfc-3cad-4f30-b3c1-8371229837bc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:18.816197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f4fe0cfc-3cad-4f30-b3c1-8371229837bc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:18.823801 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f4fe0cfc-3cad-4f30-b3c1-8371229837bc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1515 microversion: 2.1 time: 0.425538 Mar 12 21:06:18.824396 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3056/3824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:18 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1515 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:19.277917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1291396a-1acd-4d34-a367-8e7304794d77 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:19.278474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1291396a-1acd-4d34-a367-8e7304794d77 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 64374fa6-f013-4a9d-babb-60e68b81985b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:19.292686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1291396a-1acd-4d34-a367-8e7304794d77 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:19.294287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1291396a-1acd-4d34-a367-8e7304794d77 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:19.295364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1291396a-1acd-4d34-a367-8e7304794d77 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:19.298768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1291396a-1acd-4d34-a367-8e7304794d77 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:19.345871 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-1291396a-1acd-4d34-a367-8e7304794d77 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance 64374fa6-f013-4a9d-babb-60e68b81985b could not be found. Mar 12 21:06:19.348865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1291396a-1acd-4d34-a367-8e7304794d77 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance 64374fa6-f013-4a9d-babb-60e68b81985b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:06:19.349960 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1291396a-1acd-4d34-a367-8e7304794d77 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b" status: 404 len: 111 microversion: 2.1 time: 0.077328 Mar 12 21:06:19.351721 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3057/3825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:19 2022] GET /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:06:19.557314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-676038375", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "3bc356e1-2fe7-4340-aecb-f85636b06883"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:19.653826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] validate_networks() for [('3bc356e1-2fe7-4340-aecb-f85636b06883', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:06:20.874081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:06:20.874081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:06:20.874081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:06:20.875003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:06:20.875003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:06:20.884194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:20.885026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:20.886092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:20.886711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:20.906954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:06:20.914352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for user 10e1e3bae5b94b5589b47488329ad756 and project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:06:20.934846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:06:20.937985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:06:21.034491 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34f7dcdc-4b45-48e6-b0a2-1c5fc0a3e747 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.482733 Mar 12 21:06:21.040577 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3058/3826] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:06:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:06:21.048798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee046161-5a78-4c8c-9534-8d7d2cbe6a0a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:21.050694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee046161-5a78-4c8c-9534-8d7d2cbe6a0a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:21.081587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee046161-5a78-4c8c-9534-8d7d2cbe6a0a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:21.083276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee046161-5a78-4c8c-9534-8d7d2cbe6a0a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:21.084255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee046161-5a78-4c8c-9534-8d7d2cbe6a0a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:21.090622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee046161-5a78-4c8c-9534-8d7d2cbe6a0a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:21.354862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee046161-5a78-4c8c-9534-8d7d2cbe6a0a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:21.371525 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee046161-5a78-4c8c-9534-8d7d2cbe6a0a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1515 microversion: 2.1 time: 0.328358 Mar 12 21:06:21.374600 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3059/3827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:21 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1515 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:21.407389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-906e565e-3749-47e3-b8d2-98ef4f1bc33f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:21.408177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-906e565e-3749-47e3-b8d2-98ef4f1bc33f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:21.698210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-906e565e-3749-47e3-b8d2-98ef4f1bc33f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:21.730488 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-906e565e-3749-47e3-b8d2-98ef4f1bc33f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 200 len: 1214 microversion: 2.1 time: 0.339098 Mar 12 21:06:21.762439 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3060/3828] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:21 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 1214 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:21.812036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-94361501", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94a25897-3a88-44fe-b618-77b90965f553"}], "security_groups": [{"name": "tempest-securitygroup--342916864"}], "key_name": "tempest-keypair-1663527832", "user_data": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:22.224057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] validate_networks() for [('94a25897-3a88-44fe-b618-77b90965f553', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:06:23.497811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:06:23.499636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:06:23.500072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:06:23.500503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:06:23.500958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:06:23.522500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:23.523153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:23.524294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:23.524747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:23.578896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for project 2f427010b06749289b20e8b776a8b8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:06:23.590539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for user f2c8058e4e8d475c9377a065b4018a2a and project 2f427010b06749289b20e8b776a8b8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:06:23.620119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:06:23.622436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:06:23.738122 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d6156d0e-f3fb-403e-97eb-1fa3b3dc177d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.931251 Mar 12 21:06:23.742700 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3061/3829] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:06:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:06:23.753325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8fcef0e3-8199-437e-95a3-0c9c42965b14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:23.754770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8fcef0e3-8199-437e-95a3-0c9c42965b14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:23.768259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fcef0e3-8199-437e-95a3-0c9c42965b14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:23.768970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fcef0e3-8199-437e-95a3-0c9c42965b14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:23.771720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fcef0e3-8199-437e-95a3-0c9c42965b14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:23.773352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fcef0e3-8199-437e-95a3-0c9c42965b14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:24.222484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8fcef0e3-8199-437e-95a3-0c9c42965b14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:24.230791 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8fcef0e3-8199-437e-95a3-0c9c42965b14 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1510 microversion: 2.1 time: 0.486532 Mar 12 21:06:24.235120 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3062/3830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:23 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1510 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:24.245142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-acfca8a1-afe6-41cd-aa63-05a0525a95e4 req-f7e5ce4b-0ab4-4239-ac39-87392d9e2cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52f6788-3a66-4ba4-a31a-9aaab1d05ba1", "name": "network-vif-plugged", "status": "completed", "tag": "7295f7e8-0ece-4f4a-bd06-2446d6571980"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:24.274328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-acfca8a1-afe6-41cd-aa63-05a0525a95e4 req-f7e5ce4b-0ab4-4239-ac39-87392d9e2cee service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:24.275193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-acfca8a1-afe6-41cd-aa63-05a0525a95e4 req-f7e5ce4b-0ab4-4239-ac39-87392d9e2cee service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:24.295127 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-acfca8a1-afe6-41cd-aa63-05a0525a95e4 req-f7e5ce4b-0ab4-4239-ac39-87392d9e2cee service nova] Creating event network-vif-plugged:7295f7e8-0ece-4f4a-bd06-2446d6571980 for instance f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 on nch1-master-1 Mar 12 21:06:24.308188 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-acfca8a1-afe6-41cd-aa63-05a0525a95e4 req-f7e5ce4b-0ab4-4239-ac39-87392d9e2cee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071582 Mar 12 21:06:24.316219 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3063/3831] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:24.329416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39780608-58d0-437c-bab0-0c97dde2da56 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:24.332173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39780608-58d0-437c-bab0-0c97dde2da56 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:24.344384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39780608-58d0-437c-bab0-0c97dde2da56 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:24.345362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39780608-58d0-437c-bab0-0c97dde2da56 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:24.350807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39780608-58d0-437c-bab0-0c97dde2da56 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:24.351490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39780608-58d0-437c-bab0-0c97dde2da56 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:24.497674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39780608-58d0-437c-bab0-0c97dde2da56 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:24.513897 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39780608-58d0-437c-bab0-0c97dde2da56 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 200 len: 1272 microversion: 2.1 time: 0.194564 Mar 12 21:06:24.517926 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3064/3832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:24 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:24.533717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4ea024d4-a8c6-4ab5-bd73-50b7c44f60bb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:24.534385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4ea024d4-a8c6-4ab5-bd73-50b7c44f60bb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:24.754756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4ea024d4-a8c6-4ab5-bd73-50b7c44f60bb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:24.768114 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4ea024d4-a8c6-4ab5-bd73-50b7c44f60bb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1240 microversion: 2.1 time: 0.248199 Mar 12 21:06:24.769402 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3065/3833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:24 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1240 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:25.249735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-55b55cbe-5b35-4d17-8622-ffdadc095249 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:25.250462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-55b55cbe-5b35-4d17-8622-ffdadc095249 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:25.259214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55b55cbe-5b35-4d17-8622-ffdadc095249 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:25.260674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55b55cbe-5b35-4d17-8622-ffdadc095249 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:25.261188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55b55cbe-5b35-4d17-8622-ffdadc095249 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:25.261952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55b55cbe-5b35-4d17-8622-ffdadc095249 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:26.341493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-55b55cbe-5b35-4d17-8622-ffdadc095249 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:26.350157 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-55b55cbe-5b35-4d17-8622-ffdadc095249 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1510 microversion: 2.1 time: 1.105716 Mar 12 21:06:26.364499 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3066/3834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:25 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1510 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:26.381809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4edf3a8a-05c5-4472-9fa4-46ca0dc62570 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:26.384243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4edf3a8a-05c5-4472-9fa4-46ca0dc62570 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:26.418019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4edf3a8a-05c5-4472-9fa4-46ca0dc62570 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:26.418742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4edf3a8a-05c5-4472-9fa4-46ca0dc62570 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:26.423294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4edf3a8a-05c5-4472-9fa4-46ca0dc62570 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:26.424537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4edf3a8a-05c5-4472-9fa4-46ca0dc62570 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:27.776089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4edf3a8a-05c5-4472-9fa4-46ca0dc62570 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:27.798592 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4edf3a8a-05c5-4472-9fa4-46ca0dc62570 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 200 len: 1314 microversion: 2.1 time: 1.420311 Mar 12 21:06:27.799679 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3067/3835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:26 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 1314 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:27.821203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ed3de2d-323d-4b61-baa4-e34efcc99f6a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:27.822293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ed3de2d-323d-4b61-baa4-e34efcc99f6a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:27.863953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ed3de2d-323d-4b61-baa4-e34efcc99f6a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:27.865327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ed3de2d-323d-4b61-baa4-e34efcc99f6a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:27.868531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ed3de2d-323d-4b61-baa4-e34efcc99f6a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:27.871225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ed3de2d-323d-4b61-baa4-e34efcc99f6a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:28.065731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ed3de2d-323d-4b61-baa4-e34efcc99f6a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:28.082295 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ed3de2d-323d-4b61-baa4-e34efcc99f6a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1298 microversion: 2.1 time: 0.278960 Mar 12 21:06:28.096196 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3068/3836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:27 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1298 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:28.115336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1aa8f037-ae5b-4e23-8eea-043f7fda71f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:28.116488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1aa8f037-ae5b-4e23-8eea-043f7fda71f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:28.138860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1aa8f037-ae5b-4e23-8eea-043f7fda71f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:28.139507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1aa8f037-ae5b-4e23-8eea-043f7fda71f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:28.141410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1aa8f037-ae5b-4e23-8eea-043f7fda71f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:28.142120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1aa8f037-ae5b-4e23-8eea-043f7fda71f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:28.751188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1aa8f037-ae5b-4e23-8eea-043f7fda71f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:28.759960 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1aa8f037-ae5b-4e23-8eea-043f7fda71f0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1510 microversion: 2.1 time: 0.662389 Mar 12 21:06:28.769494 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3069/3837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:28 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1510 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:28.777505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-80de9879-8d0e-4ae8-9642-b765e28ebf4a req-b37d095b-2a35-4838-91bc-20145fbc97a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a220cc9-9f61-4277-9dea-98609c6cb93c", "tag": "381de734-3f26-4d20-9402-ff3175a2e8cf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:28.809654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-80de9879-8d0e-4ae8-9642-b765e28ebf4a req-b37d095b-2a35-4838-91bc-20145fbc97a1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:28.811938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-80de9879-8d0e-4ae8-9642-b765e28ebf4a req-b37d095b-2a35-4838-91bc-20145fbc97a1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:28.858667 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-80de9879-8d0e-4ae8-9642-b765e28ebf4a req-b37d095b-2a35-4838-91bc-20145fbc97a1 service nova] Creating event network-changed:381de734-3f26-4d20-9402-ff3175a2e8cf for instance 2a220cc9-9f61-4277-9dea-98609c6cb93c on nch2-master-1 Mar 12 21:06:28.872074 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-80de9879-8d0e-4ae8-9642-b765e28ebf4a req-b37d095b-2a35-4838-91bc-20145fbc97a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100919 Mar 12 21:06:28.874309 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3070/3838] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:28.897619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b794574-89cc-4310-b941-50b886a1aa7e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:28.898524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b794574-89cc-4310-b941-50b886a1aa7e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:28.913917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b794574-89cc-4310-b941-50b886a1aa7e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:28.922019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b794574-89cc-4310-b941-50b886a1aa7e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:28.923919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b794574-89cc-4310-b941-50b886a1aa7e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:28.930115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b794574-89cc-4310-b941-50b886a1aa7e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:29.741420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b794574-89cc-4310-b941-50b886a1aa7e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:29.753488 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b794574-89cc-4310-b941-50b886a1aa7e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 200 len: 1314 microversion: 2.1 time: 0.876277 Mar 12 21:06:29.754165 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3071/3839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:28 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:29.772857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ccf0fefe-6cc2-4c1b-803f-df88eaa72a9b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:29.773650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ccf0fefe-6cc2-4c1b-803f-df88eaa72a9b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:29.793599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccf0fefe-6cc2-4c1b-803f-df88eaa72a9b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:29.799487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccf0fefe-6cc2-4c1b-803f-df88eaa72a9b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:29.800735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccf0fefe-6cc2-4c1b-803f-df88eaa72a9b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:29.806384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccf0fefe-6cc2-4c1b-803f-df88eaa72a9b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:30.330525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ccf0fefe-6cc2-4c1b-803f-df88eaa72a9b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:30.345896 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ccf0fefe-6cc2-4c1b-803f-df88eaa72a9b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1365 microversion: 2.1 time: 0.583820 Mar 12 21:06:30.347173 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3072/3840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:29 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1365 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:30.361609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f23308d2-9dee-4a9b-b6de-e4737df4a4c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:30.363660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f23308d2-9dee-4a9b-b6de-e4737df4a4c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:30.386056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f23308d2-9dee-4a9b-b6de-e4737df4a4c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:30.394479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f23308d2-9dee-4a9b-b6de-e4737df4a4c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:30.396727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f23308d2-9dee-4a9b-b6de-e4737df4a4c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:30.401416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f23308d2-9dee-4a9b-b6de-e4737df4a4c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:31.080657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f23308d2-9dee-4a9b-b6de-e4737df4a4c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:31.093564 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f23308d2-9dee-4a9b-b6de-e4737df4a4c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1510 microversion: 2.1 time: 0.743047 Mar 12 21:06:31.094383 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3073/3841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:30 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1510 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:31.100205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dee92dfb-611b-4590-8d7d-8e0afc72c2be tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:31.101672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dee92dfb-611b-4590-8d7d-8e0afc72c2be tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:31.109080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dee92dfb-611b-4590-8d7d-8e0afc72c2be tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:31.109851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dee92dfb-611b-4590-8d7d-8e0afc72c2be tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:31.111045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dee92dfb-611b-4590-8d7d-8e0afc72c2be tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:31.112303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dee92dfb-611b-4590-8d7d-8e0afc72c2be tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:31.864262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dee92dfb-611b-4590-8d7d-8e0afc72c2be tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:31.872213 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dee92dfb-611b-4590-8d7d-8e0afc72c2be tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 200 len: 1314 microversion: 2.1 time: 0.776160 Mar 12 21:06:31.878336 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3074/3842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:31 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:31.896539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1a117e9b-3d6f-422e-affc-1e75aff9af53 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:31.897868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1a117e9b-3d6f-422e-affc-1e75aff9af53 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:31.904371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a117e9b-3d6f-422e-affc-1e75aff9af53 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:31.905071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a117e9b-3d6f-422e-affc-1e75aff9af53 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:31.905906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a117e9b-3d6f-422e-affc-1e75aff9af53 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:31.906519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a117e9b-3d6f-422e-affc-1e75aff9af53 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:32.475016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1a117e9b-3d6f-422e-affc-1e75aff9af53 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:32.488618 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1a117e9b-3d6f-422e-affc-1e75aff9af53 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1365 microversion: 2.1 time: 0.608893 Mar 12 21:06:32.489232 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3075/3843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:31 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1365 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:32.501741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-009e586b-64dd-449b-a9b5-968402fe03c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:32.503077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-009e586b-64dd-449b-a9b5-968402fe03c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:32.512829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-009e586b-64dd-449b-a9b5-968402fe03c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:32.513701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-009e586b-64dd-449b-a9b5-968402fe03c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:32.514827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-009e586b-64dd-449b-a9b5-968402fe03c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:32.515444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-009e586b-64dd-449b-a9b5-968402fe03c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:33.533728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-009e586b-64dd-449b-a9b5-968402fe03c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:33.543580 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-009e586b-64dd-449b-a9b5-968402fe03c8 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1510 microversion: 2.1 time: 1.052994 Mar 12 21:06:33.561725 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3076/3844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:32 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1510 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:33.579637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-968d7262-be91-4918-bd27-64b432242970 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:33.587337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-968d7262-be91-4918-bd27-64b432242970 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:33.607596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-968d7262-be91-4918-bd27-64b432242970 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:33.612850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-968d7262-be91-4918-bd27-64b432242970 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:33.616044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-968d7262-be91-4918-bd27-64b432242970 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:33.618228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-968d7262-be91-4918-bd27-64b432242970 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:34.321578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-968d7262-be91-4918-bd27-64b432242970 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:34.330712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-968d7262-be91-4918-bd27-64b432242970 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 200 len: 1314 microversion: 2.1 time: 0.767729 Mar 12 21:06:34.345318 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3077/3845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:33 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:34.368427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16b2611e-0e43-47da-9c8d-60fcd4f842ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:34.376316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16b2611e-0e43-47da-9c8d-60fcd4f842ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:34.414981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16b2611e-0e43-47da-9c8d-60fcd4f842ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:34.426332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16b2611e-0e43-47da-9c8d-60fcd4f842ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:34.428363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16b2611e-0e43-47da-9c8d-60fcd4f842ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:34.428849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16b2611e-0e43-47da-9c8d-60fcd4f842ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:35.661403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16b2611e-0e43-47da-9c8d-60fcd4f842ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:35.699825 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16b2611e-0e43-47da-9c8d-60fcd4f842ac tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1365 microversion: 2.1 time: 1.340715 Mar 12 21:06:35.701463 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3078/3846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:34 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1365 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:35.726695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-508074d9-8069-42a0-9a9c-8b55dbb28b1c req-e490fa9e-81e1-4e82-acc5-9d8967ac14a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d3f7e4-7cc1-4ebb-864f-36ddef3948fb", "tag": "a2f5edc3-02a4-4d60-a189-bb281e2c7ed9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:35.746407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-508074d9-8069-42a0-9a9c-8b55dbb28b1c req-e490fa9e-81e1-4e82-acc5-9d8967ac14a6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:35.747266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-508074d9-8069-42a0-9a9c-8b55dbb28b1c req-e490fa9e-81e1-4e82-acc5-9d8967ac14a6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:35.782895 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-508074d9-8069-42a0-9a9c-8b55dbb28b1c req-e490fa9e-81e1-4e82-acc5-9d8967ac14a6 service nova] Creating event network-changed:a2f5edc3-02a4-4d60-a189-bb281e2c7ed9 for instance 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb on nch1-master-1 Mar 12 21:06:35.793850 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-508074d9-8069-42a0-9a9c-8b55dbb28b1c req-e490fa9e-81e1-4e82-acc5-9d8967ac14a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075042 Mar 12 21:06:35.794702 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3079/3847] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:35.802689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49ba93d5-0a7f-4eea-83bd-94699a379aa0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:35.812762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-49ba93d5-0a7f-4eea-83bd-94699a379aa0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:35.850808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49ba93d5-0a7f-4eea-83bd-94699a379aa0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:35.853013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49ba93d5-0a7f-4eea-83bd-94699a379aa0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:35.856293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49ba93d5-0a7f-4eea-83bd-94699a379aa0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:35.857093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49ba93d5-0a7f-4eea-83bd-94699a379aa0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:36.403854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-49ba93d5-0a7f-4eea-83bd-94699a379aa0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:36.412469 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-49ba93d5-0a7f-4eea-83bd-94699a379aa0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1510 microversion: 2.1 time: 0.616431 Mar 12 21:06:36.413791 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3080/3848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:35 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1510 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:36.419374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2aab15a7-219b-4ca0-8613-e86301eefe91 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:36.420177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2aab15a7-219b-4ca0-8613-e86301eefe91 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:36.426624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2aab15a7-219b-4ca0-8613-e86301eefe91 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:36.427342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2aab15a7-219b-4ca0-8613-e86301eefe91 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:36.428572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2aab15a7-219b-4ca0-8613-e86301eefe91 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:36.429196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2aab15a7-219b-4ca0-8613-e86301eefe91 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:37.131262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2aab15a7-219b-4ca0-8613-e86301eefe91 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:37.145371 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2aab15a7-219b-4ca0-8613-e86301eefe91 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 200 len: 1314 microversion: 2.1 time: 0.730089 Mar 12 21:06:37.161832 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3081/3849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:36 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:37.175393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fab2241b-3a48-424c-8109-2153a1959d3a req-2bb21a7b-0f40-4f40-ae71-825713a1e028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a220cc9-9f61-4277-9dea-98609c6cb93c", "name": "network-vif-plugged", "status": "completed", "tag": "381de734-3f26-4d20-9402-ff3175a2e8cf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:37.202488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fab2241b-3a48-424c-8109-2153a1959d3a req-2bb21a7b-0f40-4f40-ae71-825713a1e028 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:37.206173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fab2241b-3a48-424c-8109-2153a1959d3a req-2bb21a7b-0f40-4f40-ae71-825713a1e028 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:37.253238 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fab2241b-3a48-424c-8109-2153a1959d3a req-2bb21a7b-0f40-4f40-ae71-825713a1e028 service nova] Creating event network-vif-plugged:381de734-3f26-4d20-9402-ff3175a2e8cf for instance 2a220cc9-9f61-4277-9dea-98609c6cb93c on nch2-master-1 Mar 12 21:06:37.266520 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fab2241b-3a48-424c-8109-2153a1959d3a req-2bb21a7b-0f40-4f40-ae71-825713a1e028 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101984 Mar 12 21:06:37.269465 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3082/3850] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:37.306128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14bbbe35-f30c-47ee-bc01-67bc0eb67171 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:37.324036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14bbbe35-f30c-47ee-bc01-67bc0eb67171 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:37.358898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14bbbe35-f30c-47ee-bc01-67bc0eb67171 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:37.359862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14bbbe35-f30c-47ee-bc01-67bc0eb67171 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:37.361407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14bbbe35-f30c-47ee-bc01-67bc0eb67171 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:37.363918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14bbbe35-f30c-47ee-bc01-67bc0eb67171 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:38.011477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14bbbe35-f30c-47ee-bc01-67bc0eb67171 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:38.025895 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14bbbe35-f30c-47ee-bc01-67bc0eb67171 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1365 microversion: 2.1 time: 0.738073 Mar 12 21:06:38.026490 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3083/3851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:37 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1365 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:38.031080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b840023-d4f8-47d0-bc0b-ca70d46eedd3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:38.031696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3b840023-d4f8-47d0-bc0b-ca70d46eedd3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:38.067295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b840023-d4f8-47d0-bc0b-ca70d46eedd3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:38.067756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b840023-d4f8-47d0-bc0b-ca70d46eedd3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:38.068560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b840023-d4f8-47d0-bc0b-ca70d46eedd3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:38.069007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b840023-d4f8-47d0-bc0b-ca70d46eedd3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:38.754150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3b840023-d4f8-47d0-bc0b-ca70d46eedd3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:38.767268 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b840023-d4f8-47d0-bc0b-ca70d46eedd3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1510 microversion: 2.1 time: 0.739587 Mar 12 21:06:38.770073 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3084/3852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:38 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1510 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:38.784319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b545960-191e-443e-a571-8b2f7d62ddea tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:38.786490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b545960-191e-443e-a571-8b2f7d62ddea tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:38.801696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b545960-191e-443e-a571-8b2f7d62ddea tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:38.804602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b545960-191e-443e-a571-8b2f7d62ddea tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:38.806967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b545960-191e-443e-a571-8b2f7d62ddea tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:38.808574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b545960-191e-443e-a571-8b2f7d62ddea tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:39.175302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b545960-191e-443e-a571-8b2f7d62ddea tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:39.183325 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b545960-191e-443e-a571-8b2f7d62ddea tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 200 len: 1314 microversion: 2.1 time: 0.411699 Mar 12 21:06:39.186811 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3085/3853] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:38 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:39.195950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8269a6f9-c757-4f17-bb5f-a99948ad692b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:39.206876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8269a6f9-c757-4f17-bb5f-a99948ad692b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:39.229104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8269a6f9-c757-4f17-bb5f-a99948ad692b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:39.229734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8269a6f9-c757-4f17-bb5f-a99948ad692b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:39.230741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8269a6f9-c757-4f17-bb5f-a99948ad692b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:39.231309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8269a6f9-c757-4f17-bb5f-a99948ad692b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:39.791269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8269a6f9-c757-4f17-bb5f-a99948ad692b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:39.809401 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8269a6f9-c757-4f17-bb5f-a99948ad692b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1365 microversion: 2.1 time: 0.620518 Mar 12 21:06:39.811505 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3086/3854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:39 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1365 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:39.818734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-889244e6-bfad-455e-8285-01753ac9ba1c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:39.820841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-889244e6-bfad-455e-8285-01753ac9ba1c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:39.831502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-889244e6-bfad-455e-8285-01753ac9ba1c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:39.832447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-889244e6-bfad-455e-8285-01753ac9ba1c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:39.837886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-889244e6-bfad-455e-8285-01753ac9ba1c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:39.838855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-889244e6-bfad-455e-8285-01753ac9ba1c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:40.530997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-889244e6-bfad-455e-8285-01753ac9ba1c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:40.542991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-889244e6-bfad-455e-8285-01753ac9ba1c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1510 microversion: 2.1 time: 0.728390 Mar 12 21:06:40.554992 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3087/3855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:39 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1510 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:40.575099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b9c2deab-9e53-46a7-9270-485f46899c41 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:40.576250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b9c2deab-9e53-46a7-9270-485f46899c41 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:40.595331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9c2deab-9e53-46a7-9270-485f46899c41 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:40.597398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9c2deab-9e53-46a7-9270-485f46899c41 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:40.598873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9c2deab-9e53-46a7-9270-485f46899c41 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:40.600279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b9c2deab-9e53-46a7-9270-485f46899c41 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:41.171810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b9c2deab-9e53-46a7-9270-485f46899c41 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:41.190710 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b9c2deab-9e53-46a7-9270-485f46899c41 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 200 len: 1502 microversion: 2.1 time: 0.632683 Mar 12 21:06:41.191413 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3088/3856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:40 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 1502 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:41.204834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ae2cf8d2-af9e-41f4-b82e-c6d13cd6634b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:41.205477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ae2cf8d2-af9e-41f4-b82e-c6d13cd6634b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:41.225195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae2cf8d2-af9e-41f4-b82e-c6d13cd6634b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:41.225665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae2cf8d2-af9e-41f4-b82e-c6d13cd6634b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:41.230201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae2cf8d2-af9e-41f4-b82e-c6d13cd6634b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:41.234248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae2cf8d2-af9e-41f4-b82e-c6d13cd6634b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:41.922324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ae2cf8d2-af9e-41f4-b82e-c6d13cd6634b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:41.930072 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ae2cf8d2-af9e-41f4-b82e-c6d13cd6634b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1365 microversion: 2.1 time: 0.736909 Mar 12 21:06:41.932599 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3089/3857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:41 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1365 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:41.950605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-68c927a7-5414-48cf-b5a0-a273d8206b71 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:41.958717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-68c927a7-5414-48cf-b5a0-a273d8206b71 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:41.973144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c927a7-5414-48cf-b5a0-a273d8206b71 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:41.973941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c927a7-5414-48cf-b5a0-a273d8206b71 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:41.974730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c927a7-5414-48cf-b5a0-a273d8206b71 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:41.975167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c927a7-5414-48cf-b5a0-a273d8206b71 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:42.119541 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-68c927a7-5414-48cf-b5a0-a273d8206b71 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "POST /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c/action" status: 202 len: 0 microversion: 2.1 time: 0.173119 Mar 12 21:06:42.120531 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3090/3858] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:06:41 2022] POST /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:06:42.132136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c6775af2-cdea-487f-81ec-08b096edf037 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:42.136690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c6775af2-cdea-487f-81ec-08b096edf037 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:42.152500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6775af2-cdea-487f-81ec-08b096edf037 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:42.153308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6775af2-cdea-487f-81ec-08b096edf037 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:42.154366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6775af2-cdea-487f-81ec-08b096edf037 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:42.155068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6775af2-cdea-487f-81ec-08b096edf037 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:42.880176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c6775af2-cdea-487f-81ec-08b096edf037 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:42.889634 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c6775af2-cdea-487f-81ec-08b096edf037 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1510 microversion: 2.1 time: 0.767515 Mar 12 21:06:42.891205 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3091/3859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:42 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1510 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:42.898749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-551b2483-6c14-455c-93d0-fbc90e5ccc9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:42.904179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-551b2483-6c14-455c-93d0-fbc90e5ccc9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:42.920307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-551b2483-6c14-455c-93d0-fbc90e5ccc9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:42.924491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-551b2483-6c14-455c-93d0-fbc90e5ccc9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:42.925597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-551b2483-6c14-455c-93d0-fbc90e5ccc9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:42.926483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-551b2483-6c14-455c-93d0-fbc90e5ccc9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:44.347534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-551b2483-6c14-455c-93d0-fbc90e5ccc9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:44.355262 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-551b2483-6c14-455c-93d0-fbc90e5ccc9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 200 len: 1487 microversion: 2.1 time: 1.462328 Mar 12 21:06:44.369474 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3092/3860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:42 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 1487 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:44.380341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd1711c1-c7d0-44b5-8cdf-ad1b9175dca5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:44.381474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd1711c1-c7d0-44b5-8cdf-ad1b9175dca5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:44.400027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd1711c1-c7d0-44b5-8cdf-ad1b9175dca5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:44.401306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd1711c1-c7d0-44b5-8cdf-ad1b9175dca5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:44.402306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd1711c1-c7d0-44b5-8cdf-ad1b9175dca5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:44.402971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd1711c1-c7d0-44b5-8cdf-ad1b9175dca5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:44.724910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bd1711c1-c7d0-44b5-8cdf-ad1b9175dca5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:44.738206 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd1711c1-c7d0-44b5-8cdf-ad1b9175dca5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1365 microversion: 2.1 time: 0.362522 Mar 12 21:06:44.739190 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3093/3861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:44 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1365 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:44.757897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-784a51bb-d01a-424d-a928-7d50a102ef66 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:44.760959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-784a51bb-d01a-424d-a928-7d50a102ef66 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:44.780227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-784a51bb-d01a-424d-a928-7d50a102ef66 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:44.781010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-784a51bb-d01a-424d-a928-7d50a102ef66 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:44.789318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-784a51bb-d01a-424d-a928-7d50a102ef66 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:44.790228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-784a51bb-d01a-424d-a928-7d50a102ef66 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:45.796502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-784a51bb-d01a-424d-a928-7d50a102ef66 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:45.811627 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-784a51bb-d01a-424d-a928-7d50a102ef66 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1510 microversion: 2.1 time: 1.071131 Mar 12 21:06:45.813370 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3094/3862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:44 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1510 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:45.829751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fbd01049-a8d9-4180-b0be-fc06d1023292 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:45.832252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fbd01049-a8d9-4180-b0be-fc06d1023292 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:45.850559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbd01049-a8d9-4180-b0be-fc06d1023292 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:45.854655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbd01049-a8d9-4180-b0be-fc06d1023292 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:45.857577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbd01049-a8d9-4180-b0be-fc06d1023292 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:45.859399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbd01049-a8d9-4180-b0be-fc06d1023292 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:45.931593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fbd01049-a8d9-4180-b0be-fc06d1023292 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:06:46.115166 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fbd01049-a8d9-4180-b0be-fc06d1023292 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 204 len: 0 microversion: 2.1 time: 0.300310 Mar 12 21:06:46.116369 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3095/3863] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:06:45 2022] DELETE /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:06:46.133562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-93077c95-9e6a-4869-aaaf-bf0fd1100e96 req-4e0aed07-7041-4a31-84e4-1eda465fa79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d3f7e4-7cc1-4ebb-864f-36ddef3948fb", "name": "network-vif-plugged", "status": "completed", "tag": "a2f5edc3-02a4-4d60-a189-bb281e2c7ed9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:46.159089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-93077c95-9e6a-4869-aaaf-bf0fd1100e96 req-4e0aed07-7041-4a31-84e4-1eda465fa79a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:46.162546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-93077c95-9e6a-4869-aaaf-bf0fd1100e96 req-4e0aed07-7041-4a31-84e4-1eda465fa79a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:46.186770 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-93077c95-9e6a-4869-aaaf-bf0fd1100e96 req-4e0aed07-7041-4a31-84e4-1eda465fa79a service nova] Creating event network-vif-plugged:a2f5edc3-02a4-4d60-a189-bb281e2c7ed9 for instance 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb on nch1-master-1 Mar 12 21:06:46.192993 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-93077c95-9e6a-4869-aaaf-bf0fd1100e96 req-4e0aed07-7041-4a31-84e4-1eda465fa79a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075021 Mar 12 21:06:46.194211 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3096/3864] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:46.203386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dfe57faf-834f-4022-b2a0-5f8ed9f6c638 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:46.204572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dfe57faf-834f-4022-b2a0-5f8ed9f6c638 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:46.212294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfe57faf-834f-4022-b2a0-5f8ed9f6c638 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:46.213223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfe57faf-834f-4022-b2a0-5f8ed9f6c638 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:46.214237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfe57faf-834f-4022-b2a0-5f8ed9f6c638 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:46.214855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfe57faf-834f-4022-b2a0-5f8ed9f6c638 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:47.063796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dfe57faf-834f-4022-b2a0-5f8ed9f6c638 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:47.078689 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dfe57faf-834f-4022-b2a0-5f8ed9f6c638 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1365 microversion: 2.1 time: 0.881459 Mar 12 21:06:47.089164 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3097/3865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:46 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1365 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:47.094996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3aa934ca-24ae-454f-b232-3a0e3e856b26 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:47.095933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3aa934ca-24ae-454f-b232-3a0e3e856b26 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:47.107237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3aa934ca-24ae-454f-b232-3a0e3e856b26 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:47.108022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3aa934ca-24ae-454f-b232-3a0e3e856b26 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:47.109100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3aa934ca-24ae-454f-b232-3a0e3e856b26 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:47.109848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3aa934ca-24ae-454f-b232-3a0e3e856b26 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:47.353193 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:06:47.354111 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:06:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:06:47.775941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3aa934ca-24ae-454f-b232-3a0e3e856b26 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:47.786778 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3aa934ca-24ae-454f-b232-3a0e3e856b26 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 200 len: 1493 microversion: 2.1 time: 0.695472 Mar 12 21:06:47.790139 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3098/3866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:47 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 1493 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:47.807278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2526050-c6c9-4c08-b681-7ed27eec4e5a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:47.808521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2526050-c6c9-4c08-b681-7ed27eec4e5a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:47.827106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2526050-c6c9-4c08-b681-7ed27eec4e5a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:47.827913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2526050-c6c9-4c08-b681-7ed27eec4e5a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:47.830084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2526050-c6c9-4c08-b681-7ed27eec4e5a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:47.831978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2526050-c6c9-4c08-b681-7ed27eec4e5a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:48.688591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e2526050-c6c9-4c08-b681-7ed27eec4e5a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:48.708665 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2526050-c6c9-4c08-b681-7ed27eec4e5a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1510 microversion: 2.1 time: 0.915527 Mar 12 21:06:48.710720 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3099/3867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:47 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1510 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:48.727528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a11cdb54-aee6-4d80-a0b6-60dc5a48688b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:48.729412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a11cdb54-aee6-4d80-a0b6-60dc5a48688b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:48.749114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a11cdb54-aee6-4d80-a0b6-60dc5a48688b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:48.750343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a11cdb54-aee6-4d80-a0b6-60dc5a48688b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:48.751586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a11cdb54-aee6-4d80-a0b6-60dc5a48688b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:48.752634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a11cdb54-aee6-4d80-a0b6-60dc5a48688b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:49.474477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a11cdb54-aee6-4d80-a0b6-60dc5a48688b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:49.487344 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a11cdb54-aee6-4d80-a0b6-60dc5a48688b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1556 microversion: 2.1 time: 0.772249 Mar 12 21:06:49.489617 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3100/3868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:48 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1556 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:49.501469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e7e2c74b-72da-402a-b9bf-62b35c3d3761 req-4e75873b-fae1-480a-8ff8-acac9c4deba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a220cc9-9f61-4277-9dea-98609c6cb93c", "name": "network-vif-deleted", "tag": "381de734-3f26-4d20-9402-ff3175a2e8cf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:49.545528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e7e2c74b-72da-402a-b9bf-62b35c3d3761 req-4e75873b-fae1-480a-8ff8-acac9c4deba8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:49.548029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e7e2c74b-72da-402a-b9bf-62b35c3d3761 req-4e75873b-fae1-480a-8ff8-acac9c4deba8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:49.573752 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e7e2c74b-72da-402a-b9bf-62b35c3d3761 req-4e75873b-fae1-480a-8ff8-acac9c4deba8 service nova] Creating event network-vif-deleted:381de734-3f26-4d20-9402-ff3175a2e8cf for instance 2a220cc9-9f61-4277-9dea-98609c6cb93c on nch2-master-1 Mar 12 21:06:49.583629 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e7e2c74b-72da-402a-b9bf-62b35c3d3761 req-4e75873b-fae1-480a-8ff8-acac9c4deba8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091981 Mar 12 21:06:49.585095 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3101/3869] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:49.593787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d5a5ec28-3eb3-4c8f-8a3d-1858a87e14b4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:49.595116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d5a5ec28-3eb3-4c8f-8a3d-1858a87e14b4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:49.605312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5a5ec28-3eb3-4c8f-8a3d-1858a87e14b4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:49.606191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5a5ec28-3eb3-4c8f-8a3d-1858a87e14b4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:49.607269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5a5ec28-3eb3-4c8f-8a3d-1858a87e14b4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:49.608097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5a5ec28-3eb3-4c8f-8a3d-1858a87e14b4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:49.625204 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d5a5ec28-3eb3-4c8f-8a3d-1858a87e14b4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance 2a220cc9-9f61-4277-9dea-98609c6cb93c could not be found. Mar 12 21:06:49.626036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d5a5ec28-3eb3-4c8f-8a3d-1858a87e14b4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance 2a220cc9-9f61-4277-9dea-98609c6cb93c could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:06:49.627238 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d5a5ec28-3eb3-4c8f-8a3d-1858a87e14b4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 404 len: 111 microversion: 2.1 time: 0.040423 Mar 12 21:06:49.628533 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3102/3870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:49 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:06:49.636674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b0e5045-3b59-418e-a968-ca6b8dc3df92 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:49.637399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b0e5045-3b59-418e-a968-ca6b8dc3df92 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:49.648934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b0e5045-3b59-418e-a968-ca6b8dc3df92 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:49.649855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b0e5045-3b59-418e-a968-ca6b8dc3df92 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:49.651670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b0e5045-3b59-418e-a968-ca6b8dc3df92 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:49.653442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b0e5045-3b59-418e-a968-ca6b8dc3df92 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:49.925163 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b0e5045-3b59-418e-a968-ca6b8dc3df92 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.295288 Mar 12 21:06:49.926583 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3103/3871] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 21:06:49 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb/os-interface => generated 285 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:49.938499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad82463b-95cd-4fa2-b2c9-952869067573 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:49.939507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad82463b-95cd-4fa2-b2c9-952869067573 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:49.948525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad82463b-95cd-4fa2-b2c9-952869067573 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:49.950262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad82463b-95cd-4fa2-b2c9-952869067573 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:49.951326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad82463b-95cd-4fa2-b2c9-952869067573 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:49.952006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad82463b-95cd-4fa2-b2c9-952869067573 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:50.363497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad82463b-95cd-4fa2-b2c9-952869067573 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:50.373403 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad82463b-95cd-4fa2-b2c9-952869067573 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1507 microversion: 2.1 time: 0.445444 Mar 12 21:06:50.378144 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3104/3872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:49 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:50.390311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-582134382", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "3bc356e1-2fe7-4340-aecb-f85636b06883"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:50.471527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] validate_networks() for [('3bc356e1-2fe7-4340-aecb-f85636b06883', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:06:51.418091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:06:51.419185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:06:51.420651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:06:51.420978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:06:51.421681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:06:51.448485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:51.449248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:51.450867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:51.452043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:51.474326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:06:51.480669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for user 10e1e3bae5b94b5589b47488329ad756 and project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:06:51.502250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:06:51.505350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:06:51.613157 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-02955007-c48a-4e36-a8ac-7e5018f43c67 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.233296 Mar 12 21:06:51.624901 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3105/3873] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:06:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:06:51.639711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fbfa64d5-278c-4987-b65f-a523086e374c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:51.647590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fbfa64d5-278c-4987-b65f-a523086e374c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:51.677921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbfa64d5-278c-4987-b65f-a523086e374c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:51.680131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbfa64d5-278c-4987-b65f-a523086e374c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:51.682742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbfa64d5-278c-4987-b65f-a523086e374c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:51.683337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbfa64d5-278c-4987-b65f-a523086e374c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:52.162708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fbfa64d5-278c-4987-b65f-a523086e374c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:52.174580 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fbfa64d5-278c-4987-b65f-a523086e374c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1507 microversion: 2.1 time: 0.548151 Mar 12 21:06:52.175192 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3106/3874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:51 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1507 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:52.189377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-40a42ed4-47ba-44d3-a5b4-ed26f03caf3c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:52.190034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-40a42ed4-47ba-44d3-a5b4-ed26f03caf3c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:52.296976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-40a42ed4-47ba-44d3-a5b4-ed26f03caf3c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:52.304049 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-40a42ed4-47ba-44d3-a5b4-ed26f03caf3c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1214 microversion: 2.1 time: 0.118567 Mar 12 21:06:52.304650 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3107/3875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:52 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1214 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:53.195429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d7e343d-61b1-4987-9730-011a19d41004 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:53.196888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d7e343d-61b1-4987-9730-011a19d41004 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:53.214368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d7e343d-61b1-4987-9730-011a19d41004 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:53.214926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d7e343d-61b1-4987-9730-011a19d41004 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:53.216586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d7e343d-61b1-4987-9730-011a19d41004 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:53.217699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d7e343d-61b1-4987-9730-011a19d41004 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:53.684569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d7e343d-61b1-4987-9730-011a19d41004 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:53.693430 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d7e343d-61b1-4987-9730-011a19d41004 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1507 microversion: 2.1 time: 0.503802 Mar 12 21:06:53.698783 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3108/3876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:53 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1507 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:53.718381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ddb7290-7d67-438b-9b27-35b52c5f006e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:53.719041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ddb7290-7d67-438b-9b27-35b52c5f006e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:53.739335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ddb7290-7d67-438b-9b27-35b52c5f006e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:53.739802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ddb7290-7d67-438b-9b27-35b52c5f006e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:53.746052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ddb7290-7d67-438b-9b27-35b52c5f006e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:53.746628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ddb7290-7d67-438b-9b27-35b52c5f006e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:53.901819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ddb7290-7d67-438b-9b27-35b52c5f006e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:53.927993 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ddb7290-7d67-438b-9b27-35b52c5f006e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1272 microversion: 2.1 time: 0.225801 Mar 12 21:06:53.930418 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3109/3877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:53 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:54.421353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6112461d-ca86-493e-8a2a-5094d9f70ba5 req-03afeb1a-6b21-484c-94a6-1b878ef766c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52f6788-3a66-4ba4-a31a-9aaab1d05ba1", "name": "network-vif-unplugged", "status": "completed", "tag": "7295f7e8-0ece-4f4a-bd06-2446d6571980"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:54.448995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6112461d-ca86-493e-8a2a-5094d9f70ba5 req-03afeb1a-6b21-484c-94a6-1b878ef766c0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:54.449449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6112461d-ca86-493e-8a2a-5094d9f70ba5 req-03afeb1a-6b21-484c-94a6-1b878ef766c0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:54.492792 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6112461d-ca86-493e-8a2a-5094d9f70ba5 req-03afeb1a-6b21-484c-94a6-1b878ef766c0 service nova] Creating event network-vif-unplugged:7295f7e8-0ece-4f4a-bd06-2446d6571980 for instance f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 on nch1-master-1 Mar 12 21:06:54.513182 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6112461d-ca86-493e-8a2a-5094d9f70ba5 req-03afeb1a-6b21-484c-94a6-1b878ef766c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093351 Mar 12 21:06:54.515651 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3110/3878] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:06:54.714998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c9bba86-5275-494c-94a4-27ed48b1aa77 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:54.716738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c9bba86-5275-494c-94a4-27ed48b1aa77 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:54.727071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c9bba86-5275-494c-94a4-27ed48b1aa77 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:54.728395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c9bba86-5275-494c-94a4-27ed48b1aa77 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:54.729504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c9bba86-5275-494c-94a4-27ed48b1aa77 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:54.730161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c9bba86-5275-494c-94a4-27ed48b1aa77 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:55.245629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9c9bba86-5275-494c-94a4-27ed48b1aa77 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:55.296884 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c9bba86-5275-494c-94a4-27ed48b1aa77 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 200 len: 1510 microversion: 2.1 time: 0.588131 Mar 12 21:06:55.298149 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3111/3879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:54 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 1510 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:55.309910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a4a45abf-062d-46a9-af9b-65621469bf62 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:55.311446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a4a45abf-062d-46a9-af9b-65621469bf62 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:55.331262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4a45abf-062d-46a9-af9b-65621469bf62 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:55.332522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4a45abf-062d-46a9-af9b-65621469bf62 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:55.337544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4a45abf-062d-46a9-af9b-65621469bf62 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:55.346881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4a45abf-062d-46a9-af9b-65621469bf62 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:56.233861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a4a45abf-062d-46a9-af9b-65621469bf62 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:56.248689 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a4a45abf-062d-46a9-af9b-65621469bf62 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1272 microversion: 2.1 time: 0.948609 Mar 12 21:06:56.249697 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3112/3880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:55 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1272 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:56.281815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c63a97f-3c7c-4ba4-a87d-82fa765c3fcd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:56.283795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c63a97f-3c7c-4ba4-a87d-82fa765c3fcd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:56.313215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c63a97f-3c7c-4ba4-a87d-82fa765c3fcd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:56.313974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c63a97f-3c7c-4ba4-a87d-82fa765c3fcd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:56.315242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c63a97f-3c7c-4ba4-a87d-82fa765c3fcd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:56.315935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c63a97f-3c7c-4ba4-a87d-82fa765c3fcd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:57.199602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9c63a97f-3c7c-4ba4-a87d-82fa765c3fcd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:57.215313 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c63a97f-3c7c-4ba4-a87d-82fa765c3fcd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.945671 Mar 12 21:06:57.224764 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3113/3881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:56 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:57.239550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c00673cb-4f8c-4e1d-803c-b1174110e9bb req-d2fc8f2a-dba0-4325-ab5b-0d547422ad44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d3f7e4-7cc1-4ebb-864f-36ddef3948fb", "tag": "a2f5edc3-02a4-4d60-a189-bb281e2c7ed9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:06:57.262275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c00673cb-4f8c-4e1d-803c-b1174110e9bb req-d2fc8f2a-dba0-4325-ab5b-0d547422ad44 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:57.262721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c00673cb-4f8c-4e1d-803c-b1174110e9bb req-d2fc8f2a-dba0-4325-ab5b-0d547422ad44 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:57.294561 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c00673cb-4f8c-4e1d-803c-b1174110e9bb req-d2fc8f2a-dba0-4325-ab5b-0d547422ad44 service nova] Creating event network-changed:a2f5edc3-02a4-4d60-a189-bb281e2c7ed9 for instance 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb on nch1-master-1 Mar 12 21:06:57.304507 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c00673cb-4f8c-4e1d-803c-b1174110e9bb req-d2fc8f2a-dba0-4325-ab5b-0d547422ad44 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077927 Mar 12 21:06:57.305376 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3114/3882] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:06:57.326878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3a2503d4-9144-4def-88c1-d82047929e7e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:57.327814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3a2503d4-9144-4def-88c1-d82047929e7e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:57.335666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a2503d4-9144-4def-88c1-d82047929e7e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:57.336329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a2503d4-9144-4def-88c1-d82047929e7e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:57.337986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a2503d4-9144-4def-88c1-d82047929e7e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:57.338623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a2503d4-9144-4def-88c1-d82047929e7e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:58.085295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3a2503d4-9144-4def-88c1-d82047929e7e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:58.098821 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3a2503d4-9144-4def-88c1-d82047929e7e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.789504 Mar 12 21:06:58.101452 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3115/3883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:57 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:58.116795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-498839e4-648a-4325-948c-d0db4e3955c9 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:58.118645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-498839e4-648a-4325-948c-d0db4e3955c9 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:58.133077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-498839e4-648a-4325-948c-d0db4e3955c9 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:58.133545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-498839e4-648a-4325-948c-d0db4e3955c9 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:58.138980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-498839e4-648a-4325-948c-d0db4e3955c9 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:58.139986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-498839e4-648a-4325-948c-d0db4e3955c9 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:58.900919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-498839e4-648a-4325-948c-d0db4e3955c9 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:58.917110 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-498839e4-648a-4325-948c-d0db4e3955c9 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1314 microversion: 2.1 time: 0.812101 Mar 12 21:06:58.920031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3116/3884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:58 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:58.938838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-22dae51a-7e44-41b5-9a4f-5a5e012cfe3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:58.939604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-22dae51a-7e44-41b5-9a4f-5a5e012cfe3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:58.953015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22dae51a-7e44-41b5-9a4f-5a5e012cfe3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:58.954013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22dae51a-7e44-41b5-9a4f-5a5e012cfe3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:58.955645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22dae51a-7e44-41b5-9a4f-5a5e012cfe3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:58.957096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22dae51a-7e44-41b5-9a4f-5a5e012cfe3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:59.642994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-22dae51a-7e44-41b5-9a4f-5a5e012cfe3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:06:59.672637 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-22dae51a-7e44-41b5-9a4f-5a5e012cfe3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.751123 Mar 12 21:06:59.675431 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3117/3885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:58 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:06:59.705809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cdd22287-3bf6-49d3-9ccf-d04947a57c04 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:06:59.707500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cdd22287-3bf6-49d3-9ccf-d04947a57c04 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:06:59.717586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdd22287-3bf6-49d3-9ccf-d04947a57c04 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:59.718191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdd22287-3bf6-49d3-9ccf-d04947a57c04 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:06:59.719101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdd22287-3bf6-49d3-9ccf-d04947a57c04 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:06:59.719638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdd22287-3bf6-49d3-9ccf-d04947a57c04 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:00.156996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cdd22287-3bf6-49d3-9ccf-d04947a57c04 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:00.167183 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cdd22287-3bf6-49d3-9ccf-d04947a57c04 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.479498 Mar 12 21:07:00.169150 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3118/3886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:06:59 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:00.177162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eeba90b8-cf03-4a02-8342-0c47f5935f34 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:00.178734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eeba90b8-cf03-4a02-8342-0c47f5935f34 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:00.213486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeba90b8-cf03-4a02-8342-0c47f5935f34 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:00.215726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeba90b8-cf03-4a02-8342-0c47f5935f34 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:00.219838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeba90b8-cf03-4a02-8342-0c47f5935f34 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:00.221753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeba90b8-cf03-4a02-8342-0c47f5935f34 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:00.686505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eeba90b8-cf03-4a02-8342-0c47f5935f34 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:00.697390 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eeba90b8-cf03-4a02-8342-0c47f5935f34 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1314 microversion: 2.1 time: 0.525088 Mar 12 21:07:00.700601 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3119/3887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:00 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:00.713573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f6414837-ab2f-481d-9ef6-6095d54e3bf9 req-6c995bdc-98ec-4142-b90c-5cd239b7aed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e4dbc9-e3c3-45e5-9d41-0b27844bc172", "tag": "fcb6ffc3-d6b9-48e7-83a1-e9a6b02cb3d9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:00.757545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f6414837-ab2f-481d-9ef6-6095d54e3bf9 req-6c995bdc-98ec-4142-b90c-5cd239b7aed0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:00.761330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f6414837-ab2f-481d-9ef6-6095d54e3bf9 req-6c995bdc-98ec-4142-b90c-5cd239b7aed0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:00.794143 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f6414837-ab2f-481d-9ef6-6095d54e3bf9 req-6c995bdc-98ec-4142-b90c-5cd239b7aed0 service nova] Creating event network-changed:fcb6ffc3-d6b9-48e7-83a1-e9a6b02cb3d9 for instance c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 on nch2-master-1 Mar 12 21:07:00.807348 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f6414837-ab2f-481d-9ef6-6095d54e3bf9 req-6c995bdc-98ec-4142-b90c-5cd239b7aed0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105473 Mar 12 21:07:00.811527 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3120/3888] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:07:00.816941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6dd34be9-2c58-4e50-9006-6697e2ed4286 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:00.831662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6dd34be9-2c58-4e50-9006-6697e2ed4286 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:00.842876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6dd34be9-2c58-4e50-9006-6697e2ed4286 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:00.885016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6dd34be9-2c58-4e50-9006-6697e2ed4286 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Going to try to stop instance {{(pid=136302) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 12 21:07:00.961300 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6dd34be9-2c58-4e50-9006-6697e2ed4286 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.148305 Mar 12 21:07:00.963003 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3121/3889] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:07:00 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:07:00.983030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b710375-d135-4bf9-b5be-ff2c4f702c7d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:00.983769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b710375-d135-4bf9-b5be-ff2c4f702c7d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:00.995652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b710375-d135-4bf9-b5be-ff2c4f702c7d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:00.996113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b710375-d135-4bf9-b5be-ff2c4f702c7d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:00.997616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b710375-d135-4bf9-b5be-ff2c4f702c7d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:00.998093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b710375-d135-4bf9-b5be-ff2c4f702c7d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:01.492735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b710375-d135-4bf9-b5be-ff2c4f702c7d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:01.506092 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b710375-d135-4bf9-b5be-ff2c4f702c7d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 0.532595 Mar 12 21:07:01.515849 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3122/3890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:00 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:01.716959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3f6ea348-982d-4452-9166-c434236d1807 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:01.718000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3f6ea348-982d-4452-9166-c434236d1807 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:01.738869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f6ea348-982d-4452-9166-c434236d1807 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:01.739172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f6ea348-982d-4452-9166-c434236d1807 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:01.739979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f6ea348-982d-4452-9166-c434236d1807 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:01.740778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f6ea348-982d-4452-9166-c434236d1807 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:02.238195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3f6ea348-982d-4452-9166-c434236d1807 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:02.253358 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3f6ea348-982d-4452-9166-c434236d1807 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1314 microversion: 2.1 time: 0.542209 Mar 12 21:07:02.265812 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3123/3891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:01 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:02.524133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3d21d83f-a827-4be1-930a-d4d350e75dc1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:02.524916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3d21d83f-a827-4be1-930a-d4d350e75dc1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:02.533034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d21d83f-a827-4be1-930a-d4d350e75dc1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:02.533762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d21d83f-a827-4be1-930a-d4d350e75dc1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:02.534850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d21d83f-a827-4be1-930a-d4d350e75dc1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:02.535487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d21d83f-a827-4be1-930a-d4d350e75dc1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:02.893241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3d21d83f-a827-4be1-930a-d4d350e75dc1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:02.901300 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3d21d83f-a827-4be1-930a-d4d350e75dc1 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 0.381608 Mar 12 21:07:02.905484 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3124/3892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:02 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:03.281663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-039acaf1-3236-4686-b0aa-fc98687c3a69 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:03.282129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-039acaf1-3236-4686-b0aa-fc98687c3a69 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:03.298146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-039acaf1-3236-4686-b0aa-fc98687c3a69 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:03.298615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-039acaf1-3236-4686-b0aa-fc98687c3a69 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:03.299414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-039acaf1-3236-4686-b0aa-fc98687c3a69 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:03.299859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-039acaf1-3236-4686-b0aa-fc98687c3a69 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:04.083910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-039acaf1-3236-4686-b0aa-fc98687c3a69 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:04.107116 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-039acaf1-3236-4686-b0aa-fc98687c3a69 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1314 microversion: 2.1 time: 0.829203 Mar 12 21:07:04.121314 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3125/3893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:03 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1314 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:04.135243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e4a16bee-c556-4f26-8172-a1478e9e08ed tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:04.137929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e4a16bee-c556-4f26-8172-a1478e9e08ed tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:04.147790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4a16bee-c556-4f26-8172-a1478e9e08ed tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:04.148936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4a16bee-c556-4f26-8172-a1478e9e08ed tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:04.150348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4a16bee-c556-4f26-8172-a1478e9e08ed tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:04.151758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4a16bee-c556-4f26-8172-a1478e9e08ed tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:04.628057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e4a16bee-c556-4f26-8172-a1478e9e08ed tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:04.644939 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e4a16bee-c556-4f26-8172-a1478e9e08ed tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 0.520388 Mar 12 21:07:04.646692 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3126/3894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:04 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:05.136173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf30617e-152e-41bd-a7b7-3b8de50ca1af tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:05.137609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bf30617e-152e-41bd-a7b7-3b8de50ca1af tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:05.144899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf30617e-152e-41bd-a7b7-3b8de50ca1af tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:05.145714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf30617e-152e-41bd-a7b7-3b8de50ca1af tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:05.147179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf30617e-152e-41bd-a7b7-3b8de50ca1af tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:05.147721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf30617e-152e-41bd-a7b7-3b8de50ca1af tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:05.485060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bf30617e-152e-41bd-a7b7-3b8de50ca1af tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:05.499309 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bf30617e-152e-41bd-a7b7-3b8de50ca1af tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1314 microversion: 2.1 time: 0.363896 Mar 12 21:07:05.500443 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3127/3895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:05 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:05.664662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b8719ba6-2c82-48c9-a931-066468c39444 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:05.665844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b8719ba6-2c82-48c9-a931-066468c39444 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:05.675331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8719ba6-2c82-48c9-a931-066468c39444 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:05.677112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8719ba6-2c82-48c9-a931-066468c39444 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:05.679821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8719ba6-2c82-48c9-a931-066468c39444 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:05.680623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b8719ba6-2c82-48c9-a931-066468c39444 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:06.072617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b8719ba6-2c82-48c9-a931-066468c39444 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:06.090799 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b8719ba6-2c82-48c9-a931-066468c39444 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 0.430482 Mar 12 21:07:06.091812 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3128/3896] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:05 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:06.127941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4d218414-0fb0-4a81-9873-486c2895ac88 req-504f5fe3-b616-41e1-9f92-3f35a5856fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e4dbc9-e3c3-45e5-9d41-0b27844bc172", "name": "network-vif-plugged", "status": "completed", "tag": "fcb6ffc3-d6b9-48e7-83a1-e9a6b02cb3d9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:06.138391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4d218414-0fb0-4a81-9873-486c2895ac88 req-504f5fe3-b616-41e1-9f92-3f35a5856fb6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:06.140671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4d218414-0fb0-4a81-9873-486c2895ac88 req-504f5fe3-b616-41e1-9f92-3f35a5856fb6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:06.158308 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4d218414-0fb0-4a81-9873-486c2895ac88 req-504f5fe3-b616-41e1-9f92-3f35a5856fb6 service nova] Creating event network-vif-plugged:fcb6ffc3-d6b9-48e7-83a1-e9a6b02cb3d9 for instance c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 on nch2-master-1 Mar 12 21:07:06.164789 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4d218414-0fb0-4a81-9873-486c2895ac88 req-504f5fe3-b616-41e1-9f92-3f35a5856fb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040373 Mar 12 21:07:06.166133 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3129/3897] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:07:06.525557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7f3ac022-4db9-4acc-94ff-dbab99cbc96f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:06.526302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7f3ac022-4db9-4acc-94ff-dbab99cbc96f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:06.541694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f3ac022-4db9-4acc-94ff-dbab99cbc96f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:06.543674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f3ac022-4db9-4acc-94ff-dbab99cbc96f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:06.545305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f3ac022-4db9-4acc-94ff-dbab99cbc96f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:06.550206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f3ac022-4db9-4acc-94ff-dbab99cbc96f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:06.881110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7f3ac022-4db9-4acc-94ff-dbab99cbc96f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:06.890026 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7f3ac022-4db9-4acc-94ff-dbab99cbc96f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1314 microversion: 2.1 time: 0.370450 Mar 12 21:07:06.900327 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3130/3898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:06 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:07.110407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-38c08f15-b134-4256-a370-059729705c3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:07.111309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-38c08f15-b134-4256-a370-059729705c3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:07.119066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38c08f15-b134-4256-a370-059729705c3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:07.119801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38c08f15-b134-4256-a370-059729705c3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:07.120849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38c08f15-b134-4256-a370-059729705c3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:07.121520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38c08f15-b134-4256-a370-059729705c3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:07.535781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-38c08f15-b134-4256-a370-059729705c3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:07.546394 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-38c08f15-b134-4256-a370-059729705c3b tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 0.440190 Mar 12 21:07:07.552064 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3131/3899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:07 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:07.907321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ef9c94d-360b-4be8-a67f-cf41c0002125 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:07.908258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ef9c94d-360b-4be8-a67f-cf41c0002125 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:07.919235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ef9c94d-360b-4be8-a67f-cf41c0002125 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:07.920575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ef9c94d-360b-4be8-a67f-cf41c0002125 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:07.921612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ef9c94d-360b-4be8-a67f-cf41c0002125 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:07.922730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ef9c94d-360b-4be8-a67f-cf41c0002125 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:08.231748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ef9c94d-360b-4be8-a67f-cf41c0002125 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:08.239623 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ef9c94d-360b-4be8-a67f-cf41c0002125 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1502 microversion: 2.1 time: 0.336726 Mar 12 21:07:08.239824 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3132/3900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:07 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1502 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:08.259581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-817019f4-3304-4be4-8301-3f749fd6482b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:08.260056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-817019f4-3304-4be4-8301-3f749fd6482b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:08.266212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-817019f4-3304-4be4-8301-3f749fd6482b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:08.266672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-817019f4-3304-4be4-8301-3f749fd6482b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:08.267462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-817019f4-3304-4be4-8301-3f749fd6482b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:08.267906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-817019f4-3304-4be4-8301-3f749fd6482b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:08.304144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-817019f4-3304-4be4-8301-3f749fd6482b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lazy-loading 'flavor' on Instance uuid c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:07:08.707314 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-817019f4-3304-4be4-8301-3f749fd6482b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "POST /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172/action" status: 202 len: 0 microversion: 2.1 time: 0.451552 Mar 12 21:07:08.712259 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3133/3901] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:07:08 2022] POST /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:07:08.718613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee6c248d-ff89-4397-a0a7-b0d6f7060671 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:08.719427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee6c248d-ff89-4397-a0a7-b0d6f7060671 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:08.725758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee6c248d-ff89-4397-a0a7-b0d6f7060671 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:08.726487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee6c248d-ff89-4397-a0a7-b0d6f7060671 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:08.728023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee6c248d-ff89-4397-a0a7-b0d6f7060671 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:08.728697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee6c248d-ff89-4397-a0a7-b0d6f7060671 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:09.011868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee6c248d-ff89-4397-a0a7-b0d6f7060671 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:09.020818 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee6c248d-ff89-4397-a0a7-b0d6f7060671 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 0.307121 Mar 12 21:07:09.021498 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3134/3902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:08 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:09.029197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-74a6ab8a-89f5-4f37-a0f6-9766424df56c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:09.030196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-74a6ab8a-89f5-4f37-a0f6-9766424df56c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:09.037403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74a6ab8a-89f5-4f37-a0f6-9766424df56c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:09.038143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74a6ab8a-89f5-4f37-a0f6-9766424df56c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:09.039037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74a6ab8a-89f5-4f37-a0f6-9766424df56c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:09.039555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74a6ab8a-89f5-4f37-a0f6-9766424df56c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:09.313581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-74a6ab8a-89f5-4f37-a0f6-9766424df56c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:09.324019 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-74a6ab8a-89f5-4f37-a0f6-9766424df56c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1508 microversion: 2.1 time: 0.301175 Mar 12 21:07:09.325158 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3135/3903] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:09 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:09.643953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21a0764e-5666-4416-a31d-5b81167ac920 tempest-PortsAdminExtendedAttrsTestJSON-466595656 tempest-PortsAdminExtendedAttrsTestJSON-466595656-project-admin] Calling method '.version_select at 0x7f6e354d7c10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:09.644834 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:07:09.644834 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:07:09.646299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21a0764e-5666-4416-a31d-5b81167ac920 tempest-PortsAdminExtendedAttrsTestJSON-466595656 tempest-PortsAdminExtendedAttrsTestJSON-466595656-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:09.646958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21a0764e-5666-4416-a31d-5b81167ac920 tempest-PortsAdminExtendedAttrsTestJSON-466595656 tempest-PortsAdminExtendedAttrsTestJSON-466595656-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:09.681298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21a0764e-5666-4416-a31d-5b81167ac920 tempest-PortsAdminExtendedAttrsTestJSON-466595656 tempest-PortsAdminExtendedAttrsTestJSON-466595656-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:09.681782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21a0764e-5666-4416-a31d-5b81167ac920 tempest-PortsAdminExtendedAttrsTestJSON-466595656 tempest-PortsAdminExtendedAttrsTestJSON-466595656-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:09.728356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21a0764e-5666-4416-a31d-5b81167ac920 tempest-PortsAdminExtendedAttrsTestJSON-466595656 tempest-PortsAdminExtendedAttrsTestJSON-466595656-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:09.732754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21a0764e-5666-4416-a31d-5b81167ac920 tempest-PortsAdminExtendedAttrsTestJSON-466595656 tempest-PortsAdminExtendedAttrsTestJSON-466595656-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:09.754323 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21a0764e-5666-4416-a31d-5b81167ac920 tempest-PortsAdminExtendedAttrsTestJSON-466595656 tempest-PortsAdminExtendedAttrsTestJSON-466595656-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.427245 Mar 12 21:07:09.755548 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3136/3904] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 21:07:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:07:10.038794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a5116768-0dad-4e6c-bca6-6addbd82e787 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:10.039443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a5116768-0dad-4e6c-bca6-6addbd82e787 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:10.055891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5116768-0dad-4e6c-bca6-6addbd82e787 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:10.056355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5116768-0dad-4e6c-bca6-6addbd82e787 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:10.057158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5116768-0dad-4e6c-bca6-6addbd82e787 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:10.057853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5116768-0dad-4e6c-bca6-6addbd82e787 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:10.485069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a5116768-0dad-4e6c-bca6-6addbd82e787 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:10.498621 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a5116768-0dad-4e6c-bca6-6addbd82e787 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1680 microversion: 2.1 time: 0.463030 Mar 12 21:07:10.503517 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3137/3905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:10 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1680 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:10.520330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c71df310-55e5-4055-88d5-3e8f3bec12c1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:10.526640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c71df310-55e5-4055-88d5-3e8f3bec12c1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:10.539897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c71df310-55e5-4055-88d5-3e8f3bec12c1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:10.541073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c71df310-55e5-4055-88d5-3e8f3bec12c1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:10.542931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c71df310-55e5-4055-88d5-3e8f3bec12c1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:10.544242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c71df310-55e5-4055-88d5-3e8f3bec12c1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:10.993549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c71df310-55e5-4055-88d5-3e8f3bec12c1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:11.004681 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c71df310-55e5-4055-88d5-3e8f3bec12c1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1508 microversion: 2.1 time: 0.499293 Mar 12 21:07:11.007292 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3138/3906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:10 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:11.526554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1195bd9c-9087-4c54-a3b0-45dd0fd51690 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:11.529645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1195bd9c-9087-4c54-a3b0-45dd0fd51690 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:11.578543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1195bd9c-9087-4c54-a3b0-45dd0fd51690 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:11.579462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1195bd9c-9087-4c54-a3b0-45dd0fd51690 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:11.587347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1195bd9c-9087-4c54-a3b0-45dd0fd51690 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:11.590968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1195bd9c-9087-4c54-a3b0-45dd0fd51690 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:12.303741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1195bd9c-9087-4c54-a3b0-45dd0fd51690 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:12.315828 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1195bd9c-9087-4c54-a3b0-45dd0fd51690 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1657 microversion: 2.1 time: 0.796197 Mar 12 21:07:12.316464 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3139/3907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:11 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1657 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:12.330108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b5e2422c-d57d-486a-b6ea-90002a367f84 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:12.331138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b5e2422c-d57d-486a-b6ea-90002a367f84 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:12.344661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5e2422c-d57d-486a-b6ea-90002a367f84 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:12.345339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5e2422c-d57d-486a-b6ea-90002a367f84 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:12.346177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5e2422c-d57d-486a-b6ea-90002a367f84 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:12.346691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5e2422c-d57d-486a-b6ea-90002a367f84 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:13.079855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b5e2422c-d57d-486a-b6ea-90002a367f84 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:13.087870 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b5e2422c-d57d-486a-b6ea-90002a367f84 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1508 microversion: 2.1 time: 0.769655 Mar 12 21:07:13.088729 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3140/3908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:12 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1508 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:13.104193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5abe8fdf-15a6-40a3-9d65-0300416a27b4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:13.111193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5abe8fdf-15a6-40a3-9d65-0300416a27b4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:13.112001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5abe8fdf-15a6-40a3-9d65-0300416a27b4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:13.142628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5abe8fdf-15a6-40a3-9d65-0300416a27b4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Going to try to start instance {{(pid=136302) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 12 21:07:13.217353 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5abe8fdf-15a6-40a3-9d65-0300416a27b4 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.117042 Mar 12 21:07:13.218675 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3141/3909] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:07:13 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:07:13.247120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c1c9aaab-76dd-4162-b7ea-ae7fe8b161d3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:13.252721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c1c9aaab-76dd-4162-b7ea-ae7fe8b161d3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:13.263160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1c9aaab-76dd-4162-b7ea-ae7fe8b161d3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:13.264319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1c9aaab-76dd-4162-b7ea-ae7fe8b161d3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:13.267140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1c9aaab-76dd-4162-b7ea-ae7fe8b161d3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:13.267887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1c9aaab-76dd-4162-b7ea-ae7fe8b161d3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:14.756831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c1c9aaab-76dd-4162-b7ea-ae7fe8b161d3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:14.768571 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c1c9aaab-76dd-4162-b7ea-ae7fe8b161d3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1666 microversion: 2.1 time: 1.530550 Mar 12 21:07:14.780490 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3142/3910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:13 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1666 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:14.785820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6fb1a40b-6970-4589-901c-de3a3f198414 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:14.786677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6fb1a40b-6970-4589-901c-de3a3f198414 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:14.793743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fb1a40b-6970-4589-901c-de3a3f198414 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:14.800952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fb1a40b-6970-4589-901c-de3a3f198414 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:14.802045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fb1a40b-6970-4589-901c-de3a3f198414 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:14.806336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fb1a40b-6970-4589-901c-de3a3f198414 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:15.482117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6fb1a40b-6970-4589-901c-de3a3f198414 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:15.516030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6fb1a40b-6970-4589-901c-de3a3f198414 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1508 microversion: 2.1 time: 0.731027 Mar 12 21:07:15.518767 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3143/3911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:14 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1508 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:15.787106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f50567c-cb2f-4563-b107-d64b309c6efc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:15.787840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f50567c-cb2f-4563-b107-d64b309c6efc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:15.796576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f50567c-cb2f-4563-b107-d64b309c6efc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:15.810506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f50567c-cb2f-4563-b107-d64b309c6efc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:15.816019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f50567c-cb2f-4563-b107-d64b309c6efc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:15.816694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f50567c-cb2f-4563-b107-d64b309c6efc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:16.356364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f50567c-cb2f-4563-b107-d64b309c6efc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:16.377887 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f50567c-cb2f-4563-b107-d64b309c6efc tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.592651 Mar 12 21:07:16.393628 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3144/3912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:15 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:16.399742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-752ee504-6d40-420e-a90c-9b060418eb56 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:16.400750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-752ee504-6d40-420e-a90c-9b060418eb56 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:16.411565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-752ee504-6d40-420e-a90c-9b060418eb56 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:16.431424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-752ee504-6d40-420e-a90c-9b060418eb56 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:16.432540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-752ee504-6d40-420e-a90c-9b060418eb56 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:16.433008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-752ee504-6d40-420e-a90c-9b060418eb56 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:16.953125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-752ee504-6d40-420e-a90c-9b060418eb56 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:16.960773 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-752ee504-6d40-420e-a90c-9b060418eb56 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.565550 Mar 12 21:07:16.961381 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3145/3913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:16 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:16.976612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5435db37-e245-4197-bb23-5405b14fadd7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:16.977981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5435db37-e245-4197-bb23-5405b14fadd7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:16.990544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5435db37-e245-4197-bb23-5405b14fadd7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:16.991001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5435db37-e245-4197-bb23-5405b14fadd7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:16.991793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5435db37-e245-4197-bb23-5405b14fadd7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:16.992227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5435db37-e245-4197-bb23-5405b14fadd7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:17.485834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5435db37-e245-4197-bb23-5405b14fadd7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:17.498839 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5435db37-e245-4197-bb23-5405b14fadd7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1508 microversion: 2.1 time: 0.535716 Mar 12 21:07:17.500413 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3146/3914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:16 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1508 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:17.514383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a0646c9d-18f7-4e62-9457-fa54b16a62af tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:17.515383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a0646c9d-18f7-4e62-9457-fa54b16a62af tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:17.523710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0646c9d-18f7-4e62-9457-fa54b16a62af tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:17.524496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0646c9d-18f7-4e62-9457-fa54b16a62af tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:17.525515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0646c9d-18f7-4e62-9457-fa54b16a62af tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:17.526760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0646c9d-18f7-4e62-9457-fa54b16a62af tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:17.978280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a0646c9d-18f7-4e62-9457-fa54b16a62af tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:17.998525 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a0646c9d-18f7-4e62-9457-fa54b16a62af tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.495724 Mar 12 21:07:18.000329 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3147/3915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:17 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:18.017433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-941212211", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:18.103728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:07:18.665994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:07:18.666423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:07:18.667037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:07:18.667586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:07:18.667989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:07:18.690019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:18.690477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:18.691289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:18.691742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:18.738586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Getting quotas for project e2ea29aba17e41fcac0b47522cf48b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:07:18.745468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Getting quotas for user c5601cc6a01a4c35bceb33df0cad0acc and project e2ea29aba17e41fcac0b47522cf48b4f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:07:18.776968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:07:18.779253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:07:18.856761 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75acb20d-5d0a-47b0-be9a-1d0e3c3e1f74 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.843830 Mar 12 21:07:18.863636 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3148/3916] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:07:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:07:18.868556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a4cce7b7-0652-4869-ab08-e3ebc133cf72 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:18.872756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a4cce7b7-0652-4869-ab08-e3ebc133cf72 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:18.886082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4cce7b7-0652-4869-ab08-e3ebc133cf72 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:18.886708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4cce7b7-0652-4869-ab08-e3ebc133cf72 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:18.887645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4cce7b7-0652-4869-ab08-e3ebc133cf72 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:18.890694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4cce7b7-0652-4869-ab08-e3ebc133cf72 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:19.332650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a4cce7b7-0652-4869-ab08-e3ebc133cf72 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:19.359566 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a4cce7b7-0652-4869-ab08-e3ebc133cf72 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.494462 Mar 12 21:07:19.360548 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3149/3917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:18 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:19.370046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e357b711-cf53-47e6-957e-a1425467d07e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:19.371641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e357b711-cf53-47e6-957e-a1425467d07e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:19.381845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e357b711-cf53-47e6-957e-a1425467d07e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:19.382559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e357b711-cf53-47e6-957e-a1425467d07e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:19.383794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e357b711-cf53-47e6-957e-a1425467d07e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:19.384512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e357b711-cf53-47e6-957e-a1425467d07e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:19.882112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e357b711-cf53-47e6-957e-a1425467d07e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:19.908954 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e357b711-cf53-47e6-957e-a1425467d07e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1508 microversion: 2.1 time: 0.547104 Mar 12 21:07:19.913542 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3150/3918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:19 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1508 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:19.924880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-65af4e6d-4ff6-4c9a-be3e-c1f676c6f4e8 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:19.925578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-65af4e6d-4ff6-4c9a-be3e-c1f676c6f4e8 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:19.949990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65af4e6d-4ff6-4c9a-be3e-c1f676c6f4e8 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:19.950679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65af4e6d-4ff6-4c9a-be3e-c1f676c6f4e8 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:19.951644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65af4e6d-4ff6-4c9a-be3e-c1f676c6f4e8 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:19.952228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65af4e6d-4ff6-4c9a-be3e-c1f676c6f4e8 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:20.172342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-65af4e6d-4ff6-4c9a-be3e-c1f676c6f4e8 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5601cc6a01a4c35bceb33df0cad0acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ea29aba17e41fcac0b47522cf48b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:20.185201 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-65af4e6d-4ff6-4c9a-be3e-c1f676c6f4e8 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7" status: 200 len: 1209 microversion: 2.1 time: 0.268448 Mar 12 21:07:20.189992 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3151/3919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:19 2022] GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7 => generated 1209 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:20.197481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b162405-fdc7-4550-9e2f-76f6e2bb29ec tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:20.206687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b162405-fdc7-4550-9e2f-76f6e2bb29ec tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:20.213625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b162405-fdc7-4550-9e2f-76f6e2bb29ec tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:20.214116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b162405-fdc7-4550-9e2f-76f6e2bb29ec tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:20.215947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b162405-fdc7-4550-9e2f-76f6e2bb29ec tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:20.215947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b162405-fdc7-4550-9e2f-76f6e2bb29ec tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:21.033885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b162405-fdc7-4550-9e2f-76f6e2bb29ec tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:21.045459 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b162405-fdc7-4550-9e2f-76f6e2bb29ec tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.854234 Mar 12 21:07:21.046295 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3152/3920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:20 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:21.051689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fe962510-1430-446e-9314-2d08b479859a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:21.052465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fe962510-1430-446e-9314-2d08b479859a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:21.062301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe962510-1430-446e-9314-2d08b479859a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:21.062845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe962510-1430-446e-9314-2d08b479859a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:21.063629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe962510-1430-446e-9314-2d08b479859a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:21.064069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe962510-1430-446e-9314-2d08b479859a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:21.307273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fe962510-1430-446e-9314-2d08b479859a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:21.315362 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fe962510-1430-446e-9314-2d08b479859a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1508 microversion: 2.1 time: 0.267853 Mar 12 21:07:21.316285 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3153/3921] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:21 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:21.327638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-206d3f8a-abbf-47fb-9401-6792b9330489 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:21.328196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-206d3f8a-abbf-47fb-9401-6792b9330489 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:21.334809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206d3f8a-abbf-47fb-9401-6792b9330489 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:21.335172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206d3f8a-abbf-47fb-9401-6792b9330489 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:21.336182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206d3f8a-abbf-47fb-9401-6792b9330489 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:21.337268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206d3f8a-abbf-47fb-9401-6792b9330489 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:21.362553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-206d3f8a-abbf-47fb-9401-6792b9330489 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lazy-loading 'flavor' on Instance uuid e537d16d-478d-4375-a61a-c28f8a785539 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:07:21.437424 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-206d3f8a-abbf-47fb-9401-6792b9330489 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.119464 Mar 12 21:07:21.442257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3154/3922] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:07:21 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:07:21.448905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e987749b-6cb3-44d2-b24d-42f5a05c9b7c tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:21.449815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e987749b-6cb3-44d2-b24d-42f5a05c9b7c tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:21.458438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e987749b-6cb3-44d2-b24d-42f5a05c9b7c tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:21.458746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e987749b-6cb3-44d2-b24d-42f5a05c9b7c tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:21.460058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e987749b-6cb3-44d2-b24d-42f5a05c9b7c tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:21.460058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e987749b-6cb3-44d2-b24d-42f5a05c9b7c tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:21.550152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e987749b-6cb3-44d2-b24d-42f5a05c9b7c tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5601cc6a01a4c35bceb33df0cad0acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ea29aba17e41fcac0b47522cf48b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:21.560803 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e987749b-6cb3-44d2-b24d-42f5a05c9b7c tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7" status: 200 len: 1271 microversion: 2.1 time: 0.116426 Mar 12 21:07:21.562108 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3155/3923] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:21 2022] GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7 => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:21.567202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b3e7db4-b985-4471-9a1a-77c5b7ef11f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:21.567810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3b3e7db4-b985-4471-9a1a-77c5b7ef11f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:21.574997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b3e7db4-b985-4471-9a1a-77c5b7ef11f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:21.575456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b3e7db4-b985-4471-9a1a-77c5b7ef11f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:21.576233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b3e7db4-b985-4471-9a1a-77c5b7ef11f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:21.577155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b3e7db4-b985-4471-9a1a-77c5b7ef11f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:21.838206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3b3e7db4-b985-4471-9a1a-77c5b7ef11f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:21.847222 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b3e7db4-b985-4471-9a1a-77c5b7ef11f9 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1678 microversion: 2.1 time: 0.283894 Mar 12 21:07:21.866433 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3156/3924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:21 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1678 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:22.333458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2fb1776e-2bb0-4b01-8015-17c29d6ee5da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:22.335061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2fb1776e-2bb0-4b01-8015-17c29d6ee5da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:22.345705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fb1776e-2bb0-4b01-8015-17c29d6ee5da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:22.348839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fb1776e-2bb0-4b01-8015-17c29d6ee5da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:22.349879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fb1776e-2bb0-4b01-8015-17c29d6ee5da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:22.350559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fb1776e-2bb0-4b01-8015-17c29d6ee5da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:22.837497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2fb1776e-2bb0-4b01-8015-17c29d6ee5da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:22.849890 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2fb1776e-2bb0-4b01-8015-17c29d6ee5da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1508 microversion: 2.1 time: 0.521154 Mar 12 21:07:22.850669 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3157/3925] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:22 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1508 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:22.857288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1ce4e63b-1ab6-48b3-8fcf-27e00560061e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:22.859780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1ce4e63b-1ab6-48b3-8fcf-27e00560061e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:22.869480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ce4e63b-1ab6-48b3-8fcf-27e00560061e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:22.870375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ce4e63b-1ab6-48b3-8fcf-27e00560061e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:22.871328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ce4e63b-1ab6-48b3-8fcf-27e00560061e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:22.871917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ce4e63b-1ab6-48b3-8fcf-27e00560061e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:23.000836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1ce4e63b-1ab6-48b3-8fcf-27e00560061e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5601cc6a01a4c35bceb33df0cad0acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ea29aba17e41fcac0b47522cf48b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:23.008807 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1ce4e63b-1ab6-48b3-8fcf-27e00560061e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7" status: 200 len: 1271 microversion: 2.1 time: 0.155781 Mar 12 21:07:23.009611 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3158/3926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:22 2022] GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:23.014304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-18891bd8-b3f1-468d-b69b-9ff546b8f662 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:23.015072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-18891bd8-b3f1-468d-b69b-9ff546b8f662 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:23.021338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18891bd8-b3f1-468d-b69b-9ff546b8f662 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:23.022040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18891bd8-b3f1-468d-b69b-9ff546b8f662 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:23.022975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18891bd8-b3f1-468d-b69b-9ff546b8f662 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:23.023565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18891bd8-b3f1-468d-b69b-9ff546b8f662 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:23.679688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-18891bd8-b3f1-468d-b69b-9ff546b8f662 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:23.693249 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-18891bd8-b3f1-468d-b69b-9ff546b8f662 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1661 microversion: 2.1 time: 0.682414 Mar 12 21:07:23.693874 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3159/3927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:23 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1661 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:23.712172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-78acdc68-2074-478b-8e21-4d4b3ef1e886 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:23.712953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-78acdc68-2074-478b-8e21-4d4b3ef1e886 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:23.724259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78acdc68-2074-478b-8e21-4d4b3ef1e886 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:23.727625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78acdc68-2074-478b-8e21-4d4b3ef1e886 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:23.728628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78acdc68-2074-478b-8e21-4d4b3ef1e886 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:23.729521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78acdc68-2074-478b-8e21-4d4b3ef1e886 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:23.838068 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-78acdc68-2074-478b-8e21-4d4b3ef1e886 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action" status: 202 len: 0 microversion: 2.1 time: 0.131734 Mar 12 21:07:23.839185 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3160/3928] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:07:23 2022] POST /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:07:23.850405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6e7cc060-a8ee-4b95-aa4c-a1826974c217 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:23.851575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6e7cc060-a8ee-4b95-aa4c-a1826974c217 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:23.862573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e7cc060-a8ee-4b95-aa4c-a1826974c217 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:23.864794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e7cc060-a8ee-4b95-aa4c-a1826974c217 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:23.866486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e7cc060-a8ee-4b95-aa4c-a1826974c217 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:23.867298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e7cc060-a8ee-4b95-aa4c-a1826974c217 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:24.769112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6e7cc060-a8ee-4b95-aa4c-a1826974c217 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:24.778065 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6e7cc060-a8ee-4b95-aa4c-a1826974c217 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1667 microversion: 2.1 time: 0.933093 Mar 12 21:07:24.778823 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3161/3929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:23 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1667 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:24.793273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-673f2411-857e-463c-a355-eadf54a4177d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:24.793848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-673f2411-857e-463c-a355-eadf54a4177d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:24.800562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-673f2411-857e-463c-a355-eadf54a4177d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:24.801015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-673f2411-857e-463c-a355-eadf54a4177d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:24.801807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-673f2411-857e-463c-a355-eadf54a4177d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:24.802252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-673f2411-857e-463c-a355-eadf54a4177d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:25.344709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-673f2411-857e-463c-a355-eadf54a4177d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:25.362630 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-673f2411-857e-463c-a355-eadf54a4177d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1508 microversion: 2.1 time: 0.572838 Mar 12 21:07:25.363658 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3162/3930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:24 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1508 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:25.372618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bafd6cbc-54e7-4b43-826f-26bbae646067 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:25.373975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bafd6cbc-54e7-4b43-826f-26bbae646067 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:25.383300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bafd6cbc-54e7-4b43-826f-26bbae646067 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:25.383840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bafd6cbc-54e7-4b43-826f-26bbae646067 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:25.384711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bafd6cbc-54e7-4b43-826f-26bbae646067 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:25.385232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bafd6cbc-54e7-4b43-826f-26bbae646067 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:25.783232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bafd6cbc-54e7-4b43-826f-26bbae646067 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5601cc6a01a4c35bceb33df0cad0acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ea29aba17e41fcac0b47522cf48b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:25.795696 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bafd6cbc-54e7-4b43-826f-26bbae646067 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7" status: 200 len: 1313 microversion: 2.1 time: 0.430216 Mar 12 21:07:25.805715 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3163/3931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:25 2022] GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:25.811192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8b2aaa0f-1b85-4b5f-9a0b-a699d504c48f req-13a02cce-b161-40ef-9180-bd38e3d8cb01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d2cee8c-6861-4351-ab79-f09a546da6a7", "tag": "21b9b4b6-c394-4843-ac40-7b06bcb27ab4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:25.865314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8b2aaa0f-1b85-4b5f-9a0b-a699d504c48f req-13a02cce-b161-40ef-9180-bd38e3d8cb01 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:25.865959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8b2aaa0f-1b85-4b5f-9a0b-a699d504c48f req-13a02cce-b161-40ef-9180-bd38e3d8cb01 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:25.879508 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8b2aaa0f-1b85-4b5f-9a0b-a699d504c48f req-13a02cce-b161-40ef-9180-bd38e3d8cb01 service nova] Creating event network-changed:21b9b4b6-c394-4843-ac40-7b06bcb27ab4 for instance 2d2cee8c-6861-4351-ab79-f09a546da6a7 on nch1-master-1 Mar 12 21:07:25.885519 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8b2aaa0f-1b85-4b5f-9a0b-a699d504c48f req-13a02cce-b161-40ef-9180-bd38e3d8cb01 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078206 Mar 12 21:07:25.886388 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3164/3932] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:07:25.892247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3857d1eb-f1e7-4c57-be5c-331b112511a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:25.893958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3857d1eb-f1e7-4c57-be5c-331b112511a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:25.905001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3857d1eb-f1e7-4c57-be5c-331b112511a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:25.905175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3857d1eb-f1e7-4c57-be5c-331b112511a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:25.905896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3857d1eb-f1e7-4c57-be5c-331b112511a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:25.906379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3857d1eb-f1e7-4c57-be5c-331b112511a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:26.269388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3857d1eb-f1e7-4c57-be5c-331b112511a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:26.280522 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3857d1eb-f1e7-4c57-be5c-331b112511a2 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1667 microversion: 2.1 time: 0.390254 Mar 12 21:07:26.294336 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3165/3933] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:25 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1667 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:26.384429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ab15346-31eb-4434-8f62-9f7ee51e26ee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:26.386326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8ab15346-31eb-4434-8f62-9f7ee51e26ee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:26.404066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ab15346-31eb-4434-8f62-9f7ee51e26ee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:26.405087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ab15346-31eb-4434-8f62-9f7ee51e26ee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:26.410151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ab15346-31eb-4434-8f62-9f7ee51e26ee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:26.414215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ab15346-31eb-4434-8f62-9f7ee51e26ee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:27.079264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ab15346-31eb-4434-8f62-9f7ee51e26ee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:27.093628 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ab15346-31eb-4434-8f62-9f7ee51e26ee tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1508 microversion: 2.1 time: 0.716281 Mar 12 21:07:27.094278 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3166/3934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:26 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1508 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:27.113010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f22758c-38a6-480a-8980-692e930c2c31 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:27.113695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4f22758c-38a6-480a-8980-692e930c2c31 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:27.120303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f22758c-38a6-480a-8980-692e930c2c31 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:27.120993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f22758c-38a6-480a-8980-692e930c2c31 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:27.121957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f22758c-38a6-480a-8980-692e930c2c31 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:27.122539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f22758c-38a6-480a-8980-692e930c2c31 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:27.577370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4f22758c-38a6-480a-8980-692e930c2c31 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5601cc6a01a4c35bceb33df0cad0acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ea29aba17e41fcac0b47522cf48b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:27.588664 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4f22758c-38a6-480a-8980-692e930c2c31 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7" status: 200 len: 1313 microversion: 2.1 time: 0.479404 Mar 12 21:07:27.600588 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3167/3935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:27 2022] GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:27.608009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-06c5fddb-457e-4e90-aedc-dc6d94f0f106 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:27.608877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-06c5fddb-457e-4e90-aedc-dc6d94f0f106 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:27.619491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06c5fddb-457e-4e90-aedc-dc6d94f0f106 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:27.620880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06c5fddb-457e-4e90-aedc-dc6d94f0f106 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:27.622479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06c5fddb-457e-4e90-aedc-dc6d94f0f106 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:27.623387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06c5fddb-457e-4e90-aedc-dc6d94f0f106 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:27.816606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-06c5fddb-457e-4e90-aedc-dc6d94f0f106 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:27.826758 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-06c5fddb-457e-4e90-aedc-dc6d94f0f106 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.223770 Mar 12 21:07:27.828000 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3168/3936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:27 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:27.850026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0498d31d-dbb6-4f54-8c74-b9f194b73396 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:27.850659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0498d31d-dbb6-4f54-8c74-b9f194b73396 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:27.862866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0498d31d-dbb6-4f54-8c74-b9f194b73396 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:27.863560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0498d31d-dbb6-4f54-8c74-b9f194b73396 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:27.864399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0498d31d-dbb6-4f54-8c74-b9f194b73396 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:27.864993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0498d31d-dbb6-4f54-8c74-b9f194b73396 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:28.353596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0498d31d-dbb6-4f54-8c74-b9f194b73396 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:28.366246 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0498d31d-dbb6-4f54-8c74-b9f194b73396 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1670 microversion: 2.1 time: 0.521185 Mar 12 21:07:28.370674 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3169/3937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:27 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1670 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:28.383614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9d3f1994-1ce7-44bb-a41e-937d9d92f914 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:28.384508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9d3f1994-1ce7-44bb-a41e-937d9d92f914 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:28.399985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d3f1994-1ce7-44bb-a41e-937d9d92f914 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:28.403105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d3f1994-1ce7-44bb-a41e-937d9d92f914 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:28.404120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d3f1994-1ce7-44bb-a41e-937d9d92f914 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:28.405183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d3f1994-1ce7-44bb-a41e-937d9d92f914 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:28.725453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9d3f1994-1ce7-44bb-a41e-937d9d92f914 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:28.736863 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9d3f1994-1ce7-44bb-a41e-937d9d92f914 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1508 microversion: 2.1 time: 0.364712 Mar 12 21:07:28.737491 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3170/3938] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:28 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1508 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:28.763939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:28.764901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:28.776032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:28.778294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:28.779966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:28.780745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:28.812140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:07:28.820092 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.api [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Working on deleting snapshot f3d74d86-1131-46fe-a24f-0dc356fb96ca from shelved instance... Mar 12 21:07:30.310130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Doing local delete in cell 4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) {{(pid=136302) _delete /opt/stack/nova/nova/compute/api.py:2489}} Mar 12 21:07:30.312060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:30.312666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:30.314551 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.api [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Mar 12 21:07:30.323264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] deallocate_for_instance() {{(pid=136302) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Mar 12 21:07:33.073849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Updating instance_info_cache with network_info: [] {{(pid=136302) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 12 21:07:34.064189 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9cd38e76-9388-4ea6-825c-05d2330b8d9a tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 204 len: 0 microversion: 2.1 time: 5.309880 Mar 12 21:07:34.064781 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3171/3939] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:07:28 2022] DELETE /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 0 bytes in 5327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:07:34.075271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7e706407-5e90-4bd0-88e5-25ed2c85237e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:34.076571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7e706407-5e90-4bd0-88e5-25ed2c85237e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:34.093456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e706407-5e90-4bd0-88e5-25ed2c85237e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:34.093948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e706407-5e90-4bd0-88e5-25ed2c85237e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:34.094726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e706407-5e90-4bd0-88e5-25ed2c85237e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:34.095180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e706407-5e90-4bd0-88e5-25ed2c85237e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:34.563451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7e706407-5e90-4bd0-88e5-25ed2c85237e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5601cc6a01a4c35bceb33df0cad0acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ea29aba17e41fcac0b47522cf48b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:34.579576 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7e706407-5e90-4bd0-88e5-25ed2c85237e tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7" status: 200 len: 1313 microversion: 2.1 time: 0.510249 Mar 12 21:07:34.582322 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3172/3940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:34 2022] GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7 => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:34.600973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2db24b2-a0c9-4281-8cad-34f579179128 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:34.602016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2db24b2-a0c9-4281-8cad-34f579179128 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:34.612126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2db24b2-a0c9-4281-8cad-34f579179128 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:34.613365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2db24b2-a0c9-4281-8cad-34f579179128 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:34.614584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2db24b2-a0c9-4281-8cad-34f579179128 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:34.615361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2db24b2-a0c9-4281-8cad-34f579179128 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:34.904719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e2db24b2-a0c9-4281-8cad-34f579179128 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:34.914183 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2db24b2-a0c9-4281-8cad-34f579179128 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1529 microversion: 2.1 time: 0.330068 Mar 12 21:07:34.915897 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3173/3941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:34 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1529 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:34.924339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6e1008dd-e304-4dc3-a78c-5bdbe57a8b1c req-1003dfc9-2e38-477d-bae3-662b6d34a92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d2cee8c-6861-4351-ab79-f09a546da6a7", "name": "network-vif-plugged", "status": "completed", "tag": "21b9b4b6-c394-4843-ac40-7b06bcb27ab4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:34.940715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6e1008dd-e304-4dc3-a78c-5bdbe57a8b1c req-1003dfc9-2e38-477d-bae3-662b6d34a92b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:34.941163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6e1008dd-e304-4dc3-a78c-5bdbe57a8b1c req-1003dfc9-2e38-477d-bae3-662b6d34a92b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:34.954541 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6e1008dd-e304-4dc3-a78c-5bdbe57a8b1c req-1003dfc9-2e38-477d-bae3-662b6d34a92b service nova] Creating event network-vif-plugged:21b9b4b6-c394-4843-ac40-7b06bcb27ab4 for instance 2d2cee8c-6861-4351-ab79-f09a546da6a7 on nch1-master-1 Mar 12 21:07:34.960015 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6e1008dd-e304-4dc3-a78c-5bdbe57a8b1c req-1003dfc9-2e38-477d-bae3-662b6d34a92b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039740 Mar 12 21:07:34.961254 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3174/3942] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:07:34.968387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6125b641-8630-424f-9bf2-4237d771ddb9 req-334d781a-c369-4de9-a1b0-b7b6c31ed17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52f6788-3a66-4ba4-a31a-9aaab1d05ba1", "name": "network-vif-deleted", "tag": "7295f7e8-0ece-4f4a-bd06-2446d6571980"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:34.980075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6125b641-8630-424f-9bf2-4237d771ddb9 req-334d781a-c369-4de9-a1b0-b7b6c31ed17b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:34.980743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6125b641-8630-424f-9bf2-4237d771ddb9 req-334d781a-c369-4de9-a1b0-b7b6c31ed17b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:35.010832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.compute.server_external_events [req-6125b641-8630-424f-9bf2-4237d771ddb9 req-334d781a-c369-4de9-a1b0-b7b6c31ed17b service nova] Unable to find a host for instance f52f6788-3a66-4ba4-a31a-9aaab1d05ba1. Dropping event network-vif-deleted {{(pid=136302) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 12 21:07:35.011807 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6125b641-8630-424f-9bf2-4237d771ddb9 req-334d781a-c369-4de9-a1b0-b7b6c31ed17b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.049166 Mar 12 21:07:35.013509 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3175/3943] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 12 21:07:35.020771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3a7a6e23-1d71-43a1-8b50-a2fab868beae tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:35.021528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3a7a6e23-1d71-43a1-8b50-a2fab868beae tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: f52f6788-3a66-4ba4-a31a-9aaab1d05ba1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:35.027931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a7a6e23-1d71-43a1-8b50-a2fab868beae tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:35.028795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a7a6e23-1d71-43a1-8b50-a2fab868beae tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:35.029731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a7a6e23-1d71-43a1-8b50-a2fab868beae tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:35.030352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a7a6e23-1d71-43a1-8b50-a2fab868beae tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:35.044949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3a7a6e23-1d71-43a1-8b50-a2fab868beae tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] HTTP exception thrown: Instance f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 could not be found. Mar 12 21:07:35.045597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3a7a6e23-1d71-43a1-8b50-a2fab868beae tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Returning 404 to user: Instance f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:07:35.046485 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3a7a6e23-1d71-43a1-8b50-a2fab868beae tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1" status: 404 len: 111 microversion: 2.1 time: 0.031903 Mar 12 21:07:35.047515 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3176/3944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:35 2022] GET /compute/v2.1/servers/f52f6788-3a66-4ba4-a31a-9aaab1d05ba1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:07:35.062308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e8d6be65-dbe1-45b6-bda0-d7ab25acd812 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:35.062943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e8d6be65-dbe1-45b6-bda0-d7ab25acd812 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:35.071730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8d6be65-dbe1-45b6-bda0-d7ab25acd812 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:35.072449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8d6be65-dbe1-45b6-bda0-d7ab25acd812 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:35.073455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8d6be65-dbe1-45b6-bda0-d7ab25acd812 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:35.074435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8d6be65-dbe1-45b6-bda0-d7ab25acd812 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:35.111383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e8d6be65-dbe1-45b6-bda0-d7ab25acd812 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:07:35.244001 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e8d6be65-dbe1-45b6-bda0-d7ab25acd812 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 204 len: 0 microversion: 2.1 time: 0.187722 Mar 12 21:07:35.248117 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3177/3945] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:07:35 2022] DELETE /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:07:35.256564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4f02d39-8f12-47cb-b726-73d7d8df1ef5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:35.257701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b4f02d39-8f12-47cb-b726-73d7d8df1ef5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:35.270903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4f02d39-8f12-47cb-b726-73d7d8df1ef5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:35.272299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4f02d39-8f12-47cb-b726-73d7d8df1ef5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:35.273679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4f02d39-8f12-47cb-b726-73d7d8df1ef5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:35.274618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4f02d39-8f12-47cb-b726-73d7d8df1ef5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:35.500148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b4f02d39-8f12-47cb-b726-73d7d8df1ef5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:35.507983 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b4f02d39-8f12-47cb-b726-73d7d8df1ef5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1466 microversion: 2.1 time: 0.258451 Mar 12 21:07:35.517881 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3178/3946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:35 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1466 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:35.606110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4fae6266-509e-408f-a287-496ef85d63f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:35.607209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4fae6266-509e-408f-a287-496ef85d63f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:35.619056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fae6266-509e-408f-a287-496ef85d63f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:35.619826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fae6266-509e-408f-a287-496ef85d63f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:35.621907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fae6266-509e-408f-a287-496ef85d63f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:35.622641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fae6266-509e-408f-a287-496ef85d63f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:35.939384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4fae6266-509e-408f-a287-496ef85d63f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5601cc6a01a4c35bceb33df0cad0acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ea29aba17e41fcac0b47522cf48b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:35.951678 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4fae6266-509e-408f-a287-496ef85d63f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7" status: 200 len: 1313 microversion: 2.1 time: 0.356328 Mar 12 21:07:35.962815 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3179/3947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:35 2022] GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:35.968223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ac7626d-fe42-4691-9b22-5a8a27e64607 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:35.969875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5ac7626d-fe42-4691-9b22-5a8a27e64607 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:35.977437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ac7626d-fe42-4691-9b22-5a8a27e64607 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:35.978141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ac7626d-fe42-4691-9b22-5a8a27e64607 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:35.979414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ac7626d-fe42-4691-9b22-5a8a27e64607 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:35.980071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ac7626d-fe42-4691-9b22-5a8a27e64607 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:36.337676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5ac7626d-fe42-4691-9b22-5a8a27e64607 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:36.356165 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ac7626d-fe42-4691-9b22-5a8a27e64607 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1529 microversion: 2.1 time: 0.391701 Mar 12 21:07:36.358015 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3180/3948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:35 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1529 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:36.525599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bce4ad21-0a3c-4ec1-ae30-76357a29083e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:36.526668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bce4ad21-0a3c-4ec1-ae30-76357a29083e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:36.537192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bce4ad21-0a3c-4ec1-ae30-76357a29083e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:36.538613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bce4ad21-0a3c-4ec1-ae30-76357a29083e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:36.542826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bce4ad21-0a3c-4ec1-ae30-76357a29083e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:36.545023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bce4ad21-0a3c-4ec1-ae30-76357a29083e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:36.847487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bce4ad21-0a3c-4ec1-ae30-76357a29083e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:36.863930 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bce4ad21-0a3c-4ec1-ae30-76357a29083e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1466 microversion: 2.1 time: 0.343269 Mar 12 21:07:36.876210 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3181/3949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:36 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1466 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:36.974584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-91cfc0e0-910d-43f4-aea0-b3a1cdb87f77 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:36.979933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-91cfc0e0-910d-43f4-aea0-b3a1cdb87f77 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:36.994106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91cfc0e0-910d-43f4-aea0-b3a1cdb87f77 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:36.996165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91cfc0e0-910d-43f4-aea0-b3a1cdb87f77 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:36.997555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91cfc0e0-910d-43f4-aea0-b3a1cdb87f77 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:37.000237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91cfc0e0-910d-43f4-aea0-b3a1cdb87f77 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:37.637436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-91cfc0e0-910d-43f4-aea0-b3a1cdb87f77 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5601cc6a01a4c35bceb33df0cad0acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ea29aba17e41fcac0b47522cf48b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:37.645097 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-91cfc0e0-910d-43f4-aea0-b3a1cdb87f77 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7" status: 200 len: 1463 microversion: 2.1 time: 0.677445 Mar 12 21:07:37.651169 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3182/3950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:36 2022] GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7 => generated 1463 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:37.657982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b31bc3d-d6fe-49ee-aa29-59fd59decd08 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:37.658752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b31bc3d-d6fe-49ee-aa29-59fd59decd08 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:37.673353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b31bc3d-d6fe-49ee-aa29-59fd59decd08 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:37.677881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b31bc3d-d6fe-49ee-aa29-59fd59decd08 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:37.678880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b31bc3d-d6fe-49ee-aa29-59fd59decd08 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:37.679352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b31bc3d-d6fe-49ee-aa29-59fd59decd08 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:38.864296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b31bc3d-d6fe-49ee-aa29-59fd59decd08 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:38.878251 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b31bc3d-d6fe-49ee-aa29-59fd59decd08 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 1.225611 Mar 12 21:07:38.879391 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3183/3951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:37 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:38.904288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f7976f4-aee8-4831-981d-f7b10214eaf0 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d219623-5b71-4651-9d9b-3c7aadd4b36f", "device": "/dev/sdb"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:38.906257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f7976f4-aee8-4831-981d-f7b10214eaf0 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:38.915315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f7976f4-aee8-4831-981d-f7b10214eaf0 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:38.915807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f7976f4-aee8-4831-981d-f7b10214eaf0 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:38.916594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f7976f4-aee8-4831-981d-f7b10214eaf0 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:38.932301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f7976f4-aee8-4831-981d-f7b10214eaf0 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:39.612949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f7976f4-aee8-4831-981d-f7b10214eaf0 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "POST /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729521 Mar 12 21:07:39.631767 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3184/3952] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:07:38 2022] POST /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:07:39.655682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6fdfad5e-5a4f-4bbb-8467-a692388ddc86 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:39.657540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6fdfad5e-5a4f-4bbb-8467-a692388ddc86 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:39.676246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fdfad5e-5a4f-4bbb-8467-a692388ddc86 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:39.677265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fdfad5e-5a4f-4bbb-8467-a692388ddc86 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:39.678488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fdfad5e-5a4f-4bbb-8467-a692388ddc86 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:39.680970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fdfad5e-5a4f-4bbb-8467-a692388ddc86 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:39.765725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fdfad5e-5a4f-4bbb-8467-a692388ddc86 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:39.767012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fdfad5e-5a4f-4bbb-8467-a692388ddc86 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:39.767704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-6fdfad5e-5a4f-4bbb-8467-a692388ddc86 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lazy-loading 'fault' on Instance uuid e5b2f963-92f2-4be3-ae29-aabc42f1ad7f {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:07:39.889167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6fdfad5e-5a4f-4bbb-8467-a692388ddc86 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:39.897908 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6fdfad5e-5a4f-4bbb-8467-a692388ddc86 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 200 len: 1305 microversion: 2.1 time: 0.261307 Mar 12 21:07:39.903347 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3185/3953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:39 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 1305 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:39.925239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-32db2fc4-7baf-4257-b11c-a883c21fc736 req-5c36d484-64a4-434c-8bf2-d7cfa1cbed13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e4dbc9-e3c3-45e5-9d41-0b27844bc172", "name": "network-vif-plugged", "status": "completed", "tag": "fcb6ffc3-d6b9-48e7-83a1-e9a6b02cb3d9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:39.960564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-32db2fc4-7baf-4257-b11c-a883c21fc736 req-5c36d484-64a4-434c-8bf2-d7cfa1cbed13 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:39.962963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-32db2fc4-7baf-4257-b11c-a883c21fc736 req-5c36d484-64a4-434c-8bf2-d7cfa1cbed13 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:40.011115 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-32db2fc4-7baf-4257-b11c-a883c21fc736 req-5c36d484-64a4-434c-8bf2-d7cfa1cbed13 service nova] Creating event network-vif-plugged:fcb6ffc3-d6b9-48e7-83a1-e9a6b02cb3d9 for instance c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 on nch2-master-1 Mar 12 21:07:40.036893 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-32db2fc4-7baf-4257-b11c-a883c21fc736 req-5c36d484-64a4-434c-8bf2-d7cfa1cbed13 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125515 Mar 12 21:07:40.038279 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3186/3954] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:07:40.054215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a209d665-f5b5-41f7-a04c-3d1242b4f6fe req-6181d5a5-588f-4df8-9f51-fe1d0ff0c220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b2f963-92f2-4be3-ae29-aabc42f1ad7f", "name": "network-vif-deleted", "tag": "e0f8a6c5-ee4e-4058-8488-fbe4df28822f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:40.066196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a209d665-f5b5-41f7-a04c-3d1242b4f6fe req-6181d5a5-588f-4df8-9f51-fe1d0ff0c220 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:40.067020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a209d665-f5b5-41f7-a04c-3d1242b4f6fe req-6181d5a5-588f-4df8-9f51-fe1d0ff0c220 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:40.099591 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a209d665-f5b5-41f7-a04c-3d1242b4f6fe req-6181d5a5-588f-4df8-9f51-fe1d0ff0c220 service nova] Creating event network-vif-deleted:e0f8a6c5-ee4e-4058-8488-fbe4df28822f for instance e5b2f963-92f2-4be3-ae29-aabc42f1ad7f on nch2-master-1 Mar 12 21:07:40.120150 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a209d665-f5b5-41f7-a04c-3d1242b4f6fe req-6181d5a5-588f-4df8-9f51-fe1d0ff0c220 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070110 Mar 12 21:07:40.120784 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3187/3955] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:07:40.146721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51085f53-6fb9-4e1a-8324-1291fabf6be0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:40.147425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51085f53-6fb9-4e1a-8324-1291fabf6be0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:40.164269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51085f53-6fb9-4e1a-8324-1291fabf6be0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:40.175174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51085f53-6fb9-4e1a-8324-1291fabf6be0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:40.177064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51085f53-6fb9-4e1a-8324-1291fabf6be0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:40.177676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51085f53-6fb9-4e1a-8324-1291fabf6be0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:40.597328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51085f53-6fb9-4e1a-8324-1291fabf6be0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:40.605867 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51085f53-6fb9-4e1a-8324-1291fabf6be0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 0.468960 Mar 12 21:07:40.618276 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3188/3956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:40 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:40.920529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-17ea6ca0-f5a0-409f-9d4d-54d8077a7440 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:40.921465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-17ea6ca0-f5a0-409f-9d4d-54d8077a7440 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e5b2f963-92f2-4be3-ae29-aabc42f1ad7f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:40.927427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17ea6ca0-f5a0-409f-9d4d-54d8077a7440 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:40.927882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17ea6ca0-f5a0-409f-9d4d-54d8077a7440 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:40.928662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17ea6ca0-f5a0-409f-9d4d-54d8077a7440 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:40.929096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17ea6ca0-f5a0-409f-9d4d-54d8077a7440 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:40.998555 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-17ea6ca0-f5a0-409f-9d4d-54d8077a7440 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] HTTP exception thrown: Instance e5b2f963-92f2-4be3-ae29-aabc42f1ad7f could not be found. Mar 12 21:07:41.008779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-17ea6ca0-f5a0-409f-9d4d-54d8077a7440 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Returning 404 to user: Instance e5b2f963-92f2-4be3-ae29-aabc42f1ad7f could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:07:41.013418 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-17ea6ca0-f5a0-409f-9d4d-54d8077a7440 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f" status: 404 len: 111 microversion: 2.1 time: 0.096709 Mar 12 21:07:41.025689 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3189/3957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:40 2022] GET /compute/v2.1/servers/e5b2f963-92f2-4be3-ae29-aabc42f1ad7f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:07:41.052287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ae9e6ec-cb6d-4671-b9f3-6b07dcba2a2c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:41.056203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ae9e6ec-cb6d-4671-b9f3-6b07dcba2a2c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:41.079634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ae9e6ec-cb6d-4671-b9f3-6b07dcba2a2c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:41.080326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ae9e6ec-cb6d-4671-b9f3-6b07dcba2a2c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:41.089303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ae9e6ec-cb6d-4671-b9f3-6b07dcba2a2c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:41.091609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ae9e6ec-cb6d-4671-b9f3-6b07dcba2a2c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:41.182052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ae9e6ec-cb6d-4671-b9f3-6b07dcba2a2c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:07:41.458968 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ae9e6ec-cb6d-4671-b9f3-6b07dcba2a2c tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "DELETE /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 204 len: 0 microversion: 2.1 time: 0.429195 Mar 12 21:07:41.460199 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3190/3958] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:07:41 2022] DELETE /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:07:41.471354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e6d77e20-f9eb-4e40-b201-9be0f98ac564 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:41.472301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e6d77e20-f9eb-4e40-b201-9be0f98ac564 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:41.492717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6d77e20-f9eb-4e40-b201-9be0f98ac564 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:41.493686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6d77e20-f9eb-4e40-b201-9be0f98ac564 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:41.496412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6d77e20-f9eb-4e40-b201-9be0f98ac564 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:41.500282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6d77e20-f9eb-4e40-b201-9be0f98ac564 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:42.385505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e6d77e20-f9eb-4e40-b201-9be0f98ac564 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:42.433571 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e6d77e20-f9eb-4e40-b201-9be0f98ac564 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 200 len: 1508 microversion: 2.1 time: 0.968324 Mar 12 21:07:42.434895 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3191/3959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:41 2022] GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 1508 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:42.492864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5703fc14-e7d7-44f0-9f71-49b92b85f896 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:42.496362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5703fc14-e7d7-44f0-9f71-49b92b85f896 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:42.533965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5703fc14-e7d7-44f0-9f71-49b92b85f896 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:42.538028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5703fc14-e7d7-44f0-9f71-49b92b85f896 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:42.543708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5703fc14-e7d7-44f0-9f71-49b92b85f896 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:42.544622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5703fc14-e7d7-44f0-9f71-49b92b85f896 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:43.044957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5703fc14-e7d7-44f0-9f71-49b92b85f896 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:43.063056 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5703fc14-e7d7-44f0-9f71-49b92b85f896 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 0.603604 Mar 12 21:07:43.070573 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3192/3960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:42 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:43.460874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ecc3c74d-66a2-4606-aaf2-71ce34cb365f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:43.461511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ecc3c74d-66a2-4606-aaf2-71ce34cb365f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:43.480385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecc3c74d-66a2-4606-aaf2-71ce34cb365f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:43.483366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecc3c74d-66a2-4606-aaf2-71ce34cb365f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:43.484382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecc3c74d-66a2-4606-aaf2-71ce34cb365f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:43.486277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecc3c74d-66a2-4606-aaf2-71ce34cb365f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:44.195944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ecc3c74d-66a2-4606-aaf2-71ce34cb365f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:44.210406 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ecc3c74d-66a2-4606-aaf2-71ce34cb365f tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 200 len: 1508 microversion: 2.1 time: 0.747798 Mar 12 21:07:44.216869 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3193/3961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:43 2022] GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 1508 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:44.243694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2e19c145-06ff-430e-a3eb-f13a6296a5a5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:44.244512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2e19c145-06ff-430e-a3eb-f13a6296a5a5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:44.252868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e19c145-06ff-430e-a3eb-f13a6296a5a5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:44.254302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e19c145-06ff-430e-a3eb-f13a6296a5a5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:44.255249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e19c145-06ff-430e-a3eb-f13a6296a5a5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:44.255837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e19c145-06ff-430e-a3eb-f13a6296a5a5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:44.630317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2e19c145-06ff-430e-a3eb-f13a6296a5a5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:44.646525 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2e19c145-06ff-430e-a3eb-f13a6296a5a5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 0.428470 Mar 12 21:07:44.652747 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3194/3962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:44 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:45.233999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e47b8a3b-068a-4a1f-8685-84de70f6168d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:45.235046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e47b8a3b-068a-4a1f-8685-84de70f6168d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:45.248904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e47b8a3b-068a-4a1f-8685-84de70f6168d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:45.253316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e47b8a3b-068a-4a1f-8685-84de70f6168d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:45.254189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e47b8a3b-068a-4a1f-8685-84de70f6168d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:45.254648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e47b8a3b-068a-4a1f-8685-84de70f6168d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:45.520970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e47b8a3b-068a-4a1f-8685-84de70f6168d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:45.537531 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e47b8a3b-068a-4a1f-8685-84de70f6168d tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 200 len: 1466 microversion: 2.1 time: 0.307633 Mar 12 21:07:45.554902 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3195/3963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:45 2022] GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 1466 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:45.667967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-984966a8-fd7f-4532-b7d7-e8715d29fbe1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:45.668616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-984966a8-fd7f-4532-b7d7-e8715d29fbe1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:45.687933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-984966a8-fd7f-4532-b7d7-e8715d29fbe1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:45.688316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-984966a8-fd7f-4532-b7d7-e8715d29fbe1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:45.689114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-984966a8-fd7f-4532-b7d7-e8715d29fbe1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:45.689552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-984966a8-fd7f-4532-b7d7-e8715d29fbe1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:46.638516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-984966a8-fd7f-4532-b7d7-e8715d29fbe1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:46.653624 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-984966a8-fd7f-4532-b7d7-e8715d29fbe1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 0.988235 Mar 12 21:07:46.654369 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3196/3964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:45 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:46.661826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-317af188-17ff-4eda-a949-f5cc96f2c3ed req-80155cae-978c-4507-949d-dd9b98404856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008404bd-cccb-4df6-925f-1b5fd2b25b04", "name": "network-vif-deleted", "tag": "51fd0a73-6532-4ffa-b723-fa81d3e3f852"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:46.689370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-317af188-17ff-4eda-a949-f5cc96f2c3ed req-80155cae-978c-4507-949d-dd9b98404856 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:46.692244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-317af188-17ff-4eda-a949-f5cc96f2c3ed req-80155cae-978c-4507-949d-dd9b98404856 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:46.719569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-317af188-17ff-4eda-a949-f5cc96f2c3ed req-80155cae-978c-4507-949d-dd9b98404856 service nova] Creating event network-vif-deleted:51fd0a73-6532-4ffa-b723-fa81d3e3f852 for instance 008404bd-cccb-4df6-925f-1b5fd2b25b04 on nch1-master-1 Mar 12 21:07:46.734300 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-317af188-17ff-4eda-a949-f5cc96f2c3ed req-80155cae-978c-4507-949d-dd9b98404856 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078210 Mar 12 21:07:46.737873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3197/3965] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:07:46.749068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6bc318dd-9eaa-4f98-b265-855ab29cba20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:46.750859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6bc318dd-9eaa-4f98-b265-855ab29cba20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 008404bd-cccb-4df6-925f-1b5fd2b25b04] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:46.763868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bc318dd-9eaa-4f98-b265-855ab29cba20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:46.766546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bc318dd-9eaa-4f98-b265-855ab29cba20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:46.768488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bc318dd-9eaa-4f98-b265-855ab29cba20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:46.771098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bc318dd-9eaa-4f98-b265-855ab29cba20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:46.799886 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-6bc318dd-9eaa-4f98-b265-855ab29cba20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] HTTP exception thrown: Instance 008404bd-cccb-4df6-925f-1b5fd2b25b04 could not be found. Mar 12 21:07:46.801352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6bc318dd-9eaa-4f98-b265-855ab29cba20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Returning 404 to user: Instance 008404bd-cccb-4df6-925f-1b5fd2b25b04 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:07:46.802850 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6bc318dd-9eaa-4f98-b265-855ab29cba20 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04" status: 404 len: 111 microversion: 2.1 time: 0.063774 Mar 12 21:07:46.811508 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3198/3966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:46 2022] GET /compute/v2.1/servers/008404bd-cccb-4df6-925f-1b5fd2b25b04 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:07:46.821270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b3c9fa41-3263-455f-9083-c8723ce5d2e0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:46.822077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b3c9fa41-3263-455f-9083-c8723ce5d2e0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:46.840256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3c9fa41-3263-455f-9083-c8723ce5d2e0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:46.842314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3c9fa41-3263-455f-9083-c8723ce5d2e0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:46.844094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3c9fa41-3263-455f-9083-c8723ce5d2e0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:46.846481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3c9fa41-3263-455f-9083-c8723ce5d2e0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:46.929029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b3c9fa41-3263-455f-9083-c8723ce5d2e0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:07:47.058442 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b3c9fa41-3263-455f-9083-c8723ce5d2e0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 204 len: 0 microversion: 2.1 time: 0.235039 Mar 12 21:07:47.061435 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3199/3967] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:07:46 2022] DELETE /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:07:47.093182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-439a8a84-6e9a-4f17-8a88-0b21b1cf6561 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:47.100811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-439a8a84-6e9a-4f17-8a88-0b21b1cf6561 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:47.132491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-439a8a84-6e9a-4f17-8a88-0b21b1cf6561 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:47.139901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-439a8a84-6e9a-4f17-8a88-0b21b1cf6561 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:47.143990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-439a8a84-6e9a-4f17-8a88-0b21b1cf6561 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:47.147262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-439a8a84-6e9a-4f17-8a88-0b21b1cf6561 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:48.200101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-439a8a84-6e9a-4f17-8a88-0b21b1cf6561 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:48.208506 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-439a8a84-6e9a-4f17-8a88-0b21b1cf6561 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1495 microversion: 2.1 time: 1.141336 Mar 12 21:07:48.214099 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3200/3968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:47 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1495 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:48.228133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eeff023d-39b4-4a43-bf89-476820a56b2e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:48.229526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eeff023d-39b4-4a43-bf89-476820a56b2e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:48.250115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeff023d-39b4-4a43-bf89-476820a56b2e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:48.255998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeff023d-39b4-4a43-bf89-476820a56b2e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:48.258067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeff023d-39b4-4a43-bf89-476820a56b2e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:48.258675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeff023d-39b4-4a43-bf89-476820a56b2e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:48.972315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eeff023d-39b4-4a43-bf89-476820a56b2e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:48.992872 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eeff023d-39b4-4a43-bf89-476820a56b2e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 0.777401 Mar 12 21:07:49.000681 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3201/3969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:48 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:49.230722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ea15164-bc7d-442c-b37e-c664d93bf8d0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:49.231998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ea15164-bc7d-442c-b37e-c664d93bf8d0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:49.249757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ea15164-bc7d-442c-b37e-c664d93bf8d0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:49.251382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ea15164-bc7d-442c-b37e-c664d93bf8d0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:49.252448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ea15164-bc7d-442c-b37e-c664d93bf8d0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:49.253729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ea15164-bc7d-442c-b37e-c664d93bf8d0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:49.870556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6ea15164-bc7d-442c-b37e-c664d93bf8d0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:49.880360 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ea15164-bc7d-442c-b37e-c664d93bf8d0 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1495 microversion: 2.1 time: 0.655790 Mar 12 21:07:49.886711 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3202/3970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:49 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1495 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:50.019447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3675805b-05e8-4089-b20c-4e3d71808bb2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:50.020208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3675805b-05e8-4089-b20c-4e3d71808bb2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:50.038620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3675805b-05e8-4089-b20c-4e3d71808bb2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:50.039150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3675805b-05e8-4089-b20c-4e3d71808bb2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:50.051153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3675805b-05e8-4089-b20c-4e3d71808bb2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:50.052331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3675805b-05e8-4089-b20c-4e3d71808bb2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:50.783605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3675805b-05e8-4089-b20c-4e3d71808bb2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:50.791790 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3675805b-05e8-4089-b20c-4e3d71808bb2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 0.784367 Mar 12 21:07:50.798549 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3203/3971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:50 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:50.816432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b5a5a678-c284-43b9-b1c5-867a0573c2bc req-714ed4c1-eb4c-47a0-960a-585840e67e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b", "name": "network-vif-deleted", "tag": "9167fcbc-ffb3-4af2-849d-77833a794562"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:50.871743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b5a5a678-c284-43b9-b1c5-867a0573c2bc req-714ed4c1-eb4c-47a0-960a-585840e67e17 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:50.872863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b5a5a678-c284-43b9-b1c5-867a0573c2bc req-714ed4c1-eb4c-47a0-960a-585840e67e17 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:50.914379 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b5a5a678-c284-43b9-b1c5-867a0573c2bc req-714ed4c1-eb4c-47a0-960a-585840e67e17 service nova] Creating event network-vif-deleted:9167fcbc-ffb3-4af2-849d-77833a794562 for instance 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b on nch1-master-1 Mar 12 21:07:50.930595 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b5a5a678-c284-43b9-b1c5-867a0573c2bc req-714ed4c1-eb4c-47a0-960a-585840e67e17 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130524 Mar 12 21:07:50.933041 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3204/3972] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:07:50.945721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-07d0f142-fa2e-4388-8ee5-9643c013e139 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:50.972332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-07d0f142-fa2e-4388-8ee5-9643c013e139 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:50.995551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07d0f142-fa2e-4388-8ee5-9643c013e139 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:50.997752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07d0f142-fa2e-4388-8ee5-9643c013e139 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:51.003332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07d0f142-fa2e-4388-8ee5-9643c013e139 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:51.004285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07d0f142-fa2e-4388-8ee5-9643c013e139 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:51.115594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07d0f142-fa2e-4388-8ee5-9643c013e139 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:51.116509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07d0f142-fa2e-4388-8ee5-9643c013e139 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:51.117538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-07d0f142-fa2e-4388-8ee5-9643c013e139 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lazy-loading 'fault' on Instance uuid 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:07:51.630386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-07d0f142-fa2e-4388-8ee5-9643c013e139 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:51.699030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-07d0f142-fa2e-4388-8ee5-9643c013e139 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 200 len: 1304 microversion: 2.1 time: 0.764141 Mar 12 21:07:51.712061 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3205/3973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:50 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 1304 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:51.816130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-501b420b-f759-4b86-af1b-ed9d392a4ae5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:51.817204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-501b420b-f759-4b86-af1b-ed9d392a4ae5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:51.823522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-501b420b-f759-4b86-af1b-ed9d392a4ae5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:51.828921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-501b420b-f759-4b86-af1b-ed9d392a4ae5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:51.832133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-501b420b-f759-4b86-af1b-ed9d392a4ae5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:51.835484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-501b420b-f759-4b86-af1b-ed9d392a4ae5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:52.612181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-501b420b-f759-4b86-af1b-ed9d392a4ae5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:52.626174 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-501b420b-f759-4b86-af1b-ed9d392a4ae5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 0.814193 Mar 12 21:07:52.627221 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3206/3974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:51 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:52.731771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2d9e4e5-458b-4474-936d-bc940f5bb18e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:52.733362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2d9e4e5-458b-4474-936d-bc940f5bb18e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:52.751456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d9e4e5-458b-4474-936d-bc940f5bb18e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:52.752251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d9e4e5-458b-4474-936d-bc940f5bb18e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:52.753249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d9e4e5-458b-4474-936d-bc940f5bb18e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:52.753920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d9e4e5-458b-4474-936d-bc940f5bb18e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:52.791018 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f2d9e4e5-458b-4474-936d-bc940f5bb18e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] HTTP exception thrown: Instance 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b could not be found. Mar 12 21:07:52.791839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2d9e4e5-458b-4474-936d-bc940f5bb18e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Returning 404 to user: Instance 2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:07:52.792781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2d9e4e5-458b-4474-936d-bc940f5bb18e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b" status: 404 len: 111 microversion: 2.1 time: 0.068039 Mar 12 21:07:52.793751 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3207/3975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:52 2022] GET /compute/v2.1/servers/2c854b50-8d02-4b6d-8bc7-e7b69fd2bf5b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:07:52.807694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0fc2ab4b-7dba-41e5-a9dc-32268023c9a5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:52.808341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0fc2ab4b-7dba-41e5-a9dc-32268023c9a5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:52.822391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fc2ab4b-7dba-41e5-a9dc-32268023c9a5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:52.823028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fc2ab4b-7dba-41e5-a9dc-32268023c9a5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:52.827445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fc2ab4b-7dba-41e5-a9dc-32268023c9a5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:52.831778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fc2ab4b-7dba-41e5-a9dc-32268023c9a5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:52.893035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0fc2ab4b-7dba-41e5-a9dc-32268023c9a5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:07:53.095883 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0fc2ab4b-7dba-41e5-a9dc-32268023c9a5 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 204 len: 0 microversion: 2.1 time: 0.297598 Mar 12 21:07:53.098583 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3208/3976] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:07:52 2022] DELETE /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:07:53.111262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-62234833-f7c3-4637-b604-a364de4a8082 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:53.112818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-62234833-f7c3-4637-b604-a364de4a8082 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:53.135252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62234833-f7c3-4637-b604-a364de4a8082 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:53.138500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62234833-f7c3-4637-b604-a364de4a8082 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:53.142352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62234833-f7c3-4637-b604-a364de4a8082 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:53.156799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62234833-f7c3-4637-b604-a364de4a8082 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:53.768909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-62234833-f7c3-4637-b604-a364de4a8082 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:53.785694 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-62234833-f7c3-4637-b604-a364de4a8082 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1676 microversion: 2.1 time: 0.681829 Mar 12 21:07:53.787307 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3209/3977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:53 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1676 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:53.799431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a439599-af7c-4ff1-aee7-418f14117e48 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:53.806131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a439599-af7c-4ff1-aee7-418f14117e48 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:53.824358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a439599-af7c-4ff1-aee7-418f14117e48 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:53.824358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a439599-af7c-4ff1-aee7-418f14117e48 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:53.825150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a439599-af7c-4ff1-aee7-418f14117e48 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:53.837032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a439599-af7c-4ff1-aee7-418f14117e48 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:55.001209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9a439599-af7c-4ff1-aee7-418f14117e48 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:55.009078 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a439599-af7c-4ff1-aee7-418f14117e48 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 1.219302 Mar 12 21:07:55.012934 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3210/3978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:53 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:55.027021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35e3a6d4-dd7e-4ab4-a732-4f08cb77e95e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:55.027943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-35e3a6d4-dd7e-4ab4-a732-4f08cb77e95e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:55.065082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35e3a6d4-dd7e-4ab4-a732-4f08cb77e95e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:55.065838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35e3a6d4-dd7e-4ab4-a732-4f08cb77e95e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:55.066707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35e3a6d4-dd7e-4ab4-a732-4f08cb77e95e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:55.067162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35e3a6d4-dd7e-4ab4-a732-4f08cb77e95e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:56.274735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-35e3a6d4-dd7e-4ab4-a732-4f08cb77e95e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:56.286129 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-35e3a6d4-dd7e-4ab4-a732-4f08cb77e95e tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1676 microversion: 2.1 time: 1.271435 Mar 12 21:07:56.289309 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3211/3979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:55 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1676 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:56.312678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-36a20604-62a9-45ce-b57d-8fa2323d529b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:56.315915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-36a20604-62a9-45ce-b57d-8fa2323d529b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:56.335579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36a20604-62a9-45ce-b57d-8fa2323d529b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:56.336050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36a20604-62a9-45ce-b57d-8fa2323d529b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:56.336866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36a20604-62a9-45ce-b57d-8fa2323d529b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:56.337320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36a20604-62a9-45ce-b57d-8fa2323d529b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:57.179164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-36a20604-62a9-45ce-b57d-8fa2323d529b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:57.193622 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-36a20604-62a9-45ce-b57d-8fa2323d529b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 0.891112 Mar 12 21:07:57.206447 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3212/3980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:56 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:57.315719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8996ff8c-9963-456f-be4d-80ff369a68bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:57.318261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8996ff8c-9963-456f-be4d-80ff369a68bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:57.353419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8996ff8c-9963-456f-be4d-80ff369a68bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:57.355167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8996ff8c-9963-456f-be4d-80ff369a68bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:57.358994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8996ff8c-9963-456f-be4d-80ff369a68bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:57.363867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8996ff8c-9963-456f-be4d-80ff369a68bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:57.641677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8996ff8c-9963-456f-be4d-80ff369a68bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:57.650427 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8996ff8c-9963-456f-be4d-80ff369a68bd tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1608 microversion: 2.1 time: 0.348245 Mar 12 21:07:57.655435 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3213/3981] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:57 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1608 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:58.212120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-57bdc74b-f871-4359-8d10-1fb4012b8f0c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:58.212941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-57bdc74b-f871-4359-8d10-1fb4012b8f0c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:58.221941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57bdc74b-f871-4359-8d10-1fb4012b8f0c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:58.233579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57bdc74b-f871-4359-8d10-1fb4012b8f0c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:58.234975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57bdc74b-f871-4359-8d10-1fb4012b8f0c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:58.235715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57bdc74b-f871-4359-8d10-1fb4012b8f0c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:58.756403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-57bdc74b-f871-4359-8d10-1fb4012b8f0c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:58.770498 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-57bdc74b-f871-4359-8d10-1fb4012b8f0c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 0.561222 Mar 12 21:07:58.773454 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3214/3982] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:58 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:07:58.791999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43515ffd-265d-4f3d-a4da-74dd4c01b3b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:58.794460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-43515ffd-265d-4f3d-a4da-74dd4c01b3b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:58.821996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43515ffd-265d-4f3d-a4da-74dd4c01b3b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:58.822951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43515ffd-265d-4f3d-a4da-74dd4c01b3b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:58.827049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43515ffd-265d-4f3d-a4da-74dd4c01b3b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:58.828026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43515ffd-265d-4f3d-a4da-74dd4c01b3b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:58.897153 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-43515ffd-265d-4f3d-a4da-74dd4c01b3b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb/ips" status: 200 len: 151 microversion: 2.1 time: 0.121815 Mar 12 21:07:58.898548 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3215/3983] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 21:07:58 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb/ips => generated 151 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:07:58.930358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-aa7dc6d3-3e67-4c3c-8ed8-257c70dd556a req-8d0336ef-657c-439e-be87-20fa211a4e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e537d16d-478d-4375-a61a-c28f8a785539", "name": "network-vif-deleted", "tag": "e0808d11-4cd5-4e52-88b4-c9eaec2126e6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:58.950718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aa7dc6d3-3e67-4c3c-8ed8-257c70dd556a req-8d0336ef-657c-439e-be87-20fa211a4e6e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:58.953406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aa7dc6d3-3e67-4c3c-8ed8-257c70dd556a req-8d0336ef-657c-439e-be87-20fa211a4e6e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:58.989991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-aa7dc6d3-3e67-4c3c-8ed8-257c70dd556a req-8d0336ef-657c-439e-be87-20fa211a4e6e service nova] Creating event network-vif-deleted:e0808d11-4cd5-4e52-88b4-c9eaec2126e6 for instance e537d16d-478d-4375-a61a-c28f8a785539 on nch2-master-1 Mar 12 21:07:59.001161 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-aa7dc6d3-3e67-4c3c-8ed8-257c70dd556a req-8d0336ef-657c-439e-be87-20fa211a4e6e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097981 Mar 12 21:07:59.004320 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3216/3984] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:07:59.017065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fa4819ea-d53b-4567-94d8-1daa47926568 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:59.021446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fa4819ea-d53b-4567-94d8-1daa47926568 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:59.035005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4819ea-d53b-4567-94d8-1daa47926568 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:59.039550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4819ea-d53b-4567-94d8-1daa47926568 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:59.041125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4819ea-d53b-4567-94d8-1daa47926568 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:59.042489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4819ea-d53b-4567-94d8-1daa47926568 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:59.108095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4819ea-d53b-4567-94d8-1daa47926568 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:59.120454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4819ea-d53b-4567-94d8-1daa47926568 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:59.121118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-fa4819ea-d53b-4567-94d8-1daa47926568 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lazy-loading 'fault' on Instance uuid e537d16d-478d-4375-a61a-c28f8a785539 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:07:59.196410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fa4819ea-d53b-4567-94d8-1daa47926568 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178b9752b5d44f9abb4df56c54e28c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab15c0a14a5b4eed97c40c0bf64150ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:07:59.208464 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fa4819ea-d53b-4567-94d8-1daa47926568 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 200 len: 1328 microversion: 2.1 time: 0.202058 Mar 12 21:07:59.209583 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3217/3985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:59 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 1328 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:07:59.215655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14241d05-7bc9-4240-8fc3-8b2732a817eb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba7d5c32-c844-466a-925a-148040924690"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:07:59.219096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14241d05-7bc9-4240-8fc3-8b2732a817eb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:59.245498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14241d05-7bc9-4240-8fc3-8b2732a817eb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:59.246346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14241d05-7bc9-4240-8fc3-8b2732a817eb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:59.250657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14241d05-7bc9-4240-8fc3-8b2732a817eb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:59.251485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14241d05-7bc9-4240-8fc3-8b2732a817eb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:59.373192 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-14241d05-7bc9-4240-8fc3-8b2732a817eb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Invalid volume: volume ba7d5c32-c844-466a-925a-148040924690 is already attached to instances: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 Mar 12 21:07:59.374238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14241d05-7bc9-4240-8fc3-8b2732a817eb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 400 to user: Invalid volume: volume ba7d5c32-c844-466a-925a-148040924690 is already attached to instances: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:07:59.375503 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14241d05-7bc9-4240-8fc3-8b2732a817eb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.163941 Mar 12 21:07:59.376839 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3218/3986] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:07:59 2022] POST /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb/os-volume_attachments => generated 174 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:07:59.388693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8bdc3cd-6663-4070-9b60-0ca5cc2a309c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:59.389445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8bdc3cd-6663-4070-9b60-0ca5cc2a309c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:59.403742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8bdc3cd-6663-4070-9b60-0ca5cc2a309c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:59.408047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8bdc3cd-6663-4070-9b60-0ca5cc2a309c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:59.409107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8bdc3cd-6663-4070-9b60-0ca5cc2a309c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:59.409709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8bdc3cd-6663-4070-9b60-0ca5cc2a309c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:59.527431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8bdc3cd-6663-4070-9b60-0ca5cc2a309c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:07:59.814029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8bdc3cd-6663-4070-9b60-0ca5cc2a309c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 204 len: 0 microversion: 2.1 time: 0.428756 Mar 12 21:07:59.819122 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3219/3987] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:07:59 2022] DELETE /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:07:59.852241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72764f15-4c26-4d90-8d8d-e6125457a9da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:07:59.854392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-72764f15-4c26-4d90-8d8d-e6125457a9da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:07:59.880588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72764f15-4c26-4d90-8d8d-e6125457a9da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:59.882774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72764f15-4c26-4d90-8d8d-e6125457a9da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:07:59.885652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72764f15-4c26-4d90-8d8d-e6125457a9da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:07:59.886317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72764f15-4c26-4d90-8d8d-e6125457a9da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:00.469332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-72764f15-4c26-4d90-8d8d-e6125457a9da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:00.500944 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72764f15-4c26-4d90-8d8d-e6125457a9da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 0.672521 Mar 12 21:08:00.501340 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3220/3988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:07:59 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:00.530686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-24856611-2fdf-4ac3-9007-bed55aca4152 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:00.532396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-24856611-2fdf-4ac3-9007-bed55aca4152 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:00.556180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24856611-2fdf-4ac3-9007-bed55aca4152 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:00.556708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24856611-2fdf-4ac3-9007-bed55aca4152 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:00.559399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24856611-2fdf-4ac3-9007-bed55aca4152 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:00.559631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24856611-2fdf-4ac3-9007-bed55aca4152 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:00.995606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-24856611-2fdf-4ac3-9007-bed55aca4152 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:01.010531 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-24856611-2fdf-4ac3-9007-bed55aca4152 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1681 microversion: 2.1 time: 0.491797 Mar 12 21:08:01.012676 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3221/3989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:00 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1681 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:01.034216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1f0f831-fbda-49aa-abb5-a907a7d690fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:01.038726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f1f0f831-fbda-49aa-abb5-a907a7d690fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] [instance: e537d16d-478d-4375-a61a-c28f8a785539] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:01.063157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1f0f831-fbda-49aa-abb5-a907a7d690fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:01.064137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1f0f831-fbda-49aa-abb5-a907a7d690fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:01.071807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1f0f831-fbda-49aa-abb5-a907a7d690fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:01.072448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1f0f831-fbda-49aa-abb5-a907a7d690fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:01.109712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f1f0f831-fbda-49aa-abb5-a907a7d690fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] HTTP exception thrown: Instance e537d16d-478d-4375-a61a-c28f8a785539 could not be found. Mar 12 21:08:01.110273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1f0f831-fbda-49aa-abb5-a907a7d690fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Returning 404 to user: Instance e537d16d-478d-4375-a61a-c28f8a785539 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:08:01.111131 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1f0f831-fbda-49aa-abb5-a907a7d690fb tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539" status: 404 len: 111 microversion: 2.1 time: 0.096333 Mar 12 21:08:01.126178 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3222/3990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:01 2022] GET /compute/v2.1/servers/e537d16d-478d-4375-a61a-c28f8a785539 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:08:01.165695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cf61a17a-bc97-4d5f-a72a-8be900cbf4b3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] Calling method '.version_select at 0x7f6e354aedc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:01.199382 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cf61a17a-bc97-4d5f-a72a-8be900cbf4b3 tempest-ServerActionsTestJSON-281178825 tempest-ServerActionsTestJSON-281178825-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-786093672" status: 202 len: 0 microversion: 2.1 time: 0.071973 Mar 12 21:08:01.200427 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3223/3991] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Mar 12 21:08:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-786093672 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:08:01.523027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ddbbfe9c-7a1c-460b-95c9-e73ef47f4013 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:01.523921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ddbbfe9c-7a1c-460b-95c9-e73ef47f4013 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:01.536282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ddbbfe9c-7a1c-460b-95c9-e73ef47f4013 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:01.540609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ddbbfe9c-7a1c-460b-95c9-e73ef47f4013 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:01.541716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ddbbfe9c-7a1c-460b-95c9-e73ef47f4013 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:01.542316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ddbbfe9c-7a1c-460b-95c9-e73ef47f4013 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:02.493102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ddbbfe9c-7a1c-460b-95c9-e73ef47f4013 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:02.512622 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ddbbfe9c-7a1c-460b-95c9-e73ef47f4013 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1524 microversion: 2.1 time: 0.997720 Mar 12 21:08:02.514125 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3224/3992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:01 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1524 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:02.521080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc0a0821-db74-41d3-a3db-9c9a655be3bf tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:02.522295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc0a0821-db74-41d3-a3db-9c9a655be3bf tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:02.532592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc0a0821-db74-41d3-a3db-9c9a655be3bf tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:02.533756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc0a0821-db74-41d3-a3db-9c9a655be3bf tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:02.535203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc0a0821-db74-41d3-a3db-9c9a655be3bf tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:02.536162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc0a0821-db74-41d3-a3db-9c9a655be3bf tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:03.283767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc0a0821-db74-41d3-a3db-9c9a655be3bf tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:03.294543 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc0a0821-db74-41d3-a3db-9c9a655be3bf tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1681 microversion: 2.1 time: 0.778980 Mar 12 21:08:03.295300 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3225/3993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:02 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1681 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:03.530357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d888602-05a8-4b3f-8290-44e6bce5625f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:03.531284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8d888602-05a8-4b3f-8290-44e6bce5625f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:03.544253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d888602-05a8-4b3f-8290-44e6bce5625f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:03.549414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d888602-05a8-4b3f-8290-44e6bce5625f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:03.550543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d888602-05a8-4b3f-8290-44e6bce5625f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:03.551305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d888602-05a8-4b3f-8290-44e6bce5625f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:04.363658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d888602-05a8-4b3f-8290-44e6bce5625f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:04.377678 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d888602-05a8-4b3f-8290-44e6bce5625f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1506 microversion: 2.1 time: 0.851815 Mar 12 21:08:04.380014 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3226/3994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:03 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1506 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:08:04.388120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4e6c1121-5e9d-4038-a6c4-0243c54a951d req-199aed40-d2c0-4368-9c56-cbf036e1ade7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d3f7e4-7cc1-4ebb-864f-36ddef3948fb", "name": "network-vif-deleted", "tag": "a2f5edc3-02a4-4d60-a189-bb281e2c7ed9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:04.403455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4e6c1121-5e9d-4038-a6c4-0243c54a951d req-199aed40-d2c0-4368-9c56-cbf036e1ade7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:04.403916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4e6c1121-5e9d-4038-a6c4-0243c54a951d req-199aed40-d2c0-4368-9c56-cbf036e1ade7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:04.419924 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4e6c1121-5e9d-4038-a6c4-0243c54a951d req-199aed40-d2c0-4368-9c56-cbf036e1ade7 service nova] Creating event network-vif-deleted:a2f5edc3-02a4-4d60-a189-bb281e2c7ed9 for instance 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb on nch1-master-1 Mar 12 21:08:04.425864 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4e6c1121-5e9d-4038-a6c4-0243c54a951d req-199aed40-d2c0-4368-9c56-cbf036e1ade7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044443 Mar 12 21:08:04.427122 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3227/3995] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:04.434451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16a1cc0c-8e54-4414-a27c-570615963c51 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:04.435427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16a1cc0c-8e54-4414-a27c-570615963c51 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:04.444286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16a1cc0c-8e54-4414-a27c-570615963c51 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:04.445190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16a1cc0c-8e54-4414-a27c-570615963c51 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:04.446235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16a1cc0c-8e54-4414-a27c-570615963c51 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:04.446906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16a1cc0c-8e54-4414-a27c-570615963c51 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:04.513124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16a1cc0c-8e54-4414-a27c-570615963c51 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:04.513893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16a1cc0c-8e54-4414-a27c-570615963c51 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:04.514613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-16a1cc0c-8e54-4414-a27c-570615963c51 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lazy-loading 'fault' on Instance uuid 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:08:04.707678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16a1cc0c-8e54-4414-a27c-570615963c51 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:04.720683 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16a1cc0c-8e54-4414-a27c-570615963c51 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 200 len: 1330 microversion: 2.1 time: 0.292137 Mar 12 21:08:04.732197 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3228/3996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:04 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 1330 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:04.921418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec6bb934-4a81-4131-abb4-47cc5d59934d tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:04.922211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec6bb934-4a81-4131-abb4-47cc5d59934d tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:04.928379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec6bb934-4a81-4131-abb4-47cc5d59934d tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:04.929095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec6bb934-4a81-4131-abb4-47cc5d59934d tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:04.930117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec6bb934-4a81-4131-abb4-47cc5d59934d tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:04.930739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec6bb934-4a81-4131-abb4-47cc5d59934d tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:05.029787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-ec6bb934-4a81-4131-abb4-47cc5d59934d tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lazy-loading 'services' on Instance uuid 2d2cee8c-6861-4351-ab79-f09a546da6a7 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:08:05.136260 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec6bb934-4a81-4131-abb4-47cc5d59934d tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7/os-volume_attachments/0d219623-5b71-4651-9d9b-3c7aadd4b36f" status: 202 len: 0 microversion: 2.1 time: 0.217792 Mar 12 21:08:05.137605 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3229/3997] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:08:04 2022] DELETE /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7/os-volume_attachments/0d219623-5b71-4651-9d9b-3c7aadd4b36f => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:08:05.401697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ba4eeb24-1a40-4c1b-a6db-817c67fe29dc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:05.402389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ba4eeb24-1a40-4c1b-a6db-817c67fe29dc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:05.411419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba4eeb24-1a40-4c1b-a6db-817c67fe29dc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:05.412101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba4eeb24-1a40-4c1b-a6db-817c67fe29dc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:05.413406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba4eeb24-1a40-4c1b-a6db-817c67fe29dc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:05.414251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba4eeb24-1a40-4c1b-a6db-817c67fe29dc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:06.180622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ba4eeb24-1a40-4c1b-a6db-817c67fe29dc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:06.192781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ba4eeb24-1a40-4c1b-a6db-817c67fe29dc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1506 microversion: 2.1 time: 0.796532 Mar 12 21:08:06.194529 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3230/3998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:05 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1506 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:08:06.207874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33c517d5-e9d8-47b5-adab-4c48a1f829c6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:06.209612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-33c517d5-e9d8-47b5-adab-4c48a1f829c6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:06.227068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33c517d5-e9d8-47b5-adab-4c48a1f829c6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:06.227692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33c517d5-e9d8-47b5-adab-4c48a1f829c6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:06.228651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33c517d5-e9d8-47b5-adab-4c48a1f829c6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:06.229236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33c517d5-e9d8-47b5-adab-4c48a1f829c6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:06.246378 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-33c517d5-e9d8-47b5-adab-4c48a1f829c6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Instance 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb could not be found. Mar 12 21:08:06.247334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33c517d5-e9d8-47b5-adab-4c48a1f829c6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 404 to user: Instance 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:08:06.248326 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-33c517d5-e9d8-47b5-adab-4c48a1f829c6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 404 len: 111 microversion: 2.1 time: 0.051267 Mar 12 21:08:06.249045 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3231/3999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:06 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:08:06.265972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-434266fe-6325-4fed-8c43-531e0a5b40bf tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '.version_select at 0x7f6e35434940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:06.295002 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-434266fe-6325-4fed-8c43-531e0a5b40bf tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663527832" status: 202 len: 0 microversion: 2.1 time: 0.041003 Mar 12 21:08:06.295610 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3232/4000] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Mar 12 21:08:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1663527832 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:08:06.327802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0caf0c75-188a-45f9-ae10-ad3ed8bde686 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:06.328346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0caf0c75-188a-45f9-ae10-ad3ed8bde686 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:06.343233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0caf0c75-188a-45f9-ae10-ad3ed8bde686 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:06.343695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0caf0c75-188a-45f9-ae10-ad3ed8bde686 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:06.344486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0caf0c75-188a-45f9-ae10-ad3ed8bde686 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:06.347550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0caf0c75-188a-45f9-ae10-ad3ed8bde686 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:06.404516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0caf0c75-188a-45f9-ae10-ad3ed8bde686 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:08:06.618690 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0caf0c75-188a-45f9-ae10-ad3ed8bde686 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7" status: 204 len: 0 microversion: 2.1 time: 0.294343 Mar 12 21:08:06.619980 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3233/4001] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:08:06 2022] DELETE /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:08:06.630649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5b0e4d1a-85db-431f-b5a0-edb33b9395b4 req-3b5adcdd-a733-4dbf-832b-99624bb1a0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e4dbc9-e3c3-45e5-9d41-0b27844bc172", "name": "network-vif-unplugged", "status": "completed", "tag": "fcb6ffc3-d6b9-48e7-83a1-e9a6b02cb3d9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:06.650406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5b0e4d1a-85db-431f-b5a0-edb33b9395b4 req-3b5adcdd-a733-4dbf-832b-99624bb1a0c1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:06.651051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5b0e4d1a-85db-431f-b5a0-edb33b9395b4 req-3b5adcdd-a733-4dbf-832b-99624bb1a0c1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:06.666182 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5b0e4d1a-85db-431f-b5a0-edb33b9395b4 req-3b5adcdd-a733-4dbf-832b-99624bb1a0c1 service nova] Creating event network-vif-unplugged:fcb6ffc3-d6b9-48e7-83a1-e9a6b02cb3d9 for instance c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 on nch2-master-1 Mar 12 21:08:06.673608 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5b0e4d1a-85db-431f-b5a0-edb33b9395b4 req-3b5adcdd-a733-4dbf-832b-99624bb1a0c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050078 Mar 12 21:08:06.674447 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3234/4002] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:06.681798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-88e618b0-5e57-4d94-bf3f-94cef3a3a6f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:06.682529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-88e618b0-5e57-4d94-bf3f-94cef3a3a6f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:06.716478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88e618b0-5e57-4d94-bf3f-94cef3a3a6f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:06.717106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88e618b0-5e57-4d94-bf3f-94cef3a3a6f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:06.718138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88e618b0-5e57-4d94-bf3f-94cef3a3a6f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:06.718787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88e618b0-5e57-4d94-bf3f-94cef3a3a6f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:07.469051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-88e618b0-5e57-4d94-bf3f-94cef3a3a6f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5601cc6a01a4c35bceb33df0cad0acc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ea29aba17e41fcac0b47522cf48b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:07.478426 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-88e618b0-5e57-4d94-bf3f-94cef3a3a6f7 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7" status: 200 len: 1469 microversion: 2.1 time: 0.802027 Mar 12 21:08:07.483482 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3235/4003] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:06 2022] GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7 => generated 1469 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:07.499107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a1875e8-9d71-4f7d-ae6c-98be150598e8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:07.500292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a1875e8-9d71-4f7d-ae6c-98be150598e8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:07.515040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a1875e8-9d71-4f7d-ae6c-98be150598e8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:07.515687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a1875e8-9d71-4f7d-ae6c-98be150598e8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:07.516824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a1875e8-9d71-4f7d-ae6c-98be150598e8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:07.519305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a1875e8-9d71-4f7d-ae6c-98be150598e8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:08.081176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5a1875e8-9d71-4f7d-ae6c-98be150598e8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:08.125723 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a1875e8-9d71-4f7d-ae6c-98be150598e8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 200 len: 1449 microversion: 2.1 time: 0.640434 Mar 12 21:08:08.133733 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3236/4004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:07 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 1449 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:08.150198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:08.150709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:08.160883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:08.161347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:08.164479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:08.165085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:08.247120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:08:08.259241 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.api [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Working on deleting snapshot c7ec397e-5983-4898-9659-627c5123abe3 from shelved instance... Mar 12 21:08:09.310857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Doing local delete in cell 4c4d5282-7cc3-4af0-ad9b-94df8d06175d(cell1) {{(pid=136302) _delete /opt/stack/nova/nova/compute/api.py:2489}} Mar 12 21:08:09.313331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:09.314102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:09.314728 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.api [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Mar 12 21:08:09.322184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] deallocate_for_instance() {{(pid=136302) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Mar 12 21:08:11.766064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Updating instance_info_cache with network_info: [] {{(pid=136302) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 12 21:08:12.093324 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cf161fe3-9d91-4dde-96e7-fb9c00e16ef1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 204 len: 0 microversion: 2.1 time: 3.947638 Mar 12 21:08:12.097349 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3237/4005] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:08:08 2022] DELETE /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 0 bytes in 3949 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:08:12.104782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a411eb59-5792-4d3d-a035-2a487b594a08 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:12.105731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a411eb59-5792-4d3d-a035-2a487b594a08 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] [instance: 2d2cee8c-6861-4351-ab79-f09a546da6a7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:12.114713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a411eb59-5792-4d3d-a035-2a487b594a08 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:12.115665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a411eb59-5792-4d3d-a035-2a487b594a08 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:12.117364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a411eb59-5792-4d3d-a035-2a487b594a08 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:12.118066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a411eb59-5792-4d3d-a035-2a487b594a08 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:12.149578 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a411eb59-5792-4d3d-a035-2a487b594a08 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] HTTP exception thrown: Instance 2d2cee8c-6861-4351-ab79-f09a546da6a7 could not be found. Mar 12 21:08:12.150496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a411eb59-5792-4d3d-a035-2a487b594a08 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] Returning 404 to user: Instance 2d2cee8c-6861-4351-ab79-f09a546da6a7 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:08:12.151716 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a411eb59-5792-4d3d-a035-2a487b594a08 tempest-VolumesBackupsTest-1109530946 tempest-VolumesBackupsTest-1109530946-project] 10.222.0.30 "GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7" status: 404 len: 111 microversion: 2.1 time: 0.053041 Mar 12 21:08:12.152354 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3238/4006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:12 2022] GET /compute/v2.1/servers/2d2cee8c-6861-4351-ab79-f09a546da6a7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:08:12.181956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1179fcd-ab47-4340-a0f9-b9ed662648f5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:12.182687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a1179fcd-ab47-4340-a0f9-b9ed662648f5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:12.202072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1179fcd-ab47-4340-a0f9-b9ed662648f5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:12.202774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1179fcd-ab47-4340-a0f9-b9ed662648f5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:12.203913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1179fcd-ab47-4340-a0f9-b9ed662648f5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:12.205988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1179fcd-ab47-4340-a0f9-b9ed662648f5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:12.417987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-a1179fcd-ab47-4340-a0f9-b9ed662648f5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lazy-loading 'services' on Instance uuid 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:08:12.581513 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1179fcd-ab47-4340-a0f9-b9ed662648f5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2/os-volume_attachments/ba7d5c32-c844-466a-925a-148040924690" status: 202 len: 0 microversion: 2.1 time: 0.427531 Mar 12 21:08:12.586033 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3239/4007] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:08:12 2022] DELETE /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2/os-volume_attachments/ba7d5c32-c844-466a-925a-148040924690 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:08:12.591872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-97a0d612-8769-45d0-b825-10b399e5f4e7 req-fc6942e2-b01a-4e1a-930f-ceddc19a363d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d2cee8c-6861-4351-ab79-f09a546da6a7", "name": "network-vif-deleted", "tag": "21b9b4b6-c394-4843-ac40-7b06bcb27ab4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:12.613292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-97a0d612-8769-45d0-b825-10b399e5f4e7 req-fc6942e2-b01a-4e1a-930f-ceddc19a363d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:12.631703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-97a0d612-8769-45d0-b825-10b399e5f4e7 req-fc6942e2-b01a-4e1a-930f-ceddc19a363d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:12.700163 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-97a0d612-8769-45d0-b825-10b399e5f4e7 req-fc6942e2-b01a-4e1a-930f-ceddc19a363d service nova] Creating event network-vif-deleted:21b9b4b6-c394-4843-ac40-7b06bcb27ab4 for instance 2d2cee8c-6861-4351-ab79-f09a546da6a7 on nch1-master-1 Mar 12 21:08:12.712125 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-97a0d612-8769-45d0-b825-10b399e5f4e7 req-fc6942e2-b01a-4e1a-930f-ceddc19a363d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124311 Mar 12 21:08:12.713084 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3240/4008] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:12.721152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a978cb4f-128f-4274-9057-41272bb072b0 req-31afa6e8-7dd4-4a5c-9932-654d1c5d51d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e4dbc9-e3c3-45e5-9d41-0b27844bc172", "name": "network-vif-deleted", "tag": "fcb6ffc3-d6b9-48e7-83a1-e9a6b02cb3d9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:12.737847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a978cb4f-128f-4274-9057-41272bb072b0 req-31afa6e8-7dd4-4a5c-9932-654d1c5d51d8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:12.739843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a978cb4f-128f-4274-9057-41272bb072b0 req-31afa6e8-7dd4-4a5c-9932-654d1c5d51d8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:12.773659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.compute.server_external_events [req-a978cb4f-128f-4274-9057-41272bb072b0 req-31afa6e8-7dd4-4a5c-9932-654d1c5d51d8 service nova] Unable to find a host for instance c7e4dbc9-e3c3-45e5-9d41-0b27844bc172. Dropping event network-vif-deleted {{(pid=136302) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 12 21:08:12.776739 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a978cb4f-128f-4274-9057-41272bb072b0 req-31afa6e8-7dd4-4a5c-9932-654d1c5d51d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.060611 Mar 12 21:08:12.779703 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3241/4009] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 66 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 12 21:08:12.791373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4f06bbf-9247-4a4b-8f82-bc084ea565d6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:12.792712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b4f06bbf-9247-4a4b-8f82-bc084ea565d6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:12.824030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4f06bbf-9247-4a4b-8f82-bc084ea565d6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:12.825085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4f06bbf-9247-4a4b-8f82-bc084ea565d6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:12.827346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4f06bbf-9247-4a4b-8f82-bc084ea565d6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:12.828368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4f06bbf-9247-4a4b-8f82-bc084ea565d6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:12.871267 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b4f06bbf-9247-4a4b-8f82-bc084ea565d6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 could not be found. Mar 12 21:08:12.871894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4f06bbf-9247-4a4b-8f82-bc084ea565d6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:08:12.872919 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b4f06bbf-9247-4a4b-8f82-bc084ea565d6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 404 len: 111 microversion: 2.1 time: 0.091803 Mar 12 21:08:12.873658 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3242/4010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:12 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:08:12.878836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f4362e71-6342-4ba4-bf76-33aeb14587b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:12.879992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f4362e71-6342-4ba4-bf76-33aeb14587b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:12.892095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4362e71-6342-4ba4-bf76-33aeb14587b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:12.900832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4362e71-6342-4ba4-bf76-33aeb14587b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:12.901804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4362e71-6342-4ba4-bf76-33aeb14587b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:12.902355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4362e71-6342-4ba4-bf76-33aeb14587b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:12.982167 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f4362e71-6342-4ba4-bf76-33aeb14587b5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106980 Mar 12 21:08:12.991785 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3243/4011] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:08:12 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:13.121544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2027650376", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "3bc356e1-2fe7-4340-aecb-f85636b06883"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:13.211740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] validate_networks() for [('3bc356e1-2fe7-4340-aecb-f85636b06883', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:08:15.243545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:08:15.244080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:08:15.250226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:08:15.250677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:08:15.251105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:08:15.268164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:15.271219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:15.272637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:15.274083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:15.327220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:08:15.349734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for user 10e1e3bae5b94b5589b47488329ad756 and project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:08:15.377173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:08:15.383824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:08:15.505425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04d31850-6201-4ac7-bb63-6fbb596bd16f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.384191 Mar 12 21:08:15.506990 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3244/4012] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:08:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:08:15.517489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e87379e0-d8e2-474c-871c-539c17173afa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:15.519094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e87379e0-d8e2-474c-871c-539c17173afa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:15.533522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e87379e0-d8e2-474c-871c-539c17173afa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:15.534081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e87379e0-d8e2-474c-871c-539c17173afa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:15.534954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e87379e0-d8e2-474c-871c-539c17173afa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:15.535408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e87379e0-d8e2-474c-871c-539c17173afa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:15.619424 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e87379e0-d8e2-474c-871c-539c17173afa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106866 Mar 12 21:08:15.620379 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3245/4013] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:08:15 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:08:15.640357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a1078b8-2256-46aa-8f54-8b792f7b03a3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:15.652384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a1078b8-2256-46aa-8f54-8b792f7b03a3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:15.755936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5a1078b8-2256-46aa-8f54-8b792f7b03a3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:15.764957 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a1078b8-2256-46aa-8f54-8b792f7b03a3 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1215 microversion: 2.1 time: 0.142956 Mar 12 21:08:15.765957 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3246/4014] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:15 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:15.770871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-45dcbed0-15fb-4c90-a504-552cd1ec3777 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:15.771447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-45dcbed0-15fb-4c90-a504-552cd1ec3777 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:15.780490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45dcbed0-15fb-4c90-a504-552cd1ec3777 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:15.782061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45dcbed0-15fb-4c90-a504-552cd1ec3777 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:15.783036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45dcbed0-15fb-4c90-a504-552cd1ec3777 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:15.783650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45dcbed0-15fb-4c90-a504-552cd1ec3777 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:15.825292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-45dcbed0-15fb-4c90-a504-552cd1ec3777 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:08:16.004725 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-45dcbed0-15fb-4c90-a504-552cd1ec3777 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 204 len: 0 microversion: 2.1 time: 0.237331 Mar 12 21:08:16.005515 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3247/4015] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:08:15 2022] DELETE /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:08:16.016290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-934218e7-53d6-474f-8055-98bc5c8f9a0a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:16.022310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-934218e7-53d6-474f-8055-98bc5c8f9a0a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:16.029424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-934218e7-53d6-474f-8055-98bc5c8f9a0a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:16.030080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-934218e7-53d6-474f-8055-98bc5c8f9a0a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:16.031048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-934218e7-53d6-474f-8055-98bc5c8f9a0a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:16.031642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-934218e7-53d6-474f-8055-98bc5c8f9a0a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:16.514469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-934218e7-53d6-474f-8055-98bc5c8f9a0a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:16.531815 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-934218e7-53d6-474f-8055-98bc5c8f9a0a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1680 microversion: 2.1 time: 0.519029 Mar 12 21:08:16.533006 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3248/4016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:16 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1680 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:16.788347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a307c5ff-cf2b-4471-b217-2fd2a9752e78 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:16.789553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a307c5ff-cf2b-4471-b217-2fd2a9752e78 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:16.813421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a307c5ff-cf2b-4471-b217-2fd2a9752e78 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:16.813907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a307c5ff-cf2b-4471-b217-2fd2a9752e78 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:16.816140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a307c5ff-cf2b-4471-b217-2fd2a9752e78 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:16.816539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a307c5ff-cf2b-4471-b217-2fd2a9752e78 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:17.190489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a307c5ff-cf2b-4471-b217-2fd2a9752e78 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:17.202730 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a307c5ff-cf2b-4471-b217-2fd2a9752e78 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1267 microversion: 2.1 time: 0.423137 Mar 12 21:08:17.208279 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3249/4017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:16 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1267 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:17.562167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85577c5a-d91c-4eee-9088-d3ef0e4d22a3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:17.567626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85577c5a-d91c-4eee-9088-d3ef0e4d22a3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:17.623293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85577c5a-d91c-4eee-9088-d3ef0e4d22a3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:17.627945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85577c5a-d91c-4eee-9088-d3ef0e4d22a3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:17.631008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85577c5a-d91c-4eee-9088-d3ef0e4d22a3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:17.632054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85577c5a-d91c-4eee-9088-d3ef0e4d22a3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:18.364458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-85577c5a-d91c-4eee-9088-d3ef0e4d22a3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:18.395574 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85577c5a-d91c-4eee-9088-d3ef0e4d22a3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1680 microversion: 2.1 time: 0.844547 Mar 12 21:08:18.398888 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3250/4018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:17 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1680 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:18.407528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04929e79-b1a3-44f1-a82c-5fb813e3d875 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:18.419613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04929e79-b1a3-44f1-a82c-5fb813e3d875 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:18.450099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04929e79-b1a3-44f1-a82c-5fb813e3d875 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:18.455577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04929e79-b1a3-44f1-a82c-5fb813e3d875 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:18.461465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04929e79-b1a3-44f1-a82c-5fb813e3d875 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:18.464043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04929e79-b1a3-44f1-a82c-5fb813e3d875 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:18.987602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04929e79-b1a3-44f1-a82c-5fb813e3d875 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:18.996911 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04929e79-b1a3-44f1-a82c-5fb813e3d875 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1273 microversion: 2.1 time: 0.594722 Mar 12 21:08:19.001611 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3251/4019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:18 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1273 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:19.748170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7c7b92fa-9514-4a39-9a05-984d25f772ff tempest-QuotasTestJSON-265179072 tempest-QuotasTestJSON-265179072-project] Calling method '.version_select at 0x7f6e3540daf0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:20.092416 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7c7b92fa-9514-4a39-9a05-984d25f772ff tempest-QuotasTestJSON-265179072 tempest-QuotasTestJSON-265179072-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/780f821447b347369b1bcdd3e4ae4ebb/defaults" status: 200 len: 371 microversion: 2.1 time: 0.896565 Mar 12 21:08:20.093024 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3252/4020] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 21:08:19 2022] GET /compute/v2.1/os-quota-sets/780f821447b347369b1bcdd3e4ae4ebb/defaults => generated 371 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:08:20.110320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-def7fa0d-51ac-4533-92ac-e904e1c2313b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:20.121557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-def7fa0d-51ac-4533-92ac-e904e1c2313b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:20.144707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-def7fa0d-51ac-4533-92ac-e904e1c2313b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:20.145411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-def7fa0d-51ac-4533-92ac-e904e1c2313b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:20.149531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-def7fa0d-51ac-4533-92ac-e904e1c2313b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:20.152827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-def7fa0d-51ac-4533-92ac-e904e1c2313b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:20.311283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-def7fa0d-51ac-4533-92ac-e904e1c2313b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:20.349682 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-def7fa0d-51ac-4533-92ac-e904e1c2313b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1613 microversion: 2.1 time: 0.242178 Mar 12 21:08:20.350643 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3253/4021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:20 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1613 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:20.360592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23a56d74-d9f7-44d2-802a-c51c3263e8c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:20.363320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-23a56d74-d9f7-44d2-802a-c51c3263e8c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:20.379641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23a56d74-d9f7-44d2-802a-c51c3263e8c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:20.383349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23a56d74-d9f7-44d2-802a-c51c3263e8c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:20.387280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23a56d74-d9f7-44d2-802a-c51c3263e8c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:20.392018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23a56d74-d9f7-44d2-802a-c51c3263e8c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:21.438369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-23a56d74-d9f7-44d2-802a-c51c3263e8c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:21.450346 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-23a56d74-d9f7-44d2-802a-c51c3263e8c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1315 microversion: 2.1 time: 1.095890 Mar 12 21:08:21.451790 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3254/4022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:20 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1315 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:21.468071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-420048f0-58a2-4dce-88e0-cf445c1f4d1b tempest-QuotasTestJSON-265179072 tempest-QuotasTestJSON-265179072-project] Calling method '.version_select at 0x7f6e354da040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:21.890971 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-420048f0-58a2-4dce-88e0-cf445c1f4d1b tempest-QuotasTestJSON-265179072 tempest-QuotasTestJSON-265179072-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/780f821447b347369b1bcdd3e4ae4ebb" status: 200 len: 371 microversion: 2.1 time: 0.437127 Mar 12 21:08:21.892522 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3255/4023] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Mar 12 21:08:21 2022] GET /compute/v2.1/os-quota-sets/780f821447b347369b1bcdd3e4ae4ebb => generated 371 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:21.899484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c4d7dfb-ada6-451d-b0d9-131ebaae0cef tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:21.900463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2c4d7dfb-ada6-451d-b0d9-131ebaae0cef tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:21.909360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c4d7dfb-ada6-451d-b0d9-131ebaae0cef tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:21.910078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c4d7dfb-ada6-451d-b0d9-131ebaae0cef tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:21.911364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c4d7dfb-ada6-451d-b0d9-131ebaae0cef tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:21.912090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c4d7dfb-ada6-451d-b0d9-131ebaae0cef tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:21.975649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c4d7dfb-ada6-451d-b0d9-131ebaae0cef tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:21.976518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c4d7dfb-ada6-451d-b0d9-131ebaae0cef tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:21.977217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-2c4d7dfb-ada6-451d-b0d9-131ebaae0cef tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lazy-loading 'fault' on Instance uuid 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:08:22.137652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c4d7dfb-ada6-451d-b0d9-131ebaae0cef tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:22.147667 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c4d7dfb-ada6-451d-b0d9-131ebaae0cef tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 200 len: 1330 microversion: 2.1 time: 0.253660 Mar 12 21:08:22.148886 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3256/4024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:21 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 1330 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:22.164289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c4d77b6f-f4b5-4d68-b00c-ca5558b1344d req-be082036-8538-40b7-b268-473a60f32233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b45740c-54fc-46b5-80d2-634e8f8ec3d2", "name": "network-vif-deleted", "tag": "408ebe63-d619-429a-851a-97ee01a4db89"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:22.202351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c4d77b6f-f4b5-4d68-b00c-ca5558b1344d req-be082036-8538-40b7-b268-473a60f32233 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:22.206263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c4d77b6f-f4b5-4d68-b00c-ca5558b1344d req-be082036-8538-40b7-b268-473a60f32233 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:22.265597 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c4d77b6f-f4b5-4d68-b00c-ca5558b1344d req-be082036-8538-40b7-b268-473a60f32233 service nova] Creating event network-vif-deleted:408ebe63-d619-429a-851a-97ee01a4db89 for instance 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 on nch1-master-1 Mar 12 21:08:22.276920 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c4d77b6f-f4b5-4d68-b00c-ca5558b1344d req-be082036-8538-40b7-b268-473a60f32233 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123473 Mar 12 21:08:22.277908 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3257/4025] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:22.286011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-48eef9ff-7ade-434d-aa61-6ea251a3fe39 tempest-QuotasTestJSON-265179072 tempest-QuotasTestJSON-265179072-project] Calling method '.version_select at 0x7f6e354345e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:22.388308 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-48eef9ff-7ade-434d-aa61-6ea251a3fe39 tempest-QuotasTestJSON-265179072 tempest-QuotasTestJSON-265179072-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/780f821447b347369b1bcdd3e4ae4ebb/defaults" status: 200 len: 371 microversion: 2.1 time: 0.107078 Mar 12 21:08:22.389867 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3258/4026] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 21:08:22 2022] GET /compute/v2.1/os-quota-sets/780f821447b347369b1bcdd3e4ae4ebb/defaults => generated 371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:22.418307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-db2b0c57-dba1-4a74-929f-7cdb3b558e8f tempest-QuotasTestJSON-265179072 tempest-QuotasTestJSON-265179072-project] Calling method '.version_select at 0x7f6e3540ddc0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:22.590163 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-db2b0c57-dba1-4a74-929f-7cdb3b558e8f tempest-QuotasTestJSON-265179072 tempest-QuotasTestJSON-265179072-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/780f821447b347369b1bcdd3e4ae4ebb" status: 200 len: 371 microversion: 2.1 time: 0.184514 Mar 12 21:08:22.591062 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3259/4027] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Mar 12 21:08:22 2022] GET /compute/v2.1/os-quota-sets/780f821447b347369b1bcdd3e4ae4ebb => generated 371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:22.604737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90d033e0-758a-47c7-a8cf-fff113b67fdb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:22.605580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90d033e0-758a-47c7-a8cf-fff113b67fdb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:22.626429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90d033e0-758a-47c7-a8cf-fff113b67fdb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:22.629697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90d033e0-758a-47c7-a8cf-fff113b67fdb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:22.635300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90d033e0-758a-47c7-a8cf-fff113b67fdb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:22.636081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90d033e0-758a-47c7-a8cf-fff113b67fdb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:22.962540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90d033e0-758a-47c7-a8cf-fff113b67fdb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:22.972600 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90d033e0-758a-47c7-a8cf-fff113b67fdb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1315 microversion: 2.1 time: 0.376979 Mar 12 21:08:22.979230 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3260/4028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:22 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:22.995828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d144f444-e163-459a-9823-b96e73ed3257 tempest-QuotasTestJSON-265179072 tempest-QuotasTestJSON-265179072-project] Calling method '.version_select at 0x7f6e354da700>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:23.161604 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d144f444-e163-459a-9823-b96e73ed3257 tempest-QuotasTestJSON-265179072 tempest-QuotasTestJSON-265179072-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/780f821447b347369b1bcdd3e4ae4ebb?user_id=8a8df6c7c3b04ab9972664809dc4d1ae" status: 200 len: 371 microversion: 2.1 time: 0.179914 Mar 12 21:08:23.163800 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3261/4029] 10.222.0.30 () {58 vars in 1322 bytes} [Sat Mar 12 21:08:22 2022] GET /compute/v2.1/os-quota-sets/780f821447b347369b1bcdd3e4ae4ebb?user_id=8a8df6c7c3b04ab9972664809dc4d1ae => generated 371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:23.169114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d89b4ea6-4cd3-4052-aa2a-c9868701c654 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:23.169730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d89b4ea6-4cd3-4052-aa2a-c9868701c654 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:23.179610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d89b4ea6-4cd3-4052-aa2a-c9868701c654 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:23.180080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d89b4ea6-4cd3-4052-aa2a-c9868701c654 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:23.180880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d89b4ea6-4cd3-4052-aa2a-c9868701c654 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:23.181319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d89b4ea6-4cd3-4052-aa2a-c9868701c654 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:23.198719 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d89b4ea6-4cd3-4052-aa2a-c9868701c654 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Instance 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 could not be found. Mar 12 21:08:23.199333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d89b4ea6-4cd3-4052-aa2a-c9868701c654 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 404 to user: Instance 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:08:23.200177 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d89b4ea6-4cd3-4052-aa2a-c9868701c654 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 404 len: 111 microversion: 2.1 time: 0.035259 Mar 12 21:08:23.201047 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3262/4030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:23 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:08:23.213812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b77146d8-46ae-4e06-abbf-92e73cd563d5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '.version_select at 0x7f6e354349d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:23.259517 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b77146d8-46ae-4e06-abbf-92e73cd563d5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982371581" status: 202 len: 0 microversion: 2.1 time: 0.053673 Mar 12 21:08:23.262566 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3263/4031] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Mar 12 21:08:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982371581 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:08:24.008959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b2292b22-796d-4c3f-83ca-221ea1b491fb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:24.016668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b2292b22-796d-4c3f-83ca-221ea1b491fb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:24.027618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2292b22-796d-4c3f-83ca-221ea1b491fb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:24.028071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2292b22-796d-4c3f-83ca-221ea1b491fb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:24.028913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2292b22-796d-4c3f-83ca-221ea1b491fb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:24.029677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2292b22-796d-4c3f-83ca-221ea1b491fb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:24.728490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b2292b22-796d-4c3f-83ca-221ea1b491fb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:24.739611 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b2292b22-796d-4c3f-83ca-221ea1b491fb tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1315 microversion: 2.1 time: 0.737321 Mar 12 21:08:24.744117 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3264/4032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:23 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:24.754247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4982865e-bf51-443b-99ed-f09bce71d9a6 req-4987dcb4-c101-4ddf-8efe-59c8b30ce076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da478e7-a161-41dc-8c25-faf4d7bb4a3b", "tag": "bdd7bc75-5486-4691-9a8c-e30a02907757"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:24.782598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4982865e-bf51-443b-99ed-f09bce71d9a6 req-4987dcb4-c101-4ddf-8efe-59c8b30ce076 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:24.783714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4982865e-bf51-443b-99ed-f09bce71d9a6 req-4987dcb4-c101-4ddf-8efe-59c8b30ce076 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:24.823813 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4982865e-bf51-443b-99ed-f09bce71d9a6 req-4987dcb4-c101-4ddf-8efe-59c8b30ce076 service nova] Creating event network-changed:bdd7bc75-5486-4691-9a8c-e30a02907757 for instance 0da478e7-a161-41dc-8c25-faf4d7bb4a3b on nch2-master-1 Mar 12 21:08:24.843794 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4982865e-bf51-443b-99ed-f09bce71d9a6 req-4987dcb4-c101-4ddf-8efe-59c8b30ce076 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097875 Mar 12 21:08:24.844417 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3265/4033] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:25.814037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be8139a0-ed1c-4ca3-af7a-9fabdc886448 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:25.816367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-be8139a0-ed1c-4ca3-af7a-9fabdc886448 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:25.879710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be8139a0-ed1c-4ca3-af7a-9fabdc886448 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:25.880707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be8139a0-ed1c-4ca3-af7a-9fabdc886448 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:25.883722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be8139a0-ed1c-4ca3-af7a-9fabdc886448 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:25.889039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be8139a0-ed1c-4ca3-af7a-9fabdc886448 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:26.245280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be8139a0-ed1c-4ca3-af7a-9fabdc886448 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:26.253303 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be8139a0-ed1c-4ca3-af7a-9fabdc886448 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1315 microversion: 2.1 time: 0.498455 Mar 12 21:08:26.270170 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3266/4034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:25 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:26.278397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ad0d125-32d7-48f5-83a8-d787d2119cae tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: .version_select at 0x7f6e35434040>, body: {"keypair": {"name": "tempest-keypair-189980980"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:26.304473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6ad0d125-32d7-48f5-83a8-d787d2119cae tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:08:26.310869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6ad0d125-32d7-48f5-83a8-d787d2119cae tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for user f2c8058e4e8d475c9377a065b4018a2a and project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:08:26.581815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6ad0d125-32d7-48f5-83a8-d787d2119cae tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:08:26.599594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6ad0d125-32d7-48f5-83a8-d787d2119cae tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for user f2c8058e4e8d475c9377a065b4018a2a and project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:08:26.629532 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ad0d125-32d7-48f5-83a8-d787d2119cae tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.357271 Mar 12 21:08:26.639653 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3267/4035] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:08:26 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:27.276057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a82c910f-1ace-4b75-b84a-4023a962eff0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:27.277234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a82c910f-1ace-4b75-b84a-4023a962eff0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:27.297740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a82c910f-1ace-4b75-b84a-4023a962eff0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:27.298539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a82c910f-1ace-4b75-b84a-4023a962eff0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:27.300258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a82c910f-1ace-4b75-b84a-4023a962eff0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:27.307593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a82c910f-1ace-4b75-b84a-4023a962eff0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:28.031464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a82c910f-1ace-4b75-b84a-4023a962eff0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:28.045526 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a82c910f-1ace-4b75-b84a-4023a962eff0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1315 microversion: 2.1 time: 0.773383 Mar 12 21:08:28.046399 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3268/4036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:27 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:08:29.064059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ccbbf9cd-07fa-4cdb-b2e2-b834bcfe5924 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:29.064684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ccbbf9cd-07fa-4cdb-b2e2-b834bcfe5924 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:29.075834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccbbf9cd-07fa-4cdb-b2e2-b834bcfe5924 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:29.077425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccbbf9cd-07fa-4cdb-b2e2-b834bcfe5924 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:29.081080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccbbf9cd-07fa-4cdb-b2e2-b834bcfe5924 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:29.081829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccbbf9cd-07fa-4cdb-b2e2-b834bcfe5924 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:29.590588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ccbbf9cd-07fa-4cdb-b2e2-b834bcfe5924 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:29.598588 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ccbbf9cd-07fa-4cdb-b2e2-b834bcfe5924 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1315 microversion: 2.1 time: 0.538427 Mar 12 21:08:29.599559 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3269/4037] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:29 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:30.618715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-91d32136-a059-4e49-80b7-428ae3ab8411 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:30.620159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-91d32136-a059-4e49-80b7-428ae3ab8411 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:30.630332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91d32136-a059-4e49-80b7-428ae3ab8411 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:30.630706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91d32136-a059-4e49-80b7-428ae3ab8411 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:30.636378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91d32136-a059-4e49-80b7-428ae3ab8411 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:30.637099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91d32136-a059-4e49-80b7-428ae3ab8411 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:31.416793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-91d32136-a059-4e49-80b7-428ae3ab8411 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:31.428311 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-91d32136-a059-4e49-80b7-428ae3ab8411 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1315 microversion: 2.1 time: 0.815998 Mar 12 21:08:31.439159 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3270/4038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:30 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:31.452375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3b733576-da2c-4b6a-8f17-0a5d274c2766 req-830052ea-7d37-4287-86bd-ee701ff1c564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da478e7-a161-41dc-8c25-faf4d7bb4a3b", "name": "network-vif-plugged", "status": "completed", "tag": "bdd7bc75-5486-4691-9a8c-e30a02907757"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:31.474871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3b733576-da2c-4b6a-8f17-0a5d274c2766 req-830052ea-7d37-4287-86bd-ee701ff1c564 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:31.475378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3b733576-da2c-4b6a-8f17-0a5d274c2766 req-830052ea-7d37-4287-86bd-ee701ff1c564 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:31.506597 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3b733576-da2c-4b6a-8f17-0a5d274c2766 req-830052ea-7d37-4287-86bd-ee701ff1c564 service nova] Creating event network-vif-plugged:bdd7bc75-5486-4691-9a8c-e30a02907757 for instance 0da478e7-a161-41dc-8c25-faf4d7bb4a3b on nch2-master-1 Mar 12 21:08:31.519742 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3b733576-da2c-4b6a-8f17-0a5d274c2766 req-830052ea-7d37-4287-86bd-ee701ff1c564 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077609 Mar 12 21:08:31.523505 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3271/4039] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:32.448212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a9d28ece-969e-42d3-83b0-2bc6a6f83fb0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:32.448929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a9d28ece-969e-42d3-83b0-2bc6a6f83fb0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:32.456865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9d28ece-969e-42d3-83b0-2bc6a6f83fb0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:32.459744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9d28ece-969e-42d3-83b0-2bc6a6f83fb0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:32.462545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9d28ece-969e-42d3-83b0-2bc6a6f83fb0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:32.463348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9d28ece-969e-42d3-83b0-2bc6a6f83fb0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:33.091637 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:08:33.092200 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:08:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:08:33.261038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a9d28ece-969e-42d3-83b0-2bc6a6f83fb0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:33.268604 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a9d28ece-969e-42d3-83b0-2bc6a6f83fb0 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1315 microversion: 2.1 time: 0.826057 Mar 12 21:08:33.270102 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3272/4040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:32 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:33.290799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-728340900", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94a25897-3a88-44fe-b618-77b90965f553"}], "security_groups": [{"name": "tempest-securitygroup--953600977"}], "key_name": "tempest-keypair-189980980", "user_data": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:33.872622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] validate_networks() for [('94a25897-3a88-44fe-b618-77b90965f553', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:08:35.542937 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:08:35.543566 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:08:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:08:35.767703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:08:35.768217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:08:35.768531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:08:35.769781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:08:35.770505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:08:35.789226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:35.791633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:35.793083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:35.795611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:35.858269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for project 2f427010b06749289b20e8b776a8b8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:08:35.876002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for user f2c8058e4e8d475c9377a065b4018a2a and project 2f427010b06749289b20e8b776a8b8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:08:35.954355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:08:36.006669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:08:36.175436 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-68c2cb93-2b58-41a6-adb3-fffbf8261073 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.903790 Mar 12 21:08:36.176134 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3273/4041] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:08:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 2905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:08:36.194126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1622e649-8e3e-4adf-b417-c078d33218e2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:36.196007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1622e649-8e3e-4adf-b417-c078d33218e2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:36.207589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1622e649-8e3e-4adf-b417-c078d33218e2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:36.208373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1622e649-8e3e-4adf-b417-c078d33218e2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:36.210057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1622e649-8e3e-4adf-b417-c078d33218e2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:36.211384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1622e649-8e3e-4adf-b417-c078d33218e2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:36.727186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1622e649-8e3e-4adf-b417-c078d33218e2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:36.756515 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1622e649-8e3e-4adf-b417-c078d33218e2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1502 microversion: 2.1 time: 0.578695 Mar 12 21:08:36.775353 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3274/4042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:36 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1502 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:36.780427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-971733c0-a05d-4c1a-85e1-e6796244e599 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:36.781075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-971733c0-a05d-4c1a-85e1-e6796244e599 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:36.943676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-971733c0-a05d-4c1a-85e1-e6796244e599 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:36.952056 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-971733c0-a05d-4c1a-85e1-e6796244e599 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1240 microversion: 2.1 time: 0.175509 Mar 12 21:08:36.952655 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3275/4043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:36 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1240 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:36.967161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-74a84ea7-abae-4e4e-ac58-313a39283042 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:36.994512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74a84ea7-abae-4e4e-ac58-313a39283042 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:36.995253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74a84ea7-abae-4e4e-ac58-313a39283042 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:37.048731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-74a84ea7-abae-4e4e-ac58-313a39283042 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Going to try to stop instance {{(pid=136302) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 12 21:08:37.200097 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-74a84ea7-abae-4e4e-ac58-313a39283042 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "POST /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b/action" status: 202 len: 0 microversion: 2.1 time: 0.227997 Mar 12 21:08:37.206107 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3276/4044] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:08:36 2022] POST /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:08:37.223451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-729446e5-c5c3-469c-a260-b1bd41fe9626 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:37.229047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-729446e5-c5c3-469c-a260-b1bd41fe9626 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:37.253229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-729446e5-c5c3-469c-a260-b1bd41fe9626 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:37.254153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-729446e5-c5c3-469c-a260-b1bd41fe9626 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:37.258199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-729446e5-c5c3-469c-a260-b1bd41fe9626 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:37.263624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-729446e5-c5c3-469c-a260-b1bd41fe9626 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:38.460156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-729446e5-c5c3-469c-a260-b1bd41fe9626 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:38.471211 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-729446e5-c5c3-469c-a260-b1bd41fe9626 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 1.260092 Mar 12 21:08:38.472135 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3277/4045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:37 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:38.482751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f8b6a4ac-dac3-4ae4-b3fc-07881823051a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:38.483666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f8b6a4ac-dac3-4ae4-b3fc-07881823051a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:38.498566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8b6a4ac-dac3-4ae4-b3fc-07881823051a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:38.500044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8b6a4ac-dac3-4ae4-b3fc-07881823051a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:38.501455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8b6a4ac-dac3-4ae4-b3fc-07881823051a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:38.502391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8b6a4ac-dac3-4ae4-b3fc-07881823051a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:39.522230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f8b6a4ac-dac3-4ae4-b3fc-07881823051a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:39.535188 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f8b6a4ac-dac3-4ae4-b3fc-07881823051a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1300 microversion: 2.1 time: 1.057114 Mar 12 21:08:39.536188 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3278/4046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:38 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1300 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:39.564272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca2574d2-9128-419c-a5f2-0285ab3a63db tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:39.598315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ca2574d2-9128-419c-a5f2-0285ab3a63db tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:39.644877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca2574d2-9128-419c-a5f2-0285ab3a63db tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:39.644877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca2574d2-9128-419c-a5f2-0285ab3a63db tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:39.656719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca2574d2-9128-419c-a5f2-0285ab3a63db tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:39.657323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca2574d2-9128-419c-a5f2-0285ab3a63db tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:41.145936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca2574d2-9128-419c-a5f2-0285ab3a63db tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:41.185641 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca2574d2-9128-419c-a5f2-0285ab3a63db tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 1.647477 Mar 12 21:08:41.186295 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3279/4047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:39 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:41.225004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b01558ec-b87c-4e85-99eb-58c81cf11cb1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:41.225881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b01558ec-b87c-4e85-99eb-58c81cf11cb1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:41.258745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b01558ec-b87c-4e85-99eb-58c81cf11cb1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:41.262457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b01558ec-b87c-4e85-99eb-58c81cf11cb1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:41.268281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b01558ec-b87c-4e85-99eb-58c81cf11cb1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:41.269867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b01558ec-b87c-4e85-99eb-58c81cf11cb1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:41.508222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b01558ec-b87c-4e85-99eb-58c81cf11cb1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:41.520896 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b01558ec-b87c-4e85-99eb-58c81cf11cb1 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1298 microversion: 2.1 time: 0.327783 Mar 12 21:08:41.532421 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3280/4048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:41 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1298 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:42.204837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce76a10a-f6e2-407f-8a84-96df0a528357 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:42.206268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce76a10a-f6e2-407f-8a84-96df0a528357 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:42.214798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce76a10a-f6e2-407f-8a84-96df0a528357 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:42.219687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce76a10a-f6e2-407f-8a84-96df0a528357 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:42.221201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce76a10a-f6e2-407f-8a84-96df0a528357 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:42.221824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce76a10a-f6e2-407f-8a84-96df0a528357 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:43.220824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce76a10a-f6e2-407f-8a84-96df0a528357 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:43.231893 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce76a10a-f6e2-407f-8a84-96df0a528357 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 1.031161 Mar 12 21:08:43.233752 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3281/4049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:42 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:08:43.243559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ea76767-91e2-4d52-90b9-9188884483ff tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:43.245909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ea76767-91e2-4d52-90b9-9188884483ff tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:43.257240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ea76767-91e2-4d52-90b9-9188884483ff tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:43.258142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ea76767-91e2-4d52-90b9-9188884483ff tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:43.259365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ea76767-91e2-4d52-90b9-9188884483ff tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:43.259985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ea76767-91e2-4d52-90b9-9188884483ff tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:43.872619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9ea76767-91e2-4d52-90b9-9188884483ff tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:43.885841 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ea76767-91e2-4d52-90b9-9188884483ff tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1365 microversion: 2.1 time: 0.650045 Mar 12 21:08:43.897662 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3282/4050] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:43 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1365 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:44.258070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d20132b0-51b5-41fb-85a1-44e56d95dff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:44.258849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d20132b0-51b5-41fb-85a1-44e56d95dff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:44.278793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d20132b0-51b5-41fb-85a1-44e56d95dff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:44.280471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d20132b0-51b5-41fb-85a1-44e56d95dff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:44.282804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d20132b0-51b5-41fb-85a1-44e56d95dff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:44.285601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d20132b0-51b5-41fb-85a1-44e56d95dff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:45.545655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d20132b0-51b5-41fb-85a1-44e56d95dff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:45.564672 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d20132b0-51b5-41fb-85a1-44e56d95dff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 1.316480 Mar 12 21:08:45.565610 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3283/4051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:44 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:08:45.571923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-03ef4a5f-0d8c-450a-917b-f95109babf6d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:45.572809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-03ef4a5f-0d8c-450a-917b-f95109babf6d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:45.581108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03ef4a5f-0d8c-450a-917b-f95109babf6d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:45.583634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03ef4a5f-0d8c-450a-917b-f95109babf6d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:45.585466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03ef4a5f-0d8c-450a-917b-f95109babf6d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:45.586358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03ef4a5f-0d8c-450a-917b-f95109babf6d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:46.360304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-03ef4a5f-0d8c-450a-917b-f95109babf6d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:46.387817 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-03ef4a5f-0d8c-450a-917b-f95109babf6d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1365 microversion: 2.1 time: 0.820153 Mar 12 21:08:46.388545 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3284/4052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:45 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1365 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:46.586072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-31025c7b-2a04-4d88-8937-31c74ba1328c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:46.586905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-31025c7b-2a04-4d88-8937-31c74ba1328c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:46.600812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31025c7b-2a04-4d88-8937-31c74ba1328c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:46.602745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31025c7b-2a04-4d88-8937-31c74ba1328c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:46.605620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31025c7b-2a04-4d88-8937-31c74ba1328c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:46.607478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31025c7b-2a04-4d88-8937-31c74ba1328c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:47.218342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-31025c7b-2a04-4d88-8937-31c74ba1328c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:47.235647 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-31025c7b-2a04-4d88-8937-31c74ba1328c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 0.654835 Mar 12 21:08:47.236280 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3285/4053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:46 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:47.248355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f5d9cbfc-e9ad-4a4e-87a1-cfdd500f0b2e req-d925c95c-08c1-47e6-b351-01d5b6f4a250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5630c6-2e87-4f5c-898a-646c3a54bad2", "tag": "ba9170e6-98eb-4fa5-b253-d9171cbe3f66"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:47.271241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f5d9cbfc-e9ad-4a4e-87a1-cfdd500f0b2e req-d925c95c-08c1-47e6-b351-01d5b6f4a250 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:47.272030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f5d9cbfc-e9ad-4a4e-87a1-cfdd500f0b2e req-d925c95c-08c1-47e6-b351-01d5b6f4a250 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:47.312976 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f5d9cbfc-e9ad-4a4e-87a1-cfdd500f0b2e req-d925c95c-08c1-47e6-b351-01d5b6f4a250 service nova] Creating event network-changed:ba9170e6-98eb-4fa5-b253-d9171cbe3f66 for instance 1f5630c6-2e87-4f5c-898a-646c3a54bad2 on nch1-master-1 Mar 12 21:08:47.323180 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f5d9cbfc-e9ad-4a4e-87a1-cfdd500f0b2e req-d925c95c-08c1-47e6-b351-01d5b6f4a250 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085617 Mar 12 21:08:47.323947 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3286/4054] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:47.407436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f155778-d70e-4183-a022-7c4ca7024a84 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:47.408656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f155778-d70e-4183-a022-7c4ca7024a84 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:47.447035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f155778-d70e-4183-a022-7c4ca7024a84 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:47.447701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f155778-d70e-4183-a022-7c4ca7024a84 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:47.449398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f155778-d70e-4183-a022-7c4ca7024a84 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:47.454219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f155778-d70e-4183-a022-7c4ca7024a84 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:48.114284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f155778-d70e-4183-a022-7c4ca7024a84 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:48.125670 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f155778-d70e-4183-a022-7c4ca7024a84 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1365 microversion: 2.1 time: 0.723436 Mar 12 21:08:48.136402 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3287/4055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:47 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1365 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:08:48.253242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-53b7e74a-ce0b-4e76-9512-8269ae379843 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:48.254292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-53b7e74a-ce0b-4e76-9512-8269ae379843 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:48.265618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53b7e74a-ce0b-4e76-9512-8269ae379843 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:48.266769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53b7e74a-ce0b-4e76-9512-8269ae379843 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:48.268025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53b7e74a-ce0b-4e76-9512-8269ae379843 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:48.268568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53b7e74a-ce0b-4e76-9512-8269ae379843 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:48.607360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-53b7e74a-ce0b-4e76-9512-8269ae379843 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:48.630052 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-53b7e74a-ce0b-4e76-9512-8269ae379843 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 0.381361 Mar 12 21:08:48.632061 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3288/4056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:48 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:49.144079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aad8b5e7-595e-48c7-8274-eeb3f348196f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:49.144589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aad8b5e7-595e-48c7-8274-eeb3f348196f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:49.166523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aad8b5e7-595e-48c7-8274-eeb3f348196f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:49.167672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aad8b5e7-595e-48c7-8274-eeb3f348196f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:49.169039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aad8b5e7-595e-48c7-8274-eeb3f348196f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:49.169910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aad8b5e7-595e-48c7-8274-eeb3f348196f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:49.908183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aad8b5e7-595e-48c7-8274-eeb3f348196f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:49.924737 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aad8b5e7-595e-48c7-8274-eeb3f348196f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1365 microversion: 2.1 time: 0.785044 Mar 12 21:08:49.926015 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3289/4057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:49 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1365 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:08:49.933641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bef6bb07-0dff-4a6c-9032-e4ba11f7fc3d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:49.934580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bef6bb07-0dff-4a6c-9032-e4ba11f7fc3d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:49.946521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bef6bb07-0dff-4a6c-9032-e4ba11f7fc3d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:49.947638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bef6bb07-0dff-4a6c-9032-e4ba11f7fc3d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:49.958212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bef6bb07-0dff-4a6c-9032-e4ba11f7fc3d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:49.961346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bef6bb07-0dff-4a6c-9032-e4ba11f7fc3d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:50.413186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bef6bb07-0dff-4a6c-9032-e4ba11f7fc3d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:50.426317 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bef6bb07-0dff-4a6c-9032-e4ba11f7fc3d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 0.498676 Mar 12 21:08:50.427510 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3290/4058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:49 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:50.943314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-df774c44-9090-4ca0-ac9b-6bb6885e3f17 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:50.944338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-df774c44-9090-4ca0-ac9b-6bb6885e3f17 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:50.957304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df774c44-9090-4ca0-ac9b-6bb6885e3f17 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:50.959570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df774c44-9090-4ca0-ac9b-6bb6885e3f17 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:50.960702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df774c44-9090-4ca0-ac9b-6bb6885e3f17 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:50.962455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df774c44-9090-4ca0-ac9b-6bb6885e3f17 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:51.884684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-df774c44-9090-4ca0-ac9b-6bb6885e3f17 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:51.893535 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-df774c44-9090-4ca0-ac9b-6bb6885e3f17 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1365 microversion: 2.1 time: 0.954900 Mar 12 21:08:51.895627 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3291/4059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:50 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1365 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:51.900535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a00f3f67-089c-4826-ba55-963888e09c7d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:51.901460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a00f3f67-089c-4826-ba55-963888e09c7d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:51.908628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a00f3f67-089c-4826-ba55-963888e09c7d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:51.909106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a00f3f67-089c-4826-ba55-963888e09c7d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:51.922603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a00f3f67-089c-4826-ba55-963888e09c7d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:51.923281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a00f3f67-089c-4826-ba55-963888e09c7d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:52.129701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a00f3f67-089c-4826-ba55-963888e09c7d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:52.140411 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a00f3f67-089c-4826-ba55-963888e09c7d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 0.243153 Mar 12 21:08:52.142321 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3292/4060] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:51 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:53.270168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-14aa2a8e-2644-4ec5-b0ea-07c42cc49f8c req-9519f4d4-400e-471b-a237-ecc95cef0997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5630c6-2e87-4f5c-898a-646c3a54bad2", "name": "network-vif-plugged", "status": "completed", "tag": "ba9170e6-98eb-4fa5-b253-d9171cbe3f66"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:08:53.280236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-14aa2a8e-2644-4ec5-b0ea-07c42cc49f8c req-9519f4d4-400e-471b-a237-ecc95cef0997 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:53.280915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-14aa2a8e-2644-4ec5-b0ea-07c42cc49f8c req-9519f4d4-400e-471b-a237-ecc95cef0997 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:53.296070 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-14aa2a8e-2644-4ec5-b0ea-07c42cc49f8c req-9519f4d4-400e-471b-a237-ecc95cef0997 service nova] Creating event network-vif-plugged:ba9170e6-98eb-4fa5-b253-d9171cbe3f66 for instance 1f5630c6-2e87-4f5c-898a-646c3a54bad2 on nch1-master-1 Mar 12 21:08:53.302107 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-14aa2a8e-2644-4ec5-b0ea-07c42cc49f8c req-9519f4d4-400e-471b-a237-ecc95cef0997 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.427213 Mar 12 21:08:53.302921 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3293/4061] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:53.310308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-efb82b84-40c6-48d6-8551-4eb805a68c86 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:53.311009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-efb82b84-40c6-48d6-8551-4eb805a68c86 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:53.323801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb82b84-40c6-48d6-8551-4eb805a68c86 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:53.324261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb82b84-40c6-48d6-8551-4eb805a68c86 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:53.325054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb82b84-40c6-48d6-8551-4eb805a68c86 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:53.325497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efb82b84-40c6-48d6-8551-4eb805a68c86 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:53.926833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-efb82b84-40c6-48d6-8551-4eb805a68c86 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:53.940262 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-efb82b84-40c6-48d6-8551-4eb805a68c86 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1365 microversion: 2.1 time: 0.635985 Mar 12 21:08:53.941818 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3294/4062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:53 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1365 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:53.954104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be75a6f6-3c18-4a21-a519-bdca2629208a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:53.954947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-be75a6f6-3c18-4a21-a519-bdca2629208a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:53.963195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be75a6f6-3c18-4a21-a519-bdca2629208a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:53.963920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be75a6f6-3c18-4a21-a519-bdca2629208a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:53.964699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be75a6f6-3c18-4a21-a519-bdca2629208a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:53.965294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be75a6f6-3c18-4a21-a519-bdca2629208a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:54.184429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be75a6f6-3c18-4a21-a519-bdca2629208a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:54.192827 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be75a6f6-3c18-4a21-a519-bdca2629208a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 0.249685 Mar 12 21:08:54.193647 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3295/4063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:53 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:54.960497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c0330c61-ee49-4b7a-846d-a159d99cd6d5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:54.962597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c0330c61-ee49-4b7a-846d-a159d99cd6d5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:54.970008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0330c61-ee49-4b7a-846d-a159d99cd6d5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:54.970787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0330c61-ee49-4b7a-846d-a159d99cd6d5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:54.971955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0330c61-ee49-4b7a-846d-a159d99cd6d5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:54.972738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0330c61-ee49-4b7a-846d-a159d99cd6d5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:55.395131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0330c61-ee49-4b7a-846d-a159d99cd6d5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:55.408280 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c0330c61-ee49-4b7a-846d-a159d99cd6d5 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1365 microversion: 2.1 time: 0.454194 Mar 12 21:08:55.419458 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3296/4064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:54 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1365 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:55.426612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5aa340fa-5ceb-46ed-870e-29b59319acc1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:55.427677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5aa340fa-5ceb-46ed-870e-29b59319acc1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:55.438153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5aa340fa-5ceb-46ed-870e-29b59319acc1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:55.438153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5aa340fa-5ceb-46ed-870e-29b59319acc1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:55.438153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5aa340fa-5ceb-46ed-870e-29b59319acc1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:55.438449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5aa340fa-5ceb-46ed-870e-29b59319acc1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:55.801709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5aa340fa-5ceb-46ed-870e-29b59319acc1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:55.814679 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5aa340fa-5ceb-46ed-870e-29b59319acc1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 0.393456 Mar 12 21:08:55.818549 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3297/4065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:55 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:56.427678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dda5e568-e850-4817-871f-a3088b36f7c7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:56.428334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dda5e568-e850-4817-871f-a3088b36f7c7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:56.437222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dda5e568-e850-4817-871f-a3088b36f7c7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:56.437674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dda5e568-e850-4817-871f-a3088b36f7c7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:56.438493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dda5e568-e850-4817-871f-a3088b36f7c7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:56.438950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dda5e568-e850-4817-871f-a3088b36f7c7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:56.839141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dda5e568-e850-4817-871f-a3088b36f7c7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:56.852977 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dda5e568-e850-4817-871f-a3088b36f7c7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1555 microversion: 2.1 time: 0.430444 Mar 12 21:08:56.853998 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3298/4066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:56 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1555 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:08:56.867880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ce4d22b-7ec3-4bf5-9703-2d697b67e6cc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:56.869882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ce4d22b-7ec3-4bf5-9703-2d697b67e6cc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:56.890736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ce4d22b-7ec3-4bf5-9703-2d697b67e6cc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:56.892569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ce4d22b-7ec3-4bf5-9703-2d697b67e6cc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:56.897707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ce4d22b-7ec3-4bf5-9703-2d697b67e6cc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:56.898464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ce4d22b-7ec3-4bf5-9703-2d697b67e6cc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:57.347658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ce4d22b-7ec3-4bf5-9703-2d697b67e6cc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:57.359375 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ce4d22b-7ec3-4bf5-9703-2d697b67e6cc tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 0.502402 Mar 12 21:08:57.360009 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3299/4067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:56 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:08:57.374263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f662fa4-8821-4ecc-84ce-c37430bc768d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:57.376192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6f662fa4-8821-4ecc-84ce-c37430bc768d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:57.394119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f662fa4-8821-4ecc-84ce-c37430bc768d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:57.397921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f662fa4-8821-4ecc-84ce-c37430bc768d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:57.402449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f662fa4-8821-4ecc-84ce-c37430bc768d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:57.403626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f662fa4-8821-4ecc-84ce-c37430bc768d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:57.646085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f662fa4-8821-4ecc-84ce-c37430bc768d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283931 Mar 12 21:08:57.647861 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3300/4068] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 21:08:57 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/os-interface => generated 284 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:08:58.376756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a17ef415-fee0-4dd4-b2ef-c0cd7c199d0d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:08:58.377368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a17ef415-fee0-4dd4-b2ef-c0cd7c199d0d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:08:58.388770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a17ef415-fee0-4dd4-b2ef-c0cd7c199d0d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:58.389604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a17ef415-fee0-4dd4-b2ef-c0cd7c199d0d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:58.392836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a17ef415-fee0-4dd4-b2ef-c0cd7c199d0d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:08:58.393509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a17ef415-fee0-4dd4-b2ef-c0cd7c199d0d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:08:59.132690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a17ef415-fee0-4dd4-b2ef-c0cd7c199d0d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:08:59.140449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a17ef415-fee0-4dd4-b2ef-c0cd7c199d0d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 0.767747 Mar 12 21:08:59.149847 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3301/4069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:08:58 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:09:00.167547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dababe0d-7a10-4de3-8964-f7a3c56623cf tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:00.168174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dababe0d-7a10-4de3-8964-f7a3c56623cf tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:00.176549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dababe0d-7a10-4de3-8964-f7a3c56623cf tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:00.177036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dababe0d-7a10-4de3-8964-f7a3c56623cf tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:00.177833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dababe0d-7a10-4de3-8964-f7a3c56623cf tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:00.178275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dababe0d-7a10-4de3-8964-f7a3c56623cf tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:00.803090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dababe0d-7a10-4de3-8964-f7a3c56623cf tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:00.829355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dababe0d-7a10-4de3-8964-f7a3c56623cf tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 0.665253 Mar 12 21:09:00.831399 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3302/4070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:00 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:09:01.256110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c4d72d66-dc23-4453-b446-a77b761a55e0 req-aeb2d23d-da1c-4a0f-ab7b-9b4d3315cedf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5630c6-2e87-4f5c-898a-646c3a54bad2", "tag": "ba9170e6-98eb-4fa5-b253-d9171cbe3f66"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:01.290967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c4d72d66-dc23-4453-b446-a77b761a55e0 req-aeb2d23d-da1c-4a0f-ab7b-9b4d3315cedf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:01.293964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c4d72d66-dc23-4453-b446-a77b761a55e0 req-aeb2d23d-da1c-4a0f-ab7b-9b4d3315cedf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:01.367027 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c4d72d66-dc23-4453-b446-a77b761a55e0 req-aeb2d23d-da1c-4a0f-ab7b-9b4d3315cedf service nova] Creating event network-changed:ba9170e6-98eb-4fa5-b253-d9171cbe3f66 for instance 1f5630c6-2e87-4f5c-898a-646c3a54bad2 on nch1-master-1 Mar 12 21:09:01.373631 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c4d72d66-dc23-4453-b446-a77b761a55e0 req-aeb2d23d-da1c-4a0f-ab7b-9b4d3315cedf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122293 Mar 12 21:09:01.374937 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3303/4071] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:09:01.856272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-24b4af9e-b709-4aa7-b659-f199b8f83f6f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:01.858235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-24b4af9e-b709-4aa7-b659-f199b8f83f6f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:01.875187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24b4af9e-b709-4aa7-b659-f199b8f83f6f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:01.875984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24b4af9e-b709-4aa7-b659-f199b8f83f6f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:01.878751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24b4af9e-b709-4aa7-b659-f199b8f83f6f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:01.879756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24b4af9e-b709-4aa7-b659-f199b8f83f6f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:02.853244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-24b4af9e-b709-4aa7-b659-f199b8f83f6f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:02.861529 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-24b4af9e-b709-4aa7-b659-f199b8f83f6f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1512 microversion: 2.1 time: 1.012577 Mar 12 21:09:02.871785 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3304/4072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:01 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1512 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:03.902003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25b355fa-7b5b-4b89-80b5-87bab24d76c7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:03.902003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-25b355fa-7b5b-4b89-80b5-87bab24d76c7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:03.927308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25b355fa-7b5b-4b89-80b5-87bab24d76c7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:03.928755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25b355fa-7b5b-4b89-80b5-87bab24d76c7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:03.930323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25b355fa-7b5b-4b89-80b5-87bab24d76c7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:03.931544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25b355fa-7b5b-4b89-80b5-87bab24d76c7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:05.445676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-25b355fa-7b5b-4b89-80b5-87bab24d76c7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:05.466735 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-25b355fa-7b5b-4b89-80b5-87bab24d76c7 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1489 microversion: 2.1 time: 1.573521 Mar 12 21:09:05.476419 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3305/4073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:03 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1489 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:05.494220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1fdab434-de07-474d-abf7-b7c7842c2061 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:05.495799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1fdab434-de07-474d-abf7-b7c7842c2061 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:05.509146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fdab434-de07-474d-abf7-b7c7842c2061 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:05.511051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fdab434-de07-474d-abf7-b7c7842c2061 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:05.512476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fdab434-de07-474d-abf7-b7c7842c2061 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:05.513084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fdab434-de07-474d-abf7-b7c7842c2061 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:05.589424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1fdab434-de07-474d-abf7-b7c7842c2061 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:09:05.761021 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1fdab434-de07-474d-abf7-b7c7842c2061 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 204 len: 0 microversion: 2.1 time: 0.272254 Mar 12 21:09:05.764854 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3306/4074] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:09:05 2022] DELETE /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:09:05.771447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c3397eb-d4ef-4643-aa8f-baf29d1404c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:05.772469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c3397eb-d4ef-4643-aa8f-baf29d1404c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:05.779699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3397eb-d4ef-4643-aa8f-baf29d1404c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:05.780163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3397eb-d4ef-4643-aa8f-baf29d1404c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:05.781193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3397eb-d4ef-4643-aa8f-baf29d1404c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:05.781651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3397eb-d4ef-4643-aa8f-baf29d1404c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:06.428852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c3397eb-d4ef-4643-aa8f-baf29d1404c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:06.445419 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c3397eb-d4ef-4643-aa8f-baf29d1404c2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1495 microversion: 2.1 time: 0.678236 Mar 12 21:09:06.447324 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3307/4075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:05 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1495 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:07.464893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a4d6294-5b2f-472f-ae90-7040891c9d12 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:07.466531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a4d6294-5b2f-472f-ae90-7040891c9d12 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:07.488444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a4d6294-5b2f-472f-ae90-7040891c9d12 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:07.490199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a4d6294-5b2f-472f-ae90-7040891c9d12 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:07.493825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a4d6294-5b2f-472f-ae90-7040891c9d12 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:07.494604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a4d6294-5b2f-472f-ae90-7040891c9d12 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:08.614850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9a4d6294-5b2f-472f-ae90-7040891c9d12 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:08.627505 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a4d6294-5b2f-472f-ae90-7040891c9d12 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 200 len: 1495 microversion: 2.1 time: 1.167757 Mar 12 21:09:08.635554 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3308/4076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:07 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 1495 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:09.081321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9592edc4-707c-4d54-8981-564fa3783e35 req-36543907-82ff-42fd-89c8-d07dce9d2767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da478e7-a161-41dc-8c25-faf4d7bb4a3b", "name": "network-vif-deleted", "tag": "bdd7bc75-5486-4691-9a8c-e30a02907757"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:09.110764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9592edc4-707c-4d54-8981-564fa3783e35 req-36543907-82ff-42fd-89c8-d07dce9d2767 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:09.111375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9592edc4-707c-4d54-8981-564fa3783e35 req-36543907-82ff-42fd-89c8-d07dce9d2767 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:09.124671 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9592edc4-707c-4d54-8981-564fa3783e35 req-36543907-82ff-42fd-89c8-d07dce9d2767 service nova] Creating event network-vif-deleted:bdd7bc75-5486-4691-9a8c-e30a02907757 for instance 0da478e7-a161-41dc-8c25-faf4d7bb4a3b on nch2-master-1 Mar 12 21:09:09.144898 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9592edc4-707c-4d54-8981-564fa3783e35 req-36543907-82ff-42fd-89c8-d07dce9d2767 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.501752 Mar 12 21:09:09.150456 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3309/4077] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:09:09.652464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc144dc1-547e-474f-ab24-783f1d58079e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:09.653239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc144dc1-547e-474f-ab24-783f1d58079e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:09.679297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc144dc1-547e-474f-ab24-783f1d58079e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:09.679758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc144dc1-547e-474f-ab24-783f1d58079e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:09.680564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc144dc1-547e-474f-ab24-783f1d58079e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:09.681008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc144dc1-547e-474f-ab24-783f1d58079e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:09.731410 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-dc144dc1-547e-474f-ab24-783f1d58079e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance 0da478e7-a161-41dc-8c25-faf4d7bb4a3b could not be found. Mar 12 21:09:09.737567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc144dc1-547e-474f-ab24-783f1d58079e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance 0da478e7-a161-41dc-8c25-faf4d7bb4a3b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:09.738712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc144dc1-547e-474f-ab24-783f1d58079e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 404 len: 111 microversion: 2.1 time: 0.090747 Mar 12 21:09:09.746197 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3310/4078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:09 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:10.003199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-940927002", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "3bc356e1-2fe7-4340-aecb-f85636b06883"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:10.097140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] validate_networks() for [('3bc356e1-2fe7-4340-aecb-f85636b06883', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:09:13.487067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:09:13.487914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:09:13.489933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:09:13.490999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:09:13.491775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:09:13.519595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:13.522504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:13.524204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:13.524824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:13.595852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:09:13.607371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Getting quotas for user 10e1e3bae5b94b5589b47488329ad756 and project 4a2c21b1992d496bab772b5ff8f601a8. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:09:13.649598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:09:13.662224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:09:13.802987 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c926812b-dcba-482e-9e29-89f452461fa6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.798330 Mar 12 21:09:13.804494 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3311/4079] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:09:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:09:13.832173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-101850db-9407-406e-b25c-117e236a55c1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:13.833096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-101850db-9407-406e-b25c-117e236a55c1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:14.044590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-101850db-9407-406e-b25c-117e236a55c1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:14.066360 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-101850db-9407-406e-b25c-117e236a55c1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1214 microversion: 2.1 time: 0.253848 Mar 12 21:09:14.083801 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3312/4080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:13 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1214 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:14.575758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b7e94afc-7267-42e0-9057-b0403aae64db tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'create', calling method: .version_select at 0x7f6e354ce040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-917593377"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:14.637850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b7e94afc-7267-42e0-9057-b0403aae64db tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:09:14.655887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b7e94afc-7267-42e0-9057-b0403aae64db tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for user 43f35f32a8064500a8d8412f19697b93 and project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:09:15.487282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b7e94afc-7267-42e0-9057-b0403aae64db tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:09:15.505553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b7e94afc-7267-42e0-9057-b0403aae64db tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for user 43f35f32a8064500a8d8412f19697b93 and project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:09:15.539980 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b7e94afc-7267-42e0-9057-b0403aae64db tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 1.443415 Mar 12 21:09:15.541743 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3313/4081] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:09:14 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:15.547854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0aa0ad0-e6b1-410f-9fc2-7d4681e69195 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:15.548694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b0aa0ad0-e6b1-410f-9fc2-7d4681e69195 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:15.557026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0aa0ad0-e6b1-410f-9fc2-7d4681e69195 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:15.558041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0aa0ad0-e6b1-410f-9fc2-7d4681e69195 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:15.559379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0aa0ad0-e6b1-410f-9fc2-7d4681e69195 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:15.560464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0aa0ad0-e6b1-410f-9fc2-7d4681e69195 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:16.001407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b0aa0ad0-e6b1-410f-9fc2-7d4681e69195 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:16.011156 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0aa0ad0-e6b1-410f-9fc2-7d4681e69195 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1218 microversion: 2.1 time: 0.468137 Mar 12 21:09:16.021928 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3314/4082] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:15 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1218 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:17.030339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d2195349-f396-45df-b1fd-6b0fb8138e7c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:17.031278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d2195349-f396-45df-b1fd-6b0fb8138e7c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:17.043306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2195349-f396-45df-b1fd-6b0fb8138e7c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:17.043950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2195349-f396-45df-b1fd-6b0fb8138e7c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:17.046908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2195349-f396-45df-b1fd-6b0fb8138e7c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:17.047480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2195349-f396-45df-b1fd-6b0fb8138e7c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:17.254183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d2195349-f396-45df-b1fd-6b0fb8138e7c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:17.267867 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d2195349-f396-45df-b1fd-6b0fb8138e7c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1272 microversion: 2.1 time: 0.242752 Mar 12 21:09:17.276176 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3315/4083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:17 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:18.290414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fa5511c1-2ffa-4afe-924f-798ae8af3530 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:18.291302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fa5511c1-2ffa-4afe-924f-798ae8af3530 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:18.313309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa5511c1-2ffa-4afe-924f-798ae8af3530 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:18.317811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa5511c1-2ffa-4afe-924f-798ae8af3530 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:18.322778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa5511c1-2ffa-4afe-924f-798ae8af3530 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:18.323739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa5511c1-2ffa-4afe-924f-798ae8af3530 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:18.497795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fa5511c1-2ffa-4afe-924f-798ae8af3530 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:18.507095 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fa5511c1-2ffa-4afe-924f-798ae8af3530 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1272 microversion: 2.1 time: 0.222340 Mar 12 21:09:18.522851 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3316/4084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:18 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1272 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:19.528264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5dc6c9c8-c487-47fd-acb3-65867ca36745 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:19.528921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5dc6c9c8-c487-47fd-acb3-65867ca36745 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:19.536896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5dc6c9c8-c487-47fd-acb3-65867ca36745 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:19.537364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5dc6c9c8-c487-47fd-acb3-65867ca36745 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:19.538192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5dc6c9c8-c487-47fd-acb3-65867ca36745 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:19.538648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5dc6c9c8-c487-47fd-acb3-65867ca36745 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:20.037988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5dc6c9c8-c487-47fd-acb3-65867ca36745 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:20.045473 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5dc6c9c8-c487-47fd-acb3-65867ca36745 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1314 microversion: 2.1 time: 0.522005 Mar 12 21:09:20.056759 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3317/4085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:19 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:09:21.073491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b65a18a-bd0d-4e10-98d5-5e54b2e197ab tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:21.074227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b65a18a-bd0d-4e10-98d5-5e54b2e197ab tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:21.088279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b65a18a-bd0d-4e10-98d5-5e54b2e197ab tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:21.100090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b65a18a-bd0d-4e10-98d5-5e54b2e197ab tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:21.101395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b65a18a-bd0d-4e10-98d5-5e54b2e197ab tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:21.102034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b65a18a-bd0d-4e10-98d5-5e54b2e197ab tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:21.921589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8b65a18a-bd0d-4e10-98d5-5e54b2e197ab tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:21.929345 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b65a18a-bd0d-4e10-98d5-5e54b2e197ab tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1314 microversion: 2.1 time: 0.859690 Mar 12 21:09:21.941461 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3318/4086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:21 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1314 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:21.946909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-54be64bd-edcb-4ea0-b6b0-50411701c186 req-fb203219-0d90-4921-a68a-e563c924afa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95", "tag": "dfaa04e9-beb6-4fec-88cd-32fbff58db2a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:21.982461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-54be64bd-edcb-4ea0-b6b0-50411701c186 req-fb203219-0d90-4921-a68a-e563c924afa4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:21.998762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-54be64bd-edcb-4ea0-b6b0-50411701c186 req-fb203219-0d90-4921-a68a-e563c924afa4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:22.016513 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-54be64bd-edcb-4ea0-b6b0-50411701c186 req-fb203219-0d90-4921-a68a-e563c924afa4 service nova] Creating event network-changed:dfaa04e9-beb6-4fec-88cd-32fbff58db2a for instance b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 on nch2-master-1 Mar 12 21:09:22.023683 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-54be64bd-edcb-4ea0-b6b0-50411701c186 req-fb203219-0d90-4921-a68a-e563c924afa4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080342 Mar 12 21:09:22.033648 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3319/4087] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:09:22.949789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7825a4e1-de9b-4d80-a0a6-32a1f2951dfe tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:22.951159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7825a4e1-de9b-4d80-a0a6-32a1f2951dfe tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:22.966789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7825a4e1-de9b-4d80-a0a6-32a1f2951dfe tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:22.967267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7825a4e1-de9b-4d80-a0a6-32a1f2951dfe tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:22.968077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7825a4e1-de9b-4d80-a0a6-32a1f2951dfe tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:22.968531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7825a4e1-de9b-4d80-a0a6-32a1f2951dfe tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:23.696190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7825a4e1-de9b-4d80-a0a6-32a1f2951dfe tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:23.707184 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7825a4e1-de9b-4d80-a0a6-32a1f2951dfe tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1314 microversion: 2.1 time: 0.762735 Mar 12 21:09:23.721369 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3320/4088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:22 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1314 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:24.222879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7f1bf600-d523-4a5f-8744-b227d4692b0b tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:24.225909 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:09:24.225909 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:09:24.227668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f1bf600-d523-4a5f-8744-b227d4692b0b tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:24.228318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f1bf600-d523-4a5f-8744-b227d4692b0b tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:24.229313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f1bf600-d523-4a5f-8744-b227d4692b0b tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:24.230808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f1bf600-d523-4a5f-8744-b227d4692b0b tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:24.335983 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7f1bf600-d523-4a5f-8744-b227d4692b0b tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.612160 Mar 12 21:09:24.336588 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3321/4089] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Mar 12 21:09:23 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:09:24.721706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-444531383", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "d131a7f4-a222-4973-b942-0298e4b36917"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:24.823960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] validate_networks() for [('d131a7f4-a222-4973-b942-0298e4b36917', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:09:26.234199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:09:26.234759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:09:26.235129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:09:26.235555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:09:26.236042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:09:26.288195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:26.289580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:26.291754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:26.292598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:26.366997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Getting quotas for project 2cf14768345a44f4888cdb3b7254195c. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:09:26.409440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Getting quotas for user 6dd21ad54a4a4012b1b1aefd2194aa76 and project 2cf14768345a44f4888cdb3b7254195c. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:09:26.463273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:09:26.488139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:09:26.684988 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e51bcafe-945b-4505-b653-d011d84a9636 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.968662 Mar 12 21:09:26.689809 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3322/4090] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:09:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:09:26.716402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3d20b585-e4a2-4ee9-9a7f-350123eec309 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:26.717824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3d20b585-e4a2-4ee9-9a7f-350123eec309 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:26.732584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d20b585-e4a2-4ee9-9a7f-350123eec309 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:26.733307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d20b585-e4a2-4ee9-9a7f-350123eec309 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:26.736011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d20b585-e4a2-4ee9-9a7f-350123eec309 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:26.737188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d20b585-e4a2-4ee9-9a7f-350123eec309 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:27.510765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3d20b585-e4a2-4ee9-9a7f-350123eec309 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:27.519420 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3d20b585-e4a2-4ee9-9a7f-350123eec309 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1314 microversion: 2.1 time: 0.829748 Mar 12 21:09:27.522144 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3323/4091] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:26 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1314 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:27.537210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-737663fe-de84-45a7-af02-63d588ecbe7b tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:27.547370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-737663fe-de84-45a7-af02-63d588ecbe7b tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:27.647915 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-737663fe-de84-45a7-af02-63d588ecbe7b tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1328 microversion: 2.1 time: 0.114396 Mar 12 21:09:27.650831 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3324/4092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:27 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:28.539180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ed9b664c-b885-402b-9e58-9886c0d120f8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:28.539802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ed9b664c-b885-402b-9e58-9886c0d120f8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:28.551723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed9b664c-b885-402b-9e58-9886c0d120f8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:28.557755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed9b664c-b885-402b-9e58-9886c0d120f8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:28.561855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed9b664c-b885-402b-9e58-9886c0d120f8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:28.563810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed9b664c-b885-402b-9e58-9886c0d120f8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:29.552575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ed9b664c-b885-402b-9e58-9886c0d120f8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:29.569521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ed9b664c-b885-402b-9e58-9886c0d120f8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1314 microversion: 2.1 time: 1.033429 Mar 12 21:09:29.570703 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3325/4093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:28 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1314 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:09:29.584454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56b2aead-b0fe-47b7-a0bf-994d8e2edbcb tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:29.587149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-56b2aead-b0fe-47b7-a0bf-994d8e2edbcb tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:29.607310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56b2aead-b0fe-47b7-a0bf-994d8e2edbcb tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:29.610465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56b2aead-b0fe-47b7-a0bf-994d8e2edbcb tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:29.611646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56b2aead-b0fe-47b7-a0bf-994d8e2edbcb tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:29.614023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56b2aead-b0fe-47b7-a0bf-994d8e2edbcb tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:30.051431 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56b2aead-b0fe-47b7-a0bf-994d8e2edbcb tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1433 microversion: 2.1 time: 0.473231 Mar 12 21:09:30.068108 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3326/4094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:29 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1433 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:30.614225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d8e08284-fa6f-4844-99d1-a6ac4ee24f45 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:30.615389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d8e08284-fa6f-4844-99d1-a6ac4ee24f45 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:30.635274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8e08284-fa6f-4844-99d1-a6ac4ee24f45 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:30.637122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8e08284-fa6f-4844-99d1-a6ac4ee24f45 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:30.642393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8e08284-fa6f-4844-99d1-a6ac4ee24f45 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:30.642836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8e08284-fa6f-4844-99d1-a6ac4ee24f45 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:31.530710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d8e08284-fa6f-4844-99d1-a6ac4ee24f45 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:31.539193 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d8e08284-fa6f-4844-99d1-a6ac4ee24f45 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1314 microversion: 2.1 time: 0.954945 Mar 12 21:09:31.542732 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3327/4095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:30 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:31.558504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d85e6145-334a-4322-8d27-af8b332009f6 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:31.559539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d85e6145-334a-4322-8d27-af8b332009f6 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:31.577344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d85e6145-334a-4322-8d27-af8b332009f6 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:31.579706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d85e6145-334a-4322-8d27-af8b332009f6 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:31.583006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d85e6145-334a-4322-8d27-af8b332009f6 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:31.586253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d85e6145-334a-4322-8d27-af8b332009f6 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:32.431694 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d85e6145-334a-4322-8d27-af8b332009f6 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1463 microversion: 2.1 time: 0.887588 Mar 12 21:09:32.436174 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3328/4096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:31 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1463 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:32.447418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fea43d4a-db78-47a5-afcb-2070d43f21d9 req-37e9ec40-273c-4a65-a548-c0d1494c9fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95", "name": "network-vif-plugged", "status": "completed", "tag": "dfaa04e9-beb6-4fec-88cd-32fbff58db2a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:32.464933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fea43d4a-db78-47a5-afcb-2070d43f21d9 req-37e9ec40-273c-4a65-a548-c0d1494c9fbe service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:32.469624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fea43d4a-db78-47a5-afcb-2070d43f21d9 req-37e9ec40-273c-4a65-a548-c0d1494c9fbe service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:32.498460 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fea43d4a-db78-47a5-afcb-2070d43f21d9 req-37e9ec40-273c-4a65-a548-c0d1494c9fbe service nova] Creating event network-vif-plugged:dfaa04e9-beb6-4fec-88cd-32fbff58db2a for instance b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 on nch2-master-1 Mar 12 21:09:32.523097 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fea43d4a-db78-47a5-afcb-2070d43f21d9 req-37e9ec40-273c-4a65-a548-c0d1494c9fbe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083345 Mar 12 21:09:32.525624 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3329/4097] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:09:32.560080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c05c6ca-461f-47a8-9be7-c42cdf57e1d2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:32.560845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c05c6ca-461f-47a8-9be7-c42cdf57e1d2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:32.582694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c05c6ca-461f-47a8-9be7-c42cdf57e1d2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:32.583214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c05c6ca-461f-47a8-9be7-c42cdf57e1d2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:32.584063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c05c6ca-461f-47a8-9be7-c42cdf57e1d2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:32.584568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c05c6ca-461f-47a8-9be7-c42cdf57e1d2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:32.956838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9c05c6ca-461f-47a8-9be7-c42cdf57e1d2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:32.983080 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c05c6ca-461f-47a8-9be7-c42cdf57e1d2 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1314 microversion: 2.1 time: 0.427483 Mar 12 21:09:32.993440 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3330/4098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:32 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:33.301175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c6af41ea-9a97-4b3b-be2b-2fb3fd2fb222 req-fb859ae2-b1f6-43b8-b47e-d2a5df779173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b6963f2-09e1-45ab-a1e2-0f68d8ad946c", "tag": "cd7cb47b-ebe9-4200-ba03-ab745c30e69c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:33.320567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c6af41ea-9a97-4b3b-be2b-2fb3fd2fb222 req-fb859ae2-b1f6-43b8-b47e-d2a5df779173 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:33.326627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c6af41ea-9a97-4b3b-be2b-2fb3fd2fb222 req-fb859ae2-b1f6-43b8-b47e-d2a5df779173 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:33.368461 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c6af41ea-9a97-4b3b-be2b-2fb3fd2fb222 req-fb859ae2-b1f6-43b8-b47e-d2a5df779173 service nova] Creating event network-changed:cd7cb47b-ebe9-4200-ba03-ab745c30e69c for instance 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c on nch1-master-1 Mar 12 21:09:33.381344 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c6af41ea-9a97-4b3b-be2b-2fb3fd2fb222 req-fb859ae2-b1f6-43b8-b47e-d2a5df779173 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.383876 Mar 12 21:09:33.382845 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3331/4099] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:09:33.453451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ecf638b0-32e2-4d3f-9a3e-520495812a10 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:33.454364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ecf638b0-32e2-4d3f-9a3e-520495812a10 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:33.470012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecf638b0-32e2-4d3f-9a3e-520495812a10 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:33.470479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecf638b0-32e2-4d3f-9a3e-520495812a10 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:33.489623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecf638b0-32e2-4d3f-9a3e-520495812a10 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:33.495008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecf638b0-32e2-4d3f-9a3e-520495812a10 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:33.794724 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ecf638b0-32e2-4d3f-9a3e-520495812a10 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1463 microversion: 2.1 time: 0.345841 Mar 12 21:09:33.795325 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3332/4100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:33 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1463 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:09:33.999729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6263e22a-98ce-4b9f-9ff9-9e38597f46b5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:34.000684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6263e22a-98ce-4b9f-9ff9-9e38597f46b5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:34.008125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6263e22a-98ce-4b9f-9ff9-9e38597f46b5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:34.015376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6263e22a-98ce-4b9f-9ff9-9e38597f46b5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:34.016673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6263e22a-98ce-4b9f-9ff9-9e38597f46b5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:34.017327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6263e22a-98ce-4b9f-9ff9-9e38597f46b5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:34.423382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6263e22a-98ce-4b9f-9ff9-9e38597f46b5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:34.435824 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6263e22a-98ce-4b9f-9ff9-9e38597f46b5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1314 microversion: 2.1 time: 0.440063 Mar 12 21:09:34.438434 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3333/4101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:33 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:09:34.815466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7625a604-2fef-4a75-add6-6af4b0975299 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:34.817158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7625a604-2fef-4a75-add6-6af4b0975299 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:34.852000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7625a604-2fef-4a75-add6-6af4b0975299 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:34.852538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7625a604-2fef-4a75-add6-6af4b0975299 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:34.857088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7625a604-2fef-4a75-add6-6af4b0975299 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:34.858171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7625a604-2fef-4a75-add6-6af4b0975299 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:35.196074 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7625a604-2fef-4a75-add6-6af4b0975299 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1463 microversion: 2.1 time: 0.386364 Mar 12 21:09:35.200000 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3334/4102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:34 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1463 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:35.468312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cc367690-6b23-47cc-90a7-8489d788040d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:35.468312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc367690-6b23-47cc-90a7-8489d788040d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:35.485286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc367690-6b23-47cc-90a7-8489d788040d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:35.486860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc367690-6b23-47cc-90a7-8489d788040d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:35.489435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc367690-6b23-47cc-90a7-8489d788040d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:35.490860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc367690-6b23-47cc-90a7-8489d788040d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:35.940538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cc367690-6b23-47cc-90a7-8489d788040d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:35.960035 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cc367690-6b23-47cc-90a7-8489d788040d tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1501 microversion: 2.1 time: 0.504376 Mar 12 21:09:35.961585 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3335/4103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:35 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1501 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:35.978713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-554c9cd4-d77a-4f23-8e68-656319d083da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:35.979940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-554c9cd4-d77a-4f23-8e68-656319d083da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:35.998130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-554c9cd4-d77a-4f23-8e68-656319d083da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:35.999567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-554c9cd4-d77a-4f23-8e68-656319d083da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:36.001350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-554c9cd4-d77a-4f23-8e68-656319d083da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:36.004690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-554c9cd4-d77a-4f23-8e68-656319d083da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:36.047663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-554c9cd4-d77a-4f23-8e68-656319d083da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lazy-loading 'flavor' on Instance uuid b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:09:36.199178 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-554c9cd4-d77a-4f23-8e68-656319d083da tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "POST /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95/action" status: 202 len: 0 microversion: 2.1 time: 0.224899 Mar 12 21:09:36.199844 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3336/4104] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:09:35 2022] POST /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:09:36.216279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7ee5479f-9291-4b35-a1da-31d6e6980e9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:36.218766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7ee5479f-9291-4b35-a1da-31d6e6980e9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:36.243570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ee5479f-9291-4b35-a1da-31d6e6980e9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:36.244833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ee5479f-9291-4b35-a1da-31d6e6980e9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:36.247781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ee5479f-9291-4b35-a1da-31d6e6980e9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:36.248331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ee5479f-9291-4b35-a1da-31d6e6980e9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:36.574435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7ee5479f-9291-4b35-a1da-31d6e6980e9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:36.582472 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7ee5479f-9291-4b35-a1da-31d6e6980e9f tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1509 microversion: 2.1 time: 0.378186 Mar 12 21:09:36.583067 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3337/4105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:36 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1509 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:36.595959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-050d8474-5a71-447d-b13c-41da0fc3f117 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:36.599961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-050d8474-5a71-447d-b13c-41da0fc3f117 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:36.625745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-050d8474-5a71-447d-b13c-41da0fc3f117 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:36.626423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-050d8474-5a71-447d-b13c-41da0fc3f117 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:36.627365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-050d8474-5a71-447d-b13c-41da0fc3f117 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:36.627823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-050d8474-5a71-447d-b13c-41da0fc3f117 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:37.276805 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-050d8474-5a71-447d-b13c-41da0fc3f117 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1463 microversion: 2.1 time: 0.689905 Mar 12 21:09:37.282252 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3338/4106] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:36 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1463 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:37.600454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e997b8d5-d45e-462c-82b9-0cd067e32439 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:37.601873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e997b8d5-d45e-462c-82b9-0cd067e32439 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:37.612723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e997b8d5-d45e-462c-82b9-0cd067e32439 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:37.616147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e997b8d5-d45e-462c-82b9-0cd067e32439 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:37.619803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e997b8d5-d45e-462c-82b9-0cd067e32439 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:37.624581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e997b8d5-d45e-462c-82b9-0cd067e32439 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:38.142390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e997b8d5-d45e-462c-82b9-0cd067e32439 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:38.154973 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e997b8d5-d45e-462c-82b9-0cd067e32439 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1492 microversion: 2.1 time: 0.558032 Mar 12 21:09:38.158198 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3339/4107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:37 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1492 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:38.179735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bed6ad39-febe-433f-93b3-7bcb6aaa8fe8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:38.180506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bed6ad39-febe-433f-93b3-7bcb6aaa8fe8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:38.215197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bed6ad39-febe-433f-93b3-7bcb6aaa8fe8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:38.216072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bed6ad39-febe-433f-93b3-7bcb6aaa8fe8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:38.217995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bed6ad39-febe-433f-93b3-7bcb6aaa8fe8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:38.221203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bed6ad39-febe-433f-93b3-7bcb6aaa8fe8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:38.334646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bed6ad39-febe-433f-93b3-7bcb6aaa8fe8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:09:38.537176 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bed6ad39-febe-433f-93b3-7bcb6aaa8fe8 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 204 len: 0 microversion: 2.1 time: 0.364343 Mar 12 21:09:38.538990 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3340/4108] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:09:38 2022] DELETE /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:09:38.545050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab90b192-5177-4516-8574-5682bbd4d4ea tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:38.545992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ab90b192-5177-4516-8574-5682bbd4d4ea tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:38.552544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab90b192-5177-4516-8574-5682bbd4d4ea tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:38.553197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab90b192-5177-4516-8574-5682bbd4d4ea tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:38.554695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab90b192-5177-4516-8574-5682bbd4d4ea tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:38.555311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab90b192-5177-4516-8574-5682bbd4d4ea tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:39.243385 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ab90b192-5177-4516-8574-5682bbd4d4ea tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1463 microversion: 2.1 time: 0.702859 Mar 12 21:09:39.243989 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3341/4109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:38 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1463 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:39.267113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80d4f1d4-139e-4a27-bca8-a3f447ddf0ac tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:39.267742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80d4f1d4-139e-4a27-bca8-a3f447ddf0ac tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:39.290601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80d4f1d4-139e-4a27-bca8-a3f447ddf0ac tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:39.291194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80d4f1d4-139e-4a27-bca8-a3f447ddf0ac tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:39.292254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80d4f1d4-139e-4a27-bca8-a3f447ddf0ac tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:39.293022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80d4f1d4-139e-4a27-bca8-a3f447ddf0ac tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:40.315718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80d4f1d4-139e-4a27-bca8-a3f447ddf0ac tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e1e3bae5b94b5589b47488329ad756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a2c21b1992d496bab772b5ff8f601a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:40.330425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80d4f1d4-139e-4a27-bca8-a3f447ddf0ac tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 200 len: 1498 microversion: 2.1 time: 1.076934 Mar 12 21:09:40.331469 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3342/4110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:39 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 1498 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:40.353112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2077465155", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "ba2914bf-1f74-4a11-a5ea-96bbc58f6d3e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-917593377", "security_groups": [{"name": "tempest-secgroup-smoke-1357330354"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:40.743631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] validate_networks() for [('ba2914bf-1f74-4a11-a5ea-96bbc58f6d3e', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:09:42.705194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:09:42.708932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:09:42.710633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:09:42.712210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:09:42.713848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:09:42.749341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:42.750215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:42.751284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:42.752685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:42.783918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for project cf66e00702594effaf99e35fcdcf05c9. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:09:42.792924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for user 43f35f32a8064500a8d8412f19697b93 and project cf66e00702594effaf99e35fcdcf05c9. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:09:42.819097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:09:42.823786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:09:42.903980 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-077d3866-be40-4edb-a88c-a90fb61a971a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.567604 Mar 12 21:09:42.912210 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3343/4111] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:09:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 2578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:09:42.917697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ba460c4f-426c-4d43-bfb3-06fd521dd609 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:42.918628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ba460c4f-426c-4d43-bfb3-06fd521dd609 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:42.926158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba460c4f-426c-4d43-bfb3-06fd521dd609 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:42.927144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba460c4f-426c-4d43-bfb3-06fd521dd609 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:42.928314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba460c4f-426c-4d43-bfb3-06fd521dd609 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:42.929043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba460c4f-426c-4d43-bfb3-06fd521dd609 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:43.339706 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ba460c4f-426c-4d43-bfb3-06fd521dd609 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1463 microversion: 2.1 time: 0.425891 Mar 12 21:09:43.358236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3344/4112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:42 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1463 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:43.373752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ae69fc93-3b64-4a25-849a-a8f3d600c9a2 req-ae8ef0b0-ba14-453b-b679-2d3f34d7f0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95", "name": "network-vif-deleted", "tag": "dfaa04e9-beb6-4fec-88cd-32fbff58db2a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:43.395985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ae69fc93-3b64-4a25-849a-a8f3d600c9a2 req-ae8ef0b0-ba14-453b-b679-2d3f34d7f0a8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:43.398853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ae69fc93-3b64-4a25-849a-a8f3d600c9a2 req-ae8ef0b0-ba14-453b-b679-2d3f34d7f0a8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:43.426253 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ae69fc93-3b64-4a25-849a-a8f3d600c9a2 req-ae8ef0b0-ba14-453b-b679-2d3f34d7f0a8 service nova] Creating event network-vif-deleted:dfaa04e9-beb6-4fec-88cd-32fbff58db2a for instance b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 on nch2-master-1 Mar 12 21:09:43.444506 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ae69fc93-3b64-4a25-849a-a8f3d600c9a2 req-ae8ef0b0-ba14-453b-b679-2d3f34d7f0a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084722 Mar 12 21:09:43.457752 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3345/4113] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:09:43.469729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-38c8145e-8bf0-4d48-8f95-f0b7248c203a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:43.479840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-38c8145e-8bf0-4d48-8f95-f0b7248c203a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:43.499538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38c8145e-8bf0-4d48-8f95-f0b7248c203a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:43.500405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38c8145e-8bf0-4d48-8f95-f0b7248c203a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:43.501349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38c8145e-8bf0-4d48-8f95-f0b7248c203a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:43.503236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38c8145e-8bf0-4d48-8f95-f0b7248c203a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:43.536373 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-38c8145e-8bf0-4d48-8f95-f0b7248c203a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 could not be found. Mar 12 21:09:43.539654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-38c8145e-8bf0-4d48-8f95-f0b7248c203a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:43.542955 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-38c8145e-8bf0-4d48-8f95-f0b7248c203a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 404 len: 111 microversion: 2.1 time: 0.082613 Mar 12 21:09:43.549105 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3346/4114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:43 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:43.561036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6c58ba8a-d23b-4c59-99b9-1df90d6bb1e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:43.566624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6c58ba8a-d23b-4c59-99b9-1df90d6bb1e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:43.718243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6c58ba8a-d23b-4c59-99b9-1df90d6bb1e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:43.739920 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6c58ba8a-d23b-4c59-99b9-1df90d6bb1e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1266 microversion: 2.1 time: 0.187098 Mar 12 21:09:43.762291 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3347/4115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:43 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:43.768979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d74e966-65e5-496f-8def-7abc2b2ffbb6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:43.770171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0d74e966-65e5-496f-8def-7abc2b2ffbb6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:43.812620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d74e966-65e5-496f-8def-7abc2b2ffbb6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:43.814337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d74e966-65e5-496f-8def-7abc2b2ffbb6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:43.817513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d74e966-65e5-496f-8def-7abc2b2ffbb6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:43.818268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d74e966-65e5-496f-8def-7abc2b2ffbb6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:43.896924 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-0d74e966-65e5-496f-8def-7abc2b2ffbb6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 could not be found. Mar 12 21:09:43.897673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d74e966-65e5-496f-8def-7abc2b2ffbb6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:43.901301 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d74e966-65e5-496f-8def-7abc2b2ffbb6 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 404 len: 111 microversion: 2.1 time: 0.135079 Mar 12 21:09:43.904444 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3348/4116] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:09:43 2022] DELETE /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:43.918313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ca570ff-832a-4f4a-9808-c993910f4ff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:43.928778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ca570ff-832a-4f4a-9808-c993910f4ff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:43.942306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ca570ff-832a-4f4a-9808-c993910f4ff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:43.943127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ca570ff-832a-4f4a-9808-c993910f4ff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:43.944203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ca570ff-832a-4f4a-9808-c993910f4ff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:43.944914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ca570ff-832a-4f4a-9808-c993910f4ff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:43.992029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-0ca570ff-832a-4f4a-9808-c993910f4ff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 could not be found. Mar 12 21:09:43.996228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ca570ff-832a-4f4a-9808-c993910f4ff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:43.997432 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ca570ff-832a-4f4a-9808-c993910f4ff4 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95" status: 404 len: 111 microversion: 2.1 time: 0.087557 Mar 12 21:09:43.998238 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3349/4117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:43 2022] GET /compute/v2.1/servers/b4b22c9d-8c06-4a15-8e8b-d6bcc5c90e95 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:44.024941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-60362077-0467-41c3-a2a0-0cfdcf2af510 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:44.025569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-60362077-0467-41c3-a2a0-0cfdcf2af510 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:44.040604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60362077-0467-41c3-a2a0-0cfdcf2af510 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:44.042399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60362077-0467-41c3-a2a0-0cfdcf2af510 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:44.045148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60362077-0467-41c3-a2a0-0cfdcf2af510 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:44.045937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60362077-0467-41c3-a2a0-0cfdcf2af510 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:44.084607 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-60362077-0467-41c3-a2a0-0cfdcf2af510 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance 0da478e7-a161-41dc-8c25-faf4d7bb4a3b could not be found. Mar 12 21:09:44.095185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-60362077-0467-41c3-a2a0-0cfdcf2af510 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance 0da478e7-a161-41dc-8c25-faf4d7bb4a3b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:44.096768 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-60362077-0467-41c3-a2a0-0cfdcf2af510 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 404 len: 111 microversion: 2.1 time: 0.084946 Mar 12 21:09:44.105014 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3350/4118] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:09:44 2022] DELETE /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:44.126003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d2a5a043-5ea0-4650-ad8b-cfde28fdca93 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:44.126755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d2a5a043-5ea0-4650-ad8b-cfde28fdca93 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 0da478e7-a161-41dc-8c25-faf4d7bb4a3b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:44.146731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2a5a043-5ea0-4650-ad8b-cfde28fdca93 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:44.148383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2a5a043-5ea0-4650-ad8b-cfde28fdca93 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:44.149762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2a5a043-5ea0-4650-ad8b-cfde28fdca93 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:44.151691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2a5a043-5ea0-4650-ad8b-cfde28fdca93 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:44.202414 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d2a5a043-5ea0-4650-ad8b-cfde28fdca93 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance 0da478e7-a161-41dc-8c25-faf4d7bb4a3b could not be found. Mar 12 21:09:44.204703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d2a5a043-5ea0-4650-ad8b-cfde28fdca93 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance 0da478e7-a161-41dc-8c25-faf4d7bb4a3b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:44.206276 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d2a5a043-5ea0-4650-ad8b-cfde28fdca93 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b" status: 404 len: 111 microversion: 2.1 time: 0.098000 Mar 12 21:09:44.208140 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3351/4119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:44 2022] GET /compute/v2.1/servers/0da478e7-a161-41dc-8c25-faf4d7bb4a3b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:44.226177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90a02d85-f569-4e56-879d-2acd0ae8728b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:44.227076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90a02d85-f569-4e56-879d-2acd0ae8728b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:44.242386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90a02d85-f569-4e56-879d-2acd0ae8728b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:44.244472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90a02d85-f569-4e56-879d-2acd0ae8728b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:44.245803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90a02d85-f569-4e56-879d-2acd0ae8728b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:44.248323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90a02d85-f569-4e56-879d-2acd0ae8728b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:44.271389 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-90a02d85-f569-4e56-879d-2acd0ae8728b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 could not be found. Mar 12 21:09:44.272379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90a02d85-f569-4e56-879d-2acd0ae8728b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:44.273592 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90a02d85-f569-4e56-879d-2acd0ae8728b tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 404 len: 111 microversion: 2.1 time: 0.061778 Mar 12 21:09:44.275565 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3352/4120] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:09:44 2022] DELETE /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:44.288725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ebffdf66-0da4-44fe-b847-4a5a7f461c07 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:44.290222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ebffdf66-0da4-44fe-b847-4a5a7f461c07 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: c7e4dbc9-e3c3-45e5-9d41-0b27844bc172] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:44.299815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebffdf66-0da4-44fe-b847-4a5a7f461c07 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:44.300922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebffdf66-0da4-44fe-b847-4a5a7f461c07 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:44.302459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebffdf66-0da4-44fe-b847-4a5a7f461c07 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:44.303541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebffdf66-0da4-44fe-b847-4a5a7f461c07 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:44.349610 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ebffdf66-0da4-44fe-b847-4a5a7f461c07 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 could not be found. Mar 12 21:09:44.351162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ebffdf66-0da4-44fe-b847-4a5a7f461c07 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:44.354291 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ebffdf66-0da4-44fe-b847-4a5a7f461c07 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172" status: 404 len: 111 microversion: 2.1 time: 0.072014 Mar 12 21:09:44.355449 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3353/4121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:44 2022] GET /compute/v2.1/servers/c7e4dbc9-e3c3-45e5-9d41-0b27844bc172 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:44.379751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d55b833-2fef-4a59-8cfb-7b99a420848f tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:44.380899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0d55b833-2fef-4a59-8cfb-7b99a420848f tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:44.389234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d55b833-2fef-4a59-8cfb-7b99a420848f tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:44.390330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d55b833-2fef-4a59-8cfb-7b99a420848f tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:44.392278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d55b833-2fef-4a59-8cfb-7b99a420848f tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:44.393049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d55b833-2fef-4a59-8cfb-7b99a420848f tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:45.138375 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d55b833-2fef-4a59-8cfb-7b99a420848f tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1463 microversion: 2.1 time: 0.780623 Mar 12 21:09:45.139046 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3354/4122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:44 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1463 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:45.184822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3943f61d-aa23-4e54-a49a-8c7bcd6775e1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:45.195248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3943f61d-aa23-4e54-a49a-8c7bcd6775e1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:45.204098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3943f61d-aa23-4e54-a49a-8c7bcd6775e1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:45.205079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3943f61d-aa23-4e54-a49a-8c7bcd6775e1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:45.216730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3943f61d-aa23-4e54-a49a-8c7bcd6775e1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:45.217542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3943f61d-aa23-4e54-a49a-8c7bcd6775e1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:45.273622 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3943f61d-aa23-4e54-a49a-8c7bcd6775e1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance 2a220cc9-9f61-4277-9dea-98609c6cb93c could not be found. Mar 12 21:09:45.274766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3943f61d-aa23-4e54-a49a-8c7bcd6775e1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance 2a220cc9-9f61-4277-9dea-98609c6cb93c could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:45.275993 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3943f61d-aa23-4e54-a49a-8c7bcd6775e1 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 404 len: 111 microversion: 2.1 time: 0.132939 Mar 12 21:09:45.277640 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3355/4123] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:09:45 2022] DELETE /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:45.285364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bdbd35c6-60f9-4058-b8d4-b7e8220cedb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:45.286270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bdbd35c6-60f9-4058-b8d4-b7e8220cedb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:45.294512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bdbd35c6-60f9-4058-b8d4-b7e8220cedb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:45.296439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bdbd35c6-60f9-4058-b8d4-b7e8220cedb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:45.297708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bdbd35c6-60f9-4058-b8d4-b7e8220cedb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:45.298578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bdbd35c6-60f9-4058-b8d4-b7e8220cedb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:45.445709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bdbd35c6-60f9-4058-b8d4-b7e8220cedb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:45.458452 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bdbd35c6-60f9-4058-b8d4-b7e8220cedb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1324 microversion: 2.1 time: 0.176122 Mar 12 21:09:45.482205 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3356/4124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:45 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1324 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:45.502176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b16a3364-54f1-4da5-bd58-1caf67ab819c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:45.502729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b16a3364-54f1-4da5-bd58-1caf67ab819c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 2a220cc9-9f61-4277-9dea-98609c6cb93c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:45.529620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b16a3364-54f1-4da5-bd58-1caf67ab819c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:45.535609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b16a3364-54f1-4da5-bd58-1caf67ab819c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:45.537459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b16a3364-54f1-4da5-bd58-1caf67ab819c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:45.538238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b16a3364-54f1-4da5-bd58-1caf67ab819c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:45.562558 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b16a3364-54f1-4da5-bd58-1caf67ab819c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance 2a220cc9-9f61-4277-9dea-98609c6cb93c could not be found. Mar 12 21:09:45.563808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b16a3364-54f1-4da5-bd58-1caf67ab819c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance 2a220cc9-9f61-4277-9dea-98609c6cb93c could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:45.565733 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b16a3364-54f1-4da5-bd58-1caf67ab819c tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c" status: 404 len: 111 microversion: 2.1 time: 0.081645 Mar 12 21:09:45.567249 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3357/4125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:45 2022] GET /compute/v2.1/servers/2a220cc9-9f61-4277-9dea-98609c6cb93c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:45.582309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e687eac0-2e3f-4b9f-bfa8-116b51550c1a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:45.583004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e687eac0-2e3f-4b9f-bfa8-116b51550c1a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 64374fa6-f013-4a9d-babb-60e68b81985b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:45.591775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e687eac0-2e3f-4b9f-bfa8-116b51550c1a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:45.592696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e687eac0-2e3f-4b9f-bfa8-116b51550c1a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:45.594036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e687eac0-2e3f-4b9f-bfa8-116b51550c1a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:45.594771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e687eac0-2e3f-4b9f-bfa8-116b51550c1a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:45.619272 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e687eac0-2e3f-4b9f-bfa8-116b51550c1a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance 64374fa6-f013-4a9d-babb-60e68b81985b could not be found. Mar 12 21:09:45.620145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e687eac0-2e3f-4b9f-bfa8-116b51550c1a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance 64374fa6-f013-4a9d-babb-60e68b81985b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:45.622329 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e687eac0-2e3f-4b9f-bfa8-116b51550c1a tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b" status: 404 len: 111 microversion: 2.1 time: 0.045172 Mar 12 21:09:45.623557 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3358/4126] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:09:45 2022] DELETE /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:45.647125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-28f8db93-d739-491a-9564-ffd878b7286e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:45.647784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-28f8db93-d739-491a-9564-ffd878b7286e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 64374fa6-f013-4a9d-babb-60e68b81985b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:45.664671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28f8db93-d739-491a-9564-ffd878b7286e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:45.665593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28f8db93-d739-491a-9564-ffd878b7286e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:45.666891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28f8db93-d739-491a-9564-ffd878b7286e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:45.667930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28f8db93-d739-491a-9564-ffd878b7286e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:45.696817 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-28f8db93-d739-491a-9564-ffd878b7286e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance 64374fa6-f013-4a9d-babb-60e68b81985b could not be found. Mar 12 21:09:45.697986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-28f8db93-d739-491a-9564-ffd878b7286e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance 64374fa6-f013-4a9d-babb-60e68b81985b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:45.699496 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-28f8db93-d739-491a-9564-ffd878b7286e tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b" status: 404 len: 111 microversion: 2.1 time: 0.070358 Mar 12 21:09:45.703442 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3359/4127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:45 2022] GET /compute/v2.1/servers/64374fa6-f013-4a9d-babb-60e68b81985b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:45.775839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4182248a-8e98-4e76-9d69-89b8d4c47b48 req-be99e6d5-799c-4b42-b4b8-f2a2d83b3bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b6963f2-09e1-45ab-a1e2-0f68d8ad946c", "name": "network-vif-plugged", "status": "completed", "tag": "cd7cb47b-ebe9-4200-ba03-ab745c30e69c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:45.799517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4182248a-8e98-4e76-9d69-89b8d4c47b48 req-be99e6d5-799c-4b42-b4b8-f2a2d83b3bde service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:45.800427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4182248a-8e98-4e76-9d69-89b8d4c47b48 req-be99e6d5-799c-4b42-b4b8-f2a2d83b3bde service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:45.860737 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4182248a-8e98-4e76-9d69-89b8d4c47b48 req-be99e6d5-799c-4b42-b4b8-f2a2d83b3bde service nova] Creating event network-vif-plugged:cd7cb47b-ebe9-4200-ba03-ab745c30e69c for instance 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c on nch1-master-1 Mar 12 21:09:45.887753 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4182248a-8e98-4e76-9d69-89b8d4c47b48 req-be99e6d5-799c-4b42-b4b8-f2a2d83b3bde service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108406 Mar 12 21:09:45.888754 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3360/4128] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:09:46.158737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aec9b60e-c7bb-4e9d-bf66-8acd3034ee05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:46.161257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aec9b60e-c7bb-4e9d-bf66-8acd3034ee05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:46.180249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aec9b60e-c7bb-4e9d-bf66-8acd3034ee05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:46.184118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aec9b60e-c7bb-4e9d-bf66-8acd3034ee05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:46.185697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aec9b60e-c7bb-4e9d-bf66-8acd3034ee05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:46.186588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aec9b60e-c7bb-4e9d-bf66-8acd3034ee05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:46.816836 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aec9b60e-c7bb-4e9d-bf66-8acd3034ee05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1463 microversion: 2.1 time: 0.663495 Mar 12 21:09:46.817379 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3361/4129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:46 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1463 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:46.849372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-95baf580-43ee-46d5-b174-e7ab86ec7a7e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:46.850061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-95baf580-43ee-46d5-b174-e7ab86ec7a7e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:46.870842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95baf580-43ee-46d5-b174-e7ab86ec7a7e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:46.874837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95baf580-43ee-46d5-b174-e7ab86ec7a7e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:46.879215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95baf580-43ee-46d5-b174-e7ab86ec7a7e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:46.879838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95baf580-43ee-46d5-b174-e7ab86ec7a7e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:47.212273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-95baf580-43ee-46d5-b174-e7ab86ec7a7e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:47.222543 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-95baf580-43ee-46d5-b174-e7ab86ec7a7e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1324 microversion: 2.1 time: 0.403997 Mar 12 21:09:47.223755 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3362/4130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:46 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1324 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:47.231055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43003a44-affb-43fc-bd3b-2f908ca95d11 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:47.231813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-43003a44-affb-43fc-bd3b-2f908ca95d11 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:47.242211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43003a44-affb-43fc-bd3b-2f908ca95d11 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:47.242593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43003a44-affb-43fc-bd3b-2f908ca95d11 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:47.243375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43003a44-affb-43fc-bd3b-2f908ca95d11 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:47.243930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43003a44-affb-43fc-bd3b-2f908ca95d11 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:47.267340 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-43003a44-affb-43fc-bd3b-2f908ca95d11 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance ed1f8df3-57c9-4312-93f5-ab79e215eae7 could not be found. Mar 12 21:09:47.268154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43003a44-affb-43fc-bd3b-2f908ca95d11 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance ed1f8df3-57c9-4312-93f5-ab79e215eae7 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:47.269889 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-43003a44-affb-43fc-bd3b-2f908ca95d11 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 404 len: 111 microversion: 2.1 time: 0.044214 Mar 12 21:09:47.270953 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3363/4131] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:09:47 2022] DELETE /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:47.287265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd6f667a-7b86-4ca9-a0ea-d9b49d1afad5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:47.288225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dd6f667a-7b86-4ca9-a0ea-d9b49d1afad5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: ed1f8df3-57c9-4312-93f5-ab79e215eae7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:47.295740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd6f667a-7b86-4ca9-a0ea-d9b49d1afad5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:47.296451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd6f667a-7b86-4ca9-a0ea-d9b49d1afad5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:47.297468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd6f667a-7b86-4ca9-a0ea-d9b49d1afad5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:47.298116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd6f667a-7b86-4ca9-a0ea-d9b49d1afad5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:47.320265 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-dd6f667a-7b86-4ca9-a0ea-d9b49d1afad5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance ed1f8df3-57c9-4312-93f5-ab79e215eae7 could not be found. Mar 12 21:09:47.321217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd6f667a-7b86-4ca9-a0ea-d9b49d1afad5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance ed1f8df3-57c9-4312-93f5-ab79e215eae7 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:47.322762 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd6f667a-7b86-4ca9-a0ea-d9b49d1afad5 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7" status: 404 len: 111 microversion: 2.1 time: 0.040296 Mar 12 21:09:47.324059 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3364/4132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:47 2022] GET /compute/v2.1/servers/ed1f8df3-57c9-4312-93f5-ab79e215eae7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:47.336425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-102fd09a-8524-4040-9a27-c4a0be183100 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:47.337405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-102fd09a-8524-4040-9a27-c4a0be183100 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:47.345717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-102fd09a-8524-4040-9a27-c4a0be183100 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:47.346522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-102fd09a-8524-4040-9a27-c4a0be183100 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:47.347674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-102fd09a-8524-4040-9a27-c4a0be183100 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:47.348457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-102fd09a-8524-4040-9a27-c4a0be183100 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:47.423165 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-102fd09a-8524-4040-9a27-c4a0be183100 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance 9f5283d2-af12-4324-9eae-886a7ba6d2a5 could not be found. Mar 12 21:09:47.424543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-102fd09a-8524-4040-9a27-c4a0be183100 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance 9f5283d2-af12-4324-9eae-886a7ba6d2a5 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:47.425830 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-102fd09a-8524-4040-9a27-c4a0be183100 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 404 len: 111 microversion: 2.1 time: 0.097755 Mar 12 21:09:47.430220 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3365/4133] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:09:47 2022] DELETE /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:47.438074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-015c7a99-fa0c-431d-84e0-2187d5c5df51 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:47.438601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-015c7a99-fa0c-431d-84e0-2187d5c5df51 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] [instance: 9f5283d2-af12-4324-9eae-886a7ba6d2a5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:47.447458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-015c7a99-fa0c-431d-84e0-2187d5c5df51 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:47.447834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-015c7a99-fa0c-431d-84e0-2187d5c5df51 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:47.448636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-015c7a99-fa0c-431d-84e0-2187d5c5df51 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:47.449090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-015c7a99-fa0c-431d-84e0-2187d5c5df51 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:47.468602 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-015c7a99-fa0c-431d-84e0-2187d5c5df51 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] HTTP exception thrown: Instance 9f5283d2-af12-4324-9eae-886a7ba6d2a5 could not be found. Mar 12 21:09:47.469363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-015c7a99-fa0c-431d-84e0-2187d5c5df51 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] Returning 404 to user: Instance 9f5283d2-af12-4324-9eae-886a7ba6d2a5 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:09:47.470577 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-015c7a99-fa0c-431d-84e0-2187d5c5df51 tempest-DeleteServersTestJSON-152948620 tempest-DeleteServersTestJSON-152948620-project] 10.222.0.30 "GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5" status: 404 len: 111 microversion: 2.1 time: 0.038921 Mar 12 21:09:47.475809 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3366/4134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:47 2022] GET /compute/v2.1/servers/9f5283d2-af12-4324-9eae-886a7ba6d2a5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:09:47.835894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ec4e763-7808-4429-a4f9-fb9fe2e053f2 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:47.836540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ec4e763-7808-4429-a4f9-fb9fe2e053f2 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:47.856514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ec4e763-7808-4429-a4f9-fb9fe2e053f2 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:47.857631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ec4e763-7808-4429-a4f9-fb9fe2e053f2 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:47.860554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ec4e763-7808-4429-a4f9-fb9fe2e053f2 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:47.870614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ec4e763-7808-4429-a4f9-fb9fe2e053f2 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:48.402062 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ec4e763-7808-4429-a4f9-fb9fe2e053f2 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1463 microversion: 2.1 time: 0.572139 Mar 12 21:09:48.402705 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3367/4135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:47 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1463 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:48.413227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e94029a8-2031-4e3f-a745-9bb94bc020d9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:48.413872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e94029a8-2031-4e3f-a745-9bb94bc020d9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:48.428902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e94029a8-2031-4e3f-a745-9bb94bc020d9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:48.429362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e94029a8-2031-4e3f-a745-9bb94bc020d9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:48.430286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e94029a8-2031-4e3f-a745-9bb94bc020d9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:48.435511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e94029a8-2031-4e3f-a745-9bb94bc020d9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:48.810674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e94029a8-2031-4e3f-a745-9bb94bc020d9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:48.824517 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e94029a8-2031-4e3f-a745-9bb94bc020d9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1392 microversion: 2.1 time: 0.420751 Mar 12 21:09:48.836281 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3368/4136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:48 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1392 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:49.419337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-efad1ede-35cb-4dc2-a77b-4679fdca8f9d tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:49.419985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-efad1ede-35cb-4dc2-a77b-4679fdca8f9d tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:49.436545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efad1ede-35cb-4dc2-a77b-4679fdca8f9d tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:49.437256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efad1ede-35cb-4dc2-a77b-4679fdca8f9d tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:49.438547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efad1ede-35cb-4dc2-a77b-4679fdca8f9d tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:49.444415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efad1ede-35cb-4dc2-a77b-4679fdca8f9d tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:49.882436 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-efad1ede-35cb-4dc2-a77b-4679fdca8f9d tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1648 microversion: 2.1 time: 0.456268 Mar 12 21:09:49.904051 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3369/4137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:49 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1648 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:49.920105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49a0588f-3269-47e1-a2c4-4dc38f1e7d86 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:49.924279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-49a0588f-3269-47e1-a2c4-4dc38f1e7d86 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:49.954816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49a0588f-3269-47e1-a2c4-4dc38f1e7d86 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:49.955636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49a0588f-3269-47e1-a2c4-4dc38f1e7d86 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:49.960071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49a0588f-3269-47e1-a2c4-4dc38f1e7d86 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:49.960813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49a0588f-3269-47e1-a2c4-4dc38f1e7d86 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:50.767424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-49a0588f-3269-47e1-a2c4-4dc38f1e7d86 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:50.788363 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-49a0588f-3269-47e1-a2c4-4dc38f1e7d86 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1392 microversion: 2.1 time: 0.880344 Mar 12 21:09:50.788994 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3370/4138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:49 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1392 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:50.804796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b41f26d2-ad3b-4755-92d9-b7c86364d381 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:50.805472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b41f26d2-ad3b-4755-92d9-b7c86364d381 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:50.832529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b41f26d2-ad3b-4755-92d9-b7c86364d381 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:50.832990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b41f26d2-ad3b-4755-92d9-b7c86364d381 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:50.850392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b41f26d2-ad3b-4755-92d9-b7c86364d381 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:50.850853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b41f26d2-ad3b-4755-92d9-b7c86364d381 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:51.502750 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b41f26d2-ad3b-4755-92d9-b7c86364d381 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1648 microversion: 2.1 time: 0.711861 Mar 12 21:09:51.514284 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3371/4139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:50 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1648 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:51.533614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9acaa061-ca17-4951-8ee2-444cfbbc38ef tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:51.538472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9acaa061-ca17-4951-8ee2-444cfbbc38ef tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:51.561049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9acaa061-ca17-4951-8ee2-444cfbbc38ef tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:51.563529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9acaa061-ca17-4951-8ee2-444cfbbc38ef tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:51.569158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9acaa061-ca17-4951-8ee2-444cfbbc38ef tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:51.582389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9acaa061-ca17-4951-8ee2-444cfbbc38ef tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:51.988719 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9acaa061-ca17-4951-8ee2-444cfbbc38ef tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1648 microversion: 2.1 time: 0.463930 Mar 12 21:09:51.991600 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3372/4140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:51 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1648 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:52.011727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2df49d7b-d395-48cb-8db0-9ffefb759863 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:52.012682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2df49d7b-d395-48cb-8db0-9ffefb759863 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:52.023496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2df49d7b-d395-48cb-8db0-9ffefb759863 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:52.024744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2df49d7b-d395-48cb-8db0-9ffefb759863 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:52.026009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2df49d7b-d395-48cb-8db0-9ffefb759863 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:52.026760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2df49d7b-d395-48cb-8db0-9ffefb759863 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:52.261207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2df49d7b-d395-48cb-8db0-9ffefb759863 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:52.270039 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2df49d7b-d395-48cb-8db0-9ffefb759863 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1392 microversion: 2.1 time: 0.276712 Mar 12 21:09:52.278719 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3373/4141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:51 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1392 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:52.293613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2eea0f94-be71-4a73-a46b-191956039b8e req-f1071135-471a-474e-9ce4-e526e63bdb49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb3c81a-e3d8-4620-9c9d-7bfb50867f47", "tag": "2d64c72f-d3dd-4cc6-807e-8819869e76e4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:52.317742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2eea0f94-be71-4a73-a46b-191956039b8e req-f1071135-471a-474e-9ce4-e526e63bdb49 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:52.318127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2eea0f94-be71-4a73-a46b-191956039b8e req-f1071135-471a-474e-9ce4-e526e63bdb49 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:52.345515 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2eea0f94-be71-4a73-a46b-191956039b8e req-f1071135-471a-474e-9ce4-e526e63bdb49 service nova] Creating event network-changed:2d64c72f-d3dd-4cc6-807e-8819869e76e4 for instance 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 on nch2-master-1 Mar 12 21:09:52.367903 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2eea0f94-be71-4a73-a46b-191956039b8e req-f1071135-471a-474e-9ce4-e526e63bdb49 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087844 Mar 12 21:09:52.372271 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3374/4142] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:09:52.536712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-794164110", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "d131a7f4-a222-4973-b942-0298e4b36917"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:09:52.644729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] validate_networks() for [('d131a7f4-a222-4973-b942-0298e4b36917', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:09:53.698713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:09:53.699758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:09:53.700392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:09:53.701530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:09:53.702158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:09:53.724626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:53.725084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:53.729320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:53.729797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:53.839396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Getting quotas for project 2cf14768345a44f4888cdb3b7254195c. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:09:53.869112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Getting quotas for user 6dd21ad54a4a4012b1b1aefd2194aa76 and project 2cf14768345a44f4888cdb3b7254195c. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:09:53.931213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:09:53.934049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:09:54.052066 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aafeebf8-ebd5-4b06-be5f-832056e962e4 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.518068 Mar 12 21:09:54.052759 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3375/4143] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:09:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:09:54.079440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f74f9fb-a1d0-4394-a833-3d54dab24b56 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:54.080082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f74f9fb-a1d0-4394-a833-3d54dab24b56 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:54.104498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f74f9fb-a1d0-4394-a833-3d54dab24b56 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:54.104961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f74f9fb-a1d0-4394-a833-3d54dab24b56 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:54.105757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f74f9fb-a1d0-4394-a833-3d54dab24b56 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:54.106228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f74f9fb-a1d0-4394-a833-3d54dab24b56 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:55.310095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f74f9fb-a1d0-4394-a833-3d54dab24b56 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:55.327093 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f74f9fb-a1d0-4394-a833-3d54dab24b56 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1392 microversion: 2.1 time: 1.271653 Mar 12 21:09:55.331825 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3376/4144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:54 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1392 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:55.346233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af87f571-e11a-4532-b2bf-537604e3eb50 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:55.347845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af87f571-e11a-4532-b2bf-537604e3eb50 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:55.367411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af87f571-e11a-4532-b2bf-537604e3eb50 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:55.371984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af87f571-e11a-4532-b2bf-537604e3eb50 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:55.373183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af87f571-e11a-4532-b2bf-537604e3eb50 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:55.375672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af87f571-e11a-4532-b2bf-537604e3eb50 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:55.562878 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af87f571-e11a-4532-b2bf-537604e3eb50 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 200 len: 1415 microversion: 2.1 time: 0.227006 Mar 12 21:09:55.563792 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3377/4145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:55 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 1415 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:56.348680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b84914e2-46ca-4366-b430-c879ca1d2583 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:56.350386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b84914e2-46ca-4366-b430-c879ca1d2583 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:56.364130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b84914e2-46ca-4366-b430-c879ca1d2583 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:56.366044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b84914e2-46ca-4366-b430-c879ca1d2583 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:56.369186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b84914e2-46ca-4366-b430-c879ca1d2583 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:56.369759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b84914e2-46ca-4366-b430-c879ca1d2583 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:57.303261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b84914e2-46ca-4366-b430-c879ca1d2583 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:57.312193 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b84914e2-46ca-4366-b430-c879ca1d2583 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1392 microversion: 2.1 time: 0.968092 Mar 12 21:09:57.318803 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3378/4146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:56 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1392 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:09:57.328008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-faafb247-cee7-4396-913c-b2bff876bf12 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:57.328642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-faafb247-cee7-4396-913c-b2bff876bf12 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:57.336381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-faafb247-cee7-4396-913c-b2bff876bf12 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:57.337078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-faafb247-cee7-4396-913c-b2bff876bf12 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:57.338076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-faafb247-cee7-4396-913c-b2bff876bf12 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:57.338674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-faafb247-cee7-4396-913c-b2bff876bf12 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:58.044036 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-faafb247-cee7-4396-913c-b2bff876bf12 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 200 len: 1463 microversion: 2.1 time: 0.721911 Mar 12 21:09:58.046968 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3379/4147] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:57 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 1463 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:58.335058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cfef4145-a454-48e6-84db-ec1d24bb762e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:58.335860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cfef4145-a454-48e6-84db-ec1d24bb762e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:58.349714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfef4145-a454-48e6-84db-ec1d24bb762e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:58.354874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfef4145-a454-48e6-84db-ec1d24bb762e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:58.358172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfef4145-a454-48e6-84db-ec1d24bb762e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:58.359969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfef4145-a454-48e6-84db-ec1d24bb762e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:59.926916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cfef4145-a454-48e6-84db-ec1d24bb762e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:09:59.934912 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cfef4145-a454-48e6-84db-ec1d24bb762e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1392 microversion: 2.1 time: 1.604111 Mar 12 21:09:59.940106 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3380/4148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:58 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1392 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:09:59.962111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0e276da8-f088-422c-9f40-ba8879f156f9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:09:59.962739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0e276da8-f088-422c-9f40-ba8879f156f9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:09:59.984410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e276da8-f088-422c-9f40-ba8879f156f9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:59.984971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e276da8-f088-422c-9f40-ba8879f156f9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:09:59.985667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e276da8-f088-422c-9f40-ba8879f156f9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:09:59.986192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e276da8-f088-422c-9f40-ba8879f156f9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:00.900540 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0e276da8-f088-422c-9f40-ba8879f156f9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 200 len: 1463 microversion: 2.1 time: 0.955159 Mar 12 21:10:00.902064 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3381/4149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:09:59 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 1463 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:00.960106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c0bf98f5-cf45-4d16-b734-f7d554db18b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:00.960766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c0bf98f5-cf45-4d16-b734-f7d554db18b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:01.030120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0bf98f5-cf45-4d16-b734-f7d554db18b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:01.032099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0bf98f5-cf45-4d16-b734-f7d554db18b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:01.033326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0bf98f5-cf45-4d16-b734-f7d554db18b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:01.037715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0bf98f5-cf45-4d16-b734-f7d554db18b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:02.557536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0bf98f5-cf45-4d16-b734-f7d554db18b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:02.574585 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c0bf98f5-cf45-4d16-b734-f7d554db18b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1392 microversion: 2.1 time: 1.620040 Mar 12 21:10:02.589919 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3382/4150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:00 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1392 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:03.088233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd39ab8e-20a9-43fe-ab36-d7b0260a7a5e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:03.089001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd39ab8e-20a9-43fe-ab36-d7b0260a7a5e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:03.098714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd39ab8e-20a9-43fe-ab36-d7b0260a7a5e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:03.101260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd39ab8e-20a9-43fe-ab36-d7b0260a7a5e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:03.102288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd39ab8e-20a9-43fe-ab36-d7b0260a7a5e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:03.106509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd39ab8e-20a9-43fe-ab36-d7b0260a7a5e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:03.163333 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd39ab8e-20a9-43fe-ab36-d7b0260a7a5e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/ips" status: 200 len: 149 microversion: 2.1 time: 0.570641 Mar 12 21:10:03.164339 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3383/4151] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 21:10:02 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/ips => generated 149 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:03.192626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-66cfe837-65a2-4d91-8f35-4cde92023490 req-fcccbde6-3033-4210-9a1d-30e8be9ff9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb3c81a-e3d8-4620-9c9d-7bfb50867f47", "name": "network-vif-plugged", "status": "completed", "tag": "2d64c72f-d3dd-4cc6-807e-8819869e76e4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:03.215279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-66cfe837-65a2-4d91-8f35-4cde92023490 req-fcccbde6-3033-4210-9a1d-30e8be9ff9c2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:03.216120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-66cfe837-65a2-4d91-8f35-4cde92023490 req-fcccbde6-3033-4210-9a1d-30e8be9ff9c2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:03.241838 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-66cfe837-65a2-4d91-8f35-4cde92023490 req-fcccbde6-3033-4210-9a1d-30e8be9ff9c2 service nova] Creating event network-vif-plugged:2d64c72f-d3dd-4cc6-807e-8819869e76e4 for instance 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 on nch2-master-1 Mar 12 21:10:03.265236 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-66cfe837-65a2-4d91-8f35-4cde92023490 req-fcccbde6-3033-4210-9a1d-30e8be9ff9c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091709 Mar 12 21:10:03.266959 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3384/4152] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:03.295244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a183afca-22ca-48de-8d37-3e85f0d3bce0 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:03.298671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a183afca-22ca-48de-8d37-3e85f0d3bce0 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:03.320284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a183afca-22ca-48de-8d37-3e85f0d3bce0 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:03.326324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a183afca-22ca-48de-8d37-3e85f0d3bce0 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:03.331357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a183afca-22ca-48de-8d37-3e85f0d3bce0 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:03.332476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a183afca-22ca-48de-8d37-3e85f0d3bce0 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:03.900195 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a183afca-22ca-48de-8d37-3e85f0d3bce0 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 200 len: 1463 microversion: 2.1 time: 0.630384 Mar 12 21:10:03.903860 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3385/4153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:03 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 1463 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:03.925647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-916947d9-208d-454b-a77b-55f8defe8455 req-29ea7c79-a095-4b3a-a59d-cf6d719d1a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b8d1d8-368f-44ac-95fc-05d208433692", "tag": "0cbebf47-bd6d-4a71-bd85-a7f1f8dc5c8e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:03.935905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-916947d9-208d-454b-a77b-55f8defe8455 req-29ea7c79-a095-4b3a-a59d-cf6d719d1a9a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:03.937566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-916947d9-208d-454b-a77b-55f8defe8455 req-29ea7c79-a095-4b3a-a59d-cf6d719d1a9a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:03.967372 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-916947d9-208d-454b-a77b-55f8defe8455 req-29ea7c79-a095-4b3a-a59d-cf6d719d1a9a service nova] Creating event network-changed:0cbebf47-bd6d-4a71-bd85-a7f1f8dc5c8e for instance a1b8d1d8-368f-44ac-95fc-05d208433692 on nch2-master-1 Mar 12 21:10:03.980519 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-916947d9-208d-454b-a77b-55f8defe8455 req-29ea7c79-a095-4b3a-a59d-cf6d719d1a9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072611 Mar 12 21:10:03.983040 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3386/4154] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:03.996883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-093d2a46-cb45-4b03-b5ed-bb3aadfd080f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:03.998200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-093d2a46-cb45-4b03-b5ed-bb3aadfd080f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:04.018055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-093d2a46-cb45-4b03-b5ed-bb3aadfd080f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:04.019328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-093d2a46-cb45-4b03-b5ed-bb3aadfd080f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:04.020639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-093d2a46-cb45-4b03-b5ed-bb3aadfd080f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:04.022536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-093d2a46-cb45-4b03-b5ed-bb3aadfd080f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:04.382355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-093d2a46-cb45-4b03-b5ed-bb3aadfd080f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:04.390898 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-093d2a46-cb45-4b03-b5ed-bb3aadfd080f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1392 microversion: 2.1 time: 0.404267 Mar 12 21:10:04.395913 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3387/4155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:03 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1392 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:04.922263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-81497866-0078-4704-b4f5-ba020cdc63e8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:04.923006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-81497866-0078-4704-b4f5-ba020cdc63e8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:04.936289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81497866-0078-4704-b4f5-ba020cdc63e8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:04.939940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81497866-0078-4704-b4f5-ba020cdc63e8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:04.943757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81497866-0078-4704-b4f5-ba020cdc63e8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:04.944529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81497866-0078-4704-b4f5-ba020cdc63e8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:06.090452 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-81497866-0078-4704-b4f5-ba020cdc63e8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 200 len: 1463 microversion: 2.1 time: 1.170299 Mar 12 21:10:06.091816 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3388/4156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:04 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 1463 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:10:06.108690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9e0dc6fc-ade6-43ac-801e-c82c8dcd641c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89e88497-9559-462f-ad2e-14638295f92b"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:06.112388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9e0dc6fc-ade6-43ac-801e-c82c8dcd641c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:06.139106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e0dc6fc-ade6-43ac-801e-c82c8dcd641c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:06.139577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e0dc6fc-ade6-43ac-801e-c82c8dcd641c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:06.140431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e0dc6fc-ade6-43ac-801e-c82c8dcd641c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:06.140881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e0dc6fc-ade6-43ac-801e-c82c8dcd641c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:06.669684 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9e0dc6fc-ade6-43ac-801e-c82c8dcd641c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.576364 Mar 12 21:10:06.672389 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3389/4157] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:10:06 2022] POST /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:06.698662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-341ac244-2dc2-4392-8ec2-33229bc8e155 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:06.704089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-341ac244-2dc2-4392-8ec2-33229bc8e155 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:06.716596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-341ac244-2dc2-4392-8ec2-33229bc8e155 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:06.719562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-341ac244-2dc2-4392-8ec2-33229bc8e155 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:06.723861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-341ac244-2dc2-4392-8ec2-33229bc8e155 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:06.726610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-341ac244-2dc2-4392-8ec2-33229bc8e155 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:07.367054 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:10:07.368233 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:10:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:10:07.488445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-341ac244-2dc2-4392-8ec2-33229bc8e155 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:07.501064 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-341ac244-2dc2-4392-8ec2-33229bc8e155 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1564 microversion: 2.1 time: 0.827303 Mar 12 21:10:07.503625 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3390/4158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:06 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1564 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:07.522129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-11bca759-9045-4600-9138-9bc9f17ccdce tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:07.525329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-11bca759-9045-4600-9138-9bc9f17ccdce tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:07.541464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11bca759-9045-4600-9138-9bc9f17ccdce tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:07.542058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11bca759-9045-4600-9138-9bc9f17ccdce tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:07.544082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11bca759-9045-4600-9138-9bc9f17ccdce tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:07.545823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11bca759-9045-4600-9138-9bc9f17ccdce tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:07.979445 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-11bca759-9045-4600-9138-9bc9f17ccdce tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 200 len: 1463 microversion: 2.1 time: 0.463267 Mar 12 21:10:07.981661 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3391/4159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:07 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 1463 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:07.994817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-46b44b4a-0e23-4312-adb5-28c09460bf99 req-553bb620-7ad5-4387-b33c-49cd8963a46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b8d1d8-368f-44ac-95fc-05d208433692", "name": "network-vif-plugged", "status": "completed", "tag": "0cbebf47-bd6d-4a71-bd85-a7f1f8dc5c8e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:08.023500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-46b44b4a-0e23-4312-adb5-28c09460bf99 req-553bb620-7ad5-4387-b33c-49cd8963a46b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:08.024631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-46b44b4a-0e23-4312-adb5-28c09460bf99 req-553bb620-7ad5-4387-b33c-49cd8963a46b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:08.051685 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-46b44b4a-0e23-4312-adb5-28c09460bf99 req-553bb620-7ad5-4387-b33c-49cd8963a46b service nova] Creating event network-vif-plugged:0cbebf47-bd6d-4a71-bd85-a7f1f8dc5c8e for instance a1b8d1d8-368f-44ac-95fc-05d208433692 on nch2-master-1 Mar 12 21:10:08.063202 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-46b44b4a-0e23-4312-adb5-28c09460bf99 req-553bb620-7ad5-4387-b33c-49cd8963a46b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079992 Mar 12 21:10:08.074762 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3392/4160] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:08.085792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-877a94ff-9d4c-47da-8e55-46ebdc7b8dd1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:08.089054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-877a94ff-9d4c-47da-8e55-46ebdc7b8dd1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:08.106616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-877a94ff-9d4c-47da-8e55-46ebdc7b8dd1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:08.109579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-877a94ff-9d4c-47da-8e55-46ebdc7b8dd1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:08.110615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-877a94ff-9d4c-47da-8e55-46ebdc7b8dd1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:08.112204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-877a94ff-9d4c-47da-8e55-46ebdc7b8dd1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:08.923193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-877a94ff-9d4c-47da-8e55-46ebdc7b8dd1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:08.932573 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-877a94ff-9d4c-47da-8e55-46ebdc7b8dd1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1564 microversion: 2.1 time: 0.855121 Mar 12 21:10:08.938283 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3393/4161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:08 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1564 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:09.002235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-10eb670f-0c81-4287-b397-ebba6848935e tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:09.004249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-10eb670f-0c81-4287-b397-ebba6848935e tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:09.042046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10eb670f-0c81-4287-b397-ebba6848935e tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:09.042497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10eb670f-0c81-4287-b397-ebba6848935e tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:09.051807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10eb670f-0c81-4287-b397-ebba6848935e tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:09.053150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-10eb670f-0c81-4287-b397-ebba6848935e tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:09.527396 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-10eb670f-0c81-4287-b397-ebba6848935e tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 200 len: 1463 microversion: 2.1 time: 0.531234 Mar 12 21:10:09.528890 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3394/4162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:08 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 1463 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:10.553084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b220165-598d-4d14-9f8b-65b6d3a22e0a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:10.554651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b220165-598d-4d14-9f8b-65b6d3a22e0a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:10.582758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b220165-598d-4d14-9f8b-65b6d3a22e0a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:10.583225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b220165-598d-4d14-9f8b-65b6d3a22e0a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:10.585653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b220165-598d-4d14-9f8b-65b6d3a22e0a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:10.586142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b220165-598d-4d14-9f8b-65b6d3a22e0a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:11.773543 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b220165-598d-4d14-9f8b-65b6d3a22e0a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 200 len: 1649 microversion: 2.1 time: 1.224068 Mar 12 21:10:11.775211 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3395/4163] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:10 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 1649 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:11.781144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1be8e6b2-fda6-47bb-800b-e84b7ef68458 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89e88497-9559-462f-ad2e-14638295f92b"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:11.782575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1be8e6b2-fda6-47bb-800b-e84b7ef68458 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:11.790742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1be8e6b2-fda6-47bb-800b-e84b7ef68458 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:11.791581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1be8e6b2-fda6-47bb-800b-e84b7ef68458 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:11.792997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1be8e6b2-fda6-47bb-800b-e84b7ef68458 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:11.794212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1be8e6b2-fda6-47bb-800b-e84b7ef68458 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:11.938462 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-1be8e6b2-fda6-47bb-800b-e84b7ef68458 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Invalid volume: volume 89e88497-9559-462f-ad2e-14638295f92b is already attached to instances: 1f5630c6-2e87-4f5c-898a-646c3a54bad2 Mar 12 21:10:11.941676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1be8e6b2-fda6-47bb-800b-e84b7ef68458 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 400 to user: Invalid volume: volume 89e88497-9559-462f-ad2e-14638295f92b is already attached to instances: 1f5630c6-2e87-4f5c-898a-646c3a54bad2 {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:10:11.945006 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1be8e6b2-fda6-47bb-800b-e84b7ef68458 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.168633 Mar 12 21:10:11.947084 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3396/4164] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:10:11 2022] POST /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/os-volume_attachments => generated 174 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:10:11.963089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e88c44ab-8656-46a7-aa26-39d39e929265 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:11.966225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e88c44ab-8656-46a7-aa26-39d39e929265 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:11.998814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e88c44ab-8656-46a7-aa26-39d39e929265 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:12.001095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e88c44ab-8656-46a7-aa26-39d39e929265 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:12.005469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e88c44ab-8656-46a7-aa26-39d39e929265 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:12.007715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e88c44ab-8656-46a7-aa26-39d39e929265 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:13.250362 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e88c44ab-8656-46a7-aa26-39d39e929265 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 200 len: 1649 microversion: 2.1 time: 1.300681 Mar 12 21:10:13.251707 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3397/4165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:11 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 1649 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:13.260070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2f90149b-e1f4-4883-b29e-dd0a38fff527 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:13.262248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2f90149b-e1f4-4883-b29e-dd0a38fff527 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:13.295806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2f90149b-e1f4-4883-b29e-dd0a38fff527 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:13.297117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2f90149b-e1f4-4883-b29e-dd0a38fff527 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:13.298576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2f90149b-e1f4-4883-b29e-dd0a38fff527 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:13.300104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2f90149b-e1f4-4883-b29e-dd0a38fff527 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:13.445714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-2f90149b-e1f4-4883-b29e-dd0a38fff527 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lazy-loading 'services' on Instance uuid 1f5630c6-2e87-4f5c-898a-646c3a54bad2 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:10:13.593568 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2f90149b-e1f4-4883-b29e-dd0a38fff527 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/os-volume_attachments/89e88497-9559-462f-ad2e-14638295f92b" status: 202 len: 0 microversion: 2.1 time: 0.340290 Mar 12 21:10:13.594755 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3398/4166] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:10:13 2022] DELETE /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/os-volume_attachments/89e88497-9559-462f-ad2e-14638295f92b => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:10:13.607634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72098eb6-406e-4038-be35-ec76db8fc288 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:13.608679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-72098eb6-406e-4038-be35-ec76db8fc288 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:13.625474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72098eb6-406e-4038-be35-ec76db8fc288 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:13.626470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72098eb6-406e-4038-be35-ec76db8fc288 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:13.628459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72098eb6-406e-4038-be35-ec76db8fc288 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:13.630167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72098eb6-406e-4038-be35-ec76db8fc288 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:14.227269 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72098eb6-406e-4038-be35-ec76db8fc288 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 200 len: 1649 microversion: 2.1 time: 0.631022 Mar 12 21:10:14.227875 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3399/4167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:13 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 1649 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:14.239694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3b13b63-eb26-4a72-8ba5-7bf60832459b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:14.247062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c3b13b63-eb26-4a72-8ba5-7bf60832459b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:14.258181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3b13b63-eb26-4a72-8ba5-7bf60832459b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:14.258778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3b13b63-eb26-4a72-8ba5-7bf60832459b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:14.259353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3b13b63-eb26-4a72-8ba5-7bf60832459b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:14.260956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3b13b63-eb26-4a72-8ba5-7bf60832459b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:14.332403 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3b13b63-eb26-4a72-8ba5-7bf60832459b tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097702 Mar 12 21:10:14.333181 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3400/4168] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:10:14 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:14.350737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c450aaf2-0068-4e35-b8ea-4561a34acdf0 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:14.351616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c450aaf2-0068-4e35-b8ea-4561a34acdf0 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:14.375645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c450aaf2-0068-4e35-b8ea-4561a34acdf0 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:14.378893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c450aaf2-0068-4e35-b8ea-4561a34acdf0 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:14.380568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c450aaf2-0068-4e35-b8ea-4561a34acdf0 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:14.383422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c450aaf2-0068-4e35-b8ea-4561a34acdf0 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:14.840192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c450aaf2-0068-4e35-b8ea-4561a34acdf0 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:14.855246 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c450aaf2-0068-4e35-b8ea-4561a34acdf0 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1564 microversion: 2.1 time: 0.517615 Mar 12 21:10:14.855897 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3401/4169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:14 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1564 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:14.870779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7e7a3c36-d7cc-4929-97a3-bf7c019e67af req-8fda9a57-f992-4aab-a4b3-d7268cf4ccb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb3c81a-e3d8-4620-9c9d-7bfb50867f47", "tag": "2d64c72f-d3dd-4cc6-807e-8819869e76e4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:14.891810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7e7a3c36-d7cc-4929-97a3-bf7c019e67af req-8fda9a57-f992-4aab-a4b3-d7268cf4ccb5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:14.892838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7e7a3c36-d7cc-4929-97a3-bf7c019e67af req-8fda9a57-f992-4aab-a4b3-d7268cf4ccb5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:14.913418 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7e7a3c36-d7cc-4929-97a3-bf7c019e67af req-8fda9a57-f992-4aab-a4b3-d7268cf4ccb5 service nova] Creating event network-changed:2d64c72f-d3dd-4cc6-807e-8819869e76e4 for instance 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 on nch2-master-1 Mar 12 21:10:14.922522 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7e7a3c36-d7cc-4929-97a3-bf7c019e67af req-8fda9a57-f992-4aab-a4b3-d7268cf4ccb5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063483 Mar 12 21:10:14.923861 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3402/4170] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:14.934272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-28076d3c-d552-4f3e-b642-4c11a88b9d05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:14.935448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-28076d3c-d552-4f3e-b642-4c11a88b9d05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:14.947219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28076d3c-d552-4f3e-b642-4c11a88b9d05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:14.959152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28076d3c-d552-4f3e-b642-4c11a88b9d05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:14.960038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28076d3c-d552-4f3e-b642-4c11a88b9d05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:14.960499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28076d3c-d552-4f3e-b642-4c11a88b9d05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:15.025465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-28076d3c-d552-4f3e-b642-4c11a88b9d05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:10:15.169079 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-28076d3c-d552-4f3e-b642-4c11a88b9d05 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 204 len: 0 microversion: 2.1 time: 0.242545 Mar 12 21:10:15.170201 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3403/4171] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:10:14 2022] DELETE /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:10:15.180867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26738000-0957-4535-8eaf-505aa0f476e9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:15.182067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-26738000-0957-4535-8eaf-505aa0f476e9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:15.191529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26738000-0957-4535-8eaf-505aa0f476e9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:15.192176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26738000-0957-4535-8eaf-505aa0f476e9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:15.193463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26738000-0957-4535-8eaf-505aa0f476e9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:15.194075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26738000-0957-4535-8eaf-505aa0f476e9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:15.941628 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-26738000-0957-4535-8eaf-505aa0f476e9 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 200 len: 1655 microversion: 2.1 time: 0.762403 Mar 12 21:10:15.946091 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3404/4172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:15 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 1655 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:15.954088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-461ef162-d8cb-4fa0-a876-3738ab019ce3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:15.959725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-461ef162-d8cb-4fa0-a876-3738ab019ce3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:15.977821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-461ef162-d8cb-4fa0-a876-3738ab019ce3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:15.978269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-461ef162-d8cb-4fa0-a876-3738ab019ce3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:15.979056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-461ef162-d8cb-4fa0-a876-3738ab019ce3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:15.982449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-461ef162-d8cb-4fa0-a876-3738ab019ce3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:16.049267 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-461ef162-d8cb-4fa0-a876-3738ab019ce3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100955 Mar 12 21:10:16.050241 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3405/4173] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:10:15 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 12 21:10:16.170837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5074ed54-2ba4-4ef1-a7bd-35d1c9f74289 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:16.171354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5074ed54-2ba4-4ef1-a7bd-35d1c9f74289 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:16.184205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5074ed54-2ba4-4ef1-a7bd-35d1c9f74289 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:16.184666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5074ed54-2ba4-4ef1-a7bd-35d1c9f74289 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:16.189239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5074ed54-2ba4-4ef1-a7bd-35d1c9f74289 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:16.189858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5074ed54-2ba4-4ef1-a7bd-35d1c9f74289 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:16.260959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5074ed54-2ba4-4ef1-a7bd-35d1c9f74289 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:10:16.490195 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5074ed54-2ba4-4ef1-a7bd-35d1c9f74289 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 204 len: 0 microversion: 2.1 time: 0.324753 Mar 12 21:10:16.492696 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3406/4174] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:10:16 2022] DELETE /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:10:16.501501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04d2a481-4f83-426c-85db-e6aca63cda64 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:16.503384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04d2a481-4f83-426c-85db-e6aca63cda64 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:16.512909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04d2a481-4f83-426c-85db-e6aca63cda64 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:16.513713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04d2a481-4f83-426c-85db-e6aca63cda64 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:16.514776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04d2a481-4f83-426c-85db-e6aca63cda64 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:16.515480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04d2a481-4f83-426c-85db-e6aca63cda64 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:16.999987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04d2a481-4f83-426c-85db-e6aca63cda64 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:17.009645 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04d2a481-4f83-426c-85db-e6aca63cda64 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1679 microversion: 2.1 time: 0.512795 Mar 12 21:10:17.010284 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3407/4175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:16 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1679 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:17.027071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f7b7307-589b-4d07-82ea-4af1ee46dc32 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:17.034521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f7b7307-589b-4d07-82ea-4af1ee46dc32 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:17.063602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f7b7307-589b-4d07-82ea-4af1ee46dc32 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:17.064069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f7b7307-589b-4d07-82ea-4af1ee46dc32 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:17.074653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f7b7307-589b-4d07-82ea-4af1ee46dc32 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:17.075120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f7b7307-589b-4d07-82ea-4af1ee46dc32 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:17.563139 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f7b7307-589b-4d07-82ea-4af1ee46dc32 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 200 len: 1655 microversion: 2.1 time: 0.551785 Mar 12 21:10:17.564341 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3408/4176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:17 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 1655 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:17.649220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8b0c4779-c00f-4144-a1da-968ede8b3ae2 req-bfbef781-5d8a-4a5b-80b6-805cf41e21a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b8d1d8-368f-44ac-95fc-05d208433692", "name": "network-vif-deleted", "tag": "0cbebf47-bd6d-4a71-bd85-a7f1f8dc5c8e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:17.669254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8b0c4779-c00f-4144-a1da-968ede8b3ae2 req-bfbef781-5d8a-4a5b-80b6-805cf41e21a6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:17.671390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8b0c4779-c00f-4144-a1da-968ede8b3ae2 req-bfbef781-5d8a-4a5b-80b6-805cf41e21a6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:17.726576 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8b0c4779-c00f-4144-a1da-968ede8b3ae2 req-bfbef781-5d8a-4a5b-80b6-805cf41e21a6 service nova] Creating event network-vif-deleted:0cbebf47-bd6d-4a71-bd85-a7f1f8dc5c8e for instance a1b8d1d8-368f-44ac-95fc-05d208433692 on nch2-master-1 Mar 12 21:10:17.744910 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8b0c4779-c00f-4144-a1da-968ede8b3ae2 req-bfbef781-5d8a-4a5b-80b6-805cf41e21a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099639 Mar 12 21:10:17.754859 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3409/4177] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:10:18.029466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ac1d9b5c-f7a0-45b2-8ea8-9e1caeea2e4e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:18.030218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ac1d9b5c-f7a0-45b2-8ea8-9e1caeea2e4e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:18.052096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac1d9b5c-f7a0-45b2-8ea8-9e1caeea2e4e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:18.054903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac1d9b5c-f7a0-45b2-8ea8-9e1caeea2e4e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:18.055745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac1d9b5c-f7a0-45b2-8ea8-9e1caeea2e4e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:18.058142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac1d9b5c-f7a0-45b2-8ea8-9e1caeea2e4e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:19.234805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ac1d9b5c-f7a0-45b2-8ea8-9e1caeea2e4e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:19.249012 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ac1d9b5c-f7a0-45b2-8ea8-9e1caeea2e4e tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1679 microversion: 2.1 time: 1.220372 Mar 12 21:10:19.255344 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3410/4178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:18 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1679 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:10:19.267480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-994c341f-ef2b-469f-a5b3-f8f9c5ba6b41 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:19.271213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-994c341f-ef2b-469f-a5b3-f8f9c5ba6b41 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: a1b8d1d8-368f-44ac-95fc-05d208433692] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:19.298276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-994c341f-ef2b-469f-a5b3-f8f9c5ba6b41 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:19.298975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-994c341f-ef2b-469f-a5b3-f8f9c5ba6b41 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:19.300827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-994c341f-ef2b-469f-a5b3-f8f9c5ba6b41 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:19.302327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-994c341f-ef2b-469f-a5b3-f8f9c5ba6b41 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:19.358862 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-994c341f-ef2b-469f-a5b3-f8f9c5ba6b41 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] HTTP exception thrown: Instance a1b8d1d8-368f-44ac-95fc-05d208433692 could not be found. Mar 12 21:10:19.359583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-994c341f-ef2b-469f-a5b3-f8f9c5ba6b41 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Returning 404 to user: Instance a1b8d1d8-368f-44ac-95fc-05d208433692 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:10:19.360436 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-994c341f-ef2b-469f-a5b3-f8f9c5ba6b41 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692" status: 404 len: 111 microversion: 2.1 time: 0.100295 Mar 12 21:10:19.374568 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3411/4179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:19 2022] GET /compute/v2.1/servers/a1b8d1d8-368f-44ac-95fc-05d208433692 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:10:19.383554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a2163d2-9aa9-4d24-9d4c-f08801b1f9f8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:19.383983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a2163d2-9aa9-4d24-9d4c-f08801b1f9f8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:19.401250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a2163d2-9aa9-4d24-9d4c-f08801b1f9f8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:19.401717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a2163d2-9aa9-4d24-9d4c-f08801b1f9f8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:19.407452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a2163d2-9aa9-4d24-9d4c-f08801b1f9f8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:19.407928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a2163d2-9aa9-4d24-9d4c-f08801b1f9f8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:19.467652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a2163d2-9aa9-4d24-9d4c-f08801b1f9f8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:10:19.676071 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a2163d2-9aa9-4d24-9d4c-f08801b1f9f8 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 204 len: 0 microversion: 2.1 time: 0.297107 Mar 12 21:10:19.677513 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3412/4180] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:10:19 2022] DELETE /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:10:19.696734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d87d1c8e-c554-44f4-b84a-2ae3276795c1 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:19.700664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d87d1c8e-c554-44f4-b84a-2ae3276795c1 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:19.724337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d87d1c8e-c554-44f4-b84a-2ae3276795c1 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:19.724826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d87d1c8e-c554-44f4-b84a-2ae3276795c1 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:19.732632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d87d1c8e-c554-44f4-b84a-2ae3276795c1 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:19.733137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d87d1c8e-c554-44f4-b84a-2ae3276795c1 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:20.746756 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d87d1c8e-c554-44f4-b84a-2ae3276795c1 tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1654 microversion: 2.1 time: 1.061631 Mar 12 21:10:20.748471 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3413/4181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:19 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1654 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:20.768858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1c1b4b17-e87d-444f-a6dd-4bf1dc9bd2a4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:20.772213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1c1b4b17-e87d-444f-a6dd-4bf1dc9bd2a4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:20.782095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c1b4b17-e87d-444f-a6dd-4bf1dc9bd2a4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:20.782907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c1b4b17-e87d-444f-a6dd-4bf1dc9bd2a4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:20.784632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c1b4b17-e87d-444f-a6dd-4bf1dc9bd2a4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:20.785566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c1b4b17-e87d-444f-a6dd-4bf1dc9bd2a4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:21.482958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1c1b4b17-e87d-444f-a6dd-4bf1dc9bd2a4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:21.494469 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1c1b4b17-e87d-444f-a6dd-4bf1dc9bd2a4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1679 microversion: 2.1 time: 0.743933 Mar 12 21:10:21.499114 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3414/4182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:20 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1679 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:21.534367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d21d1815-1328-4713-89a4-ac197411499f req-80c8e520-cb90-4af7-a05c-f6485302d06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5630c6-2e87-4f5c-898a-646c3a54bad2", "name": "network-vif-unplugged", "status": "completed", "tag": "ba9170e6-98eb-4fa5-b253-d9171cbe3f66"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:21.546166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d21d1815-1328-4713-89a4-ac197411499f req-80c8e520-cb90-4af7-a05c-f6485302d06d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:21.551561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d21d1815-1328-4713-89a4-ac197411499f req-80c8e520-cb90-4af7-a05c-f6485302d06d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:21.642071 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d21d1815-1328-4713-89a4-ac197411499f req-80c8e520-cb90-4af7-a05c-f6485302d06d service nova] Creating event network-vif-unplugged:ba9170e6-98eb-4fa5-b253-d9171cbe3f66 for instance 1f5630c6-2e87-4f5c-898a-646c3a54bad2 on nch1-master-1 Mar 12 21:10:21.657115 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d21d1815-1328-4713-89a4-ac197411499f req-80c8e520-cb90-4af7-a05c-f6485302d06d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130697 Mar 12 21:10:21.661020 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3415/4183] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Mar 12 21:10:21.768457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1f60c71-95a5-443d-a36c-7937bb45460a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:21.769191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a1f60c71-95a5-443d-a36c-7937bb45460a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:21.790026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1f60c71-95a5-443d-a36c-7937bb45460a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:21.791694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1f60c71-95a5-443d-a36c-7937bb45460a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:21.793519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1f60c71-95a5-443d-a36c-7937bb45460a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:21.796194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1f60c71-95a5-443d-a36c-7937bb45460a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:22.862063 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1f60c71-95a5-443d-a36c-7937bb45460a tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 200 len: 1654 microversion: 2.1 time: 1.100937 Mar 12 21:10:22.865385 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3416/4184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:21 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 1654 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:10:22.878975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2e47bad8-929d-46fa-950d-b5b03412cd37 req-73163b95-0001-4951-ba9c-8f1014c02ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b6963f2-09e1-45ab-a1e2-0f68d8ad946c", "name": "network-vif-deleted", "tag": "cd7cb47b-ebe9-4200-ba03-ab745c30e69c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:22.893576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2e47bad8-929d-46fa-950d-b5b03412cd37 req-73163b95-0001-4951-ba9c-8f1014c02ce0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:22.901728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2e47bad8-929d-46fa-950d-b5b03412cd37 req-73163b95-0001-4951-ba9c-8f1014c02ce0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:22.931365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2e47bad8-929d-46fa-950d-b5b03412cd37 req-73163b95-0001-4951-ba9c-8f1014c02ce0 service nova] Creating event network-vif-deleted:cd7cb47b-ebe9-4200-ba03-ab745c30e69c for instance 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c on nch1-master-1 Mar 12 21:10:22.955091 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2e47bad8-929d-46fa-950d-b5b03412cd37 req-73163b95-0001-4951-ba9c-8f1014c02ce0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086905 Mar 12 21:10:22.968406 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3417/4185] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:22.985468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f0982009-00eb-4d1f-856c-e6a59f5b4af3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:22.986981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f0982009-00eb-4d1f-856c-e6a59f5b4af3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:23.007569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0982009-00eb-4d1f-856c-e6a59f5b4af3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:23.008556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0982009-00eb-4d1f-856c-e6a59f5b4af3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:23.013985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0982009-00eb-4d1f-856c-e6a59f5b4af3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:23.016005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0982009-00eb-4d1f-856c-e6a59f5b4af3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:23.254799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f0982009-00eb-4d1f-856c-e6a59f5b4af3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:23.266868 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f0982009-00eb-4d1f-856c-e6a59f5b4af3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1612 microversion: 2.1 time: 0.294086 Mar 12 21:10:23.268715 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3418/4186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:22 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1612 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:23.588744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4320be68-1ca2-429e-81b9-fc7d574a0f2b req-f7fc8910-d926-4c11-b701-4867c5f2c09a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5630c6-2e87-4f5c-898a-646c3a54bad2", "name": "network-vif-deleted", "tag": "ba9170e6-98eb-4fa5-b253-d9171cbe3f66"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:23.614912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4320be68-1ca2-429e-81b9-fc7d574a0f2b req-f7fc8910-d926-4c11-b701-4867c5f2c09a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:23.615781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4320be68-1ca2-429e-81b9-fc7d574a0f2b req-f7fc8910-d926-4c11-b701-4867c5f2c09a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:23.655137 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4320be68-1ca2-429e-81b9-fc7d574a0f2b req-f7fc8910-d926-4c11-b701-4867c5f2c09a service nova] Creating event network-vif-deleted:ba9170e6-98eb-4fa5-b253-d9171cbe3f66 for instance 1f5630c6-2e87-4f5c-898a-646c3a54bad2 on nch1-master-1 Mar 12 21:10:23.683435 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4320be68-1ca2-429e-81b9-fc7d574a0f2b req-f7fc8910-d926-4c11-b701-4867c5f2c09a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096392 Mar 12 21:10:23.690678 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3419/4187] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:23.881710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-627e88a2-4636-426e-85c7-d792b14a23fd tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:23.883619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-627e88a2-4636-426e-85c7-d792b14a23fd tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] [instance: 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:23.895147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-627e88a2-4636-426e-85c7-d792b14a23fd tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:23.897729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-627e88a2-4636-426e-85c7-d792b14a23fd tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:23.899187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-627e88a2-4636-426e-85c7-d792b14a23fd tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:23.902363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-627e88a2-4636-426e-85c7-d792b14a23fd tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:23.932913 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-627e88a2-4636-426e-85c7-d792b14a23fd tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] HTTP exception thrown: Instance 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c could not be found. Mar 12 21:10:23.933538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-627e88a2-4636-426e-85c7-d792b14a23fd tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] Returning 404 to user: Instance 9b6963f2-09e1-45ab-a1e2-0f68d8ad946c could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:10:23.934434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-627e88a2-4636-426e-85c7-d792b14a23fd tempest-TestServerMultinode-2047225204 tempest-TestServerMultinode-2047225204-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c" status: 404 len: 111 microversion: 2.1 time: 0.057704 Mar 12 21:10:23.936638 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3420/4188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:23 2022] GET /compute/v2.1/servers/9b6963f2-09e1-45ab-a1e2-0f68d8ad946c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:10:24.292113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a3066a1a-88e1-4f70-8955-4587b994cd02 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:24.294556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a3066a1a-88e1-4f70-8955-4587b994cd02 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:24.309657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3066a1a-88e1-4f70-8955-4587b994cd02 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:24.312238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3066a1a-88e1-4f70-8955-4587b994cd02 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:24.315154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3066a1a-88e1-4f70-8955-4587b994cd02 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:24.316834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3066a1a-88e1-4f70-8955-4587b994cd02 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:24.427645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3066a1a-88e1-4f70-8955-4587b994cd02 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:24.428498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3066a1a-88e1-4f70-8955-4587b994cd02 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:24.434519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-a3066a1a-88e1-4f70-8955-4587b994cd02 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lazy-loading 'fault' on Instance uuid 1f5630c6-2e87-4f5c-898a-646c3a54bad2 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:10:24.526189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a3066a1a-88e1-4f70-8955-4587b994cd02 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:24.536466 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a3066a1a-88e1-4f70-8955-4587b994cd02 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 200 len: 1330 microversion: 2.1 time: 0.253422 Mar 12 21:10:24.537304 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3421/4189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:24 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 1330 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:25.573782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2044f269-72e9-4f9e-bfb8-9cd0b234e6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:25.574429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2044f269-72e9-4f9e-bfb8-9cd0b234e6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:25.606290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2044f269-72e9-4f9e-bfb8-9cd0b234e6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:25.606290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2044f269-72e9-4f9e-bfb8-9cd0b234e6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:25.606290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2044f269-72e9-4f9e-bfb8-9cd0b234e6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:25.606290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2044f269-72e9-4f9e-bfb8-9cd0b234e6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:25.643759 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-2044f269-72e9-4f9e-bfb8-9cd0b234e6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Instance 1f5630c6-2e87-4f5c-898a-646c3a54bad2 could not be found. Mar 12 21:10:25.645395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2044f269-72e9-4f9e-bfb8-9cd0b234e6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 404 to user: Instance 1f5630c6-2e87-4f5c-898a-646c3a54bad2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:10:25.659995 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2044f269-72e9-4f9e-bfb8-9cd0b234e6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 404 len: 111 microversion: 2.1 time: 0.104479 Mar 12 21:10:25.664805 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3422/4190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:25 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:10:25.672039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-645b774c-d131-4d42-8791-5fd8b2d4ef39 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '.version_select at 0x7f6e355a4c10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:25.716130 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-645b774c-d131-4d42-8791-5fd8b2d4ef39 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-189980980" status: 202 len: 0 microversion: 2.1 time: 0.048290 Mar 12 21:10:25.717532 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3423/4191] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Mar 12 21:10:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-189980980 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:10:28.763325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4049094d-94b9-4085-9a71-2e253a4de0aa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: .version_select at 0x7f6e35549b80>, body: {"keypair": {"name": "tempest-keypair-421008801"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:28.786035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4049094d-94b9-4085-9a71-2e253a4de0aa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:10:28.791325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4049094d-94b9-4085-9a71-2e253a4de0aa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for user f2c8058e4e8d475c9377a065b4018a2a and project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:10:29.015016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4049094d-94b9-4085-9a71-2e253a4de0aa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:10:29.022058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4049094d-94b9-4085-9a71-2e253a4de0aa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for user f2c8058e4e8d475c9377a065b4018a2a and project 2f427010b06749289b20e8b776a8b8c2. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:10:29.046073 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4049094d-94b9-4085-9a71-2e253a4de0aa tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.288483 Mar 12 21:10:29.047691 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3424/4192] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:10:28 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:30.484421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dbb0563b-e2df-4261-98a2-db16bc1c27e2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:30.486833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dbb0563b-e2df-4261-98a2-db16bc1c27e2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:30.508940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbb0563b-e2df-4261-98a2-db16bc1c27e2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:30.509405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbb0563b-e2df-4261-98a2-db16bc1c27e2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:30.511065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbb0563b-e2df-4261-98a2-db16bc1c27e2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:30.511712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbb0563b-e2df-4261-98a2-db16bc1c27e2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:30.593792 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dbb0563b-e2df-4261-98a2-db16bc1c27e2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47/action" status: 200 len: 24573 microversion: 2.1 time: 0.114018 Mar 12 21:10:30.595252 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3425/4193] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:10:30 2022] POST /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47/action => generated 24573 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 21:10:33.332063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1866644992", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94a25897-3a88-44fe-b618-77b90965f553"}], "security_groups": [{"name": "tempest-securitygroup--887504032"}], "key_name": "tempest-keypair-421008801", "user_data": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:33.702145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] validate_networks() for [('94a25897-3a88-44fe-b618-77b90965f553', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:10:35.196907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:10:35.197487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:10:35.201160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:10:35.201587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:10:35.202055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:10:35.228818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:35.229325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:35.241292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:35.241915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:35.338753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for project 2f427010b06749289b20e8b776a8b8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:10:35.362710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Getting quotas for user f2c8058e4e8d475c9377a065b4018a2a and project 2f427010b06749289b20e8b776a8b8c2. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:10:35.417206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:10:35.419941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:10:35.573180 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6fb9411d-597f-4cb4-860b-8a27fc805ff3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.247671 Mar 12 21:10:35.575772 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3426/4194] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:10:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:10:35.585013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da7c3b7c-86b6-4b82-a09c-92533fd1edc7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:35.590099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da7c3b7c-86b6-4b82-a09c-92533fd1edc7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:35.836216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da7c3b7c-86b6-4b82-a09c-92533fd1edc7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:35.852538 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da7c3b7c-86b6-4b82-a09c-92533fd1edc7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1241 microversion: 2.1 time: 0.271522 Mar 12 21:10:35.853173 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3427/4195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:35 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1241 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:10:36.900126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc106347-7919-497e-86ea-a5ed66dc66ec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:36.900126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc106347-7919-497e-86ea-a5ed66dc66ec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:36.917563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc106347-7919-497e-86ea-a5ed66dc66ec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:36.918277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc106347-7919-497e-86ea-a5ed66dc66ec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:36.922019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc106347-7919-497e-86ea-a5ed66dc66ec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:36.930116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc106347-7919-497e-86ea-a5ed66dc66ec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:37.161300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dc106347-7919-497e-86ea-a5ed66dc66ec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:37.177836 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc106347-7919-497e-86ea-a5ed66dc66ec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1237 microversion: 2.1 time: 0.308162 Mar 12 21:10:37.189524 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3428/4196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:36 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1237 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:10:37.195293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-92804522-6125-4115-869c-93b347b934ac tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:37.202749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-92804522-6125-4115-869c-93b347b934ac tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:37.209633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92804522-6125-4115-869c-93b347b934ac tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:37.210150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92804522-6125-4115-869c-93b347b934ac tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:37.211776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92804522-6125-4115-869c-93b347b934ac tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:37.212179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92804522-6125-4115-869c-93b347b934ac tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:38.271834 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-92804522-6125-4115-869c-93b347b934ac tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1834 microversion: 2.1 time: 1.080819 Mar 12 21:10:38.272514 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3429/4197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:37 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1834 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:38.278053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb5f9317-e0e3-4516-867f-f601a4754878 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:38.283213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fb5f9317-e0e3-4516-867f-f601a4754878 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:38.293145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb5f9317-e0e3-4516-867f-f601a4754878 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:38.293856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb5f9317-e0e3-4516-867f-f601a4754878 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:38.294822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb5f9317-e0e3-4516-867f-f601a4754878 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:38.295598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb5f9317-e0e3-4516-867f-f601a4754878 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:38.384944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fb5f9317-e0e3-4516-867f-f601a4754878 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:38.396191 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb5f9317-e0e3-4516-867f-f601a4754878 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1299 microversion: 2.1 time: 0.121518 Mar 12 21:10:38.397176 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3430/4198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:38 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:38.415197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d893b6cd-80e4-4cdb-9a05-ff02b592b3e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:38.416412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d893b6cd-80e4-4cdb-9a05-ff02b592b3e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:38.436968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d893b6cd-80e4-4cdb-9a05-ff02b592b3e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:38.443367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d893b6cd-80e4-4cdb-9a05-ff02b592b3e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:38.444234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d893b6cd-80e4-4cdb-9a05-ff02b592b3e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:38.444689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d893b6cd-80e4-4cdb-9a05-ff02b592b3e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:39.099866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d893b6cd-80e4-4cdb-9a05-ff02b592b3e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:39.121135 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d893b6cd-80e4-4cdb-9a05-ff02b592b3e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1683 microversion: 2.1 time: 0.709526 Mar 12 21:10:39.122757 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3431/4199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:38 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1683 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:39.303748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8eb42c29-ccef-400b-829a-818ac61df9fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:39.305625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8eb42c29-ccef-400b-829a-818ac61df9fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:39.321614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8eb42c29-ccef-400b-829a-818ac61df9fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:39.324145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8eb42c29-ccef-400b-829a-818ac61df9fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:39.325402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8eb42c29-ccef-400b-829a-818ac61df9fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:39.326010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8eb42c29-ccef-400b-829a-818ac61df9fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:39.442656 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8eb42c29-ccef-400b-829a-818ac61df9fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47/action" status: 200 len: 32642 microversion: 2.1 time: 0.144598 Mar 12 21:10:39.446413 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3432/4200] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:10:39 2022] POST /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47/action => generated 32642 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:10:39.461950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ecfbe966-8893-45d7-ac0b-b1e9fd5714fb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:39.462705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ecfbe966-8893-45d7-ac0b-b1e9fd5714fb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:39.483657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecfbe966-8893-45d7-ac0b-b1e9fd5714fb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:39.484120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecfbe966-8893-45d7-ac0b-b1e9fd5714fb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:39.484919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecfbe966-8893-45d7-ac0b-b1e9fd5714fb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:39.485365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecfbe966-8893-45d7-ac0b-b1e9fd5714fb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:39.602123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ecfbe966-8893-45d7-ac0b-b1e9fd5714fb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:39.612297 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ecfbe966-8893-45d7-ac0b-b1e9fd5714fb tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1299 microversion: 2.1 time: 0.165138 Mar 12 21:10:39.612907 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3433/4201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:39 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:39.626425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c4ff14fe-1a6b-46c5-9d32-707888d75051 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Action: 'create', calling method: .version_select at 0x7f6e35567700>, body: {"keypair": {"name": "tempest-keypair-1525760273"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:39.663568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c4ff14fe-1a6b-46c5-9d32-707888d75051 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Getting quotas for project 84e4429fb88f43b4b511a4fed7fd2caa. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:10:39.670951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c4ff14fe-1a6b-46c5-9d32-707888d75051 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Getting quotas for user cb5f0a9eb48441c6844afe3d559af06b and project 84e4429fb88f43b4b511a4fed7fd2caa. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:10:39.857425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c4ff14fe-1a6b-46c5-9d32-707888d75051 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Getting quotas for project 84e4429fb88f43b4b511a4fed7fd2caa. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:10:39.865022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c4ff14fe-1a6b-46c5-9d32-707888d75051 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Getting quotas for user cb5f0a9eb48441c6844afe3d559af06b and project 84e4429fb88f43b4b511a4fed7fd2caa. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:10:39.893867 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c4ff14fe-1a6b-46c5-9d32-707888d75051 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.32 time: 0.277792 Mar 12 21:10:39.894877 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3434/4202] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Mar 12 21:10:39 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 280 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:10:39.902820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-97013cb1-6011-47bc-858c-c888c4178d43 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:39.903684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-97013cb1-6011-47bc-858c-c888c4178d43 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:39.932336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97013cb1-6011-47bc-858c-c888c4178d43 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:39.933966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97013cb1-6011-47bc-858c-c888c4178d43 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:39.936326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97013cb1-6011-47bc-858c-c888c4178d43 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:39.938133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97013cb1-6011-47bc-858c-c888c4178d43 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:40.129183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-97013cb1-6011-47bc-858c-c888c4178d43 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e082a08eba8f41e3b82e46f7bfc41d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa690a96e94044dbb8be9236d64b53e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:40.130239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-97013cb1-6011-47bc-858c-c888c4178d43 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] flavor_id is None. Assuming migration. {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4140}} Mar 12 21:10:40.131116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-97013cb1-6011-47bc-858c-c888c4178d43 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 21:10:41.016888 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-97013cb1-6011-47bc-858c-c888c4178d43 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47/action" status: 202 len: 0 microversion: 2.1 time: 1.120322 Mar 12 21:10:41.018960 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3435/4203] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:10:39 2022] POST /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47/action => generated 0 bytes in 1123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:10:41.027232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec31d2bf-eba4-44ee-a866-4ea4a5af90b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:41.030703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec31d2bf-eba4-44ee-a866-4ea4a5af90b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:41.049942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec31d2bf-eba4-44ee-a866-4ea4a5af90b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:41.053666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec31d2bf-eba4-44ee-a866-4ea4a5af90b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:41.054663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec31d2bf-eba4-44ee-a866-4ea4a5af90b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:41.055197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec31d2bf-eba4-44ee-a866-4ea4a5af90b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:41.348959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ec31d2bf-eba4-44ee-a866-4ea4a5af90b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:41.373872 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec31d2bf-eba4-44ee-a866-4ea4a5af90b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1366 microversion: 2.1 time: 0.350892 Mar 12 21:10:41.377065 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3436/4204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:41 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:41.403927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-24dc66c3-8ea5-41f3-8143-d34a091a7d00 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:41.404554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-24dc66c3-8ea5-41f3-8143-d34a091a7d00 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:41.422456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24dc66c3-8ea5-41f3-8143-d34a091a7d00 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:41.424427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24dc66c3-8ea5-41f3-8143-d34a091a7d00 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:41.425311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24dc66c3-8ea5-41f3-8143-d34a091a7d00 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:41.427893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24dc66c3-8ea5-41f3-8143-d34a091a7d00 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:41.845989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-24dc66c3-8ea5-41f3-8143-d34a091a7d00 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:41.866978 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-24dc66c3-8ea5-41f3-8143-d34a091a7d00 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1692 microversion: 2.1 time: 0.471097 Mar 12 21:10:41.868332 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3437/4205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:41 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1692 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:42.394523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d17851d9-31a0-443f-88f9-494a81cd4433 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:42.396461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d17851d9-31a0-443f-88f9-494a81cd4433 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:42.408162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d17851d9-31a0-443f-88f9-494a81cd4433 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:42.408710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d17851d9-31a0-443f-88f9-494a81cd4433 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:42.409545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d17851d9-31a0-443f-88f9-494a81cd4433 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:42.414860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d17851d9-31a0-443f-88f9-494a81cd4433 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:43.086073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d17851d9-31a0-443f-88f9-494a81cd4433 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:43.100060 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d17851d9-31a0-443f-88f9-494a81cd4433 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1366 microversion: 2.1 time: 0.710969 Mar 12 21:10:43.106130 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3438/4206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:42 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1366 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:10:43.116545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bf4b142b-d601-46a7-8a32-2630b155e1f6 req-912e5442-b252-4039-bb17-0ffc432922a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add0bf65-fc12-498d-b1fa-68d1bb659524", "tag": "0d5e522b-3263-42db-b7e7-ba95e5db5399"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:43.140421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bf4b142b-d601-46a7-8a32-2630b155e1f6 req-912e5442-b252-4039-bb17-0ffc432922a5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:43.141703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bf4b142b-d601-46a7-8a32-2630b155e1f6 req-912e5442-b252-4039-bb17-0ffc432922a5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:43.167755 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bf4b142b-d601-46a7-8a32-2630b155e1f6 req-912e5442-b252-4039-bb17-0ffc432922a5 service nova] Creating event network-changed:0d5e522b-3263-42db-b7e7-ba95e5db5399 for instance add0bf65-fc12-498d-b1fa-68d1bb659524 on nch1-master-1 Mar 12 21:10:43.180145 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bf4b142b-d601-46a7-8a32-2630b155e1f6 req-912e5442-b252-4039-bb17-0ffc432922a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072434 Mar 12 21:10:43.180956 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3439/4207] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:43.188060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-79bf22e0-6404-493f-a1c0-af4b038a18e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:43.193973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-79bf22e0-6404-493f-a1c0-af4b038a18e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:43.210081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79bf22e0-6404-493f-a1c0-af4b038a18e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:43.210876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79bf22e0-6404-493f-a1c0-af4b038a18e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:43.211905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79bf22e0-6404-493f-a1c0-af4b038a18e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:43.214332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79bf22e0-6404-493f-a1c0-af4b038a18e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:43.656378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-79bf22e0-6404-493f-a1c0-af4b038a18e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:43.672874 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-79bf22e0-6404-493f-a1c0-af4b038a18e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1692 microversion: 2.1 time: 0.487396 Mar 12 21:10:43.683867 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3440/4208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:43 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1692 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:44.118515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-137e9d09-c783-48f6-bde6-936c1285e04c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:44.119382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-137e9d09-c783-48f6-bde6-936c1285e04c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:44.133764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-137e9d09-c783-48f6-bde6-936c1285e04c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:44.134663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-137e9d09-c783-48f6-bde6-936c1285e04c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:44.136692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-137e9d09-c783-48f6-bde6-936c1285e04c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:44.140293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-137e9d09-c783-48f6-bde6-936c1285e04c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:44.995230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-137e9d09-c783-48f6-bde6-936c1285e04c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:45.004210 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-137e9d09-c783-48f6-bde6-936c1285e04c tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1366 microversion: 2.1 time: 0.891353 Mar 12 21:10:45.016836 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3441/4209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:44 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1366 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:10:45.022480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-613b1a7a-77e9-4bf7-9e7c-9c6826b7a12a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:45.023272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-613b1a7a-77e9-4bf7-9e7c-9c6826b7a12a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:45.030850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-613b1a7a-77e9-4bf7-9e7c-9c6826b7a12a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:45.039326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-613b1a7a-77e9-4bf7-9e7c-9c6826b7a12a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:45.040380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-613b1a7a-77e9-4bf7-9e7c-9c6826b7a12a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:45.040993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-613b1a7a-77e9-4bf7-9e7c-9c6826b7a12a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:45.932070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-613b1a7a-77e9-4bf7-9e7c-9c6826b7a12a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:45.945188 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-613b1a7a-77e9-4bf7-9e7c-9c6826b7a12a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1692 microversion: 2.1 time: 0.926315 Mar 12 21:10:45.949453 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3442/4210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:45 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1692 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:46.037418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1986c908-c2f6-4769-afed-933674ecbd65 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:46.039806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1986c908-c2f6-4769-afed-933674ecbd65 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:46.050308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1986c908-c2f6-4769-afed-933674ecbd65 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:46.050830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1986c908-c2f6-4769-afed-933674ecbd65 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:46.051992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1986c908-c2f6-4769-afed-933674ecbd65 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:46.053236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1986c908-c2f6-4769-afed-933674ecbd65 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:46.430636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1986c908-c2f6-4769-afed-933674ecbd65 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:46.438527 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1986c908-c2f6-4769-afed-933674ecbd65 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1366 microversion: 2.1 time: 0.408238 Mar 12 21:10:46.441214 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3443/4211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:46 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:46.446282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1478220423", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "bcfd3d27-7aa0-4631-9910-5beef334d97d"}, {"port": "f49f4c24-9f44-42d0-939e-231a7d1e5b6f", "tag": "port-1"}, {"port": "c4ac74ea-714d-47dc-8e6e-7e337514c985", "tag": "port-2"}, {"uuid": "07ee1c3b-7969-4bcc-82c7-0748aa557b90", "tag": "net-1"}, {"uuid": "07ee1c3b-7969-4bcc-82c7-0748aa557b90"}, {"uuid": "c06beeef-cc79-4bc3-9b10-4acaeb3cf3b9", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c06beeef-cc79-4bc3-9b10-4acaeb3cf3b9", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "33b5d761-3965-4dcf-89b4-d41fc8e26fd9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "519a2fed-2ed7-49b2-973b-b1a48e2e8095", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--622341679"}], "key_name": "tempest-keypair-1525760273", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:46.649431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] validate_networks() for [('bcfd3d27-7aa0-4631-9910-5beef334d97d', None, None, None, None, None), (None, None, 'f49f4c24-9f44-42d0-939e-231a7d1e5b6f', None, None, None), (None, None, 'c4ac74ea-714d-47dc-8e6e-7e337514c985', None, None, None), ('07ee1c3b-7969-4bcc-82c7-0748aa557b90', None, None, None, None, None), ('07ee1c3b-7969-4bcc-82c7-0748aa557b90', None, None, None, None, None), ('c06beeef-cc79-4bc3-9b10-4acaeb3cf3b9', '10.2.2.100', None, None, None, None), ('c06beeef-cc79-4bc3-9b10-4acaeb3cf3b9', '10.2.2.200', None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:10:50.392857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:10:50.393447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:10:50.394256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:10:50.394775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:10:50.395256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:10:50.420130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:50.420596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:50.422313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:50.424475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:50.448544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Getting quotas for project 84e4429fb88f43b4b511a4fed7fd2caa. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:10:50.455084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Getting quotas for user cb5f0a9eb48441c6844afe3d559af06b and project 84e4429fb88f43b4b511a4fed7fd2caa. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:10:50.658401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:10:50.661332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='33b5d761-3965-4dcf-89b4-d41fc8e26fd9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='519a2fed-2ed7-49b2-973b-b1a48e2e8095',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97dcd19d-c778-4d5a-ac7e-e6f2d767dbf4',volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:10:51.174321 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2584fbe1-2bf1-428c-9e2d-f899e25943b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 4.731709 Mar 12 21:10:51.175515 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3444/4212] 10.222.0.30 () {62 vars in 1188 bytes} [Sat Mar 12 21:10:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 4734 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 12 21:10:51.185650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd0d6b5a-0cf3-4010-9c32-84af716e6959 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:51.186574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd0d6b5a-0cf3-4010-9c32-84af716e6959 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:51.197917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd0d6b5a-0cf3-4010-9c32-84af716e6959 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:51.198657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd0d6b5a-0cf3-4010-9c32-84af716e6959 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:51.199641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd0d6b5a-0cf3-4010-9c32-84af716e6959 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:51.200260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd0d6b5a-0cf3-4010-9c32-84af716e6959 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:51.541497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bd0d6b5a-0cf3-4010-9c32-84af716e6959 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:51.559002 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd0d6b5a-0cf3-4010-9c32-84af716e6959 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1697 microversion: 2.1 time: 0.374698 Mar 12 21:10:51.568059 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3445/4213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:51 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1697 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:51.575965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e4a32ce-98b5-4b3e-a464-4eb955be1cb6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:51.577420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5e4a32ce-98b5-4b3e-a464-4eb955be1cb6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:51.586056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e4a32ce-98b5-4b3e-a464-4eb955be1cb6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:51.586765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e4a32ce-98b5-4b3e-a464-4eb955be1cb6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:51.587753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e4a32ce-98b5-4b3e-a464-4eb955be1cb6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:51.588358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e4a32ce-98b5-4b3e-a464-4eb955be1cb6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:52.041306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5e4a32ce-98b5-4b3e-a464-4eb955be1cb6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:52.054882 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e4a32ce-98b5-4b3e-a464-4eb955be1cb6 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1366 microversion: 2.1 time: 0.483189 Mar 12 21:10:52.067680 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3446/4214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:51 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1366 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:52.077989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-251a66cb-16ae-4151-adf2-563de0f255a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:52.084385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-251a66cb-16ae-4151-adf2-563de0f255a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:52.222908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-251a66cb-16ae-4151-adf2-563de0f255a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:52.240569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-251a66cb-16ae-4151-adf2-563de0f255a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:52.243659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-251a66cb-16ae-4151-adf2-563de0f255a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:52.248612 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-251a66cb-16ae-4151-adf2-563de0f255a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1286 microversion: 2.32 time: 0.178316 Mar 12 21:10:52.249462 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3447/4215] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:10:52 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1286 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:10:52.321614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-92400351-04d2-4c8f-9a5c-08c3c0351095 req-81f96644-2578-42a6-a4b9-ba0bdc979dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add0bf65-fc12-498d-b1fa-68d1bb659524", "name": "network-vif-plugged", "status": "completed", "tag": "0d5e522b-3263-42db-b7e7-ba95e5db5399"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:52.335536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-92400351-04d2-4c8f-9a5c-08c3c0351095 req-81f96644-2578-42a6-a4b9-ba0bdc979dc5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:52.337882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-92400351-04d2-4c8f-9a5c-08c3c0351095 req-81f96644-2578-42a6-a4b9-ba0bdc979dc5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:52.373035 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-92400351-04d2-4c8f-9a5c-08c3c0351095 req-81f96644-2578-42a6-a4b9-ba0bdc979dc5 service nova] Creating event network-vif-plugged:0d5e522b-3263-42db-b7e7-ba95e5db5399 for instance add0bf65-fc12-498d-b1fa-68d1bb659524 on nch1-master-1 Mar 12 21:10:52.387487 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-92400351-04d2-4c8f-9a5c-08c3c0351095 req-81f96644-2578-42a6-a4b9-ba0bdc979dc5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070587 Mar 12 21:10:52.392488 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3448/4216] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:52.578295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-876557c6-e5c9-41b0-9aba-ed1ed157268e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:52.579837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-876557c6-e5c9-41b0-9aba-ed1ed157268e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:52.594239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-876557c6-e5c9-41b0-9aba-ed1ed157268e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:52.599133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-876557c6-e5c9-41b0-9aba-ed1ed157268e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:52.600340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-876557c6-e5c9-41b0-9aba-ed1ed157268e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:52.606657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-876557c6-e5c9-41b0-9aba-ed1ed157268e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:52.919782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-876557c6-e5c9-41b0-9aba-ed1ed157268e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:52.935261 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-876557c6-e5c9-41b0-9aba-ed1ed157268e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1697 microversion: 2.1 time: 0.362239 Mar 12 21:10:52.935890 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3449/4217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:52 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1697 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:10:53.078079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-864ded0e-d297-438b-b5d9-e22a3078e807 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:53.082904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-864ded0e-d297-438b-b5d9-e22a3078e807 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:53.105146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-864ded0e-d297-438b-b5d9-e22a3078e807 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:53.106783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-864ded0e-d297-438b-b5d9-e22a3078e807 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:53.108425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-864ded0e-d297-438b-b5d9-e22a3078e807 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:53.109073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-864ded0e-d297-438b-b5d9-e22a3078e807 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:53.599459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-864ded0e-d297-438b-b5d9-e22a3078e807 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:53.607953 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-864ded0e-d297-438b-b5d9-e22a3078e807 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1366 microversion: 2.1 time: 0.541605 Mar 12 21:10:53.630488 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3450/4218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:53 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1366 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:53.630488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f0b761a9-553b-4cc1-887a-b63f43138506 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:53.633935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f0b761a9-553b-4cc1-887a-b63f43138506 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:53.650658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0b761a9-553b-4cc1-887a-b63f43138506 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:53.653566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0b761a9-553b-4cc1-887a-b63f43138506 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:53.656978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0b761a9-553b-4cc1-887a-b63f43138506 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:53.657763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0b761a9-553b-4cc1-887a-b63f43138506 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:53.828904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f0b761a9-553b-4cc1-887a-b63f43138506 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:53.840077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f0b761a9-553b-4cc1-887a-b63f43138506 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:53.849411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f0b761a9-553b-4cc1-887a-b63f43138506 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:53.853365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f0b761a9-553b-4cc1-887a-b63f43138506 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1584 microversion: 2.32 time: 0.227354 Mar 12 21:10:53.869101 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3451/4219] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:10:53 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1584 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:10:53.953607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5134d590-a387-4555-907f-ad0dd0f117d7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:53.954793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5134d590-a387-4555-907f-ad0dd0f117d7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:53.968426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5134d590-a387-4555-907f-ad0dd0f117d7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:53.971764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5134d590-a387-4555-907f-ad0dd0f117d7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:53.972679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5134d590-a387-4555-907f-ad0dd0f117d7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:53.973152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5134d590-a387-4555-907f-ad0dd0f117d7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:54.377877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5134d590-a387-4555-907f-ad0dd0f117d7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:54.385304 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5134d590-a387-4555-907f-ad0dd0f117d7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1697 microversion: 2.1 time: 0.436049 Mar 12 21:10:54.389489 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3452/4220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:53 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1697 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:10:54.647651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9fe5fa38-6293-44b9-b2f7-db5c2408c2b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:54.649728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9fe5fa38-6293-44b9-b2f7-db5c2408c2b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:54.661309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9fe5fa38-6293-44b9-b2f7-db5c2408c2b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:54.662712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9fe5fa38-6293-44b9-b2f7-db5c2408c2b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:54.664977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9fe5fa38-6293-44b9-b2f7-db5c2408c2b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:54.665937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9fe5fa38-6293-44b9-b2f7-db5c2408c2b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:54.894362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9fe5fa38-6293-44b9-b2f7-db5c2408c2b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:54.912469 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9fe5fa38-6293-44b9-b2f7-db5c2408c2b4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1556 microversion: 2.1 time: 0.272782 Mar 12 21:10:54.914387 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3453/4221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:54 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1556 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:54.931704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2958b491-aa6f-4393-80ac-4e058cafb392 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:54.932607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2958b491-aa6f-4393-80ac-4e058cafb392 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:54.944725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2958b491-aa6f-4393-80ac-4e058cafb392 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:54.945179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2958b491-aa6f-4393-80ac-4e058cafb392 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:54.946261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2958b491-aa6f-4393-80ac-4e058cafb392 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:54.946820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2958b491-aa6f-4393-80ac-4e058cafb392 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:55.047457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2958b491-aa6f-4393-80ac-4e058cafb392 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:55.060698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2958b491-aa6f-4393-80ac-4e058cafb392 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:55.063276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2958b491-aa6f-4393-80ac-4e058cafb392 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:55.065695 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2958b491-aa6f-4393-80ac-4e058cafb392 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1594 microversion: 2.32 time: 0.149800 Mar 12 21:10:55.067036 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3454/4222] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:10:54 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1594 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:10:55.082904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-47ee83b5-b47c-40f1-ac63-b6a3564607ce tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:55.084117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-47ee83b5-b47c-40f1-ac63-b6a3564607ce tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:55.090923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47ee83b5-b47c-40f1-ac63-b6a3564607ce tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:55.091972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47ee83b5-b47c-40f1-ac63-b6a3564607ce tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:55.093112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47ee83b5-b47c-40f1-ac63-b6a3564607ce tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:55.093848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47ee83b5-b47c-40f1-ac63-b6a3564607ce tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:55.327995 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-47ee83b5-b47c-40f1-ac63-b6a3564607ce tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.259588 Mar 12 21:10:55.328841 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3455/4223] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 21:10:55 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524/os-interface => generated 284 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:55.405459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-947bf6d5-9c5e-4633-8e60-4f318e456bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:55.406504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-947bf6d5-9c5e-4633-8e60-4f318e456bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:55.425860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-947bf6d5-9c5e-4633-8e60-4f318e456bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:55.426468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-947bf6d5-9c5e-4633-8e60-4f318e456bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:55.427532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-947bf6d5-9c5e-4633-8e60-4f318e456bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:55.427876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-947bf6d5-9c5e-4633-8e60-4f318e456bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:56.100811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-947bf6d5-9c5e-4633-8e60-4f318e456bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:56.111391 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-947bf6d5-9c5e-4633-8e60-4f318e456bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1697 microversion: 2.1 time: 0.710238 Mar 12 21:10:56.123107 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3456/4224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:55 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1697 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:10:56.130484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4ee25b27-cd0d-4b80-992e-d485ad7b25b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:56.131552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4ee25b27-cd0d-4b80-992e-d485ad7b25b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:56.142196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ee25b27-cd0d-4b80-992e-d485ad7b25b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:56.143557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ee25b27-cd0d-4b80-992e-d485ad7b25b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:56.145012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ee25b27-cd0d-4b80-992e-d485ad7b25b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:56.145903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ee25b27-cd0d-4b80-992e-d485ad7b25b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:57.038966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4ee25b27-cd0d-4b80-992e-d485ad7b25b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:57.059327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4ee25b27-cd0d-4b80-992e-d485ad7b25b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:57.060914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4ee25b27-cd0d-4b80-992e-d485ad7b25b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:57.062167 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4ee25b27-cd0d-4b80-992e-d485ad7b25b9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1661 microversion: 2.32 time: 0.937704 Mar 12 21:10:57.073841 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3457/4225] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:10:56 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1661 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:10:57.129564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-989c56a1-8c84-4041-840a-3dded7ac13bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:57.131058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-989c56a1-8c84-4041-840a-3dded7ac13bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:57.149526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-989c56a1-8c84-4041-840a-3dded7ac13bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:57.150301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-989c56a1-8c84-4041-840a-3dded7ac13bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:57.151269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-989c56a1-8c84-4041-840a-3dded7ac13bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:57.151871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-989c56a1-8c84-4041-840a-3dded7ac13bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:57.721605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-989c56a1-8c84-4041-840a-3dded7ac13bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:57.734282 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-989c56a1-8c84-4041-840a-3dded7ac13bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1697 microversion: 2.1 time: 0.609148 Mar 12 21:10:57.734891 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3458/4226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:57 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1697 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:10:58.081687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-526f22c2-bc82-4275-a2c6-453a64865c52 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:58.083444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-526f22c2-bc82-4275-a2c6-453a64865c52 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:58.112159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-526f22c2-bc82-4275-a2c6-453a64865c52 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:58.112849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-526f22c2-bc82-4275-a2c6-453a64865c52 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:58.114308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-526f22c2-bc82-4275-a2c6-453a64865c52 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:58.115148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-526f22c2-bc82-4275-a2c6-453a64865c52 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:58.706124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-526f22c2-bc82-4275-a2c6-453a64865c52 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:58.724361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-526f22c2-bc82-4275-a2c6-453a64865c52 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:58.726678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-526f22c2-bc82-4275-a2c6-453a64865c52 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:58.730320 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-526f22c2-bc82-4275-a2c6-453a64865c52 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1707 microversion: 2.32 time: 0.651689 Mar 12 21:10:58.748022 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3459/4227] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:10:58 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1707 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:10:58.758523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d97db450-da46-47ed-bf26-ad3d301703b1 req-21557e67-4de2-4075-8970-ba170edeb54b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add0bf65-fc12-498d-b1fa-68d1bb659524", "tag": "0d5e522b-3263-42db-b7e7-ba95e5db5399"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:10:58.772482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d97db450-da46-47ed-bf26-ad3d301703b1 req-21557e67-4de2-4075-8970-ba170edeb54b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:58.773140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d97db450-da46-47ed-bf26-ad3d301703b1 req-21557e67-4de2-4075-8970-ba170edeb54b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:58.814772 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d97db450-da46-47ed-bf26-ad3d301703b1 req-21557e67-4de2-4075-8970-ba170edeb54b service nova] Creating event network-changed:0d5e522b-3263-42db-b7e7-ba95e5db5399 for instance add0bf65-fc12-498d-b1fa-68d1bb659524 on nch1-master-1 Mar 12 21:10:58.856011 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d97db450-da46-47ed-bf26-ad3d301703b1 req-21557e67-4de2-4075-8970-ba170edeb54b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104218 Mar 12 21:10:58.857343 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3460/4228] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:10:58.875176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-01e8f466-c6e6-4483-bbbc-9ef4f5e5f56c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:58.878724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-01e8f466-c6e6-4483-bbbc-9ef4f5e5f56c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:58.901573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01e8f466-c6e6-4483-bbbc-9ef4f5e5f56c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:58.903639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01e8f466-c6e6-4483-bbbc-9ef4f5e5f56c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:58.904871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01e8f466-c6e6-4483-bbbc-9ef4f5e5f56c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:58.907460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01e8f466-c6e6-4483-bbbc-9ef4f5e5f56c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:59.481080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-01e8f466-c6e6-4483-bbbc-9ef4f5e5f56c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:10:59.489613 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-01e8f466-c6e6-4483-bbbc-9ef4f5e5f56c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1696 microversion: 2.1 time: 0.630486 Mar 12 21:10:59.493666 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3461/4229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:10:58 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1696 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:10:59.754302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3f0fcb3a-3215-45ac-9460-aaca36a1c467 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:10:59.756240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3f0fcb3a-3215-45ac-9460-aaca36a1c467 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:10:59.767515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f0fcb3a-3215-45ac-9460-aaca36a1c467 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:59.768353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f0fcb3a-3215-45ac-9460-aaca36a1c467 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:10:59.769704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f0fcb3a-3215-45ac-9460-aaca36a1c467 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:10:59.770421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f0fcb3a-3215-45ac-9460-aaca36a1c467 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:00.504255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3f0fcb3a-3215-45ac-9460-aaca36a1c467 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:00.518145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3f0fcb3a-3215-45ac-9460-aaca36a1c467 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:00.520384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3f0fcb3a-3215-45ac-9460-aaca36a1c467 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:00.521901 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3f0fcb3a-3215-45ac-9460-aaca36a1c467 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1741 microversion: 2.32 time: 0.772805 Mar 12 21:11:00.522750 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3462/4230] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:10:59 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1741 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:00.530811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c4ed6d9a-8eea-412c-9a43-dd136758202b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:00.532883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c4ed6d9a-8eea-412c-9a43-dd136758202b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:00.541082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4ed6d9a-8eea-412c-9a43-dd136758202b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:00.541631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4ed6d9a-8eea-412c-9a43-dd136758202b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:00.556465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4ed6d9a-8eea-412c-9a43-dd136758202b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:00.556946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4ed6d9a-8eea-412c-9a43-dd136758202b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:00.823034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c4ed6d9a-8eea-412c-9a43-dd136758202b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:00.841173 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c4ed6d9a-8eea-412c-9a43-dd136758202b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1696 microversion: 2.1 time: 0.316083 Mar 12 21:11:00.842089 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3463/4231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:00 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1696 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:01.065323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7b3215bd-8328-44ee-a683-889d3f10d7db req-e8bc0197-9b01-4d82-9dba-a88fb5bdbbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb3c81a-e3d8-4620-9c9d-7bfb50867f47", "name": "network-vif-unplugged", "status": "completed", "tag": "2d64c72f-d3dd-4cc6-807e-8819869e76e4"}, {"name": "network-changed", "server_uuid": "6fb3c81a-e3d8-4620-9c9d-7bfb50867f47", "tag": "2d64c72f-d3dd-4cc6-807e-8819869e76e4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:01.105998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7b3215bd-8328-44ee-a683-889d3f10d7db req-e8bc0197-9b01-4d82-9dba-a88fb5bdbbd0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:01.109541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7b3215bd-8328-44ee-a683-889d3f10d7db req-e8bc0197-9b01-4d82-9dba-a88fb5bdbbd0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:01.130142 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7b3215bd-8328-44ee-a683-889d3f10d7db req-e8bc0197-9b01-4d82-9dba-a88fb5bdbbd0 service nova] Creating event network-vif-unplugged:2d64c72f-d3dd-4cc6-807e-8819869e76e4 for instance 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 on nch1-master-1 Mar 12 21:11:01.131129 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7b3215bd-8328-44ee-a683-889d3f10d7db req-e8bc0197-9b01-4d82-9dba-a88fb5bdbbd0 service nova] Creating event network-changed:2d64c72f-d3dd-4cc6-807e-8819869e76e4 for instance 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 on nch1-master-1 Mar 12 21:11:01.151627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-7b3215bd-8328-44ee-a683-889d3f10d7db req-e8bc0197-9b01-4d82-9dba-a88fb5bdbbd0 service nova] Instance 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:11:01.181127 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7b3215bd-8328-44ee-a683-889d3f10d7db req-e8bc0197-9b01-4d82-9dba-a88fb5bdbbd0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.130377 Mar 12 21:11:01.182143 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3464/4232] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:11:01.541458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-444dc5ba-e1b4-4e69-8943-e896716db31c tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:01.542217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-444dc5ba-e1b4-4e69-8943-e896716db31c tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:01.553192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-444dc5ba-e1b4-4e69-8943-e896716db31c tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:01.553968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-444dc5ba-e1b4-4e69-8943-e896716db31c tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:01.560338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-444dc5ba-e1b4-4e69-8943-e896716db31c tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:01.561273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-444dc5ba-e1b4-4e69-8943-e896716db31c tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:02.241533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-444dc5ba-e1b4-4e69-8943-e896716db31c tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:02.250549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-444dc5ba-e1b4-4e69-8943-e896716db31c tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:02.252380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-444dc5ba-e1b4-4e69-8943-e896716db31c tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:02.253722 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-444dc5ba-e1b4-4e69-8943-e896716db31c tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1787 microversion: 2.32 time: 0.716663 Mar 12 21:11:02.265001 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3465/4233] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:01 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1787 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:02.270344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a025c674-9134-4aa3-9ff0-6a0a3bbb1f95 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:02.271392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a025c674-9134-4aa3-9ff0-6a0a3bbb1f95 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:02.279270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a025c674-9134-4aa3-9ff0-6a0a3bbb1f95 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:02.280106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a025c674-9134-4aa3-9ff0-6a0a3bbb1f95 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:02.281381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a025c674-9134-4aa3-9ff0-6a0a3bbb1f95 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:02.282549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a025c674-9134-4aa3-9ff0-6a0a3bbb1f95 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:02.767598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a025c674-9134-4aa3-9ff0-6a0a3bbb1f95 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:02.810018 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a025c674-9134-4aa3-9ff0-6a0a3bbb1f95 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1694 microversion: 2.1 time: 0.543389 Mar 12 21:11:02.810642 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3466/4234] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:02 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1694 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:03.272230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-255bb19a-4278-415d-b0ab-1870943d3067 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:03.272837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-255bb19a-4278-415d-b0ab-1870943d3067 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:03.280828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-255bb19a-4278-415d-b0ab-1870943d3067 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:03.283172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-255bb19a-4278-415d-b0ab-1870943d3067 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:03.283975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-255bb19a-4278-415d-b0ab-1870943d3067 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:03.284461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-255bb19a-4278-415d-b0ab-1870943d3067 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:03.589506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-255bb19a-4278-415d-b0ab-1870943d3067 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:03.602310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-255bb19a-4278-415d-b0ab-1870943d3067 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:03.604240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-255bb19a-4278-415d-b0ab-1870943d3067 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:03.605957 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-255bb19a-4278-415d-b0ab-1870943d3067 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1787 microversion: 2.32 time: 0.337568 Mar 12 21:11:03.606801 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3467/4235] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:03 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1787 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:03.832667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f0da1d54-6f21-46d2-b7db-07c79ee86ad3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:03.833865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f0da1d54-6f21-46d2-b7db-07c79ee86ad3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:03.873003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0da1d54-6f21-46d2-b7db-07c79ee86ad3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:03.877468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0da1d54-6f21-46d2-b7db-07c79ee86ad3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:03.880281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0da1d54-6f21-46d2-b7db-07c79ee86ad3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:03.882239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0da1d54-6f21-46d2-b7db-07c79ee86ad3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:04.256975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f0da1d54-6f21-46d2-b7db-07c79ee86ad3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:04.268602 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f0da1d54-6f21-46d2-b7db-07c79ee86ad3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1694 microversion: 2.1 time: 0.442398 Mar 12 21:11:04.278413 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3468/4236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:03 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1694 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:04.626672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da30121d-ffed-44c2-b891-c2c4fe4e0de3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:04.627303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da30121d-ffed-44c2-b891-c2c4fe4e0de3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:04.637737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da30121d-ffed-44c2-b891-c2c4fe4e0de3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:04.638225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da30121d-ffed-44c2-b891-c2c4fe4e0de3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:04.648820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da30121d-ffed-44c2-b891-c2c4fe4e0de3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:04.649237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da30121d-ffed-44c2-b891-c2c4fe4e0de3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:05.036622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da30121d-ffed-44c2-b891-c2c4fe4e0de3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:05.047987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da30121d-ffed-44c2-b891-c2c4fe4e0de3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:05.049880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da30121d-ffed-44c2-b891-c2c4fe4e0de3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:05.051305 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da30121d-ffed-44c2-b891-c2c4fe4e0de3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1833 microversion: 2.32 time: 0.429325 Mar 12 21:11:05.052670 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3469/4237] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:04 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1833 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:05.288527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d455a80d-0438-40c4-97f3-9355bcc5e65e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:05.290031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d455a80d-0438-40c4-97f3-9355bcc5e65e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:05.304431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d455a80d-0438-40c4-97f3-9355bcc5e65e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:05.305221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d455a80d-0438-40c4-97f3-9355bcc5e65e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:05.306478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d455a80d-0438-40c4-97f3-9355bcc5e65e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:05.310445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d455a80d-0438-40c4-97f3-9355bcc5e65e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:05.588382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d455a80d-0438-40c4-97f3-9355bcc5e65e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:05.604481 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d455a80d-0438-40c4-97f3-9355bcc5e65e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1691 microversion: 2.1 time: 0.319771 Mar 12 21:11:05.605430 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3470/4238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:05 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1691 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:11:05.611413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4294d52b-0feb-41da-8e8d-f44ccab85284 req-9f3b5fcc-f17a-46e6-883e-2730a5de5b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "tag": "d7cad44c-ac79-49fd-81f5-358305a16691"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:05.621804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4294d52b-0feb-41da-8e8d-f44ccab85284 req-9f3b5fcc-f17a-46e6-883e-2730a5de5b35 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:05.622400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4294d52b-0feb-41da-8e8d-f44ccab85284 req-9f3b5fcc-f17a-46e6-883e-2730a5de5b35 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:05.656004 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4294d52b-0feb-41da-8e8d-f44ccab85284 req-9f3b5fcc-f17a-46e6-883e-2730a5de5b35 service nova] Creating event network-changed:d7cad44c-ac79-49fd-81f5-358305a16691 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:05.669491 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4294d52b-0feb-41da-8e8d-f44ccab85284 req-9f3b5fcc-f17a-46e6-883e-2730a5de5b35 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062636 Mar 12 21:11:05.673925 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3471/4239] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:11:05.681160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad26567d-6957-4196-8052-533697322398 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:05.681869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad26567d-6957-4196-8052-533697322398 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:05.701376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad26567d-6957-4196-8052-533697322398 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:05.702176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad26567d-6957-4196-8052-533697322398 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:05.705900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad26567d-6957-4196-8052-533697322398 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:05.713113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad26567d-6957-4196-8052-533697322398 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:05.874497 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad26567d-6957-4196-8052-533697322398 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47/action" status: 204 len: 0 microversion: 2.1 time: 0.198559 Mar 12 21:11:05.875793 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3472/4240] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:11:05 2022] POST /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47/action => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:11:05.890449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc9deb1e-6c9d-49a7-8cda-5892ab444cbe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:05.896310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc9deb1e-6c9d-49a7-8cda-5892ab444cbe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:05.930085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc9deb1e-6c9d-49a7-8cda-5892ab444cbe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:05.930965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc9deb1e-6c9d-49a7-8cda-5892ab444cbe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:05.932022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc9deb1e-6c9d-49a7-8cda-5892ab444cbe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:05.932546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc9deb1e-6c9d-49a7-8cda-5892ab444cbe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:06.918547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dc9deb1e-6c9d-49a7-8cda-5892ab444cbe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:06.934518 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc9deb1e-6c9d-49a7-8cda-5892ab444cbe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1691 microversion: 2.1 time: 1.044745 Mar 12 21:11:06.935601 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3473/4241] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:05 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1691 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:06.941119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c0bf1e19-b2d4-4cf4-9eca-494bb918deec tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:06.941743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c0bf1e19-b2d4-4cf4-9eca-494bb918deec tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:06.966422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0bf1e19-b2d4-4cf4-9eca-494bb918deec tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:06.968014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0bf1e19-b2d4-4cf4-9eca-494bb918deec tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:06.969265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0bf1e19-b2d4-4cf4-9eca-494bb918deec tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:06.974147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0bf1e19-b2d4-4cf4-9eca-494bb918deec tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:07.492746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0bf1e19-b2d4-4cf4-9eca-494bb918deec tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:07.504207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0bf1e19-b2d4-4cf4-9eca-494bb918deec tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:07.511591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0bf1e19-b2d4-4cf4-9eca-494bb918deec tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:07.515057 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c0bf1e19-b2d4-4cf4-9eca-494bb918deec tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1854 microversion: 2.32 time: 0.578234 Mar 12 21:11:07.515903 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3474/4242] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:06 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1854 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:11:07.750197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b7f88366-6134-477f-9bea-788c7ad39323 req-b43fb591-12d6-4200-bde7-9f42d50414a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "tag": "f49f4c24-9f44-42d0-939e-231a7d1e5b6f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:07.776348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b7f88366-6134-477f-9bea-788c7ad39323 req-b43fb591-12d6-4200-bde7-9f42d50414a5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:07.776821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b7f88366-6134-477f-9bea-788c7ad39323 req-b43fb591-12d6-4200-bde7-9f42d50414a5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:07.798256 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b7f88366-6134-477f-9bea-788c7ad39323 req-b43fb591-12d6-4200-bde7-9f42d50414a5 service nova] Creating event network-changed:f49f4c24-9f44-42d0-939e-231a7d1e5b6f for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:07.822918 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b7f88366-6134-477f-9bea-788c7ad39323 req-b43fb591-12d6-4200-bde7-9f42d50414a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077139 Mar 12 21:11:07.824700 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3475/4243] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:11:07.973122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e869a412-df36-454e-ac84-bd45d119e828 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:07.975152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e869a412-df36-454e-ac84-bd45d119e828 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:07.984718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e869a412-df36-454e-ac84-bd45d119e828 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:07.986426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e869a412-df36-454e-ac84-bd45d119e828 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:07.987456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e869a412-df36-454e-ac84-bd45d119e828 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:07.988112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e869a412-df36-454e-ac84-bd45d119e828 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:08.423528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e869a412-df36-454e-ac84-bd45d119e828 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:08.436789 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e869a412-df36-454e-ac84-bd45d119e828 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1691 microversion: 2.1 time: 0.481717 Mar 12 21:11:08.451762 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3476/4244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:07 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1691 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:11:08.544649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f08475e-4776-4112-b322-300cee8bd2e3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:08.545283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f08475e-4776-4112-b322-300cee8bd2e3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:08.557692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f08475e-4776-4112-b322-300cee8bd2e3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:08.558182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f08475e-4776-4112-b322-300cee8bd2e3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:08.558986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f08475e-4776-4112-b322-300cee8bd2e3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:08.559432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f08475e-4776-4112-b322-300cee8bd2e3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:09.004915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f08475e-4776-4112-b322-300cee8bd2e3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:09.026866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f08475e-4776-4112-b322-300cee8bd2e3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:09.029485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f08475e-4776-4112-b322-300cee8bd2e3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:09.031002 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f08475e-4776-4112-b322-300cee8bd2e3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1854 microversion: 2.32 time: 0.490390 Mar 12 21:11:09.044658 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3477/4245] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:08 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1854 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:11:09.467661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35d35ea8-f23b-4b1c-aa2b-01c28ec78266 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:09.468818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-35d35ea8-f23b-4b1c-aa2b-01c28ec78266 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:09.497142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35d35ea8-f23b-4b1c-aa2b-01c28ec78266 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:09.499207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35d35ea8-f23b-4b1c-aa2b-01c28ec78266 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:09.503434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35d35ea8-f23b-4b1c-aa2b-01c28ec78266 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:09.506036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35d35ea8-f23b-4b1c-aa2b-01c28ec78266 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:09.920411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-35d35ea8-f23b-4b1c-aa2b-01c28ec78266 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:09.934751 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-35d35ea8-f23b-4b1c-aa2b-01c28ec78266 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1683 microversion: 2.1 time: 0.479024 Mar 12 21:11:09.935698 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3478/4246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:09 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1683 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:10.034704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e2e8d094-ec18-4c8d-b6fa-1133daeb7648 req-5521da67-8540-45e3-8c5c-ef745caaf647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb3c81a-e3d8-4620-9c9d-7bfb50867f47", "name": "network-vif-plugged", "status": "completed", "tag": "2d64c72f-d3dd-4cc6-807e-8819869e76e4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:10.051544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e2e8d094-ec18-4c8d-b6fa-1133daeb7648 req-5521da67-8540-45e3-8c5c-ef745caaf647 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:10.051987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e2e8d094-ec18-4c8d-b6fa-1133daeb7648 req-5521da67-8540-45e3-8c5c-ef745caaf647 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:10.079764 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e2e8d094-ec18-4c8d-b6fa-1133daeb7648 req-5521da67-8540-45e3-8c5c-ef745caaf647 service nova] Creating event network-vif-plugged:2d64c72f-d3dd-4cc6-807e-8819869e76e4 for instance 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 on nch1-master-1 Mar 12 21:11:10.092145 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e2e8d094-ec18-4c8d-b6fa-1133daeb7648 req-5521da67-8540-45e3-8c5c-ef745caaf647 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061087 Mar 12 21:11:10.095921 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3479/4247] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:11:10.121881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a38e6055-de45-402d-8f45-399f339c9b2b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:10.123994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a38e6055-de45-402d-8f45-399f339c9b2b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:10.140315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a38e6055-de45-402d-8f45-399f339c9b2b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:10.141436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a38e6055-de45-402d-8f45-399f339c9b2b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:10.146169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a38e6055-de45-402d-8f45-399f339c9b2b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:10.148314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a38e6055-de45-402d-8f45-399f339c9b2b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:10.715040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a38e6055-de45-402d-8f45-399f339c9b2b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:10.730435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a38e6055-de45-402d-8f45-399f339c9b2b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:10.732314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a38e6055-de45-402d-8f45-399f339c9b2b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:10.733571 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a38e6055-de45-402d-8f45-399f339c9b2b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.636312 Mar 12 21:11:10.734357 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3480/4248] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:10 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:11:10.739126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-01551974-6a36-46f4-9bc4-6a11db1a19d2 req-e2e2faa5-8a1b-41d8-884a-0d972a85eb19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "tag": "c4ac74ea-714d-47dc-8e6e-7e337514c985"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:10.747567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-01551974-6a36-46f4-9bc4-6a11db1a19d2 req-e2e2faa5-8a1b-41d8-884a-0d972a85eb19 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:10.748394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-01551974-6a36-46f4-9bc4-6a11db1a19d2 req-e2e2faa5-8a1b-41d8-884a-0d972a85eb19 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:10.765934 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-01551974-6a36-46f4-9bc4-6a11db1a19d2 req-e2e2faa5-8a1b-41d8-884a-0d972a85eb19 service nova] Creating event network-changed:c4ac74ea-714d-47dc-8e6e-7e337514c985 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:10.778050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-01551974-6a36-46f4-9bc4-6a11db1a19d2 req-e2e2faa5-8a1b-41d8-884a-0d972a85eb19 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042187 Mar 12 21:11:10.779363 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3481/4249] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:11:11.756147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80cc3dc6-635f-4fd3-8ea7-207d70947bb7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:11.756822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80cc3dc6-635f-4fd3-8ea7-207d70947bb7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:11.783749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80cc3dc6-635f-4fd3-8ea7-207d70947bb7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:11.793732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80cc3dc6-635f-4fd3-8ea7-207d70947bb7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:11.798504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80cc3dc6-635f-4fd3-8ea7-207d70947bb7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:11.801378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80cc3dc6-635f-4fd3-8ea7-207d70947bb7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:12.125374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80cc3dc6-635f-4fd3-8ea7-207d70947bb7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:12.143391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80cc3dc6-635f-4fd3-8ea7-207d70947bb7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:12.145297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80cc3dc6-635f-4fd3-8ea7-207d70947bb7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:12.147891 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80cc3dc6-635f-4fd3-8ea7-207d70947bb7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.398733 Mar 12 21:11:12.161677 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3482/4250] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:11 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:11:12.801502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-98dfed6f-07dd-4795-bc2a-5806c467ec62 req-2e4c18d9-4482-43a0-aaaf-7cb1dd1b54a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "tag": "b4fcc1fc-d404-45a3-b9fb-ccf200735b91"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:12.822437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-98dfed6f-07dd-4795-bc2a-5806c467ec62 req-2e4c18d9-4482-43a0-aaaf-7cb1dd1b54a9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:12.823672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-98dfed6f-07dd-4795-bc2a-5806c467ec62 req-2e4c18d9-4482-43a0-aaaf-7cb1dd1b54a9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:12.868013 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-98dfed6f-07dd-4795-bc2a-5806c467ec62 req-2e4c18d9-4482-43a0-aaaf-7cb1dd1b54a9 service nova] Creating event network-changed:b4fcc1fc-d404-45a3-b9fb-ccf200735b91 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:12.882168 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-98dfed6f-07dd-4795-bc2a-5806c467ec62 req-2e4c18d9-4482-43a0-aaaf-7cb1dd1b54a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084026 Mar 12 21:11:12.885120 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3483/4251] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:11:13.176290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-206363b8-293d-4cb1-9b10-412bf41f984b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:13.176290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-206363b8-293d-4cb1-9b10-412bf41f984b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:13.194271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206363b8-293d-4cb1-9b10-412bf41f984b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:13.195736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206363b8-293d-4cb1-9b10-412bf41f984b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:13.198730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206363b8-293d-4cb1-9b10-412bf41f984b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:13.200778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-206363b8-293d-4cb1-9b10-412bf41f984b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:13.514837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-206363b8-293d-4cb1-9b10-412bf41f984b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:13.533738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-206363b8-293d-4cb1-9b10-412bf41f984b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:13.536245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-206363b8-293d-4cb1-9b10-412bf41f984b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:13.537213 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-206363b8-293d-4cb1-9b10-412bf41f984b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.371139 Mar 12 21:11:13.537819 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3484/4252] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:13 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:11:14.558437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c2184ca-e854-4b85-b9bf-c6c842bc9e96 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:14.559088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c2184ca-e854-4b85-b9bf-c6c842bc9e96 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:14.571589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c2184ca-e854-4b85-b9bf-c6c842bc9e96 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:14.572877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c2184ca-e854-4b85-b9bf-c6c842bc9e96 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:14.577215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c2184ca-e854-4b85-b9bf-c6c842bc9e96 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:14.580367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c2184ca-e854-4b85-b9bf-c6c842bc9e96 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:14.944007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c2184ca-e854-4b85-b9bf-c6c842bc9e96 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:14.965488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c2184ca-e854-4b85-b9bf-c6c842bc9e96 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:14.968695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c2184ca-e854-4b85-b9bf-c6c842bc9e96 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:14.971329 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c2184ca-e854-4b85-b9bf-c6c842bc9e96 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.417036 Mar 12 21:11:14.972107 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3485/4253] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:14 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:14.978049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f5621398-d6be-4287-a399-86b2913e1ebc req-2da8d0a1-2c86-4a9b-97df-018c05ef4204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "tag": "36bd6dd0-f857-47f1-81d0-ab99988c0627"}, {"name": "network-changed", "server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "tag": "d6d53430-b25f-48da-b813-b4ea2577b13f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:14.989617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f5621398-d6be-4287-a399-86b2913e1ebc req-2da8d0a1-2c86-4a9b-97df-018c05ef4204 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:14.990179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f5621398-d6be-4287-a399-86b2913e1ebc req-2da8d0a1-2c86-4a9b-97df-018c05ef4204 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:15.006601 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f5621398-d6be-4287-a399-86b2913e1ebc req-2da8d0a1-2c86-4a9b-97df-018c05ef4204 service nova] Creating event network-changed:36bd6dd0-f857-47f1-81d0-ab99988c0627 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:15.006992 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f5621398-d6be-4287-a399-86b2913e1ebc req-2da8d0a1-2c86-4a9b-97df-018c05ef4204 service nova] Creating event network-changed:d6d53430-b25f-48da-b813-b4ea2577b13f for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:15.012565 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f5621398-d6be-4287-a399-86b2913e1ebc req-2da8d0a1-2c86-4a9b-97df-018c05ef4204 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038831 Mar 12 21:11:15.014113 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3486/4254] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:11:15.994106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-feb59ed1-bfd0-439f-963b-e9fa71ec6afc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:15.996439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-feb59ed1-bfd0-439f-963b-e9fa71ec6afc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:16.005891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feb59ed1-bfd0-439f-963b-e9fa71ec6afc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:16.006446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feb59ed1-bfd0-439f-963b-e9fa71ec6afc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:16.007354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feb59ed1-bfd0-439f-963b-e9fa71ec6afc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:16.007978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feb59ed1-bfd0-439f-963b-e9fa71ec6afc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:16.364213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-feb59ed1-bfd0-439f-963b-e9fa71ec6afc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:16.373231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-feb59ed1-bfd0-439f-963b-e9fa71ec6afc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:16.374990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-feb59ed1-bfd0-439f-963b-e9fa71ec6afc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:16.376898 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-feb59ed1-bfd0-439f-963b-e9fa71ec6afc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.389724 Mar 12 21:11:16.377474 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3487/4255] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:15 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:17.395632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7f669758-e705-4e6e-ba5c-89ed247bcbb8 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:17.396298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7f669758-e705-4e6e-ba5c-89ed247bcbb8 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:17.403701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f669758-e705-4e6e-ba5c-89ed247bcbb8 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:17.404618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f669758-e705-4e6e-ba5c-89ed247bcbb8 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:17.405887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f669758-e705-4e6e-ba5c-89ed247bcbb8 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:17.407088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f669758-e705-4e6e-ba5c-89ed247bcbb8 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:17.725287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7f669758-e705-4e6e-ba5c-89ed247bcbb8 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:17.741613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7f669758-e705-4e6e-ba5c-89ed247bcbb8 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:17.743388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7f669758-e705-4e6e-ba5c-89ed247bcbb8 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:17.744856 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7f669758-e705-4e6e-ba5c-89ed247bcbb8 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.352943 Mar 12 21:11:17.745728 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3488/4256] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:17 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:17.752174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b5b06fdd-02af-4866-9450-9a2317de2889 req-eb3ba7d7-a631-4b18-9525-d9d136889c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "tag": "bdf07d65-9fbe-4b43-8a5a-80bc9ee4ab02"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:17.766751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b5b06fdd-02af-4866-9450-9a2317de2889 req-eb3ba7d7-a631-4b18-9525-d9d136889c78 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:17.767356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b5b06fdd-02af-4866-9450-9a2317de2889 req-eb3ba7d7-a631-4b18-9525-d9d136889c78 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:17.780081 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b5b06fdd-02af-4866-9450-9a2317de2889 req-eb3ba7d7-a631-4b18-9525-d9d136889c78 service nova] Creating event network-changed:bdf07d65-9fbe-4b43-8a5a-80bc9ee4ab02 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:17.786278 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b5b06fdd-02af-4866-9450-9a2317de2889 req-eb3ba7d7-a631-4b18-9525-d9d136889c78 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038694 Mar 12 21:11:17.787107 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3489/4257] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:11:18.150244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1831820253", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "757f12d3-fb2b-477f-a322-e3b1ba86aa1f"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:18.216332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] validate_networks() for [('757f12d3-fb2b-477f-a322-e3b1ba86aa1f', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:11:18.726593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:11:18.729290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:11:18.733115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:11:18.735383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:11:18.736840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:11:18.750982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:18.751442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:18.752545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:18.752995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:18.773494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Getting quotas for project d30a0195c6334b39a246a88b1f4cc81f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:11:18.780817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Getting quotas for user 96d0c07fcae34c48b4c0ed61c4cec1c2 and project d30a0195c6334b39a246a88b1f4cc81f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:11:18.799113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:11:18.805738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:11:18.900115 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6dd5a266-68b9-4389-ab06-d68e76f0ce19 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754714 Mar 12 21:11:18.900726 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3490/4258] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:11:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:11:18.907712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e9a4d228-54f4-4ac9-bbf2-d84381ada4fe tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:18.908606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e9a4d228-54f4-4ac9-bbf2-d84381ada4fe tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:18.916698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9a4d228-54f4-4ac9-bbf2-d84381ada4fe tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:18.917485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9a4d228-54f4-4ac9-bbf2-d84381ada4fe tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:18.918587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9a4d228-54f4-4ac9-bbf2-d84381ada4fe tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:18.919190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9a4d228-54f4-4ac9-bbf2-d84381ada4fe tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:19.254924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e9a4d228-54f4-4ac9-bbf2-d84381ada4fe tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:19.265126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e9a4d228-54f4-4ac9-bbf2-d84381ada4fe tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:19.267277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e9a4d228-54f4-4ac9-bbf2-d84381ada4fe tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:19.269294 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e9a4d228-54f4-4ac9-bbf2-d84381ada4fe tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.366670 Mar 12 21:11:19.269294 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3491/4259] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:18 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:11:19.285501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0b1e9eeb-78ec-4046-bff4-4fe0b01325ca tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:19.286375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0b1e9eeb-78ec-4046-bff4-4fe0b01325ca tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:19.366077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0b1e9eeb-78ec-4046-bff4-4fe0b01325ca tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:19.375152 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0b1e9eeb-78ec-4046-bff4-4fe0b01325ca tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1219 microversion: 2.1 time: 0.104780 Mar 12 21:11:19.377027 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3492/4260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:19 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:20.287905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cf37b3d1-86a9-4905-b6dd-768898564b7b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:20.289424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cf37b3d1-86a9-4905-b6dd-768898564b7b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:20.298659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf37b3d1-86a9-4905-b6dd-768898564b7b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:20.299495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf37b3d1-86a9-4905-b6dd-768898564b7b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:20.300503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf37b3d1-86a9-4905-b6dd-768898564b7b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:20.300953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf37b3d1-86a9-4905-b6dd-768898564b7b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:21.064150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cf37b3d1-86a9-4905-b6dd-768898564b7b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:21.077661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cf37b3d1-86a9-4905-b6dd-768898564b7b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:21.080929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cf37b3d1-86a9-4905-b6dd-768898564b7b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:21.082261 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cf37b3d1-86a9-4905-b6dd-768898564b7b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.798594 Mar 12 21:11:21.083085 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3493/4261] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:20 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:21.094703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be14342d-1c14-43f8-9418-47eb6a50ec9d tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:21.095781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-be14342d-1c14-43f8-9418-47eb6a50ec9d tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:21.102547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be14342d-1c14-43f8-9418-47eb6a50ec9d tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:21.103118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be14342d-1c14-43f8-9418-47eb6a50ec9d tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:21.104317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be14342d-1c14-43f8-9418-47eb6a50ec9d tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:21.105010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be14342d-1c14-43f8-9418-47eb6a50ec9d tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:21.198742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be14342d-1c14-43f8-9418-47eb6a50ec9d tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:21.208980 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be14342d-1c14-43f8-9418-47eb6a50ec9d tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1277 microversion: 2.1 time: 0.124421 Mar 12 21:11:21.210745 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3494/4262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:21 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:22.102243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33a49c1f-9c98-4eec-856c-1e69fe3ad664 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:22.102866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-33a49c1f-9c98-4eec-856c-1e69fe3ad664 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:22.115131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33a49c1f-9c98-4eec-856c-1e69fe3ad664 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:22.116866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33a49c1f-9c98-4eec-856c-1e69fe3ad664 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:22.119480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33a49c1f-9c98-4eec-856c-1e69fe3ad664 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:22.120847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33a49c1f-9c98-4eec-856c-1e69fe3ad664 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:22.576710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-33a49c1f-9c98-4eec-856c-1e69fe3ad664 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:22.589430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-33a49c1f-9c98-4eec-856c-1e69fe3ad664 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:22.591136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-33a49c1f-9c98-4eec-856c-1e69fe3ad664 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:22.592748 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-33a49c1f-9c98-4eec-856c-1e69fe3ad664 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.494714 Mar 12 21:11:22.604331 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3495/4263] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:22 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:11:22.610406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-784be09e-b1fb-4bf8-91e9-ab6c2d63416e tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:22.611204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-784be09e-b1fb-4bf8-91e9-ab6c2d63416e tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:22.617655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-784be09e-b1fb-4bf8-91e9-ab6c2d63416e tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:22.618130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-784be09e-b1fb-4bf8-91e9-ab6c2d63416e tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:22.619103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-784be09e-b1fb-4bf8-91e9-ab6c2d63416e tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:22.619543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-784be09e-b1fb-4bf8-91e9-ab6c2d63416e tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:22.849976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-784be09e-b1fb-4bf8-91e9-ab6c2d63416e tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:22.858616 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-784be09e-b1fb-4bf8-91e9-ab6c2d63416e tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1319 microversion: 2.1 time: 0.252643 Mar 12 21:11:22.861253 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3496/4264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:22 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:22.872378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0c298b2b-2f32-49ac-b89d-987c63e32d68 req-0c12ff3c-e0f5-466d-865c-2278b81f428e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "256e8bf0-a13c-4736-af5d-519e7bfbbc0f", "tag": "4ce3d584-edf2-4a97-a6bb-8b8b56dfd1d4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:22.881410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0c298b2b-2f32-49ac-b89d-987c63e32d68 req-0c12ff3c-e0f5-466d-865c-2278b81f428e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:22.882383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0c298b2b-2f32-49ac-b89d-987c63e32d68 req-0c12ff3c-e0f5-466d-865c-2278b81f428e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:22.898964 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0c298b2b-2f32-49ac-b89d-987c63e32d68 req-0c12ff3c-e0f5-466d-865c-2278b81f428e service nova] Creating event network-changed:4ce3d584-edf2-4a97-a6bb-8b8b56dfd1d4 for instance 256e8bf0-a13c-4736-af5d-519e7bfbbc0f on nch1-master-1 Mar 12 21:11:22.904666 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0c298b2b-2f32-49ac-b89d-987c63e32d68 req-0c12ff3c-e0f5-466d-865c-2278b81f428e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037646 Mar 12 21:11:22.905813 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3497/4265] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:11:23.614348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8340571e-29ed-4270-9847-a8b778f2031b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:23.615817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8340571e-29ed-4270-9847-a8b778f2031b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:23.623125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8340571e-29ed-4270-9847-a8b778f2031b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:23.623857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8340571e-29ed-4270-9847-a8b778f2031b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:23.624806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8340571e-29ed-4270-9847-a8b778f2031b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:23.625583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8340571e-29ed-4270-9847-a8b778f2031b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:23.945597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8340571e-29ed-4270-9847-a8b778f2031b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:23.956739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8340571e-29ed-4270-9847-a8b778f2031b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:23.958293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8340571e-29ed-4270-9847-a8b778f2031b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:23.960014 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8340571e-29ed-4270-9847-a8b778f2031b tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.352168 Mar 12 21:11:23.961020 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3498/4266] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:23 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:23.965828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-47214089-1762-4bfa-9428-c3e6d95bd5f7 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:23.966702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-47214089-1762-4bfa-9428-c3e6d95bd5f7 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:23.974227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47214089-1762-4bfa-9428-c3e6d95bd5f7 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:23.974912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47214089-1762-4bfa-9428-c3e6d95bd5f7 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:23.976526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47214089-1762-4bfa-9428-c3e6d95bd5f7 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:23.977169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47214089-1762-4bfa-9428-c3e6d95bd5f7 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:24.164607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-47214089-1762-4bfa-9428-c3e6d95bd5f7 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:24.176505 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-47214089-1762-4bfa-9428-c3e6d95bd5f7 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1319 microversion: 2.1 time: 0.214215 Mar 12 21:11:24.177101 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3499/4267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:23 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:24.979094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26bf2ed4-210e-4d68-9de5-89004c3b6f46 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:24.980388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-26bf2ed4-210e-4d68-9de5-89004c3b6f46 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:24.987379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26bf2ed4-210e-4d68-9de5-89004c3b6f46 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:24.994726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26bf2ed4-210e-4d68-9de5-89004c3b6f46 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:24.995606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26bf2ed4-210e-4d68-9de5-89004c3b6f46 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:24.996056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26bf2ed4-210e-4d68-9de5-89004c3b6f46 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:25.216146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-26bf2ed4-210e-4d68-9de5-89004c3b6f46 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:25.229379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-26bf2ed4-210e-4d68-9de5-89004c3b6f46 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:25.231683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-26bf2ed4-210e-4d68-9de5-89004c3b6f46 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:25.233391 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-26bf2ed4-210e-4d68-9de5-89004c3b6f46 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.258192 Mar 12 21:11:25.234789 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3500/4268] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:24 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:25.240640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca78fd63-681a-46c3-becf-d5f14ff37255 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:25.241523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ca78fd63-681a-46c3-becf-d5f14ff37255 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:25.249515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca78fd63-681a-46c3-becf-d5f14ff37255 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:25.250205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca78fd63-681a-46c3-becf-d5f14ff37255 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:25.251114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca78fd63-681a-46c3-becf-d5f14ff37255 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:25.252159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca78fd63-681a-46c3-becf-d5f14ff37255 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:25.472482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca78fd63-681a-46c3-becf-d5f14ff37255 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:25.480063 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca78fd63-681a-46c3-becf-d5f14ff37255 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1319 microversion: 2.1 time: 0.244021 Mar 12 21:11:25.480840 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3501/4269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:25 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:26.254333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc06d48b-99c3-49f8-8b5d-f3e56e636033 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:26.254930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc06d48b-99c3-49f8-8b5d-f3e56e636033 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:26.261279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc06d48b-99c3-49f8-8b5d-f3e56e636033 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:26.261731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc06d48b-99c3-49f8-8b5d-f3e56e636033 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:26.262521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc06d48b-99c3-49f8-8b5d-f3e56e636033 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:26.262966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc06d48b-99c3-49f8-8b5d-f3e56e636033 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:26.472902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc06d48b-99c3-49f8-8b5d-f3e56e636033 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:26.482489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc06d48b-99c3-49f8-8b5d-f3e56e636033 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:26.484055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc06d48b-99c3-49f8-8b5d-f3e56e636033 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:26.485251 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc06d48b-99c3-49f8-8b5d-f3e56e636033 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.234938 Mar 12 21:11:26.485846 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3502/4270] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:26 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:26.497133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da30fbbe-bd93-495e-b2fb-d2f39d4add43 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:26.498013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da30fbbe-bd93-495e-b2fb-d2f39d4add43 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:26.504304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da30fbbe-bd93-495e-b2fb-d2f39d4add43 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:26.504792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da30fbbe-bd93-495e-b2fb-d2f39d4add43 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:26.505608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da30fbbe-bd93-495e-b2fb-d2f39d4add43 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:26.506238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da30fbbe-bd93-495e-b2fb-d2f39d4add43 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:26.645673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da30fbbe-bd93-495e-b2fb-d2f39d4add43 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:26.653286 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da30fbbe-bd93-495e-b2fb-d2f39d4add43 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1319 microversion: 2.1 time: 0.160450 Mar 12 21:11:26.653885 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3503/4271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:26 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:11:27.303434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-75d44ff5-c409-4eb7-a046-7efc03d15596 req-d2c30dcc-063c-413c-af33-99eb16273778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-plugged", "status": "completed", "tag": "f49f4c24-9f44-42d0-939e-231a7d1e5b6f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:27.313416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-75d44ff5-c409-4eb7-a046-7efc03d15596 req-d2c30dcc-063c-413c-af33-99eb16273778 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:27.313907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-75d44ff5-c409-4eb7-a046-7efc03d15596 req-d2c30dcc-063c-413c-af33-99eb16273778 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:27.326212 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-75d44ff5-c409-4eb7-a046-7efc03d15596 req-d2c30dcc-063c-413c-af33-99eb16273778 service nova] Creating event network-vif-plugged:f49f4c24-9f44-42d0-939e-231a7d1e5b6f for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:27.331952 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-75d44ff5-c409-4eb7-a046-7efc03d15596 req-d2c30dcc-063c-413c-af33-99eb16273778 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032675 Mar 12 21:11:27.332554 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3504/4272] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:11:27.505277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a0fd3290-5392-407d-8d35-72634c1f9595 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:27.506274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a0fd3290-5392-407d-8d35-72634c1f9595 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:27.512447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0fd3290-5392-407d-8d35-72634c1f9595 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:27.512909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0fd3290-5392-407d-8d35-72634c1f9595 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:27.513688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0fd3290-5392-407d-8d35-72634c1f9595 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:27.514472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0fd3290-5392-407d-8d35-72634c1f9595 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:27.723827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a0fd3290-5392-407d-8d35-72634c1f9595 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:27.732633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a0fd3290-5392-407d-8d35-72634c1f9595 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:27.734199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a0fd3290-5392-407d-8d35-72634c1f9595 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:27.736124 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a0fd3290-5392-407d-8d35-72634c1f9595 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.235911 Mar 12 21:11:27.736702 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3505/4273] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:27 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:27.751576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1bddd177-de83-4eeb-88f9-66ed766ca8c4 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:27.752193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1bddd177-de83-4eeb-88f9-66ed766ca8c4 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:27.758086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bddd177-de83-4eeb-88f9-66ed766ca8c4 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:27.758545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bddd177-de83-4eeb-88f9-66ed766ca8c4 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:27.759332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bddd177-de83-4eeb-88f9-66ed766ca8c4 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:27.759798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bddd177-de83-4eeb-88f9-66ed766ca8c4 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:27.907160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1bddd177-de83-4eeb-88f9-66ed766ca8c4 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:27.914938 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1bddd177-de83-4eeb-88f9-66ed766ca8c4 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1319 microversion: 2.1 time: 0.167048 Mar 12 21:11:27.915920 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3506/4274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:27 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:28.757279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d3613542-669c-4a2e-9ab4-f687719f5b87 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:28.758358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d3613542-669c-4a2e-9ab4-f687719f5b87 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:28.772369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3613542-669c-4a2e-9ab4-f687719f5b87 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:28.773420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3613542-669c-4a2e-9ab4-f687719f5b87 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:28.774259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3613542-669c-4a2e-9ab4-f687719f5b87 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:28.774703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3613542-669c-4a2e-9ab4-f687719f5b87 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:28.999767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d3613542-669c-4a2e-9ab4-f687719f5b87 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:29.009110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d3613542-669c-4a2e-9ab4-f687719f5b87 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:29.010658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d3613542-669c-4a2e-9ab4-f687719f5b87 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:29.011821 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d3613542-669c-4a2e-9ab4-f687719f5b87 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.261321 Mar 12 21:11:29.012399 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3507/4275] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:28 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:29.017321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ac4dc20-72e5-45de-87b2-3302860ce3e3 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:29.017963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5ac4dc20-72e5-45de-87b2-3302860ce3e3 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:29.023917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ac4dc20-72e5-45de-87b2-3302860ce3e3 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:29.024483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ac4dc20-72e5-45de-87b2-3302860ce3e3 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:29.025251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ac4dc20-72e5-45de-87b2-3302860ce3e3 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:29.025690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ac4dc20-72e5-45de-87b2-3302860ce3e3 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:29.158415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5ac4dc20-72e5-45de-87b2-3302860ce3e3 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:29.165729 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ac4dc20-72e5-45de-87b2-3302860ce3e3 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1319 microversion: 2.1 time: 0.152383 Mar 12 21:11:29.166332 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3508/4276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:29 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:29.423933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5c754e4d-6759-4cb8-99e6-640d1886eded req-338950ed-b7cf-419e-b681-0e1d5ad5d400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "256e8bf0-a13c-4736-af5d-519e7bfbbc0f", "name": "network-vif-plugged", "status": "completed", "tag": "4ce3d584-edf2-4a97-a6bb-8b8b56dfd1d4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:29.443860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5c754e4d-6759-4cb8-99e6-640d1886eded req-338950ed-b7cf-419e-b681-0e1d5ad5d400 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:29.444656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5c754e4d-6759-4cb8-99e6-640d1886eded req-338950ed-b7cf-419e-b681-0e1d5ad5d400 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:29.472241 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5c754e4d-6759-4cb8-99e6-640d1886eded req-338950ed-b7cf-419e-b681-0e1d5ad5d400 service nova] Creating event network-vif-plugged:4ce3d584-edf2-4a97-a6bb-8b8b56dfd1d4 for instance 256e8bf0-a13c-4736-af5d-519e7bfbbc0f on nch1-master-1 Mar 12 21:11:29.478813 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5c754e4d-6759-4cb8-99e6-640d1886eded req-338950ed-b7cf-419e-b681-0e1d5ad5d400 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064330 Mar 12 21:11:29.480045 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3509/4277] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:11:30.030569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9e68875b-bb40-43d4-ab36-0386a26971f9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:30.031353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9e68875b-bb40-43d4-ab36-0386a26971f9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:30.038445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e68875b-bb40-43d4-ab36-0386a26971f9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:30.038902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e68875b-bb40-43d4-ab36-0386a26971f9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:30.039678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e68875b-bb40-43d4-ab36-0386a26971f9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:30.040117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e68875b-bb40-43d4-ab36-0386a26971f9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:30.245288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9e68875b-bb40-43d4-ab36-0386a26971f9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:30.255131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9e68875b-bb40-43d4-ab36-0386a26971f9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:30.256660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9e68875b-bb40-43d4-ab36-0386a26971f9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:30.257898 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9e68875b-bb40-43d4-ab36-0386a26971f9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.231713 Mar 12 21:11:30.258487 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3510/4278] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:30 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:30.268576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2fd0fded-d5e1-47aa-a5e2-d0062d7fbd61 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:30.269401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2fd0fded-d5e1-47aa-a5e2-d0062d7fbd61 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:30.275743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fd0fded-d5e1-47aa-a5e2-d0062d7fbd61 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:30.276198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fd0fded-d5e1-47aa-a5e2-d0062d7fbd61 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:30.276986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fd0fded-d5e1-47aa-a5e2-d0062d7fbd61 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:30.277396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fd0fded-d5e1-47aa-a5e2-d0062d7fbd61 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:30.416557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2fd0fded-d5e1-47aa-a5e2-d0062d7fbd61 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:30.425605 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2fd0fded-d5e1-47aa-a5e2-d0062d7fbd61 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1319 microversion: 2.1 time: 0.165339 Mar 12 21:11:30.426256 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3511/4279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:30 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:31.278017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d8613b2-b34c-4497-bdfe-44dc54f0d320 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:31.278674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5d8613b2-b34c-4497-bdfe-44dc54f0d320 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:31.286195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d8613b2-b34c-4497-bdfe-44dc54f0d320 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:31.286642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d8613b2-b34c-4497-bdfe-44dc54f0d320 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:31.287428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d8613b2-b34c-4497-bdfe-44dc54f0d320 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:31.287875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d8613b2-b34c-4497-bdfe-44dc54f0d320 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:31.508020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5d8613b2-b34c-4497-bdfe-44dc54f0d320 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:31.521077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5d8613b2-b34c-4497-bdfe-44dc54f0d320 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:31.523003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5d8613b2-b34c-4497-bdfe-44dc54f0d320 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:31.524426 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5d8613b2-b34c-4497-bdfe-44dc54f0d320 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.250647 Mar 12 21:11:31.525051 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3512/4280] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:31 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:31.530347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6655a698-9d3d-4819-bdd5-e2a5c4ada06c tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:31.531266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6655a698-9d3d-4819-bdd5-e2a5c4ada06c tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:31.537894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6655a698-9d3d-4819-bdd5-e2a5c4ada06c tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:31.548077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6655a698-9d3d-4819-bdd5-e2a5c4ada06c tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:31.548960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6655a698-9d3d-4819-bdd5-e2a5c4ada06c tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:31.549427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6655a698-9d3d-4819-bdd5-e2a5c4ada06c tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:31.731099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6655a698-9d3d-4819-bdd5-e2a5c4ada06c tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:31.741292 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6655a698-9d3d-4819-bdd5-e2a5c4ada06c tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1507 microversion: 2.1 time: 0.214631 Mar 12 21:11:31.741716 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3513/4281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:11:31 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:11:31.746609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fe2b77e2-42ea-461b-bcef-54bcfb4d26c2 req-857817a1-33f1-4a98-aae2-eb2a92f43939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-plugged", "status": "completed", "tag": "d7cad44c-ac79-49fd-81f5-358305a16691"}, {"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-plugged", "status": "completed", "tag": "b4fcc1fc-d404-45a3-b9fb-ccf200735b91"}, {"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-plugged", "status": "completed", "tag": "36bd6dd0-f857-47f1-81d0-ab99988c0627"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:31.757499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fe2b77e2-42ea-461b-bcef-54bcfb4d26c2 req-857817a1-33f1-4a98-aae2-eb2a92f43939 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:31.758031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fe2b77e2-42ea-461b-bcef-54bcfb4d26c2 req-857817a1-33f1-4a98-aae2-eb2a92f43939 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:31.774914 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fe2b77e2-42ea-461b-bcef-54bcfb4d26c2 req-857817a1-33f1-4a98-aae2-eb2a92f43939 service nova] Creating event network-vif-plugged:d7cad44c-ac79-49fd-81f5-358305a16691 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:31.775484 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fe2b77e2-42ea-461b-bcef-54bcfb4d26c2 req-857817a1-33f1-4a98-aae2-eb2a92f43939 service nova] Creating event network-vif-plugged:b4fcc1fc-d404-45a3-b9fb-ccf200735b91 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:31.775996 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fe2b77e2-42ea-461b-bcef-54bcfb4d26c2 req-857817a1-33f1-4a98-aae2-eb2a92f43939 service nova] Creating event network-vif-plugged:36bd6dd0-f857-47f1-81d0-ab99988c0627 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:31.795972 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fe2b77e2-42ea-461b-bcef-54bcfb4d26c2 req-857817a1-33f1-4a98-aae2-eb2a92f43939 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.052325 Mar 12 21:11:31.797571 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3514/4282] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:11:32.544715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6782c7ad-18e7-4b67-948d-a8e1e80d7164 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:32.545489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6782c7ad-18e7-4b67-948d-a8e1e80d7164 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:32.552635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6782c7ad-18e7-4b67-948d-a8e1e80d7164 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:32.553388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6782c7ad-18e7-4b67-948d-a8e1e80d7164 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:32.554313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6782c7ad-18e7-4b67-948d-a8e1e80d7164 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:32.555108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6782c7ad-18e7-4b67-948d-a8e1e80d7164 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:32.748083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6782c7ad-18e7-4b67-948d-a8e1e80d7164 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:32.756922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6782c7ad-18e7-4b67-948d-a8e1e80d7164 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:32.758472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6782c7ad-18e7-4b67-948d-a8e1e80d7164 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:32.759627 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6782c7ad-18e7-4b67-948d-a8e1e80d7164 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.220274 Mar 12 21:11:32.760204 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3515/4283] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:32 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:33.779349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-267acc05-bb1b-40c8-bea8-bc11ca284e50 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:33.779972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-267acc05-bb1b-40c8-bea8-bc11ca284e50 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:33.788200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-267acc05-bb1b-40c8-bea8-bc11ca284e50 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:33.788657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-267acc05-bb1b-40c8-bea8-bc11ca284e50 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:33.789438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-267acc05-bb1b-40c8-bea8-bc11ca284e50 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:33.789909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-267acc05-bb1b-40c8-bea8-bc11ca284e50 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:34.000888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-267acc05-bb1b-40c8-bea8-bc11ca284e50 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:34.009740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-267acc05-bb1b-40c8-bea8-bc11ca284e50 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:34.011302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-267acc05-bb1b-40c8-bea8-bc11ca284e50 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:34.012468 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-267acc05-bb1b-40c8-bea8-bc11ca284e50 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.237381 Mar 12 21:11:34.013050 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3516/4284] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:33 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:11:34.018091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2900c632-ca99-466e-8d08-97fd61a87847 req-32a645f8-307c-4f20-9941-a10d7a0c0552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-plugged", "status": "completed", "tag": "d6d53430-b25f-48da-b813-b4ea2577b13f"}, {"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-plugged", "status": "completed", "tag": "bdf07d65-9fbe-4b43-8a5a-80bc9ee4ab02"}, {"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-plugged", "status": "completed", "tag": "c4ac74ea-714d-47dc-8e6e-7e337514c985"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:34.025998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2900c632-ca99-466e-8d08-97fd61a87847 req-32a645f8-307c-4f20-9941-a10d7a0c0552 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:34.026470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2900c632-ca99-466e-8d08-97fd61a87847 req-32a645f8-307c-4f20-9941-a10d7a0c0552 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:34.038382 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2900c632-ca99-466e-8d08-97fd61a87847 req-32a645f8-307c-4f20-9941-a10d7a0c0552 service nova] Creating event network-vif-plugged:d6d53430-b25f-48da-b813-b4ea2577b13f for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:34.039504 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2900c632-ca99-466e-8d08-97fd61a87847 req-32a645f8-307c-4f20-9941-a10d7a0c0552 service nova] Creating event network-vif-plugged:bdf07d65-9fbe-4b43-8a5a-80bc9ee4ab02 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:34.039504 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2900c632-ca99-466e-8d08-97fd61a87847 req-32a645f8-307c-4f20-9941-a10d7a0c0552 service nova] Creating event network-vif-plugged:c4ac74ea-714d-47dc-8e6e-7e337514c985 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:34.044846 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2900c632-ca99-466e-8d08-97fd61a87847 req-32a645f8-307c-4f20-9941-a10d7a0c0552 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.030675 Mar 12 21:11:34.045614 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3517/4285] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:11:34.298133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d50a7ee-e570-4171-b1d7-d8a4ebad93fa tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc07a109-25a4-455a-b16f-7887aa370147", "device": "/dev/sdb"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:34.299682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2d50a7ee-e570-4171-b1d7-d8a4ebad93fa tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:34.306467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d50a7ee-e570-4171-b1d7-d8a4ebad93fa tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:34.306919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d50a7ee-e570-4171-b1d7-d8a4ebad93fa tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:34.307691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d50a7ee-e570-4171-b1d7-d8a4ebad93fa tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:34.308132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d50a7ee-e570-4171-b1d7-d8a4ebad93fa tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:34.538086 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d50a7ee-e570-4171-b1d7-d8a4ebad93fa tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "POST /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244616 Mar 12 21:11:34.538860 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3518/4286] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:11:34 2022] POST /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:11:35.034087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-433b0513-dfcb-4698-9543-10e92c274a47 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:35.034785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-433b0513-dfcb-4698-9543-10e92c274a47 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:35.041172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-433b0513-dfcb-4698-9543-10e92c274a47 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:35.041635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-433b0513-dfcb-4698-9543-10e92c274a47 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:35.042460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-433b0513-dfcb-4698-9543-10e92c274a47 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:35.042899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-433b0513-dfcb-4698-9543-10e92c274a47 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:35.231072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-433b0513-dfcb-4698-9543-10e92c274a47 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:35.240506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-433b0513-dfcb-4698-9543-10e92c274a47 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:35.242052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-433b0513-dfcb-4698-9543-10e92c274a47 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:35.243206 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-433b0513-dfcb-4698-9543-10e92c274a47 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1875 microversion: 2.32 time: 0.215169 Mar 12 21:11:35.243778 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3519/4287] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:35 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1875 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:36.263625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f15a40b5-939b-4330-9807-d962e9384654 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:36.264514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f15a40b5-939b-4330-9807-d962e9384654 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:36.273484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f15a40b5-939b-4330-9807-d962e9384654 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:36.274147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f15a40b5-939b-4330-9807-d962e9384654 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:36.274982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f15a40b5-939b-4330-9807-d962e9384654 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:36.275421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f15a40b5-939b-4330-9807-d962e9384654 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:36.481300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f15a40b5-939b-4330-9807-d962e9384654 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:36.491292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f15a40b5-939b-4330-9807-d962e9384654 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:36.492867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f15a40b5-939b-4330-9807-d962e9384654 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:11:36.494094 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f15a40b5-939b-4330-9807-d962e9384654 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 2825 microversion: 2.32 time: 0.236119 Mar 12 21:11:36.494705 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3520/4288] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:11:36 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 2825 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:11:36.514349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3179fef7-39d6-426f-bfce-7171099374aa tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:11:36.514954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3179fef7-39d6-426f-bfce-7171099374aa tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:36.521461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3179fef7-39d6-426f-bfce-7171099374aa tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:36.522628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3179fef7-39d6-426f-bfce-7171099374aa tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:36.522960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3179fef7-39d6-426f-bfce-7171099374aa tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:36.523413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3179fef7-39d6-426f-bfce-7171099374aa tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:36.664248 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3179fef7-39d6-426f-bfce-7171099374aa tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.154015 Mar 12 21:11:36.664966 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3521/4289] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Mar 12 21:11:36 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371/os-interface => generated 1830 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:11:38.191391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-468813a2-4243-4658-97f8-ede29009d82d req-7c64ab81-5543-4c6a-92aa-145c27162207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "tag": "d7cad44c-ac79-49fd-81f5-358305a16691"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:38.200534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-468813a2-4243-4658-97f8-ede29009d82d req-7c64ab81-5543-4c6a-92aa-145c27162207 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:38.201061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-468813a2-4243-4658-97f8-ede29009d82d req-7c64ab81-5543-4c6a-92aa-145c27162207 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:38.213731 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-468813a2-4243-4658-97f8-ede29009d82d req-7c64ab81-5543-4c6a-92aa-145c27162207 service nova] Creating event network-changed:d7cad44c-ac79-49fd-81f5-358305a16691 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:11:38.219560 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-468813a2-4243-4658-97f8-ede29009d82d req-7c64ab81-5543-4c6a-92aa-145c27162207 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033059 Mar 12 21:11:38.220177 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3522/4290] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:11:40.189346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7e11fe20-fa25-4fd2-af48-3595a7c64a59 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:11:40.190606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7e11fe20-fa25-4fd2-af48-3595a7c64a59 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:11:40.199947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e11fe20-fa25-4fd2-af48-3595a7c64a59 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:40.200846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e11fe20-fa25-4fd2-af48-3595a7c64a59 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:40.201968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e11fe20-fa25-4fd2-af48-3595a7c64a59 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:11:40.202416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e11fe20-fa25-4fd2-af48-3595a7c64a59 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:11:40.271576 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7e11fe20-fa25-4fd2-af48-3595a7c64a59 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47/action" status: 200 len: 24492 microversion: 2.1 time: 0.088143 Mar 12 21:11:40.281819 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3523/4291] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:11:40 2022] POST /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47/action => generated 24492 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:11:53.101860 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:11:53.102435 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:11:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:11:55.554978 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:11:55.555624 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:11:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:12:02.734382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d4ca830f-ef61-4bc0-9733-a8354d470422 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:02.734966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d4ca830f-ef61-4bc0-9733-a8354d470422 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:02.743145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4ca830f-ef61-4bc0-9733-a8354d470422 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:02.743603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4ca830f-ef61-4bc0-9733-a8354d470422 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:02.744605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4ca830f-ef61-4bc0-9733-a8354d470422 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:02.745056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4ca830f-ef61-4bc0-9733-a8354d470422 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:02.787864 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d4ca830f-ef61-4bc0-9733-a8354d470422 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524/ips" status: 200 len: 150 microversion: 2.1 time: 0.057654 Mar 12 21:12:02.788631 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3524/4292] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Mar 12 21:12:02 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524/ips => generated 150 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:12:02.973124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-baa6f9af-ac1b-4627-8d38-54545e678412 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:02.974170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-baa6f9af-ac1b-4627-8d38-54545e678412 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:02.983548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-baa6f9af-ac1b-4627-8d38-54545e678412 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:02.984334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-baa6f9af-ac1b-4627-8d38-54545e678412 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:02.985392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-baa6f9af-ac1b-4627-8d38-54545e678412 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:02.986037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-baa6f9af-ac1b-4627-8d38-54545e678412 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:03.242457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-baa6f9af-ac1b-4627-8d38-54545e678412 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1834 microversion: 2.1 time: 0.274646 Mar 12 21:12:03.243492 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3525/4293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:02 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1834 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:04.239583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea69ee63-bdb7-47d0-aae6-6fb7048a630d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcb70a5a-733c-41a4-9720-36b2f07c886d"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:12:04.240732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea69ee63-bdb7-47d0-aae6-6fb7048a630d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:04.249097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea69ee63-bdb7-47d0-aae6-6fb7048a630d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:04.249884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea69ee63-bdb7-47d0-aae6-6fb7048a630d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:04.250927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea69ee63-bdb7-47d0-aae6-6fb7048a630d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:04.251550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea69ee63-bdb7-47d0-aae6-6fb7048a630d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:04.556493 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea69ee63-bdb7-47d0-aae6-6fb7048a630d tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "POST /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321135 Mar 12 21:12:04.557891 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3526/4294] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:12:04 2022] POST /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:12:04.563682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-02418df4-5107-4c73-bb57-d00540d70ee6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:04.565500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-02418df4-5107-4c73-bb57-d00540d70ee6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:04.577592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02418df4-5107-4c73-bb57-d00540d70ee6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:04.578400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02418df4-5107-4c73-bb57-d00540d70ee6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:04.579500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02418df4-5107-4c73-bb57-d00540d70ee6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:04.580248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02418df4-5107-4c73-bb57-d00540d70ee6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:04.609472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-02418df4-5107-4c73-bb57-d00540d70ee6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:12:04.725318 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-02418df4-5107-4c73-bb57-d00540d70ee6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 204 len: 0 microversion: 2.1 time: 0.165658 Mar 12 21:12:04.726473 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3527/4295] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:12:04 2022] DELETE /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:12:04.743918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5c00ce0a-d066-449b-8f68-bfc7d87d8db7 req-eba793a8-82c2-415c-9563-903ff3e76c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb3c81a-e3d8-4620-9c9d-7bfb50867f47", "tag": "2d64c72f-d3dd-4cc6-807e-8819869e76e4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:12:04.759100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5c00ce0a-d066-449b-8f68-bfc7d87d8db7 req-eba793a8-82c2-415c-9563-903ff3e76c49 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:04.759797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5c00ce0a-d066-449b-8f68-bfc7d87d8db7 req-eba793a8-82c2-415c-9563-903ff3e76c49 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:04.796621 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5c00ce0a-d066-449b-8f68-bfc7d87d8db7 req-eba793a8-82c2-415c-9563-903ff3e76c49 service nova] Creating event network-changed:2d64c72f-d3dd-4cc6-807e-8819869e76e4 for instance 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 on nch1-master-1 Mar 12 21:12:04.810382 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5c00ce0a-d066-449b-8f68-bfc7d87d8db7 req-eba793a8-82c2-415c-9563-903ff3e76c49 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080137 Mar 12 21:12:04.811935 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3528/4296] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:12:04.840763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-149e79af-1a57-4c53-8692-84b91af01050 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:04.842164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-149e79af-1a57-4c53-8692-84b91af01050 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:04.852397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-149e79af-1a57-4c53-8692-84b91af01050 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:04.853658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-149e79af-1a57-4c53-8692-84b91af01050 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:04.864325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-149e79af-1a57-4c53-8692-84b91af01050 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:04.864962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-149e79af-1a57-4c53-8692-84b91af01050 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:05.179441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-149e79af-1a57-4c53-8692-84b91af01050 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:05.192139 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-149e79af-1a57-4c53-8692-84b91af01050 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1689 microversion: 2.1 time: 0.378384 Mar 12 21:12:05.193967 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3529/4297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:04 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1689 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:12:06.213263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8859953-a47e-4343-9eba-dde09d2eebb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:06.215391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8859953-a47e-4343-9eba-dde09d2eebb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:06.225738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8859953-a47e-4343-9eba-dde09d2eebb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:06.226614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8859953-a47e-4343-9eba-dde09d2eebb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:06.229038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8859953-a47e-4343-9eba-dde09d2eebb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:06.230106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8859953-a47e-4343-9eba-dde09d2eebb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:06.403359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c8859953-a47e-4343-9eba-dde09d2eebb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:06.411903 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8859953-a47e-4343-9eba-dde09d2eebb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1689 microversion: 2.1 time: 0.204373 Mar 12 21:12:06.412906 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3530/4298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:06 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1689 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:12:07.004146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ccfdb060-2986-4b78-ba08-b616855e6ae3 req-bce5cdee-ae0f-4714-a468-ed02ed5c790b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb3c81a-e3d8-4620-9c9d-7bfb50867f47", "name": "network-vif-deleted", "tag": "2d64c72f-d3dd-4cc6-807e-8819869e76e4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:12:07.015807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ccfdb060-2986-4b78-ba08-b616855e6ae3 req-bce5cdee-ae0f-4714-a468-ed02ed5c790b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:07.016306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ccfdb060-2986-4b78-ba08-b616855e6ae3 req-bce5cdee-ae0f-4714-a468-ed02ed5c790b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:07.032668 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ccfdb060-2986-4b78-ba08-b616855e6ae3 req-bce5cdee-ae0f-4714-a468-ed02ed5c790b service nova] Creating event network-vif-deleted:2d64c72f-d3dd-4cc6-807e-8819869e76e4 for instance 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 on nch1-master-1 Mar 12 21:12:07.039707 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ccfdb060-2986-4b78-ba08-b616855e6ae3 req-bce5cdee-ae0f-4714-a468-ed02ed5c790b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041090 Mar 12 21:12:07.040990 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3531/4299] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:12:07.432943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f6e808b-ccc3-46c3-88fd-50757367b428 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:07.433939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6f6e808b-ccc3-46c3-88fd-50757367b428 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:07.447317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f6e808b-ccc3-46c3-88fd-50757367b428 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:07.447876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f6e808b-ccc3-46c3-88fd-50757367b428 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:07.449650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f6e808b-ccc3-46c3-88fd-50757367b428 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:07.450206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f6e808b-ccc3-46c3-88fd-50757367b428 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:07.485472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f6e808b-ccc3-46c3-88fd-50757367b428 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:07.485960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f6e808b-ccc3-46c3-88fd-50757367b428 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:07.486484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-6f6e808b-ccc3-46c3-88fd-50757367b428 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lazy-loading 'fault' on Instance uuid 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:12:07.550996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6f6e808b-ccc3-46c3-88fd-50757367b428 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:07.561629 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f6e808b-ccc3-46c3-88fd-50757367b428 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 200 len: 1356 microversion: 2.1 time: 0.135666 Mar 12 21:12:07.562972 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3532/4300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:07 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 1356 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:08.124247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3111a94c-9ab3-4be6-b4a4-6970080a76e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:08.125124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3111a94c-9ab3-4be6-b4a4-6970080a76e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:08.132200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3111a94c-9ab3-4be6-b4a4-6970080a76e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:08.132379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3111a94c-9ab3-4be6-b4a4-6970080a76e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:08.133183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3111a94c-9ab3-4be6-b4a4-6970080a76e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:08.133615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3111a94c-9ab3-4be6-b4a4-6970080a76e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:08.215517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-3111a94c-9ab3-4be6-b4a4-6970080a76e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lazy-loading 'services' on Instance uuid add0bf65-fc12-498d-b1fa-68d1bb659524 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:12:08.302521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3111a94c-9ab3-4be6-b4a4-6970080a76e0 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524/os-volume_attachments/bcb70a5a-733c-41a4-9720-36b2f07c886d" status: 202 len: 0 microversion: 2.1 time: 0.182264 Mar 12 21:12:08.303213 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3533/4301] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:12:08 2022] DELETE /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524/os-volume_attachments/bcb70a5a-733c-41a4-9720-36b2f07c886d => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:12:08.313806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-91e65e86-803d-45c3-adad-24a3ea1cfd1f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:08.314982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-91e65e86-803d-45c3-adad-24a3ea1cfd1f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:08.322343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91e65e86-803d-45c3-adad-24a3ea1cfd1f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:08.323539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91e65e86-803d-45c3-adad-24a3ea1cfd1f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:08.324151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91e65e86-803d-45c3-adad-24a3ea1cfd1f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:08.324708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91e65e86-803d-45c3-adad-24a3ea1cfd1f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:08.364795 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-91e65e86-803d-45c3-adad-24a3ea1cfd1f tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056566 Mar 12 21:12:08.365670 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3534/4302] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:12:08 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:12:08.582967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd532b03-067b-4886-989c-c8599cadc713 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:08.583908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd532b03-067b-4886-989c-c8599cadc713 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:08.591329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd532b03-067b-4886-989c-c8599cadc713 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:08.591793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd532b03-067b-4886-989c-c8599cadc713 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:08.592581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd532b03-067b-4886-989c-c8599cadc713 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:08.593024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd532b03-067b-4886-989c-c8599cadc713 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:08.609241 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bd532b03-067b-4886-989c-c8599cadc713 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] HTTP exception thrown: Instance 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 could not be found. Mar 12 21:12:08.609883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd532b03-067b-4886-989c-c8599cadc713 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Returning 404 to user: Instance 6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:12:08.610739 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd532b03-067b-4886-989c-c8599cadc713 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47" status: 404 len: 111 microversion: 2.1 time: 0.033320 Mar 12 21:12:08.611304 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3535/4303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:08 2022] GET /compute/v2.1/servers/6fb3c81a-e3d8-4620-9c9d-7bfb50867f47 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:12:09.377073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4a789219-efd9-4b62-889d-f6dcffcdd324 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:09.378791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4a789219-efd9-4b62-889d-f6dcffcdd324 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:09.384770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a789219-efd9-4b62-889d-f6dcffcdd324 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:09.385227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a789219-efd9-4b62-889d-f6dcffcdd324 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:09.386074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a789219-efd9-4b62-889d-f6dcffcdd324 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:09.386522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4a789219-efd9-4b62-889d-f6dcffcdd324 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:09.415475 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4a789219-efd9-4b62-889d-f6dcffcdd324 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042591 Mar 12 21:12:09.416062 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3536/4304] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:12:09 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 12 21:12:09.475499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6caaf97d-15a6-47df-8f93-193a47ad40a7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:09.475983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6caaf97d-15a6-47df-8f93-193a47ad40a7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:09.482601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6caaf97d-15a6-47df-8f93-193a47ad40a7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:09.483289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6caaf97d-15a6-47df-8f93-193a47ad40a7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:09.484300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6caaf97d-15a6-47df-8f93-193a47ad40a7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:09.484988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6caaf97d-15a6-47df-8f93-193a47ad40a7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:09.516008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6caaf97d-15a6-47df-8f93-193a47ad40a7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:12:09.631538 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6caaf97d-15a6-47df-8f93-193a47ad40a7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 204 len: 0 microversion: 2.1 time: 0.160297 Mar 12 21:12:09.632482 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3537/4305] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:12:09 2022] DELETE /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:12:09.641215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-808ee247-278e-45fe-916b-73dc87c65509 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:09.642488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-808ee247-278e-45fe-916b-73dc87c65509 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:09.649151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-808ee247-278e-45fe-916b-73dc87c65509 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:09.649621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-808ee247-278e-45fe-916b-73dc87c65509 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:09.650899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-808ee247-278e-45fe-916b-73dc87c65509 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:09.651389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-808ee247-278e-45fe-916b-73dc87c65509 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:09.864833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-808ee247-278e-45fe-916b-73dc87c65509 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:09.875565 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-808ee247-278e-45fe-916b-73dc87c65509 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1681 microversion: 2.1 time: 0.238737 Mar 12 21:12:09.877209 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3538/4306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:09 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:10.895130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a2df23f5-b05a-47db-87bc-c5da02fbb6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:10.896465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a2df23f5-b05a-47db-87bc-c5da02fbb6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:10.903882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2df23f5-b05a-47db-87bc-c5da02fbb6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:10.904656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2df23f5-b05a-47db-87bc-c5da02fbb6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:10.906161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2df23f5-b05a-47db-87bc-c5da02fbb6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:10.907160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2df23f5-b05a-47db-87bc-c5da02fbb6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:11.129366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a2df23f5-b05a-47db-87bc-c5da02fbb6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:11.136792 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a2df23f5-b05a-47db-87bc-c5da02fbb6c4 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1681 microversion: 2.1 time: 0.246895 Mar 12 21:12:11.137396 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3539/4307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:10 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1681 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:12.156126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6cd4b4a-4e22-4237-ba7d-ca0188dca2bc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:12.157491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d6cd4b4a-4e22-4237-ba7d-ca0188dca2bc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:12.167601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6cd4b4a-4e22-4237-ba7d-ca0188dca2bc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:12.168369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6cd4b4a-4e22-4237-ba7d-ca0188dca2bc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:12.169573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6cd4b4a-4e22-4237-ba7d-ca0188dca2bc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:12.170554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6cd4b4a-4e22-4237-ba7d-ca0188dca2bc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:12.432384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d6cd4b4a-4e22-4237-ba7d-ca0188dca2bc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:12.464512 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d6cd4b4a-4e22-4237-ba7d-ca0188dca2bc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1681 microversion: 2.1 time: 0.308847 Mar 12 21:12:12.475553 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3540/4308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:12 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1681 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:12:12.568874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-159ebeaa-08c0-4dc4-8aa8-3cada64fa287 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '.version_select at 0x7f6e48dd9940>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:12.600122 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-159ebeaa-08c0-4dc4-8aa8-3cada64fa287 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-917593377" status: 202 len: 0 microversion: 2.1 time: 0.036968 Mar 12 21:12:12.601244 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3541/4309] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Mar 12 21:12:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-917593377 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:12:12.643717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-963d584b-c98e-40cf-9730-0d681d36fd83 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'create', calling method: .version_select at 0x7f6e48d41310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-337869288"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:12:12.666340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-963d584b-c98e-40cf-9730-0d681d36fd83 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:12:12.673266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-963d584b-c98e-40cf-9730-0d681d36fd83 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for user 43f35f32a8064500a8d8412f19697b93 and project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:12:12.810565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-963d584b-c98e-40cf-9730-0d681d36fd83 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:12:12.816989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-963d584b-c98e-40cf-9730-0d681d36fd83 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for user 43f35f32a8064500a8d8412f19697b93 and project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:12:12.837068 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-963d584b-c98e-40cf-9730-0d681d36fd83 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.210890 Mar 12 21:12:12.838219 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3542/4310] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:12:12 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:12.964994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-08ae005e-6d78-4099-9fa6-4e2466c15c23 req-d8c79829-4698-4295-ab99-ccf16ac947a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add0bf65-fc12-498d-b1fa-68d1bb659524", "name": "network-vif-deleted", "tag": "0d5e522b-3263-42db-b7e7-ba95e5db5399"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:12:12.982905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-08ae005e-6d78-4099-9fa6-4e2466c15c23 req-d8c79829-4698-4295-ab99-ccf16ac947a5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:12.989088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-08ae005e-6d78-4099-9fa6-4e2466c15c23 req-d8c79829-4698-4295-ab99-ccf16ac947a5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:13.024528 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-08ae005e-6d78-4099-9fa6-4e2466c15c23 req-d8c79829-4698-4295-ab99-ccf16ac947a5 service nova] Creating event network-vif-deleted:0d5e522b-3263-42db-b7e7-ba95e5db5399 for instance add0bf65-fc12-498d-b1fa-68d1bb659524 on nch1-master-1 Mar 12 21:12:13.051256 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-08ae005e-6d78-4099-9fa6-4e2466c15c23 req-d8c79829-4698-4295-ab99-ccf16ac947a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090166 Mar 12 21:12:13.052465 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3543/4311] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:12:13.485277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f81727b-0508-4445-89d7-5b0841676bec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:13.487404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f81727b-0508-4445-89d7-5b0841676bec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:13.503437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f81727b-0508-4445-89d7-5b0841676bec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:13.505424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f81727b-0508-4445-89d7-5b0841676bec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:13.507736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f81727b-0508-4445-89d7-5b0841676bec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:13.509740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f81727b-0508-4445-89d7-5b0841676bec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:13.615164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f81727b-0508-4445-89d7-5b0841676bec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:13.616179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f81727b-0508-4445-89d7-5b0841676bec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:13.616673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-0f81727b-0508-4445-89d7-5b0841676bec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lazy-loading 'fault' on Instance uuid add0bf65-fc12-498d-b1fa-68d1bb659524 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:12:13.677611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f81727b-0508-4445-89d7-5b0841676bec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c8058e4e8d475c9377a065b4018a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f427010b06749289b20e8b776a8b8c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:13.701611 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f81727b-0508-4445-89d7-5b0841676bec tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 200 len: 1331 microversion: 2.1 time: 0.219289 Mar 12 21:12:13.703167 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3544/4312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:13 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 1331 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:12:14.725112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23d4fa6d-22fb-41b1-b4c6-f382e1e5edd9 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:14.725830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-23d4fa6d-22fb-41b1-b4c6-f382e1e5edd9 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:14.739662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23d4fa6d-22fb-41b1-b4c6-f382e1e5edd9 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:14.745153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23d4fa6d-22fb-41b1-b4c6-f382e1e5edd9 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:14.746495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23d4fa6d-22fb-41b1-b4c6-f382e1e5edd9 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:14.747176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23d4fa6d-22fb-41b1-b4c6-f382e1e5edd9 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:14.781714 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-23d4fa6d-22fb-41b1-b4c6-f382e1e5edd9 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Instance add0bf65-fc12-498d-b1fa-68d1bb659524 could not be found. Mar 12 21:12:14.782358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23d4fa6d-22fb-41b1-b4c6-f382e1e5edd9 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 404 to user: Instance add0bf65-fc12-498d-b1fa-68d1bb659524 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:12:14.783239 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-23d4fa6d-22fb-41b1-b4c6-f382e1e5edd9 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 404 len: 111 microversion: 2.1 time: 0.066815 Mar 12 21:12:14.783816 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3545/4313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:14 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:12:14.797525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d07c959-52cb-4512-a004-89daa62bc28a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '.version_select at 0x7f6e3728d3a0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:14.825651 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d07c959-52cb-4512-a004-89daa62bc28a tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-421008801" status: 202 len: 0 microversion: 2.1 time: 0.031982 Mar 12 21:12:14.826680 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3546/4314] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Mar 12 21:12:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-421008801 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:12:16.646748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-560d4c8a-0411-4004-8e20-6944b535c086 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:16.647385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-560d4c8a-0411-4004-8e20-6944b535c086 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:16.654351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-560d4c8a-0411-4004-8e20-6944b535c086 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:16.654890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-560d4c8a-0411-4004-8e20-6944b535c086 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:16.655784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-560d4c8a-0411-4004-8e20-6944b535c086 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:16.656304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-560d4c8a-0411-4004-8e20-6944b535c086 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:16.674282 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-560d4c8a-0411-4004-8e20-6944b535c086 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Instance add0bf65-fc12-498d-b1fa-68d1bb659524 could not be found. Mar 12 21:12:16.674896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-560d4c8a-0411-4004-8e20-6944b535c086 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 404 to user: Instance add0bf65-fc12-498d-b1fa-68d1bb659524 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:12:16.675747 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-560d4c8a-0411-4004-8e20-6944b535c086 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 404 len: 111 microversion: 2.1 time: 0.033898 Mar 12 21:12:16.679722 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3547/4315] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:12:16 2022] DELETE /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:12:16.685489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4efd87a4-23da-49f9-b858-9a0248495552 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:16.686150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4efd87a4-23da-49f9-b858-9a0248495552 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: add0bf65-fc12-498d-b1fa-68d1bb659524] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:16.692839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4efd87a4-23da-49f9-b858-9a0248495552 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:16.693312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4efd87a4-23da-49f9-b858-9a0248495552 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:16.694125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4efd87a4-23da-49f9-b858-9a0248495552 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:16.694570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4efd87a4-23da-49f9-b858-9a0248495552 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:16.708541 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-4efd87a4-23da-49f9-b858-9a0248495552 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Instance add0bf65-fc12-498d-b1fa-68d1bb659524 could not be found. Mar 12 21:12:16.709162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4efd87a4-23da-49f9-b858-9a0248495552 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 404 to user: Instance add0bf65-fc12-498d-b1fa-68d1bb659524 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:12:16.710049 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4efd87a4-23da-49f9-b858-9a0248495552 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524" status: 404 len: 111 microversion: 2.1 time: 0.029376 Mar 12 21:12:16.713721 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3548/4316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:16 2022] GET /compute/v2.1/servers/add0bf65-fc12-498d-b1fa-68d1bb659524 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:12:17.917680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e3c8fd37-043b-45f7-bb95-d3214d272ad3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:17.918980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e3c8fd37-043b-45f7-bb95-d3214d272ad3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:17.928064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3c8fd37-043b-45f7-bb95-d3214d272ad3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:17.930325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3c8fd37-043b-45f7-bb95-d3214d272ad3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:17.931437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3c8fd37-043b-45f7-bb95-d3214d272ad3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:17.932663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3c8fd37-043b-45f7-bb95-d3214d272ad3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:17.960473 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e3c8fd37-043b-45f7-bb95-d3214d272ad3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Instance 1f5630c6-2e87-4f5c-898a-646c3a54bad2 could not be found. Mar 12 21:12:17.963881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e3c8fd37-043b-45f7-bb95-d3214d272ad3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 404 to user: Instance 1f5630c6-2e87-4f5c-898a-646c3a54bad2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:12:17.964564 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e3c8fd37-043b-45f7-bb95-d3214d272ad3 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 404 len: 111 microversion: 2.1 time: 0.054110 Mar 12 21:12:17.965107 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3549/4317] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:12:17 2022] DELETE /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:12:17.980280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3e907783-63d8-4615-93d2-401e1d066dd7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:17.981205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3e907783-63d8-4615-93d2-401e1d066dd7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 1f5630c6-2e87-4f5c-898a-646c3a54bad2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:18.000178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e907783-63d8-4615-93d2-401e1d066dd7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:18.000621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e907783-63d8-4615-93d2-401e1d066dd7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:18.001413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e907783-63d8-4615-93d2-401e1d066dd7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:18.002310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e907783-63d8-4615-93d2-401e1d066dd7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:18.018521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3e907783-63d8-4615-93d2-401e1d066dd7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Instance 1f5630c6-2e87-4f5c-898a-646c3a54bad2 could not be found. Mar 12 21:12:18.019306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3e907783-63d8-4615-93d2-401e1d066dd7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 404 to user: Instance 1f5630c6-2e87-4f5c-898a-646c3a54bad2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:12:18.020208 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3e907783-63d8-4615-93d2-401e1d066dd7 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2" status: 404 len: 111 microversion: 2.1 time: 0.050581 Mar 12 21:12:18.020861 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3550/4318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:17 2022] GET /compute/v2.1/servers/1f5630c6-2e87-4f5c-898a-646c3a54bad2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:12:18.047444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc92e0bd-4e59-467b-ac56-7759ba206edc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:18.053224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc92e0bd-4e59-467b-ac56-7759ba206edc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:18.064518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc92e0bd-4e59-467b-ac56-7759ba206edc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:18.065300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc92e0bd-4e59-467b-ac56-7759ba206edc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:18.066265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc92e0bd-4e59-467b-ac56-7759ba206edc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:18.066832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc92e0bd-4e59-467b-ac56-7759ba206edc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:18.093234 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bc92e0bd-4e59-467b-ac56-7759ba206edc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Instance 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb could not be found. Mar 12 21:12:18.095099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc92e0bd-4e59-467b-ac56-7759ba206edc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 404 to user: Instance 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:12:18.096626 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc92e0bd-4e59-467b-ac56-7759ba206edc tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 404 len: 111 microversion: 2.1 time: 0.069866 Mar 12 21:12:18.097444 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3551/4319] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:12:18 2022] DELETE /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:12:18.107373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fcca57a3-aaf9-49d1-951e-fbaf5732a865 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:18.108499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fcca57a3-aaf9-49d1-951e-fbaf5732a865 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:18.116988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcca57a3-aaf9-49d1-951e-fbaf5732a865 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:18.118400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcca57a3-aaf9-49d1-951e-fbaf5732a865 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:18.119978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcca57a3-aaf9-49d1-951e-fbaf5732a865 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:18.120712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcca57a3-aaf9-49d1-951e-fbaf5732a865 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:18.154894 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-fcca57a3-aaf9-49d1-951e-fbaf5732a865 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Instance 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb could not be found. Mar 12 21:12:18.156262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fcca57a3-aaf9-49d1-951e-fbaf5732a865 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 404 to user: Instance 30d3f7e4-7cc1-4ebb-864f-36ddef3948fb could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:12:18.157291 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fcca57a3-aaf9-49d1-951e-fbaf5732a865 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb" status: 404 len: 111 microversion: 2.1 time: 0.054996 Mar 12 21:12:18.159189 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3552/4320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:18 2022] GET /compute/v2.1/servers/30d3f7e4-7cc1-4ebb-864f-36ddef3948fb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:12:19.344422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be487ad9-bf51-41e0-877f-56450f4017ab tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:19.346406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-be487ad9-bf51-41e0-877f-56450f4017ab tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:19.353803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be487ad9-bf51-41e0-877f-56450f4017ab tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:19.354255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be487ad9-bf51-41e0-877f-56450f4017ab tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:19.355042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be487ad9-bf51-41e0-877f-56450f4017ab tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:19.358191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be487ad9-bf51-41e0-877f-56450f4017ab tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:19.374685 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-be487ad9-bf51-41e0-877f-56450f4017ab tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Instance 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 could not be found. Mar 12 21:12:19.375769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be487ad9-bf51-41e0-877f-56450f4017ab tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 404 to user: Instance 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:12:19.376668 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be487ad9-bf51-41e0-877f-56450f4017ab tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 404 len: 111 microversion: 2.1 time: 0.036232 Mar 12 21:12:19.377614 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3553/4321] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:12:19 2022] DELETE /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:12:19.386250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ef3eecf-9c88-47fb-bd8c-83a459a3cc22 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:19.387637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ef3eecf-9c88-47fb-bd8c-83a459a3cc22 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] [instance: 9b45740c-54fc-46b5-80d2-634e8f8ec3d2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:19.396734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ef3eecf-9c88-47fb-bd8c-83a459a3cc22 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:19.397530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ef3eecf-9c88-47fb-bd8c-83a459a3cc22 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:19.398933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ef3eecf-9c88-47fb-bd8c-83a459a3cc22 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:19.400164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ef3eecf-9c88-47fb-bd8c-83a459a3cc22 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:19.418558 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3ef3eecf-9c88-47fb-bd8c-83a459a3cc22 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] HTTP exception thrown: Instance 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 could not be found. Mar 12 21:12:19.420622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ef3eecf-9c88-47fb-bd8c-83a459a3cc22 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] Returning 404 to user: Instance 9b45740c-54fc-46b5-80d2-634e8f8ec3d2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:12:19.422104 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ef3eecf-9c88-47fb-bd8c-83a459a3cc22 tempest-AttachVolumeNegativeTest-2014367252 tempest-AttachVolumeNegativeTest-2014367252-project] 10.222.0.30 "GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2" status: 404 len: 111 microversion: 2.1 time: 0.040199 Mar 12 21:12:19.422750 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3554/4322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:19 2022] GET /compute/v2.1/servers/9b45740c-54fc-46b5-80d2-634e8f8ec3d2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:12:20.529964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-460163526", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "98e23cd4-f9b9-499f-8050-5062eb04ae6d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-337869288", "security_groups": [{"name": "tempest-secgroup-smoke-1476538529"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:12:20.735313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] validate_networks() for [('98e23cd4-f9b9-499f-8050-5062eb04ae6d', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:12:21.378639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:12:21.379076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:12:21.379657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:12:21.379981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:12:21.380592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:12:21.397285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:21.397734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:21.398613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:21.399044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:21.510524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for project cf66e00702594effaf99e35fcdcf05c9. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:12:21.523540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for user 43f35f32a8064500a8d8412f19697b93 and project cf66e00702594effaf99e35fcdcf05c9. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:12:21.552330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:12:21.556056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:12:21.689531 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2137e30b-d72d-4729-ba98-a19f0c787ad8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.163701 Mar 12 21:12:21.691471 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3555/4323] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:12:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:12:21.719076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cdfa009c-e1b0-4342-b8ea-e8312d1d8223 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:21.721307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cdfa009c-e1b0-4342-b8ea-e8312d1d8223 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:21.813943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cdfa009c-e1b0-4342-b8ea-e8312d1d8223 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:21.823305 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cdfa009c-e1b0-4342-b8ea-e8312d1d8223 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1265 microversion: 2.1 time: 0.124889 Mar 12 21:12:21.835418 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3556/4324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:21 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:12:22.853100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8dda0867-6bf3-4d1c-b64d-3e8fb12dd153 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:22.854214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8dda0867-6bf3-4d1c-b64d-3e8fb12dd153 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:22.886553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dda0867-6bf3-4d1c-b64d-3e8fb12dd153 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:22.893912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dda0867-6bf3-4d1c-b64d-3e8fb12dd153 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:22.897785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dda0867-6bf3-4d1c-b64d-3e8fb12dd153 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:22.900684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8dda0867-6bf3-4d1c-b64d-3e8fb12dd153 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:23.140176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8dda0867-6bf3-4d1c-b64d-3e8fb12dd153 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:23.156915 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8dda0867-6bf3-4d1c-b64d-3e8fb12dd153 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1261 microversion: 2.1 time: 0.317944 Mar 12 21:12:23.160924 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3557/4325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:22 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1261 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:12:24.177528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cea5a595-fc73-46ec-812e-fae0804bf3b5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:24.179038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cea5a595-fc73-46ec-812e-fae0804bf3b5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:24.194072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cea5a595-fc73-46ec-812e-fae0804bf3b5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:24.199608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cea5a595-fc73-46ec-812e-fae0804bf3b5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:24.200860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cea5a595-fc73-46ec-812e-fae0804bf3b5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:24.202329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cea5a595-fc73-46ec-812e-fae0804bf3b5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:24.349616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cea5a595-fc73-46ec-812e-fae0804bf3b5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:24.364830 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cea5a595-fc73-46ec-812e-fae0804bf3b5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1323 microversion: 2.1 time: 0.191670 Mar 12 21:12:24.366388 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3558/4326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:24 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:12:25.389820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b2f807ec-03b1-49e5-bfcd-a8064f25c95f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:25.393014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b2f807ec-03b1-49e5-bfcd-a8064f25c95f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:25.404433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2f807ec-03b1-49e5-bfcd-a8064f25c95f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:25.405152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2f807ec-03b1-49e5-bfcd-a8064f25c95f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:25.406423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2f807ec-03b1-49e5-bfcd-a8064f25c95f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:25.406974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2f807ec-03b1-49e5-bfcd-a8064f25c95f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:26.147749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b2f807ec-03b1-49e5-bfcd-a8064f25c95f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:26.164721 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b2f807ec-03b1-49e5-bfcd-a8064f25c95f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1391 microversion: 2.1 time: 0.784291 Mar 12 21:12:26.167250 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3559/4327] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:25 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1391 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:26.784607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-dce00e41-439a-4ad9-977b-7c1d6c36c7c5 req-63de9971-e91f-4677-ad62-55f947724828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c852e33-59fa-408e-ae85-2db0fb6a96a6", "tag": "cd8b144c-540d-432c-afe3-8cbec9f808a3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:12:26.808255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-dce00e41-439a-4ad9-977b-7c1d6c36c7c5 req-63de9971-e91f-4677-ad62-55f947724828 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:26.808762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-dce00e41-439a-4ad9-977b-7c1d6c36c7c5 req-63de9971-e91f-4677-ad62-55f947724828 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:26.837298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-dce00e41-439a-4ad9-977b-7c1d6c36c7c5 req-63de9971-e91f-4677-ad62-55f947724828 service nova] Creating event network-changed:cd8b144c-540d-432c-afe3-8cbec9f808a3 for instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 on nch2-master-1 Mar 12 21:12:26.853281 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-dce00e41-439a-4ad9-977b-7c1d6c36c7c5 req-63de9971-e91f-4677-ad62-55f947724828 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074229 Mar 12 21:12:26.854832 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3560/4328] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:12:27.186808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a0985d1-92a8-49e9-92f8-e7606e414ecf tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:27.188360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a0985d1-92a8-49e9-92f8-e7606e414ecf tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:27.196653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a0985d1-92a8-49e9-92f8-e7606e414ecf tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:27.197265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a0985d1-92a8-49e9-92f8-e7606e414ecf tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:27.198385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a0985d1-92a8-49e9-92f8-e7606e414ecf tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:27.199083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a0985d1-92a8-49e9-92f8-e7606e414ecf tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:27.378717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8a0985d1-92a8-49e9-92f8-e7606e414ecf tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:27.389805 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a0985d1-92a8-49e9-92f8-e7606e414ecf tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1391 microversion: 2.1 time: 0.207394 Mar 12 21:12:27.399765 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3561/4329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:27 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1391 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:12:28.410232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a14ba86b-4316-4f86-9b3b-09f71fc7800f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:28.410890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a14ba86b-4316-4f86-9b3b-09f71fc7800f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:28.418341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a14ba86b-4316-4f86-9b3b-09f71fc7800f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:28.419128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a14ba86b-4316-4f86-9b3b-09f71fc7800f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:28.419950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a14ba86b-4316-4f86-9b3b-09f71fc7800f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:28.420496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a14ba86b-4316-4f86-9b3b-09f71fc7800f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:28.581950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a14ba86b-4316-4f86-9b3b-09f71fc7800f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:28.590903 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a14ba86b-4316-4f86-9b3b-09f71fc7800f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1391 microversion: 2.1 time: 0.185612 Mar 12 21:12:28.599375 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3562/4330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:28 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:29.613186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-42647fbd-25b3-4f4e-89ed-2352c70ca34a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:29.613948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-42647fbd-25b3-4f4e-89ed-2352c70ca34a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:29.621143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42647fbd-25b3-4f4e-89ed-2352c70ca34a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:29.621758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42647fbd-25b3-4f4e-89ed-2352c70ca34a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:29.622663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42647fbd-25b3-4f4e-89ed-2352c70ca34a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:29.623127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42647fbd-25b3-4f4e-89ed-2352c70ca34a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:29.786719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-42647fbd-25b3-4f4e-89ed-2352c70ca34a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:29.796920 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-42647fbd-25b3-4f4e-89ed-2352c70ca34a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1391 microversion: 2.1 time: 0.187847 Mar 12 21:12:29.797644 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3563/4331] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:29 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:12:30.816381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e8d92d88-5c82-49ca-87a4-62314a629f93 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:30.817012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e8d92d88-5c82-49ca-87a4-62314a629f93 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:30.827024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8d92d88-5c82-49ca-87a4-62314a629f93 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:30.831275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8d92d88-5c82-49ca-87a4-62314a629f93 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:30.832421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8d92d88-5c82-49ca-87a4-62314a629f93 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:30.836333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8d92d88-5c82-49ca-87a4-62314a629f93 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:31.032246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8d92d88-5c82-49ca-87a4-62314a629f93 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:31.040091 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e8d92d88-5c82-49ca-87a4-62314a629f93 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1391 microversion: 2.1 time: 0.228143 Mar 12 21:12:31.045356 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3564/4332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:30 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1391 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:32.058769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f68fb6a1-a960-42d7-be22-f0d14674a5bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:32.058769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f68fb6a1-a960-42d7-be22-f0d14674a5bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:32.066347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f68fb6a1-a960-42d7-be22-f0d14674a5bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:32.066813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f68fb6a1-a960-42d7-be22-f0d14674a5bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:32.067606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f68fb6a1-a960-42d7-be22-f0d14674a5bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:32.068049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f68fb6a1-a960-42d7-be22-f0d14674a5bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:32.262553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f68fb6a1-a960-42d7-be22-f0d14674a5bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:32.274534 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f68fb6a1-a960-42d7-be22-f0d14674a5bd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1391 microversion: 2.1 time: 0.221860 Mar 12 21:12:32.286151 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3565/4333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:32 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1391 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:33.296108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c0587ce6-042f-450d-a231-0f4d62a43d2c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:33.297236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c0587ce6-042f-450d-a231-0f4d62a43d2c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:33.307231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0587ce6-042f-450d-a231-0f4d62a43d2c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:33.307879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0587ce6-042f-450d-a231-0f4d62a43d2c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:33.308868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0587ce6-042f-450d-a231-0f4d62a43d2c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:33.311385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0587ce6-042f-450d-a231-0f4d62a43d2c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:33.558303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0587ce6-042f-450d-a231-0f4d62a43d2c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:33.577903 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c0587ce6-042f-450d-a231-0f4d62a43d2c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1391 microversion: 2.1 time: 0.287653 Mar 12 21:12:33.578948 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3566/4334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:33 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1391 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:33.589721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2dee2207-5ba1-49ce-8bac-c578cbbe592e req-94d15bd9-885b-46fe-8ef5-6aada7df796c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c852e33-59fa-408e-ae85-2db0fb6a96a6", "name": "network-vif-plugged", "status": "completed", "tag": "cd8b144c-540d-432c-afe3-8cbec9f808a3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:12:33.602471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2dee2207-5ba1-49ce-8bac-c578cbbe592e req-94d15bd9-885b-46fe-8ef5-6aada7df796c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:33.603322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2dee2207-5ba1-49ce-8bac-c578cbbe592e req-94d15bd9-885b-46fe-8ef5-6aada7df796c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:33.626605 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2dee2207-5ba1-49ce-8bac-c578cbbe592e req-94d15bd9-885b-46fe-8ef5-6aada7df796c service nova] Creating event network-vif-plugged:cd8b144c-540d-432c-afe3-8cbec9f808a3 for instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 on nch2-master-1 Mar 12 21:12:33.633176 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2dee2207-5ba1-49ce-8bac-c578cbbe592e req-94d15bd9-885b-46fe-8ef5-6aada7df796c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052516 Mar 12 21:12:33.634257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3567/4335] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:12:34.615391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b608978-b83d-42d0-9b25-3c64a87faa21 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:34.616090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b608978-b83d-42d0-9b25-3c64a87faa21 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:34.629928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b608978-b83d-42d0-9b25-3c64a87faa21 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:34.630389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b608978-b83d-42d0-9b25-3c64a87faa21 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:34.631196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b608978-b83d-42d0-9b25-3c64a87faa21 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:34.631639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b608978-b83d-42d0-9b25-3c64a87faa21 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:34.843047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8b608978-b83d-42d0-9b25-3c64a87faa21 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:34.867032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b608978-b83d-42d0-9b25-3c64a87faa21 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1391 microversion: 2.1 time: 0.275348 Mar 12 21:12:34.867673 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3568/4336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:34 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:35.885655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f17b8f43-086f-4c4b-8a8a-02ef4cbdf545 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:35.886525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f17b8f43-086f-4c4b-8a8a-02ef4cbdf545 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:35.893940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f17b8f43-086f-4c4b-8a8a-02ef4cbdf545 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:35.894403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f17b8f43-086f-4c4b-8a8a-02ef4cbdf545 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:35.895191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f17b8f43-086f-4c4b-8a8a-02ef4cbdf545 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:35.895638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f17b8f43-086f-4c4b-8a8a-02ef4cbdf545 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:36.051342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f17b8f43-086f-4c4b-8a8a-02ef4cbdf545 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:36.060697 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f17b8f43-086f-4c4b-8a8a-02ef4cbdf545 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1564 microversion: 2.1 time: 0.179663 Mar 12 21:12:36.061637 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3569/4337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:35 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:36.080323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-486877a3-998b-48f2-9ec4-ee23562bd164 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:36.081043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-486877a3-998b-48f2-9ec4-ee23562bd164 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:36.090116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-486877a3-998b-48f2-9ec4-ee23562bd164 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:36.090580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-486877a3-998b-48f2-9ec4-ee23562bd164 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:36.091384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-486877a3-998b-48f2-9ec4-ee23562bd164 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:36.091913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-486877a3-998b-48f2-9ec4-ee23562bd164 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:36.250503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-486877a3-998b-48f2-9ec4-ee23562bd164 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:36.260218 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-486877a3-998b-48f2-9ec4-ee23562bd164 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1564 microversion: 2.1 time: 0.184915 Mar 12 21:12:36.260815 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3570/4338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:36 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1564 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:38.710180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d3f7593-bd6d-45b3-8c89-1cee659c9612 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:38.711452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0d3f7593-bd6d-45b3-8c89-1cee659c9612 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:38.720772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d3f7593-bd6d-45b3-8c89-1cee659c9612 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:38.721469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d3f7593-bd6d-45b3-8c89-1cee659c9612 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:38.722653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d3f7593-bd6d-45b3-8c89-1cee659c9612 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:38.723531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d3f7593-bd6d-45b3-8c89-1cee659c9612 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:38.917705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0d3f7593-bd6d-45b3-8c89-1cee659c9612 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:38.934281 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d3f7593-bd6d-45b3-8c89-1cee659c9612 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1564 microversion: 2.1 time: 0.228728 Mar 12 21:12:38.935207 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3571/4339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:38 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1564 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:38.940574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3606b1a1-d3ae-4b21-97a6-23a37c9809ab req-77775b14-57d0-4083-ae49-b2cf4a1f6a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c852e33-59fa-408e-ae85-2db0fb6a96a6", "tag": "cd8b144c-540d-432c-afe3-8cbec9f808a3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:12:38.966601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3606b1a1-d3ae-4b21-97a6-23a37c9809ab req-77775b14-57d0-4083-ae49-b2cf4a1f6a52 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:38.967441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3606b1a1-d3ae-4b21-97a6-23a37c9809ab req-77775b14-57d0-4083-ae49-b2cf4a1f6a52 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:38.989484 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3606b1a1-d3ae-4b21-97a6-23a37c9809ab req-77775b14-57d0-4083-ae49-b2cf4a1f6a52 service nova] Creating event network-changed:cd8b144c-540d-432c-afe3-8cbec9f808a3 for instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 on nch2-master-1 Mar 12 21:12:39.003395 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3606b1a1-d3ae-4b21-97a6-23a37c9809ab req-77775b14-57d0-4083-ae49-b2cf4a1f6a52 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066703 Mar 12 21:12:39.004137 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3572/4340] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:12:43.107623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56909a96-b8fb-4e3f-b011-f00fdb5cd5a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:43.108558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-56909a96-b8fb-4e3f-b011-f00fdb5cd5a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:43.116524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56909a96-b8fb-4e3f-b011-f00fdb5cd5a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:43.117113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56909a96-b8fb-4e3f-b011-f00fdb5cd5a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:43.121040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56909a96-b8fb-4e3f-b011-f00fdb5cd5a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:43.121900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56909a96-b8fb-4e3f-b011-f00fdb5cd5a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:43.361688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-56909a96-b8fb-4e3f-b011-f00fdb5cd5a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:43.371446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-56909a96-b8fb-4e3f-b011-f00fdb5cd5a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:43.373092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-56909a96-b8fb-4e3f-b011-f00fdb5cd5a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:43.374396 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56909a96-b8fb-4e3f-b011-f00fdb5cd5a7 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 2943 microversion: 2.32 time: 0.272786 Mar 12 21:12:43.374976 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3573/4341] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:12:43 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 2943 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:12:43.406891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-172cccbb-a4f3-4f14-9603-e3ed166b501e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:43.407396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-172cccbb-a4f3-4f14-9603-e3ed166b501e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:43.413633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-172cccbb-a4f3-4f14-9603-e3ed166b501e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:43.414130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-172cccbb-a4f3-4f14-9603-e3ed166b501e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:43.414922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-172cccbb-a4f3-4f14-9603-e3ed166b501e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:43.415362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-172cccbb-a4f3-4f14-9603-e3ed166b501e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:43.561375 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-172cccbb-a4f3-4f14-9603-e3ed166b501e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.158622 Mar 12 21:12:43.562613 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3574/4342] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Mar 12 21:12:43 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371/os-interface => generated 1830 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:12:52.586642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-475545595", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "1d131dbd-e7c0-4a81-b96f-afbf16774551"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:12:52.644859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] validate_networks() for [('1d131dbd-e7c0-4a81-b96f-afbf16774551', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:12:53.259829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:12:53.260503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:12:53.260990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:12:53.261427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:12:53.262247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:12:53.283608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:53.284565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:53.285552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:53.286379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:53.315361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Getting quotas for project a5723877279b461baac745c825906ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:12:53.326361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Getting quotas for user 0cbb67154fb040359bf0c5460995d665 and project a5723877279b461baac745c825906ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:12:53.340861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:12:53.343235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:12:53.390696 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a56c5e7-3656-4b90-a630-d4ca61896d14 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810960 Mar 12 21:12:53.396936 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3575/4343] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:12:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:12:53.402447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dea22cb6-19bd-42a4-b6c6-7e51f632816c tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:53.403325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dea22cb6-19bd-42a4-b6c6-7e51f632816c tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:53.467217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dea22cb6-19bd-42a4-b6c6-7e51f632816c tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:53.475543 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dea22cb6-19bd-42a4-b6c6-7e51f632816c tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1213 microversion: 2.1 time: 0.076950 Mar 12 21:12:53.476143 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3576/4344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:53 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:12:54.492912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cb4f1f1e-fbdf-4983-916f-70100e2d99ae tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:54.494414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cb4f1f1e-fbdf-4983-916f-70100e2d99ae tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:54.503231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb4f1f1e-fbdf-4983-916f-70100e2d99ae tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:54.503690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb4f1f1e-fbdf-4983-916f-70100e2d99ae tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:54.504486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb4f1f1e-fbdf-4983-916f-70100e2d99ae tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:54.504917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb4f1f1e-fbdf-4983-916f-70100e2d99ae tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:54.577884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cb4f1f1e-fbdf-4983-916f-70100e2d99ae tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:54.588125 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cb4f1f1e-fbdf-4983-916f-70100e2d99ae tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1273 microversion: 2.1 time: 0.099117 Mar 12 21:12:54.589935 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3577/4345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:54 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:55.608133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-76c426b8-2b76-4ae1-868b-4547123a5414 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:55.609560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-76c426b8-2b76-4ae1-868b-4547123a5414 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:55.616884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76c426b8-2b76-4ae1-868b-4547123a5414 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:55.617343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76c426b8-2b76-4ae1-868b-4547123a5414 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:55.618256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76c426b8-2b76-4ae1-868b-4547123a5414 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:55.618704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76c426b8-2b76-4ae1-868b-4547123a5414 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:55.758178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-76c426b8-2b76-4ae1-868b-4547123a5414 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:55.765581 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-76c426b8-2b76-4ae1-868b-4547123a5414 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1313 microversion: 2.1 time: 0.163878 Mar 12 21:12:55.766191 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3578/4346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:55 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:56.279439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1c6b0925-224d-40fe-8528-a9fd9022bc47 req-389e587c-7ab6-4b67-a9e5-573555f75be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5289dfa1-67a8-48f5-8724-dff16e81e4db", "tag": "19aed5e6-c7b5-4975-bca9-2d4e4192c0a5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:12:56.295431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1c6b0925-224d-40fe-8528-a9fd9022bc47 req-389e587c-7ab6-4b67-a9e5-573555f75be4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:56.295891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1c6b0925-224d-40fe-8528-a9fd9022bc47 req-389e587c-7ab6-4b67-a9e5-573555f75be4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:56.308656 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1c6b0925-224d-40fe-8528-a9fd9022bc47 req-389e587c-7ab6-4b67-a9e5-573555f75be4 service nova] Creating event network-changed:19aed5e6-c7b5-4975-bca9-2d4e4192c0a5 for instance 5289dfa1-67a8-48f5-8724-dff16e81e4db on nch1-master-1 Mar 12 21:12:56.313443 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1c6b0925-224d-40fe-8528-a9fd9022bc47 req-389e587c-7ab6-4b67-a9e5-573555f75be4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041824 Mar 12 21:12:56.314184 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3579/4347] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:12:56.784256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-935f2ad3-9039-4c9f-ac28-d40862790cfb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:56.785693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-935f2ad3-9039-4c9f-ac28-d40862790cfb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:56.792971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-935f2ad3-9039-4c9f-ac28-d40862790cfb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:56.793630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-935f2ad3-9039-4c9f-ac28-d40862790cfb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:56.794620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-935f2ad3-9039-4c9f-ac28-d40862790cfb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:56.795073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-935f2ad3-9039-4c9f-ac28-d40862790cfb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:57.301496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-935f2ad3-9039-4c9f-ac28-d40862790cfb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:57.309853 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-935f2ad3-9039-4c9f-ac28-d40862790cfb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1313 microversion: 2.1 time: 0.530840 Mar 12 21:12:57.310530 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3580/4348] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:56 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:58.327607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9059ed63-d154-4714-ae76-ad5c4d9d8eeb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:58.328392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9059ed63-d154-4714-ae76-ad5c4d9d8eeb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:58.335399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9059ed63-d154-4714-ae76-ad5c4d9d8eeb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:58.336001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9059ed63-d154-4714-ae76-ad5c4d9d8eeb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:58.336899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9059ed63-d154-4714-ae76-ad5c4d9d8eeb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:58.337446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9059ed63-d154-4714-ae76-ad5c4d9d8eeb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:58.483750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9059ed63-d154-4714-ae76-ad5c4d9d8eeb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:58.491927 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9059ed63-d154-4714-ae76-ad5c4d9d8eeb tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1313 microversion: 2.1 time: 0.168414 Mar 12 21:12:58.492509 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3581/4349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:58 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:12:59.508730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33009af3-207a-4ca7-a97a-b9a2c53310c1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:12:59.510108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-33009af3-207a-4ca7-a97a-b9a2c53310c1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:12:59.517388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33009af3-207a-4ca7-a97a-b9a2c53310c1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:59.518077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33009af3-207a-4ca7-a97a-b9a2c53310c1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:59.519038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33009af3-207a-4ca7-a97a-b9a2c53310c1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:12:59.519632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33009af3-207a-4ca7-a97a-b9a2c53310c1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:12:59.737359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-33009af3-207a-4ca7-a97a-b9a2c53310c1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:12:59.746201 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-33009af3-207a-4ca7-a97a-b9a2c53310c1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1313 microversion: 2.1 time: 0.241482 Mar 12 21:12:59.755347 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3582/4350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:12:59 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:00.247801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c62d08ae-8c49-440d-b305-b1ac0b0e2880 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:00.248731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c62d08ae-8c49-440d-b305-b1ac0b0e2880 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:00.254706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c62d08ae-8c49-440d-b305-b1ac0b0e2880 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:00.255104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c62d08ae-8c49-440d-b305-b1ac0b0e2880 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:00.255868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c62d08ae-8c49-440d-b305-b1ac0b0e2880 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:00.256310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c62d08ae-8c49-440d-b305-b1ac0b0e2880 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:00.304499 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c62d08ae-8c49-440d-b305-b1ac0b0e2880 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6/action" status: 200 len: 24559 microversion: 2.1 time: 0.059968 Mar 12 21:13:00.306710 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3583/4351] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:13:00 2022] POST /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6/action => generated 24559 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:13:00.763569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-91928e83-5e34-49c0-bbd7-7f11baa05bcf tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:00.764133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-91928e83-5e34-49c0-bbd7-7f11baa05bcf tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:00.771488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91928e83-5e34-49c0-bbd7-7f11baa05bcf tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:00.771943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91928e83-5e34-49c0-bbd7-7f11baa05bcf tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:00.772719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91928e83-5e34-49c0-bbd7-7f11baa05bcf tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:00.773164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91928e83-5e34-49c0-bbd7-7f11baa05bcf tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:00.928451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-91928e83-5e34-49c0-bbd7-7f11baa05bcf tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:00.937233 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-91928e83-5e34-49c0-bbd7-7f11baa05bcf tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1313 microversion: 2.1 time: 0.177922 Mar 12 21:13:00.938383 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3584/4352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:00 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:01.956631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-286f3116-1cf2-4480-9880-9613b9104b37 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:01.957363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-286f3116-1cf2-4480-9880-9613b9104b37 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:01.964905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-286f3116-1cf2-4480-9880-9613b9104b37 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:01.965451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-286f3116-1cf2-4480-9880-9613b9104b37 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:01.966343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-286f3116-1cf2-4480-9880-9613b9104b37 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:01.966865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-286f3116-1cf2-4480-9880-9613b9104b37 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:02.117264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-286f3116-1cf2-4480-9880-9613b9104b37 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:02.126505 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-286f3116-1cf2-4480-9880-9613b9104b37 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1313 microversion: 2.1 time: 0.174722 Mar 12 21:13:02.127343 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3585/4353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:01 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:03.145481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a0b6b4e4-d786-45b0-8c87-1862ed7dce24 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:03.146358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a0b6b4e4-d786-45b0-8c87-1862ed7dce24 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:03.154982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0b6b4e4-d786-45b0-8c87-1862ed7dce24 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:03.155796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0b6b4e4-d786-45b0-8c87-1862ed7dce24 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:03.156915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0b6b4e4-d786-45b0-8c87-1862ed7dce24 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:03.157616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0b6b4e4-d786-45b0-8c87-1862ed7dce24 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:03.313636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a0b6b4e4-d786-45b0-8c87-1862ed7dce24 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:03.321227 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a0b6b4e4-d786-45b0-8c87-1862ed7dce24 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1313 microversion: 2.1 time: 0.180837 Mar 12 21:13:03.321845 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3586/4354] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:03 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:03.907093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8f2aeb9d-f17c-442b-8cab-295077473c69 req-232f72c3-ae1a-4e72-9666-bb3a6dcf6b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5289dfa1-67a8-48f5-8724-dff16e81e4db", "name": "network-vif-plugged", "status": "completed", "tag": "19aed5e6-c7b5-4975-bca9-2d4e4192c0a5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:03.922822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8f2aeb9d-f17c-442b-8cab-295077473c69 req-232f72c3-ae1a-4e72-9666-bb3a6dcf6b3c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:03.925112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8f2aeb9d-f17c-442b-8cab-295077473c69 req-232f72c3-ae1a-4e72-9666-bb3a6dcf6b3c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:03.960144 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8f2aeb9d-f17c-442b-8cab-295077473c69 req-232f72c3-ae1a-4e72-9666-bb3a6dcf6b3c service nova] Creating event network-vif-plugged:19aed5e6-c7b5-4975-bca9-2d4e4192c0a5 for instance 5289dfa1-67a8-48f5-8724-dff16e81e4db on nch1-master-1 Mar 12 21:13:03.972916 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8f2aeb9d-f17c-442b-8cab-295077473c69 req-232f72c3-ae1a-4e72-9666-bb3a6dcf6b3c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073819 Mar 12 21:13:03.974872 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3587/4355] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:13:04.338510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a2f16a7e-9ef3-4ace-9a24-b0a3f7262667 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:04.339678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a2f16a7e-9ef3-4ace-9a24-b0a3f7262667 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:04.346149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2f16a7e-9ef3-4ace-9a24-b0a3f7262667 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:04.347250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2f16a7e-9ef3-4ace-9a24-b0a3f7262667 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:04.348070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2f16a7e-9ef3-4ace-9a24-b0a3f7262667 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:04.348516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2f16a7e-9ef3-4ace-9a24-b0a3f7262667 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:04.555960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a2f16a7e-9ef3-4ace-9a24-b0a3f7262667 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:04.564724 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a2f16a7e-9ef3-4ace-9a24-b0a3f7262667 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1313 microversion: 2.1 time: 0.230510 Mar 12 21:13:04.565352 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3588/4356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:04 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:05.584311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7c4eafe-9890-4546-9a93-54668fd30cca tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:05.584964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f7c4eafe-9890-4546-9a93-54668fd30cca tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:05.591454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7c4eafe-9890-4546-9a93-54668fd30cca tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:05.591913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7c4eafe-9890-4546-9a93-54668fd30cca tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:05.592691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7c4eafe-9890-4546-9a93-54668fd30cca tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:05.593138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7c4eafe-9890-4546-9a93-54668fd30cca tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:05.754455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f7c4eafe-9890-4546-9a93-54668fd30cca tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:05.761995 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f7c4eafe-9890-4546-9a93-54668fd30cca tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1496 microversion: 2.1 time: 0.181589 Mar 12 21:13:05.762565 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3589/4357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:05 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1496 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:06.132251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0b01ab1-1699-4fd4-8303-fd8c5dcf711e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:06.132763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b0b01ab1-1699-4fd4-8303-fd8c5dcf711e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:06.138676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0b01ab1-1699-4fd4-8303-fd8c5dcf711e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:06.139130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0b01ab1-1699-4fd4-8303-fd8c5dcf711e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:06.139900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0b01ab1-1699-4fd4-8303-fd8c5dcf711e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:06.140343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0b01ab1-1699-4fd4-8303-fd8c5dcf711e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:06.164978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b0b01ab1-1699-4fd4-8303-fd8c5dcf711e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:13:06.246046 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0b01ab1-1699-4fd4-8303-fd8c5dcf711e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 204 len: 0 microversion: 2.1 time: 0.117502 Mar 12 21:13:06.246866 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3590/4358] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:13:06 2022] DELETE /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:13:06.256691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ca0ef4b-b109-49f7-acf3-70f88df4cd73 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:06.257333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ca0ef4b-b109-49f7-acf3-70f88df4cd73 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:06.263641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ca0ef4b-b109-49f7-acf3-70f88df4cd73 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:06.264174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ca0ef4b-b109-49f7-acf3-70f88df4cd73 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:06.264991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ca0ef4b-b109-49f7-acf3-70f88df4cd73 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:06.265440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ca0ef4b-b109-49f7-acf3-70f88df4cd73 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:06.413082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ca0ef4b-b109-49f7-acf3-70f88df4cd73 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:06.420640 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ca0ef4b-b109-49f7-acf3-70f88df4cd73 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1502 microversion: 2.1 time: 0.168126 Mar 12 21:13:06.421313 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3591/4359] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:06 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:07.440009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d7cb2180-441f-4191-9530-38a039721410 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:07.441424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d7cb2180-441f-4191-9530-38a039721410 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:07.451010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7cb2180-441f-4191-9530-38a039721410 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:07.451721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7cb2180-441f-4191-9530-38a039721410 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:07.452781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7cb2180-441f-4191-9530-38a039721410 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:07.453250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7cb2180-441f-4191-9530-38a039721410 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:07.692405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d7cb2180-441f-4191-9530-38a039721410 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:07.700192 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d7cb2180-441f-4191-9530-38a039721410 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 200 len: 1502 microversion: 2.1 time: 0.264788 Mar 12 21:13:07.715436 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3592/4360] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:07 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:08.212888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3bbf604d-7976-4c84-8e29-bf8be39d6dd1 req-69a9f022-d414-4f4a-8ad5-b2ee112b14c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5289dfa1-67a8-48f5-8724-dff16e81e4db", "name": "network-vif-deleted", "tag": "19aed5e6-c7b5-4975-bca9-2d4e4192c0a5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:08.230046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3bbf604d-7976-4c84-8e29-bf8be39d6dd1 req-69a9f022-d414-4f4a-8ad5-b2ee112b14c9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:08.231116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3bbf604d-7976-4c84-8e29-bf8be39d6dd1 req-69a9f022-d414-4f4a-8ad5-b2ee112b14c9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:08.255038 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3bbf604d-7976-4c84-8e29-bf8be39d6dd1 req-69a9f022-d414-4f4a-8ad5-b2ee112b14c9 service nova] Creating event network-vif-deleted:19aed5e6-c7b5-4975-bca9-2d4e4192c0a5 for instance 5289dfa1-67a8-48f5-8724-dff16e81e4db on nch1-master-1 Mar 12 21:13:08.260014 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3bbf604d-7976-4c84-8e29-bf8be39d6dd1 req-69a9f022-d414-4f4a-8ad5-b2ee112b14c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051840 Mar 12 21:13:08.260976 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3593/4361] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:13:08.719395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b88894eb-ee72-4ca3-b7eb-49cf1aa31da1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:08.720687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b88894eb-ee72-4ca3-b7eb-49cf1aa31da1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 5289dfa1-67a8-48f5-8724-dff16e81e4db] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:08.728967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b88894eb-ee72-4ca3-b7eb-49cf1aa31da1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:08.729505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b88894eb-ee72-4ca3-b7eb-49cf1aa31da1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:08.730456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b88894eb-ee72-4ca3-b7eb-49cf1aa31da1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:08.730994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b88894eb-ee72-4ca3-b7eb-49cf1aa31da1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:08.750420 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b88894eb-ee72-4ca3-b7eb-49cf1aa31da1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] HTTP exception thrown: Instance 5289dfa1-67a8-48f5-8724-dff16e81e4db could not be found. Mar 12 21:13:08.751768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b88894eb-ee72-4ca3-b7eb-49cf1aa31da1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Returning 404 to user: Instance 5289dfa1-67a8-48f5-8724-dff16e81e4db could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:13:08.753051 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b88894eb-ee72-4ca3-b7eb-49cf1aa31da1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db" status: 404 len: 111 microversion: 2.1 time: 0.039104 Mar 12 21:13:08.754118 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3594/4362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:08 2022] GET /compute/v2.1/servers/5289dfa1-67a8-48f5-8724-dff16e81e4db => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:13:08.864289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-704604681", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "1d131dbd-e7c0-4a81-b96f-afbf16774551"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:09.272077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] validate_networks() for [('1d131dbd-e7c0-4a81-b96f-afbf16774551', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:13:09.793876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:13:09.794439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:13:09.794917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:13:09.795438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:13:09.795962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:13:09.812569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:09.813029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:09.813885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:09.814335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:09.832129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Getting quotas for project a5723877279b461baac745c825906ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:13:09.837473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Getting quotas for user 0cbb67154fb040359bf0c5460995d665 and project a5723877279b461baac745c825906ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:13:09.852810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:13:09.855430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:13:09.900684 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0782d3b5-f3ad-4ce8-a9d9-3e2aec9fe603 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040292 Mar 12 21:13:09.902557 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3595/4363] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:13:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:13:09.920145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9474151f-9846-4e23-ae47-4e94c18cdd15 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:09.921167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9474151f-9846-4e23-ae47-4e94c18cdd15 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:09.987432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9474151f-9846-4e23-ae47-4e94c18cdd15 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:09.994204 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9474151f-9846-4e23-ae47-4e94c18cdd15 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1213 microversion: 2.1 time: 0.085515 Mar 12 21:13:09.994787 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3596/4364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:09 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:11.011477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ea91622-2fca-4fa9-b7c8-c2b468ce0152 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:11.012359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ea91622-2fca-4fa9-b7c8-c2b468ce0152 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:11.020782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ea91622-2fca-4fa9-b7c8-c2b468ce0152 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:11.021501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ea91622-2fca-4fa9-b7c8-c2b468ce0152 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:11.022629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ea91622-2fca-4fa9-b7c8-c2b468ce0152 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:11.023229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ea91622-2fca-4fa9-b7c8-c2b468ce0152 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:11.137184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ea91622-2fca-4fa9-b7c8-c2b468ce0152 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:11.144733 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ea91622-2fca-4fa9-b7c8-c2b468ce0152 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1283 microversion: 2.1 time: 0.137456 Mar 12 21:13:11.145435 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3597/4365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:11 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1283 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:11.367504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e1d19e03-c943-40c0-bd81-d6e83c0d36c6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:11.368364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e1d19e03-c943-40c0-bd81-d6e83c0d36c6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:11.374615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1d19e03-c943-40c0-bd81-d6e83c0d36c6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:11.375200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1d19e03-c943-40c0-bd81-d6e83c0d36c6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:11.376233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1d19e03-c943-40c0-bd81-d6e83c0d36c6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:11.376909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1d19e03-c943-40c0-bd81-d6e83c0d36c6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:12.005332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e1d19e03-c943-40c0-bd81-d6e83c0d36c6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1834 microversion: 2.1 time: 0.641706 Mar 12 21:13:12.017363 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3598/4366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:11 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1834 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:12.024885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-642c6f6b-ee53-4ed0-83d8-4e3d428be44f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:12.025518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-642c6f6b-ee53-4ed0-83d8-4e3d428be44f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:12.033645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-642c6f6b-ee53-4ed0-83d8-4e3d428be44f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:12.034245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-642c6f6b-ee53-4ed0-83d8-4e3d428be44f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:12.035205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-642c6f6b-ee53-4ed0-83d8-4e3d428be44f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:12.035747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-642c6f6b-ee53-4ed0-83d8-4e3d428be44f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:12.230030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-642c6f6b-ee53-4ed0-83d8-4e3d428be44f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:12.240198 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-642c6f6b-ee53-4ed0-83d8-4e3d428be44f tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1683 microversion: 2.1 time: 0.219090 Mar 12 21:13:12.252300 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3599/4367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:12 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1683 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:12.252300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f6a6767-26b9-4ee5-9fce-2353337fcf2a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:12.252300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f6a6767-26b9-4ee5-9fce-2353337fcf2a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:12.276757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f6a6767-26b9-4ee5-9fce-2353337fcf2a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:12.277641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f6a6767-26b9-4ee5-9fce-2353337fcf2a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:12.278949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f6a6767-26b9-4ee5-9fce-2353337fcf2a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:12.279571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f6a6767-26b9-4ee5-9fce-2353337fcf2a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:12.513405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8f6a6767-26b9-4ee5-9fce-2353337fcf2a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:12.525019 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f6a6767-26b9-4ee5-9fce-2353337fcf2a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1313 microversion: 2.1 time: 0.280932 Mar 12 21:13:12.535069 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3600/4368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:12 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:12.537423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-305d92c2-2309-4710-b19f-4b8b23fcd0f1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:12.538787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-305d92c2-2309-4710-b19f-4b8b23fcd0f1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:12.554518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-305d92c2-2309-4710-b19f-4b8b23fcd0f1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:12.555198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-305d92c2-2309-4710-b19f-4b8b23fcd0f1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:12.557551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-305d92c2-2309-4710-b19f-4b8b23fcd0f1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:12.558717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-305d92c2-2309-4710-b19f-4b8b23fcd0f1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:12.618585 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-305d92c2-2309-4710-b19f-4b8b23fcd0f1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6/action" status: 200 len: 32637 microversion: 2.1 time: 0.084775 Mar 12 21:13:12.632218 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3601/4369] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:13:12 2022] POST /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6/action => generated 32637 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 21:13:12.768784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2fbf32de-1b23-40c2-9689-b6a7d411248e tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:12.769800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2fbf32de-1b23-40c2-9689-b6a7d411248e tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:12.777891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fbf32de-1b23-40c2-9689-b6a7d411248e tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:12.779298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fbf32de-1b23-40c2-9689-b6a7d411248e tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:12.780310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fbf32de-1b23-40c2-9689-b6a7d411248e tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:12.780922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fbf32de-1b23-40c2-9689-b6a7d411248e tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:12.829342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2fbf32de-1b23-40c2-9689-b6a7d411248e tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e082a08eba8f41e3b82e46f7bfc41d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa690a96e94044dbb8be9236d64b53e1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:12.831009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2fbf32de-1b23-40c2-9689-b6a7d411248e tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] flavor_id is None. Assuming migration. {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4140}} Mar 12 21:13:12.831654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2fbf32de-1b23-40c2-9689-b6a7d411248e tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 21:13:13.027329 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2fbf32de-1b23-40c2-9689-b6a7d411248e tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6/action" status: 202 len: 0 microversion: 2.1 time: 0.264149 Mar 12 21:13:13.034216 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3602/4370] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:13:12 2022] POST /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:13:13.043200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4ce94562-5cb3-4b42-97e4-1a1cefb645b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:13.044052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4ce94562-5cb3-4b42-97e4-1a1cefb645b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:13.064584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ce94562-5cb3-4b42-97e4-1a1cefb645b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:13.065428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ce94562-5cb3-4b42-97e4-1a1cefb645b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:13.065917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ce94562-5cb3-4b42-97e4-1a1cefb645b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:13.066593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ce94562-5cb3-4b42-97e4-1a1cefb645b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:13.263407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4ce94562-5cb3-4b42-97e4-1a1cefb645b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:13.272244 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4ce94562-5cb3-4b42-97e4-1a1cefb645b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1692 microversion: 2.1 time: 0.236611 Mar 12 21:13:13.272861 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3603/4371] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:13 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1692 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:13.277937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-49a4add7-c1ab-411b-947d-58d04921e442 req-e90123e7-0125-43e7-934a-985e3de0235d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094c8994-a412-4b04-bf27-848bb1d10327", "tag": "852c9a5b-4d91-452a-816e-2b2d4f90b38b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:13.291859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-49a4add7-c1ab-411b-947d-58d04921e442 req-e90123e7-0125-43e7-934a-985e3de0235d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:13.292223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-49a4add7-c1ab-411b-947d-58d04921e442 req-e90123e7-0125-43e7-934a-985e3de0235d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:13.307245 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-49a4add7-c1ab-411b-947d-58d04921e442 req-e90123e7-0125-43e7-934a-985e3de0235d service nova] Creating event network-changed:852c9a5b-4d91-452a-816e-2b2d4f90b38b for instance 094c8994-a412-4b04-bf27-848bb1d10327 on nch1-master-1 Mar 12 21:13:13.312727 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-49a4add7-c1ab-411b-947d-58d04921e442 req-e90123e7-0125-43e7-934a-985e3de0235d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038672 Mar 12 21:13:13.313466 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3604/4372] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:13:13.552903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8a3ac2e-fd8b-4392-a0b4-93087e4cdbc1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:13.555775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8a3ac2e-fd8b-4392-a0b4-93087e4cdbc1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:13.565413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a3ac2e-fd8b-4392-a0b4-93087e4cdbc1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:13.565904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a3ac2e-fd8b-4392-a0b4-93087e4cdbc1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:13.566898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a3ac2e-fd8b-4392-a0b4-93087e4cdbc1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:13.567512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a3ac2e-fd8b-4392-a0b4-93087e4cdbc1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:13.815329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c8a3ac2e-fd8b-4392-a0b4-93087e4cdbc1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:13.836526 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8a3ac2e-fd8b-4392-a0b4-93087e4cdbc1 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1313 microversion: 2.1 time: 0.297365 Mar 12 21:13:13.837144 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3605/4373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:13 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:14.290487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1d1f7cbb-75de-4f03-b44e-a49fdc8d5c7a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:14.291179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1d1f7cbb-75de-4f03-b44e-a49fdc8d5c7a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:14.298725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d1f7cbb-75de-4f03-b44e-a49fdc8d5c7a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:14.299458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d1f7cbb-75de-4f03-b44e-a49fdc8d5c7a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:14.300439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d1f7cbb-75de-4f03-b44e-a49fdc8d5c7a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:14.301067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d1f7cbb-75de-4f03-b44e-a49fdc8d5c7a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:14.438774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1d1f7cbb-75de-4f03-b44e-a49fdc8d5c7a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:14.446394 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1d1f7cbb-75de-4f03-b44e-a49fdc8d5c7a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1692 microversion: 2.1 time: 0.159907 Mar 12 21:13:14.446988 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3606/4374] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:14 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:14.856016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb665532-7ca1-4a56-b078-0b80b91f0073 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:14.857037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fb665532-7ca1-4a56-b078-0b80b91f0073 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:14.865980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb665532-7ca1-4a56-b078-0b80b91f0073 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:14.866578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb665532-7ca1-4a56-b078-0b80b91f0073 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:14.867555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb665532-7ca1-4a56-b078-0b80b91f0073 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:14.868171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb665532-7ca1-4a56-b078-0b80b91f0073 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:15.099861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fb665532-7ca1-4a56-b078-0b80b91f0073 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:15.107645 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb665532-7ca1-4a56-b078-0b80b91f0073 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1313 microversion: 2.1 time: 0.257802 Mar 12 21:13:15.108242 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3607/4375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:14 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:15.464189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-13a74f5d-19f3-46be-aa44-97194dff7fdc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:15.464847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-13a74f5d-19f3-46be-aa44-97194dff7fdc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:15.472282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13a74f5d-19f3-46be-aa44-97194dff7fdc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:15.472738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13a74f5d-19f3-46be-aa44-97194dff7fdc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:15.473504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13a74f5d-19f3-46be-aa44-97194dff7fdc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:15.473983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-13a74f5d-19f3-46be-aa44-97194dff7fdc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:15.640932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-13a74f5d-19f3-46be-aa44-97194dff7fdc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:15.648549 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-13a74f5d-19f3-46be-aa44-97194dff7fdc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1697 microversion: 2.1 time: 0.188360 Mar 12 21:13:15.649136 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3608/4376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:15 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:16.022344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1ea034e1-4b27-4bdb-84a7-51b735040d72 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:16.022852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1ea034e1-4b27-4bdb-84a7-51b735040d72 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:16.028793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ea034e1-4b27-4bdb-84a7-51b735040d72 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:16.029255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ea034e1-4b27-4bdb-84a7-51b735040d72 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:16.030065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ea034e1-4b27-4bdb-84a7-51b735040d72 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:16.030513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ea034e1-4b27-4bdb-84a7-51b735040d72 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:16.112090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-1ea034e1-4b27-4bdb-84a7-51b735040d72 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lazy-loading 'services' on Instance uuid 256e8bf0-a13c-4736-af5d-519e7bfbbc0f {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:13:16.185542 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1ea034e1-4b27-4bdb-84a7-51b735040d72 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "DELETE /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f/os-volume_attachments/fc07a109-25a4-455a-b16f-7887aa370147" status: 202 len: 0 microversion: 2.1 time: 0.166988 Mar 12 21:13:16.186222 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3609/4377] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:13:16 2022] DELETE /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f/os-volume_attachments/fc07a109-25a4-455a-b16f-7887aa370147 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:13:16.192920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6e97b896-4538-4923-85e3-73f2f540ce17 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:16.193857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6e97b896-4538-4923-85e3-73f2f540ce17 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:16.201445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e97b896-4538-4923-85e3-73f2f540ce17 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:16.202478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e97b896-4538-4923-85e3-73f2f540ce17 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:16.203600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e97b896-4538-4923-85e3-73f2f540ce17 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:16.204218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e97b896-4538-4923-85e3-73f2f540ce17 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:16.415453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6e97b896-4538-4923-85e3-73f2f540ce17 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:16.422961 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6e97b896-4538-4923-85e3-73f2f540ce17 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1313 microversion: 2.1 time: 0.235607 Mar 12 21:13:16.423547 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3610/4378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:16 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:16.666315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-93e59b6d-c014-46bd-8dd3-1d811bc6143c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:16.666967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-93e59b6d-c014-46bd-8dd3-1d811bc6143c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:16.674045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93e59b6d-c014-46bd-8dd3-1d811bc6143c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:16.674502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93e59b6d-c014-46bd-8dd3-1d811bc6143c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:16.675332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93e59b6d-c014-46bd-8dd3-1d811bc6143c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:16.675769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93e59b6d-c014-46bd-8dd3-1d811bc6143c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:16.816897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-93e59b6d-c014-46bd-8dd3-1d811bc6143c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:16.824615 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-93e59b6d-c014-46bd-8dd3-1d811bc6143c tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1697 microversion: 2.1 time: 0.162209 Mar 12 21:13:16.825291 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3611/4379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:16 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:17.327298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-87f40f4d-bb21-46da-a4ad-bcb310b8edc2 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:17.327807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-87f40f4d-bb21-46da-a4ad-bcb310b8edc2 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:17.334425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87f40f4d-bb21-46da-a4ad-bcb310b8edc2 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:17.334997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87f40f4d-bb21-46da-a4ad-bcb310b8edc2 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:17.335781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87f40f4d-bb21-46da-a4ad-bcb310b8edc2 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:17.336275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87f40f4d-bb21-46da-a4ad-bcb310b8edc2 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:17.361307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-87f40f4d-bb21-46da-a4ad-bcb310b8edc2 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:13:17.452288 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-87f40f4d-bb21-46da-a4ad-bcb310b8edc2 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "DELETE /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 204 len: 0 microversion: 2.1 time: 0.128527 Mar 12 21:13:17.457321 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3612/4380] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:13:17 2022] DELETE /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:13:17.461491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad8ddae2-baf8-4c97-9cd6-766a3923320f tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:17.462236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad8ddae2-baf8-4c97-9cd6-766a3923320f tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:17.469255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad8ddae2-baf8-4c97-9cd6-766a3923320f tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:17.470837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad8ddae2-baf8-4c97-9cd6-766a3923320f tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:17.472530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad8ddae2-baf8-4c97-9cd6-766a3923320f tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:17.473100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad8ddae2-baf8-4c97-9cd6-766a3923320f tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:17.681399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad8ddae2-baf8-4c97-9cd6-766a3923320f tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:17.690209 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad8ddae2-baf8-4c97-9cd6-766a3923320f tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1313 microversion: 2.1 time: 0.234182 Mar 12 21:13:17.691127 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3613/4381] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:17 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:17.695842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96fd43cd-f141-47ab-a292-c369663c1eed tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:17.697066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96fd43cd-f141-47ab-a292-c369663c1eed tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:17.703204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96fd43cd-f141-47ab-a292-c369663c1eed tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:17.704015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96fd43cd-f141-47ab-a292-c369663c1eed tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:17.705031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96fd43cd-f141-47ab-a292-c369663c1eed tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:17.705684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96fd43cd-f141-47ab-a292-c369663c1eed tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:17.941339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96fd43cd-f141-47ab-a292-c369663c1eed tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:17.949841 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96fd43cd-f141-47ab-a292-c369663c1eed tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1513 microversion: 2.1 time: 0.257442 Mar 12 21:13:17.950608 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3614/4382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:17 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:17.955686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49c1ab52-b6a7-429d-81b8-dcf2981c696b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:17.956438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-49c1ab52-b6a7-429d-81b8-dcf2981c696b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:17.963704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49c1ab52-b6a7-429d-81b8-dcf2981c696b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:17.964322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49c1ab52-b6a7-429d-81b8-dcf2981c696b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:17.965214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49c1ab52-b6a7-429d-81b8-dcf2981c696b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:17.965814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49c1ab52-b6a7-429d-81b8-dcf2981c696b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:18.232368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-49c1ab52-b6a7-429d-81b8-dcf2981c696b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:18.238413 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-49c1ab52-b6a7-429d-81b8-dcf2981c696b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1697 microversion: 2.1 time: 0.286417 Mar 12 21:13:18.239187 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3615/4383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:17 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1697 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:18.710422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-948e0c9e-28d3-4026-95e6-053d89c7e766 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:18.711098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-948e0c9e-28d3-4026-95e6-053d89c7e766 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:18.720832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-948e0c9e-28d3-4026-95e6-053d89c7e766 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:18.721587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-948e0c9e-28d3-4026-95e6-053d89c7e766 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:18.722474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-948e0c9e-28d3-4026-95e6-053d89c7e766 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:18.723144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-948e0c9e-28d3-4026-95e6-053d89c7e766 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:18.978620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-948e0c9e-28d3-4026-95e6-053d89c7e766 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:18.990309 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-948e0c9e-28d3-4026-95e6-053d89c7e766 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1313 microversion: 2.1 time: 0.286855 Mar 12 21:13:18.990921 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3616/4384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:18 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:18.995927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ac5e45b-7d62-4b71-8e8d-c0218cfddeee tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:18.996550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ac5e45b-7d62-4b71-8e8d-c0218cfddeee tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:19.004157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ac5e45b-7d62-4b71-8e8d-c0218cfddeee tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:19.004629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ac5e45b-7d62-4b71-8e8d-c0218cfddeee tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:19.005427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ac5e45b-7d62-4b71-8e8d-c0218cfddeee tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:19.005911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ac5e45b-7d62-4b71-8e8d-c0218cfddeee tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:19.234330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ac5e45b-7d62-4b71-8e8d-c0218cfddeee tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:19.245593 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ac5e45b-7d62-4b71-8e8d-c0218cfddeee tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1513 microversion: 2.1 time: 0.253448 Mar 12 21:13:19.246433 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3617/4385] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:18 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:19.256591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-458b0e00-06ee-4aa7-83a1-50372429e904 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:19.257217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-458b0e00-06ee-4aa7-83a1-50372429e904 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:19.263877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-458b0e00-06ee-4aa7-83a1-50372429e904 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:19.264699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-458b0e00-06ee-4aa7-83a1-50372429e904 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:19.266545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-458b0e00-06ee-4aa7-83a1-50372429e904 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:19.267011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-458b0e00-06ee-4aa7-83a1-50372429e904 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:19.424462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-458b0e00-06ee-4aa7-83a1-50372429e904 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:19.432372 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-458b0e00-06ee-4aa7-83a1-50372429e904 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1697 microversion: 2.1 time: 0.180842 Mar 12 21:13:19.432980 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3618/4386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:19 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:20.010116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-54301cbe-51a0-4c57-a126-5de397ce0fd6 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:20.010778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-54301cbe-51a0-4c57-a126-5de397ce0fd6 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:20.020314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54301cbe-51a0-4c57-a126-5de397ce0fd6 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:20.023405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54301cbe-51a0-4c57-a126-5de397ce0fd6 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:20.024748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54301cbe-51a0-4c57-a126-5de397ce0fd6 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:20.025273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54301cbe-51a0-4c57-a126-5de397ce0fd6 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:20.193249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-54301cbe-51a0-4c57-a126-5de397ce0fd6 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:20.201821 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-54301cbe-51a0-4c57-a126-5de397ce0fd6 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1313 microversion: 2.1 time: 0.198416 Mar 12 21:13:20.202558 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3619/4387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:20 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:20.270736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6e711c81-eaaa-42c5-a4f3-538127e4c9d6 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:20.271594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6e711c81-eaaa-42c5-a4f3-538127e4c9d6 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:20.279478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e711c81-eaaa-42c5-a4f3-538127e4c9d6 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:20.280275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e711c81-eaaa-42c5-a4f3-538127e4c9d6 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:20.281392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e711c81-eaaa-42c5-a4f3-538127e4c9d6 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:20.282603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e711c81-eaaa-42c5-a4f3-538127e4c9d6 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:20.363848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6e711c81-eaaa-42c5-a4f3-538127e4c9d6 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:20.384617 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6e711c81-eaaa-42c5-a4f3-538127e4c9d6 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 200 len: 1471 microversion: 2.1 time: 0.124946 Mar 12 21:13:20.385718 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3620/4388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:20 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 1471 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:20.393816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2bc60bb3-b105-4714-8283-fb0f07ff22c0 req-e1ec0f45-cd3f-4218-8393-54fe6690ee65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "256e8bf0-a13c-4736-af5d-519e7bfbbc0f", "name": "network-vif-deleted", "tag": "4ce3d584-edf2-4a97-a6bb-8b8b56dfd1d4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:20.412780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2bc60bb3-b105-4714-8283-fb0f07ff22c0 req-e1ec0f45-cd3f-4218-8393-54fe6690ee65 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:20.413502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2bc60bb3-b105-4714-8283-fb0f07ff22c0 req-e1ec0f45-cd3f-4218-8393-54fe6690ee65 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:20.433625 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2bc60bb3-b105-4714-8283-fb0f07ff22c0 req-e1ec0f45-cd3f-4218-8393-54fe6690ee65 service nova] Creating event network-vif-deleted:4ce3d584-edf2-4a97-a6bb-8b8b56dfd1d4 for instance 256e8bf0-a13c-4736-af5d-519e7bfbbc0f on nch1-master-1 Mar 12 21:13:20.442268 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2bc60bb3-b105-4714-8283-fb0f07ff22c0 req-e1ec0f45-cd3f-4218-8393-54fe6690ee65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054878 Mar 12 21:13:20.443000 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3621/4389] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:13:20.453954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9c0a2853-e276-4ad5-a78e-b4847fb3fcc3 req-c9eb126d-67f1-4dd1-8eb2-ca5dcd86ff51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094c8994-a412-4b04-bf27-848bb1d10327", "name": "network-vif-plugged", "status": "completed", "tag": "852c9a5b-4d91-452a-816e-2b2d4f90b38b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:20.465442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9c0a2853-e276-4ad5-a78e-b4847fb3fcc3 req-c9eb126d-67f1-4dd1-8eb2-ca5dcd86ff51 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:20.466100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9c0a2853-e276-4ad5-a78e-b4847fb3fcc3 req-c9eb126d-67f1-4dd1-8eb2-ca5dcd86ff51 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:20.477859 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9c0a2853-e276-4ad5-a78e-b4847fb3fcc3 req-c9eb126d-67f1-4dd1-8eb2-ca5dcd86ff51 service nova] Creating event network-vif-plugged:852c9a5b-4d91-452a-816e-2b2d4f90b38b for instance 094c8994-a412-4b04-bf27-848bb1d10327 on nch1-master-1 Mar 12 21:13:20.486006 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9c0a2853-e276-4ad5-a78e-b4847fb3fcc3 req-c9eb126d-67f1-4dd1-8eb2-ca5dcd86ff51 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039740 Mar 12 21:13:20.487659 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3622/4390] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:13:20.495843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d59d0283-16a0-4674-ad4e-95cd7c2beae8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:20.496824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d59d0283-16a0-4674-ad4e-95cd7c2beae8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:20.505400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d59d0283-16a0-4674-ad4e-95cd7c2beae8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:20.505901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d59d0283-16a0-4674-ad4e-95cd7c2beae8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:20.506702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d59d0283-16a0-4674-ad4e-95cd7c2beae8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:20.507147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d59d0283-16a0-4674-ad4e-95cd7c2beae8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:20.731667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d59d0283-16a0-4674-ad4e-95cd7c2beae8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:20.740806 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d59d0283-16a0-4674-ad4e-95cd7c2beae8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1697 microversion: 2.1 time: 0.251605 Mar 12 21:13:20.742047 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3623/4391] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:20 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1697 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:21.219143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5677711d-e0eb-443f-9938-66430cd20360 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:21.221001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5677711d-e0eb-443f-9938-66430cd20360 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:21.228379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5677711d-e0eb-443f-9938-66430cd20360 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:21.229290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5677711d-e0eb-443f-9938-66430cd20360 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:21.230307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5677711d-e0eb-443f-9938-66430cd20360 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:21.230918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5677711d-e0eb-443f-9938-66430cd20360 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:21.401388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5677711d-e0eb-443f-9938-66430cd20360 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:21.409598 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5677711d-e0eb-443f-9938-66430cd20360 tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1313 microversion: 2.1 time: 0.194324 Mar 12 21:13:21.410867 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3624/4392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:21 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:21.416527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b71d8a5f-1d9e-4302-8e71-35a7eeb44749 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:21.417458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b71d8a5f-1d9e-4302-8e71-35a7eeb44749 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: 256e8bf0-a13c-4736-af5d-519e7bfbbc0f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:21.424192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b71d8a5f-1d9e-4302-8e71-35a7eeb44749 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:21.424651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b71d8a5f-1d9e-4302-8e71-35a7eeb44749 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:21.425442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b71d8a5f-1d9e-4302-8e71-35a7eeb44749 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:21.425918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b71d8a5f-1d9e-4302-8e71-35a7eeb44749 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:21.442905 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b71d8a5f-1d9e-4302-8e71-35a7eeb44749 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] HTTP exception thrown: Instance 256e8bf0-a13c-4736-af5d-519e7bfbbc0f could not be found. Mar 12 21:13:21.443521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b71d8a5f-1d9e-4302-8e71-35a7eeb44749 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Returning 404 to user: Instance 256e8bf0-a13c-4736-af5d-519e7bfbbc0f could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:13:21.444370 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b71d8a5f-1d9e-4302-8e71-35a7eeb44749 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f" status: 404 len: 111 microversion: 2.1 time: 0.032343 Mar 12 21:13:21.445096 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3625/4393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:21 2022] GET /compute/v2.1/servers/256e8bf0-a13c-4736-af5d-519e7bfbbc0f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:13:21.759326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96f97a25-8817-4000-9fdc-9157fc743ec1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:21.759821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96f97a25-8817-4000-9fdc-9157fc743ec1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:21.768101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96f97a25-8817-4000-9fdc-9157fc743ec1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:21.771069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96f97a25-8817-4000-9fdc-9157fc743ec1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:21.772114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96f97a25-8817-4000-9fdc-9157fc743ec1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:21.772742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96f97a25-8817-4000-9fdc-9157fc743ec1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:22.020737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96f97a25-8817-4000-9fdc-9157fc743ec1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:22.035466 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96f97a25-8817-4000-9fdc-9157fc743ec1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1697 microversion: 2.1 time: 0.280335 Mar 12 21:13:22.045163 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3626/4394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:21 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1697 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:22.428484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a95d349-99a3-4dda-802c-dd802070a4bc tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:22.429845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a95d349-99a3-4dda-802c-dd802070a4bc tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:22.438494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a95d349-99a3-4dda-802c-dd802070a4bc tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:22.439199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a95d349-99a3-4dda-802c-dd802070a4bc tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:22.440265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a95d349-99a3-4dda-802c-dd802070a4bc tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:22.441422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a95d349-99a3-4dda-802c-dd802070a4bc tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:22.679596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8a95d349-99a3-4dda-802c-dd802070a4bc tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:22.688814 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a95d349-99a3-4dda-802c-dd802070a4bc tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1496 microversion: 2.1 time: 0.264906 Mar 12 21:13:22.690217 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3627/4395] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:22 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1496 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:23.056029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ac298297-a909-4a27-9e08-1c94375ff6b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:23.056860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ac298297-a909-4a27-9e08-1c94375ff6b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:23.067334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac298297-a909-4a27-9e08-1c94375ff6b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:23.073351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac298297-a909-4a27-9e08-1c94375ff6b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:23.074949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac298297-a909-4a27-9e08-1c94375ff6b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:23.078060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac298297-a909-4a27-9e08-1c94375ff6b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:23.309292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ac298297-a909-4a27-9e08-1c94375ff6b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:23.327351 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ac298297-a909-4a27-9e08-1c94375ff6b6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1697 microversion: 2.1 time: 0.274724 Mar 12 21:13:23.330318 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3628/4396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:23 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1697 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:23.335588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d310b16-021d-4901-bfb9-381769eb858a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:23.336349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d310b16-021d-4901-bfb9-381769eb858a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:23.343491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d310b16-021d-4901-bfb9-381769eb858a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:23.344595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d310b16-021d-4901-bfb9-381769eb858a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:23.345391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d310b16-021d-4901-bfb9-381769eb858a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:23.346069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d310b16-021d-4901-bfb9-381769eb858a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:23.382097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d310b16-021d-4901-bfb9-381769eb858a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:13:23.488477 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d310b16-021d-4901-bfb9-381769eb858a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "DELETE /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 204 len: 0 microversion: 2.1 time: 0.156411 Mar 12 21:13:23.490616 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3629/4397] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:13:23 2022] DELETE /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:13:23.503916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7c4de2d-cee1-4878-a72b-53947925de7e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:23.504760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e7c4de2d-cee1-4878-a72b-53947925de7e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:23.511697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7c4de2d-cee1-4878-a72b-53947925de7e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:23.512166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7c4de2d-cee1-4878-a72b-53947925de7e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:23.512967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7c4de2d-cee1-4878-a72b-53947925de7e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:23.513420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7c4de2d-cee1-4878-a72b-53947925de7e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:23.669484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e7c4de2d-cee1-4878-a72b-53947925de7e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:23.682016 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e7c4de2d-cee1-4878-a72b-53947925de7e tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1502 microversion: 2.1 time: 0.182554 Mar 12 21:13:23.682016 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3630/4398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:23 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:24.341800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8cc15cbc-34c4-4e4b-b4e2-1ba456244eea tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:24.342460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8cc15cbc-34c4-4e4b-b4e2-1ba456244eea tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:24.349296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cc15cbc-34c4-4e4b-b4e2-1ba456244eea tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:24.349758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cc15cbc-34c4-4e4b-b4e2-1ba456244eea tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:24.350584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cc15cbc-34c4-4e4b-b4e2-1ba456244eea tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:24.351210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cc15cbc-34c4-4e4b-b4e2-1ba456244eea tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:24.580235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8cc15cbc-34c4-4e4b-b4e2-1ba456244eea tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:24.587560 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8cc15cbc-34c4-4e4b-b4e2-1ba456244eea tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1697 microversion: 2.1 time: 0.249629 Mar 12 21:13:24.588139 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3631/4399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:24 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1697 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:24.696309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5346ecb0-9485-4fe7-b735-67f8203013ec tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:24.696847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5346ecb0-9485-4fe7-b735-67f8203013ec tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:24.703504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5346ecb0-9485-4fe7-b735-67f8203013ec tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:24.704045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5346ecb0-9485-4fe7-b735-67f8203013ec tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:24.704893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5346ecb0-9485-4fe7-b735-67f8203013ec tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:24.705349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5346ecb0-9485-4fe7-b735-67f8203013ec tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:25.425039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5346ecb0-9485-4fe7-b735-67f8203013ec tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbb67154fb040359bf0c5460995d665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5723877279b461baac745c825906ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:25.433501 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5346ecb0-9485-4fe7-b735-67f8203013ec tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 200 len: 1502 microversion: 2.1 time: 0.741299 Mar 12 21:13:25.434320 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3632/4400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:24 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 1502 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:25.604656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa20d404-d61e-4503-a255-6dec7fe09f81 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:25.605373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aa20d404-d61e-4503-a255-6dec7fe09f81 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:25.615002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa20d404-d61e-4503-a255-6dec7fe09f81 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:25.615554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa20d404-d61e-4503-a255-6dec7fe09f81 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:25.616503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa20d404-d61e-4503-a255-6dec7fe09f81 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:25.617282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa20d404-d61e-4503-a255-6dec7fe09f81 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:25.882614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aa20d404-d61e-4503-a255-6dec7fe09f81 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:25.891016 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aa20d404-d61e-4503-a255-6dec7fe09f81 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1697 microversion: 2.1 time: 0.290320 Mar 12 21:13:25.892182 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3633/4401] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:25 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1697 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:25.897405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-07e0b345-8738-4d88-8ef3-77453ded67eb req-45189fda-3d9c-4457-8eda-5acf46d677d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094c8994-a412-4b04-bf27-848bb1d10327", "name": "network-vif-deleted", "tag": "852c9a5b-4d91-452a-816e-2b2d4f90b38b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:25.907710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-07e0b345-8738-4d88-8ef3-77453ded67eb req-45189fda-3d9c-4457-8eda-5acf46d677d4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:25.908172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-07e0b345-8738-4d88-8ef3-77453ded67eb req-45189fda-3d9c-4457-8eda-5acf46d677d4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:25.920603 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-07e0b345-8738-4d88-8ef3-77453ded67eb req-45189fda-3d9c-4457-8eda-5acf46d677d4 service nova] Creating event network-vif-deleted:852c9a5b-4d91-452a-816e-2b2d4f90b38b for instance 094c8994-a412-4b04-bf27-848bb1d10327 on nch1-master-1 Mar 12 21:13:25.927002 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-07e0b345-8738-4d88-8ef3-77453ded67eb req-45189fda-3d9c-4457-8eda-5acf46d677d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033027 Mar 12 21:13:25.932930 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3634/4402] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:13:26.452086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-84eb8942-d5d2-40ca-bfcd-81933a6cbe9a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:26.452810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-84eb8942-d5d2-40ca-bfcd-81933a6cbe9a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] [instance: 094c8994-a412-4b04-bf27-848bb1d10327] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:26.459287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84eb8942-d5d2-40ca-bfcd-81933a6cbe9a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:26.459696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84eb8942-d5d2-40ca-bfcd-81933a6cbe9a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:26.460685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84eb8942-d5d2-40ca-bfcd-81933a6cbe9a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:26.461306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84eb8942-d5d2-40ca-bfcd-81933a6cbe9a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:26.495065 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-84eb8942-d5d2-40ca-bfcd-81933a6cbe9a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] HTTP exception thrown: Instance 094c8994-a412-4b04-bf27-848bb1d10327 could not be found. Mar 12 21:13:26.495786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-84eb8942-d5d2-40ca-bfcd-81933a6cbe9a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] Returning 404 to user: Instance 094c8994-a412-4b04-bf27-848bb1d10327 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:13:26.496697 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-84eb8942-d5d2-40ca-bfcd-81933a6cbe9a tempest-VolumesActionsTest-192579851 tempest-VolumesActionsTest-192579851-project] 10.222.0.30 "GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327" status: 404 len: 111 microversion: 2.1 time: 0.049008 Mar 12 21:13:26.497291 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3635/4403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:26 2022] GET /compute/v2.1/servers/094c8994-a412-4b04-bf27-848bb1d10327 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:13:26.910517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c0a9bb38-5b07-4be1-9e97-dd415fd8eb5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:26.911203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c0a9bb38-5b07-4be1-9e97-dd415fd8eb5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:26.918412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0a9bb38-5b07-4be1-9e97-dd415fd8eb5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:26.919138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0a9bb38-5b07-4be1-9e97-dd415fd8eb5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:26.920122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0a9bb38-5b07-4be1-9e97-dd415fd8eb5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:26.920734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0a9bb38-5b07-4be1-9e97-dd415fd8eb5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:27.125387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0a9bb38-5b07-4be1-9e97-dd415fd8eb5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:27.142430 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c0a9bb38-5b07-4be1-9e97-dd415fd8eb5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1697 microversion: 2.1 time: 0.229650 Mar 12 21:13:27.142430 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3636/4404] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:26 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1697 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:27.386162 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:13:27.386662 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:13:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:13:27.525226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-469331209", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "757f12d3-fb2b-477f-a322-e3b1ba86aa1f"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:27.620397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] validate_networks() for [('757f12d3-fb2b-477f-a322-e3b1ba86aa1f', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:13:28.701350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:13:28.701906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:13:28.702263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:13:28.702682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:13:28.703104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:13:28.742304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:28.742852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:28.743948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:28.744412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:28.795253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Getting quotas for project d30a0195c6334b39a246a88b1f4cc81f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:13:28.801114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Getting quotas for user 96d0c07fcae34c48b4c0ed61c4cec1c2 and project d30a0195c6334b39a246a88b1f4cc81f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:13:28.816757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:13:28.819559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:13:28.922154 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-424f4946-64e9-46eb-9850-f600e458a964 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402534 Mar 12 21:13:28.935744 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3637/4405] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:13:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:13:28.942563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39a34997-0e90-40f1-a74d-9f20734d97d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:28.948158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39a34997-0e90-40f1-a74d-9f20734d97d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:28.963034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39a34997-0e90-40f1-a74d-9f20734d97d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:28.963487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39a34997-0e90-40f1-a74d-9f20734d97d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:28.964482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39a34997-0e90-40f1-a74d-9f20734d97d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:28.965460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39a34997-0e90-40f1-a74d-9f20734d97d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:29.489216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39a34997-0e90-40f1-a74d-9f20734d97d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:29.498141 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39a34997-0e90-40f1-a74d-9f20734d97d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1696 microversion: 2.1 time: 0.560992 Mar 12 21:13:29.513107 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3638/4406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:28 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1696 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:29.518681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-36c8414a-3e38-4d44-8e9f-35eaf2839c5e req-c44ed438-6a58-4af4-8224-abb7ffe71bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c852e33-59fa-408e-ae85-2db0fb6a96a6", "name": "network-vif-unplugged", "status": "completed", "tag": "cd8b144c-540d-432c-afe3-8cbec9f808a3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:29.554015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-36c8414a-3e38-4d44-8e9f-35eaf2839c5e req-c44ed438-6a58-4af4-8224-abb7ffe71bd1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:29.555367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-36c8414a-3e38-4d44-8e9f-35eaf2839c5e req-c44ed438-6a58-4af4-8224-abb7ffe71bd1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:29.587791 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-36c8414a-3e38-4d44-8e9f-35eaf2839c5e req-c44ed438-6a58-4af4-8224-abb7ffe71bd1 service nova] Creating event network-vif-unplugged:cd8b144c-540d-432c-afe3-8cbec9f808a3 for instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 on nch1-master-1 Mar 12 21:13:29.603524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-36c8414a-3e38-4d44-8e9f-35eaf2839c5e req-c44ed438-6a58-4af4-8224-abb7ffe71bd1 service nova] Instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:13:29.650549 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-36c8414a-3e38-4d44-8e9f-35eaf2839c5e req-c44ed438-6a58-4af4-8224-abb7ffe71bd1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134638 Mar 12 21:13:29.651581 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3639/4407] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:13:29.668396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b30c6de-8384-4acd-b8aa-8052767af62f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:29.670062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3b30c6de-8384-4acd-b8aa-8052767af62f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:29.821847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3b30c6de-8384-4acd-b8aa-8052767af62f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:29.839825 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b30c6de-8384-4acd-b8aa-8052767af62f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1218 microversion: 2.1 time: 0.185381 Mar 12 21:13:29.840470 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3640/4408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:29 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1218 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:30.516222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4de3936a-5ba9-4673-8ad0-afe5c6e2cfb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:30.517178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4de3936a-5ba9-4673-8ad0-afe5c6e2cfb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:30.540267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4de3936a-5ba9-4673-8ad0-afe5c6e2cfb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:30.541003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4de3936a-5ba9-4673-8ad0-afe5c6e2cfb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:30.542044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4de3936a-5ba9-4673-8ad0-afe5c6e2cfb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:30.542656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4de3936a-5ba9-4673-8ad0-afe5c6e2cfb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:30.844580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4de3936a-5ba9-4673-8ad0-afe5c6e2cfb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:30.859298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4de3936a-5ba9-4673-8ad0-afe5c6e2cfb2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1696 microversion: 2.1 time: 0.345184 Mar 12 21:13:30.860698 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3641/4409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:30 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1696 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:30.882469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0329fe31-1f9f-48ff-93b7-95618ea6a98b tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:30.884595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0329fe31-1f9f-48ff-93b7-95618ea6a98b tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:30.901075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0329fe31-1f9f-48ff-93b7-95618ea6a98b tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:30.901540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0329fe31-1f9f-48ff-93b7-95618ea6a98b tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:30.902375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0329fe31-1f9f-48ff-93b7-95618ea6a98b tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:30.902828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0329fe31-1f9f-48ff-93b7-95618ea6a98b tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:31.008348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0329fe31-1f9f-48ff-93b7-95618ea6a98b tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:31.031283 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0329fe31-1f9f-48ff-93b7-95618ea6a98b tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1276 microversion: 2.1 time: 0.158286 Mar 12 21:13:31.033396 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3642/4410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:30 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:31.877956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2972e795-1809-4d5e-92bb-9e1310a6bd20 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:31.879094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2972e795-1809-4d5e-92bb-9e1310a6bd20 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:31.894894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2972e795-1809-4d5e-92bb-9e1310a6bd20 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:31.895355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2972e795-1809-4d5e-92bb-9e1310a6bd20 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:31.899620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2972e795-1809-4d5e-92bb-9e1310a6bd20 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:31.900091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2972e795-1809-4d5e-92bb-9e1310a6bd20 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:32.382137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2972e795-1809-4d5e-92bb-9e1310a6bd20 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:32.408670 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2972e795-1809-4d5e-92bb-9e1310a6bd20 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1694 microversion: 2.1 time: 0.535218 Mar 12 21:13:32.423536 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3643/4411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:31 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1694 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:32.431932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9028a41-9bb8-43fb-bd91-2ed84776c4ac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:32.432563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9028a41-9bb8-43fb-bd91-2ed84776c4ac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:32.448053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9028a41-9bb8-43fb-bd91-2ed84776c4ac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:32.448403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9028a41-9bb8-43fb-bd91-2ed84776c4ac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:32.449514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9028a41-9bb8-43fb-bd91-2ed84776c4ac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:32.449988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9028a41-9bb8-43fb-bd91-2ed84776c4ac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:32.985642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9028a41-9bb8-43fb-bd91-2ed84776c4ac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:32.998496 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9028a41-9bb8-43fb-bd91-2ed84776c4ac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1318 microversion: 2.1 time: 0.573433 Mar 12 21:13:33.001953 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3644/4412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:32 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:33.009487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0150af7e-5aeb-44e8-a3d4-9afa67e7ee90 req-f220b790-ad20-49da-a158-539df486a505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c852e33-59fa-408e-ae85-2db0fb6a96a6", "tag": "cd8b144c-540d-432c-afe3-8cbec9f808a3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:33.026785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0150af7e-5aeb-44e8-a3d4-9afa67e7ee90 req-f220b790-ad20-49da-a158-539df486a505 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:33.027237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0150af7e-5aeb-44e8-a3d4-9afa67e7ee90 req-f220b790-ad20-49da-a158-539df486a505 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:33.046529 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0150af7e-5aeb-44e8-a3d4-9afa67e7ee90 req-f220b790-ad20-49da-a158-539df486a505 service nova] Creating event network-changed:cd8b144c-540d-432c-afe3-8cbec9f808a3 for instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 on nch1-master-1 Mar 12 21:13:33.059622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-0150af7e-5aeb-44e8-a3d4-9afa67e7ee90 req-f220b790-ad20-49da-a158-539df486a505 service nova] Instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:13:33.082390 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0150af7e-5aeb-44e8-a3d4-9afa67e7ee90 req-f220b790-ad20-49da-a158-539df486a505 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077260 Mar 12 21:13:33.088287 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3645/4413] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:13:33.427469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f8fdcb41-10c6-4af0-b810-c217b180cb63 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:33.428785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f8fdcb41-10c6-4af0-b810-c217b180cb63 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:33.455269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8fdcb41-10c6-4af0-b810-c217b180cb63 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:33.458691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8fdcb41-10c6-4af0-b810-c217b180cb63 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:33.462053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8fdcb41-10c6-4af0-b810-c217b180cb63 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:33.463861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8fdcb41-10c6-4af0-b810-c217b180cb63 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:34.084439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f8fdcb41-10c6-4af0-b810-c217b180cb63 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:34.098240 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f8fdcb41-10c6-4af0-b810-c217b180cb63 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1694 microversion: 2.1 time: 0.675497 Mar 12 21:13:34.100792 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3646/4414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:33 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1694 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:34.114344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d95563d8-8b56-40b2-b7d9-53cb825b1965 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:34.119526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d95563d8-8b56-40b2-b7d9-53cb825b1965 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:34.133838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d95563d8-8b56-40b2-b7d9-53cb825b1965 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:34.134607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d95563d8-8b56-40b2-b7d9-53cb825b1965 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:34.135670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d95563d8-8b56-40b2-b7d9-53cb825b1965 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:34.138087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d95563d8-8b56-40b2-b7d9-53cb825b1965 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:34.625503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d95563d8-8b56-40b2-b7d9-53cb825b1965 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:34.662177 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d95563d8-8b56-40b2-b7d9-53cb825b1965 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1318 microversion: 2.1 time: 0.559374 Mar 12 21:13:34.670885 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3647/4415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:34 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1318 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:35.114085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2cf8279a-b2ea-428f-bf04-b58fd470a76e req-4b17b26b-b861-4e83-ba42-39c2d124c724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64431cf-644f-47c1-86eb-e1d12fda3937", "tag": "4629a6c8-95f0-4db6-9469-6b2d64c02fb4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:35.131661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2cf8279a-b2ea-428f-bf04-b58fd470a76e req-4b17b26b-b861-4e83-ba42-39c2d124c724 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:35.133523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2cf8279a-b2ea-428f-bf04-b58fd470a76e req-4b17b26b-b861-4e83-ba42-39c2d124c724 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:35.148915 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2cf8279a-b2ea-428f-bf04-b58fd470a76e req-4b17b26b-b861-4e83-ba42-39c2d124c724 service nova] Creating event network-changed:4629a6c8-95f0-4db6-9469-6b2d64c02fb4 for instance f64431cf-644f-47c1-86eb-e1d12fda3937 on nch1-master-1 Mar 12 21:13:35.163731 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2cf8279a-b2ea-428f-bf04-b58fd470a76e req-4b17b26b-b861-4e83-ba42-39c2d124c724 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054152 Mar 12 21:13:35.165757 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3648/4416] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:13:35.176321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af7e87fb-2313-4338-8110-0a8cdf7777df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:35.179862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af7e87fb-2313-4338-8110-0a8cdf7777df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:35.190919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af7e87fb-2313-4338-8110-0a8cdf7777df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:35.191530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af7e87fb-2313-4338-8110-0a8cdf7777df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:35.192427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af7e87fb-2313-4338-8110-0a8cdf7777df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:35.193282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af7e87fb-2313-4338-8110-0a8cdf7777df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:35.630082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-af7e87fb-2313-4338-8110-0a8cdf7777df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:35.638083 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af7e87fb-2313-4338-8110-0a8cdf7777df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1691 microversion: 2.1 time: 0.467860 Mar 12 21:13:35.641924 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3649/4417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:35 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1691 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:35.654154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-810e5fa8-d2c3-4cad-9207-e9a51df37c61 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:35.654712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-810e5fa8-d2c3-4cad-9207-e9a51df37c61 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:35.669446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810e5fa8-d2c3-4cad-9207-e9a51df37c61 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:35.669950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810e5fa8-d2c3-4cad-9207-e9a51df37c61 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:35.670748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810e5fa8-d2c3-4cad-9207-e9a51df37c61 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:35.671192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810e5fa8-d2c3-4cad-9207-e9a51df37c61 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:36.000042 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-810e5fa8-d2c3-4cad-9207-e9a51df37c61 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6/action" status: 202 len: 0 microversion: 2.1 time: 0.349504 Mar 12 21:13:36.004279 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3650/4418] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:13:35 2022] POST /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:13:36.019262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3a6d946b-765f-49d4-a509-dbde6df45cbe tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:36.020125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3a6d946b-765f-49d4-a509-dbde6df45cbe tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:36.038825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a6d946b-765f-49d4-a509-dbde6df45cbe tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:36.039100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a6d946b-765f-49d4-a509-dbde6df45cbe tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:36.042124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a6d946b-765f-49d4-a509-dbde6df45cbe tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:36.042595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a6d946b-765f-49d4-a509-dbde6df45cbe tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:36.658174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3a6d946b-765f-49d4-a509-dbde6df45cbe tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:36.670632 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3a6d946b-765f-49d4-a509-dbde6df45cbe tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1318 microversion: 2.1 time: 0.665052 Mar 12 21:13:36.674515 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3651/4419] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:36 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:36.691273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c6a9656-a0f9-4cc3-8ab2-fbac7643b17d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:36.694116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c6a9656-a0f9-4cc3-8ab2-fbac7643b17d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:36.703210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c6a9656-a0f9-4cc3-8ab2-fbac7643b17d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:36.703815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c6a9656-a0f9-4cc3-8ab2-fbac7643b17d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:36.704727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c6a9656-a0f9-4cc3-8ab2-fbac7643b17d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:36.705277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c6a9656-a0f9-4cc3-8ab2-fbac7643b17d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:37.064076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0c6a9656-a0f9-4cc3-8ab2-fbac7643b17d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:37.074756 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c6a9656-a0f9-4cc3-8ab2-fbac7643b17d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1690 microversion: 2.1 time: 0.398387 Mar 12 21:13:37.082737 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3652/4420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:36 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1690 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:37.688387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5982e1c2-168a-4d2d-b1e9-029e88bf5fce tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:37.689009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5982e1c2-168a-4d2d-b1e9-029e88bf5fce tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:37.698069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5982e1c2-168a-4d2d-b1e9-029e88bf5fce tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:37.698527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5982e1c2-168a-4d2d-b1e9-029e88bf5fce tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:37.699316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5982e1c2-168a-4d2d-b1e9-029e88bf5fce tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:37.699765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5982e1c2-168a-4d2d-b1e9-029e88bf5fce tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:37.998695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5982e1c2-168a-4d2d-b1e9-029e88bf5fce tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:38.011346 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5982e1c2-168a-4d2d-b1e9-029e88bf5fce tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1318 microversion: 2.1 time: 0.326724 Mar 12 21:13:38.012212 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3653/4421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:37 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:38.099979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27b0832f-b6df-4264-a7d9-0e1cd1b8a8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:38.100609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27b0832f-b6df-4264-a7d9-0e1cd1b8a8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:38.116861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27b0832f-b6df-4264-a7d9-0e1cd1b8a8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:38.122354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27b0832f-b6df-4264-a7d9-0e1cd1b8a8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:38.123225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27b0832f-b6df-4264-a7d9-0e1cd1b8a8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:38.123682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27b0832f-b6df-4264-a7d9-0e1cd1b8a8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:38.379297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27b0832f-b6df-4264-a7d9-0e1cd1b8a8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:38.398171 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27b0832f-b6df-4264-a7d9-0e1cd1b8a8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1690 microversion: 2.1 time: 0.302269 Mar 12 21:13:38.409503 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3654/4422] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:38 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1690 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:38.415879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-917f7580-6322-4e39-a402-00bd7a9eac64 req-c963c688-5fc0-4db3-8e3f-82078f0c1560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c852e33-59fa-408e-ae85-2db0fb6a96a6", "name": "network-vif-plugged", "status": "completed", "tag": "cd8b144c-540d-432c-afe3-8cbec9f808a3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:38.433544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-917f7580-6322-4e39-a402-00bd7a9eac64 req-c963c688-5fc0-4db3-8e3f-82078f0c1560 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:38.435217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-917f7580-6322-4e39-a402-00bd7a9eac64 req-c963c688-5fc0-4db3-8e3f-82078f0c1560 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:38.453586 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-917f7580-6322-4e39-a402-00bd7a9eac64 req-c963c688-5fc0-4db3-8e3f-82078f0c1560 service nova] Creating event network-vif-plugged:cd8b144c-540d-432c-afe3-8cbec9f808a3 for instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 on nch1-master-1 Mar 12 21:13:38.462887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-917f7580-6322-4e39-a402-00bd7a9eac64 req-c963c688-5fc0-4db3-8e3f-82078f0c1560 service nova] Instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:13:38.492620 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-917f7580-6322-4e39-a402-00bd7a9eac64 req-c963c688-5fc0-4db3-8e3f-82078f0c1560 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079518 Mar 12 21:13:38.493468 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3655/4423] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:13:39.030126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e3e1fe0-4cbc-4c4d-8847-924fed7b1f6f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:39.032211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e3e1fe0-4cbc-4c4d-8847-924fed7b1f6f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:39.042755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e3e1fe0-4cbc-4c4d-8847-924fed7b1f6f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:39.043354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e3e1fe0-4cbc-4c4d-8847-924fed7b1f6f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:39.044253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e3e1fe0-4cbc-4c4d-8847-924fed7b1f6f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:39.045492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e3e1fe0-4cbc-4c4d-8847-924fed7b1f6f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:39.389114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8e3e1fe0-4cbc-4c4d-8847-924fed7b1f6f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:39.408675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8e3e1fe0-4cbc-4c4d-8847-924fed7b1f6f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1318 microversion: 2.1 time: 0.383460 Mar 12 21:13:39.422585 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3656/4424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:39 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:39.428609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec7f4e1f-f0c0-4e1c-a2bc-2d441a7af14a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:39.429510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec7f4e1f-f0c0-4e1c-a2bc-2d441a7af14a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:39.436321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec7f4e1f-f0c0-4e1c-a2bc-2d441a7af14a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:39.436791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec7f4e1f-f0c0-4e1c-a2bc-2d441a7af14a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:39.437654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec7f4e1f-f0c0-4e1c-a2bc-2d441a7af14a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:39.438152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec7f4e1f-f0c0-4e1c-a2bc-2d441a7af14a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:39.734883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ec7f4e1f-f0c0-4e1c-a2bc-2d441a7af14a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:39.746920 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec7f4e1f-f0c0-4e1c-a2bc-2d441a7af14a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1690 microversion: 2.1 time: 0.322798 Mar 12 21:13:39.747501 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3657/4425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:39 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1690 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:40.428778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a4c234a-892a-4423-8658-12213954f55f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:40.430198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a4c234a-892a-4423-8658-12213954f55f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:40.441920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a4c234a-892a-4423-8658-12213954f55f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:40.442797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a4c234a-892a-4423-8658-12213954f55f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:40.452317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a4c234a-892a-4423-8658-12213954f55f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:40.452858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a4c234a-892a-4423-8658-12213954f55f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:40.659464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5a4c234a-892a-4423-8658-12213954f55f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:40.669748 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a4c234a-892a-4423-8658-12213954f55f tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1318 microversion: 2.1 time: 0.245020 Mar 12 21:13:40.671034 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3658/4426] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:40 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:40.769027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-caaf2bbe-3f18-49aa-9668-a5bda6c5f5e1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:40.769975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-caaf2bbe-3f18-49aa-9668-a5bda6c5f5e1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:40.779251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caaf2bbe-3f18-49aa-9668-a5bda6c5f5e1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:40.780459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caaf2bbe-3f18-49aa-9668-a5bda6c5f5e1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:40.785050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caaf2bbe-3f18-49aa-9668-a5bda6c5f5e1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:40.785749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caaf2bbe-3f18-49aa-9668-a5bda6c5f5e1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:41.056893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-caaf2bbe-3f18-49aa-9668-a5bda6c5f5e1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:41.068984 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-caaf2bbe-3f18-49aa-9668-a5bda6c5f5e1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1690 microversion: 2.1 time: 0.303084 Mar 12 21:13:41.070272 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3659/4427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:40 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1690 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:41.196913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-41784f9a-ec34-4c22-8cd0-691d5f42d399 req-55c6b41b-472f-41dc-b3e9-3446849f717c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c852e33-59fa-408e-ae85-2db0fb6a96a6", "name": "network-vif-unplugged", "status": "completed", "tag": "cd8b144c-540d-432c-afe3-8cbec9f808a3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:41.207221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-41784f9a-ec34-4c22-8cd0-691d5f42d399 req-55c6b41b-472f-41dc-b3e9-3446849f717c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:41.207944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-41784f9a-ec34-4c22-8cd0-691d5f42d399 req-55c6b41b-472f-41dc-b3e9-3446849f717c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:41.225867 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-41784f9a-ec34-4c22-8cd0-691d5f42d399 req-55c6b41b-472f-41dc-b3e9-3446849f717c service nova] Creating event network-vif-unplugged:cd8b144c-540d-432c-afe3-8cbec9f808a3 for instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 on nch2-master-1 Mar 12 21:13:41.242705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-41784f9a-ec34-4c22-8cd0-691d5f42d399 req-55c6b41b-472f-41dc-b3e9-3446849f717c service nova] Instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:13:41.263012 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-41784f9a-ec34-4c22-8cd0-691d5f42d399 req-55c6b41b-472f-41dc-b3e9-3446849f717c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072322 Mar 12 21:13:41.264542 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3660/4428] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:13:41.688367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bac81c79-38a1-4a93-aac1-82b370035bcc tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:41.689075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bac81c79-38a1-4a93-aac1-82b370035bcc tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:41.702286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bac81c79-38a1-4a93-aac1-82b370035bcc tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:41.703562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bac81c79-38a1-4a93-aac1-82b370035bcc tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:41.704621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bac81c79-38a1-4a93-aac1-82b370035bcc tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:41.706082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bac81c79-38a1-4a93-aac1-82b370035bcc tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:41.940137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bac81c79-38a1-4a93-aac1-82b370035bcc tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:41.961455 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bac81c79-38a1-4a93-aac1-82b370035bcc tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1318 microversion: 2.1 time: 0.277151 Mar 12 21:13:41.962114 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3661/4429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:41 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:42.088181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86e54481-9f98-4ee8-92e6-86e9f51003e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:42.090822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86e54481-9f98-4ee8-92e6-86e9f51003e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:42.104747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86e54481-9f98-4ee8-92e6-86e9f51003e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:42.105517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86e54481-9f98-4ee8-92e6-86e9f51003e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:42.106552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86e54481-9f98-4ee8-92e6-86e9f51003e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:42.107164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86e54481-9f98-4ee8-92e6-86e9f51003e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:42.378268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86e54481-9f98-4ee8-92e6-86e9f51003e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:42.397659 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86e54481-9f98-4ee8-92e6-86e9f51003e5 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1690 microversion: 2.1 time: 0.314274 Mar 12 21:13:42.403895 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3662/4430] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:42 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1690 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:42.411501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-eebfdaef-635a-4b68-b787-f5957b837a9b req-148dd546-9e6f-4335-97ce-8853d605d1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64431cf-644f-47c1-86eb-e1d12fda3937", "name": "network-vif-plugged", "status": "completed", "tag": "4629a6c8-95f0-4db6-9469-6b2d64c02fb4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:42.428125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-eebfdaef-635a-4b68-b787-f5957b837a9b req-148dd546-9e6f-4335-97ce-8853d605d1e7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:42.429041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-eebfdaef-635a-4b68-b787-f5957b837a9b req-148dd546-9e6f-4335-97ce-8853d605d1e7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:42.455151 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-eebfdaef-635a-4b68-b787-f5957b837a9b req-148dd546-9e6f-4335-97ce-8853d605d1e7 service nova] Creating event network-vif-plugged:4629a6c8-95f0-4db6-9469-6b2d64c02fb4 for instance f64431cf-644f-47c1-86eb-e1d12fda3937 on nch1-master-1 Mar 12 21:13:42.463585 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-eebfdaef-635a-4b68-b787-f5957b837a9b req-148dd546-9e6f-4335-97ce-8853d605d1e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055603 Mar 12 21:13:42.464652 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3663/4431] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:13:42.987233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-264e9c8c-b7eb-47e5-b40e-1f83e6147cac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:42.988291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-264e9c8c-b7eb-47e5-b40e-1f83e6147cac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:43.016616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-264e9c8c-b7eb-47e5-b40e-1f83e6147cac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:43.018328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-264e9c8c-b7eb-47e5-b40e-1f83e6147cac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:43.020802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-264e9c8c-b7eb-47e5-b40e-1f83e6147cac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:43.022739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-264e9c8c-b7eb-47e5-b40e-1f83e6147cac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:43.236471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-264e9c8c-b7eb-47e5-b40e-1f83e6147cac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:43.248708 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-264e9c8c-b7eb-47e5-b40e-1f83e6147cac tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1318 microversion: 2.1 time: 0.267202 Mar 12 21:13:43.260721 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3664/4432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:42 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:43.283819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7c534d0c-8b11-4527-ac01-e94e6902924e req-deeff821-2ada-42a5-b6b5-4f9a25305996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c852e33-59fa-408e-ae85-2db0fb6a96a6", "tag": "cd8b144c-540d-432c-afe3-8cbec9f808a3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:43.296531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7c534d0c-8b11-4527-ac01-e94e6902924e req-deeff821-2ada-42a5-b6b5-4f9a25305996 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:43.297267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7c534d0c-8b11-4527-ac01-e94e6902924e req-deeff821-2ada-42a5-b6b5-4f9a25305996 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:43.310862 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7c534d0c-8b11-4527-ac01-e94e6902924e req-deeff821-2ada-42a5-b6b5-4f9a25305996 service nova] Creating event network-changed:cd8b144c-540d-432c-afe3-8cbec9f808a3 for instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 on nch2-master-1 Mar 12 21:13:43.320627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-7c534d0c-8b11-4527-ac01-e94e6902924e req-deeff821-2ada-42a5-b6b5-4f9a25305996 service nova] Instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:13:43.353500 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7c534d0c-8b11-4527-ac01-e94e6902924e req-deeff821-2ada-42a5-b6b5-4f9a25305996 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066644 Mar 12 21:13:43.354805 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3665/4433] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:13:43.421005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8056f95d-c3e2-446d-b9c1-779c91ddf472 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:43.422174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8056f95d-c3e2-446d-b9c1-779c91ddf472 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:43.434633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8056f95d-c3e2-446d-b9c1-779c91ddf472 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:43.435099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8056f95d-c3e2-446d-b9c1-779c91ddf472 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:43.435894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8056f95d-c3e2-446d-b9c1-779c91ddf472 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:43.436338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8056f95d-c3e2-446d-b9c1-779c91ddf472 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:43.957075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8056f95d-c3e2-446d-b9c1-779c91ddf472 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:43.967567 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8056f95d-c3e2-446d-b9c1-779c91ddf472 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1690 microversion: 2.1 time: 0.548218 Mar 12 21:13:43.971312 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3666/4434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:43 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1690 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:44.269469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bca59617-9565-4469-8922-ba13104bc5f1 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:44.271217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bca59617-9565-4469-8922-ba13104bc5f1 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:44.283175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bca59617-9565-4469-8922-ba13104bc5f1 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:44.286152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bca59617-9565-4469-8922-ba13104bc5f1 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:44.289054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bca59617-9565-4469-8922-ba13104bc5f1 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:44.289703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bca59617-9565-4469-8922-ba13104bc5f1 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:44.758182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bca59617-9565-4469-8922-ba13104bc5f1 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:44.768946 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bca59617-9565-4469-8922-ba13104bc5f1 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1506 microversion: 2.1 time: 0.505533 Mar 12 21:13:44.773372 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3667/4435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:44 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:44.797874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3adc30b5-dd11-4bf4-b49f-8948d96bf3bb tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7aa69d6a-de21-48b0-a279-c3e51e53b549", "device": "/dev/sdb"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:44.797874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3adc30b5-dd11-4bf4-b49f-8948d96bf3bb tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:44.809547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3adc30b5-dd11-4bf4-b49f-8948d96bf3bb tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:44.815419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3adc30b5-dd11-4bf4-b49f-8948d96bf3bb tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:44.815419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3adc30b5-dd11-4bf4-b49f-8948d96bf3bb tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:44.815419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3adc30b5-dd11-4bf4-b49f-8948d96bf3bb tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:45.196813 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3adc30b5-dd11-4bf4-b49f-8948d96bf3bb tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "POST /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412577 Mar 12 21:13:45.200377 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3668/4436] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:13:44 2022] POST /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:13:45.228971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9987c86d-c6ed-49c4-b4bd-a45de450cae6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:45.236048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9987c86d-c6ed-49c4-b4bd-a45de450cae6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:45.263016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9987c86d-c6ed-49c4-b4bd-a45de450cae6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:45.264763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9987c86d-c6ed-49c4-b4bd-a45de450cae6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:45.267794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9987c86d-c6ed-49c4-b4bd-a45de450cae6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:45.268455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9987c86d-c6ed-49c4-b4bd-a45de450cae6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:45.496794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9987c86d-c6ed-49c4-b4bd-a45de450cae6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:45.507021 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9987c86d-c6ed-49c4-b4bd-a45de450cae6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1690 microversion: 2.1 time: 0.304306 Mar 12 21:13:45.508360 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3669/4437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:45 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1690 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:13:46.524717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-61b1d588-cce5-450f-9869-9f947917f70d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:13:46.526070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-61b1d588-cce5-450f-9869-9f947917f70d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:13:46.539110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61b1d588-cce5-450f-9869-9f947917f70d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:46.539841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61b1d588-cce5-450f-9869-9f947917f70d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:46.543607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61b1d588-cce5-450f-9869-9f947917f70d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:46.544490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61b1d588-cce5-450f-9869-9f947917f70d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:46.789626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-61b1d588-cce5-450f-9869-9f947917f70d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:13:46.798333 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-61b1d588-cce5-450f-9869-9f947917f70d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1683 microversion: 2.1 time: 0.277744 Mar 12 21:13:46.800133 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3670/4438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:13:46 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1683 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:13:49.981931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d5599586-2953-4820-8600-14669f3f9c3a req-e555b0c5-29ac-455c-9620-492bcdabe794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c852e33-59fa-408e-ae85-2db0fb6a96a6", "name": "network-vif-plugged", "status": "completed", "tag": "cd8b144c-540d-432c-afe3-8cbec9f808a3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:13:49.997075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d5599586-2953-4820-8600-14669f3f9c3a req-e555b0c5-29ac-455c-9620-492bcdabe794 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:13:50.002494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d5599586-2953-4820-8600-14669f3f9c3a req-e555b0c5-29ac-455c-9620-492bcdabe794 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:13:50.032480 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d5599586-2953-4820-8600-14669f3f9c3a req-e555b0c5-29ac-455c-9620-492bcdabe794 service nova] Creating event network-vif-plugged:cd8b144c-540d-432c-afe3-8cbec9f808a3 for instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 on nch2-master-1 Mar 12 21:13:50.044346 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d5599586-2953-4820-8600-14669f3f9c3a req-e555b0c5-29ac-455c-9620-492bcdabe794 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066895 Mar 12 21:13:50.045796 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3671/4439] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:14:03.806474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1931836341", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:03.880389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:14:04.233256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:14:04.234251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:14:04.234905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:14:04.235490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:14:04.235910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:14:04.246932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:04.247945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:04.248809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:04.249440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:04.267243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Getting quotas for project b6e9f7e3df0b412d9cd07bacc8873fcf. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:14:04.272728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Getting quotas for user d130f87046374d9096555d9df2bdbed7 and project b6e9f7e3df0b412d9cd07bacc8873fcf. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:14:04.288420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:14:04.290860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:14:04.336895 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-184b1edb-de89-491f-baba-ccb6afda844c tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536383 Mar 12 21:14:04.337683 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3672/4440] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:14:04.347279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ef188456-8b08-4802-afcc-b49e856615a1 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:04.347907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ef188456-8b08-4802-afcc-b49e856615a1 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:04.421232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ef188456-8b08-4802-afcc-b49e856615a1 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd130f87046374d9096555d9df2bdbed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e9f7e3df0b412d9cd07bacc8873fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:04.430066 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ef188456-8b08-4802-afcc-b49e856615a1 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 200 len: 1215 microversion: 2.1 time: 0.086522 Mar 12 21:14:04.434827 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3673/4441] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:04 2022] GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:05.449642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce6e3d20-6683-4b43-83fd-461de7c6ca11 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:05.451176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce6e3d20-6683-4b43-83fd-461de7c6ca11 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:05.461421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce6e3d20-6683-4b43-83fd-461de7c6ca11 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:05.462108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce6e3d20-6683-4b43-83fd-461de7c6ca11 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:05.463127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce6e3d20-6683-4b43-83fd-461de7c6ca11 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:05.463731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce6e3d20-6683-4b43-83fd-461de7c6ca11 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:05.534176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce6e3d20-6683-4b43-83fd-461de7c6ca11 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd130f87046374d9096555d9df2bdbed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e9f7e3df0b412d9cd07bacc8873fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:05.541942 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce6e3d20-6683-4b43-83fd-461de7c6ca11 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 200 len: 1273 microversion: 2.1 time: 0.098369 Mar 12 21:14:05.543232 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3674/4442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:05 2022] GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:06.559829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6c43e6ff-39bc-4e80-847e-365f193c5473 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:06.560756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6c43e6ff-39bc-4e80-847e-365f193c5473 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:06.568490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c43e6ff-39bc-4e80-847e-365f193c5473 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:06.568953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c43e6ff-39bc-4e80-847e-365f193c5473 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:06.570024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c43e6ff-39bc-4e80-847e-365f193c5473 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:06.570846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c43e6ff-39bc-4e80-847e-365f193c5473 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:06.735761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6c43e6ff-39bc-4e80-847e-365f193c5473 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd130f87046374d9096555d9df2bdbed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e9f7e3df0b412d9cd07bacc8873fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:06.744554 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6c43e6ff-39bc-4e80-847e-365f193c5473 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 200 len: 1315 microversion: 2.1 time: 0.188751 Mar 12 21:14:06.745144 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3675/4443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:06 2022] GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:07.056910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1358c440-ad04-49dc-9384-aa08203af31f req-01a2a7b5-2043-42ea-b353-852ace8892ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "418a1e24-3228-4dce-b25e-5f6043955a80", "tag": "e19ff53b-218f-47dc-a578-df3180c99a99"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:07.066986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1358c440-ad04-49dc-9384-aa08203af31f req-01a2a7b5-2043-42ea-b353-852ace8892ae service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:07.067446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1358c440-ad04-49dc-9384-aa08203af31f req-01a2a7b5-2043-42ea-b353-852ace8892ae service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:07.087448 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1358c440-ad04-49dc-9384-aa08203af31f req-01a2a7b5-2043-42ea-b353-852ace8892ae service nova] Creating event network-changed:e19ff53b-218f-47dc-a578-df3180c99a99 for instance 418a1e24-3228-4dce-b25e-5f6043955a80 on nch2-master-1 Mar 12 21:14:07.093538 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1358c440-ad04-49dc-9384-aa08203af31f req-01a2a7b5-2043-42ea-b353-852ace8892ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041331 Mar 12 21:14:07.094826 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3676/4444] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:14:07.762363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-84f7314e-f4bd-4bf3-bb75-6bc47901c5ac tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:07.763773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-84f7314e-f4bd-4bf3-bb75-6bc47901c5ac tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:07.770841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84f7314e-f4bd-4bf3-bb75-6bc47901c5ac tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:07.771487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84f7314e-f4bd-4bf3-bb75-6bc47901c5ac tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:07.772435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84f7314e-f4bd-4bf3-bb75-6bc47901c5ac tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:07.772876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84f7314e-f4bd-4bf3-bb75-6bc47901c5ac tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:07.992637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-84f7314e-f4bd-4bf3-bb75-6bc47901c5ac tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd130f87046374d9096555d9df2bdbed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e9f7e3df0b412d9cd07bacc8873fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:08.013130 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-84f7314e-f4bd-4bf3-bb75-6bc47901c5ac tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 200 len: 1315 microversion: 2.1 time: 0.255915 Mar 12 21:14:08.014200 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3677/4445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:07 2022] GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:09.030038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5645638-a152-4852-a4d3-1e0d8349435b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:09.030889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c5645638-a152-4852-a4d3-1e0d8349435b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:09.039669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5645638-a152-4852-a4d3-1e0d8349435b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:09.040164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5645638-a152-4852-a4d3-1e0d8349435b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:09.040977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5645638-a152-4852-a4d3-1e0d8349435b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:09.041454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5645638-a152-4852-a4d3-1e0d8349435b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:09.246779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c5645638-a152-4852-a4d3-1e0d8349435b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd130f87046374d9096555d9df2bdbed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e9f7e3df0b412d9cd07bacc8873fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:09.255894 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c5645638-a152-4852-a4d3-1e0d8349435b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 200 len: 1315 microversion: 2.1 time: 0.229823 Mar 12 21:14:09.256770 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3678/4446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:09 2022] GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:10.272727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f110538-5c57-4835-9b1c-fe0dd917e754 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:10.274235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6f110538-5c57-4835-9b1c-fe0dd917e754 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:10.281985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f110538-5c57-4835-9b1c-fe0dd917e754 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:10.282704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f110538-5c57-4835-9b1c-fe0dd917e754 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:10.283590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f110538-5c57-4835-9b1c-fe0dd917e754 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:10.284137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f110538-5c57-4835-9b1c-fe0dd917e754 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:10.427860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6f110538-5c57-4835-9b1c-fe0dd917e754 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd130f87046374d9096555d9df2bdbed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e9f7e3df0b412d9cd07bacc8873fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:10.435135 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f110538-5c57-4835-9b1c-fe0dd917e754 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 200 len: 1315 microversion: 2.1 time: 0.166520 Mar 12 21:14:10.435714 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3679/4447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:10 2022] GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:11.065264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ffe2cd38-ac69-4b80-b9f1-a744bfe794ba tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:11.066351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ffe2cd38-ac69-4b80-b9f1-a744bfe794ba tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:11.072600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffe2cd38-ac69-4b80-b9f1-a744bfe794ba tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:11.073171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffe2cd38-ac69-4b80-b9f1-a744bfe794ba tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:11.073864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffe2cd38-ac69-4b80-b9f1-a744bfe794ba tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:11.074354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffe2cd38-ac69-4b80-b9f1-a744bfe794ba tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:11.130178 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ffe2cd38-ac69-4b80-b9f1-a744bfe794ba tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6/action" status: 200 len: 63136 microversion: 2.1 time: 0.069032 Mar 12 21:14:11.138364 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3680/4448] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:14:11 2022] POST /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6/action => generated 63136 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:14:11.452539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9aee3f44-4a32-434a-a1f2-a631497da8e9 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:11.453249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9aee3f44-4a32-434a-a1f2-a631497da8e9 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:11.461639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9aee3f44-4a32-434a-a1f2-a631497da8e9 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:11.462130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9aee3f44-4a32-434a-a1f2-a631497da8e9 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:11.462917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9aee3f44-4a32-434a-a1f2-a631497da8e9 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:11.463366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9aee3f44-4a32-434a-a1f2-a631497da8e9 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:11.607472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9aee3f44-4a32-434a-a1f2-a631497da8e9 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd130f87046374d9096555d9df2bdbed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e9f7e3df0b412d9cd07bacc8873fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:11.615139 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9aee3f44-4a32-434a-a1f2-a631497da8e9 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 200 len: 1315 microversion: 2.1 time: 0.167415 Mar 12 21:14:11.615721 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3681/4449] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:11 2022] GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:12.072051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-156fa593-ef8b-4eea-b66a-d87b00131955 req-1ef3e7af-3fae-4468-a2db-8413990eed65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "418a1e24-3228-4dce-b25e-5f6043955a80", "name": "network-vif-plugged", "status": "completed", "tag": "e19ff53b-218f-47dc-a578-df3180c99a99"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:12.080611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-156fa593-ef8b-4eea-b66a-d87b00131955 req-1ef3e7af-3fae-4468-a2db-8413990eed65 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:12.081070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-156fa593-ef8b-4eea-b66a-d87b00131955 req-1ef3e7af-3fae-4468-a2db-8413990eed65 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:12.094697 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-156fa593-ef8b-4eea-b66a-d87b00131955 req-1ef3e7af-3fae-4468-a2db-8413990eed65 service nova] Creating event network-vif-plugged:e19ff53b-218f-47dc-a578-df3180c99a99 for instance 418a1e24-3228-4dce-b25e-5f6043955a80 on nch2-master-1 Mar 12 21:14:12.099612 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-156fa593-ef8b-4eea-b66a-d87b00131955 req-1ef3e7af-3fae-4468-a2db-8413990eed65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189674 Mar 12 21:14:12.100223 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3682/4450] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:14:12.633403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb9dcc40-fca3-4b6b-a879-1bc4c5fbc7fc tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:12.634127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb9dcc40-fca3-4b6b-a879-1bc4c5fbc7fc tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:12.641032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb9dcc40-fca3-4b6b-a879-1bc4c5fbc7fc tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:12.641493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb9dcc40-fca3-4b6b-a879-1bc4c5fbc7fc tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:12.642294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb9dcc40-fca3-4b6b-a879-1bc4c5fbc7fc tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:12.642747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb9dcc40-fca3-4b6b-a879-1bc4c5fbc7fc tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:12.909168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bb9dcc40-fca3-4b6b-a879-1bc4c5fbc7fc tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd130f87046374d9096555d9df2bdbed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e9f7e3df0b412d9cd07bacc8873fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:12.916558 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb9dcc40-fca3-4b6b-a879-1bc4c5fbc7fc tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 200 len: 1315 microversion: 2.1 time: 0.288286 Mar 12 21:14:12.917146 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3683/4451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:12 2022] GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:13.934152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14cdf9ef-b603-4678-b215-c699739ce692 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:13.934774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14cdf9ef-b603-4678-b215-c699739ce692 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:13.941963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14cdf9ef-b603-4678-b215-c699739ce692 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:13.942419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14cdf9ef-b603-4678-b215-c699739ce692 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:13.943408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14cdf9ef-b603-4678-b215-c699739ce692 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:13.944243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14cdf9ef-b603-4678-b215-c699739ce692 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:14.113572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14cdf9ef-b603-4678-b215-c699739ce692 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd130f87046374d9096555d9df2bdbed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e9f7e3df0b412d9cd07bacc8873fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:14.121208 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14cdf9ef-b603-4678-b215-c699739ce692 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 200 len: 1464 microversion: 2.1 time: 0.191045 Mar 12 21:14:14.121877 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3684/4452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:13 2022] GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 1464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:14.164045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8214d96-a708-41d9-a21f-271c4b4a719b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:14.164558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8214d96-a708-41d9-a21f-271c4b4a719b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:14.170480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8214d96-a708-41d9-a21f-271c4b4a719b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:14.170966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8214d96-a708-41d9-a21f-271c4b4a719b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:14.171742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8214d96-a708-41d9-a21f-271c4b4a719b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:14.172185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8214d96-a708-41d9-a21f-271c4b4a719b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:14.196875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8214d96-a708-41d9-a21f-271c4b4a719b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:14:14.272324 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8214d96-a708-41d9-a21f-271c4b4a719b tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "DELETE /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 204 len: 0 microversion: 2.1 time: 0.112109 Mar 12 21:14:14.273015 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3685/4453] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:14:14 2022] DELETE /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:14:14.282248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bdc9f7fd-6067-4eda-855c-437968e1586a tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:14.282894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bdc9f7fd-6067-4eda-855c-437968e1586a tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:14.288994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bdc9f7fd-6067-4eda-855c-437968e1586a tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:14.289811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bdc9f7fd-6067-4eda-855c-437968e1586a tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:14.290264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bdc9f7fd-6067-4eda-855c-437968e1586a tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:14.290712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bdc9f7fd-6067-4eda-855c-437968e1586a tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:14.438843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bdc9f7fd-6067-4eda-855c-437968e1586a tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd130f87046374d9096555d9df2bdbed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e9f7e3df0b412d9cd07bacc8873fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:14.446289 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bdc9f7fd-6067-4eda-855c-437968e1586a tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 200 len: 1470 microversion: 2.1 time: 0.168869 Mar 12 21:14:14.446886 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3686/4454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:14 2022] GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:15.464007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-68391464-5b35-474e-9f77-cc1cd0ce5eae tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:15.464738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-68391464-5b35-474e-9f77-cc1cd0ce5eae tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:15.472944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68391464-5b35-474e-9f77-cc1cd0ce5eae tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:15.473789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68391464-5b35-474e-9f77-cc1cd0ce5eae tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:15.475684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68391464-5b35-474e-9f77-cc1cd0ce5eae tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:15.476170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68391464-5b35-474e-9f77-cc1cd0ce5eae tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:15.619661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-68391464-5b35-474e-9f77-cc1cd0ce5eae tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd130f87046374d9096555d9df2bdbed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e9f7e3df0b412d9cd07bacc8873fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:15.627200 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-68391464-5b35-474e-9f77-cc1cd0ce5eae tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 200 len: 1470 microversion: 2.1 time: 0.167159 Mar 12 21:14:15.627789 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3687/4455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:15 2022] GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:16.338427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-90962902-4ad0-43a6-a3b4-ca9f8371f401 req-d4591a78-168e-4433-9a69-4473b1e623dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "418a1e24-3228-4dce-b25e-5f6043955a80", "name": "network-vif-deleted", "tag": "e19ff53b-218f-47dc-a578-df3180c99a99"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:16.346963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-90962902-4ad0-43a6-a3b4-ca9f8371f401 req-d4591a78-168e-4433-9a69-4473b1e623dd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:16.347358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-90962902-4ad0-43a6-a3b4-ca9f8371f401 req-d4591a78-168e-4433-9a69-4473b1e623dd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:16.361074 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-90962902-4ad0-43a6-a3b4-ca9f8371f401 req-d4591a78-168e-4433-9a69-4473b1e623dd service nova] Creating event network-vif-deleted:e19ff53b-218f-47dc-a578-df3180c99a99 for instance 418a1e24-3228-4dce-b25e-5f6043955a80 on nch2-master-1 Mar 12 21:14:16.366104 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-90962902-4ad0-43a6-a3b4-ca9f8371f401 req-d4591a78-168e-4433-9a69-4473b1e623dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211081 Mar 12 21:14:16.366719 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3688/4456] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:14:16.647890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f155a61e-32d5-44ac-85b0-fcc8a9627619 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:16.649509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f155a61e-32d5-44ac-85b0-fcc8a9627619 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] [instance: 418a1e24-3228-4dce-b25e-5f6043955a80] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:16.657754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f155a61e-32d5-44ac-85b0-fcc8a9627619 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:16.658417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f155a61e-32d5-44ac-85b0-fcc8a9627619 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:16.660088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f155a61e-32d5-44ac-85b0-fcc8a9627619 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:16.660622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f155a61e-32d5-44ac-85b0-fcc8a9627619 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:16.678269 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f155a61e-32d5-44ac-85b0-fcc8a9627619 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] HTTP exception thrown: Instance 418a1e24-3228-4dce-b25e-5f6043955a80 could not be found. Mar 12 21:14:16.678885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f155a61e-32d5-44ac-85b0-fcc8a9627619 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] Returning 404 to user: Instance 418a1e24-3228-4dce-b25e-5f6043955a80 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:14:16.680374 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f155a61e-32d5-44ac-85b0-fcc8a9627619 tempest-VolumesNegativeTest-134266749 tempest-VolumesNegativeTest-134266749-project] 10.222.0.30 "GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80" status: 404 len: 111 microversion: 2.1 time: 0.038798 Mar 12 21:14:16.680955 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3689/4457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:16 2022] GET /compute/v2.1/servers/418a1e24-3228-4dce-b25e-5f6043955a80 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:14:17.560731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7c46465a-5e2d-4800-85af-655b218782f1 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:17.561679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7c46465a-5e2d-4800-85af-655b218782f1 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:17.567963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c46465a-5e2d-4800-85af-655b218782f1 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:17.568502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c46465a-5e2d-4800-85af-655b218782f1 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:17.569344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c46465a-5e2d-4800-85af-655b218782f1 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:17.569881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c46465a-5e2d-4800-85af-655b218782f1 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:18.091180 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7c46465a-5e2d-4800-85af-655b218782f1 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1834 microversion: 2.1 time: 0.534132 Mar 12 21:14:18.104767 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3690/4458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:17 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1834 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:19.620894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-03c7a5ba-7d77-47c2-b451-e44e39f86c5d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:19.621461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-03c7a5ba-7d77-47c2-b451-e44e39f86c5d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:19.629315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03c7a5ba-7d77-47c2-b451-e44e39f86c5d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:19.629816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03c7a5ba-7d77-47c2-b451-e44e39f86c5d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:19.630602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03c7a5ba-7d77-47c2-b451-e44e39f86c5d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:19.631052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03c7a5ba-7d77-47c2-b451-e44e39f86c5d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:19.662562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-03c7a5ba-7d77-47c2-b451-e44e39f86c5d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:14:19.776415 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-03c7a5ba-7d77-47c2-b451-e44e39f86c5d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 204 len: 0 microversion: 2.1 time: 0.153126 Mar 12 21:14:19.777252 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3691/4459] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:14:19 2022] DELETE /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:14:19.791345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6b4c01a3-08a5-41a5-adc7-ae62d27edda4 req-d6ba291a-0f69-4b48-acf9-5a3655ab9793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c852e33-59fa-408e-ae85-2db0fb6a96a6", "tag": "cd8b144c-540d-432c-afe3-8cbec9f808a3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:19.804290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6b4c01a3-08a5-41a5-adc7-ae62d27edda4 req-d6ba291a-0f69-4b48-acf9-5a3655ab9793 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:19.806121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6b4c01a3-08a5-41a5-adc7-ae62d27edda4 req-d6ba291a-0f69-4b48-acf9-5a3655ab9793 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:19.818609 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6b4c01a3-08a5-41a5-adc7-ae62d27edda4 req-d6ba291a-0f69-4b48-acf9-5a3655ab9793 service nova] Creating event network-changed:cd8b144c-540d-432c-afe3-8cbec9f808a3 for instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 on nch2-master-1 Mar 12 21:14:19.823868 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6b4c01a3-08a5-41a5-adc7-ae62d27edda4 req-d6ba291a-0f69-4b48-acf9-5a3655ab9793 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041638 Mar 12 21:14:19.824666 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3692/4460] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:19.831308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f45fc53-d383-402e-9163-a0fc169c65c7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:19.832264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f45fc53-d383-402e-9163-a0fc169c65c7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:19.853490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f45fc53-d383-402e-9163-a0fc169c65c7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:19.854103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f45fc53-d383-402e-9163-a0fc169c65c7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:19.855401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f45fc53-d383-402e-9163-a0fc169c65c7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:19.855841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f45fc53-d383-402e-9163-a0fc169c65c7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:20.107067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8f45fc53-d383-402e-9163-a0fc169c65c7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:20.122273 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f45fc53-d383-402e-9163-a0fc169c65c7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1689 microversion: 2.1 time: 0.295902 Mar 12 21:14:20.132858 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3693/4461] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:19 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1689 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:14:21.140271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e9ee4535-4748-4dba-9599-f983cd46d3df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:21.140913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e9ee4535-4748-4dba-9599-f983cd46d3df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:21.147878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9ee4535-4748-4dba-9599-f983cd46d3df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:21.148338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9ee4535-4748-4dba-9599-f983cd46d3df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:21.149128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9ee4535-4748-4dba-9599-f983cd46d3df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:21.149576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9ee4535-4748-4dba-9599-f983cd46d3df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:21.304479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e9ee4535-4748-4dba-9599-f983cd46d3df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:21.312237 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e9ee4535-4748-4dba-9599-f983cd46d3df tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 200 len: 1570 microversion: 2.1 time: 0.176266 Mar 12 21:14:21.313133 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3694/4462] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:21 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:21.866880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9fc1969e-fad9-4f8d-b50b-877e61e82ba8 req-10d23988-c79a-47f8-8dfe-e170db926965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c852e33-59fa-408e-ae85-2db0fb6a96a6", "name": "network-vif-deleted", "tag": "cd8b144c-540d-432c-afe3-8cbec9f808a3"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:21.875563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9fc1969e-fad9-4f8d-b50b-877e61e82ba8 req-10d23988-c79a-47f8-8dfe-e170db926965 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:21.876276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9fc1969e-fad9-4f8d-b50b-877e61e82ba8 req-10d23988-c79a-47f8-8dfe-e170db926965 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:21.888059 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9fc1969e-fad9-4f8d-b50b-877e61e82ba8 req-10d23988-c79a-47f8-8dfe-e170db926965 service nova] Creating event network-vif-deleted:cd8b144c-540d-432c-afe3-8cbec9f808a3 for instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 on nch2-master-1 Mar 12 21:14:21.893424 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9fc1969e-fad9-4f8d-b50b-877e61e82ba8 req-10d23988-c79a-47f8-8dfe-e170db926965 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030856 Mar 12 21:14:21.894074 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3695/4463] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:22.333336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a33f3e03-9a4c-4666-84cd-664b14ca68b7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:22.334847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a33f3e03-9a4c-4666-84cd-664b14ca68b7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: 9c852e33-59fa-408e-ae85-2db0fb6a96a6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:22.341566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a33f3e03-9a4c-4666-84cd-664b14ca68b7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:22.342414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a33f3e03-9a4c-4666-84cd-664b14ca68b7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:22.343383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a33f3e03-9a4c-4666-84cd-664b14ca68b7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:22.344140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a33f3e03-9a4c-4666-84cd-664b14ca68b7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:22.363329 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a33f3e03-9a4c-4666-84cd-664b14ca68b7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] HTTP exception thrown: Instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 could not be found. Mar 12 21:14:22.364112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a33f3e03-9a4c-4666-84cd-664b14ca68b7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Returning 404 to user: Instance 9c852e33-59fa-408e-ae85-2db0fb6a96a6 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:14:22.365143 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a33f3e03-9a4c-4666-84cd-664b14ca68b7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6" status: 404 len: 111 microversion: 2.1 time: 0.037016 Mar 12 21:14:22.365878 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3696/4464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:22 2022] GET /compute/v2.1/servers/9c852e33-59fa-408e-ae85-2db0fb6a96a6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:14:27.673593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1d68a4f6-190f-49ea-aa4a-fc8f8d31ab02 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '.version_select at 0x7f6e366f71f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:27.701435 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1d68a4f6-190f-49ea-aa4a-fc8f8d31ab02 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-337869288" status: 202 len: 0 microversion: 2.1 time: 0.034797 Mar 12 21:14:27.703291 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3697/4465] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Mar 12 21:14:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-337869288 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:14:27.741325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-92b096f3-0059-445e-8a4d-f13a5b399bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'create', calling method: .version_select at 0x7f6e37515dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1271687427"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:27.764578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-92b096f3-0059-445e-8a4d-f13a5b399bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:14:27.770684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-92b096f3-0059-445e-8a4d-f13a5b399bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for user 43f35f32a8064500a8d8412f19697b93 and project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:14:28.122813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-92b096f3-0059-445e-8a4d-f13a5b399bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:14:28.143434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-92b096f3-0059-445e-8a4d-f13a5b399bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for user 43f35f32a8064500a8d8412f19697b93 and project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:14:28.169891 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-92b096f3-0059-445e-8a4d-f13a5b399bf7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.434667 Mar 12 21:14:28.170946 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3698/4466] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:14:27 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:14:39.511630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b121931-de0c-4a3f-8472-e35e3600a1a7 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-741195174", "availability_zone": "foo_zone"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:39.514027 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:14:39.514027 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:14:39.516131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.aggregate [None req-7b121931-de0c-4a3f-8472-e35e3600a1a7 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Generated uuid 08614683-85d4-4036-a124-cc31d5f73334 for aggregate {{(pid=136302) create /opt/stack/nova/nova/objects/aggregate.py:298}} Mar 12 21:14:39.556723 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b121931-de0c-4a3f-8472-e35e3600a1a7 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.244288 Mar 12 21:14:39.559373 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3699/4467] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Mar 12 21:14:39 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:14:39.571080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-46957bb0-40ed-47ed-ad58-54571bbe8116 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:39.573337 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:14:39.573337 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:14:39.624970 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-46957bb0-40ed-47ed-ad58-54571bbe8116 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.058169 Mar 12 21:14:39.626671 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3700/4468] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 21:14:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:14:39.643699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6084ba1c-f397-41fd-a665-82b1982c0728 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:39.646446 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:14:39.646446 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:14:39.648425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6084ba1c-f397-41fd-a665-82b1982c0728 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:39.649034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6084ba1c-f397-41fd-a665-82b1982c0728 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:39.650050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6084ba1c-f397-41fd-a665-82b1982c0728 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:39.650649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6084ba1c-f397-41fd-a665-82b1982c0728 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:39.700261 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6084ba1c-f397-41fd-a665-82b1982c0728 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.062500 Mar 12 21:14:39.707387 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3701/4469] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Mar 12 21:14:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:39.714016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d685fbc4-7a52-4d40-93bb-c59cc29577cb tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:39.715201 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:14:39.715201 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:14:39.725282 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d685fbc4-7a52-4d40-93bb-c59cc29577cb tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.015102 Mar 12 21:14:39.726148 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3702/4470] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Mar 12 21:14:39 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:39.737856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9a489be-7a4f-4ecf-81a7-bb94a64e8a97 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:39.739253 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:14:39.739253 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:14:39.751914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9a489be-7a4f-4ecf-81a7-bb94a64e8a97 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:39.752562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9a489be-7a4f-4ecf-81a7-bb94a64e8a97 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:40.087895 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9a489be-7a4f-4ecf-81a7-bb94a64e8a97 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.354446 Mar 12 21:14:40.088919 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3703/4471] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 21:14:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:40.098866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1905893891", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "dea7ae27-fd44-4d20-a741-566eb723ec25"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1271687427", "security_groups": [{"name": "tempest-secgroup-smoke-131701431"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:40.209892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] validate_networks() for [('dea7ae27-fd44-4d20-a741-566eb723ec25', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:14:40.768186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:14:40.769616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:14:40.770313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:14:40.771771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:14:40.772514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:14:40.784546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:40.785357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:40.785846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:40.786293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:40.810083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for project cf66e00702594effaf99e35fcdcf05c9. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:14:40.816722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for user 43f35f32a8064500a8d8412f19697b93 and project cf66e00702594effaf99e35fcdcf05c9. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:14:40.829907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:14:40.832258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:14:40.887099 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a4e8f7f9-d89d-4c22-84ac-355348f28d77 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.796893 Mar 12 21:14:40.888956 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3704/4472] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:14:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:14:40.895626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e9f3f06e-37d3-45eb-ad97-e275834c3f20 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:40.897515 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:14:40.897515 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:14:40.905905 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e9f3f06e-37d3-45eb-ad97-e275834c3f20 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.015670 Mar 12 21:14:40.906480 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3705/4473] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 21:14:40 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:40.911193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b5ab4834-ac66-4428-87dd-23faed524434 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:40.912062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b5ab4834-ac66-4428-87dd-23faed524434 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:40.993651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b5ab4834-ac66-4428-87dd-23faed524434 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:41.008439 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b5ab4834-ac66-4428-87dd-23faed524434 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1267 microversion: 2.1 time: 0.097995 Mar 12 21:14:41.009923 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3706/4474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:40 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:14:41.016899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34613242-392b-4cad-a01c-84189c512312 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-187102429", "availability_zone": "foo_zone"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:41.018620 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:14:41.018620 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:14:41.083815 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34613242-392b-4cad-a01c-84189c512312 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.071900 Mar 12 21:14:41.089867 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3707/4475] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Mar 12 21:14:41 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:41.095470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7c17f8c4-811a-4075-bd9b-661c1e21aa10 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:41.096771 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:14:41.096771 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:14:41.124094 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7c17f8c4-811a-4075-bd9b-661c1e21aa10 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.032988 Mar 12 21:14:41.124920 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3708/4476] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 21:14:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:41.137638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd77d444-70f2-43ed-800a-c722ac85998a tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:41.138567 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:14:41.138567 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:14:41.148791 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd77d444-70f2-43ed-800a-c722ac85998a tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.017829 Mar 12 21:14:41.149547 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3709/4477] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Mar 12 21:14:41 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:14:41.160305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-03727ca2-346f-4a8e-971d-e8812004b797 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:41.161692 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:14:41.161692 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:14:41.170845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03727ca2-346f-4a8e-971d-e8812004b797 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:41.171316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-03727ca2-346f-4a8e-971d-e8812004b797 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:41.314506 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-03727ca2-346f-4a8e-971d-e8812004b797 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.157922 Mar 12 21:14:41.317820 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3710/4478] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Mar 12 21:14:41 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:14:41.326656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb23367c-c2a5-4d83-a656-88be74d7f4d9 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:41.327576 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:14:41.327576 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:14:41.351725 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb23367c-c2a5-4d83-a656-88be74d7f4d9 tempest-TestAggregatesBasicOps-1443023295 tempest-TestAggregatesBasicOps-1443023295-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.030218 Mar 12 21:14:41.352389 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3711/4479] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Mar 12 21:14:41 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Mar 12 21:14:42.026058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9cca6ed-7fb7-4c06-be93-620efb2b5716 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:42.027827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9cca6ed-7fb7-4c06-be93-620efb2b5716 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:42.034916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9cca6ed-7fb7-4c06-be93-620efb2b5716 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:42.035606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9cca6ed-7fb7-4c06-be93-620efb2b5716 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:42.048435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9cca6ed-7fb7-4c06-be93-620efb2b5716 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:42.050927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9cca6ed-7fb7-4c06-be93-620efb2b5716 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:42.195645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f9cca6ed-7fb7-4c06-be93-620efb2b5716 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:42.203392 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9cca6ed-7fb7-4c06-be93-620efb2b5716 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1319 microversion: 2.1 time: 0.181639 Mar 12 21:14:42.205157 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3712/4480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:42 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:43.222505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce045af4-2ec3-42a3-90bc-d72bf4b8ec48 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:43.225110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce045af4-2ec3-42a3-90bc-d72bf4b8ec48 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:43.238076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce045af4-2ec3-42a3-90bc-d72bf4b8ec48 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:43.238527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce045af4-2ec3-42a3-90bc-d72bf4b8ec48 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:43.240880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce045af4-2ec3-42a3-90bc-d72bf4b8ec48 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:43.241338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce045af4-2ec3-42a3-90bc-d72bf4b8ec48 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:43.348642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce045af4-2ec3-42a3-90bc-d72bf4b8ec48 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:43.361887 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce045af4-2ec3-42a3-90bc-d72bf4b8ec48 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1325 microversion: 2.1 time: 0.144063 Mar 12 21:14:43.362918 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3713/4481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:43 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1325 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:14:44.383418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9bcf387-85ca-478c-b426-ad4e81bba66a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:44.384945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9bcf387-85ca-478c-b426-ad4e81bba66a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:44.399808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9bcf387-85ca-478c-b426-ad4e81bba66a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:44.400379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9bcf387-85ca-478c-b426-ad4e81bba66a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:44.401219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9bcf387-85ca-478c-b426-ad4e81bba66a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:44.401695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9bcf387-85ca-478c-b426-ad4e81bba66a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:45.013016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9bcf387-85ca-478c-b426-ad4e81bba66a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:45.021312 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9bcf387-85ca-478c-b426-ad4e81bba66a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1392 microversion: 2.1 time: 0.645278 Mar 12 21:14:45.025634 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3714/4482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:44 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1392 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:45.630825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3d88e485-6692-4011-8a5c-69381efe9537 req-fc87aac8-d3c7-4db1-b373-9570bd05e473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9896014-d757-4c57-9279-0aa92533121b", "tag": "9dba12ae-2168-465a-9f58-ee424e8cb6ce"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:45.649592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3d88e485-6692-4011-8a5c-69381efe9537 req-fc87aac8-d3c7-4db1-b373-9570bd05e473 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:45.651036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3d88e485-6692-4011-8a5c-69381efe9537 req-fc87aac8-d3c7-4db1-b373-9570bd05e473 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:45.700048 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3d88e485-6692-4011-8a5c-69381efe9537 req-fc87aac8-d3c7-4db1-b373-9570bd05e473 service nova] Creating event network-changed:9dba12ae-2168-465a-9f58-ee424e8cb6ce for instance d9896014-d757-4c57-9279-0aa92533121b on nch2-master-1 Mar 12 21:14:45.707990 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3d88e485-6692-4011-8a5c-69381efe9537 req-fc87aac8-d3c7-4db1-b373-9570bd05e473 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085115 Mar 12 21:14:45.709171 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3715/4483] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:46.045316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-615adfdb-cf68-408a-8537-8772cab35edc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:46.048652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-615adfdb-cf68-408a-8537-8772cab35edc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:46.070095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-615adfdb-cf68-408a-8537-8772cab35edc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:46.071776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-615adfdb-cf68-408a-8537-8772cab35edc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:46.077395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-615adfdb-cf68-408a-8537-8772cab35edc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:46.078135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-615adfdb-cf68-408a-8537-8772cab35edc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:46.624536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-615adfdb-cf68-408a-8537-8772cab35edc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:46.636976 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-615adfdb-cf68-408a-8537-8772cab35edc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1392 microversion: 2.1 time: 0.600073 Mar 12 21:14:46.643127 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3716/4484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:46 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1392 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:47.658698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e22f3f7-f7b7-49b2-bb24-7be9ee1561a6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:47.659424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e22f3f7-f7b7-49b2-bb24-7be9ee1561a6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:47.666289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e22f3f7-f7b7-49b2-bb24-7be9ee1561a6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:47.666980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e22f3f7-f7b7-49b2-bb24-7be9ee1561a6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:47.668739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e22f3f7-f7b7-49b2-bb24-7be9ee1561a6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:47.670186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e22f3f7-f7b7-49b2-bb24-7be9ee1561a6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:47.934703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8e22f3f7-f7b7-49b2-bb24-7be9ee1561a6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:47.942276 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8e22f3f7-f7b7-49b2-bb24-7be9ee1561a6 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1392 microversion: 2.1 time: 0.291193 Mar 12 21:14:47.943189 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3717/4485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:47 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1392 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:14:48.776827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d7683ed2-87c5-4539-a7c7-891686682770 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:48.777490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d7683ed2-87c5-4539-a7c7-891686682770 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:48.784831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7683ed2-87c5-4539-a7c7-891686682770 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:48.785297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7683ed2-87c5-4539-a7c7-891686682770 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:48.786107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7683ed2-87c5-4539-a7c7-891686682770 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:48.786565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7683ed2-87c5-4539-a7c7-891686682770 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:48.813934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d7683ed2-87c5-4539-a7c7-891686682770 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:14:48.954558 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d7683ed2-87c5-4539-a7c7-891686682770 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "DELETE /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 204 len: 0 microversion: 2.32 time: 0.179692 Mar 12 21:14:48.956068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3718/4486] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 21:14:48 2022] DELETE /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 12 21:14:48.962839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f777811-ef89-4b33-a6a5-a87e2c483854 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:48.963790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6f777811-ef89-4b33-a6a5-a87e2c483854 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:48.973376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f777811-ef89-4b33-a6a5-a87e2c483854 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:48.974176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f777811-ef89-4b33-a6a5-a87e2c483854 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:48.975222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f777811-ef89-4b33-a6a5-a87e2c483854 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:48.976133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f777811-ef89-4b33-a6a5-a87e2c483854 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:49.217272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6f777811-ef89-4b33-a6a5-a87e2c483854 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:49.225179 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f777811-ef89-4b33-a6a5-a87e2c483854 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1392 microversion: 2.1 time: 0.267648 Mar 12 21:14:49.225798 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3719/4487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:48 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1392 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:14:49.230488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-81ad0e21-8de7-4f91-a8ba-a32db903923e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:49.231296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-81ad0e21-8de7-4f91-a8ba-a32db903923e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:49.238993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81ad0e21-8de7-4f91-a8ba-a32db903923e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:49.239665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81ad0e21-8de7-4f91-a8ba-a32db903923e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:49.240621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81ad0e21-8de7-4f91-a8ba-a32db903923e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:49.241064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81ad0e21-8de7-4f91-a8ba-a32db903923e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:49.467404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-81ad0e21-8de7-4f91-a8ba-a32db903923e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:49.482658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-81ad0e21-8de7-4f91-a8ba-a32db903923e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:49.484546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-81ad0e21-8de7-4f91-a8ba-a32db903923e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:49.485422 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-81ad0e21-8de7-4f91-a8ba-a32db903923e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 2949 microversion: 2.32 time: 0.258533 Mar 12 21:14:49.486051 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3720/4488] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:14:49 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 2949 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:14:50.242567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34a9055a-21d5-4b85-8f50-5faa5c5a299b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:50.243182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34a9055a-21d5-4b85-8f50-5faa5c5a299b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:50.252259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34a9055a-21d5-4b85-8f50-5faa5c5a299b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:50.253178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34a9055a-21d5-4b85-8f50-5faa5c5a299b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:50.254163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34a9055a-21d5-4b85-8f50-5faa5c5a299b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:50.255515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34a9055a-21d5-4b85-8f50-5faa5c5a299b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:50.411963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34a9055a-21d5-4b85-8f50-5faa5c5a299b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:50.423701 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34a9055a-21d5-4b85-8f50-5faa5c5a299b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1392 microversion: 2.1 time: 0.184817 Mar 12 21:14:50.424266 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3721/4489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:50 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:50.509404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fbdd2349-afdc-4281-8af1-07ac5522a3b3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:50.516409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fbdd2349-afdc-4281-8af1-07ac5522a3b3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:50.533539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbdd2349-afdc-4281-8af1-07ac5522a3b3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:50.533979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbdd2349-afdc-4281-8af1-07ac5522a3b3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:50.535219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbdd2349-afdc-4281-8af1-07ac5522a3b3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:50.535668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbdd2349-afdc-4281-8af1-07ac5522a3b3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:50.837016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fbdd2349-afdc-4281-8af1-07ac5522a3b3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:50.847150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fbdd2349-afdc-4281-8af1-07ac5522a3b3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:50.849210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fbdd2349-afdc-4281-8af1-07ac5522a3b3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:50.850535 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fbdd2349-afdc-4281-8af1-07ac5522a3b3 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 2949 microversion: 2.32 time: 0.345572 Mar 12 21:14:50.851120 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3722/4490] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:14:50 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 2949 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:14:51.443205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3383a4ae-98c2-478d-b0ae-166feddc3b43 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:51.443887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3383a4ae-98c2-478d-b0ae-166feddc3b43 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:51.451715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3383a4ae-98c2-478d-b0ae-166feddc3b43 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:51.452637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3383a4ae-98c2-478d-b0ae-166feddc3b43 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:51.453447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3383a4ae-98c2-478d-b0ae-166feddc3b43 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:51.453912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3383a4ae-98c2-478d-b0ae-166feddc3b43 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:51.723858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3383a4ae-98c2-478d-b0ae-166feddc3b43 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:51.732617 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3383a4ae-98c2-478d-b0ae-166feddc3b43 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1392 microversion: 2.1 time: 0.293684 Mar 12 21:14:51.733322 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3723/4491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:51 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1392 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:14:51.871412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51bc3ccf-0b57-4cbc-9403-6262d4a950c9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:51.873243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51bc3ccf-0b57-4cbc-9403-6262d4a950c9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:51.880151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51bc3ccf-0b57-4cbc-9403-6262d4a950c9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:51.880745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51bc3ccf-0b57-4cbc-9403-6262d4a950c9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:51.881597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51bc3ccf-0b57-4cbc-9403-6262d4a950c9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:51.882149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51bc3ccf-0b57-4cbc-9403-6262d4a950c9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:52.182997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51bc3ccf-0b57-4cbc-9403-6262d4a950c9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:52.202991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51bc3ccf-0b57-4cbc-9403-6262d4a950c9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:52.208813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51bc3ccf-0b57-4cbc-9403-6262d4a950c9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:52.210455 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51bc3ccf-0b57-4cbc-9403-6262d4a950c9 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 2949 microversion: 2.32 time: 0.343765 Mar 12 21:14:52.214576 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3724/4492] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:14:51 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 2949 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:14:52.220959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-294bd8fd-fcea-4a2e-9e8a-f761c3a25119 req-109a5ca1-2bb5-4993-b380-76f5d52a6fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9896014-d757-4c57-9279-0aa92533121b", "name": "network-vif-plugged", "status": "completed", "tag": "9dba12ae-2168-465a-9f58-ee424e8cb6ce"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:52.240427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-294bd8fd-fcea-4a2e-9e8a-f761c3a25119 req-109a5ca1-2bb5-4993-b380-76f5d52a6fc8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:52.241398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-294bd8fd-fcea-4a2e-9e8a-f761c3a25119 req-109a5ca1-2bb5-4993-b380-76f5d52a6fc8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:52.264501 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-294bd8fd-fcea-4a2e-9e8a-f761c3a25119 req-109a5ca1-2bb5-4993-b380-76f5d52a6fc8 service nova] Creating event network-vif-plugged:9dba12ae-2168-465a-9f58-ee424e8cb6ce for instance d9896014-d757-4c57-9279-0aa92533121b on nch2-master-1 Mar 12 21:14:52.270464 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-294bd8fd-fcea-4a2e-9e8a-f761c3a25119 req-109a5ca1-2bb5-4993-b380-76f5d52a6fc8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054364 Mar 12 21:14:52.289484 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3725/4493] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:52.752011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-628fd274-5b27-4a8d-8988-a74ecf524f30 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:52.753557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-628fd274-5b27-4a8d-8988-a74ecf524f30 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:52.761399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-628fd274-5b27-4a8d-8988-a74ecf524f30 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:52.761884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-628fd274-5b27-4a8d-8988-a74ecf524f30 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:52.762668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-628fd274-5b27-4a8d-8988-a74ecf524f30 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:52.763420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-628fd274-5b27-4a8d-8988-a74ecf524f30 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:52.992110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-628fd274-5b27-4a8d-8988-a74ecf524f30 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:53.000854 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-628fd274-5b27-4a8d-8988-a74ecf524f30 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1392 microversion: 2.1 time: 0.254583 Mar 12 21:14:53.002077 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3726/4494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:52 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:53.242081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-18f2b484-d253-4782-bc01-a521bec5a7cc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:53.242736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-18f2b484-d253-4782-bc01-a521bec5a7cc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:53.260474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18f2b484-d253-4782-bc01-a521bec5a7cc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:53.261391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18f2b484-d253-4782-bc01-a521bec5a7cc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:53.262448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18f2b484-d253-4782-bc01-a521bec5a7cc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:53.263187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18f2b484-d253-4782-bc01-a521bec5a7cc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:53.639436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-18f2b484-d253-4782-bc01-a521bec5a7cc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:53.656826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-18f2b484-d253-4782-bc01-a521bec5a7cc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:53.660374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-18f2b484-d253-4782-bc01-a521bec5a7cc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:53.662855 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-18f2b484-d253-4782-bc01-a521bec5a7cc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 2907 microversion: 2.32 time: 0.429843 Mar 12 21:14:53.664577 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3727/4495] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:14:53 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 2907 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:14:54.017710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad0508e9-81a8-437e-81b8-a751f27bc131 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:54.018357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad0508e9-81a8-437e-81b8-a751f27bc131 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:54.028150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad0508e9-81a8-437e-81b8-a751f27bc131 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:54.029562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad0508e9-81a8-437e-81b8-a751f27bc131 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:54.030567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad0508e9-81a8-437e-81b8-a751f27bc131 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:54.031214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad0508e9-81a8-437e-81b8-a751f27bc131 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:54.271840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad0508e9-81a8-437e-81b8-a751f27bc131 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:54.281085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad0508e9-81a8-437e-81b8-a751f27bc131 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1564 microversion: 2.1 time: 0.267043 Mar 12 21:14:54.282127 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3728/4496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:54 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1564 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:14:54.286908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-416bfe61-8365-408b-8634-6259b7514351 req-6a76821f-d618-4ee0-acbb-6945f8ca2a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-deleted", "tag": "36bd6dd0-f857-47f1-81d0-ab99988c0627"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:54.298987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-416bfe61-8365-408b-8634-6259b7514351 req-6a76821f-d618-4ee0-acbb-6945f8ca2a5d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:54.299723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-416bfe61-8365-408b-8634-6259b7514351 req-6a76821f-d618-4ee0-acbb-6945f8ca2a5d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:54.315911 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-416bfe61-8365-408b-8634-6259b7514351 req-6a76821f-d618-4ee0-acbb-6945f8ca2a5d service nova] Creating event network-vif-deleted:36bd6dd0-f857-47f1-81d0-ab99988c0627 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:14:54.328187 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-416bfe61-8365-408b-8634-6259b7514351 req-6a76821f-d618-4ee0-acbb-6945f8ca2a5d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038159 Mar 12 21:14:54.328997 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3729/4497] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:54.334800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-656cdc1d-3d17-462c-846e-a6fdb8e9819a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:54.335446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-656cdc1d-3d17-462c-846e-a6fdb8e9819a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:54.344383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-656cdc1d-3d17-462c-846e-a6fdb8e9819a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:54.345117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-656cdc1d-3d17-462c-846e-a6fdb8e9819a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:54.347557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-656cdc1d-3d17-462c-846e-a6fdb8e9819a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:54.348239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-656cdc1d-3d17-462c-846e-a6fdb8e9819a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:54.625745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-656cdc1d-3d17-462c-846e-a6fdb8e9819a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:54.635976 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-656cdc1d-3d17-462c-846e-a6fdb8e9819a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1564 microversion: 2.1 time: 0.305939 Mar 12 21:14:54.639732 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3730/4498] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:54 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1564 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:14:54.685079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12b77507-7746-4afe-abe5-f14c1d6224cb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:54.685783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-12b77507-7746-4afe-abe5-f14c1d6224cb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:54.699912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12b77507-7746-4afe-abe5-f14c1d6224cb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:54.700390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12b77507-7746-4afe-abe5-f14c1d6224cb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:54.701199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12b77507-7746-4afe-abe5-f14c1d6224cb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:54.701644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12b77507-7746-4afe-abe5-f14c1d6224cb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:54.950643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-12b77507-7746-4afe-abe5-f14c1d6224cb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:54.964311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-12b77507-7746-4afe-abe5-f14c1d6224cb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:54.966545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-12b77507-7746-4afe-abe5-f14c1d6224cb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:54.968175 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-12b77507-7746-4afe-abe5-f14c1d6224cb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 2701 microversion: 2.32 time: 0.287456 Mar 12 21:14:54.970100 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3731/4499] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:14:54 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 2701 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:14:55.988259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8623963c-7ccd-4d4f-98d9-1f6255105171 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:55.988899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8623963c-7ccd-4d4f-98d9-1f6255105171 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:56.000807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8623963c-7ccd-4d4f-98d9-1f6255105171 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:56.001564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8623963c-7ccd-4d4f-98d9-1f6255105171 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:56.002553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8623963c-7ccd-4d4f-98d9-1f6255105171 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:56.003549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8623963c-7ccd-4d4f-98d9-1f6255105171 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:56.425223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8623963c-7ccd-4d4f-98d9-1f6255105171 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:56.459375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8623963c-7ccd-4d4f-98d9-1f6255105171 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:56.464202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8623963c-7ccd-4d4f-98d9-1f6255105171 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:56.469184 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8623963c-7ccd-4d4f-98d9-1f6255105171 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 2655 microversion: 2.32 time: 0.484814 Mar 12 21:14:56.473416 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3732/4500] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:14:55 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 2655 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:14:56.505930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-eed61ad6-040a-4b43-95cc-22c1c01899a3 req-d1e3dee0-b934-4517-84a9-af8d923a931a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-deleted", "tag": "bdf07d65-9fbe-4b43-8a5a-80bc9ee4ab02"}, {"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-deleted", "tag": "d6d53430-b25f-48da-b813-b4ea2577b13f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:56.527349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-eed61ad6-040a-4b43-95cc-22c1c01899a3 req-d1e3dee0-b934-4517-84a9-af8d923a931a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:56.530554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-eed61ad6-040a-4b43-95cc-22c1c01899a3 req-d1e3dee0-b934-4517-84a9-af8d923a931a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:56.556259 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-eed61ad6-040a-4b43-95cc-22c1c01899a3 req-d1e3dee0-b934-4517-84a9-af8d923a931a service nova] Creating event network-vif-deleted:bdf07d65-9fbe-4b43-8a5a-80bc9ee4ab02 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:14:56.556789 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-eed61ad6-040a-4b43-95cc-22c1c01899a3 req-d1e3dee0-b934-4517-84a9-af8d923a931a service nova] Creating event network-vif-deleted:d6d53430-b25f-48da-b813-b4ea2577b13f for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:14:56.573129 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-eed61ad6-040a-4b43-95cc-22c1c01899a3 req-d1e3dee0-b934-4517-84a9-af8d923a931a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078771 Mar 12 21:14:56.574096 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3733/4501] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:56.706090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-341a3932-d6f8-49a8-b049-d13483595f2d req-6db9e583-84e9-486b-ae76-c95622e75953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-unplugged", "status": "completed", "tag": "d7cad44c-ac79-49fd-81f5-358305a16691"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:56.756294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-341a3932-d6f8-49a8-b049-d13483595f2d req-6db9e583-84e9-486b-ae76-c95622e75953 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:56.756749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-341a3932-d6f8-49a8-b049-d13483595f2d req-6db9e583-84e9-486b-ae76-c95622e75953 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:56.782738 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-341a3932-d6f8-49a8-b049-d13483595f2d req-6db9e583-84e9-486b-ae76-c95622e75953 service nova] Creating event network-vif-unplugged:d7cad44c-ac79-49fd-81f5-358305a16691 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:14:56.799537 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-341a3932-d6f8-49a8-b049-d13483595f2d req-6db9e583-84e9-486b-ae76-c95622e75953 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097914 Mar 12 21:14:56.800454 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3734/4502] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:57.499225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1722da63-a53c-488f-be89-e4377fba747a tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:57.504897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1722da63-a53c-488f-be89-e4377fba747a tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:57.525756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1722da63-a53c-488f-be89-e4377fba747a tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:57.527570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1722da63-a53c-488f-be89-e4377fba747a tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:57.530737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1722da63-a53c-488f-be89-e4377fba747a tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:57.531505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1722da63-a53c-488f-be89-e4377fba747a tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:57.824539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1722da63-a53c-488f-be89-e4377fba747a tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:57.834541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1722da63-a53c-488f-be89-e4377fba747a tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:57.836091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1722da63-a53c-488f-be89-e4377fba747a tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:57.837354 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1722da63-a53c-488f-be89-e4377fba747a tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 2339 microversion: 2.32 time: 0.344130 Mar 12 21:14:57.837971 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3735/4503] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:14:57 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 2339 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 12 21:14:58.629081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e2f1f386-55f3-42b3-b201-eb0963a61b82 req-884f25de-15a0-4aab-a915-8495d2405351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-deleted", "tag": "b4fcc1fc-d404-45a3-b9fb-ccf200735b91"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:14:58.642728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e2f1f386-55f3-42b3-b201-eb0963a61b82 req-884f25de-15a0-4aab-a915-8495d2405351 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:58.648685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e2f1f386-55f3-42b3-b201-eb0963a61b82 req-884f25de-15a0-4aab-a915-8495d2405351 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:58.673891 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e2f1f386-55f3-42b3-b201-eb0963a61b82 req-884f25de-15a0-4aab-a915-8495d2405351 service nova] Creating event network-vif-deleted:b4fcc1fc-d404-45a3-b9fb-ccf200735b91 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:14:58.686518 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e2f1f386-55f3-42b3-b201-eb0963a61b82 req-884f25de-15a0-4aab-a915-8495d2405351 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061438 Mar 12 21:14:58.690960 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3736/4504] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:14:58.857243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-036cf4d5-2342-480b-8373-3c163de1f32e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:58.857990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-036cf4d5-2342-480b-8373-3c163de1f32e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:58.879987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-036cf4d5-2342-480b-8373-3c163de1f32e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:58.881012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-036cf4d5-2342-480b-8373-3c163de1f32e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:58.882631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-036cf4d5-2342-480b-8373-3c163de1f32e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:58.886937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-036cf4d5-2342-480b-8373-3c163de1f32e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:58.977489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-036cf4d5-2342-480b-8373-3c163de1f32e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:59.003334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-036cf4d5-2342-480b-8373-3c163de1f32e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:59.004877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-036cf4d5-2342-480b-8373-3c163de1f32e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:59.006153 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-036cf4d5-2342-480b-8373-3c163de1f32e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 2158 microversion: 2.32 time: 0.153308 Mar 12 21:14:59.018310 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3737/4505] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:14:58 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 2158 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:14:59.188519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6af7e488-eb53-4444-8d2b-31bd42ddcb64 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:14:59.189128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6af7e488-eb53-4444-8d2b-31bd42ddcb64 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:14:59.200241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6af7e488-eb53-4444-8d2b-31bd42ddcb64 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:59.200993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6af7e488-eb53-4444-8d2b-31bd42ddcb64 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:59.202005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6af7e488-eb53-4444-8d2b-31bd42ddcb64 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:14:59.204545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6af7e488-eb53-4444-8d2b-31bd42ddcb64 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:14:59.562045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6af7e488-eb53-4444-8d2b-31bd42ddcb64 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:14:59.578051 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6af7e488-eb53-4444-8d2b-31bd42ddcb64 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1564 microversion: 2.1 time: 0.393890 Mar 12 21:14:59.583607 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3738/4506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:14:59 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1564 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:00.027349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-17940bfd-3eb7-4b3c-b125-d8cbde5dc2fb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:00.028067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-17940bfd-3eb7-4b3c-b125-d8cbde5dc2fb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:00.062279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17940bfd-3eb7-4b3c-b125-d8cbde5dc2fb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:00.064879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17940bfd-3eb7-4b3c-b125-d8cbde5dc2fb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:00.065758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17940bfd-3eb7-4b3c-b125-d8cbde5dc2fb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:00.066439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17940bfd-3eb7-4b3c-b125-d8cbde5dc2fb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:00.257191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-17940bfd-3eb7-4b3c-b125-d8cbde5dc2fb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:00.271521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-17940bfd-3eb7-4b3c-b125-d8cbde5dc2fb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:00.274449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-17940bfd-3eb7-4b3c-b125-d8cbde5dc2fb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cb5f0a9eb48441c6844afe3d559af06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e4429fb88f43b4b511a4fed7fd2caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:00.281289 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-17940bfd-3eb7-4b3c-b125-d8cbde5dc2fb tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 200 len: 1605 microversion: 2.32 time: 0.253019 Mar 12 21:15:00.283963 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3739/4507] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:15:00 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 1605 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 12 21:15:00.724603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8470e6b7-4c50-474a-9950-05ea3d7a851b req-84f115b4-a404-4d52-920c-7592bb2e5351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9896014-d757-4c57-9279-0aa92533121b", "tag": "9dba12ae-2168-465a-9f58-ee424e8cb6ce"}, {"server_uuid": "73e1b717-98b1-4923-ad74-7611a4bc2371", "name": "network-vif-deleted", "tag": "d7cad44c-ac79-49fd-81f5-358305a16691"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:00.734920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8470e6b7-4c50-474a-9950-05ea3d7a851b req-84f115b4-a404-4d52-920c-7592bb2e5351 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:00.735783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8470e6b7-4c50-474a-9950-05ea3d7a851b req-84f115b4-a404-4d52-920c-7592bb2e5351 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:00.758530 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8470e6b7-4c50-474a-9950-05ea3d7a851b req-84f115b4-a404-4d52-920c-7592bb2e5351 service nova] Creating event network-changed:9dba12ae-2168-465a-9f58-ee424e8cb6ce for instance d9896014-d757-4c57-9279-0aa92533121b on nch2-master-1 Mar 12 21:15:00.759047 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8470e6b7-4c50-474a-9950-05ea3d7a851b req-84f115b4-a404-4d52-920c-7592bb2e5351 service nova] Creating event network-vif-deleted:d7cad44c-ac79-49fd-81f5-358305a16691 for instance 73e1b717-98b1-4923-ad74-7611a4bc2371 on nch2-master-1 Mar 12 21:15:00.767325 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8470e6b7-4c50-474a-9950-05ea3d7a851b req-84f115b4-a404-4d52-920c-7592bb2e5351 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048075 Mar 12 21:15:00.768540 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3740/4508] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:01.305256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce847f03-1424-48e6-8bc1-9a63cdaeac69 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:01.305993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce847f03-1424-48e6-8bc1-9a63cdaeac69 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:01.318103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce847f03-1424-48e6-8bc1-9a63cdaeac69 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:01.321226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce847f03-1424-48e6-8bc1-9a63cdaeac69 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:01.324399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce847f03-1424-48e6-8bc1-9a63cdaeac69 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:01.325019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce847f03-1424-48e6-8bc1-9a63cdaeac69 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:01.359082 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ce847f03-1424-48e6-8bc1-9a63cdaeac69 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] HTTP exception thrown: Instance 73e1b717-98b1-4923-ad74-7611a4bc2371 could not be found. Mar 12 21:15:01.360504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce847f03-1424-48e6-8bc1-9a63cdaeac69 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Returning 404 to user: Instance 73e1b717-98b1-4923-ad74-7611a4bc2371 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:15:01.361651 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce847f03-1424-48e6-8bc1-9a63cdaeac69 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 404 len: 111 microversion: 2.32 time: 0.062926 Mar 12 21:15:01.363115 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3741/4509] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:15:01 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:15:01.376268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-02484e37-99cd-4fc2-9ac5-dd630380d65e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '.version_select at 0x7f6e3565c820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:01.411551 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-02484e37-99cd-4fc2-9ac5-dd630380d65e tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525760273" status: 204 len: 0 microversion: 2.32 time: 0.040665 Mar 12 21:15:01.412484 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3742/4510] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Mar 12 21:15:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525760273 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 12 21:15:07.115742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8768c467-0923-4203-a6a4-846e8ecea2dc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:07.116290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8768c467-0923-4203-a6a4-846e8ecea2dc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:07.131451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8768c467-0923-4203-a6a4-846e8ecea2dc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:07.136374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8768c467-0923-4203-a6a4-846e8ecea2dc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:07.138987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8768c467-0923-4203-a6a4-846e8ecea2dc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:07.139796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8768c467-0923-4203-a6a4-846e8ecea2dc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:07.191074 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8768c467-0923-4203-a6a4-846e8ecea2dc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] HTTP exception thrown: Instance 73e1b717-98b1-4923-ad74-7611a4bc2371 could not be found. Mar 12 21:15:07.191859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8768c467-0923-4203-a6a4-846e8ecea2dc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Returning 404 to user: Instance 73e1b717-98b1-4923-ad74-7611a4bc2371 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:15:07.196509 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8768c467-0923-4203-a6a4-846e8ecea2dc tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "DELETE /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 404 len: 111 microversion: 2.32 time: 0.089176 Mar 12 21:15:07.197462 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3743/4511] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Mar 12 21:15:07 2022] DELETE /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:15:07.210739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-231c64ba-3f2a-491f-8ea9-1db6e009ed94 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:07.211953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-231c64ba-3f2a-491f-8ea9-1db6e009ed94 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] [instance: 73e1b717-98b1-4923-ad74-7611a4bc2371] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:07.225237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-231c64ba-3f2a-491f-8ea9-1db6e009ed94 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:07.226640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-231c64ba-3f2a-491f-8ea9-1db6e009ed94 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:07.235972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-231c64ba-3f2a-491f-8ea9-1db6e009ed94 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:07.238026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-231c64ba-3f2a-491f-8ea9-1db6e009ed94 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:07.268242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-231c64ba-3f2a-491f-8ea9-1db6e009ed94 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] HTTP exception thrown: Instance 73e1b717-98b1-4923-ad74-7611a4bc2371 could not be found. Mar 12 21:15:07.269119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-231c64ba-3f2a-491f-8ea9-1db6e009ed94 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] Returning 404 to user: Instance 73e1b717-98b1-4923-ad74-7611a4bc2371 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:15:07.270682 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-231c64ba-3f2a-491f-8ea9-1db6e009ed94 tempest-TaggedBootDevicesTest-378912436 tempest-TaggedBootDevicesTest-378912436-project] 10.222.0.30 "GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371" status: 404 len: 111 microversion: 2.32 time: 0.068964 Mar 12 21:15:07.271866 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3744/4512] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Mar 12 21:15:07 2022] GET /compute/v2.1/servers/73e1b717-98b1-4923-ad74-7611a4bc2371 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 12 21:15:13.111079 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:15:13.112171 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:15:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:15:15.564388 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:15:15.565108 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:15:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:15:15.799973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1010313343", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8218e946-7910-4db9-8525-92d33d1f7a62", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "9594c761-7638-4f69-b579-79baa62b3c38"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:15.933470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] validate_networks() for [('9594c761-7638-4f69-b579-79baa62b3c38', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:15:17.033256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:15:17.035145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:15:17.035936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:15:17.037226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:15:17.038244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:15:17.072775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:17.072775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:17.072775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:17.072775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:17.100105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:15:17.107386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for user 284a1908713c4b74a35a1d3b5cd10e80 and project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:15:17.129459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:15:17.134532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8218e946-7910-4db9-8525-92d33d1f7a62',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:15:17.214317 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-abbde679-de26-474d-b4d5-1d1af09a1d8d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.418910 Mar 12 21:15:17.215908 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3745/4513] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:15:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:15:17.226147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f3f97af9-2afa-483d-ac64-c19168edcc13 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:17.226979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f3f97af9-2afa-483d-ac64-c19168edcc13 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:17.316833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f3f97af9-2afa-483d-ac64-c19168edcc13 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:17.327714 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f3f97af9-2afa-483d-ac64-c19168edcc13 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1057 microversion: 2.1 time: 0.105033 Mar 12 21:15:17.328356 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3746/4514] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:17 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1057 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:18.179148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1f09bbb-89c2-4446-829b-f348908ef13e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:18.181097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f1f09bbb-89c2-4446-829b-f348908ef13e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:18.188970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1f09bbb-89c2-4446-829b-f348908ef13e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:18.189856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1f09bbb-89c2-4446-829b-f348908ef13e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:18.191089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1f09bbb-89c2-4446-829b-f348908ef13e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:18.191536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1f09bbb-89c2-4446-829b-f348908ef13e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:18.251827 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1f09bbb-89c2-4446-829b-f348908ef13e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b/action" status: 200 len: 24571 microversion: 2.1 time: 0.076697 Mar 12 21:15:18.255715 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3747/4515] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:15:18 2022] POST /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:15:18.349348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34f492f5-840f-4d07-8842-b2481fa72741 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:18.350658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34f492f5-840f-4d07-8842-b2481fa72741 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:18.360211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34f492f5-840f-4d07-8842-b2481fa72741 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:18.361034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34f492f5-840f-4d07-8842-b2481fa72741 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:18.362104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34f492f5-840f-4d07-8842-b2481fa72741 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:18.362710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34f492f5-840f-4d07-8842-b2481fa72741 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:18.658341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34f492f5-840f-4d07-8842-b2481fa72741 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:18.668818 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34f492f5-840f-4d07-8842-b2481fa72741 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1127 microversion: 2.1 time: 0.327418 Mar 12 21:15:18.670276 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3748/4516] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:18 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1127 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:19.687667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1b706bdd-ef1c-42a0-9319-196e6edf397a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:19.688636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1b706bdd-ef1c-42a0-9319-196e6edf397a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:19.707855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b706bdd-ef1c-42a0-9319-196e6edf397a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:19.708686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b706bdd-ef1c-42a0-9319-196e6edf397a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:19.711846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b706bdd-ef1c-42a0-9319-196e6edf397a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:19.712559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b706bdd-ef1c-42a0-9319-196e6edf397a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:19.968009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1b706bdd-ef1c-42a0-9319-196e6edf397a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:19.980280 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1b706bdd-ef1c-42a0-9319-196e6edf397a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1169 microversion: 2.1 time: 0.298023 Mar 12 21:15:19.986395 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3749/4517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:19 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1169 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:20.410677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3b5b971c-0df9-4059-b3f0-0d06bf5d4e3c req-3a697b74-1ff6-4d17-abc8-9181694380bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f79f91-1255-4148-baac-98e39ab439ca", "tag": "5881f0d8-8725-4810-8673-6ddb52f48dd7"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:20.440729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3b5b971c-0df9-4059-b3f0-0d06bf5d4e3c req-3a697b74-1ff6-4d17-abc8-9181694380bc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:20.441395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3b5b971c-0df9-4059-b3f0-0d06bf5d4e3c req-3a697b74-1ff6-4d17-abc8-9181694380bc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:20.475716 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3b5b971c-0df9-4059-b3f0-0d06bf5d4e3c req-3a697b74-1ff6-4d17-abc8-9181694380bc service nova] Creating event network-changed:5881f0d8-8725-4810-8673-6ddb52f48dd7 for instance 40f79f91-1255-4148-baac-98e39ab439ca on nch2-master-1 Mar 12 21:15:20.485859 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3b5b971c-0df9-4059-b3f0-0d06bf5d4e3c req-3a697b74-1ff6-4d17-abc8-9181694380bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097961 Mar 12 21:15:20.489590 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3750/4518] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:21.004963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e660d092-7e88-4d2d-98af-26a97176bdf8 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:21.005697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e660d092-7e88-4d2d-98af-26a97176bdf8 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:21.016409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e660d092-7e88-4d2d-98af-26a97176bdf8 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:21.017129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e660d092-7e88-4d2d-98af-26a97176bdf8 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:21.018186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e660d092-7e88-4d2d-98af-26a97176bdf8 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:21.018639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e660d092-7e88-4d2d-98af-26a97176bdf8 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:21.361712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e660d092-7e88-4d2d-98af-26a97176bdf8 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:21.369695 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e660d092-7e88-4d2d-98af-26a97176bdf8 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1169 microversion: 2.1 time: 0.371791 Mar 12 21:15:21.380773 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3751/4519] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:20 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1169 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:22.390981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3a13bdae-7b18-461b-953f-b724dffda59e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:22.391787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3a13bdae-7b18-461b-953f-b724dffda59e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:22.400068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a13bdae-7b18-461b-953f-b724dffda59e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:22.401019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a13bdae-7b18-461b-953f-b724dffda59e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:22.402203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a13bdae-7b18-461b-953f-b724dffda59e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:22.402860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3a13bdae-7b18-461b-953f-b724dffda59e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:22.604205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3a13bdae-7b18-461b-953f-b724dffda59e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:22.613395 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3a13bdae-7b18-461b-953f-b724dffda59e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1169 microversion: 2.1 time: 0.228500 Mar 12 21:15:22.614606 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3752/4520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:22 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1169 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:23.630152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2e9b206a-5e7e-4ba9-b11a-18fd31b61d3c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:23.630778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2e9b206a-5e7e-4ba9-b11a-18fd31b61d3c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:23.638221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e9b206a-5e7e-4ba9-b11a-18fd31b61d3c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:23.638682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e9b206a-5e7e-4ba9-b11a-18fd31b61d3c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:23.639494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e9b206a-5e7e-4ba9-b11a-18fd31b61d3c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:23.639937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e9b206a-5e7e-4ba9-b11a-18fd31b61d3c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:23.788866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2e9b206a-5e7e-4ba9-b11a-18fd31b61d3c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:23.796766 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2e9b206a-5e7e-4ba9-b11a-18fd31b61d3c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1203 microversion: 2.1 time: 0.170375 Mar 12 21:15:23.797520 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3753/4521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:23 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:24.694490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-62aa884b-898f-4aff-a83a-e532341f9601 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:24.695252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-62aa884b-898f-4aff-a83a-e532341f9601 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:24.704575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62aa884b-898f-4aff-a83a-e532341f9601 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:24.709680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62aa884b-898f-4aff-a83a-e532341f9601 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:24.710561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62aa884b-898f-4aff-a83a-e532341f9601 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:24.711021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62aa884b-898f-4aff-a83a-e532341f9601 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:24.880922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-62aa884b-898f-4aff-a83a-e532341f9601 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:24.889114 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-62aa884b-898f-4aff-a83a-e532341f9601 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1683 microversion: 2.1 time: 0.198515 Mar 12 21:15:24.889692 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3754/4522] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:24 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1683 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:24.894322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4dea01e7-ea71-452d-a11e-9b3758f77275 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:24.894815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4dea01e7-ea71-452d-a11e-9b3758f77275 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:24.900602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4dea01e7-ea71-452d-a11e-9b3758f77275 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:24.901057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4dea01e7-ea71-452d-a11e-9b3758f77275 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:24.901857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4dea01e7-ea71-452d-a11e-9b3758f77275 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:24.902953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4dea01e7-ea71-452d-a11e-9b3758f77275 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:24.983051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-4dea01e7-ea71-452d-a11e-9b3758f77275 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lazy-loading 'services' on Instance uuid f64431cf-644f-47c1-86eb-e1d12fda3937 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:15:25.049938 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4dea01e7-ea71-452d-a11e-9b3758f77275 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937/os-volume_attachments/7aa69d6a-de21-48b0-a279-c3e51e53b549" status: 202 len: 0 microversion: 2.1 time: 0.158966 Mar 12 21:15:25.050517 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3755/4523] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:15:24 2022] DELETE /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937/os-volume_attachments/7aa69d6a-de21-48b0-a279-c3e51e53b549 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:15:25.174887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1477725354", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "ce7fea5a-3eae-467b-bf69-7520f28242b5"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:25.226151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] validate_networks() for [('ce7fea5a-3eae-467b-bf69-7520f28242b5', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:15:25.558079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:15:25.559042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:15:25.559527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:15:25.559941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:15:25.560358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:15:25.568947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:25.569395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:25.570263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:25.570700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:25.587536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Getting quotas for project f53824c1b6294e158b07b6761fca67de. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:15:25.592643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Getting quotas for user 400f96438d0e4672ade671a9af0c786d and project f53824c1b6294e158b07b6761fca67de. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:15:25.605080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Going to run 2 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:15:25.608016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 0e610120-daea-4c80-9bcf-12b3d6b86859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:15:25.638693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: feed0155-4d0f-4464-970b-0ae3fb4e0cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=0e610120-daea-4c80-9bcf-12b3d6b86859,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:15:25.693575 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-554f717a-3063-4fe9-a884-00c3acd4bdd0 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641462 Mar 12 21:15:25.694436 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3756/4524] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:15:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:15:25.698747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-84e9837f-235a-4006-8ce2-d7dc063321d1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:25.699384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-84e9837f-235a-4006-8ce2-d7dc063321d1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:25.707108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84e9837f-235a-4006-8ce2-d7dc063321d1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:25.707567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84e9837f-235a-4006-8ce2-d7dc063321d1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:25.708358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84e9837f-235a-4006-8ce2-d7dc063321d1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:25.708803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84e9837f-235a-4006-8ce2-d7dc063321d1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:25.861495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-84e9837f-235a-4006-8ce2-d7dc063321d1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:25.870251 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-84e9837f-235a-4006-8ce2-d7dc063321d1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1203 microversion: 2.1 time: 0.174904 Mar 12 21:15:25.870847 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3757/4525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:25 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:25.875971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1e3f1eac-bfa3-423f-af98-23877fd76bff tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:25.876954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1e3f1eac-bfa3-423f-af98-23877fd76bff tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:25.884114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e3f1eac-bfa3-423f-af98-23877fd76bff tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:25.884578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e3f1eac-bfa3-423f-af98-23877fd76bff tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:25.885368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e3f1eac-bfa3-423f-af98-23877fd76bff tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:25.885842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e3f1eac-bfa3-423f-af98-23877fd76bff tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:25.949395 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1e3f1eac-bfa3-423f-af98-23877fd76bff tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b/action" status: 200 len: 32645 microversion: 2.1 time: 0.076736 Mar 12 21:15:25.965791 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3758/4526] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:15:25 2022] POST /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b/action => generated 32645 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 21:15:25.965791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abd14a4b-dd43-409e-bb40-ea6163fdefae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:25.965791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-abd14a4b-dd43-409e-bb40-ea6163fdefae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:25.965791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-abd14a4b-dd43-409e-bb40-ea6163fdefae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Searching by: {'deleted': False, 'project_id': 'f53824c1b6294e158b07b6761fca67de'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 21:15:25.979491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abd14a4b-dd43-409e-bb40-ea6163fdefae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:25.979870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abd14a4b-dd43-409e-bb40-ea6163fdefae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:25.981277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abd14a4b-dd43-409e-bb40-ea6163fdefae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:25.981731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abd14a4b-dd43-409e-bb40-ea6163fdefae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:26.004922 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-abd14a4b-dd43-409e-bb40-ea6163fdefae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.052266 Mar 12 21:15:26.005619 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3759/4527] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 21:15:25 2022] GET /compute/v2.1/servers => generated 677 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:26.015538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be8ebd7a-e5de-43cc-a57c-52c993535208 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:26.016269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-be8ebd7a-e5de-43cc-a57c-52c993535208 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: feed0155-4d0f-4464-970b-0ae3fb4e0cc5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:26.075906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be8ebd7a-e5de-43cc-a57c-52c993535208 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:26.082877 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be8ebd7a-e5de-43cc-a57c-52c993535208 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5" status: 200 len: 1220 microversion: 2.1 time: 0.071023 Mar 12 21:15:26.083473 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3760/4528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:26 2022] GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5 => generated 1220 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:26.088491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cf1a8953-8b8a-4bea-9b85-9825cb30b699 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:26.088673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cf1a8953-8b8a-4bea-9b85-9825cb30b699 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:26.095403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf1a8953-8b8a-4bea-9b85-9825cb30b699 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:26.095868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf1a8953-8b8a-4bea-9b85-9825cb30b699 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:26.096707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf1a8953-8b8a-4bea-9b85-9825cb30b699 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:26.097157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf1a8953-8b8a-4bea-9b85-9825cb30b699 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:26.243287 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cf1a8953-8b8a-4bea-9b85-9825cb30b699 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1834 microversion: 2.1 time: 0.158474 Mar 12 21:15:26.244106 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3761/4529] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:26 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1834 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:26.249834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2bbf8542-7653-4d4d-9d28-46f121912c57 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:26.250530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2bbf8542-7653-4d4d-9d28-46f121912c57 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:26.258330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2bbf8542-7653-4d4d-9d28-46f121912c57 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:26.259047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2bbf8542-7653-4d4d-9d28-46f121912c57 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:26.259826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2bbf8542-7653-4d4d-9d28-46f121912c57 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:26.260261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2bbf8542-7653-4d4d-9d28-46f121912c57 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:26.285719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2bbf8542-7653-4d4d-9d28-46f121912c57 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:15:26.375163 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2bbf8542-7653-4d4d-9d28-46f121912c57 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 204 len: 0 microversion: 2.1 time: 0.128492 Mar 12 21:15:26.375941 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3762/4530] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:15:26 2022] DELETE /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:15:26.382451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f70f3c52-f508-4ad1-a1f3-d0a75efc2fa0 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:26.384085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f70f3c52-f508-4ad1-a1f3-d0a75efc2fa0 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:26.390700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f70f3c52-f508-4ad1-a1f3-d0a75efc2fa0 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:26.391228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f70f3c52-f508-4ad1-a1f3-d0a75efc2fa0 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:26.392156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f70f3c52-f508-4ad1-a1f3-d0a75efc2fa0 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:26.392852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f70f3c52-f508-4ad1-a1f3-d0a75efc2fa0 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:26.422391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-f70f3c52-f508-4ad1-a1f3-d0a75efc2fa0 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lazy-loading 'flavor' on Instance uuid d9896014-d757-4c57-9279-0aa92533121b {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:15:26.436715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f70f3c52-f508-4ad1-a1f3-d0a75efc2fa0 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: d9896014-d757-4c57-9279-0aa92533121b] Going to try to live migrate instance to another host {{(pid=136302) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Mar 12 21:15:28.466099 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f70f3c52-f508-4ad1-a1f3-d0a75efc2fa0 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b/action" status: 202 len: 0 microversion: 2.1 time: 2.088696 Mar 12 21:15:28.467072 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3763/4531] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:15:26 2022] POST /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b/action => generated 0 bytes in 2090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:15:28.473489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-46784883-43f5-4168-bc44-16c4ee9836c8 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:28.474253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-46784883-43f5-4168-bc44-16c4ee9836c8 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:28.485763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46784883-43f5-4168-bc44-16c4ee9836c8 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:28.487729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46784883-43f5-4168-bc44-16c4ee9836c8 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:28.488559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46784883-43f5-4168-bc44-16c4ee9836c8 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:28.488997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46784883-43f5-4168-bc44-16c4ee9836c8 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:28.706774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-46784883-43f5-4168-bc44-16c4ee9836c8 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:28.716394 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-46784883-43f5-4168-bc44-16c4ee9836c8 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1512 microversion: 2.1 time: 0.248479 Mar 12 21:15:28.717291 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3764/4532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:28 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:28.723074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27e823ad-4029-4ff6-a266-aee9f745ec18 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:28.723976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27e823ad-4029-4ff6-a266-aee9f745ec18 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:28.730390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27e823ad-4029-4ff6-a266-aee9f745ec18 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:28.730928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27e823ad-4029-4ff6-a266-aee9f745ec18 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:28.732078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27e823ad-4029-4ff6-a266-aee9f745ec18 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:28.733435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27e823ad-4029-4ff6-a266-aee9f745ec18 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:28.989472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27e823ad-4029-4ff6-a266-aee9f745ec18 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:29.000150 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27e823ad-4029-4ff6-a266-aee9f745ec18 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1203 microversion: 2.1 time: 0.281518 Mar 12 21:15:29.000790 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3765/4533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:28 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1203 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:29.006133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f3c64184-15fa-449c-9164-7b2b2686d0ee tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:29.007101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f3c64184-15fa-449c-9164-7b2b2686d0ee tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: feed0155-4d0f-4464-970b-0ae3fb4e0cc5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:29.014673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3c64184-15fa-449c-9164-7b2b2686d0ee tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:29.015507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3c64184-15fa-449c-9164-7b2b2686d0ee tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:29.017217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3c64184-15fa-449c-9164-7b2b2686d0ee tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:29.017729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3c64184-15fa-449c-9164-7b2b2686d0ee tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:29.280593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f3c64184-15fa-449c-9164-7b2b2686d0ee tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:29.289213 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f3c64184-15fa-449c-9164-7b2b2686d0ee tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5" status: 200 len: 1320 microversion: 2.1 time: 0.287123 Mar 12 21:15:29.290272 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3766/4534] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:29 2022] GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5 => generated 1320 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:29.299030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-85a3a37a-d716-4127-ab55-3719fa083e24 req-61ed6d95-853c-4fba-a3ec-e37659ffce0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f79f91-1255-4148-baac-98e39ab439ca", "name": "network-vif-plugged", "status": "completed", "tag": "5881f0d8-8725-4810-8673-6ddb52f48dd7"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:29.309415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-85a3a37a-d716-4127-ab55-3719fa083e24 req-61ed6d95-853c-4fba-a3ec-e37659ffce0a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:29.310244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-85a3a37a-d716-4127-ab55-3719fa083e24 req-61ed6d95-853c-4fba-a3ec-e37659ffce0a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:29.321826 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-85a3a37a-d716-4127-ab55-3719fa083e24 req-61ed6d95-853c-4fba-a3ec-e37659ffce0a service nova] Creating event network-vif-plugged:5881f0d8-8725-4810-8673-6ddb52f48dd7 for instance 40f79f91-1255-4148-baac-98e39ab439ca on nch2-master-1 Mar 12 21:15:29.327697 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-85a3a37a-d716-4127-ab55-3719fa083e24 req-61ed6d95-853c-4fba-a3ec-e37659ffce0a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036100 Mar 12 21:15:29.328508 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3767/4535] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:29.334110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2526550e-31cf-4795-b775-776a8ecacf58 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:29.334818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2526550e-31cf-4795-b775-776a8ecacf58 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:29.341674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2526550e-31cf-4795-b775-776a8ecacf58 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:29.342247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2526550e-31cf-4795-b775-776a8ecacf58 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:29.343084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2526550e-31cf-4795-b775-776a8ecacf58 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:29.343839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2526550e-31cf-4795-b775-776a8ecacf58 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:29.615743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2526550e-31cf-4795-b775-776a8ecacf58 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:29.625556 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2526550e-31cf-4795-b775-776a8ecacf58 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1693 microversion: 2.1 time: 0.295731 Mar 12 21:15:29.635651 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3768/4536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:29 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1693 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:29.635651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ccd0218e-dcab-4839-8d01-a0f9d99aec88 req-9385142e-8aea-42f1-8e4b-155a7506907f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feed0155-4d0f-4464-970b-0ae3fb4e0cc5", "tag": "052194b3-1654-40cc-949e-9ac1b123b29b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:29.643663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ccd0218e-dcab-4839-8d01-a0f9d99aec88 req-9385142e-8aea-42f1-8e4b-155a7506907f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:29.644926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ccd0218e-dcab-4839-8d01-a0f9d99aec88 req-9385142e-8aea-42f1-8e4b-155a7506907f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:29.658462 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ccd0218e-dcab-4839-8d01-a0f9d99aec88 req-9385142e-8aea-42f1-8e4b-155a7506907f service nova] Creating event network-changed:052194b3-1654-40cc-949e-9ac1b123b29b for instance feed0155-4d0f-4464-970b-0ae3fb4e0cc5 on nch2-master-1 Mar 12 21:15:29.663905 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ccd0218e-dcab-4839-8d01-a0f9d99aec88 req-9385142e-8aea-42f1-8e4b-155a7506907f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036054 Mar 12 21:15:29.664797 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3769/4537] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:29.734855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4f658aa3-f9f8-41c8-876b-d6b4aa851bac req-a99a03da-44ab-47d3-a3d1-71b766bb7738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e610120-daea-4c80-9bcf-12b3d6b86859", "tag": "87f9cdc8-0e6e-4dd4-bbe6-f2d6ffc075d8"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:29.742964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4f658aa3-f9f8-41c8-876b-d6b4aa851bac req-a99a03da-44ab-47d3-a3d1-71b766bb7738 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:29.743422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4f658aa3-f9f8-41c8-876b-d6b4aa851bac req-a99a03da-44ab-47d3-a3d1-71b766bb7738 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:29.754136 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4f658aa3-f9f8-41c8-876b-d6b4aa851bac req-a99a03da-44ab-47d3-a3d1-71b766bb7738 service nova] Creating event network-changed:87f9cdc8-0e6e-4dd4-bbe6-f2d6ffc075d8 for instance 0e610120-daea-4c80-9bcf-12b3d6b86859 on nch1-master-1 Mar 12 21:15:29.758903 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4f658aa3-f9f8-41c8-876b-d6b4aa851bac req-a99a03da-44ab-47d3-a3d1-71b766bb7738 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092293 Mar 12 21:15:29.760239 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3770/4538] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:29.765368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14705f64-151e-4a46-9566-9263563af837 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:29.766098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14705f64-151e-4a46-9566-9263563af837 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:29.772701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14705f64-151e-4a46-9566-9263563af837 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:29.773166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14705f64-151e-4a46-9566-9263563af837 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:29.774231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14705f64-151e-4a46-9566-9263563af837 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:29.774446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14705f64-151e-4a46-9566-9263563af837 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:29.852265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14705f64-151e-4a46-9566-9263563af837 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d0c07fcae34c48b4c0ed61c4cec1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd30a0195c6334b39a246a88b1f4cc81f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:29.863647 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14705f64-151e-4a46-9566-9263563af837 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 200 len: 1470 microversion: 2.1 time: 0.101575 Mar 12 21:15:29.863776 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3771/4539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:29 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 1470 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:30.017430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b687a7f2-92a9-4d63-9e5e-48a187095f45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:30.018086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b687a7f2-92a9-4d63-9e5e-48a187095f45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:30.024584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b687a7f2-92a9-4d63-9e5e-48a187095f45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:30.025040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b687a7f2-92a9-4d63-9e5e-48a187095f45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:30.025887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b687a7f2-92a9-4d63-9e5e-48a187095f45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:30.026337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b687a7f2-92a9-4d63-9e5e-48a187095f45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:30.265669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b687a7f2-92a9-4d63-9e5e-48a187095f45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:30.275768 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b687a7f2-92a9-4d63-9e5e-48a187095f45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1203 microversion: 2.1 time: 0.262386 Mar 12 21:15:30.276403 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3772/4540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:30 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1203 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:30.307563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-986ea905-6082-40eb-b8ee-76c964f46be4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:30.309073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-986ea905-6082-40eb-b8ee-76c964f46be4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: feed0155-4d0f-4464-970b-0ae3fb4e0cc5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:30.316381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-986ea905-6082-40eb-b8ee-76c964f46be4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:30.317092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-986ea905-6082-40eb-b8ee-76c964f46be4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:30.318081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-986ea905-6082-40eb-b8ee-76c964f46be4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:30.318693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-986ea905-6082-40eb-b8ee-76c964f46be4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:30.479552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-986ea905-6082-40eb-b8ee-76c964f46be4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:30.487760 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-986ea905-6082-40eb-b8ee-76c964f46be4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5" status: 200 len: 1320 microversion: 2.1 time: 0.185071 Mar 12 21:15:30.488340 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3773/4541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:30 2022] GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5 => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:30.644306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-893bf64c-37bc-404a-b767-5919df8f7533 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:30.645730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-893bf64c-37bc-404a-b767-5919df8f7533 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:30.653074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-893bf64c-37bc-404a-b767-5919df8f7533 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:30.653274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-893bf64c-37bc-404a-b767-5919df8f7533 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:30.654036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-893bf64c-37bc-404a-b767-5919df8f7533 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:30.654488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-893bf64c-37bc-404a-b767-5919df8f7533 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:30.799214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-893bf64c-37bc-404a-b767-5919df8f7533 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:30.808170 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-893bf64c-37bc-404a-b767-5919df8f7533 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1693 microversion: 2.1 time: 0.168142 Mar 12 21:15:30.809349 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3774/4542] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:30 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:30.881173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-200235fc-e7e3-4eb9-aea8-32341fc03327 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:30.881838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-200235fc-e7e3-4eb9-aea8-32341fc03327 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] [instance: f64431cf-644f-47c1-86eb-e1d12fda3937] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:30.888641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-200235fc-e7e3-4eb9-aea8-32341fc03327 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:30.889106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-200235fc-e7e3-4eb9-aea8-32341fc03327 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:30.889941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-200235fc-e7e3-4eb9-aea8-32341fc03327 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:30.890393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-200235fc-e7e3-4eb9-aea8-32341fc03327 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:30.905307 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-200235fc-e7e3-4eb9-aea8-32341fc03327 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] HTTP exception thrown: Instance f64431cf-644f-47c1-86eb-e1d12fda3937 could not be found. Mar 12 21:15:30.906227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-200235fc-e7e3-4eb9-aea8-32341fc03327 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] Returning 404 to user: Instance f64431cf-644f-47c1-86eb-e1d12fda3937 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:15:30.906716 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-200235fc-e7e3-4eb9-aea8-32341fc03327 tempest-VolumesSnapshotTestJSON-1127165440 tempest-VolumesSnapshotTestJSON-1127165440-project] 10.222.0.30 "GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937" status: 404 len: 111 microversion: 2.1 time: 0.029983 Mar 12 21:15:30.907510 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3775/4543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:30 2022] GET /compute/v2.1/servers/f64431cf-644f-47c1-86eb-e1d12fda3937 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:15:31.292679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d064cfee-97ca-43d3-b5d6-eb2d70e18600 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:31.294593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d064cfee-97ca-43d3-b5d6-eb2d70e18600 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:31.305244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d064cfee-97ca-43d3-b5d6-eb2d70e18600 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:31.305709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d064cfee-97ca-43d3-b5d6-eb2d70e18600 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:31.306531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d064cfee-97ca-43d3-b5d6-eb2d70e18600 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:31.311768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d064cfee-97ca-43d3-b5d6-eb2d70e18600 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:31.484259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d064cfee-97ca-43d3-b5d6-eb2d70e18600 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:31.505395 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d064cfee-97ca-43d3-b5d6-eb2d70e18600 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1389 microversion: 2.1 time: 0.216596 Mar 12 21:15:31.506872 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3776/4544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:31 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1389 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:31.512432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c0af184b-4c98-4bd6-bb4b-6e001531db51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:31.513159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c0af184b-4c98-4bd6-bb4b-6e001531db51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: feed0155-4d0f-4464-970b-0ae3fb4e0cc5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:31.521902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0af184b-4c98-4bd6-bb4b-6e001531db51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:31.522760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0af184b-4c98-4bd6-bb4b-6e001531db51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:31.523850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0af184b-4c98-4bd6-bb4b-6e001531db51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:31.524978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0af184b-4c98-4bd6-bb4b-6e001531db51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:31.717045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0af184b-4c98-4bd6-bb4b-6e001531db51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:31.727339 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c0af184b-4c98-4bd6-bb4b-6e001531db51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5" status: 200 len: 1320 microversion: 2.1 time: 0.219029 Mar 12 21:15:31.737391 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3777/4545] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:31 2022] GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5 => generated 1320 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:31.738710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94ba15fc-3830-46f1-bc50-d513d38c2a87 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:31.739381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94ba15fc-3830-46f1-bc50-d513d38c2a87 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:31.745802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94ba15fc-3830-46f1-bc50-d513d38c2a87 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:31.747046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94ba15fc-3830-46f1-bc50-d513d38c2a87 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:31.747849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94ba15fc-3830-46f1-bc50-d513d38c2a87 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:31.748298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94ba15fc-3830-46f1-bc50-d513d38c2a87 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:31.897487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-94ba15fc-3830-46f1-bc50-d513d38c2a87 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:31.905024 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94ba15fc-3830-46f1-bc50-d513d38c2a87 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1389 microversion: 2.1 time: 0.170958 Mar 12 21:15:31.909821 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3778/4546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:31 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:31.910157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0ed3f4a0-e163-48b0-bfaf-24095141b488 req-8b9334dc-15d4-42e3-8245-6c4da14846bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9896014-d757-4c57-9279-0aa92533121b", "name": "network-vif-plugged", "status": "completed", "tag": "9dba12ae-2168-465a-9f58-ee424e8cb6ce"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:31.919072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0ed3f4a0-e163-48b0-bfaf-24095141b488 req-8b9334dc-15d4-42e3-8245-6c4da14846bf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:31.919533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0ed3f4a0-e163-48b0-bfaf-24095141b488 req-8b9334dc-15d4-42e3-8245-6c4da14846bf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:31.930888 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0ed3f4a0-e163-48b0-bfaf-24095141b488 req-8b9334dc-15d4-42e3-8245-6c4da14846bf service nova] Creating event network-vif-plugged:9dba12ae-2168-465a-9f58-ee424e8cb6ce for instance d9896014-d757-4c57-9279-0aa92533121b on nch2-master-1 Mar 12 21:15:31.936239 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0ed3f4a0-e163-48b0-bfaf-24095141b488 req-8b9334dc-15d4-42e3-8245-6c4da14846bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029461 Mar 12 21:15:31.937146 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3779/4547] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:31.942236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fb18cb78-1744-4e36-a9f6-c991120c3037 req-ffdab28f-415b-42ca-986f-1b7611d30751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64431cf-644f-47c1-86eb-e1d12fda3937", "name": "network-vif-deleted", "tag": "4629a6c8-95f0-4db6-9469-6b2d64c02fb4"}, {"server_uuid": "d9896014-d757-4c57-9279-0aa92533121b", "name": "network-vif-unplugged", "status": "completed", "tag": "9dba12ae-2168-465a-9f58-ee424e8cb6ce"}, {"name": "network-changed", "server_uuid": "d9896014-d757-4c57-9279-0aa92533121b", "tag": "9dba12ae-2168-465a-9f58-ee424e8cb6ce"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:31.951226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fb18cb78-1744-4e36-a9f6-c991120c3037 req-ffdab28f-415b-42ca-986f-1b7611d30751 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:31.951683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fb18cb78-1744-4e36-a9f6-c991120c3037 req-ffdab28f-415b-42ca-986f-1b7611d30751 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:31.966043 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fb18cb78-1744-4e36-a9f6-c991120c3037 req-ffdab28f-415b-42ca-986f-1b7611d30751 service nova] Creating event network-vif-deleted:4629a6c8-95f0-4db6-9469-6b2d64c02fb4 for instance f64431cf-644f-47c1-86eb-e1d12fda3937 on nch1-master-1 Mar 12 21:15:31.966562 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fb18cb78-1744-4e36-a9f6-c991120c3037 req-ffdab28f-415b-42ca-986f-1b7611d30751 service nova] Creating event network-vif-unplugged:9dba12ae-2168-465a-9f58-ee424e8cb6ce for instance d9896014-d757-4c57-9279-0aa92533121b on nch2-master-1 Mar 12 21:15:31.967075 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fb18cb78-1744-4e36-a9f6-c991120c3037 req-ffdab28f-415b-42ca-986f-1b7611d30751 service nova] Creating event network-changed:9dba12ae-2168-465a-9f58-ee424e8cb6ce for instance d9896014-d757-4c57-9279-0aa92533121b on nch2-master-1 Mar 12 21:15:31.975294 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fb18cb78-1744-4e36-a9f6-c991120c3037 req-ffdab28f-415b-42ca-986f-1b7611d30751 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.036808 Mar 12 21:15:31.975903 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3780/4548] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:31.981604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d91c31be-eb49-4d10-8bc2-6c367adf3335 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:31.982339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d91c31be-eb49-4d10-8bc2-6c367adf3335 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:31.988437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d91c31be-eb49-4d10-8bc2-6c367adf3335 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:31.989251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d91c31be-eb49-4d10-8bc2-6c367adf3335 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:31.989987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d91c31be-eb49-4d10-8bc2-6c367adf3335 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:31.990435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d91c31be-eb49-4d10-8bc2-6c367adf3335 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:32.139217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d91c31be-eb49-4d10-8bc2-6c367adf3335 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:32.146698 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d91c31be-eb49-4d10-8bc2-6c367adf3335 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1693 microversion: 2.1 time: 0.169578 Mar 12 21:15:32.156532 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3781/4549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:31 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:32.156532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-453486b4-fd9d-4f62-84c9-cc26b377097f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:32.156532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-453486b4-fd9d-4f62-84c9-cc26b377097f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:32.159119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-453486b4-fd9d-4f62-84c9-cc26b377097f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:32.159574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-453486b4-fd9d-4f62-84c9-cc26b377097f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:32.160347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-453486b4-fd9d-4f62-84c9-cc26b377097f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:32.160784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-453486b4-fd9d-4f62-84c9-cc26b377097f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:32.314157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-453486b4-fd9d-4f62-84c9-cc26b377097f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:32.321884 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-453486b4-fd9d-4f62-84c9-cc26b377097f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1389 microversion: 2.1 time: 0.173069 Mar 12 21:15:32.333656 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3782/4550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:32 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1389 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:32.406315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-89f46735-0c9e-414a-9268-58bbda1d05f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:32.407090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89f46735-0c9e-414a-9268-58bbda1d05f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:32.413525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89f46735-0c9e-414a-9268-58bbda1d05f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:32.414212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89f46735-0c9e-414a-9268-58bbda1d05f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:32.415192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89f46735-0c9e-414a-9268-58bbda1d05f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:32.415801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89f46735-0c9e-414a-9268-58bbda1d05f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:32.451922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89f46735-0c9e-414a-9268-58bbda1d05f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:15:32.551878 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-89f46735-0c9e-414a-9268-58bbda1d05f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "DELETE /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 204 len: 0 microversion: 2.1 time: 0.148920 Mar 12 21:15:32.552626 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3783/4551] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:15:32 2022] DELETE /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:15:32.565824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c96dd6b-2af0-40a5-816e-bf7b53c94fb0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:32.566790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c96dd6b-2af0-40a5-816e-bf7b53c94fb0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:32.574444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c96dd6b-2af0-40a5-816e-bf7b53c94fb0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:32.574862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c96dd6b-2af0-40a5-816e-bf7b53c94fb0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:32.575660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c96dd6b-2af0-40a5-816e-bf7b53c94fb0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:32.576112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c96dd6b-2af0-40a5-816e-bf7b53c94fb0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:32.727196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c96dd6b-2af0-40a5-816e-bf7b53c94fb0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:32.735336 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c96dd6b-2af0-40a5-816e-bf7b53c94fb0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1395 microversion: 2.1 time: 0.178504 Mar 12 21:15:32.735932 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3784/4552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:32 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1395 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:32.750107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33155614-4344-4286-8fdb-23e5ba910083 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:32.750816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-33155614-4344-4286-8fdb-23e5ba910083 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: feed0155-4d0f-4464-970b-0ae3fb4e0cc5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:32.756715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33155614-4344-4286-8fdb-23e5ba910083 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:32.757168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33155614-4344-4286-8fdb-23e5ba910083 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:32.757970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33155614-4344-4286-8fdb-23e5ba910083 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:32.758413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33155614-4344-4286-8fdb-23e5ba910083 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:32.900684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-33155614-4344-4286-8fdb-23e5ba910083 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:32.908865 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-33155614-4344-4286-8fdb-23e5ba910083 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5" status: 200 len: 1320 microversion: 2.1 time: 0.167391 Mar 12 21:15:32.909447 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3785/4553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:32 2022] GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5 => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:33.164227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-50120b56-723d-4db8-86b7-d7041c7ee278 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:33.164841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-50120b56-723d-4db8-86b7-d7041c7ee278 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:33.170828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50120b56-723d-4db8-86b7-d7041c7ee278 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:33.171275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50120b56-723d-4db8-86b7-d7041c7ee278 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:33.172066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50120b56-723d-4db8-86b7-d7041c7ee278 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:33.172503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50120b56-723d-4db8-86b7-d7041c7ee278 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:33.305882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-50120b56-723d-4db8-86b7-d7041c7ee278 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:33.313184 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-50120b56-723d-4db8-86b7-d7041c7ee278 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1693 microversion: 2.1 time: 0.152858 Mar 12 21:15:33.313778 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3786/4554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:33 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:33.757091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a0a24385-e822-4079-b89f-7550b89268db tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:33.757756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a0a24385-e822-4079-b89f-7550b89268db tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:33.765119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0a24385-e822-4079-b89f-7550b89268db tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:33.765518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0a24385-e822-4079-b89f-7550b89268db tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:33.766317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0a24385-e822-4079-b89f-7550b89268db tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:33.766830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0a24385-e822-4079-b89f-7550b89268db tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:33.931382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a0a24385-e822-4079-b89f-7550b89268db tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:33.939344 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a0a24385-e822-4079-b89f-7550b89268db tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1395 microversion: 2.1 time: 0.186739 Mar 12 21:15:33.939946 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3787/4555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:33 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1395 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:33.944812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86cba1a2-feb4-46df-9d5e-1434c89c5374 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:33.945454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86cba1a2-feb4-46df-9d5e-1434c89c5374 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: feed0155-4d0f-4464-970b-0ae3fb4e0cc5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:33.951660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86cba1a2-feb4-46df-9d5e-1434c89c5374 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:33.952112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86cba1a2-feb4-46df-9d5e-1434c89c5374 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:33.952879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86cba1a2-feb4-46df-9d5e-1434c89c5374 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:33.953319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86cba1a2-feb4-46df-9d5e-1434c89c5374 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:34.091913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86cba1a2-feb4-46df-9d5e-1434c89c5374 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:34.099946 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86cba1a2-feb4-46df-9d5e-1434c89c5374 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5" status: 200 len: 1320 microversion: 2.1 time: 0.158956 Mar 12 21:15:34.100811 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3788/4556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:33 2022] GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5 => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:34.319685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-41626c48-ca16-421c-9b1b-8947cc89e07b req-4f509685-7d88-403b-98ef-606c9e443ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feed0155-4d0f-4464-970b-0ae3fb4e0cc5", "name": "network-vif-plugged", "status": "completed", "tag": "052194b3-1654-40cc-949e-9ac1b123b29b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:34.340548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-41626c48-ca16-421c-9b1b-8947cc89e07b req-4f509685-7d88-403b-98ef-606c9e443ae3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:34.341481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-41626c48-ca16-421c-9b1b-8947cc89e07b req-4f509685-7d88-403b-98ef-606c9e443ae3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:34.358303 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-41626c48-ca16-421c-9b1b-8947cc89e07b req-4f509685-7d88-403b-98ef-606c9e443ae3 service nova] Creating event network-vif-plugged:052194b3-1654-40cc-949e-9ac1b123b29b for instance feed0155-4d0f-4464-970b-0ae3fb4e0cc5 on nch2-master-1 Mar 12 21:15:34.364729 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-41626c48-ca16-421c-9b1b-8947cc89e07b req-4f509685-7d88-403b-98ef-606c9e443ae3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048636 Mar 12 21:15:34.366513 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3789/4557] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:34.374781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0284fdb0-a62b-433e-860c-3e0aaa782ab8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:34.375625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0284fdb0-a62b-433e-860c-3e0aaa782ab8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:34.382259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0284fdb0-a62b-433e-860c-3e0aaa782ab8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:34.383024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0284fdb0-a62b-433e-860c-3e0aaa782ab8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:34.384065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0284fdb0-a62b-433e-860c-3e0aaa782ab8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:34.384749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0284fdb0-a62b-433e-860c-3e0aaa782ab8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:34.544510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0284fdb0-a62b-433e-860c-3e0aaa782ab8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:34.554598 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0284fdb0-a62b-433e-860c-3e0aaa782ab8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1693 microversion: 2.1 time: 0.186190 Mar 12 21:15:34.555034 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3790/4558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:34 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1693 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:34.775110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9949f064-c261-4b93-a383-69b5c1b186f0 req-9aa90689-ce04-4bfb-bdbd-5912676397fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f79f91-1255-4148-baac-98e39ab439ca", "name": "network-vif-deleted", "tag": "5881f0d8-8725-4810-8673-6ddb52f48dd7"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:34.783735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9949f064-c261-4b93-a383-69b5c1b186f0 req-9aa90689-ce04-4bfb-bdbd-5912676397fb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:34.784471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9949f064-c261-4b93-a383-69b5c1b186f0 req-9aa90689-ce04-4bfb-bdbd-5912676397fb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:34.796504 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9949f064-c261-4b93-a383-69b5c1b186f0 req-9aa90689-ce04-4bfb-bdbd-5912676397fb service nova] Creating event network-vif-deleted:5881f0d8-8725-4810-8673-6ddb52f48dd7 for instance 40f79f91-1255-4148-baac-98e39ab439ca on nch2-master-1 Mar 12 21:15:34.802011 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9949f064-c261-4b93-a383-69b5c1b186f0 req-9aa90689-ce04-4bfb-bdbd-5912676397fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030746 Mar 12 21:15:34.802621 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3791/4559] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:15:34.959076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-08139946-937b-43f9-9ee4-6f9a1aacb1f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:34.961150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-08139946-937b-43f9-9ee4-6f9a1aacb1f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:34.974015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08139946-937b-43f9-9ee4-6f9a1aacb1f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:34.974430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08139946-937b-43f9-9ee4-6f9a1aacb1f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:34.975461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08139946-937b-43f9-9ee4-6f9a1aacb1f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:34.976768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08139946-937b-43f9-9ee4-6f9a1aacb1f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:35.051240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-08139946-937b-43f9-9ee4-6f9a1aacb1f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:35.061184 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-08139946-937b-43f9-9ee4-6f9a1aacb1f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 200 len: 1188 microversion: 2.1 time: 0.108033 Mar 12 21:15:35.073261 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3792/4560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:34 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 1188 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:35.120923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6060723c-bd20-4116-b480-24856371a4eb tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:35.123405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6060723c-bd20-4116-b480-24856371a4eb tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: feed0155-4d0f-4464-970b-0ae3fb4e0cc5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:35.137609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6060723c-bd20-4116-b480-24856371a4eb tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:35.138841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6060723c-bd20-4116-b480-24856371a4eb tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:35.139988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6060723c-bd20-4116-b480-24856371a4eb tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:35.140551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6060723c-bd20-4116-b480-24856371a4eb tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:35.317726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6060723c-bd20-4116-b480-24856371a4eb tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:35.327598 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6060723c-bd20-4116-b480-24856371a4eb tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5" status: 200 len: 1320 microversion: 2.1 time: 0.213321 Mar 12 21:15:35.328549 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3793/4561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:35 2022] GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:35.572768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-beb01f4f-35f2-4f54-9703-76e79958a3b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:35.573487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-beb01f4f-35f2-4f54-9703-76e79958a3b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:35.581152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-beb01f4f-35f2-4f54-9703-76e79958a3b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:35.581631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-beb01f4f-35f2-4f54-9703-76e79958a3b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:35.582641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-beb01f4f-35f2-4f54-9703-76e79958a3b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:35.582990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-beb01f4f-35f2-4f54-9703-76e79958a3b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:35.742238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-beb01f4f-35f2-4f54-9703-76e79958a3b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:35.750648 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-beb01f4f-35f2-4f54-9703-76e79958a3b8 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1693 microversion: 2.1 time: 0.182466 Mar 12 21:15:35.751178 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3794/4562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:35 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:36.080486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea5165cb-332e-410c-a35a-6555123ee6fe tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:36.081139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea5165cb-332e-410c-a35a-6555123ee6fe tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:36.087706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea5165cb-332e-410c-a35a-6555123ee6fe tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.088139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea5165cb-332e-410c-a35a-6555123ee6fe tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.088909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea5165cb-332e-410c-a35a-6555123ee6fe tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.089355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea5165cb-332e-410c-a35a-6555123ee6fe tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.102704 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ea5165cb-332e-410c-a35a-6555123ee6fe tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance 40f79f91-1255-4148-baac-98e39ab439ca could not be found. Mar 12 21:15:36.103324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea5165cb-332e-410c-a35a-6555123ee6fe tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance 40f79f91-1255-4148-baac-98e39ab439ca could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:15:36.104320 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea5165cb-332e-410c-a35a-6555123ee6fe tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 404 len: 111 microversion: 2.1 time: 0.027739 Mar 12 21:15:36.104822 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3795/4563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:36 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:15:36.134297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e10df558-640a-4c2a-9af9-222417421c7f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:36.134824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e10df558-640a-4c2a-9af9-222417421c7f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:36.140653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e10df558-640a-4c2a-9af9-222417421c7f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.141106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e10df558-640a-4c2a-9af9-222417421c7f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.141903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e10df558-640a-4c2a-9af9-222417421c7f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.142350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e10df558-640a-4c2a-9af9-222417421c7f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.155482 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e10df558-640a-4c2a-9af9-222417421c7f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance 40f79f91-1255-4148-baac-98e39ab439ca could not be found. Mar 12 21:15:36.156078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e10df558-640a-4c2a-9af9-222417421c7f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance 40f79f91-1255-4148-baac-98e39ab439ca could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:15:36.156900 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e10df558-640a-4c2a-9af9-222417421c7f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "DELETE /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 404 len: 111 microversion: 2.1 time: 0.026551 Mar 12 21:15:36.157444 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3796/4564] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:15:36 2022] DELETE /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:15:36.165253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd47e5c4-ab21-4ccf-bb31-aab7744173f2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:36.165883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dd47e5c4-ab21-4ccf-bb31-aab7744173f2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 40f79f91-1255-4148-baac-98e39ab439ca] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:36.172215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd47e5c4-ab21-4ccf-bb31-aab7744173f2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.172669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd47e5c4-ab21-4ccf-bb31-aab7744173f2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.173432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd47e5c4-ab21-4ccf-bb31-aab7744173f2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.173895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd47e5c4-ab21-4ccf-bb31-aab7744173f2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.189134 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-dd47e5c4-ab21-4ccf-bb31-aab7744173f2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance 40f79f91-1255-4148-baac-98e39ab439ca could not be found. Mar 12 21:15:36.189719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd47e5c4-ab21-4ccf-bb31-aab7744173f2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance 40f79f91-1255-4148-baac-98e39ab439ca could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:15:36.190562 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd47e5c4-ab21-4ccf-bb31-aab7744173f2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca" status: 404 len: 111 microversion: 2.1 time: 0.028969 Mar 12 21:15:36.191095 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3797/4565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:36 2022] GET /compute/v2.1/servers/40f79f91-1255-4148-baac-98e39ab439ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:15:36.346359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7311f4f1-6e05-4d77-91e2-1cc08e45d713 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:36.347351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7311f4f1-6e05-4d77-91e2-1cc08e45d713 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: feed0155-4d0f-4464-970b-0ae3fb4e0cc5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:36.356518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7311f4f1-6e05-4d77-91e2-1cc08e45d713 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.357255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7311f4f1-6e05-4d77-91e2-1cc08e45d713 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.358312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7311f4f1-6e05-4d77-91e2-1cc08e45d713 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.358996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7311f4f1-6e05-4d77-91e2-1cc08e45d713 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.526388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7311f4f1-6e05-4d77-91e2-1cc08e45d713 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:36.535603 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7311f4f1-6e05-4d77-91e2-1cc08e45d713 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5" status: 200 len: 1508 microversion: 2.1 time: 0.194598 Mar 12 21:15:36.536612 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3798/4566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:36 2022] GET /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:36.553691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-70a60ed7-833d-4788-afce-349e8cc4d790 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:36.554579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-70a60ed7-833d-4788-afce-349e8cc4d790 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 0e610120-daea-4c80-9bcf-12b3d6b86859] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:36.563004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70a60ed7-833d-4788-afce-349e8cc4d790 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.563455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70a60ed7-833d-4788-afce-349e8cc4d790 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.564233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70a60ed7-833d-4788-afce-349e8cc4d790 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.564673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70a60ed7-833d-4788-afce-349e8cc4d790 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.714097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-70a60ed7-833d-4788-afce-349e8cc4d790 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:36.723261 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-70a60ed7-833d-4788-afce-349e8cc4d790 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/0e610120-daea-4c80-9bcf-12b3d6b86859" status: 200 len: 1320 microversion: 2.1 time: 0.173760 Mar 12 21:15:36.723844 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3799/4567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:36 2022] GET /compute/v2.1/servers/0e610120-daea-4c80-9bcf-12b3d6b86859 => generated 1320 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:36.728186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1d64ee1a-dc13-498b-8a2c-ce06ab38da2d req-c78eb5d0-6158-4c9c-aefb-aa0005c7f724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e610120-daea-4c80-9bcf-12b3d6b86859", "name": "network-vif-plugged", "status": "completed", "tag": "87f9cdc8-0e6e-4dd4-bbe6-f2d6ffc075d8"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:36.736348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1d64ee1a-dc13-498b-8a2c-ce06ab38da2d req-c78eb5d0-6158-4c9c-aefb-aa0005c7f724 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.736796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1d64ee1a-dc13-498b-8a2c-ce06ab38da2d req-c78eb5d0-6158-4c9c-aefb-aa0005c7f724 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.747171 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1d64ee1a-dc13-498b-8a2c-ce06ab38da2d req-c78eb5d0-6158-4c9c-aefb-aa0005c7f724 service nova] Creating event network-vif-plugged:87f9cdc8-0e6e-4dd4-bbe6-f2d6ffc075d8 for instance 0e610120-daea-4c80-9bcf-12b3d6b86859 on nch1-master-1 Mar 12 21:15:36.751930 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1d64ee1a-dc13-498b-8a2c-ce06ab38da2d req-c78eb5d0-6158-4c9c-aefb-aa0005c7f724 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027004 Mar 12 21:15:36.752631 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3800/4568] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:36.767947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9bb138d8-f17d-4727-b4e8-f28863e8f5d1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:36.768646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9bb138d8-f17d-4727-b4e8-f28863e8f5d1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:36.774667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bb138d8-f17d-4727-b4e8-f28863e8f5d1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.775118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bb138d8-f17d-4727-b4e8-f28863e8f5d1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.775878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bb138d8-f17d-4727-b4e8-f28863e8f5d1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:36.776315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9bb138d8-f17d-4727-b4e8-f28863e8f5d1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:36.927034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9bb138d8-f17d-4727-b4e8-f28863e8f5d1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:36.934461 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9bb138d8-f17d-4727-b4e8-f28863e8f5d1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1693 microversion: 2.1 time: 0.170779 Mar 12 21:15:36.935053 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3801/4569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:36 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:37.740382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ebe6e5ae-b695-4bc0-a0b9-6b142a137e03 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:37.741030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ebe6e5ae-b695-4bc0-a0b9-6b142a137e03 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 0e610120-daea-4c80-9bcf-12b3d6b86859] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:37.747786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebe6e5ae-b695-4bc0-a0b9-6b142a137e03 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:37.748269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebe6e5ae-b695-4bc0-a0b9-6b142a137e03 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:37.749031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebe6e5ae-b695-4bc0-a0b9-6b142a137e03 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:37.749470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ebe6e5ae-b695-4bc0-a0b9-6b142a137e03 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:37.880125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ebe6e5ae-b695-4bc0-a0b9-6b142a137e03 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:37.888010 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ebe6e5ae-b695-4bc0-a0b9-6b142a137e03 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/0e610120-daea-4c80-9bcf-12b3d6b86859" status: 200 len: 1320 microversion: 2.1 time: 0.151613 Mar 12 21:15:37.888597 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3802/4570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:37 2022] GET /compute/v2.1/servers/0e610120-daea-4c80-9bcf-12b3d6b86859 => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:37.951580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c6c36120-5aa1-49e9-be93-2867822071fc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:37.952187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c6c36120-5aa1-49e9-be93-2867822071fc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:37.958031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6c36120-5aa1-49e9-be93-2867822071fc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:37.958489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6c36120-5aa1-49e9-be93-2867822071fc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:37.959254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6c36120-5aa1-49e9-be93-2867822071fc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:37.959694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6c36120-5aa1-49e9-be93-2867822071fc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:38.098502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c6c36120-5aa1-49e9-be93-2867822071fc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:38.105882 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c6c36120-5aa1-49e9-be93-2867822071fc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1693 microversion: 2.1 time: 0.158633 Mar 12 21:15:38.106467 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3803/4571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:37 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:38.906412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-762dae33-054e-4c79-bcd4-4edd0351a481 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:38.907093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-762dae33-054e-4c79-bcd4-4edd0351a481 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 0e610120-daea-4c80-9bcf-12b3d6b86859] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:38.920876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-762dae33-054e-4c79-bcd4-4edd0351a481 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:38.921550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-762dae33-054e-4c79-bcd4-4edd0351a481 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:38.922373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-762dae33-054e-4c79-bcd4-4edd0351a481 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:38.922816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-762dae33-054e-4c79-bcd4-4edd0351a481 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:39.060828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-762dae33-054e-4c79-bcd4-4edd0351a481 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:39.068276 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-762dae33-054e-4c79-bcd4-4edd0351a481 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/0e610120-daea-4c80-9bcf-12b3d6b86859" status: 200 len: 1508 microversion: 2.1 time: 0.167513 Mar 12 21:15:39.068861 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3804/4572] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:38 2022] GET /compute/v2.1/servers/0e610120-daea-4c80-9bcf-12b3d6b86859 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:39.084184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-952639ba-791f-4497-afe0-9240af1511a5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:39.084682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-952639ba-791f-4497-afe0-9240af1511a5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 0e610120-daea-4c80-9bcf-12b3d6b86859] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:39.090868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-952639ba-791f-4497-afe0-9240af1511a5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:39.091323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-952639ba-791f-4497-afe0-9240af1511a5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:39.092089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-952639ba-791f-4497-afe0-9240af1511a5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:39.092529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-952639ba-791f-4497-afe0-9240af1511a5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:39.117102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-952639ba-791f-4497-afe0-9240af1511a5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 0e610120-daea-4c80-9bcf-12b3d6b86859] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:15:39.189975 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-952639ba-791f-4497-afe0-9240af1511a5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0e610120-daea-4c80-9bcf-12b3d6b86859" status: 204 len: 0 microversion: 2.1 time: 0.108929 Mar 12 21:15:39.190481 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3805/4573] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:15:39 2022] DELETE /compute/v2.1/servers/0e610120-daea-4c80-9bcf-12b3d6b86859 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:15:39.195759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1163d51f-46c4-45e7-a362-8549ad765b68 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:39.196460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1163d51f-46c4-45e7-a362-8549ad765b68 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:39.204345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1163d51f-46c4-45e7-a362-8549ad765b68 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:39.204818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1163d51f-46c4-45e7-a362-8549ad765b68 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:39.205986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1163d51f-46c4-45e7-a362-8549ad765b68 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:39.206432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1163d51f-46c4-45e7-a362-8549ad765b68 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:39.345849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1163d51f-46c4-45e7-a362-8549ad765b68 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:39.353306 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1163d51f-46c4-45e7-a362-8549ad765b68 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1693 microversion: 2.1 time: 0.161740 Mar 12 21:15:39.353914 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3806/4574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:39 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:39.358302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85951b55-5df7-44ff-98ff-cd31572bb699 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:39.358800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85951b55-5df7-44ff-98ff-cd31572bb699 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: feed0155-4d0f-4464-970b-0ae3fb4e0cc5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:39.364929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85951b55-5df7-44ff-98ff-cd31572bb699 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:39.365515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85951b55-5df7-44ff-98ff-cd31572bb699 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:39.366339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85951b55-5df7-44ff-98ff-cd31572bb699 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:39.366818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85951b55-5df7-44ff-98ff-cd31572bb699 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:39.394916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85951b55-5df7-44ff-98ff-cd31572bb699 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: feed0155-4d0f-4464-970b-0ae3fb4e0cc5] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:15:39.482844 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85951b55-5df7-44ff-98ff-cd31572bb699 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "DELETE /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5" status: 204 len: 0 microversion: 2.1 time: 0.127672 Mar 12 21:15:39.483989 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3807/4575] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:15:39 2022] DELETE /compute/v2.1/servers/feed0155-4d0f-4464-970b-0ae3fb4e0cc5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:15:39.538963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1755753893", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "ce7fea5a-3eae-467b-bf69-7520f28242b5"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:39.594320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] validate_networks() for [('ce7fea5a-3eae-467b-bf69-7520f28242b5', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:15:40.024031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:15:40.024551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:15:40.024953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:15:40.025364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:15:40.025807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:15:40.041945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:40.042447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:40.043659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:40.043801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:40.062735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Getting quotas for project f53824c1b6294e158b07b6761fca67de. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:15:40.068510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Getting quotas for user 400f96438d0e4672ade671a9af0c786d and project f53824c1b6294e158b07b6761fca67de. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:15:40.082962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Going to run 2 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:15:40.085756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: c68de2ee-e5c5-422f-afdd-3098184097c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:15:40.125710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=c68de2ee-e5c5-422f-afdd-3098184097c2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:15:40.186565 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-98e02518-5ff5-4903-8234-985c5a7c3ee8 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.651799 Mar 12 21:15:40.187200 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3808/4576] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:15:39 2022] POST /compute/v2.1/servers => generated 32 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Mar 12 21:15:40.195558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5797d1bb-c490-428b-bcd2-193e2c10c3d1 req-f2ebe6ca-f449-45fa-9638-35161f6765c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9896014-d757-4c57-9279-0aa92533121b", "name": "network-vif-unplugged", "status": "completed", "tag": "9dba12ae-2168-465a-9f58-ee424e8cb6ce"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:40.210983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5797d1bb-c490-428b-bcd2-193e2c10c3d1 req-f2ebe6ca-f449-45fa-9638-35161f6765c9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:40.212253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5797d1bb-c490-428b-bcd2-193e2c10c3d1 req-f2ebe6ca-f449-45fa-9638-35161f6765c9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:40.227763 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5797d1bb-c490-428b-bcd2-193e2c10c3d1 req-f2ebe6ca-f449-45fa-9638-35161f6765c9 service nova] Creating event network-vif-unplugged:9dba12ae-2168-465a-9f58-ee424e8cb6ce for instance d9896014-d757-4c57-9279-0aa92533121b on nch2-master-1 Mar 12 21:15:40.246676 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5797d1bb-c490-428b-bcd2-193e2c10c3d1 req-f2ebe6ca-f449-45fa-9638-35161f6765c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054208 Mar 12 21:15:40.248204 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3809/4577] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:40.256597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-137f60f7-3bb6-45f7-9eff-feb11dfadd18 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:40.262027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-137f60f7-3bb6-45f7-9eff-feb11dfadd18 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:40.263003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-137f60f7-3bb6-45f7-9eff-feb11dfadd18 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Searching by: {'deleted': False, 'project_id': 'f53824c1b6294e158b07b6761fca67de'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 21:15:40.281993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-137f60f7-3bb6-45f7-9eff-feb11dfadd18 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:40.282695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-137f60f7-3bb6-45f7-9eff-feb11dfadd18 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:40.283916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-137f60f7-3bb6-45f7-9eff-feb11dfadd18 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:40.284531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-137f60f7-3bb6-45f7-9eff-feb11dfadd18 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:40.320771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-137f60f7-3bb6-45f7-9eff-feb11dfadd18 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 21:15:40.372250 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-137f60f7-3bb6-45f7-9eff-feb11dfadd18 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.121659 Mar 12 21:15:40.379854 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3810/4578] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 21:15:40 2022] GET /compute/v2.1/servers => generated 1337 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:40.385071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14c214d7-f864-42b2-88a8-c4c26a0d2f6a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:40.385869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14c214d7-f864-42b2-88a8-c4c26a0d2f6a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:40.393966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14c214d7-f864-42b2-88a8-c4c26a0d2f6a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:40.394901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14c214d7-f864-42b2-88a8-c4c26a0d2f6a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:40.396304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14c214d7-f864-42b2-88a8-c4c26a0d2f6a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:40.397251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14c214d7-f864-42b2-88a8-c4c26a0d2f6a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:40.653851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14c214d7-f864-42b2-88a8-c4c26a0d2f6a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:40.668994 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14c214d7-f864-42b2-88a8-c4c26a0d2f6a tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1693 microversion: 2.1 time: 0.286210 Mar 12 21:15:40.670216 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3811/4579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:40 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1693 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:40.684846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c06c9a7a-c7ae-4951-8209-cb9d14dcae3c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:40.685486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c06c9a7a-c7ae-4951-8209-cb9d14dcae3c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:40.826788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c06c9a7a-c7ae-4951-8209-cb9d14dcae3c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:40.837491 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c06c9a7a-c7ae-4951-8209-cb9d14dcae3c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400" status: 200 len: 1218 microversion: 2.1 time: 0.166204 Mar 12 21:15:40.841712 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3812/4580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:40 2022] GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400 => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:41.689410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec98190a-92b7-43be-a0fd-1b3547065dde tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:41.690082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec98190a-92b7-43be-a0fd-1b3547065dde tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:41.710112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec98190a-92b7-43be-a0fd-1b3547065dde tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:41.710615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec98190a-92b7-43be-a0fd-1b3547065dde tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:41.711423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec98190a-92b7-43be-a0fd-1b3547065dde tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:41.712061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec98190a-92b7-43be-a0fd-1b3547065dde tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:42.000351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ec98190a-92b7-43be-a0fd-1b3547065dde tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:42.016006 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec98190a-92b7-43be-a0fd-1b3547065dde tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1693 microversion: 2.1 time: 0.330740 Mar 12 21:15:42.016970 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3813/4581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:41 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1693 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:42.022740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f8ca2afe-5604-4f3d-b9fe-44f7a3aa1fdd tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:42.028090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f8ca2afe-5604-4f3d-b9fe-44f7a3aa1fdd tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:42.042030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8ca2afe-5604-4f3d-b9fe-44f7a3aa1fdd tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:42.043857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8ca2afe-5604-4f3d-b9fe-44f7a3aa1fdd tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:42.044891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8ca2afe-5604-4f3d-b9fe-44f7a3aa1fdd tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:42.045655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8ca2afe-5604-4f3d-b9fe-44f7a3aa1fdd tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:42.182715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f8ca2afe-5604-4f3d-b9fe-44f7a3aa1fdd tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:42.192622 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f8ca2afe-5604-4f3d-b9fe-44f7a3aa1fdd tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400" status: 200 len: 1270 microversion: 2.1 time: 0.174432 Mar 12 21:15:42.205312 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3814/4582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:42 2022] GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400 => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:42.211874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8a944daf-a8b8-4a1d-acb0-224b0f99031f req-01b10f74-3eb4-4ca4-902f-951b3d435850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e610120-daea-4c80-9bcf-12b3d6b86859", "name": "network-vif-deleted", "tag": "87f9cdc8-0e6e-4dd4-bbe6-f2d6ffc075d8"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:42.223437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8a944daf-a8b8-4a1d-acb0-224b0f99031f req-01b10f74-3eb4-4ca4-902f-951b3d435850 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:42.224333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8a944daf-a8b8-4a1d-acb0-224b0f99031f req-01b10f74-3eb4-4ca4-902f-951b3d435850 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:42.237904 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8a944daf-a8b8-4a1d-acb0-224b0f99031f req-01b10f74-3eb4-4ca4-902f-951b3d435850 service nova] Creating event network-vif-deleted:87f9cdc8-0e6e-4dd4-bbe6-f2d6ffc075d8 for instance 0e610120-daea-4c80-9bcf-12b3d6b86859 on nch1-master-1 Mar 12 21:15:42.244260 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8a944daf-a8b8-4a1d-acb0-224b0f99031f req-01b10f74-3eb4-4ca4-902f-951b3d435850 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036612 Mar 12 21:15:42.245935 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3815/4583] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:42.462215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a9b7515f-58a6-4857-ac6f-35e0d1364ee2 req-33405073-9ae3-4f10-a539-15202fa7c0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feed0155-4d0f-4464-970b-0ae3fb4e0cc5", "name": "network-vif-deleted", "tag": "052194b3-1654-40cc-949e-9ac1b123b29b"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:42.496873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a9b7515f-58a6-4857-ac6f-35e0d1364ee2 req-33405073-9ae3-4f10-a539-15202fa7c0e7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:42.500388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a9b7515f-58a6-4857-ac6f-35e0d1364ee2 req-33405073-9ae3-4f10-a539-15202fa7c0e7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:42.547238 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a9b7515f-58a6-4857-ac6f-35e0d1364ee2 req-33405073-9ae3-4f10-a539-15202fa7c0e7 service nova] Creating event network-vif-deleted:052194b3-1654-40cc-949e-9ac1b123b29b for instance feed0155-4d0f-4464-970b-0ae3fb4e0cc5 on nch2-master-1 Mar 12 21:15:42.556041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a9b7515f-58a6-4857-ac6f-35e0d1364ee2 req-33405073-9ae3-4f10-a539-15202fa7c0e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098691 Mar 12 21:15:42.558828 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3816/4584] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:42.848435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-99e77c4a-c413-4c52-a308-efaacd3c1878 req-b8f44755-1a46-4922-909a-a75f42ebe289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9896014-d757-4c57-9279-0aa92533121b", "name": "network-vif-plugged", "status": "completed", "tag": "9dba12ae-2168-465a-9f58-ee424e8cb6ce"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:42.878864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-99e77c4a-c413-4c52-a308-efaacd3c1878 req-b8f44755-1a46-4922-909a-a75f42ebe289 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:42.879705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-99e77c4a-c413-4c52-a308-efaacd3c1878 req-b8f44755-1a46-4922-909a-a75f42ebe289 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:42.894041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-99e77c4a-c413-4c52-a308-efaacd3c1878 req-b8f44755-1a46-4922-909a-a75f42ebe289 service nova] Creating event network-vif-plugged:9dba12ae-2168-465a-9f58-ee424e8cb6ce for instance d9896014-d757-4c57-9279-0aa92533121b on nch2-master-1 Mar 12 21:15:42.901462 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-99e77c4a-c413-4c52-a308-efaacd3c1878 req-b8f44755-1a46-4922-909a-a75f42ebe289 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063653 Mar 12 21:15:42.903086 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3817/4585] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:43.035487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-126c2438-7435-485b-923d-8c1d8b620078 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:43.037284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-126c2438-7435-485b-923d-8c1d8b620078 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:43.044899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-126c2438-7435-485b-923d-8c1d8b620078 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:43.045348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-126c2438-7435-485b-923d-8c1d8b620078 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:43.046179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-126c2438-7435-485b-923d-8c1d8b620078 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:43.046739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-126c2438-7435-485b-923d-8c1d8b620078 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:43.457018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-126c2438-7435-485b-923d-8c1d8b620078 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:43.469552 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-126c2438-7435-485b-923d-8c1d8b620078 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1693 microversion: 2.1 time: 0.439279 Mar 12 21:15:43.471324 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3818/4586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:43 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1693 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:43.475076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6bef56fc-4be0-48af-a188-32a1168d5e5a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:43.475833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6bef56fc-4be0-48af-a188-32a1168d5e5a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:43.483316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bef56fc-4be0-48af-a188-32a1168d5e5a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:43.483818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bef56fc-4be0-48af-a188-32a1168d5e5a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:43.484831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bef56fc-4be0-48af-a188-32a1168d5e5a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:43.485476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6bef56fc-4be0-48af-a188-32a1168d5e5a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:43.599846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6bef56fc-4be0-48af-a188-32a1168d5e5a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:43.638430 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6bef56fc-4be0-48af-a188-32a1168d5e5a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400" status: 200 len: 1276 microversion: 2.1 time: 0.166580 Mar 12 21:15:43.639189 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3819/4587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:43 2022] GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:43.776066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1575758763", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c56d924b-a997-4b3b-972a-14b4626e8e2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "9594c761-7638-4f69-b579-79baa62b3c38"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:43.853215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] validate_networks() for [('9594c761-7638-4f69-b579-79baa62b3c38', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:15:44.562577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:15:44.563058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:15:44.563544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:15:44.564686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:15:44.565540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:15:44.575261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:44.576092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:44.576885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:44.577325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:44.595820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:15:44.601539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for user 284a1908713c4b74a35a1d3b5cd10e80 and project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:15:44.674000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:15:44.677788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c56d924b-a997-4b3b-972a-14b4626e8e2a',volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:15:44.911762 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-54849bd9-27e3-4ffb-9734-f76da97ee363 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143330 Mar 12 21:15:44.922955 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3820/4588] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:15:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:15:44.932245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cfd5d90d-3be5-4392-ba33-951c8420a92b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:44.936350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cfd5d90d-3be5-4392-ba33-951c8420a92b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:44.948687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfd5d90d-3be5-4392-ba33-951c8420a92b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:44.949800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfd5d90d-3be5-4392-ba33-951c8420a92b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:44.950735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfd5d90d-3be5-4392-ba33-951c8420a92b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:44.951525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfd5d90d-3be5-4392-ba33-951c8420a92b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:45.231153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cfd5d90d-3be5-4392-ba33-951c8420a92b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:45.248542 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cfd5d90d-3be5-4392-ba33-951c8420a92b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1683 microversion: 2.1 time: 0.323563 Mar 12 21:15:45.249344 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3821/4589] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:44 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1683 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:45.256765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1e67c6a1-47cd-4791-bf5c-0efa5da965ae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:45.257870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1e67c6a1-47cd-4791-bf5c-0efa5da965ae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:45.268069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e67c6a1-47cd-4791-bf5c-0efa5da965ae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:45.269822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e67c6a1-47cd-4791-bf5c-0efa5da965ae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:45.278691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e67c6a1-47cd-4791-bf5c-0efa5da965ae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:45.279226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e67c6a1-47cd-4791-bf5c-0efa5da965ae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:45.428928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1e67c6a1-47cd-4791-bf5c-0efa5da965ae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:45.438718 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1e67c6a1-47cd-4791-bf5c-0efa5da965ae tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400" status: 200 len: 1318 microversion: 2.1 time: 0.187500 Mar 12 21:15:45.439645 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3822/4590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:45 2022] GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:45.444218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3fd08ab1-b594-4d12-bcc3-132ca37d6aec req-bbd93a9a-b75e-49a1-9f12-da093c73ce76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c68de2ee-e5c5-422f-afdd-3098184097c2", "tag": "894f74f6-9fca-4bc8-8e25-02c0b81799b7"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:45.456528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3fd08ab1-b594-4d12-bcc3-132ca37d6aec req-bbd93a9a-b75e-49a1-9f12-da093c73ce76 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:45.457208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3fd08ab1-b594-4d12-bcc3-132ca37d6aec req-bbd93a9a-b75e-49a1-9f12-da093c73ce76 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:45.481970 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3fd08ab1-b594-4d12-bcc3-132ca37d6aec req-bbd93a9a-b75e-49a1-9f12-da093c73ce76 service nova] Creating event network-changed:894f74f6-9fca-4bc8-8e25-02c0b81799b7 for instance c68de2ee-e5c5-422f-afdd-3098184097c2 on nch1-master-1 Mar 12 21:15:45.488191 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3fd08ab1-b594-4d12-bcc3-132ca37d6aec req-bbd93a9a-b75e-49a1-9f12-da093c73ce76 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047039 Mar 12 21:15:45.489086 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3823/4591] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:45.496327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59a2b3e5-bc9f-483e-816c-0217587c4c45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:45.497344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59a2b3e5-bc9f-483e-816c-0217587c4c45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:45.504556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59a2b3e5-bc9f-483e-816c-0217587c4c45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:45.505276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59a2b3e5-bc9f-483e-816c-0217587c4c45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:45.506497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59a2b3e5-bc9f-483e-816c-0217587c4c45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:45.507217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59a2b3e5-bc9f-483e-816c-0217587c4c45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:45.605550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-59a2b3e5-bc9f-483e-816c-0217587c4c45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:45.616945 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59a2b3e5-bc9f-483e-816c-0217587c4c45 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1113 microversion: 2.1 time: 0.126182 Mar 12 21:15:45.619870 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3824/4592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:45 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1113 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:45.635006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6c44e8cc-81c5-4408-8039-55db69e510e6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:45.636466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6c44e8cc-81c5-4408-8039-55db69e510e6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:45.645118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c44e8cc-81c5-4408-8039-55db69e510e6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:45.645854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c44e8cc-81c5-4408-8039-55db69e510e6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:45.646851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c44e8cc-81c5-4408-8039-55db69e510e6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:45.647472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c44e8cc-81c5-4408-8039-55db69e510e6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:45.882948 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6c44e8cc-81c5-4408-8039-55db69e510e6 tempest-TestNetworkAdvancedServerOps-247231782 tempest-TestNetworkAdvancedServerOps-247231782-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1834 microversion: 2.1 time: 0.252132 Mar 12 21:15:45.883548 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3825/4593] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:45 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1834 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:45.890315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bff2a996-e311-469e-880f-f713683382db req-aeb1c002-2dae-4c68-b672-e16c3d0de6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89eb8827-60b4-4dbe-bbfc-54ba1857b400", "tag": "d8850ccc-e96d-4b3c-8386-23731ad8b077"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:45.905166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bff2a996-e311-469e-880f-f713683382db req-aeb1c002-2dae-4c68-b672-e16c3d0de6c7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:45.905646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bff2a996-e311-469e-880f-f713683382db req-aeb1c002-2dae-4c68-b672-e16c3d0de6c7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:45.925220 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bff2a996-e311-469e-880f-f713683382db req-aeb1c002-2dae-4c68-b672-e16c3d0de6c7 service nova] Creating event network-changed:d8850ccc-e96d-4b3c-8386-23731ad8b077 for instance 89eb8827-60b4-4dbe-bbfc-54ba1857b400 on nch2-master-1 Mar 12 21:15:45.939628 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bff2a996-e311-469e-880f-f713683382db req-aeb1c002-2dae-4c68-b672-e16c3d0de6c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046155 Mar 12 21:15:45.940597 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3826/4594] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:45.956672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-041db742-3b6a-4ee5-b920-8cc2b20ecf8e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:45.957383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-041db742-3b6a-4ee5-b920-8cc2b20ecf8e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:45.963738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-041db742-3b6a-4ee5-b920-8cc2b20ecf8e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:45.964807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-041db742-3b6a-4ee5-b920-8cc2b20ecf8e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:45.965600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-041db742-3b6a-4ee5-b920-8cc2b20ecf8e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:45.966079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-041db742-3b6a-4ee5-b920-8cc2b20ecf8e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:46.267754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-041db742-3b6a-4ee5-b920-8cc2b20ecf8e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:46.279292 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-041db742-3b6a-4ee5-b920-8cc2b20ecf8e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1683 microversion: 2.1 time: 0.337215 Mar 12 21:15:46.280067 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3827/4595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:45 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1683 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:46.429652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7cb42b07-fd91-4aa9-b6d9-385bb2d0e89e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:46.431536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7cb42b07-fd91-4aa9-b6d9-385bb2d0e89e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:46.442835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cb42b07-fd91-4aa9-b6d9-385bb2d0e89e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:46.443532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cb42b07-fd91-4aa9-b6d9-385bb2d0e89e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:46.444880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cb42b07-fd91-4aa9-b6d9-385bb2d0e89e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:46.445911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7cb42b07-fd91-4aa9-b6d9-385bb2d0e89e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:46.520517 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7cb42b07-fd91-4aa9-b6d9-385bb2d0e89e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b/action" status: 200 len: 38492 microversion: 2.1 time: 0.097569 Mar 12 21:15:46.534800 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3828/4596] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:15:46 2022] POST /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b/action => generated 38492 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:15:46.541601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-022f7261-b409-4b01-88bd-ad9543408448 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:46.545540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-022f7261-b409-4b01-88bd-ad9543408448 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:46.559169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-022f7261-b409-4b01-88bd-ad9543408448 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:46.560066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-022f7261-b409-4b01-88bd-ad9543408448 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:46.564077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-022f7261-b409-4b01-88bd-ad9543408448 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:46.564821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-022f7261-b409-4b01-88bd-ad9543408448 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:46.729631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-022f7261-b409-4b01-88bd-ad9543408448 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:46.738279 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-022f7261-b409-4b01-88bd-ad9543408448 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400" status: 200 len: 1318 microversion: 2.1 time: 0.201979 Mar 12 21:15:46.739187 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3829/4597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:46 2022] GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:46.744481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e9e9260d-ac0f-4859-9e41-e7f10cd66bbc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:46.745339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e9e9260d-ac0f-4859-9e41-e7f10cd66bbc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:46.751692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9e9260d-ac0f-4859-9e41-e7f10cd66bbc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:46.752154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9e9260d-ac0f-4859-9e41-e7f10cd66bbc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:46.752965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9e9260d-ac0f-4859-9e41-e7f10cd66bbc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:46.753405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9e9260d-ac0f-4859-9e41-e7f10cd66bbc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:46.820236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e9e9260d-ac0f-4859-9e41-e7f10cd66bbc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:46.832679 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e9e9260d-ac0f-4859-9e41-e7f10cd66bbc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1187 microversion: 2.1 time: 0.092059 Mar 12 21:15:46.833631 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3830/4598] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:46 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:47.756462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6689619f-2004-40e3-8f1f-3bef04881a5c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:47.757882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6689619f-2004-40e3-8f1f-3bef04881a5c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:47.765304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6689619f-2004-40e3-8f1f-3bef04881a5c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:47.765756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6689619f-2004-40e3-8f1f-3bef04881a5c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:47.766574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6689619f-2004-40e3-8f1f-3bef04881a5c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:47.767007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6689619f-2004-40e3-8f1f-3bef04881a5c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:47.923351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6689619f-2004-40e3-8f1f-3bef04881a5c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:47.931597 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6689619f-2004-40e3-8f1f-3bef04881a5c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400" status: 200 len: 1318 microversion: 2.1 time: 0.180093 Mar 12 21:15:47.932178 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3831/4599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:47 2022] GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:47.937277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e36d81b8-95c7-40d1-8df7-5f0e0f6940dd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:47.938214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e36d81b8-95c7-40d1-8df7-5f0e0f6940dd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:47.944527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e36d81b8-95c7-40d1-8df7-5f0e0f6940dd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:47.944991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e36d81b8-95c7-40d1-8df7-5f0e0f6940dd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:47.945789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e36d81b8-95c7-40d1-8df7-5f0e0f6940dd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:47.946323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e36d81b8-95c7-40d1-8df7-5f0e0f6940dd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:48.085061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e36d81b8-95c7-40d1-8df7-5f0e0f6940dd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:48.094953 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e36d81b8-95c7-40d1-8df7-5f0e0f6940dd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1217 microversion: 2.1 time: 0.161706 Mar 12 21:15:48.095640 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3832/4600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:47 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:48.768385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c59b9ec5-1685-4c1d-8a67-96194d0fc61b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:48.769208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c59b9ec5-1685-4c1d-8a67-96194d0fc61b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:48.785619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c59b9ec5-1685-4c1d-8a67-96194d0fc61b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:48.786116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c59b9ec5-1685-4c1d-8a67-96194d0fc61b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:48.786914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c59b9ec5-1685-4c1d-8a67-96194d0fc61b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:48.787370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c59b9ec5-1685-4c1d-8a67-96194d0fc61b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:48.819240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c59b9ec5-1685-4c1d-8a67-96194d0fc61b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:15:48.960569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c59b9ec5-1685-4c1d-8a67-96194d0fc61b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 204 len: 0 microversion: 2.1 time: 0.195024 Mar 12 21:15:48.963172 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3833/4601] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:15:48 2022] DELETE /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:15:48.989688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-cca30f3b-f3c3-452a-a12f-8e95ec298889 req-f50e3e88-1557-4cef-99a6-3e9f33d83747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9896014-d757-4c57-9279-0aa92533121b", "tag": "9dba12ae-2168-465a-9f58-ee424e8cb6ce"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:49.015125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cca30f3b-f3c3-452a-a12f-8e95ec298889 req-f50e3e88-1557-4cef-99a6-3e9f33d83747 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:49.015588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cca30f3b-f3c3-452a-a12f-8e95ec298889 req-f50e3e88-1557-4cef-99a6-3e9f33d83747 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:49.029597 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-cca30f3b-f3c3-452a-a12f-8e95ec298889 req-f50e3e88-1557-4cef-99a6-3e9f33d83747 service nova] Creating event network-changed:9dba12ae-2168-465a-9f58-ee424e8cb6ce for instance d9896014-d757-4c57-9279-0aa92533121b on nch1-master-1 Mar 12 21:15:49.035743 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-cca30f3b-f3c3-452a-a12f-8e95ec298889 req-f50e3e88-1557-4cef-99a6-3e9f33d83747 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056062 Mar 12 21:15:49.036397 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3834/4602] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:49.041994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d8a7f7a2-f906-4ef7-ab12-e7994a4f9053 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:49.042723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d8a7f7a2-f906-4ef7-ab12-e7994a4f9053 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:49.051420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8a7f7a2-f906-4ef7-ab12-e7994a4f9053 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:49.051885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8a7f7a2-f906-4ef7-ab12-e7994a4f9053 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:49.052694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8a7f7a2-f906-4ef7-ab12-e7994a4f9053 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:49.053144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8a7f7a2-f906-4ef7-ab12-e7994a4f9053 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:49.289062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d8a7f7a2-f906-4ef7-ab12-e7994a4f9053 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:49.297493 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d8a7f7a2-f906-4ef7-ab12-e7994a4f9053 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400" status: 200 len: 1318 microversion: 2.1 time: 0.259902 Mar 12 21:15:49.306773 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3835/4603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:49 2022] GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:49.311262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-45713a9f-9a0c-406a-bd47-3d743e90a1fd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:49.311898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-45713a9f-9a0c-406a-bd47-3d743e90a1fd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:49.328483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45713a9f-9a0c-406a-bd47-3d743e90a1fd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:49.328949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45713a9f-9a0c-406a-bd47-3d743e90a1fd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:49.329756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45713a9f-9a0c-406a-bd47-3d743e90a1fd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:49.330536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45713a9f-9a0c-406a-bd47-3d743e90a1fd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:49.615724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-45713a9f-9a0c-406a-bd47-3d743e90a1fd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:49.631496 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-45713a9f-9a0c-406a-bd47-3d743e90a1fd tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 200 len: 1689 microversion: 2.1 time: 0.327934 Mar 12 21:15:49.632092 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3836/4604] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:49 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 1689 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:49.637881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-48591990-52b7-43a2-8124-380506654695 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:49.638500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-48591990-52b7-43a2-8124-380506654695 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:49.654894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48591990-52b7-43a2-8124-380506654695 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:49.656982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48591990-52b7-43a2-8124-380506654695 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:49.660576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48591990-52b7-43a2-8124-380506654695 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:49.661548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-48591990-52b7-43a2-8124-380506654695 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:49.971513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-48591990-52b7-43a2-8124-380506654695 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:49.980504 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-48591990-52b7-43a2-8124-380506654695 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1217 microversion: 2.1 time: 0.346726 Mar 12 21:15:49.981346 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3837/4605] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:49 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1217 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:50.313975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea135ee2-c5ac-4704-8cdf-bef4d154dbd4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:50.314602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea135ee2-c5ac-4704-8cdf-bef4d154dbd4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:50.321743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea135ee2-c5ac-4704-8cdf-bef4d154dbd4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:50.322457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea135ee2-c5ac-4704-8cdf-bef4d154dbd4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:50.324010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea135ee2-c5ac-4704-8cdf-bef4d154dbd4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:50.324643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea135ee2-c5ac-4704-8cdf-bef4d154dbd4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:50.482919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ea135ee2-c5ac-4704-8cdf-bef4d154dbd4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:50.490757 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea135ee2-c5ac-4704-8cdf-bef4d154dbd4 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400" status: 200 len: 1318 microversion: 2.1 time: 0.180865 Mar 12 21:15:50.491343 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3838/4606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:50 2022] GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:50.497985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-51758255-6c98-431d-9e3e-feb0e61f2e55 req-ef5ac899-17b7-4800-9ed7-e036aa22a929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89eb8827-60b4-4dbe-bbfc-54ba1857b400", "name": "network-vif-plugged", "status": "completed", "tag": "d8850ccc-e96d-4b3c-8386-23731ad8b077"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:50.507283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-51758255-6c98-431d-9e3e-feb0e61f2e55 req-ef5ac899-17b7-4800-9ed7-e036aa22a929 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:50.508163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-51758255-6c98-431d-9e3e-feb0e61f2e55 req-ef5ac899-17b7-4800-9ed7-e036aa22a929 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:50.521754 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-51758255-6c98-431d-9e3e-feb0e61f2e55 req-ef5ac899-17b7-4800-9ed7-e036aa22a929 service nova] Creating event network-vif-plugged:d8850ccc-e96d-4b3c-8386-23731ad8b077 for instance 89eb8827-60b4-4dbe-bbfc-54ba1857b400 on nch2-master-1 Mar 12 21:15:50.527266 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-51758255-6c98-431d-9e3e-feb0e61f2e55 req-ef5ac899-17b7-4800-9ed7-e036aa22a929 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033985 Mar 12 21:15:50.527880 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3839/4607] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:50.649955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bcc7705a-b662-4e3b-b899-81cbe9d9d507 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:50.651738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bcc7705a-b662-4e3b-b899-81cbe9d9d507 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: d9896014-d757-4c57-9279-0aa92533121b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:50.661070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcc7705a-b662-4e3b-b899-81cbe9d9d507 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:50.664399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcc7705a-b662-4e3b-b899-81cbe9d9d507 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:50.667440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcc7705a-b662-4e3b-b899-81cbe9d9d507 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:50.669148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bcc7705a-b662-4e3b-b899-81cbe9d9d507 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:50.696993 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bcc7705a-b662-4e3b-b899-81cbe9d9d507 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] HTTP exception thrown: Instance d9896014-d757-4c57-9279-0aa92533121b could not be found. Mar 12 21:15:50.698096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bcc7705a-b662-4e3b-b899-81cbe9d9d507 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Returning 404 to user: Instance d9896014-d757-4c57-9279-0aa92533121b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:15:50.699333 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bcc7705a-b662-4e3b-b899-81cbe9d9d507 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b" status: 404 len: 111 microversion: 2.1 time: 0.054116 Mar 12 21:15:50.701146 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3840/4608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:50 2022] GET /compute/v2.1/servers/d9896014-d757-4c57-9279-0aa92533121b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:15:50.996609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3f85d401-fd7b-43ad-b628-101c01e5bd1a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:50.997349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3f85d401-fd7b-43ad-b628-101c01e5bd1a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:51.004792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f85d401-fd7b-43ad-b628-101c01e5bd1a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:51.005242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f85d401-fd7b-43ad-b628-101c01e5bd1a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:51.006068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f85d401-fd7b-43ad-b628-101c01e5bd1a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:51.006535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f85d401-fd7b-43ad-b628-101c01e5bd1a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:51.194223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3f85d401-fd7b-43ad-b628-101c01e5bd1a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:51.202669 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3f85d401-fd7b-43ad-b628-101c01e5bd1a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1217 microversion: 2.1 time: 0.210067 Mar 12 21:15:51.203373 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3841/4609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:50 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:51.211479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ff53ea02-a8d9-45df-8efe-fb0f28df4e48 req-3f11952f-0d54-4d19-a39f-c778f5401b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d44bcf-4b65-473c-bad8-9a555f0e0002", "tag": "79464166-3ddf-4589-9a64-a9a30fa86be2"}, {"server_uuid": "d9896014-d757-4c57-9279-0aa92533121b", "name": "network-vif-deleted", "tag": "9dba12ae-2168-465a-9f58-ee424e8cb6ce"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:51.217931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ff53ea02-a8d9-45df-8efe-fb0f28df4e48 req-3f11952f-0d54-4d19-a39f-c778f5401b2b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:51.218390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ff53ea02-a8d9-45df-8efe-fb0f28df4e48 req-3f11952f-0d54-4d19-a39f-c778f5401b2b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:51.230474 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ff53ea02-a8d9-45df-8efe-fb0f28df4e48 req-3f11952f-0d54-4d19-a39f-c778f5401b2b service nova] Creating event network-changed:79464166-3ddf-4589-9a64-a9a30fa86be2 for instance 03d44bcf-4b65-473c-bad8-9a555f0e0002 on nch2-master-1 Mar 12 21:15:51.230992 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ff53ea02-a8d9-45df-8efe-fb0f28df4e48 req-3f11952f-0d54-4d19-a39f-c778f5401b2b service nova] Creating event network-vif-deleted:9dba12ae-2168-465a-9f58-ee424e8cb6ce for instance d9896014-d757-4c57-9279-0aa92533121b on nch1-master-1 Mar 12 21:15:51.240180 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ff53ea02-a8d9-45df-8efe-fb0f28df4e48 req-3f11952f-0d54-4d19-a39f-c778f5401b2b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035620 Mar 12 21:15:51.240790 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3842/4610] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:51.510787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-260e64db-8f13-47fc-a0b4-66e318c86b7c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:51.511991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-260e64db-8f13-47fc-a0b4-66e318c86b7c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:51.522518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-260e64db-8f13-47fc-a0b4-66e318c86b7c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:51.523293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-260e64db-8f13-47fc-a0b4-66e318c86b7c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:51.524335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-260e64db-8f13-47fc-a0b4-66e318c86b7c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:51.525236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-260e64db-8f13-47fc-a0b4-66e318c86b7c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:52.091644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-260e64db-8f13-47fc-a0b4-66e318c86b7c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:52.099270 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-260e64db-8f13-47fc-a0b4-66e318c86b7c tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400" status: 200 len: 1318 microversion: 2.1 time: 0.594428 Mar 12 21:15:52.100492 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3843/4611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:51 2022] GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400 => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:52.220075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-924faad8-de48-4b8c-a063-4b016e3616e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:52.221122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-924faad8-de48-4b8c-a063-4b016e3616e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:52.227270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-924faad8-de48-4b8c-a063-4b016e3616e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:52.228169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-924faad8-de48-4b8c-a063-4b016e3616e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:52.229237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-924faad8-de48-4b8c-a063-4b016e3616e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:52.230560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-924faad8-de48-4b8c-a063-4b016e3616e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:52.652417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-924faad8-de48-4b8c-a063-4b016e3616e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:52.660020 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-924faad8-de48-4b8c-a063-4b016e3616e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1217 microversion: 2.1 time: 0.444285 Mar 12 21:15:52.660696 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3844/4612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:52 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1217 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:52.665312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-68e631c5-53e7-4f6a-954e-5e75168337a8 req-d66a880e-773c-4ea9-8001-faa657836785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c68de2ee-e5c5-422f-afdd-3098184097c2", "name": "network-vif-plugged", "status": "completed", "tag": "894f74f6-9fca-4bc8-8e25-02c0b81799b7"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:52.674312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-68e631c5-53e7-4f6a-954e-5e75168337a8 req-d66a880e-773c-4ea9-8001-faa657836785 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:52.674845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-68e631c5-53e7-4f6a-954e-5e75168337a8 req-d66a880e-773c-4ea9-8001-faa657836785 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:52.691597 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-68e631c5-53e7-4f6a-954e-5e75168337a8 req-d66a880e-773c-4ea9-8001-faa657836785 service nova] Creating event network-vif-plugged:894f74f6-9fca-4bc8-8e25-02c0b81799b7 for instance c68de2ee-e5c5-422f-afdd-3098184097c2 on nch1-master-1 Mar 12 21:15:52.699108 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-68e631c5-53e7-4f6a-954e-5e75168337a8 req-d66a880e-773c-4ea9-8001-faa657836785 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036148 Mar 12 21:15:52.699981 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3845/4613] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:53.117130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-78bd432e-acdf-435f-adde-c8bf33a6264a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:53.118509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-78bd432e-acdf-435f-adde-c8bf33a6264a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:53.130956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78bd432e-acdf-435f-adde-c8bf33a6264a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:53.131851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78bd432e-acdf-435f-adde-c8bf33a6264a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:53.133210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78bd432e-acdf-435f-adde-c8bf33a6264a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:53.135024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78bd432e-acdf-435f-adde-c8bf33a6264a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:53.353712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-78bd432e-acdf-435f-adde-c8bf33a6264a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:53.362257 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-78bd432e-acdf-435f-adde-c8bf33a6264a tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400" status: 200 len: 1507 microversion: 2.1 time: 0.249292 Mar 12 21:15:53.375882 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3846/4614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:53 2022] GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:53.382509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09a4b665-d465-4c0a-ba43-ab41102ed1d1 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:53.383387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-09a4b665-d465-4c0a-ba43-ab41102ed1d1 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: c68de2ee-e5c5-422f-afdd-3098184097c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:53.391787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09a4b665-d465-4c0a-ba43-ab41102ed1d1 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:53.393066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09a4b665-d465-4c0a-ba43-ab41102ed1d1 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:53.394670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09a4b665-d465-4c0a-ba43-ab41102ed1d1 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:53.395290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09a4b665-d465-4c0a-ba43-ab41102ed1d1 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:53.679229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09a4b665-d465-4c0a-ba43-ab41102ed1d1 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:53.696885 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09a4b665-d465-4c0a-ba43-ab41102ed1d1 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2" status: 200 len: 1318 microversion: 2.1 time: 0.318804 Mar 12 21:15:53.698083 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3847/4615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:53 2022] GET /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:53.704472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-926f150b-97dd-44a7-b8f0-189b69fa93f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:53.705394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-926f150b-97dd-44a7-b8f0-189b69fa93f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:53.712650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-926f150b-97dd-44a7-b8f0-189b69fa93f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:53.713446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-926f150b-97dd-44a7-b8f0-189b69fa93f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:53.715173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-926f150b-97dd-44a7-b8f0-189b69fa93f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:53.715962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-926f150b-97dd-44a7-b8f0-189b69fa93f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:54.038406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-926f150b-97dd-44a7-b8f0-189b69fa93f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:54.050621 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-926f150b-97dd-44a7-b8f0-189b69fa93f3 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1217 microversion: 2.1 time: 0.351016 Mar 12 21:15:54.063908 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3848/4616] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:53 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1217 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:54.716572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2dffa592-7f85-4007-8b9e-c51aaf230c39 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:54.717994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2dffa592-7f85-4007-8b9e-c51aaf230c39 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: c68de2ee-e5c5-422f-afdd-3098184097c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:54.748255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2dffa592-7f85-4007-8b9e-c51aaf230c39 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:54.748923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2dffa592-7f85-4007-8b9e-c51aaf230c39 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:54.749896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2dffa592-7f85-4007-8b9e-c51aaf230c39 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:54.750502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2dffa592-7f85-4007-8b9e-c51aaf230c39 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:54.994022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2dffa592-7f85-4007-8b9e-c51aaf230c39 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:55.005578 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2dffa592-7f85-4007-8b9e-c51aaf230c39 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2" status: 200 len: 1506 microversion: 2.1 time: 0.293680 Mar 12 21:15:55.006324 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3849/4617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:54 2022] GET /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:55.013269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-22c28cf8-6854-431b-8fa8-c83376d138c4 req-a86cc53d-b068-4649-85e5-bc0d7298d3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d44bcf-4b65-473c-bad8-9a555f0e0002", "name": "network-vif-plugged", "status": "completed", "tag": "79464166-3ddf-4589-9a64-a9a30fa86be2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:55.030578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-22c28cf8-6854-431b-8fa8-c83376d138c4 req-a86cc53d-b068-4649-85e5-bc0d7298d3fa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:55.031028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-22c28cf8-6854-431b-8fa8-c83376d138c4 req-a86cc53d-b068-4649-85e5-bc0d7298d3fa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:55.049215 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-22c28cf8-6854-431b-8fa8-c83376d138c4 req-a86cc53d-b068-4649-85e5-bc0d7298d3fa service nova] Creating event network-vif-plugged:79464166-3ddf-4589-9a64-a9a30fa86be2 for instance 03d44bcf-4b65-473c-bad8-9a555f0e0002 on nch2-master-1 Mar 12 21:15:55.055880 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-22c28cf8-6854-431b-8fa8-c83376d138c4 req-a86cc53d-b068-4649-85e5-bc0d7298d3fa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048291 Mar 12 21:15:55.056504 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3850/4618] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:55.064700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-db744559-04c4-4a58-a55d-2ca8fc5eda16 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:55.065602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-db744559-04c4-4a58-a55d-2ca8fc5eda16 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: c68de2ee-e5c5-422f-afdd-3098184097c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:55.072635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db744559-04c4-4a58-a55d-2ca8fc5eda16 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:55.074011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db744559-04c4-4a58-a55d-2ca8fc5eda16 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:55.074972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db744559-04c4-4a58-a55d-2ca8fc5eda16 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:55.075422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db744559-04c4-4a58-a55d-2ca8fc5eda16 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:55.104698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-db744559-04c4-4a58-a55d-2ca8fc5eda16 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: c68de2ee-e5c5-422f-afdd-3098184097c2] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:15:55.214511 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-db744559-04c4-4a58-a55d-2ca8fc5eda16 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2" status: 204 len: 0 microversion: 2.1 time: 0.155342 Mar 12 21:15:55.216248 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3851/4619] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:15:55 2022] DELETE /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:15:55.225572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-963cd6fe-77b0-4e8e-b4ed-4fbbd4f4e7dc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:55.226580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-963cd6fe-77b0-4e8e-b4ed-4fbbd4f4e7dc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:55.235156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-963cd6fe-77b0-4e8e-b4ed-4fbbd4f4e7dc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:55.235854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-963cd6fe-77b0-4e8e-b4ed-4fbbd4f4e7dc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:55.236853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-963cd6fe-77b0-4e8e-b4ed-4fbbd4f4e7dc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:55.238254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-963cd6fe-77b0-4e8e-b4ed-4fbbd4f4e7dc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:55.409462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-963cd6fe-77b0-4e8e-b4ed-4fbbd4f4e7dc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:55.419422 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-963cd6fe-77b0-4e8e-b4ed-4fbbd4f4e7dc tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1217 microversion: 2.1 time: 0.201890 Mar 12 21:15:55.420027 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3852/4620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:55 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:55.434681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c38181b5-3261-4c88-9755-d8b24eea69c5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:55.435382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c38181b5-3261-4c88-9755-d8b24eea69c5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:55.443599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c38181b5-3261-4c88-9755-d8b24eea69c5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:55.444286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c38181b5-3261-4c88-9755-d8b24eea69c5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:55.445111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c38181b5-3261-4c88-9755-d8b24eea69c5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:55.445517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c38181b5-3261-4c88-9755-d8b24eea69c5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:55.474324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c38181b5-3261-4c88-9755-d8b24eea69c5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:15:55.574192 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c38181b5-3261-4c88-9755-d8b24eea69c5 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "DELETE /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400" status: 204 len: 0 microversion: 2.1 time: 0.142268 Mar 12 21:15:55.575122 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3853/4621] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:15:55 2022] DELETE /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:15:55.585347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ba185bae-652b-461a-87eb-96c4b3b03f45 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:55.586176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ba185bae-652b-461a-87eb-96c4b3b03f45 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: c68de2ee-e5c5-422f-afdd-3098184097c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:55.594940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba185bae-652b-461a-87eb-96c4b3b03f45 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:55.595930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba185bae-652b-461a-87eb-96c4b3b03f45 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:55.597509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba185bae-652b-461a-87eb-96c4b3b03f45 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:55.598205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba185bae-652b-461a-87eb-96c4b3b03f45 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:55.753680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ba185bae-652b-461a-87eb-96c4b3b03f45 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:55.761020 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ba185bae-652b-461a-87eb-96c4b3b03f45 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2" status: 200 len: 1512 microversion: 2.1 time: 0.181212 Mar 12 21:15:55.761604 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3854/4622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:55 2022] GET /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2 => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:15:55.766110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f1cf863-8911-4b33-bee6-feb9d7fafd60 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '.version_select at 0x7f6e353953a0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:55.786752 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f1cf863-8911-4b33-bee6-feb9d7fafd60 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1271687427" status: 202 len: 0 microversion: 2.1 time: 0.024102 Mar 12 21:15:55.787335 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3855/4623] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Mar 12 21:15:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1271687427 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:15:55.824534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-76f84e20-62a1-4047-9896-b3a113f51168 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'create', calling method: .version_select at 0x7f6e353e2ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1271516711"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:55.839235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-76f84e20-62a1-4047-9896-b3a113f51168 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:15:55.847756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-76f84e20-62a1-4047-9896-b3a113f51168 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for user 43f35f32a8064500a8d8412f19697b93 and project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:15:55.976263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-76f84e20-62a1-4047-9896-b3a113f51168 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:15:55.982258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-76f84e20-62a1-4047-9896-b3a113f51168 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for user 43f35f32a8064500a8d8412f19697b93 and project cf66e00702594effaf99e35fcdcf05c9. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:15:55.997196 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-76f84e20-62a1-4047-9896-b3a113f51168 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.176630 Mar 12 21:15:55.997731 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3856/4624] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:15:55 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:56.436923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f0c07b4b-10a0-43dd-8b70-1ecd6cda3d71 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:56.437665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f0c07b4b-10a0-43dd-8b70-1ecd6cda3d71 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:56.449390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0c07b4b-10a0-43dd-8b70-1ecd6cda3d71 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:56.450170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0c07b4b-10a0-43dd-8b70-1ecd6cda3d71 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:56.452136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0c07b4b-10a0-43dd-8b70-1ecd6cda3d71 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:56.453697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0c07b4b-10a0-43dd-8b70-1ecd6cda3d71 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:56.701935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f0c07b4b-10a0-43dd-8b70-1ecd6cda3d71 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:56.711463 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f0c07b4b-10a0-43dd-8b70-1ecd6cda3d71 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1217 microversion: 2.1 time: 0.278332 Mar 12 21:15:56.712157 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3857/4625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:56 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1217 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:56.780026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca2f5bb4-17e6-4b1c-822e-fa519ad1bf51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:56.780667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ca2f5bb4-17e6-4b1c-822e-fa519ad1bf51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: c68de2ee-e5c5-422f-afdd-3098184097c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:56.790499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca2f5bb4-17e6-4b1c-822e-fa519ad1bf51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:56.790968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca2f5bb4-17e6-4b1c-822e-fa519ad1bf51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:56.791921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca2f5bb4-17e6-4b1c-822e-fa519ad1bf51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:56.792373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca2f5bb4-17e6-4b1c-822e-fa519ad1bf51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:56.981142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca2f5bb4-17e6-4b1c-822e-fa519ad1bf51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:56.989671 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca2f5bb4-17e6-4b1c-822e-fa519ad1bf51 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2" status: 200 len: 1512 microversion: 2.1 time: 0.214377 Mar 12 21:15:56.990830 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3858/4626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:56 2022] GET /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2 => generated 1512 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:57.730477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75e0cde4-1681-4c30-b925-392876d41e4d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:57.731376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75e0cde4-1681-4c30-b925-392876d41e4d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:57.741243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75e0cde4-1681-4c30-b925-392876d41e4d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:57.744613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75e0cde4-1681-4c30-b925-392876d41e4d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:57.746364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75e0cde4-1681-4c30-b925-392876d41e4d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:57.748566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75e0cde4-1681-4c30-b925-392876d41e4d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:58.038993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-75e0cde4-1681-4c30-b925-392876d41e4d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:58.053223 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75e0cde4-1681-4c30-b925-392876d41e4d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1403 microversion: 2.1 time: 0.326945 Mar 12 21:15:58.065921 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3859/4627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:57 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1403 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:58.072149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-00943689-d98a-483a-9f4a-ce64a52a01b7 req-be890ef4-ed27-4ef2-a96d-5c877d7698f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c68de2ee-e5c5-422f-afdd-3098184097c2", "name": "network-vif-deleted", "tag": "894f74f6-9fca-4bc8-8e25-02c0b81799b7"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:58.084524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-00943689-d98a-483a-9f4a-ce64a52a01b7 req-be890ef4-ed27-4ef2-a96d-5c877d7698f0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:58.084985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-00943689-d98a-483a-9f4a-ce64a52a01b7 req-be890ef4-ed27-4ef2-a96d-5c877d7698f0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:58.104854 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-00943689-d98a-483a-9f4a-ce64a52a01b7 req-be890ef4-ed27-4ef2-a96d-5c877d7698f0 service nova] Creating event network-vif-deleted:894f74f6-9fca-4bc8-8e25-02c0b81799b7 for instance c68de2ee-e5c5-422f-afdd-3098184097c2 on nch1-master-1 Mar 12 21:15:58.114431 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-00943689-d98a-483a-9f4a-ce64a52a01b7 req-be890ef4-ed27-4ef2-a96d-5c877d7698f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045571 Mar 12 21:15:58.115172 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3860/4628] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:15:58.121542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f90f6a0-f675-4f67-8ba8-3281d430af61 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:58.123354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f90f6a0-f675-4f67-8ba8-3281d430af61 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: c68de2ee-e5c5-422f-afdd-3098184097c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:58.131189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f90f6a0-f675-4f67-8ba8-3281d430af61 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:58.131786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f90f6a0-f675-4f67-8ba8-3281d430af61 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:58.132668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f90f6a0-f675-4f67-8ba8-3281d430af61 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:58.133305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f90f6a0-f675-4f67-8ba8-3281d430af61 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:58.195268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f90f6a0-f675-4f67-8ba8-3281d430af61 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:58.196008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f90f6a0-f675-4f67-8ba8-3281d430af61 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:58.196648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-8f90f6a0-f675-4f67-8ba8-3281d430af61 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lazy-loading 'fault' on Instance uuid c68de2ee-e5c5-422f-afdd-3098184097c2 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:15:58.248938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8f90f6a0-f675-4f67-8ba8-3281d430af61 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '400f96438d0e4672ade671a9af0c786d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53824c1b6294e158b07b6761fca67de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:58.258248 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f90f6a0-f675-4f67-8ba8-3281d430af61 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2" status: 200 len: 1308 microversion: 2.1 time: 0.141785 Mar 12 21:15:58.259629 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3861/4629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:58 2022] GET /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2 => generated 1308 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:58.266755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-07c2ed53-0943-486b-bff5-80d458b09a09 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:58.267574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-07c2ed53-0943-486b-bff5-80d458b09a09 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:58.275620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07c2ed53-0943-486b-bff5-80d458b09a09 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:58.277251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07c2ed53-0943-486b-bff5-80d458b09a09 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:58.278494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07c2ed53-0943-486b-bff5-80d458b09a09 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:58.279172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07c2ed53-0943-486b-bff5-80d458b09a09 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:58.476957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-07c2ed53-0943-486b-bff5-80d458b09a09 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:15:58.485010 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-07c2ed53-0943-486b-bff5-80d458b09a09 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1403 microversion: 2.1 time: 0.223142 Mar 12 21:15:58.486155 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3862/4630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:58 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1403 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:15:58.504058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6faf76ee-ffe6-4dd9-a09b-1326b9ca2329 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-75970492"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:15:58.505378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6faf76ee-ffe6-4dd9-a09b-1326b9ca2329 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:58.525823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6faf76ee-ffe6-4dd9-a09b-1326b9ca2329 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:58.527060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6faf76ee-ffe6-4dd9-a09b-1326b9ca2329 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:58.528024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6faf76ee-ffe6-4dd9-a09b-1326b9ca2329 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:58.528648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6faf76ee-ffe6-4dd9-a09b-1326b9ca2329 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:58.649516 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.api [None req-6faf76ee-ffe6-4dd9-a09b-1326b9ca2329 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Attempting to quiesce instance before volume snapshot. Mar 12 21:15:58.716365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.api [None req-6faf76ee-ffe6-4dd9-a09b-1326b9ca2329 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Mar 12 21:15:58.812758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6faf76ee-ffe6-4dd9-a09b-1326b9ca2329 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Creating snapshot from volume c56d924b-a997-4b3b-972a-14b4626e8e2a. {{(pid=136302) snapshot_instance /opt/stack/nova/nova/compute/api.py:3452}} Mar 12 21:15:59.908076 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6faf76ee-ffe6-4dd9-a09b-1326b9ca2329 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "POST /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002/action" status: 202 len: 0 microversion: 2.1 time: 1.407923 Mar 12 21:15:59.909384 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3863/4631] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:15:58 2022] POST /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002/action => generated 0 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 12 21:15:59.919253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2cb24b0d-93f1-4175-9e4c-3e36affe496e tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:15:59.920600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2cb24b0d-93f1-4175-9e4c-3e36affe496e tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: c68de2ee-e5c5-422f-afdd-3098184097c2] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:15:59.929942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cb24b0d-93f1-4175-9e4c-3e36affe496e tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:59.930493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cb24b0d-93f1-4175-9e4c-3e36affe496e tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:59.931363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cb24b0d-93f1-4175-9e4c-3e36affe496e tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:15:59.931890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cb24b0d-93f1-4175-9e4c-3e36affe496e tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:15:59.946796 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-2cb24b0d-93f1-4175-9e4c-3e36affe496e tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] HTTP exception thrown: Instance c68de2ee-e5c5-422f-afdd-3098184097c2 could not be found. Mar 12 21:15:59.947411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2cb24b0d-93f1-4175-9e4c-3e36affe496e tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Returning 404 to user: Instance c68de2ee-e5c5-422f-afdd-3098184097c2 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:15:59.948330 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2cb24b0d-93f1-4175-9e4c-3e36affe496e tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2" status: 404 len: 111 microversion: 2.1 time: 0.037845 Mar 12 21:15:59.952158 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3864/4632] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:15:59 2022] GET /compute/v2.1/servers/c68de2ee-e5c5-422f-afdd-3098184097c2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:16:00.126874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14418e0d-d930-4bdc-a258-7d1b35a3461a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Action: 'create', calling method: .version_select at 0x7f6e3565cdc0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-603499308"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:00.140625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-14418e0d-d930-4bdc-a258-7d1b35a3461a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Getting quotas for project 69c756a4ad07449182f9786c376ed0f7. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:16:00.146875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-14418e0d-d930-4bdc-a258-7d1b35a3461a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Getting quotas for user 0060aa19407c4b7fb35e11846e467dec and project 69c756a4ad07449182f9786c376ed0f7. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:16:00.257188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-14418e0d-d930-4bdc-a258-7d1b35a3461a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Getting quotas for project 69c756a4ad07449182f9786c376ed0f7. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:16:00.263486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-14418e0d-d930-4bdc-a258-7d1b35a3461a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Getting quotas for user 0060aa19407c4b7fb35e11846e467dec and project 69c756a4ad07449182f9786c376ed0f7. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:16:00.279473 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14418e0d-d930-4bdc-a258-7d1b35a3461a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.329189 Mar 12 21:16:00.284996 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3865/4633] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:15:59 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:00.286053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-202d2640-f768-4abb-9b71-3f5b43a27a41 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:00.286053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-202d2640-f768-4abb-9b71-3f5b43a27a41 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] [instance: 89eb8827-60b4-4dbe-bbfc-54ba1857b400] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:00.293190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-202d2640-f768-4abb-9b71-3f5b43a27a41 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:00.293652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-202d2640-f768-4abb-9b71-3f5b43a27a41 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:00.294462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-202d2640-f768-4abb-9b71-3f5b43a27a41 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:00.294908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-202d2640-f768-4abb-9b71-3f5b43a27a41 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:00.309284 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-202d2640-f768-4abb-9b71-3f5b43a27a41 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] HTTP exception thrown: Instance 89eb8827-60b4-4dbe-bbfc-54ba1857b400 could not be found. Mar 12 21:16:00.309963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-202d2640-f768-4abb-9b71-3f5b43a27a41 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] Returning 404 to user: Instance 89eb8827-60b4-4dbe-bbfc-54ba1857b400 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:16:00.310794 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-202d2640-f768-4abb-9b71-3f5b43a27a41 tempest-MultipleCreateTestJSON-1856039242 tempest-MultipleCreateTestJSON-1856039242-project] 10.222.0.30 "GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400" status: 404 len: 111 microversion: 2.1 time: 0.029223 Mar 12 21:16:00.311549 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3866/4634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:00 2022] GET /compute/v2.1/servers/89eb8827-60b4-4dbe-bbfc-54ba1857b400 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:16:00.316824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1693630320", "imageRef": "b71aedb7-6d8f-4df2-8fd7-53e9e3260b06", "flavorRef": "452", "networks": [{"uuid": "9594c761-7638-4f69-b579-79baa62b3c38"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:00.375610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] validate_networks() for [('9594c761-7638-4f69-b579-79baa62b3c38', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:16:01.628462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:16:01.629611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:16:01.630354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:16:01.631497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:16:01.632169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:16:01.644115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:01.644971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:01.654457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:01.655290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:01.693862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:16:01.701130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for user 284a1908713c4b74a35a1d3b5cd10e80 and project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:16:01.716089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:16:01.731786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1bbd1af2-0776-4d46-9083-08ed0c820c68',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:16:01.959423 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d5fd8f1a-29be-4476-b8fa-2948a80ea322 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.640709 Mar 12 21:16:01.967349 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3867/4635] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:16:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:16:01.987311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ea775615-33c9-4f56-a92b-caa3efa00198 req-1b7009ec-01e9-40a9-9d70-55632b1a304f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89eb8827-60b4-4dbe-bbfc-54ba1857b400", "name": "network-vif-deleted", "tag": "d8850ccc-e96d-4b3c-8386-23731ad8b077"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:02.009565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ea775615-33c9-4f56-a92b-caa3efa00198 req-1b7009ec-01e9-40a9-9d70-55632b1a304f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:02.010521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ea775615-33c9-4f56-a92b-caa3efa00198 req-1b7009ec-01e9-40a9-9d70-55632b1a304f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:02.035829 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ea775615-33c9-4f56-a92b-caa3efa00198 req-1b7009ec-01e9-40a9-9d70-55632b1a304f service nova] Creating event network-vif-deleted:d8850ccc-e96d-4b3c-8386-23731ad8b077 for instance 89eb8827-60b4-4dbe-bbfc-54ba1857b400 on nch2-master-1 Mar 12 21:16:02.048842 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ea775615-33c9-4f56-a92b-caa3efa00198 req-1b7009ec-01e9-40a9-9d70-55632b1a304f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078663 Mar 12 21:16:02.050776 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3868/4636] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:02.059482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-001863fe-5ca7-46c9-b3c7-257f6728acca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:02.062276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-001863fe-5ca7-46c9-b3c7-257f6728acca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:02.183773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-001863fe-5ca7-46c9-b3c7-257f6728acca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:02.190924 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-001863fe-5ca7-46c9-b3c7-257f6728acca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1230 microversion: 2.1 time: 0.138437 Mar 12 21:16:02.198227 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3869/4637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:02 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1230 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:03.207599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3aa4907d-890b-49d3-9743-df74eea6e7ab tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:03.208919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3aa4907d-890b-49d3-9743-df74eea6e7ab tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:03.219453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3aa4907d-890b-49d3-9743-df74eea6e7ab tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:03.220356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3aa4907d-890b-49d3-9743-df74eea6e7ab tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:03.220743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3aa4907d-890b-49d3-9743-df74eea6e7ab tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:03.221203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3aa4907d-890b-49d3-9743-df74eea6e7ab tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:03.334074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3aa4907d-890b-49d3-9743-df74eea6e7ab tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:03.344252 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3aa4907d-890b-49d3-9743-df74eea6e7ab tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1282 microversion: 2.1 time: 0.140109 Mar 12 21:16:03.354479 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3870/4638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:03 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:04.363129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-495c43f0-ba5a-422e-9d66-e9d8b504ad2d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:04.363860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-495c43f0-ba5a-422e-9d66-e9d8b504ad2d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:04.379310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-495c43f0-ba5a-422e-9d66-e9d8b504ad2d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:04.379782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-495c43f0-ba5a-422e-9d66-e9d8b504ad2d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:04.380585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-495c43f0-ba5a-422e-9d66-e9d8b504ad2d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:04.381042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-495c43f0-ba5a-422e-9d66-e9d8b504ad2d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:04.615760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-495c43f0-ba5a-422e-9d66-e9d8b504ad2d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:04.628339 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-495c43f0-ba5a-422e-9d66-e9d8b504ad2d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1300 microversion: 2.1 time: 0.269900 Mar 12 21:16:04.630433 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3871/4639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:04 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1300 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:05.645616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f8d7917e-397b-4ce3-b6ff-e371300023d7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:05.647044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f8d7917e-397b-4ce3-b6ff-e371300023d7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:05.659868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8d7917e-397b-4ce3-b6ff-e371300023d7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:05.664771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8d7917e-397b-4ce3-b6ff-e371300023d7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:05.665944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8d7917e-397b-4ce3-b6ff-e371300023d7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:05.667200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8d7917e-397b-4ce3-b6ff-e371300023d7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:05.848824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f8d7917e-397b-4ce3-b6ff-e371300023d7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:05.873480 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f8d7917e-397b-4ce3-b6ff-e371300023d7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1300 microversion: 2.1 time: 0.231622 Mar 12 21:16:05.876194 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3872/4640] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:05 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1300 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:06.402036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1134092012", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "fd99822f-5469-4690-ba79-1b426a6164f2"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:06.476212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] validate_networks() for [('fd99822f-5469-4690-ba79-1b426a6164f2', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:16:07.454821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:16:07.457381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:16:07.458205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:16:07.458830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:16:07.459436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:16:07.481548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:07.484866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:07.490048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:07.490674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:07.537926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Getting quotas for project 85fc76f24b4a46fbabcebc5c4d300fcf. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:16:07.558001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Getting quotas for user 82873d77f30e4e82b41921a464a20ecf and project 85fc76f24b4a46fbabcebc5c4d300fcf. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:16:07.588039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:16:07.605200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:16:07.681355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-801826c7-4b6b-4646-83a5-de325fe4e9da tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444153 Mar 12 21:16:07.684413 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3873/4641] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:16:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:16:07.692074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1357965403", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "eb731792-b49b-4631-b421-34b95a34d260"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1271516711", "security_groups": [{"name": "tempest-secgroup-smoke-429107886"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:07.900258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] validate_networks() for [('eb731792-b49b-4631-b421-34b95a34d260', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:16:08.814414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:16:08.815193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:16:08.816334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:16:08.816788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:16:08.817373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:16:08.864506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:08.865014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:08.873954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:08.874689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:08.950362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for project cf66e00702594effaf99e35fcdcf05c9. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:16:08.967406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Getting quotas for user 43f35f32a8064500a8d8412f19697b93 and project cf66e00702594effaf99e35fcdcf05c9. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:16:09.013052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:16:09.019265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:16:09.124308 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-363f0e93-e874-4dda-812c-854bae19922b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.438428 Mar 12 21:16:09.125206 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3874/4642] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:16:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:16:09.139107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cdc32e76-7795-48e4-8262-f9bff467a124 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:09.141356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cdc32e76-7795-48e4-8262-f9bff467a124 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:09.154742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdc32e76-7795-48e4-8262-f9bff467a124 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:09.155236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdc32e76-7795-48e4-8262-f9bff467a124 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:09.167424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdc32e76-7795-48e4-8262-f9bff467a124 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:09.168410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdc32e76-7795-48e4-8262-f9bff467a124 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:09.475614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cdc32e76-7795-48e4-8262-f9bff467a124 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:09.485690 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cdc32e76-7795-48e4-8262-f9bff467a124 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1342 microversion: 2.1 time: 0.358985 Mar 12 21:16:09.486191 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3875/4643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:09 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1342 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:09.504189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b716fc7-8163-4552-97a5-06cc142352ca tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:09.504835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b716fc7-8163-4552-97a5-06cc142352ca tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:09.520825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b716fc7-8163-4552-97a5-06cc142352ca tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:09.521324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b716fc7-8163-4552-97a5-06cc142352ca tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:09.524625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b716fc7-8163-4552-97a5-06cc142352ca tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:09.525103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b716fc7-8163-4552-97a5-06cc142352ca tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:09.764021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b716fc7-8163-4552-97a5-06cc142352ca tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:09.790906 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b716fc7-8163-4552-97a5-06cc142352ca tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1276 microversion: 2.1 time: 0.299957 Mar 12 21:16:09.794775 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3876/4644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:09 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1276 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:09.847401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9253ebe6-cc61-49c7-a5df-b720af60658d req-fdc1936a-a1cb-4802-b527-7fc092ad584f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80d96e50-c6c0-4f6f-a0ae-f33c1724e89d", "tag": "2dbe4431-426f-40bc-8bbf-68742b1be825"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:09.908898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9253ebe6-cc61-49c7-a5df-b720af60658d req-fdc1936a-a1cb-4802-b527-7fc092ad584f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:09.913759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9253ebe6-cc61-49c7-a5df-b720af60658d req-fdc1936a-a1cb-4802-b527-7fc092ad584f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:09.945997 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9253ebe6-cc61-49c7-a5df-b720af60658d req-fdc1936a-a1cb-4802-b527-7fc092ad584f service nova] Creating event network-changed:2dbe4431-426f-40bc-8bbf-68742b1be825 for instance 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d on nch1-master-1 Mar 12 21:16:09.960223 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9253ebe6-cc61-49c7-a5df-b720af60658d req-fdc1936a-a1cb-4802-b527-7fc092ad584f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159029 Mar 12 21:16:09.962223 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3877/4645] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:09.999580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3e1802c3-3a73-4253-9277-29eacbbeebc4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:10.010720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3e1802c3-3a73-4253-9277-29eacbbeebc4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:10.250158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3e1802c3-3a73-4253-9277-29eacbbeebc4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:10.273474 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3e1802c3-3a73-4253-9277-29eacbbeebc4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1267 microversion: 2.1 time: 0.300896 Mar 12 21:16:10.274356 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3878/4646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:09 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1267 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:10.503118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-60dcd639-54de-471d-a8a9-86aab8757ab2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:10.503686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-60dcd639-54de-471d-a8a9-86aab8757ab2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:10.517800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60dcd639-54de-471d-a8a9-86aab8757ab2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:10.518289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60dcd639-54de-471d-a8a9-86aab8757ab2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:10.519096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60dcd639-54de-471d-a8a9-86aab8757ab2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:10.519554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60dcd639-54de-471d-a8a9-86aab8757ab2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:11.108712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-60dcd639-54de-471d-a8a9-86aab8757ab2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:11.132244 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-60dcd639-54de-471d-a8a9-86aab8757ab2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1376 microversion: 2.1 time: 0.632205 Mar 12 21:16:11.133569 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3879/4647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:10 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1376 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:11.144838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f586de39-1e65-45d2-84f3-91b1940f0f26 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:11.146944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f586de39-1e65-45d2-84f3-91b1940f0f26 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:11.154436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f586de39-1e65-45d2-84f3-91b1940f0f26 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:11.155267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f586de39-1e65-45d2-84f3-91b1940f0f26 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:11.157333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f586de39-1e65-45d2-84f3-91b1940f0f26 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:11.160749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f586de39-1e65-45d2-84f3-91b1940f0f26 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:11.382004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f586de39-1e65-45d2-84f3-91b1940f0f26 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:11.394544 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f586de39-1e65-45d2-84f3-91b1940f0f26 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1282 microversion: 2.1 time: 0.257720 Mar 12 21:16:11.396643 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3880/4648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:11 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1282 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:11.404404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa9267ab-70e3-4a53-80d5-b6431df3da31 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:11.409713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aa9267ab-70e3-4a53-80d5-b6431df3da31 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:11.419384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa9267ab-70e3-4a53-80d5-b6431df3da31 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:11.425753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa9267ab-70e3-4a53-80d5-b6431df3da31 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:11.427036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa9267ab-70e3-4a53-80d5-b6431df3da31 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:11.427729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa9267ab-70e3-4a53-80d5-b6431df3da31 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:11.549404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aa9267ab-70e3-4a53-80d5-b6431df3da31 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:11.568750 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aa9267ab-70e3-4a53-80d5-b6431df3da31 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1325 microversion: 2.1 time: 0.167399 Mar 12 21:16:11.570506 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3881/4649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:11 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1325 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:12.151288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-858db685-342d-47d2-8452-454d7d2c156a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:12.152924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-858db685-342d-47d2-8452-454d7d2c156a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:12.161273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-858db685-342d-47d2-8452-454d7d2c156a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:12.162705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-858db685-342d-47d2-8452-454d7d2c156a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:12.164535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-858db685-342d-47d2-8452-454d7d2c156a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:12.166024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-858db685-342d-47d2-8452-454d7d2c156a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:12.506915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-858db685-342d-47d2-8452-454d7d2c156a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:12.520756 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-858db685-342d-47d2-8452-454d7d2c156a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1376 microversion: 2.1 time: 0.374562 Mar 12 21:16:12.521346 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3882/4650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:12 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1376 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:12.531777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-db78f912-23b5-4812-88a4-b6759eeaa850 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:12.535556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-db78f912-23b5-4812-88a4-b6759eeaa850 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:12.551045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db78f912-23b5-4812-88a4-b6759eeaa850 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:12.551594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db78f912-23b5-4812-88a4-b6759eeaa850 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:12.553659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db78f912-23b5-4812-88a4-b6759eeaa850 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:12.557489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-db78f912-23b5-4812-88a4-b6759eeaa850 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:12.921631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-db78f912-23b5-4812-88a4-b6759eeaa850 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:12.933272 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-db78f912-23b5-4812-88a4-b6759eeaa850 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1324 microversion: 2.1 time: 0.410527 Mar 12 21:16:12.942553 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3883/4651] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:12 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1324 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:12.948851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04ae4c5d-b856-4da0-b8ac-eb2e9bc98166 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:12.949488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04ae4c5d-b856-4da0-b8ac-eb2e9bc98166 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:12.956020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04ae4c5d-b856-4da0-b8ac-eb2e9bc98166 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:12.956777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04ae4c5d-b856-4da0-b8ac-eb2e9bc98166 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:12.957828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04ae4c5d-b856-4da0-b8ac-eb2e9bc98166 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:12.958472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04ae4c5d-b856-4da0-b8ac-eb2e9bc98166 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:13.285394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04ae4c5d-b856-4da0-b8ac-eb2e9bc98166 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:13.296733 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04ae4c5d-b856-4da0-b8ac-eb2e9bc98166 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1392 microversion: 2.1 time: 0.352281 Mar 12 21:16:13.312436 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3884/4652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:12 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1392 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:13.390671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-521676658-access_point-1564042418", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "2b952fb2-6374-4f36-ac87-d6adc1946a79"}], "key_name": "tempest-TestSecurityGroupsBasicOps-603499308", "security_groups": [{"name": "tempest-secgroup_access--1312463126"}, {"name": "tempest-secgroup_general--62522691"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:13.657032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] validate_networks() for [('2b952fb2-6374-4f36-ac87-d6adc1946a79', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:16:14.186251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:16:14.186702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:16:14.187206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:16:14.187639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:16:14.188581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:16:14.198100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:14.199097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:14.200329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:14.201215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:14.233736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Getting quotas for project 69c756a4ad07449182f9786c376ed0f7. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:16:14.241353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Getting quotas for user 0060aa19407c4b7fb35e11846e467dec and project 69c756a4ad07449182f9786c376ed0f7. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:16:14.261295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:16:14.264454 ncdv-master-1 devstack@n-api.service[136302]: WARNING nova.utils [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-521676658-access_point-1564042418 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-521676658-acc Mar 12 21:16:14.265633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:16:14.339125 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f570e896-a2ec-402c-8b72-7e2f7c796a21 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 0.955546 Mar 12 21:16:14.340970 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3885/4653] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:16:13 2022] POST /compute/v2.1/servers => generated 456 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:16:14.346545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-63344f5a-213e-4e20-bc82-5b33b0f8d81e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:14.347550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-63344f5a-213e-4e20-bc82-5b33b0f8d81e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:14.354745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63344f5a-213e-4e20-bc82-5b33b0f8d81e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:14.355635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63344f5a-213e-4e20-bc82-5b33b0f8d81e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:14.360635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63344f5a-213e-4e20-bc82-5b33b0f8d81e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:14.361111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63344f5a-213e-4e20-bc82-5b33b0f8d81e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:14.593017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-63344f5a-213e-4e20-bc82-5b33b0f8d81e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:14.602830 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-63344f5a-213e-4e20-bc82-5b33b0f8d81e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1376 microversion: 2.1 time: 0.260498 Mar 12 21:16:14.603424 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3886/4654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:14 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1376 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:14.609877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-708d109a-5423-4797-a1d6-5ba722b27b4f tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:14.620286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-708d109a-5423-4797-a1d6-5ba722b27b4f tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:14.635522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-708d109a-5423-4797-a1d6-5ba722b27b4f tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:14.636389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-708d109a-5423-4797-a1d6-5ba722b27b4f tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:14.641711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-708d109a-5423-4797-a1d6-5ba722b27b4f tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:14.642551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-708d109a-5423-4797-a1d6-5ba722b27b4f tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:14.888427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-708d109a-5423-4797-a1d6-5ba722b27b4f tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:14.898016 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-708d109a-5423-4797-a1d6-5ba722b27b4f tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1324 microversion: 2.1 time: 0.292669 Mar 12 21:16:14.898940 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3887/4655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:14 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1324 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:14.904389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7b30ef85-3cf4-475c-a0c1-e8771025e10f req-5ebff3f6-01c5-48d7-b12f-38d600bbafc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1998fa-885f-46b7-af22-f2966ffa7a12", "tag": "607b4ce8-bfc1-4c96-a5e7-3ecd22d49b98"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:14.913529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7b30ef85-3cf4-475c-a0c1-e8771025e10f req-5ebff3f6-01c5-48d7-b12f-38d600bbafc2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:14.914332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7b30ef85-3cf4-475c-a0c1-e8771025e10f req-5ebff3f6-01c5-48d7-b12f-38d600bbafc2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:14.929085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7b30ef85-3cf4-475c-a0c1-e8771025e10f req-5ebff3f6-01c5-48d7-b12f-38d600bbafc2 service nova] Creating event network-changed:607b4ce8-bfc1-4c96-a5e7-3ecd22d49b98 for instance ea1998fa-885f-46b7-af22-f2966ffa7a12 on nch2-master-1 Mar 12 21:16:14.940663 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7b30ef85-3cf4-475c-a0c1-e8771025e10f req-5ebff3f6-01c5-48d7-b12f-38d600bbafc2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040132 Mar 12 21:16:14.941730 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3888/4656] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:14.950112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-79929b96-43c8-4343-b5c8-ba7c64cae7cc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:14.951363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-79929b96-43c8-4343-b5c8-ba7c64cae7cc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:14.967699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79929b96-43c8-4343-b5c8-ba7c64cae7cc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:14.969401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79929b96-43c8-4343-b5c8-ba7c64cae7cc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:14.970976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79929b96-43c8-4343-b5c8-ba7c64cae7cc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:14.971983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79929b96-43c8-4343-b5c8-ba7c64cae7cc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:15.207672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-79929b96-43c8-4343-b5c8-ba7c64cae7cc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:15.218258 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-79929b96-43c8-4343-b5c8-ba7c64cae7cc tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1392 microversion: 2.1 time: 0.274919 Mar 12 21:16:15.219160 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3889/4657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:14 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:15.225185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3fbf1e1b-d905-46c6-a68d-b98594127e41 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:15.225840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3fbf1e1b-d905-46c6-a68d-b98594127e41 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:15.239247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fbf1e1b-d905-46c6-a68d-b98594127e41 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:15.239729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fbf1e1b-d905-46c6-a68d-b98594127e41 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:15.242109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fbf1e1b-d905-46c6-a68d-b98594127e41 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:15.243132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fbf1e1b-d905-46c6-a68d-b98594127e41 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:15.318949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3fbf1e1b-d905-46c6-a68d-b98594127e41 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:15.331161 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3fbf1e1b-d905-46c6-a68d-b98594127e41 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1297 microversion: 2.1 time: 0.109542 Mar 12 21:16:15.332316 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3890/4658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:15 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:15.622965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c204831c-8842-43bb-8347-74412806c18d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:15.624393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c204831c-8842-43bb-8347-74412806c18d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:15.631006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c204831c-8842-43bb-8347-74412806c18d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:15.631471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c204831c-8842-43bb-8347-74412806c18d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:15.632266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c204831c-8842-43bb-8347-74412806c18d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:15.632857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c204831c-8842-43bb-8347-74412806c18d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:15.822088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c204831c-8842-43bb-8347-74412806c18d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:15.834509 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c204831c-8842-43bb-8347-74412806c18d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1376 microversion: 2.1 time: 0.217698 Mar 12 21:16:15.846042 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3891/4659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:15 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1376 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:15.923830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bacc390d-9888-48ea-9901-07728db60c50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:15.924472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bacc390d-9888-48ea-9901-07728db60c50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:15.933280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bacc390d-9888-48ea-9901-07728db60c50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:15.934054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bacc390d-9888-48ea-9901-07728db60c50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:15.935036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bacc390d-9888-48ea-9901-07728db60c50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:15.935647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bacc390d-9888-48ea-9901-07728db60c50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:16.160479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bacc390d-9888-48ea-9901-07728db60c50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:16.173691 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bacc390d-9888-48ea-9901-07728db60c50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1324 microversion: 2.1 time: 0.256382 Mar 12 21:16:16.175348 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3892/4660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:15 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1324 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:16.237678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c701c982-45dd-459a-8a66-efc14fff1e27 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:16.238958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c701c982-45dd-459a-8a66-efc14fff1e27 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:16.246532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c701c982-45dd-459a-8a66-efc14fff1e27 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:16.247155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c701c982-45dd-459a-8a66-efc14fff1e27 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:16.248060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c701c982-45dd-459a-8a66-efc14fff1e27 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:16.248744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c701c982-45dd-459a-8a66-efc14fff1e27 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:16.422364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c701c982-45dd-459a-8a66-efc14fff1e27 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:16.431782 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c701c982-45dd-459a-8a66-efc14fff1e27 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1392 microversion: 2.1 time: 0.198141 Mar 12 21:16:16.432767 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3893/4661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:16 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1392 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:16.437676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cb109dc1-4c62-4fb1-886f-054dd1d04639 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:16.438515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cb109dc1-4c62-4fb1-886f-054dd1d04639 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:16.444842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb109dc1-4c62-4fb1-886f-054dd1d04639 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:16.445314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb109dc1-4c62-4fb1-886f-054dd1d04639 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:16.446140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb109dc1-4c62-4fb1-886f-054dd1d04639 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:16.446599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb109dc1-4c62-4fb1-886f-054dd1d04639 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:16.515155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cb109dc1-4c62-4fb1-886f-054dd1d04639 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:16.547867 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cb109dc1-4c62-4fb1-886f-054dd1d04639 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1351 microversion: 2.1 time: 0.113727 Mar 12 21:16:16.549680 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3894/4662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:16 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:16.852680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3edc759c-36d0-433a-8827-577a21290965 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:16.853350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3edc759c-36d0-433a-8827-577a21290965 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:16.860526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3edc759c-36d0-433a-8827-577a21290965 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:16.861291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3edc759c-36d0-433a-8827-577a21290965 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:16.862440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3edc759c-36d0-433a-8827-577a21290965 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:16.862892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3edc759c-36d0-433a-8827-577a21290965 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:17.023587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3edc759c-36d0-433a-8827-577a21290965 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:17.031926 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3edc759c-36d0-433a-8827-577a21290965 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1376 microversion: 2.1 time: 0.183208 Mar 12 21:16:17.032501 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3895/4663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:16 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1376 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:17.193182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f86d7be-b95a-4c4f-9c46-372839adc325 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:17.194031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4f86d7be-b95a-4c4f-9c46-372839adc325 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:17.205421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f86d7be-b95a-4c4f-9c46-372839adc325 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:17.205948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f86d7be-b95a-4c4f-9c46-372839adc325 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:17.212209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f86d7be-b95a-4c4f-9c46-372839adc325 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:17.212633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f86d7be-b95a-4c4f-9c46-372839adc325 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:17.390033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4f86d7be-b95a-4c4f-9c46-372839adc325 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:17.398415 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4f86d7be-b95a-4c4f-9c46-372839adc325 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1324 microversion: 2.1 time: 0.210448 Mar 12 21:16:17.399222 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3896/4664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:17 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1324 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:17.420209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5c0a6707-e3e0-4b40-8156-40225413cf2f req-fa70145c-c168-46e2-965d-3b9b45241eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2116b6a-ccc9-4993-8476-d53c16d9a896", "tag": "ccbb58f4-5ca0-4fd2-9c8e-3763d9182d52"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:17.431308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5c0a6707-e3e0-4b40-8156-40225413cf2f req-fa70145c-c168-46e2-965d-3b9b45241eb8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:17.432493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5c0a6707-e3e0-4b40-8156-40225413cf2f req-fa70145c-c168-46e2-965d-3b9b45241eb8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:17.449306 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5c0a6707-e3e0-4b40-8156-40225413cf2f req-fa70145c-c168-46e2-965d-3b9b45241eb8 service nova] Creating event network-changed:ccbb58f4-5ca0-4fd2-9c8e-3763d9182d52 for instance a2116b6a-ccc9-4993-8476-d53c16d9a896 on nch2-master-1 Mar 12 21:16:17.455595 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5c0a6707-e3e0-4b40-8156-40225413cf2f req-fa70145c-c168-46e2-965d-3b9b45241eb8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038625 Mar 12 21:16:17.456528 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3897/4665] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:17.470988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-65fbff89-78cc-4ee2-a620-3bfd56dd8ee1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:17.471900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-65fbff89-78cc-4ee2-a620-3bfd56dd8ee1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:17.483715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65fbff89-78cc-4ee2-a620-3bfd56dd8ee1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:17.484190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65fbff89-78cc-4ee2-a620-3bfd56dd8ee1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:17.484986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65fbff89-78cc-4ee2-a620-3bfd56dd8ee1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:17.485441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65fbff89-78cc-4ee2-a620-3bfd56dd8ee1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:17.742307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-65fbff89-78cc-4ee2-a620-3bfd56dd8ee1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:17.753229 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-65fbff89-78cc-4ee2-a620-3bfd56dd8ee1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1392 microversion: 2.1 time: 0.295348 Mar 12 21:16:17.753969 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3898/4666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:17 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1392 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:17.776060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-325b4837-ba61-482c-ac5e-fecbb19839b1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:17.777138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-325b4837-ba61-482c-ac5e-fecbb19839b1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:17.792017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-325b4837-ba61-482c-ac5e-fecbb19839b1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:17.792670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-325b4837-ba61-482c-ac5e-fecbb19839b1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:17.793457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-325b4837-ba61-482c-ac5e-fecbb19839b1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:17.794130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-325b4837-ba61-482c-ac5e-fecbb19839b1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:17.995572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-325b4837-ba61-482c-ac5e-fecbb19839b1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:18.005277 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-325b4837-ba61-482c-ac5e-fecbb19839b1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1469 microversion: 2.1 time: 0.249087 Mar 12 21:16:18.009831 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3899/4667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:17 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1469 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:18.050144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f00f80b4-352b-40d0-bb57-c6d42b94b6aa tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:18.052790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f00f80b4-352b-40d0-bb57-c6d42b94b6aa tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:18.060961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f00f80b4-352b-40d0-bb57-c6d42b94b6aa tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:18.061434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f00f80b4-352b-40d0-bb57-c6d42b94b6aa tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:18.062301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f00f80b4-352b-40d0-bb57-c6d42b94b6aa tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:18.062756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f00f80b4-352b-40d0-bb57-c6d42b94b6aa tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:18.232406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f00f80b4-352b-40d0-bb57-c6d42b94b6aa tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:18.241498 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f00f80b4-352b-40d0-bb57-c6d42b94b6aa tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1376 microversion: 2.1 time: 0.196555 Mar 12 21:16:18.242027 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3900/4668] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:18 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1376 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:18.415830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7789c3eb-bac8-418e-9eb3-a434634de236 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:18.417891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7789c3eb-bac8-418e-9eb3-a434634de236 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:18.425383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7789c3eb-bac8-418e-9eb3-a434634de236 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:18.426508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7789c3eb-bac8-418e-9eb3-a434634de236 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:18.427522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7789c3eb-bac8-418e-9eb3-a434634de236 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:18.428146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7789c3eb-bac8-418e-9eb3-a434634de236 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:18.643329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7789c3eb-bac8-418e-9eb3-a434634de236 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:18.655559 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7789c3eb-bac8-418e-9eb3-a434634de236 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1324 microversion: 2.1 time: 0.243718 Mar 12 21:16:18.667485 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3901/4669] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:18 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:18.807296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c6c79a8-8208-43b8-98bc-1ab32548f527 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:18.807987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c6c79a8-8208-43b8-98bc-1ab32548f527 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:18.815372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c6c79a8-8208-43b8-98bc-1ab32548f527 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:18.815840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c6c79a8-8208-43b8-98bc-1ab32548f527 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:18.816669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c6c79a8-8208-43b8-98bc-1ab32548f527 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:18.817506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c6c79a8-8208-43b8-98bc-1ab32548f527 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:18.984471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4c6c79a8-8208-43b8-98bc-1ab32548f527 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:18.992103 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4c6c79a8-8208-43b8-98bc-1ab32548f527 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1392 microversion: 2.1 time: 0.204822 Mar 12 21:16:18.992687 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3902/4670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:18 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1392 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:19.023823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1a6f9642-2d53-48b7-b934-556effc29b1e tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:19.024455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1a6f9642-2d53-48b7-b934-556effc29b1e tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:19.030266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a6f9642-2d53-48b7-b934-556effc29b1e tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:19.030729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a6f9642-2d53-48b7-b934-556effc29b1e tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:19.031511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a6f9642-2d53-48b7-b934-556effc29b1e tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:19.031961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a6f9642-2d53-48b7-b934-556effc29b1e tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:19.198783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1a6f9642-2d53-48b7-b934-556effc29b1e tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:19.210206 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1a6f9642-2d53-48b7-b934-556effc29b1e tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1469 microversion: 2.1 time: 0.190139 Mar 12 21:16:19.210804 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3903/4671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:19 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1469 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:19.215284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1ab029d5-0365-4684-975e-892f664f9771 req-20b97eba-d3f0-45cb-bedc-6397e13f2238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d96e50-c6c0-4f6f-a0ae-f33c1724e89d", "name": "network-vif-plugged", "status": "completed", "tag": "2dbe4431-426f-40bc-8bbf-68742b1be825"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:19.223964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1ab029d5-0365-4684-975e-892f664f9771 req-20b97eba-d3f0-45cb-bedc-6397e13f2238 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:19.224468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1ab029d5-0365-4684-975e-892f664f9771 req-20b97eba-d3f0-45cb-bedc-6397e13f2238 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:19.238763 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1ab029d5-0365-4684-975e-892f664f9771 req-20b97eba-d3f0-45cb-bedc-6397e13f2238 service nova] Creating event network-vif-plugged:2dbe4431-426f-40bc-8bbf-68742b1be825 for instance 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d on nch1-master-1 Mar 12 21:16:19.245365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1ab029d5-0365-4684-975e-892f664f9771 req-20b97eba-d3f0-45cb-bedc-6397e13f2238 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033416 Mar 12 21:16:19.246008 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3904/4672] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:19.259579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d076d339-5d79-45c6-a851-5ba4c3b6c2c4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:19.260433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d076d339-5d79-45c6-a851-5ba4c3b6c2c4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:19.267456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d076d339-5d79-45c6-a851-5ba4c3b6c2c4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:19.268147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d076d339-5d79-45c6-a851-5ba4c3b6c2c4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:19.269094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d076d339-5d79-45c6-a851-5ba4c3b6c2c4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:19.269787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d076d339-5d79-45c6-a851-5ba4c3b6c2c4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:19.439291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d076d339-5d79-45c6-a851-5ba4c3b6c2c4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:19.446899 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d076d339-5d79-45c6-a851-5ba4c3b6c2c4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1376 microversion: 2.1 time: 0.191962 Mar 12 21:16:19.448354 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3905/4673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:19 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1376 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:19.471335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7ccd1961-9945-45ab-8d16-34bd3b8ec681 req-b0faf881-6776-4671-aafa-5dfccf15a9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0580517f-a6d7-45c0-a8f4-b9a00ae9891b", "tag": "6a9222df-2390-4790-b296-bd3aa877fefc"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:19.479124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7ccd1961-9945-45ab-8d16-34bd3b8ec681 req-b0faf881-6776-4671-aafa-5dfccf15a9d9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:19.479586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7ccd1961-9945-45ab-8d16-34bd3b8ec681 req-b0faf881-6776-4671-aafa-5dfccf15a9d9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:19.490316 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7ccd1961-9945-45ab-8d16-34bd3b8ec681 req-b0faf881-6776-4671-aafa-5dfccf15a9d9 service nova] Creating event network-changed:6a9222df-2390-4790-b296-bd3aa877fefc for instance 0580517f-a6d7-45c0-a8f4-b9a00ae9891b on nch1-master-1 Mar 12 21:16:19.495113 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7ccd1961-9945-45ab-8d16-34bd3b8ec681 req-b0faf881-6776-4671-aafa-5dfccf15a9d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027432 Mar 12 21:16:19.495714 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3906/4674] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:19.673216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ff129b9-d261-49d3-976c-8f6c3ed3bb9c tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:19.674216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ff129b9-d261-49d3-976c-8f6c3ed3bb9c tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:19.680979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ff129b9-d261-49d3-976c-8f6c3ed3bb9c tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:19.682142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ff129b9-d261-49d3-976c-8f6c3ed3bb9c tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:19.692405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ff129b9-d261-49d3-976c-8f6c3ed3bb9c tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:19.692877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ff129b9-d261-49d3-976c-8f6c3ed3bb9c tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:19.837626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ff129b9-d261-49d3-976c-8f6c3ed3bb9c tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:19.845239 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ff129b9-d261-49d3-976c-8f6c3ed3bb9c tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1324 microversion: 2.1 time: 0.176485 Mar 12 21:16:19.846175 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3907/4675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:19 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1324 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:20.011432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71f02624-7b94-41b2-9f27-a95d2ff2faef tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:20.012387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71f02624-7b94-41b2-9f27-a95d2ff2faef tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:20.023369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71f02624-7b94-41b2-9f27-a95d2ff2faef tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:20.023835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71f02624-7b94-41b2-9f27-a95d2ff2faef tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:20.024626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71f02624-7b94-41b2-9f27-a95d2ff2faef tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:20.025074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71f02624-7b94-41b2-9f27-a95d2ff2faef tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:20.444879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-71f02624-7b94-41b2-9f27-a95d2ff2faef tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:20.452467 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71f02624-7b94-41b2-9f27-a95d2ff2faef tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1392 microversion: 2.1 time: 0.446062 Mar 12 21:16:20.453376 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3908/4676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:20 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1392 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:20.459175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f4541cc6-31eb-4191-9119-ea0915635564 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:20.460023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f4541cc6-31eb-4191-9119-ea0915635564 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:20.466859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4541cc6-31eb-4191-9119-ea0915635564 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:20.467305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4541cc6-31eb-4191-9119-ea0915635564 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:20.468303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4541cc6-31eb-4191-9119-ea0915635564 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:20.468758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4541cc6-31eb-4191-9119-ea0915635564 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:20.620318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f4541cc6-31eb-4191-9119-ea0915635564 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:20.628645 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f4541cc6-31eb-4191-9119-ea0915635564 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1469 microversion: 2.1 time: 0.174228 Mar 12 21:16:20.629256 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3909/4677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:20 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:20.634538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-63197826-94ed-47bd-8113-a5d7bc6326f5 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:20.635231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-63197826-94ed-47bd-8113-a5d7bc6326f5 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:20.641863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63197826-94ed-47bd-8113-a5d7bc6326f5 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:20.642339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63197826-94ed-47bd-8113-a5d7bc6326f5 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:20.643126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63197826-94ed-47bd-8113-a5d7bc6326f5 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:20.643613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63197826-94ed-47bd-8113-a5d7bc6326f5 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:20.786783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-63197826-94ed-47bd-8113-a5d7bc6326f5 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:20.794378 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-63197826-94ed-47bd-8113-a5d7bc6326f5 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1376 microversion: 2.1 time: 0.164181 Mar 12 21:16:20.794949 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3910/4678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:20 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:20.862495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3e9e936b-cb69-4d8a-a6e2-be4726f89407 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:20.863117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3e9e936b-cb69-4d8a-a6e2-be4726f89407 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:20.869574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e9e936b-cb69-4d8a-a6e2-be4726f89407 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:20.870298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e9e936b-cb69-4d8a-a6e2-be4726f89407 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:20.871625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e9e936b-cb69-4d8a-a6e2-be4726f89407 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:20.872556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e9e936b-cb69-4d8a-a6e2-be4726f89407 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:21.024973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3e9e936b-cb69-4d8a-a6e2-be4726f89407 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:21.032524 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3e9e936b-cb69-4d8a-a6e2-be4726f89407 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1324 microversion: 2.1 time: 0.174527 Mar 12 21:16:21.033096 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3911/4679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:20 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:21.266339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ea84dbbf-ebcc-4d3e-9a02-f3c2d89a4f4b req-3768cb00-fc7a-4dfd-af7d-95293b8c78bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2116b6a-ccc9-4993-8476-d53c16d9a896", "name": "network-vif-plugged", "status": "completed", "tag": "ccbb58f4-5ca0-4fd2-9c8e-3763d9182d52"}, {"server_uuid": "ea1998fa-885f-46b7-af22-f2966ffa7a12", "name": "network-vif-plugged", "status": "completed", "tag": "607b4ce8-bfc1-4c96-a5e7-3ecd22d49b98"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:21.277457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ea84dbbf-ebcc-4d3e-9a02-f3c2d89a4f4b req-3768cb00-fc7a-4dfd-af7d-95293b8c78bf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:21.277885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ea84dbbf-ebcc-4d3e-9a02-f3c2d89a4f4b req-3768cb00-fc7a-4dfd-af7d-95293b8c78bf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:21.291958 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ea84dbbf-ebcc-4d3e-9a02-f3c2d89a4f4b req-3768cb00-fc7a-4dfd-af7d-95293b8c78bf service nova] Creating event network-vif-plugged:ccbb58f4-5ca0-4fd2-9c8e-3763d9182d52 for instance a2116b6a-ccc9-4993-8476-d53c16d9a896 on nch2-master-1 Mar 12 21:16:21.292626 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ea84dbbf-ebcc-4d3e-9a02-f3c2d89a4f4b req-3768cb00-fc7a-4dfd-af7d-95293b8c78bf service nova] Creating event network-vif-plugged:607b4ce8-bfc1-4c96-a5e7-3ecd22d49b98 for instance ea1998fa-885f-46b7-af22-f2966ffa7a12 on nch2-master-1 Mar 12 21:16:21.300307 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ea84dbbf-ebcc-4d3e-9a02-f3c2d89a4f4b req-3768cb00-fc7a-4dfd-af7d-95293b8c78bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037415 Mar 12 21:16:21.301032 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3912/4680] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:16:21.471345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9d4ffa22-7530-4109-9bba-9c74ab628877 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:21.472707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9d4ffa22-7530-4109-9bba-9c74ab628877 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:21.480390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d4ffa22-7530-4109-9bba-9c74ab628877 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:21.480861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d4ffa22-7530-4109-9bba-9c74ab628877 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:21.481809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d4ffa22-7530-4109-9bba-9c74ab628877 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:21.482300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d4ffa22-7530-4109-9bba-9c74ab628877 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:21.625878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9d4ffa22-7530-4109-9bba-9c74ab628877 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:21.633356 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9d4ffa22-7530-4109-9bba-9c74ab628877 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1392 microversion: 2.1 time: 0.166887 Mar 12 21:16:21.633967 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3913/4681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:21 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:21.645653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71ee5788-741a-43a0-8b3c-2adbf89922a0 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:21.646363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71ee5788-741a-43a0-8b3c-2adbf89922a0 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:21.653109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71ee5788-741a-43a0-8b3c-2adbf89922a0 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:21.653566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71ee5788-741a-43a0-8b3c-2adbf89922a0 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:21.654440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71ee5788-741a-43a0-8b3c-2adbf89922a0 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:21.654904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71ee5788-741a-43a0-8b3c-2adbf89922a0 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:21.811200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-71ee5788-741a-43a0-8b3c-2adbf89922a0 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:21.819752 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71ee5788-741a-43a0-8b3c-2adbf89922a0 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1469 microversion: 2.1 time: 0.177845 Mar 12 21:16:21.820574 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3914/4682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:21 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1469 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:21.825120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f0a421a-16c1-4ef4-8fbd-33bf513186ff tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:21.825829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f0a421a-16c1-4ef4-8fbd-33bf513186ff tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:21.832209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f0a421a-16c1-4ef4-8fbd-33bf513186ff tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:21.832686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f0a421a-16c1-4ef4-8fbd-33bf513186ff tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:21.833858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f0a421a-16c1-4ef4-8fbd-33bf513186ff tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:21.834222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f0a421a-16c1-4ef4-8fbd-33bf513186ff tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:21.982796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8f0a421a-16c1-4ef4-8fbd-33bf513186ff tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:21.990867 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f0a421a-16c1-4ef4-8fbd-33bf513186ff tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1562 microversion: 2.1 time: 0.169236 Mar 12 21:16:21.991640 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3915/4683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:21 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:22.008056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ee071b0-3a7d-455e-afbc-ac35478254f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:22.008663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5ee071b0-3a7d-455e-afbc-ac35478254f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:22.015617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ee071b0-3a7d-455e-afbc-ac35478254f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:22.016101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ee071b0-3a7d-455e-afbc-ac35478254f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:22.016933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ee071b0-3a7d-455e-afbc-ac35478254f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:22.017389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ee071b0-3a7d-455e-afbc-ac35478254f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:22.157821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5ee071b0-3a7d-455e-afbc-ac35478254f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:22.166179 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ee071b0-3a7d-455e-afbc-ac35478254f1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1562 microversion: 2.1 time: 0.161824 Mar 12 21:16:22.166760 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3916/4684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:22 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:22.171336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6397314a-fad5-4a1e-b596-ec8f5b4c6d50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:22.172953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6397314a-fad5-4a1e-b596-ec8f5b4c6d50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:22.180811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6397314a-fad5-4a1e-b596-ec8f5b4c6d50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:22.181222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6397314a-fad5-4a1e-b596-ec8f5b4c6d50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:22.182598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6397314a-fad5-4a1e-b596-ec8f5b4c6d50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:22.183044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6397314a-fad5-4a1e-b596-ec8f5b4c6d50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:22.335038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6397314a-fad5-4a1e-b596-ec8f5b4c6d50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:22.343572 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6397314a-fad5-4a1e-b596-ec8f5b4c6d50 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1324 microversion: 2.1 time: 0.175837 Mar 12 21:16:22.344185 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3917/4685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:22 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1324 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:22.349735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-622a844c-e1d6-4e0f-b262-865ebd137ba1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:22.350313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-622a844c-e1d6-4e0f-b262-865ebd137ba1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:22.356983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-622a844c-e1d6-4e0f-b262-865ebd137ba1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:22.357481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-622a844c-e1d6-4e0f-b262-865ebd137ba1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:22.358320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-622a844c-e1d6-4e0f-b262-865ebd137ba1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:22.358786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-622a844c-e1d6-4e0f-b262-865ebd137ba1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:22.388870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-622a844c-e1d6-4e0f-b262-865ebd137ba1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:16:22.470652 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-622a844c-e1d6-4e0f-b262-865ebd137ba1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "DELETE /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 204 len: 0 microversion: 2.1 time: 0.125023 Mar 12 21:16:22.471561 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3918/4686] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:16:22 2022] DELETE /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:16:22.481245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4c95f4e-b96f-4c25-9f3e-07c801cf6f9c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:22.482146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b4c95f4e-b96f-4c25-9f3e-07c801cf6f9c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:22.488831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4c95f4e-b96f-4c25-9f3e-07c801cf6f9c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:22.489414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4c95f4e-b96f-4c25-9f3e-07c801cf6f9c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:22.490234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4c95f4e-b96f-4c25-9f3e-07c801cf6f9c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:22.490691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4c95f4e-b96f-4c25-9f3e-07c801cf6f9c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:22.642891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b4c95f4e-b96f-4c25-9f3e-07c801cf6f9c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:22.651957 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b4c95f4e-b96f-4c25-9f3e-07c801cf6f9c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1568 microversion: 2.1 time: 0.175417 Mar 12 21:16:22.652559 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3919/4687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:22 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:22.657110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0bc559a0-6085-4c23-9808-ea0685dab2a1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:22.657741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0bc559a0-6085-4c23-9808-ea0685dab2a1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:22.664017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bc559a0-6085-4c23-9808-ea0685dab2a1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:22.664483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bc559a0-6085-4c23-9808-ea0685dab2a1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:22.665285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bc559a0-6085-4c23-9808-ea0685dab2a1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:22.665747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bc559a0-6085-4c23-9808-ea0685dab2a1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:22.816910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0bc559a0-6085-4c23-9808-ea0685dab2a1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:22.826625 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0bc559a0-6085-4c23-9808-ea0685dab2a1 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1392 microversion: 2.1 time: 0.173024 Mar 12 21:16:22.837129 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3920/4688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:22 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:22.843451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2ffcfb9-3a81-47eb-9864-b5aa2ccc1c27 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:22.844084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2ffcfb9-3a81-47eb-9864-b5aa2ccc1c27 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:22.850830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2ffcfb9-3a81-47eb-9864-b5aa2ccc1c27 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:22.851298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2ffcfb9-3a81-47eb-9864-b5aa2ccc1c27 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:22.852230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2ffcfb9-3a81-47eb-9864-b5aa2ccc1c27 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:22.852815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2ffcfb9-3a81-47eb-9864-b5aa2ccc1c27 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:23.030560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e2ffcfb9-3a81-47eb-9864-b5aa2ccc1c27 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:23.039117 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2ffcfb9-3a81-47eb-9864-b5aa2ccc1c27 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1469 microversion: 2.1 time: 0.199967 Mar 12 21:16:23.039714 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3921/4689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:22 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1469 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:23.360925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6e3a70f6-e86a-451e-93b3-6a1b77caefb5 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:23.361586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6e3a70f6-e86a-451e-93b3-6a1b77caefb5 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:23.368710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e3a70f6-e86a-451e-93b3-6a1b77caefb5 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:23.369754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e3a70f6-e86a-451e-93b3-6a1b77caefb5 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:23.370697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e3a70f6-e86a-451e-93b3-6a1b77caefb5 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:23.371271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e3a70f6-e86a-451e-93b3-6a1b77caefb5 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:23.525363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6e3a70f6-e86a-451e-93b3-6a1b77caefb5 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:23.533956 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6e3a70f6-e86a-451e-93b3-6a1b77caefb5 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1520 microversion: 2.1 time: 0.177046 Mar 12 21:16:23.534636 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3922/4690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:23 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:23.596102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d4456ac9-2c74-4e5e-a280-3dbd0d97e261 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-669050111", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "fd99822f-5469-4690-ba79-1b426a6164f2"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:23.597838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d4456ac9-2c74-4e5e-a280-3dbd0d97e261 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:16:23.598740 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d4456ac9-2c74-4e5e-a280-3dbd0d97e261 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.007404 Mar 12 21:16:23.599296 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3923/4691] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:16:23 2022] POST /compute/v2.1/servers => generated 175 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 12 21:16:23.610503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12d94cac-ffb3-4f37-8c79-9a1fcb65eb61 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:23.613049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-12d94cac-ffb3-4f37-8c79-9a1fcb65eb61 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: 39bf3fe4-509b-4f2c-9c2e-66c4a5c739fd] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:23.619821 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-12d94cac-ffb3-4f37-8c79-9a1fcb65eb61 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] HTTP exception thrown: Instance 39bf3fe4-509b-4f2c-9c2e-66c4a5c739fd could not be found. Mar 12 21:16:23.620453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12d94cac-ffb3-4f37-8c79-9a1fcb65eb61 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Returning 404 to user: Instance 39bf3fe4-509b-4f2c-9c2e-66c4a5c739fd could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:16:23.621281 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-12d94cac-ffb3-4f37-8c79-9a1fcb65eb61 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/39bf3fe4-509b-4f2c-9c2e-66c4a5c739fd/metadata" status: 404 len: 111 microversion: 2.1 time: 0.015027 Mar 12 21:16:23.621888 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3924/4692] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 21:16:23 2022] GET /compute/v2.1/servers/39bf3fe4-509b-4f2c-9c2e-66c4a5c739fd/metadata => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:16:23.672344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f070db6c-2f64-4299-91ed-b5b558caf8e9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:23.673261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f070db6c-2f64-4299-91ed-b5b558caf8e9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:23.680949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f070db6c-2f64-4299-91ed-b5b558caf8e9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:23.681511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f070db6c-2f64-4299-91ed-b5b558caf8e9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:23.682336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f070db6c-2f64-4299-91ed-b5b558caf8e9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:23.683102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f070db6c-2f64-4299-91ed-b5b558caf8e9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:23.842827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f070db6c-2f64-4299-91ed-b5b558caf8e9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:23.851284 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f070db6c-2f64-4299-91ed-b5b558caf8e9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1568 microversion: 2.1 time: 0.184999 Mar 12 21:16:23.851825 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3925/4693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:23 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:23.858595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-095638df-0a18-4969-a0cd-e93c0b08bfef tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1402280164", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "fd99822f-5469-4690-ba79-1b426a6164f2"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:23.858769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-095638df-0a18-4969-a0cd-e93c0b08bfef tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:16:23.859974 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-095638df-0a18-4969-a0cd-e93c0b08bfef tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.007144 Mar 12 21:16:23.869022 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3926/4694] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:16:23 2022] POST /compute/v2.1/servers => generated 687 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:16:23.874449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1ffeda64-71fc-4f5b-9432-ad38f8f51a90 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:23.875311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1ffeda64-71fc-4f5b-9432-ad38f8f51a90 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:23.883986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ffeda64-71fc-4f5b-9432-ad38f8f51a90 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:23.885078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ffeda64-71fc-4f5b-9432-ad38f8f51a90 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:23.886707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ffeda64-71fc-4f5b-9432-ad38f8f51a90 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:23.887877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ffeda64-71fc-4f5b-9432-ad38f8f51a90 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:24.042958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1ffeda64-71fc-4f5b-9432-ad38f8f51a90 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:24.050675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1ffeda64-71fc-4f5b-9432-ad38f8f51a90 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1565 microversion: 2.1 time: 0.189143 Mar 12 21:16:24.051428 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3927/4695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:23 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:24.055921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-833fc212-a0be-4958-99b9-7e88bf97fd39 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2096394447", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "fd99822f-5469-4690-ba79-1b426a6164f2"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:24.058323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-833fc212-a0be-4958-99b9-7e88bf97fd39 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:16:24.059530 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-833fc212-a0be-4958-99b9-7e88bf97fd39 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.007149 Mar 12 21:16:24.060074 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3928/4696] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:16:24 2022] POST /compute/v2.1/servers => generated 689 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:16:24.064989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0950a5d4-c8dc-4623-9a89-1db97273d36f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:24.065894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0950a5d4-c8dc-4623-9a89-1db97273d36f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:24.074124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0950a5d4-c8dc-4623-9a89-1db97273d36f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:24.074614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0950a5d4-c8dc-4623-9a89-1db97273d36f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:24.075606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0950a5d4-c8dc-4623-9a89-1db97273d36f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:24.076183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0950a5d4-c8dc-4623-9a89-1db97273d36f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:24.248643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0950a5d4-c8dc-4623-9a89-1db97273d36f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:24.257135 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0950a5d4-c8dc-4623-9a89-1db97273d36f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1469 microversion: 2.1 time: 0.196063 Mar 12 21:16:24.258225 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3929/4697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:24 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1469 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:24.263042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b5d1557-5739-4d4b-bb65-c57e6b5599a3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:24.263901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b5d1557-5739-4d4b-bb65-c57e6b5599a3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:24.271082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b5d1557-5739-4d4b-bb65-c57e6b5599a3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:24.271485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b5d1557-5739-4d4b-bb65-c57e6b5599a3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:24.272286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b5d1557-5739-4d4b-bb65-c57e6b5599a3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:24.272752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b5d1557-5739-4d4b-bb65-c57e6b5599a3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:24.436220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b5d1557-5739-4d4b-bb65-c57e6b5599a3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:24.444430 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b5d1557-5739-4d4b-bb65-c57e6b5599a3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1565 microversion: 2.1 time: 0.185311 Mar 12 21:16:24.445237 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3930/4698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:24 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1565 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:24.450109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bcbfbf66-f98b-4252-9dea-91f03eb5a932 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-352864145", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "fd99822f-5469-4690-ba79-1b426a6164f2"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:24.451569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bcbfbf66-f98b-4252-9dea-91f03eb5a932 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:16:24.452384 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bcbfbf66-f98b-4252-9dea-91f03eb5a932 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.006443 Mar 12 21:16:24.461170 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3931/4699] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:16:24 2022] POST /compute/v2.1/servers => generated 1197 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Mar 12 21:16:24.520010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-83873d59-b2ec-4483-a52c-bb5b5bb90520 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1480042311", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "fd99822f-5469-4690-ba79-1b426a6164f2"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:24.522051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-83873d59-b2ec-4483-a52c-bb5b5bb90520 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:16:24.523373 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-83873d59-b2ec-4483-a52c-bb5b5bb90520 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.008929 Mar 12 21:16:24.524442 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3932/4700] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Mar 12 21:16:24 2022] POST /compute/v2.1/servers => generated 2221 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Mar 12 21:16:24.537963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b07f833f-c614-40cb-b801-ad3bf3536856 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:24.538796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b07f833f-c614-40cb-b801-ad3bf3536856 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: 7d685a17-5d2e-4217-b435-7d8acd7cc1fb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:24.545800 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b07f833f-c614-40cb-b801-ad3bf3536856 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] HTTP exception thrown: Instance 7d685a17-5d2e-4217-b435-7d8acd7cc1fb could not be found. Mar 12 21:16:24.546953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b07f833f-c614-40cb-b801-ad3bf3536856 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Returning 404 to user: Instance 7d685a17-5d2e-4217-b435-7d8acd7cc1fb could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:16:24.548152 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b07f833f-c614-40cb-b801-ad3bf3536856 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/7d685a17-5d2e-4217-b435-7d8acd7cc1fb/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.015996 Mar 12 21:16:24.548949 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3933/4701] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Mar 12 21:16:24 2022] GET /compute/v2.1/servers/7d685a17-5d2e-4217-b435-7d8acd7cc1fb/metadata/test2 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:16:24.565020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e776ea12-dd36-4b7f-a1b8-1bae76872e30 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:24.565458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e776ea12-dd36-4b7f-a1b8-1bae76872e30 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:24.574043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e776ea12-dd36-4b7f-a1b8-1bae76872e30 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:24.574043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e776ea12-dd36-4b7f-a1b8-1bae76872e30 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:24.574043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e776ea12-dd36-4b7f-a1b8-1bae76872e30 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:24.574360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e776ea12-dd36-4b7f-a1b8-1bae76872e30 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:24.602055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e776ea12-dd36-4b7f-a1b8-1bae76872e30 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:16:24.704345 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e776ea12-dd36-4b7f-a1b8-1bae76872e30 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 204 len: 0 microversion: 2.1 time: 0.142748 Mar 12 21:16:24.705094 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3934/4702] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:16:24 2022] DELETE /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:16:24.715863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-38306914-4503-40a1-9b70-b55f7f75bb9b tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:24.717227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-38306914-4503-40a1-9b70-b55f7f75bb9b tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:24.727109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38306914-4503-40a1-9b70-b55f7f75bb9b tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:24.727768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38306914-4503-40a1-9b70-b55f7f75bb9b tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:24.729079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38306914-4503-40a1-9b70-b55f7f75bb9b tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:24.729516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38306914-4503-40a1-9b70-b55f7f75bb9b tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:25.051135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-38306914-4503-40a1-9b70-b55f7f75bb9b tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:25.075962 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-38306914-4503-40a1-9b70-b55f7f75bb9b tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1526 microversion: 2.1 time: 0.362314 Mar 12 21:16:25.078597 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3935/4703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:24 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1526 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:25.087196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-202ef024-12f8-4613-b41d-f3c8bad8f635 req-1628eeb8-4c65-43d3-8e78-ecaec3c43fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80d96e50-c6c0-4f6f-a0ae-f33c1724e89d", "name": "network-vif-deleted", "tag": "2dbe4431-426f-40bc-8bbf-68742b1be825"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:25.098974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-202ef024-12f8-4613-b41d-f3c8bad8f635 req-1628eeb8-4c65-43d3-8e78-ecaec3c43fa6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:25.098974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-202ef024-12f8-4613-b41d-f3c8bad8f635 req-1628eeb8-4c65-43d3-8e78-ecaec3c43fa6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:25.129757 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-202ef024-12f8-4613-b41d-f3c8bad8f635 req-1628eeb8-4c65-43d3-8e78-ecaec3c43fa6 service nova] Creating event network-vif-deleted:2dbe4431-426f-40bc-8bbf-68742b1be825 for instance 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d on nch1-master-1 Mar 12 21:16:25.141509 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-202ef024-12f8-4613-b41d-f3c8bad8f635 req-1628eeb8-4c65-43d3-8e78-ecaec3c43fa6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060170 Mar 12 21:16:25.142121 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3936/4704] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:25.157509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc4bc050-b342-44d4-8a4e-c32c9f4cc4c1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:25.158417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc4bc050-b342-44d4-8a4e-c32c9f4cc4c1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:25.180163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc4bc050-b342-44d4-8a4e-c32c9f4cc4c1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:25.185609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc4bc050-b342-44d4-8a4e-c32c9f4cc4c1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:25.195534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc4bc050-b342-44d4-8a4e-c32c9f4cc4c1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:25.195534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc4bc050-b342-44d4-8a4e-c32c9f4cc4c1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:25.287040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dc4bc050-b342-44d4-8a4e-c32c9f4cc4c1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:25.298059 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc4bc050-b342-44d4-8a4e-c32c9f4cc4c1 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 200 len: 1361 microversion: 2.1 time: 0.153946 Mar 12 21:16:25.300040 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3937/4705] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:25 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:25.318975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3216c87e-033a-4405-a5db-5a32e4d943df req-9d17a20b-8966-4c71-9094-72cdc8a3b184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0580517f-a6d7-45c0-a8f4-b9a00ae9891b", "name": "network-vif-plugged", "status": "completed", "tag": "6a9222df-2390-4790-b296-bd3aa877fefc"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:25.328324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3216c87e-033a-4405-a5db-5a32e4d943df req-9d17a20b-8966-4c71-9094-72cdc8a3b184 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:25.328791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3216c87e-033a-4405-a5db-5a32e4d943df req-9d17a20b-8966-4c71-9094-72cdc8a3b184 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:25.340795 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3216c87e-033a-4405-a5db-5a32e4d943df req-9d17a20b-8966-4c71-9094-72cdc8a3b184 service nova] Creating event network-vif-plugged:6a9222df-2390-4790-b296-bd3aa877fefc for instance 0580517f-a6d7-45c0-a8f4-b9a00ae9891b on nch1-master-1 Mar 12 21:16:25.345912 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3216c87e-033a-4405-a5db-5a32e4d943df req-9d17a20b-8966-4c71-9094-72cdc8a3b184 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045208 Mar 12 21:16:25.346644 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3938/4706] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:25.352147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85a219ff-545b-4ba7-a7a0-f6a64f727085 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:25.352849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85a219ff-545b-4ba7-a7a0-f6a64f727085 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:25.360846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85a219ff-545b-4ba7-a7a0-f6a64f727085 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:25.361453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85a219ff-545b-4ba7-a7a0-f6a64f727085 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:25.362723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85a219ff-545b-4ba7-a7a0-f6a64f727085 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:25.362860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85a219ff-545b-4ba7-a7a0-f6a64f727085 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:25.680445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-85a219ff-545b-4ba7-a7a0-f6a64f727085 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:25.691401 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85a219ff-545b-4ba7-a7a0-f6a64f727085 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1469 microversion: 2.1 time: 0.343426 Mar 12 21:16:25.701852 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3939/4707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:25 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1469 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:26.094610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0299bf34-1430-4d13-b343-3a4918840d46 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:26.095326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0299bf34-1430-4d13-b343-3a4918840d46 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:26.102564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0299bf34-1430-4d13-b343-3a4918840d46 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:26.102564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0299bf34-1430-4d13-b343-3a4918840d46 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:26.103146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0299bf34-1430-4d13-b343-3a4918840d46 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:26.104065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0299bf34-1430-4d13-b343-3a4918840d46 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:26.381472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0299bf34-1430-4d13-b343-3a4918840d46 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:26.389475 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0299bf34-1430-4d13-b343-3a4918840d46 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1526 microversion: 2.1 time: 0.298980 Mar 12 21:16:26.390118 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3940/4708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:26 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1526 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:26.398045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-801663ae-53b6-4512-ba77-8f38c1433795 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:26.398045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-801663ae-53b6-4512-ba77-8f38c1433795 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:26.403190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-801663ae-53b6-4512-ba77-8f38c1433795 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:26.404210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-801663ae-53b6-4512-ba77-8f38c1433795 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:26.405356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-801663ae-53b6-4512-ba77-8f38c1433795 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:26.405921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-801663ae-53b6-4512-ba77-8f38c1433795 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:26.425283 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-801663ae-53b6-4512-ba77-8f38c1433795 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d could not be found. Mar 12 21:16:26.426190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-801663ae-53b6-4512-ba77-8f38c1433795 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:16:26.427209 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-801663ae-53b6-4512-ba77-8f38c1433795 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 404 len: 111 microversion: 2.1 time: 0.036185 Mar 12 21:16:26.427945 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3941/4709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:26 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:16:26.716239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf0ffafe-e8a1-4edc-9ec5-5c40c005b1d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:26.718012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bf0ffafe-e8a1-4edc-9ec5-5c40c005b1d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:26.735191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf0ffafe-e8a1-4edc-9ec5-5c40c005b1d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:26.735969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf0ffafe-e8a1-4edc-9ec5-5c40c005b1d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:26.736788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf0ffafe-e8a1-4edc-9ec5-5c40c005b1d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:26.738787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf0ffafe-e8a1-4edc-9ec5-5c40c005b1d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:27.051207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bf0ffafe-e8a1-4edc-9ec5-5c40c005b1d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:27.059694 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bf0ffafe-e8a1-4edc-9ec5-5c40c005b1d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1469 microversion: 2.1 time: 0.354816 Mar 12 21:16:27.063897 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3942/4710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:26 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:27.158223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-68c89890-7ca2-47b1-ab5d-b45bcbce121b req-e46418a9-21ec-49f0-a5d2-9b83bd95059c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1998fa-885f-46b7-af22-f2966ffa7a12", "name": "network-vif-deleted", "tag": "607b4ce8-bfc1-4c96-a5e7-3ecd22d49b98"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:27.167389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-68c89890-7ca2-47b1-ab5d-b45bcbce121b req-e46418a9-21ec-49f0-a5d2-9b83bd95059c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:27.167855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-68c89890-7ca2-47b1-ab5d-b45bcbce121b req-e46418a9-21ec-49f0-a5d2-9b83bd95059c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:27.180119 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-68c89890-7ca2-47b1-ab5d-b45bcbce121b req-e46418a9-21ec-49f0-a5d2-9b83bd95059c service nova] Creating event network-vif-deleted:607b4ce8-bfc1-4c96-a5e7-3ecd22d49b98 for instance ea1998fa-885f-46b7-af22-f2966ffa7a12 on nch2-master-1 Mar 12 21:16:27.185434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-68c89890-7ca2-47b1-ab5d-b45bcbce121b req-e46418a9-21ec-49f0-a5d2-9b83bd95059c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030851 Mar 12 21:16:27.186094 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3943/4711] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:16:27.408070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb9b0898-6d21-4a3c-a7e3-ce95b551dea3 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:27.408784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fb9b0898-6d21-4a3c-a7e3-ce95b551dea3 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:27.419246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb9b0898-6d21-4a3c-a7e3-ce95b551dea3 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:27.419848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb9b0898-6d21-4a3c-a7e3-ce95b551dea3 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:27.421262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb9b0898-6d21-4a3c-a7e3-ce95b551dea3 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:27.421722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb9b0898-6d21-4a3c-a7e3-ce95b551dea3 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:27.469063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb9b0898-6d21-4a3c-a7e3-ce95b551dea3 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:27.469528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb9b0898-6d21-4a3c-a7e3-ce95b551dea3 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:27.470112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-fb9b0898-6d21-4a3c-a7e3-ce95b551dea3 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lazy-loading 'fault' on Instance uuid ea1998fa-885f-46b7-af22-f2966ffa7a12 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:16:27.522336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fb9b0898-6d21-4a3c-a7e3-ce95b551dea3 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82873d77f30e4e82b41921a464a20ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fc76f24b4a46fbabcebc5c4d300fcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:27.533497 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb9b0898-6d21-4a3c-a7e3-ce95b551dea3 tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 200 len: 1314 microversion: 2.1 time: 0.127866 Mar 12 21:16:27.534337 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3944/4712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:27 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 1314 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:27.567743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75e1ea8a-7890-4a00-9a9f-52dfdc17676b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:27.568393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75e1ea8a-7890-4a00-9a9f-52dfdc17676b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:27.575324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75e1ea8a-7890-4a00-9a9f-52dfdc17676b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:27.575786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75e1ea8a-7890-4a00-9a9f-52dfdc17676b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:27.576601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75e1ea8a-7890-4a00-9a9f-52dfdc17676b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:27.577047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75e1ea8a-7890-4a00-9a9f-52dfdc17676b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:27.730916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-75e1ea8a-7890-4a00-9a9f-52dfdc17676b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:27.738621 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75e1ea8a-7890-4a00-9a9f-52dfdc17676b tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1565 microversion: 2.1 time: 0.174952 Mar 12 21:16:27.739203 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3945/4713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:27 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:27.743628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6afa8bfe-08e0-4477-9008-daeb4eed61cb req-d4feff99-513d-454b-83b4-59615bf59847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2116b6a-ccc9-4993-8476-d53c16d9a896", "tag": "ccbb58f4-5ca0-4fd2-9c8e-3763d9182d52"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:27.751651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6afa8bfe-08e0-4477-9008-daeb4eed61cb req-d4feff99-513d-454b-83b4-59615bf59847 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:27.752121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6afa8bfe-08e0-4477-9008-daeb4eed61cb req-d4feff99-513d-454b-83b4-59615bf59847 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:27.764417 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6afa8bfe-08e0-4477-9008-daeb4eed61cb req-d4feff99-513d-454b-83b4-59615bf59847 service nova] Creating event network-changed:ccbb58f4-5ca0-4fd2-9c8e-3763d9182d52 for instance a2116b6a-ccc9-4993-8476-d53c16d9a896 on nch2-master-1 Mar 12 21:16:27.769280 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6afa8bfe-08e0-4477-9008-daeb4eed61cb req-d4feff99-513d-454b-83b4-59615bf59847 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028944 Mar 12 21:16:27.769912 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3946/4714] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:28.081090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09e3b603-76fb-424d-b2f5-46f5a6dcb105 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:28.081832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-09e3b603-76fb-424d-b2f5-46f5a6dcb105 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:28.088167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e3b603-76fb-424d-b2f5-46f5a6dcb105 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:28.088636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e3b603-76fb-424d-b2f5-46f5a6dcb105 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:28.089438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e3b603-76fb-424d-b2f5-46f5a6dcb105 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:28.089928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09e3b603-76fb-424d-b2f5-46f5a6dcb105 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:28.239547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09e3b603-76fb-424d-b2f5-46f5a6dcb105 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:28.249309 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09e3b603-76fb-424d-b2f5-46f5a6dcb105 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1641 microversion: 2.1 time: 0.172533 Mar 12 21:16:28.249934 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3947/4715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:28 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1641 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:28.265234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1829a59-a08d-4862-b825-1996575c0f32 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:28.265874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a1829a59-a08d-4862-b825-1996575c0f32 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:28.272367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1829a59-a08d-4862-b825-1996575c0f32 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:28.272837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1829a59-a08d-4862-b825-1996575c0f32 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:28.273670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1829a59-a08d-4862-b825-1996575c0f32 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:28.274157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1829a59-a08d-4862-b825-1996575c0f32 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:28.444712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a1829a59-a08d-4862-b825-1996575c0f32 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:28.454059 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1829a59-a08d-4862-b825-1996575c0f32 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1641 microversion: 2.1 time: 0.192391 Mar 12 21:16:28.454754 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3948/4716] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:28 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1641 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:28.473319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd192444-a4ad-4b87-b24f-5a740ed70bb7 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:28.473981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd192444-a4ad-4b87-b24f-5a740ed70bb7 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:28.480920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd192444-a4ad-4b87-b24f-5a740ed70bb7 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:28.481545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd192444-a4ad-4b87-b24f-5a740ed70bb7 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:28.482456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd192444-a4ad-4b87-b24f-5a740ed70bb7 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:28.482919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd192444-a4ad-4b87-b24f-5a740ed70bb7 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:28.760878 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd192444-a4ad-4b87-b24f-5a740ed70bb7 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1792 microversion: 2.1 time: 0.291921 Mar 12 21:16:28.761624 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3949/4717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:28 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1792 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:28.778937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea51e12f-ddf7-4e73-ba83-3d2a7d1ba1ea tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:28.780479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea51e12f-ddf7-4e73-ba83-3d2a7d1ba1ea tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] [instance: ea1998fa-885f-46b7-af22-f2966ffa7a12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:28.787357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea51e12f-ddf7-4e73-ba83-3d2a7d1ba1ea tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:28.787864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea51e12f-ddf7-4e73-ba83-3d2a7d1ba1ea tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:28.788833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea51e12f-ddf7-4e73-ba83-3d2a7d1ba1ea tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:28.789528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea51e12f-ddf7-4e73-ba83-3d2a7d1ba1ea tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:28.806804 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ea51e12f-ddf7-4e73-ba83-3d2a7d1ba1ea tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] HTTP exception thrown: Instance ea1998fa-885f-46b7-af22-f2966ffa7a12 could not be found. Mar 12 21:16:28.807659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea51e12f-ddf7-4e73-ba83-3d2a7d1ba1ea tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] Returning 404 to user: Instance ea1998fa-885f-46b7-af22-f2966ffa7a12 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:16:28.808671 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea51e12f-ddf7-4e73-ba83-3d2a7d1ba1ea tempest-ServerMetadataNegativeTestJSON-632211954 tempest-ServerMetadataNegativeTestJSON-632211954-project] 10.222.0.30 "GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12" status: 404 len: 111 microversion: 2.1 time: 0.034573 Mar 12 21:16:28.809592 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3950/4718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:28 2022] GET /compute/v2.1/servers/ea1998fa-885f-46b7-af22-f2966ffa7a12 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:16:30.804450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6eff8171-055c-428a-969b-0c1a7d8b4231 req-df0525e1-3099-49ce-9004-3ab58b7b576f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0580517f-a6d7-45c0-a8f4-b9a00ae9891b", "tag": "6a9222df-2390-4790-b296-bd3aa877fefc"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:30.815693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6eff8171-055c-428a-969b-0c1a7d8b4231 req-df0525e1-3099-49ce-9004-3ab58b7b576f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:30.816177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6eff8171-055c-428a-969b-0c1a7d8b4231 req-df0525e1-3099-49ce-9004-3ab58b7b576f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:30.840896 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6eff8171-055c-428a-969b-0c1a7d8b4231 req-df0525e1-3099-49ce-9004-3ab58b7b576f service nova] Creating event network-changed:6a9222df-2390-4790-b296-bd3aa877fefc for instance 0580517f-a6d7-45c0-a8f4-b9a00ae9891b on nch1-master-1 Mar 12 21:16:30.847808 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6eff8171-055c-428a-969b-0c1a7d8b4231 req-df0525e1-3099-49ce-9004-3ab58b7b576f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047665 Mar 12 21:16:30.848771 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3951/4719] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:16:32.469057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1068664317", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "ee10e394-b9a4-4301-b170-a0cb0111bac0"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:32.530446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] validate_networks() for [('ee10e394-b9a4-4301-b170-a0cb0111bac0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:16:32.906679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:16:32.907124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:16:32.907745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:16:32.908436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:16:32.909008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:16:32.920614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:32.921374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:32.922331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:32.922789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:32.943884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:16:32.950776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for user 074c6de57bf94d4a943b2d04e2072ae7 and project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:16:32.966315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:16:32.968811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:16:33.036670 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2354d542-25fc-475b-be40-706194088857 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711169 Mar 12 21:16:33.037405 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3952/4720] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:16:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:16:33.050465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b5877b4-e320-4977-b217-69c7f81467f6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:33.051233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b5877b4-e320-4977-b217-69c7f81467f6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:33.106758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b5877b4-e320-4977-b217-69c7f81467f6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:33.114671 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b5877b4-e320-4977-b217-69c7f81467f6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 200 len: 1193 microversion: 2.1 time: 0.068978 Mar 12 21:16:33.115310 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3953/4721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:33 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 1193 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:34.132747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ef8b99f-83e1-4743-9a79-c8be14c75d47 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:34.133451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ef8b99f-83e1-4743-9a79-c8be14c75d47 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:34.140682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ef8b99f-83e1-4743-9a79-c8be14c75d47 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:34.141338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ef8b99f-83e1-4743-9a79-c8be14c75d47 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:34.142629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ef8b99f-83e1-4743-9a79-c8be14c75d47 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:34.143267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ef8b99f-83e1-4743-9a79-c8be14c75d47 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:34.212913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ef8b99f-83e1-4743-9a79-c8be14c75d47 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:34.220941 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ef8b99f-83e1-4743-9a79-c8be14c75d47 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 200 len: 1251 microversion: 2.1 time: 0.092198 Mar 12 21:16:34.221555 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3954/4722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:34 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 1251 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:35.239048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-476b01bd-f54f-404f-86bf-7ddfc0193bfd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:35.239794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-476b01bd-f54f-404f-86bf-7ddfc0193bfd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:35.247390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-476b01bd-f54f-404f-86bf-7ddfc0193bfd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:35.247857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-476b01bd-f54f-404f-86bf-7ddfc0193bfd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:35.249377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-476b01bd-f54f-404f-86bf-7ddfc0193bfd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:35.249885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-476b01bd-f54f-404f-86bf-7ddfc0193bfd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:35.421245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-476b01bd-f54f-404f-86bf-7ddfc0193bfd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:35.429535 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-476b01bd-f54f-404f-86bf-7ddfc0193bfd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 200 len: 1293 microversion: 2.1 time: 0.194589 Mar 12 21:16:35.430182 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3955/4723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:35 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 1293 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:35.435093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1915b15c-a752-4810-a7ce-ad1735266f6f req-821db1ed-176f-41fd-aa00-102d43b21e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66ec9fb-1980-47de-84ca-9edf47c1cb1f", "tag": "ffc39159-6ca0-4504-bdc2-a66122d0bb59"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:35.444149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1915b15c-a752-4810-a7ce-ad1735266f6f req-821db1ed-176f-41fd-aa00-102d43b21e7e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:35.444604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1915b15c-a752-4810-a7ce-ad1735266f6f req-821db1ed-176f-41fd-aa00-102d43b21e7e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:35.458697 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1915b15c-a752-4810-a7ce-ad1735266f6f req-821db1ed-176f-41fd-aa00-102d43b21e7e service nova] Creating event network-changed:ffc39159-6ca0-4504-bdc2-a66122d0bb59 for instance b66ec9fb-1980-47de-84ca-9edf47c1cb1f on nch1-master-1 Mar 12 21:16:35.467337 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1915b15c-a752-4810-a7ce-ad1735266f6f req-821db1ed-176f-41fd-aa00-102d43b21e7e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035898 Mar 12 21:16:35.468054 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3956/4724] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:36.450312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d065a07-6cf4-443e-aa5b-0b9a5554d743 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:36.451125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8d065a07-6cf4-443e-aa5b-0b9a5554d743 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:36.457430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d065a07-6cf4-443e-aa5b-0b9a5554d743 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:36.457960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d065a07-6cf4-443e-aa5b-0b9a5554d743 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:36.458719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d065a07-6cf4-443e-aa5b-0b9a5554d743 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:36.459232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d065a07-6cf4-443e-aa5b-0b9a5554d743 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:36.605173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d065a07-6cf4-443e-aa5b-0b9a5554d743 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:36.613293 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d065a07-6cf4-443e-aa5b-0b9a5554d743 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 200 len: 1293 microversion: 2.1 time: 0.169348 Mar 12 21:16:36.614106 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3957/4725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:36 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 1293 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:37.632218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fedd9910-f397-4f1e-8913-0081c2025644 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:37.632853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fedd9910-f397-4f1e-8913-0081c2025644 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:37.641136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fedd9910-f397-4f1e-8913-0081c2025644 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:37.641702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fedd9910-f397-4f1e-8913-0081c2025644 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:37.642686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fedd9910-f397-4f1e-8913-0081c2025644 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:37.643296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fedd9910-f397-4f1e-8913-0081c2025644 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:37.786316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fedd9910-f397-4f1e-8913-0081c2025644 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:37.795538 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fedd9910-f397-4f1e-8913-0081c2025644 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 200 len: 1293 microversion: 2.1 time: 0.168314 Mar 12 21:16:37.796267 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3958/4726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:37 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 1293 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:38.815032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f4f08ec6-07c7-4a52-86af-c982168bba2b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:38.815692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f4f08ec6-07c7-4a52-86af-c982168bba2b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:38.823833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4f08ec6-07c7-4a52-86af-c982168bba2b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:38.824401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4f08ec6-07c7-4a52-86af-c982168bba2b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:38.825407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4f08ec6-07c7-4a52-86af-c982168bba2b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:38.825899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4f08ec6-07c7-4a52-86af-c982168bba2b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:38.986713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f4f08ec6-07c7-4a52-86af-c982168bba2b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:38.995953 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f4f08ec6-07c7-4a52-86af-c982168bba2b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 200 len: 1293 microversion: 2.1 time: 0.184988 Mar 12 21:16:38.996977 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3959/4727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:38 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 1293 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:40.016210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aab62d16-cd53-4662-96dc-eed16b17f85a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:40.016907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aab62d16-cd53-4662-96dc-eed16b17f85a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:40.023885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aab62d16-cd53-4662-96dc-eed16b17f85a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:40.024356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aab62d16-cd53-4662-96dc-eed16b17f85a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:40.025709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aab62d16-cd53-4662-96dc-eed16b17f85a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:40.026184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aab62d16-cd53-4662-96dc-eed16b17f85a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:40.170812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aab62d16-cd53-4662-96dc-eed16b17f85a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:40.178283 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aab62d16-cd53-4662-96dc-eed16b17f85a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 200 len: 1293 microversion: 2.1 time: 0.166255 Mar 12 21:16:40.178860 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3960/4728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:40 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 1293 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:40.877091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-75b32704-cce6-4ea3-b32c-b8fab3eb327e req-afb5f9d6-ff12-4a38-98d0-feba41725ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66ec9fb-1980-47de-84ca-9edf47c1cb1f", "name": "network-vif-plugged", "status": "completed", "tag": "ffc39159-6ca0-4504-bdc2-a66122d0bb59"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:40.886391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-75b32704-cce6-4ea3-b32c-b8fab3eb327e req-afb5f9d6-ff12-4a38-98d0-feba41725ede service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:40.888142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-75b32704-cce6-4ea3-b32c-b8fab3eb327e req-afb5f9d6-ff12-4a38-98d0-feba41725ede service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:40.902703 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-75b32704-cce6-4ea3-b32c-b8fab3eb327e req-afb5f9d6-ff12-4a38-98d0-feba41725ede service nova] Creating event network-vif-plugged:ffc39159-6ca0-4504-bdc2-a66122d0bb59 for instance b66ec9fb-1980-47de-84ca-9edf47c1cb1f on nch1-master-1 Mar 12 21:16:40.907611 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-75b32704-cce6-4ea3-b32c-b8fab3eb327e req-afb5f9d6-ff12-4a38-98d0-feba41725ede service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035641 Mar 12 21:16:40.908587 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3961/4729] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:16:41.195788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-956a554c-da6d-449f-902e-b0e623173967 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:41.196505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-956a554c-da6d-449f-902e-b0e623173967 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:41.203497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-956a554c-da6d-449f-902e-b0e623173967 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:41.203967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-956a554c-da6d-449f-902e-b0e623173967 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:41.204765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-956a554c-da6d-449f-902e-b0e623173967 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:41.205228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-956a554c-da6d-449f-902e-b0e623173967 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:41.341180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-956a554c-da6d-449f-902e-b0e623173967 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:41.348427 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-956a554c-da6d-449f-902e-b0e623173967 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 200 len: 1293 microversion: 2.1 time: 0.156901 Mar 12 21:16:41.348996 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3962/4730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:41 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 1293 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:42.366716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-857629e5-158a-45c4-9dca-7e3e74474fb7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:42.367378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-857629e5-158a-45c4-9dca-7e3e74474fb7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:42.374055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-857629e5-158a-45c4-9dca-7e3e74474fb7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:42.374623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-857629e5-158a-45c4-9dca-7e3e74474fb7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:42.375435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-857629e5-158a-45c4-9dca-7e3e74474fb7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:42.375886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-857629e5-158a-45c4-9dca-7e3e74474fb7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:42.517970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-857629e5-158a-45c4-9dca-7e3e74474fb7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:42.525417 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-857629e5-158a-45c4-9dca-7e3e74474fb7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 200 len: 1293 microversion: 2.1 time: 0.162518 Mar 12 21:16:42.526096 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3963/4731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:42 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 1293 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:43.542272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3afad4a-a8a3-4361-9dba-9797e27ced68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:43.542967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c3afad4a-a8a3-4361-9dba-9797e27ced68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:43.550581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3afad4a-a8a3-4361-9dba-9797e27ced68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:43.551054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3afad4a-a8a3-4361-9dba-9797e27ced68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:43.551846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3afad4a-a8a3-4361-9dba-9797e27ced68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:43.552308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3afad4a-a8a3-4361-9dba-9797e27ced68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:43.686768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c3afad4a-a8a3-4361-9dba-9797e27ced68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:43.694296 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3afad4a-a8a3-4361-9dba-9797e27ced68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 200 len: 1474 microversion: 2.1 time: 0.155851 Mar 12 21:16:43.694881 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3964/4732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:43 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 1474 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:43.749979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-287247004", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:43.802485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] validate_networks() for [('ee10e394-b9a4-4301-b170-a0cb0111bac0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:16:44.161679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:16:44.162156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:16:44.162701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:16:44.163126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:16:44.163567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:16:44.172688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:44.173152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:44.174006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:44.174720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:44.192327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:16:44.197562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for user 074c6de57bf94d4a943b2d04e2072ae7 and project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:16:44.209477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:16:44.211774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2d86c292-74e6-48af-9aa6-80213d366057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:16:44.255001 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-19ce6631-a4f3-4aab-bce1-b3ddf84b4b3c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509738 Mar 12 21:16:44.255660 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3965/4733] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:16:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:16:44.265269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8332fbf-9cb1-4ecc-a3ca-c72e8fe14f4b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:44.265794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8332fbf-9cb1-4ecc-a3ca-c72e8fe14f4b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2d86c292-74e6-48af-9aa6-80213d366057] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:44.281814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8332fbf-9cb1-4ecc-a3ca-c72e8fe14f4b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2d86c292-74e6-48af-9aa6-80213d366057] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:16:44.522763 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.scheduler.client.report [None req-c8332fbf-9cb1-4ecc-a3ca-c72e8fe14f4b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Deleted allocations for instance 2d86c292-74e6-48af-9aa6-80213d366057 Mar 12 21:16:44.549632 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8332fbf-9cb1-4ecc-a3ca-c72e8fe14f4b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2d86c292-74e6-48af-9aa6-80213d366057" status: 204 len: 0 microversion: 2.1 time: 0.287399 Mar 12 21:16:44.551782 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3966/4734] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:16:44 2022] DELETE /compute/v2.1/servers/2d86c292-74e6-48af-9aa6-80213d366057 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:16:44.562535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b6c52d70-50e1-4868-8978-c712f404b92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:44.563164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b6c52d70-50e1-4868-8978-c712f404b92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2d86c292-74e6-48af-9aa6-80213d366057] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:44.568602 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b6c52d70-50e1-4868-8978-c712f404b92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 2d86c292-74e6-48af-9aa6-80213d366057 could not be found. Mar 12 21:16:44.569365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b6c52d70-50e1-4868-8978-c712f404b92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 2d86c292-74e6-48af-9aa6-80213d366057 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:16:44.570165 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b6c52d70-50e1-4868-8978-c712f404b92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2d86c292-74e6-48af-9aa6-80213d366057" status: 404 len: 111 microversion: 2.1 time: 0.012424 Mar 12 21:16:44.570738 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3967/4735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:44 2022] GET /compute/v2.1/servers/2d86c292-74e6-48af-9aa6-80213d366057 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:16:44.623326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-804821475", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ee10e394-b9a4-4301-b170-a0cb0111bac0"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:44.676136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] validate_networks() for [('ee10e394-b9a4-4301-b170-a0cb0111bac0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:16:45.070512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:16:45.070956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:16:45.071521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:16:45.071989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:16:45.072393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:16:45.082091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:45.082554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:45.083366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:45.083834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:45.105485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:16:45.110960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for user 074c6de57bf94d4a943b2d04e2072ae7 and project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:16:45.124677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:16:45.126881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:16:45.173282 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2763c51e-cc1c-4927-93a9-fd8a35893401 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554549 Mar 12 21:16:45.173989 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3968/4736] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:16:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:16:45.184720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d3ffa95f-507e-4727-ad2e-d7f8e1a7a0eb tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:45.185371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d3ffa95f-507e-4727-ad2e-d7f8e1a7a0eb tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:45.240898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d3ffa95f-507e-4727-ad2e-d7f8e1a7a0eb tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:45.249007 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d3ffa95f-507e-4727-ad2e-d7f8e1a7a0eb tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 200 len: 1220 microversion: 2.1 time: 0.068754 Mar 12 21:16:45.249583 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3969/4737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:45 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 1220 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:46.266765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2a65ba8-263d-424d-b24f-449ed3758c29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:46.267798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2a65ba8-263d-424d-b24f-449ed3758c29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:46.275466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2a65ba8-263d-424d-b24f-449ed3758c29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:46.275939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2a65ba8-263d-424d-b24f-449ed3758c29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:46.276771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2a65ba8-263d-424d-b24f-449ed3758c29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:46.277239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2a65ba8-263d-424d-b24f-449ed3758c29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:46.339409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f2a65ba8-263d-424d-b24f-449ed3758c29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:46.348261 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2a65ba8-263d-424d-b24f-449ed3758c29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 200 len: 1278 microversion: 2.1 time: 0.085428 Mar 12 21:16:46.348840 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3970/4738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:46 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:47.367791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dbf766c6-4a22-4a38-ac9f-11e366ce4dda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:47.368916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dbf766c6-4a22-4a38-ac9f-11e366ce4dda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:47.376862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbf766c6-4a22-4a38-ac9f-11e366ce4dda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:47.377449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbf766c6-4a22-4a38-ac9f-11e366ce4dda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:47.378540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbf766c6-4a22-4a38-ac9f-11e366ce4dda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:47.378880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbf766c6-4a22-4a38-ac9f-11e366ce4dda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:47.395556 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:16:47.396151 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:16:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:16:47.531788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dbf766c6-4a22-4a38-ac9f-11e366ce4dda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:47.542034 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dbf766c6-4a22-4a38-ac9f-11e366ce4dda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 200 len: 1320 microversion: 2.1 time: 0.179526 Mar 12 21:16:47.542624 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3971/4739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:47 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:47.751163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-074e71e8-034f-4d28-8446-87731b1b79fa req-b29cd33b-22e7-48ed-b917-d5fb0dd71686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3effa5c1-99ff-452e-9110-d5b83795fa4a", "tag": "7227da31-b877-4825-8213-31d52aa37c4c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:47.764702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-074e71e8-034f-4d28-8446-87731b1b79fa req-b29cd33b-22e7-48ed-b917-d5fb0dd71686 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:47.765471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-074e71e8-034f-4d28-8446-87731b1b79fa req-b29cd33b-22e7-48ed-b917-d5fb0dd71686 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:47.782138 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-074e71e8-034f-4d28-8446-87731b1b79fa req-b29cd33b-22e7-48ed-b917-d5fb0dd71686 service nova] Creating event network-changed:7227da31-b877-4825-8213-31d52aa37c4c for instance 3effa5c1-99ff-452e-9110-d5b83795fa4a on nch2-master-1 Mar 12 21:16:47.789036 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-074e71e8-034f-4d28-8446-87731b1b79fa req-b29cd33b-22e7-48ed-b917-d5fb0dd71686 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045514 Mar 12 21:16:47.790463 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3972/4740] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:48.561055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2724375f-6c56-4dd8-a605-49182488d586 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:48.562505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2724375f-6c56-4dd8-a605-49182488d586 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:48.570435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2724375f-6c56-4dd8-a605-49182488d586 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:48.570902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2724375f-6c56-4dd8-a605-49182488d586 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:48.571827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2724375f-6c56-4dd8-a605-49182488d586 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:48.572398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2724375f-6c56-4dd8-a605-49182488d586 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:48.724579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2724375f-6c56-4dd8-a605-49182488d586 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:48.732314 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2724375f-6c56-4dd8-a605-49182488d586 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 200 len: 1320 microversion: 2.1 time: 0.175791 Mar 12 21:16:48.732979 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3973/4741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:48 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:49.022237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d7f5d1e5-26f4-4413-bab8-52994477ddc4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:49.023291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d7f5d1e5-26f4-4413-bab8-52994477ddc4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:49.030162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7f5d1e5-26f4-4413-bab8-52994477ddc4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:49.030672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7f5d1e5-26f4-4413-bab8-52994477ddc4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:49.031611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7f5d1e5-26f4-4413-bab8-52994477ddc4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:49.032053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7f5d1e5-26f4-4413-bab8-52994477ddc4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:49.092663 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d7f5d1e5-26f4-4413-bab8-52994477ddc4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896/action" status: 200 len: 24566 microversion: 2.1 time: 0.074725 Mar 12 21:16:49.093258 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3974/4742] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:16:49 2022] POST /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896/action => generated 24566 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 21:16:49.749942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5d33f21-6f64-4509-88eb-5cd99c0dacf9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:49.750659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e5d33f21-6f64-4509-88eb-5cd99c0dacf9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:49.758029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5d33f21-6f64-4509-88eb-5cd99c0dacf9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:49.758495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5d33f21-6f64-4509-88eb-5cd99c0dacf9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:49.759273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5d33f21-6f64-4509-88eb-5cd99c0dacf9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:49.759723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5d33f21-6f64-4509-88eb-5cd99c0dacf9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:49.897131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e5d33f21-6f64-4509-88eb-5cd99c0dacf9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:49.905009 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e5d33f21-6f64-4509-88eb-5cd99c0dacf9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 200 len: 1320 microversion: 2.1 time: 0.159380 Mar 12 21:16:49.905581 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3975/4743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:49 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 1320 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:50.922393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5ad634b-f207-4cba-9b9b-41fd6e128062 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:50.923088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f5ad634b-f207-4cba-9b9b-41fd6e128062 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:50.930677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5ad634b-f207-4cba-9b9b-41fd6e128062 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:50.931154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5ad634b-f207-4cba-9b9b-41fd6e128062 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:50.931950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5ad634b-f207-4cba-9b9b-41fd6e128062 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:50.932436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5ad634b-f207-4cba-9b9b-41fd6e128062 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:51.065389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f5ad634b-f207-4cba-9b9b-41fd6e128062 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:51.072620 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5ad634b-f207-4cba-9b9b-41fd6e128062 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 200 len: 1320 microversion: 2.1 time: 0.154862 Mar 12 21:16:51.073202 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3976/4744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:50 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:52.088973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a0bb4527-a554-4b13-8694-64bbc860e959 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:52.089624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a0bb4527-a554-4b13-8694-64bbc860e959 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:52.096116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0bb4527-a554-4b13-8694-64bbc860e959 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:52.096580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0bb4527-a554-4b13-8694-64bbc860e959 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:52.097357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0bb4527-a554-4b13-8694-64bbc860e959 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:52.097825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0bb4527-a554-4b13-8694-64bbc860e959 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:52.233012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a0bb4527-a554-4b13-8694-64bbc860e959 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:52.240350 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a0bb4527-a554-4b13-8694-64bbc860e959 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 200 len: 1320 microversion: 2.1 time: 0.155886 Mar 12 21:16:52.240916 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3977/4745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:52 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:52.614280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-215b831a-ee3a-4010-8bf2-2889b79c5682 req-b4aa3495-0dc7-4ff9-ab0f-eec0fdb6c589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3effa5c1-99ff-452e-9110-d5b83795fa4a", "name": "network-vif-plugged", "status": "completed", "tag": "7227da31-b877-4825-8213-31d52aa37c4c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:52.624099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-215b831a-ee3a-4010-8bf2-2889b79c5682 req-b4aa3495-0dc7-4ff9-ab0f-eec0fdb6c589 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:52.624927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-215b831a-ee3a-4010-8bf2-2889b79c5682 req-b4aa3495-0dc7-4ff9-ab0f-eec0fdb6c589 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:52.635839 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-215b831a-ee3a-4010-8bf2-2889b79c5682 req-b4aa3495-0dc7-4ff9-ab0f-eec0fdb6c589 service nova] Creating event network-vif-plugged:7227da31-b877-4825-8213-31d52aa37c4c for instance 3effa5c1-99ff-452e-9110-d5b83795fa4a on nch2-master-1 Mar 12 21:16:52.641042 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-215b831a-ee3a-4010-8bf2-2889b79c5682 req-b4aa3495-0dc7-4ff9-ab0f-eec0fdb6c589 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030699 Mar 12 21:16:52.641644 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3978/4746] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:16:53.258100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c51274b-f83d-423f-84d7-68b0346ec6f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:53.258811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c51274b-f83d-423f-84d7-68b0346ec6f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:53.266518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c51274b-f83d-423f-84d7-68b0346ec6f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:53.266997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c51274b-f83d-423f-84d7-68b0346ec6f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:53.267797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c51274b-f83d-423f-84d7-68b0346ec6f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:53.268254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c51274b-f83d-423f-84d7-68b0346ec6f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:53.402926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0c51274b-f83d-423f-84d7-68b0346ec6f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:53.410337 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c51274b-f83d-423f-84d7-68b0346ec6f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 200 len: 1320 microversion: 2.1 time: 0.156500 Mar 12 21:16:53.410907 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3979/4747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:53 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:54.427471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c74528b-77b5-46b2-9ef4-866c877280c5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:54.428111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c74528b-77b5-46b2-9ef4-866c877280c5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:54.435660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c74528b-77b5-46b2-9ef4-866c877280c5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:54.436135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c74528b-77b5-46b2-9ef4-866c877280c5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:54.436931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c74528b-77b5-46b2-9ef4-866c877280c5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:54.437385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c74528b-77b5-46b2-9ef4-866c877280c5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:54.568138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0c74528b-77b5-46b2-9ef4-866c877280c5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:54.575459 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c74528b-77b5-46b2-9ef4-866c877280c5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 200 len: 1502 microversion: 2.1 time: 0.152301 Mar 12 21:16:54.576036 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3980/4748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:54 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:54.590944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ae42e46-9eff-4a26-ab33-fce056a34331 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:54.591544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ae42e46-9eff-4a26-ab33-fce056a34331 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:54.597145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ae42e46-9eff-4a26-ab33-fce056a34331 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:54.597612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ae42e46-9eff-4a26-ab33-fce056a34331 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:54.598450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ae42e46-9eff-4a26-ab33-fce056a34331 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:54.598903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ae42e46-9eff-4a26-ab33-fce056a34331 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:54.734719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9ae42e46-9eff-4a26-ab33-fce056a34331 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:54.742661 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ae42e46-9eff-4a26-ab33-fce056a34331 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 200 len: 1502 microversion: 2.1 time: 0.155224 Mar 12 21:16:54.743273 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3981/4749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:54 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:54.759490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b25b8a86-71ea-4bfb-8f55-1f60ded43ff4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:54.760059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b25b8a86-71ea-4bfb-8f55-1f60ded43ff4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:54.766303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b25b8a86-71ea-4bfb-8f55-1f60ded43ff4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:54.766772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b25b8a86-71ea-4bfb-8f55-1f60ded43ff4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:54.767557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b25b8a86-71ea-4bfb-8f55-1f60ded43ff4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:54.768014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b25b8a86-71ea-4bfb-8f55-1f60ded43ff4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:54.792190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b25b8a86-71ea-4bfb-8f55-1f60ded43ff4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:16:54.865833 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b25b8a86-71ea-4bfb-8f55-1f60ded43ff4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 204 len: 0 microversion: 2.1 time: 0.109926 Mar 12 21:16:54.866442 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3982/4750] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:16:54 2022] DELETE /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:16:54.874980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d81f7e5-cee2-47ec-b770-74a90062f19f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:54.875708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2d81f7e5-cee2-47ec-b770-74a90062f19f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:54.881834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d81f7e5-cee2-47ec-b770-74a90062f19f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:54.882305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d81f7e5-cee2-47ec-b770-74a90062f19f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:54.883089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d81f7e5-cee2-47ec-b770-74a90062f19f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:54.883544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d81f7e5-cee2-47ec-b770-74a90062f19f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:55.016125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2d81f7e5-cee2-47ec-b770-74a90062f19f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:55.023572 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d81f7e5-cee2-47ec-b770-74a90062f19f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 200 len: 1508 microversion: 2.1 time: 0.152911 Mar 12 21:16:55.024153 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3983/4751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:54 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:56.040491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cebc5574-8c60-4e21-91c3-204629ec5b41 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:56.041254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cebc5574-8c60-4e21-91c3-204629ec5b41 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:56.048311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cebc5574-8c60-4e21-91c3-204629ec5b41 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:56.048776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cebc5574-8c60-4e21-91c3-204629ec5b41 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:56.049844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cebc5574-8c60-4e21-91c3-204629ec5b41 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:56.050301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cebc5574-8c60-4e21-91c3-204629ec5b41 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:56.186941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cebc5574-8c60-4e21-91c3-204629ec5b41 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:56.194317 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cebc5574-8c60-4e21-91c3-204629ec5b41 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 200 len: 1508 microversion: 2.1 time: 0.157783 Mar 12 21:16:56.194891 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3984/4752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:56 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:56.721074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-eb68f9ec-1bc2-4337-b32e-35fabad75b5e req-428d11c9-ee0a-4bcd-8f39-47788993a8ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3effa5c1-99ff-452e-9110-d5b83795fa4a", "name": "network-vif-deleted", "tag": "7227da31-b877-4825-8213-31d52aa37c4c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:56.738846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-eb68f9ec-1bc2-4337-b32e-35fabad75b5e req-428d11c9-ee0a-4bcd-8f39-47788993a8ad service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:56.739655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-eb68f9ec-1bc2-4337-b32e-35fabad75b5e req-428d11c9-ee0a-4bcd-8f39-47788993a8ad service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:56.758712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-eb68f9ec-1bc2-4337-b32e-35fabad75b5e req-428d11c9-ee0a-4bcd-8f39-47788993a8ad service nova] Creating event network-vif-deleted:7227da31-b877-4825-8213-31d52aa37c4c for instance 3effa5c1-99ff-452e-9110-d5b83795fa4a on nch2-master-1 Mar 12 21:16:56.765733 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-eb68f9ec-1bc2-4337-b32e-35fabad75b5e req-428d11c9-ee0a-4bcd-8f39-47788993a8ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047969 Mar 12 21:16:56.767162 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3985/4753] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:57.211543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-370a504a-ad6c-4f76-8880-3181c5c8b004 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:57.212246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-370a504a-ad6c-4f76-8880-3181c5c8b004 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:57.219132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-370a504a-ad6c-4f76-8880-3181c5c8b004 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:57.219593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-370a504a-ad6c-4f76-8880-3181c5c8b004 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:57.220371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-370a504a-ad6c-4f76-8880-3181c5c8b004 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:57.220818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-370a504a-ad6c-4f76-8880-3181c5c8b004 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:57.233494 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-370a504a-ad6c-4f76-8880-3181c5c8b004 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 3effa5c1-99ff-452e-9110-d5b83795fa4a could not be found. Mar 12 21:16:57.234125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-370a504a-ad6c-4f76-8880-3181c5c8b004 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 3effa5c1-99ff-452e-9110-d5b83795fa4a could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:16:57.234950 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-370a504a-ad6c-4f76-8880-3181c5c8b004 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 404 len: 111 microversion: 2.1 time: 0.027991 Mar 12 21:16:57.235481 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3986/4754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:57 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:16:57.244821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6ea2d89-d59a-4ac1-939b-42eb98f039a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'create', calling method: .version_select at 0x7f6e343673a0>, body: {"keypair": {"name": "tempest-key-1171168572"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:57.258569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d6ea2d89-d59a-4ac1-939b-42eb98f039a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:16:57.264146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d6ea2d89-d59a-4ac1-939b-42eb98f039a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for user 074c6de57bf94d4a943b2d04e2072ae7 and project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:16:57.463466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d6ea2d89-d59a-4ac1-939b-42eb98f039a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:16:57.468291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d6ea2d89-d59a-4ac1-939b-42eb98f039a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for user 074c6de57bf94d4a943b2d04e2072ae7 and project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:16:57.482678 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d6ea2d89-d59a-4ac1-939b-42eb98f039a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.241361 Mar 12 21:16:57.483281 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3987/4755] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:16:57 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:57.492622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-68dd0eb2-b53e-48f1-90ea-4f97143c9b99 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '.version_select at 0x7f6e3435c550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:57.495313 ncdv-master-1 devstack@n-api.service[136302]: WARNING oslo_db.sqlalchemy.utils [None req-68dd0eb2-b53e-48f1-90ea-4f97143c9b99 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 12 21:16:57.500999 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-68dd0eb2-b53e-48f1-90ea-4f97143c9b99 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 545 microversion: 2.1 time: 0.012093 Mar 12 21:16:57.501827 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3988/4756] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 21:16:57 2022] GET /compute/v2.1/os-keypairs => generated 545 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:16:57.508690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51329383-2ce1-4867-bced-23c82f3a37e0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:57.509194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51329383-2ce1-4867-bced-23c82f3a37e0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:57.516287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51329383-2ce1-4867-bced-23c82f3a37e0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:57.516755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51329383-2ce1-4867-bced-23c82f3a37e0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:57.517530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51329383-2ce1-4867-bced-23c82f3a37e0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:57.518008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51329383-2ce1-4867-bced-23c82f3a37e0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:57.541331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51329383-2ce1-4867-bced-23c82f3a37e0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:16:57.613030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51329383-2ce1-4867-bced-23c82f3a37e0 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "DELETE /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 204 len: 0 microversion: 2.1 time: 0.107714 Mar 12 21:16:57.613632 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3989/4757] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:16:57 2022] DELETE /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:16:57.619300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1345149155", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "key_name": "tempest-key-1171168572", "networks": [{"uuid": "ee10e394-b9a4-4301-b170-a0cb0111bac0"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:16:57.669296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] validate_networks() for [('ee10e394-b9a4-4301-b170-a0cb0111bac0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:16:58.022789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:16:58.023245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:16:58.023741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:16:58.024168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:16:58.024596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:16:58.033940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:58.034404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:58.035248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:58.035694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:58.054352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:16:58.060937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for user 074c6de57bf94d4a943b2d04e2072ae7 and project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:16:58.078737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:16:58.081179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:16:58.124289 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9ef5c7f-14f1-4c20-8b90-d5c5e704e76d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509274 Mar 12 21:16:58.124945 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3990/4758] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:16:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:16:58.130450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2f14e8e4-1b4a-49a9-bbca-874303a455ed tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:58.131420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2f14e8e4-1b4a-49a9-bbca-874303a455ed tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:58.138373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2f14e8e4-1b4a-49a9-bbca-874303a455ed tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:58.138835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2f14e8e4-1b4a-49a9-bbca-874303a455ed tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:58.139635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2f14e8e4-1b4a-49a9-bbca-874303a455ed tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:58.140079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2f14e8e4-1b4a-49a9-bbca-874303a455ed tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:58.277566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2f14e8e4-1b4a-49a9-bbca-874303a455ed tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:58.285487 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2f14e8e4-1b4a-49a9-bbca-874303a455ed tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1409 microversion: 2.1 time: 0.158769 Mar 12 21:16:58.286116 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3991/4759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:58 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:58.292138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27a3acc6-485b-4c5d-97ab-080ce03e5acf tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:58.293581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27a3acc6-485b-4c5d-97ab-080ce03e5acf tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:58.347383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27a3acc6-485b-4c5d-97ab-080ce03e5acf tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:58.354274 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27a3acc6-485b-4c5d-97ab-080ce03e5acf tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1229 microversion: 2.1 time: 0.065787 Mar 12 21:16:58.354817 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3992/4760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:58 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1229 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:16:59.303285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ec9a272-9ff0-4776-ab0a-7b7ab2503b9f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:59.304663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ec9a272-9ff0-4776-ab0a-7b7ab2503b9f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:59.312189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ec9a272-9ff0-4776-ab0a-7b7ab2503b9f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:59.312655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ec9a272-9ff0-4776-ab0a-7b7ab2503b9f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:59.313443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ec9a272-9ff0-4776-ab0a-7b7ab2503b9f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:59.313929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ec9a272-9ff0-4776-ab0a-7b7ab2503b9f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:59.464043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9ec9a272-9ff0-4776-ab0a-7b7ab2503b9f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:59.472178 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ec9a272-9ff0-4776-ab0a-7b7ab2503b9f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1409 microversion: 2.1 time: 0.172999 Mar 12 21:16:59.472842 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3993/4761] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:59 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1409 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:16:59.477513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b74db5fd-e589-475b-a9c6-f3b43945f84c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:16:59.478178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b74db5fd-e589-475b-a9c6-f3b43945f84c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:16:59.484915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b74db5fd-e589-475b-a9c6-f3b43945f84c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:59.485375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b74db5fd-e589-475b-a9c6-f3b43945f84c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:59.486243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b74db5fd-e589-475b-a9c6-f3b43945f84c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:16:59.486691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b74db5fd-e589-475b-a9c6-f3b43945f84c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:16:59.546732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b74db5fd-e589-475b-a9c6-f3b43945f84c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:16:59.554285 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b74db5fd-e589-475b-a9c6-f3b43945f84c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1287 microversion: 2.1 time: 0.080233 Mar 12 21:16:59.554867 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3994/4762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:16:59 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:00.005845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:00.007401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:00.014110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:00.014615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:00.015403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:00.015852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:00.125363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:17:00.125826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:17:00.126471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:17:00.126898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:17:00.127490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:17:00.206528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:00.214263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:00.214936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:00.215983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:00.216626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:00.253256 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eadabf4f-2680-47b7-8c71-a99424060a7d tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896/action" status: 202 len: 1139 microversion: 2.1 time: 0.251662 Mar 12 21:17:00.263374 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3995/4763] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:17:00 2022] POST /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896/action => generated 1139 bytes in 253 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 12 21:17:00.263374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-40027ea0-daa1-4807-b1cc-51e4741ad1cb req-f76f7670-9e05-466d-90b0-3b9725b9b2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d44bcf-4b65-473c-bad8-9a555f0e0002", "name": "network-vif-deleted", "tag": "79464166-3ddf-4589-9a64-a9a30fa86be2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:00.269076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-40027ea0-daa1-4807-b1cc-51e4741ad1cb req-f76f7670-9e05-466d-90b0-3b9725b9b2a4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:00.269688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-40027ea0-daa1-4807-b1cc-51e4741ad1cb req-f76f7670-9e05-466d-90b0-3b9725b9b2a4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:00.285253 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-40027ea0-daa1-4807-b1cc-51e4741ad1cb req-f76f7670-9e05-466d-90b0-3b9725b9b2a4 service nova] Creating event network-vif-deleted:79464166-3ddf-4589-9a64-a9a30fa86be2 for instance 03d44bcf-4b65-473c-bad8-9a555f0e0002 on nch2-master-1 Mar 12 21:17:00.290899 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-40027ea0-daa1-4807-b1cc-51e4741ad1cb req-f76f7670-9e05-466d-90b0-3b9725b9b2a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035405 Mar 12 21:17:00.291806 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3996/4764] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:17:00.298106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3d4d7178-8f40-42d9-ae3a-3f8facafb9f4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:00.298869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3d4d7178-8f40-42d9-ae3a-3f8facafb9f4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:00.307231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d4d7178-8f40-42d9-ae3a-3f8facafb9f4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:00.309006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d4d7178-8f40-42d9-ae3a-3f8facafb9f4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:00.310184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d4d7178-8f40-42d9-ae3a-3f8facafb9f4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:00.310818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d4d7178-8f40-42d9-ae3a-3f8facafb9f4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:00.509170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3d4d7178-8f40-42d9-ae3a-3f8facafb9f4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:00.525355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3d4d7178-8f40-42d9-ae3a-3f8facafb9f4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1693 microversion: 2.1 time: 0.232200 Mar 12 21:17:00.528258 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3997/4765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:00 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1693 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:00.541707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-355ca7fe-9dec-4620-96b1-773986e8d702 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:00.542940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-355ca7fe-9dec-4620-96b1-773986e8d702 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:00.555426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-355ca7fe-9dec-4620-96b1-773986e8d702 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:00.555819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-355ca7fe-9dec-4620-96b1-773986e8d702 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:00.556642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-355ca7fe-9dec-4620-96b1-773986e8d702 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:00.561853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-355ca7fe-9dec-4620-96b1-773986e8d702 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:00.621937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-355ca7fe-9dec-4620-96b1-773986e8d702 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:00.624201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-355ca7fe-9dec-4620-96b1-773986e8d702 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:00.624791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-355ca7fe-9dec-4620-96b1-773986e8d702 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lazy-loading 'fault' on Instance uuid 03d44bcf-4b65-473c-bad8-9a555f0e0002 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:17:00.679450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-355ca7fe-9dec-4620-96b1-773986e8d702 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:00.688332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-355ca7fe-9dec-4620-96b1-773986e8d702 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 200 len: 1207 microversion: 2.1 time: 0.156400 Mar 12 21:17:00.689389 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3998/4766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:00 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 1207 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:00.705232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-805d8034-3997-4fbf-9835-a01b28c108da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:00.705911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-805d8034-3997-4fbf-9835-a01b28c108da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:00.712870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-805d8034-3997-4fbf-9835-a01b28c108da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:00.713483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-805d8034-3997-4fbf-9835-a01b28c108da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:00.715106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-805d8034-3997-4fbf-9835-a01b28c108da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:00.715761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-805d8034-3997-4fbf-9835-a01b28c108da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:00.899257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-805d8034-3997-4fbf-9835-a01b28c108da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:00.908687 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-805d8034-3997-4fbf-9835-a01b28c108da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1329 microversion: 2.1 time: 0.207780 Mar 12 21:17:00.910191 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 3999/4767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:00 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1329 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:01.545144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1b6a5987-347b-4857-972f-59d144ff40d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:01.545807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1b6a5987-347b-4857-972f-59d144ff40d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:01.552889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b6a5987-347b-4857-972f-59d144ff40d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:01.553376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b6a5987-347b-4857-972f-59d144ff40d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:01.554192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b6a5987-347b-4857-972f-59d144ff40d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:01.554648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1b6a5987-347b-4857-972f-59d144ff40d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:01.689146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1b6a5987-347b-4857-972f-59d144ff40d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:01.696693 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1b6a5987-347b-4857-972f-59d144ff40d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1693 microversion: 2.1 time: 0.156014 Mar 12 21:17:01.697281 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4000/4768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:01 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:01.706598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a93113b-965f-49af-b1cf-c1a90032e6fd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:01.707218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a93113b-965f-49af-b1cf-c1a90032e6fd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:01.712816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a93113b-965f-49af-b1cf-c1a90032e6fd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:01.713292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a93113b-965f-49af-b1cf-c1a90032e6fd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:01.714109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a93113b-965f-49af-b1cf-c1a90032e6fd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:01.715068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a93113b-965f-49af-b1cf-c1a90032e6fd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:01.727902 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-5a93113b-965f-49af-b1cf-c1a90032e6fd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance 03d44bcf-4b65-473c-bad8-9a555f0e0002 could not be found. Mar 12 21:17:01.728504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a93113b-965f-49af-b1cf-c1a90032e6fd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance 03d44bcf-4b65-473c-bad8-9a555f0e0002 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:17:01.729329 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a93113b-965f-49af-b1cf-c1a90032e6fd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 404 len: 111 microversion: 2.1 time: 0.026403 Mar 12 21:17:01.729876 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4001/4769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:01 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:17:01.761832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9790871-9e0f-4655-b6c6-321bda24124f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:01.762356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9790871-9e0f-4655-b6c6-321bda24124f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:01.768378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9790871-9e0f-4655-b6c6-321bda24124f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:01.768850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9790871-9e0f-4655-b6c6-321bda24124f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:01.769638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9790871-9e0f-4655-b6c6-321bda24124f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:01.770124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9790871-9e0f-4655-b6c6-321bda24124f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:01.783624 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f9790871-9e0f-4655-b6c6-321bda24124f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d could not be found. Mar 12 21:17:01.784224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9790871-9e0f-4655-b6c6-321bda24124f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:17:01.785061 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9790871-9e0f-4655-b6c6-321bda24124f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "DELETE /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 404 len: 111 microversion: 2.1 time: 0.027275 Mar 12 21:17:01.785753 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4002/4770] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:17:01 2022] DELETE /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:17:01.794167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c36b20f2-0a09-481b-8f5e-4d711a5c31ca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:01.794741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c36b20f2-0a09-481b-8f5e-4d711a5c31ca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:01.800764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c36b20f2-0a09-481b-8f5e-4d711a5c31ca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:01.801234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c36b20f2-0a09-481b-8f5e-4d711a5c31ca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:01.802058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c36b20f2-0a09-481b-8f5e-4d711a5c31ca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:01.802519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c36b20f2-0a09-481b-8f5e-4d711a5c31ca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:01.815768 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c36b20f2-0a09-481b-8f5e-4d711a5c31ca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d could not be found. Mar 12 21:17:01.816419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c36b20f2-0a09-481b-8f5e-4d711a5c31ca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance 80d96e50-c6c0-4f6f-a0ae-f33c1724e89d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:17:01.817236 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c36b20f2-0a09-481b-8f5e-4d711a5c31ca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d" status: 404 len: 111 microversion: 2.1 time: 0.027447 Mar 12 21:17:01.817783 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4003/4771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:01 2022] GET /compute/v2.1/servers/80d96e50-c6c0-4f6f-a0ae-f33c1724e89d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:17:01.926062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ef928950-d80c-444c-98fe-911412ce44dd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:01.926692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ef928950-d80c-444c-98fe-911412ce44dd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:01.932724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef928950-d80c-444c-98fe-911412ce44dd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:01.933192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef928950-d80c-444c-98fe-911412ce44dd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:01.934001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef928950-d80c-444c-98fe-911412ce44dd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:01.934454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef928950-d80c-444c-98fe-911412ce44dd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:02.071945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ef928950-d80c-444c-98fe-911412ce44dd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:02.079949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ef928950-d80c-444c-98fe-911412ce44dd tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1329 microversion: 2.1 time: 0.158025 Mar 12 21:17:02.080707 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4004/4772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:01 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1329 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:02.294815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0fc26de4-bd48-4e39-b48f-ef43ccec1c19 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:02.295364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0fc26de4-bd48-4e39-b48f-ef43ccec1c19 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:02.301507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fc26de4-bd48-4e39-b48f-ef43ccec1c19 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:02.302021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fc26de4-bd48-4e39-b48f-ef43ccec1c19 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:02.302803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fc26de4-bd48-4e39-b48f-ef43ccec1c19 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:02.303256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fc26de4-bd48-4e39-b48f-ef43ccec1c19 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:02.316280 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-0fc26de4-bd48-4e39-b48f-ef43ccec1c19 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance 03d44bcf-4b65-473c-bad8-9a555f0e0002 could not be found. Mar 12 21:17:02.316884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0fc26de4-bd48-4e39-b48f-ef43ccec1c19 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance 03d44bcf-4b65-473c-bad8-9a555f0e0002 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:17:02.317714 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0fc26de4-bd48-4e39-b48f-ef43ccec1c19 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "DELETE /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 404 len: 111 microversion: 2.1 time: 0.027583 Mar 12 21:17:02.318673 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4005/4773] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:17:02 2022] DELETE /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:17:02.323393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6f95b8c7-a60c-4a93-8d51-e82060062334 req-97bd4308-6b07-4697-91cd-3f989a9f8d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74be7221-8403-44c6-8dcf-847be3cd826f", "tag": "71a72f21-d5eb-459d-bc7e-72168f7db854"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:02.330973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6f95b8c7-a60c-4a93-8d51-e82060062334 req-97bd4308-6b07-4697-91cd-3f989a9f8d33 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:02.331430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6f95b8c7-a60c-4a93-8d51-e82060062334 req-97bd4308-6b07-4697-91cd-3f989a9f8d33 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:02.342638 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6f95b8c7-a60c-4a93-8d51-e82060062334 req-97bd4308-6b07-4697-91cd-3f989a9f8d33 service nova] Creating event network-changed:71a72f21-d5eb-459d-bc7e-72168f7db854 for instance 74be7221-8403-44c6-8dcf-847be3cd826f on nch2-master-1 Mar 12 21:17:02.347391 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6f95b8c7-a60c-4a93-8d51-e82060062334 req-97bd4308-6b07-4697-91cd-3f989a9f8d33 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027535 Mar 12 21:17:02.347971 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4006/4774] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:17:02.352899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a035e760-b287-4aa6-83b8-9c6c7939ca80 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:02.353663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a035e760-b287-4aa6-83b8-9c6c7939ca80 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 03d44bcf-4b65-473c-bad8-9a555f0e0002] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:02.360346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a035e760-b287-4aa6-83b8-9c6c7939ca80 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:02.360813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a035e760-b287-4aa6-83b8-9c6c7939ca80 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:02.361592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a035e760-b287-4aa6-83b8-9c6c7939ca80 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:02.362080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a035e760-b287-4aa6-83b8-9c6c7939ca80 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:02.375810 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a035e760-b287-4aa6-83b8-9c6c7939ca80 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance 03d44bcf-4b65-473c-bad8-9a555f0e0002 could not be found. Mar 12 21:17:02.376453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a035e760-b287-4aa6-83b8-9c6c7939ca80 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance 03d44bcf-4b65-473c-bad8-9a555f0e0002 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:17:02.377370 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a035e760-b287-4aa6-83b8-9c6c7939ca80 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002" status: 404 len: 111 microversion: 2.1 time: 0.028276 Mar 12 21:17:02.378001 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4007/4775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:02 2022] GET /compute/v2.1/servers/03d44bcf-4b65-473c-bad8-9a555f0e0002 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:17:02.443583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ca1765e-85f9-4de2-b6e8-a501b935ace7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Action: 'create', calling method: .version_select at 0x7f6e3435ca60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2016371990"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:02.457101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0ca1765e-85f9-4de2-b6e8-a501b935ace7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:17:02.462217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0ca1765e-85f9-4de2-b6e8-a501b935ace7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for user 284a1908713c4b74a35a1d3b5cd10e80 and project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:17:02.643374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0ca1765e-85f9-4de2-b6e8-a501b935ace7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:17:02.649204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0ca1765e-85f9-4de2-b6e8-a501b935ace7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for user 284a1908713c4b74a35a1d3b5cd10e80 and project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:17:02.664345 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ca1765e-85f9-4de2-b6e8-a501b935ace7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.224727 Mar 12 21:17:02.665114 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4008/4776] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:17:02 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:02.715400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b5a14e7f-9cbd-42fc-9d46-61222a4ed0fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:02.716156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b5a14e7f-9cbd-42fc-9d46-61222a4ed0fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:02.723019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5a14e7f-9cbd-42fc-9d46-61222a4ed0fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:02.723686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5a14e7f-9cbd-42fc-9d46-61222a4ed0fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:02.724503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5a14e7f-9cbd-42fc-9d46-61222a4ed0fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:02.724960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5a14e7f-9cbd-42fc-9d46-61222a4ed0fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:02.958131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b5a14e7f-9cbd-42fc-9d46-61222a4ed0fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:02.966618 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b5a14e7f-9cbd-42fc-9d46-61222a4ed0fe tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1693 microversion: 2.1 time: 0.256556 Mar 12 21:17:02.967208 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4009/4777] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:02 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1693 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:03.096850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cbff924f-f94b-4591-bf08-800267186696 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:03.097487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cbff924f-f94b-4591-bf08-800267186696 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:03.103518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbff924f-f94b-4591-bf08-800267186696 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:03.103987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbff924f-f94b-4591-bf08-800267186696 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:03.104769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbff924f-f94b-4591-bf08-800267186696 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:03.105226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbff924f-f94b-4591-bf08-800267186696 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:03.301997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cbff924f-f94b-4591-bf08-800267186696 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:03.313165 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cbff924f-f94b-4591-bf08-800267186696 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1329 microversion: 2.1 time: 0.220214 Mar 12 21:17:03.322958 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4010/4778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:03 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1329 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:03.988229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f42d60f-a123-4498-bca8-e32de0dea2a4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:03.989011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4f42d60f-a123-4498-bca8-e32de0dea2a4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:03.996370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f42d60f-a123-4498-bca8-e32de0dea2a4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:03.997047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f42d60f-a123-4498-bca8-e32de0dea2a4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:03.998048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f42d60f-a123-4498-bca8-e32de0dea2a4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:03.998688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f42d60f-a123-4498-bca8-e32de0dea2a4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:04.172228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4f42d60f-a123-4498-bca8-e32de0dea2a4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:04.180415 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4f42d60f-a123-4498-bca8-e32de0dea2a4 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1693 microversion: 2.1 time: 0.199089 Mar 12 21:17:04.190288 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4011/4779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:03 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1693 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:04.330658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-421df39b-0d6f-43e0-a01d-a3f46e240a09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:04.331555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-421df39b-0d6f-43e0-a01d-a3f46e240a09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:04.345681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-421df39b-0d6f-43e0-a01d-a3f46e240a09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:04.346564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-421df39b-0d6f-43e0-a01d-a3f46e240a09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:04.347427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-421df39b-0d6f-43e0-a01d-a3f46e240a09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:04.349065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-421df39b-0d6f-43e0-a01d-a3f46e240a09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:04.499379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-421df39b-0d6f-43e0-a01d-a3f46e240a09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:04.506670 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-421df39b-0d6f-43e0-a01d-a3f46e240a09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1329 microversion: 2.1 time: 0.179897 Mar 12 21:17:04.507265 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4012/4780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:04 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1329 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:05.197432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5c40a06-f595-46cd-b9e6-656e8bc899e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:05.198093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f5c40a06-f595-46cd-b9e6-656e8bc899e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:05.204802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5c40a06-f595-46cd-b9e6-656e8bc899e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:05.205273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5c40a06-f595-46cd-b9e6-656e8bc899e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:05.206083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5c40a06-f595-46cd-b9e6-656e8bc899e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:05.206548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5c40a06-f595-46cd-b9e6-656e8bc899e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:05.340364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f5c40a06-f595-46cd-b9e6-656e8bc899e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:05.347747 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5c40a06-f595-46cd-b9e6-656e8bc899e9 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1693 microversion: 2.1 time: 0.154412 Mar 12 21:17:05.348340 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4013/4781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:05 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:05.523312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1e6dc132-8f17-41a6-8143-a79035a138d6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:05.523950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1e6dc132-8f17-41a6-8143-a79035a138d6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:05.530807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e6dc132-8f17-41a6-8143-a79035a138d6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:05.531229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e6dc132-8f17-41a6-8143-a79035a138d6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:05.532217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e6dc132-8f17-41a6-8143-a79035a138d6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:05.532672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e6dc132-8f17-41a6-8143-a79035a138d6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:05.677190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1e6dc132-8f17-41a6-8143-a79035a138d6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:05.684906 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1e6dc132-8f17-41a6-8143-a79035a138d6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1329 microversion: 2.1 time: 0.165522 Mar 12 21:17:05.685483 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4014/4782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:05 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1329 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:06.343829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1062858088", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2016371990", "security_groups": [{"name": "tempest-secgroup-smoke-1247205612"}], "block_device_mapping_v2": [{"uuid": "feb089af-2825-4985-aa6e-09e75c64231e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9594c761-7638-4f69-b579-79baa62b3c38"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:06.454024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] validate_networks() for [('9594c761-7638-4f69-b579-79baa62b3c38', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:17:06.818958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:17:06.819395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:17:06.819886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:17:06.820380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:17:06.820829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:17:06.829614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:06.830153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:06.831155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:06.831605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:06.848480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:17:06.853612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for user 284a1908713c4b74a35a1d3b5cd10e80 and project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:17:06.911063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:17:06.913198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='feb089af-2825-4985-aa6e-09e75c64231e',volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:17:07.055774 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ed055cd-ab84-4e68-b5bf-3404648b1270 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715732 Mar 12 21:17:07.056434 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4015/4783] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:17:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:17:07.064536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-91ae223f-f6b6-43bd-ab97-c1ca0f3104ca tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:07.065190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-91ae223f-f6b6-43bd-ab97-c1ca0f3104ca tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:07.071174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91ae223f-f6b6-43bd-ab97-c1ca0f3104ca tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:07.071639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91ae223f-f6b6-43bd-ab97-c1ca0f3104ca tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:07.072429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91ae223f-f6b6-43bd-ab97-c1ca0f3104ca tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:07.072884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91ae223f-f6b6-43bd-ab97-c1ca0f3104ca tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:07.211886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-91ae223f-f6b6-43bd-ab97-c1ca0f3104ca tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:07.219515 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-91ae223f-f6b6-43bd-ab97-c1ca0f3104ca tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1693 microversion: 2.1 time: 0.158986 Mar 12 21:17:07.220087 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4016/4784] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:07 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:07.224639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ad3c71c-df8e-4e75-9f3c-0f4cbbb7f000 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:07.225251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ad3c71c-df8e-4e75-9f3c-0f4cbbb7f000 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:07.231739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ad3c71c-df8e-4e75-9f3c-0f4cbbb7f000 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:07.232202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ad3c71c-df8e-4e75-9f3c-0f4cbbb7f000 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:07.232985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ad3c71c-df8e-4e75-9f3c-0f4cbbb7f000 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:07.233438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ad3c71c-df8e-4e75-9f3c-0f4cbbb7f000 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:07.374013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ad3c71c-df8e-4e75-9f3c-0f4cbbb7f000 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:07.382835 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ad3c71c-df8e-4e75-9f3c-0f4cbbb7f000 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1329 microversion: 2.1 time: 0.161604 Mar 12 21:17:07.383447 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4017/4785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:07 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1329 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:07.392701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b1393bd1-4801-42a9-8dee-899e740e8d34 req-902bf2e9-6fda-4857-9907-bbde42eb1e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74be7221-8403-44c6-8dcf-847be3cd826f", "name": "network-vif-plugged", "status": "completed", "tag": "71a72f21-d5eb-459d-bc7e-72168f7db854"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:07.397269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b1393bd1-4801-42a9-8dee-899e740e8d34 req-902bf2e9-6fda-4857-9907-bbde42eb1e16 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:07.397817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b1393bd1-4801-42a9-8dee-899e740e8d34 req-902bf2e9-6fda-4857-9907-bbde42eb1e16 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:07.414041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b1393bd1-4801-42a9-8dee-899e740e8d34 req-902bf2e9-6fda-4857-9907-bbde42eb1e16 service nova] Creating event network-vif-plugged:71a72f21-d5eb-459d-bc7e-72168f7db854 for instance 74be7221-8403-44c6-8dcf-847be3cd826f on nch2-master-1 Mar 12 21:17:07.419554 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b1393bd1-4801-42a9-8dee-899e740e8d34 req-902bf2e9-6fda-4857-9907-bbde42eb1e16 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034564 Mar 12 21:17:07.420570 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4018/4786] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:17:07.426099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b119858f-413b-4ac8-add6-c2de82b25c0f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:07.426824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b119858f-413b-4ac8-add6-c2de82b25c0f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:07.433262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b119858f-413b-4ac8-add6-c2de82b25c0f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:07.433782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b119858f-413b-4ac8-add6-c2de82b25c0f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:07.434648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b119858f-413b-4ac8-add6-c2de82b25c0f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:07.435109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b119858f-413b-4ac8-add6-c2de82b25c0f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:07.503040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b119858f-413b-4ac8-add6-c2de82b25c0f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:07.510478 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b119858f-413b-4ac8-add6-c2de82b25c0f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1145 microversion: 2.1 time: 0.088493 Mar 12 21:17:07.511331 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4019/4787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:07 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:08.236415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f050f61a-d7cd-4e8d-bf40-44a47b5c3458 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:08.237370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f050f61a-d7cd-4e8d-bf40-44a47b5c3458 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:08.243665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f050f61a-d7cd-4e8d-bf40-44a47b5c3458 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:08.244139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f050f61a-d7cd-4e8d-bf40-44a47b5c3458 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:08.244925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f050f61a-d7cd-4e8d-bf40-44a47b5c3458 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:08.245375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f050f61a-d7cd-4e8d-bf40-44a47b5c3458 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:08.418065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f050f61a-d7cd-4e8d-bf40-44a47b5c3458 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:08.427005 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f050f61a-d7cd-4e8d-bf40-44a47b5c3458 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1693 microversion: 2.1 time: 0.194362 Mar 12 21:17:08.427903 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4020/4788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:08 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:08.433289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a510e17-0bde-497c-8c67-37e528baf41f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:08.433939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0a510e17-0bde-497c-8c67-37e528baf41f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:08.440697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a510e17-0bde-497c-8c67-37e528baf41f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:08.441550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a510e17-0bde-497c-8c67-37e528baf41f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:08.442383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a510e17-0bde-497c-8c67-37e528baf41f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:08.443050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a510e17-0bde-497c-8c67-37e528baf41f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:08.617248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0a510e17-0bde-497c-8c67-37e528baf41f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:08.628052 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0a510e17-0bde-497c-8c67-37e528baf41f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1329 microversion: 2.1 time: 0.198893 Mar 12 21:17:08.628676 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4021/4789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:08 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1329 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:08.637859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-126d31b4-3a9e-4e4e-8d14-8245734514c2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:08.637859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-126d31b4-3a9e-4e4e-8d14-8245734514c2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:08.647755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-126d31b4-3a9e-4e4e-8d14-8245734514c2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:08.648752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-126d31b4-3a9e-4e4e-8d14-8245734514c2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:08.649924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-126d31b4-3a9e-4e4e-8d14-8245734514c2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:08.650542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-126d31b4-3a9e-4e4e-8d14-8245734514c2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:08.724360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-126d31b4-3a9e-4e4e-8d14-8245734514c2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:08.732937 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-126d31b4-3a9e-4e4e-8d14-8245734514c2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1211 microversion: 2.1 time: 0.101532 Mar 12 21:17:08.742773 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4022/4790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:08 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1211 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:09.446175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dfae1639-98b7-46b6-954b-1c050a12b8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:09.446922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dfae1639-98b7-46b6-954b-1c050a12b8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:09.455522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfae1639-98b7-46b6-954b-1c050a12b8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:09.456024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfae1639-98b7-46b6-954b-1c050a12b8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:09.457622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfae1639-98b7-46b6-954b-1c050a12b8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:09.458113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dfae1639-98b7-46b6-954b-1c050a12b8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:09.595126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dfae1639-98b7-46b6-954b-1c050a12b8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:09.602503 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dfae1639-98b7-46b6-954b-1c050a12b8e7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1693 microversion: 2.1 time: 0.160877 Mar 12 21:17:09.603091 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4023/4791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:09 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:09.644250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bee3699c-6761-4c4e-bfe5-cdb4bc34f189 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:09.644893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bee3699c-6761-4c4e-bfe5-cdb4bc34f189 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:09.650763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bee3699c-6761-4c4e-bfe5-cdb4bc34f189 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:09.651248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bee3699c-6761-4c4e-bfe5-cdb4bc34f189 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:09.652027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bee3699c-6761-4c4e-bfe5-cdb4bc34f189 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:09.652484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bee3699c-6761-4c4e-bfe5-cdb4bc34f189 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:09.820931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bee3699c-6761-4c4e-bfe5-cdb4bc34f189 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:09.835112 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bee3699c-6761-4c4e-bfe5-cdb4bc34f189 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1511 microversion: 2.1 time: 0.194238 Mar 12 21:17:09.846325 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4024/4792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:09 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:09.853267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee3241d1-3a0c-4a75-bf0d-134b4e2c8b03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:09.853948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee3241d1-3a0c-4a75-bf0d-134b4e2c8b03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:09.861410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee3241d1-3a0c-4a75-bf0d-134b4e2c8b03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:09.862985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee3241d1-3a0c-4a75-bf0d-134b4e2c8b03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:09.864362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee3241d1-3a0c-4a75-bf0d-134b4e2c8b03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:09.864997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee3241d1-3a0c-4a75-bf0d-134b4e2c8b03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:10.038243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee3241d1-3a0c-4a75-bf0d-134b4e2c8b03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:10.047045 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee3241d1-3a0c-4a75-bf0d-134b4e2c8b03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1267 microversion: 2.1 time: 0.199254 Mar 12 21:17:10.047825 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4025/4793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:09 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:10.053260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86deeba2-553a-4a78-a82f-ce94860945ce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:10.053909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86deeba2-553a-4a78-a82f-ce94860945ce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:10.061761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86deeba2-553a-4a78-a82f-ce94860945ce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:10.062250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86deeba2-553a-4a78-a82f-ce94860945ce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:10.063050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86deeba2-553a-4a78-a82f-ce94860945ce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:10.063501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86deeba2-553a-4a78-a82f-ce94860945ce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:10.219888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86deeba2-553a-4a78-a82f-ce94860945ce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:10.227543 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86deeba2-553a-4a78-a82f-ce94860945ce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1511 microversion: 2.1 time: 0.178793 Mar 12 21:17:10.228159 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4026/4794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:10 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:10.233270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2eff402c-521f-477f-a6d8-c83cb9a17b63 req-ae4836a8-70ed-4586-bef5-6496210d7cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a823fc52-c4a2-438a-8d37-f43139baf443", "tag": "988c1269-00db-4f30-a158-3ab020b0dfa6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:10.241056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2eff402c-521f-477f-a6d8-c83cb9a17b63 req-ae4836a8-70ed-4586-bef5-6496210d7cb0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:10.241541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2eff402c-521f-477f-a6d8-c83cb9a17b63 req-ae4836a8-70ed-4586-bef5-6496210d7cb0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:10.253054 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2eff402c-521f-477f-a6d8-c83cb9a17b63 req-ae4836a8-70ed-4586-bef5-6496210d7cb0 service nova] Creating event network-changed:988c1269-00db-4f30-a158-3ab020b0dfa6 for instance a823fc52-c4a2-438a-8d37-f43139baf443 on nch2-master-1 Mar 12 21:17:10.257955 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2eff402c-521f-477f-a6d8-c83cb9a17b63 req-ae4836a8-70ed-4586-bef5-6496210d7cb0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028363 Mar 12 21:17:10.258972 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4027/4795] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:17:10.264608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4930c8a1-3554-4128-be5d-145be78a0237 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:10.265203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4930c8a1-3554-4128-be5d-145be78a0237 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:10.271171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4930c8a1-3554-4128-be5d-145be78a0237 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:10.271636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4930c8a1-3554-4128-be5d-145be78a0237 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:10.272444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4930c8a1-3554-4128-be5d-145be78a0237 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:10.272895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4930c8a1-3554-4128-be5d-145be78a0237 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:10.299447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4930c8a1-3554-4128-be5d-145be78a0237 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:17:10.374237 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4930c8a1-3554-4128-be5d-145be78a0237 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 204 len: 0 microversion: 2.1 time: 0.113765 Mar 12 21:17:10.375752 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4028/4796] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:17:10 2022] DELETE /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:17:10.383520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-98c0c4c1-74ce-4819-8545-0069a6a09481 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:10.384228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-98c0c4c1-74ce-4819-8545-0069a6a09481 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:10.390666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98c0c4c1-74ce-4819-8545-0069a6a09481 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:10.391137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98c0c4c1-74ce-4819-8545-0069a6a09481 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:10.391917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98c0c4c1-74ce-4819-8545-0069a6a09481 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:10.392369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98c0c4c1-74ce-4819-8545-0069a6a09481 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:10.541380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-98c0c4c1-74ce-4819-8545-0069a6a09481 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:10.549335 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-98c0c4c1-74ce-4819-8545-0069a6a09481 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1517 microversion: 2.1 time: 0.169349 Mar 12 21:17:10.549996 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4029/4797] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:10 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:10.620694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7e80d4a-280f-48e0-ae61-e1b8a6d45490 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:10.621328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7e80d4a-280f-48e0-ae61-e1b8a6d45490 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:10.627593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7e80d4a-280f-48e0-ae61-e1b8a6d45490 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:10.628066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7e80d4a-280f-48e0-ae61-e1b8a6d45490 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:10.628858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7e80d4a-280f-48e0-ae61-e1b8a6d45490 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:10.629319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7e80d4a-280f-48e0-ae61-e1b8a6d45490 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:10.763528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c7e80d4a-280f-48e0-ae61-e1b8a6d45490 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:10.771771 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7e80d4a-280f-48e0-ae61-e1b8a6d45490 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1693 microversion: 2.1 time: 0.154943 Mar 12 21:17:10.772354 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4030/4798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:10 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:11.064448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e19822a1-b7ff-4edf-8cff-a7ebb769e0d6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:11.064993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e19822a1-b7ff-4edf-8cff-a7ebb769e0d6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:11.070924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e19822a1-b7ff-4edf-8cff-a7ebb769e0d6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:11.071391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e19822a1-b7ff-4edf-8cff-a7ebb769e0d6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:11.072170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e19822a1-b7ff-4edf-8cff-a7ebb769e0d6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:11.072625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e19822a1-b7ff-4edf-8cff-a7ebb769e0d6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:11.214875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e19822a1-b7ff-4edf-8cff-a7ebb769e0d6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:11.226456 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e19822a1-b7ff-4edf-8cff-a7ebb769e0d6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1267 microversion: 2.1 time: 0.165987 Mar 12 21:17:11.227032 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4031/4799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:11 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:11.566218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7df3e3bb-9f9e-43d6-b660-2ee950c8fe46 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:11.566909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7df3e3bb-9f9e-43d6-b660-2ee950c8fe46 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:11.573680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7df3e3bb-9f9e-43d6-b660-2ee950c8fe46 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:11.574180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7df3e3bb-9f9e-43d6-b660-2ee950c8fe46 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:11.575558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7df3e3bb-9f9e-43d6-b660-2ee950c8fe46 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:11.576010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7df3e3bb-9f9e-43d6-b660-2ee950c8fe46 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:11.707248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7df3e3bb-9f9e-43d6-b660-2ee950c8fe46 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:11.714584 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7df3e3bb-9f9e-43d6-b660-2ee950c8fe46 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1517 microversion: 2.1 time: 0.152488 Mar 12 21:17:11.715163 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4032/4800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:11 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:11.789982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e6b0bb23-3d64-4b52-a7a1-0521eb4856f7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:11.790614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e6b0bb23-3d64-4b52-a7a1-0521eb4856f7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:11.797078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6b0bb23-3d64-4b52-a7a1-0521eb4856f7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:11.797590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6b0bb23-3d64-4b52-a7a1-0521eb4856f7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:11.798413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6b0bb23-3d64-4b52-a7a1-0521eb4856f7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:11.799127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6b0bb23-3d64-4b52-a7a1-0521eb4856f7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:11.936153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e6b0bb23-3d64-4b52-a7a1-0521eb4856f7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:11.943480 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e6b0bb23-3d64-4b52-a7a1-0521eb4856f7 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1693 microversion: 2.1 time: 0.157465 Mar 12 21:17:11.944061 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4033/4801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:11 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:12.243084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-035e1d9d-85f9-4b58-81d5-b65be67fbc03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:12.243737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-035e1d9d-85f9-4b58-81d5-b65be67fbc03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:12.250185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-035e1d9d-85f9-4b58-81d5-b65be67fbc03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:12.250648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-035e1d9d-85f9-4b58-81d5-b65be67fbc03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:12.251428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-035e1d9d-85f9-4b58-81d5-b65be67fbc03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:12.251878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-035e1d9d-85f9-4b58-81d5-b65be67fbc03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:12.419792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-035e1d9d-85f9-4b58-81d5-b65be67fbc03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:12.429180 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-035e1d9d-85f9-4b58-81d5-b65be67fbc03 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1267 microversion: 2.1 time: 0.189438 Mar 12 21:17:12.430441 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4034/4802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:12 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:12.437729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-91ea8960-c059-4669-a769-a84d8f65b337 req-08f9b05c-02aa-40bc-a220-164807635275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74be7221-8403-44c6-8dcf-847be3cd826f", "name": "network-vif-deleted", "tag": "71a72f21-d5eb-459d-bc7e-72168f7db854"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:12.447636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-91ea8960-c059-4669-a769-a84d8f65b337 req-08f9b05c-02aa-40bc-a220-164807635275 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:12.448144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-91ea8960-c059-4669-a769-a84d8f65b337 req-08f9b05c-02aa-40bc-a220-164807635275 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:12.460459 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-91ea8960-c059-4669-a769-a84d8f65b337 req-08f9b05c-02aa-40bc-a220-164807635275 service nova] Creating event network-vif-deleted:71a72f21-d5eb-459d-bc7e-72168f7db854 for instance 74be7221-8403-44c6-8dcf-847be3cd826f on nch2-master-1 Mar 12 21:17:12.466690 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-91ea8960-c059-4669-a769-a84d8f65b337 req-08f9b05c-02aa-40bc-a220-164807635275 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034764 Mar 12 21:17:12.467564 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4035/4803] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:17:12.732368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd26519f-3f32-4381-9e87-c439ebb444d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:12.733060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dd26519f-3f32-4381-9e87-c439ebb444d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:12.740217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd26519f-3f32-4381-9e87-c439ebb444d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:12.740699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd26519f-3f32-4381-9e87-c439ebb444d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:12.741512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd26519f-3f32-4381-9e87-c439ebb444d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:12.741995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd26519f-3f32-4381-9e87-c439ebb444d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:12.772072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd26519f-3f32-4381-9e87-c439ebb444d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:12.772420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd26519f-3f32-4381-9e87-c439ebb444d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:12.772877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-dd26519f-3f32-4381-9e87-c439ebb444d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lazy-loading 'fault' on Instance uuid 74be7221-8403-44c6-8dcf-847be3cd826f {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:17:12.812807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dd26519f-3f32-4381-9e87-c439ebb444d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:12.820332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd26519f-3f32-4381-9e87-c439ebb444d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 200 len: 1319 microversion: 2.1 time: 0.092369 Mar 12 21:17:12.820912 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4036/4804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:12 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 1319 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:12.960119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67451b54-6bc7-4f87-a760-4e47160b98d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:12.960747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-67451b54-6bc7-4f87-a760-4e47160b98d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:12.966738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67451b54-6bc7-4f87-a760-4e47160b98d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:12.967203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67451b54-6bc7-4f87-a760-4e47160b98d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:12.967980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67451b54-6bc7-4f87-a760-4e47160b98d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:12.968458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67451b54-6bc7-4f87-a760-4e47160b98d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:13.099115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-67451b54-6bc7-4f87-a760-4e47160b98d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:13.106509 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67451b54-6bc7-4f87-a760-4e47160b98d2 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1699 microversion: 2.1 time: 0.150348 Mar 12 21:17:13.107080 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4037/4805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:12 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1699 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:13.447761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f6ab10d0-601e-4b6d-b8d0-2c83720de477 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:13.448574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f6ab10d0-601e-4b6d-b8d0-2c83720de477 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:13.455392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6ab10d0-601e-4b6d-b8d0-2c83720de477 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:13.455868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6ab10d0-601e-4b6d-b8d0-2c83720de477 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:13.456681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6ab10d0-601e-4b6d-b8d0-2c83720de477 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:13.457141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6ab10d0-601e-4b6d-b8d0-2c83720de477 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:13.595543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f6ab10d0-601e-4b6d-b8d0-2c83720de477 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:13.602946 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f6ab10d0-601e-4b6d-b8d0-2c83720de477 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1267 microversion: 2.1 time: 0.160030 Mar 12 21:17:13.603514 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4038/4806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:13 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:13.837336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4afd1d66-7c4e-4d46-92ba-eeb230e45dca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:13.838031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4afd1d66-7c4e-4d46-92ba-eeb230e45dca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:13.845250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4afd1d66-7c4e-4d46-92ba-eeb230e45dca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:13.845718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4afd1d66-7c4e-4d46-92ba-eeb230e45dca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:13.846547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4afd1d66-7c4e-4d46-92ba-eeb230e45dca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:13.846997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4afd1d66-7c4e-4d46-92ba-eeb230e45dca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:13.860709 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-4afd1d66-7c4e-4d46-92ba-eeb230e45dca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 74be7221-8403-44c6-8dcf-847be3cd826f could not be found. Mar 12 21:17:13.861318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4afd1d66-7c4e-4d46-92ba-eeb230e45dca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 74be7221-8403-44c6-8dcf-847be3cd826f could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:17:13.862198 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4afd1d66-7c4e-4d46-92ba-eeb230e45dca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 404 len: 111 microversion: 2.1 time: 0.028799 Mar 12 21:17:13.862747 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4039/4807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:13 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:17:13.870379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-55c31aaf-de87-48be-9d90-05121fe261e7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '.version_select at 0x7f6e342e21f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:13.889543 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-55c31aaf-de87-48be-9d90-05121fe261e7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-key-1171168572" status: 202 len: 0 microversion: 2.1 time: 0.022539 Mar 12 21:17:13.890203 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4040/4808] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Mar 12 21:17:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1171168572 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:17:13.937818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-255890875", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "ee10e394-b9a4-4301-b170-a0cb0111bac0"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:13.991277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] validate_networks() for [('ee10e394-b9a4-4301-b170-a0cb0111bac0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:17:14.343208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:17:14.343587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:17:14.344373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:17:14.344520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:17:14.344928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:17:14.353995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:14.354463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:14.355284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:14.355739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:14.372987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:17:14.378441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for user 074c6de57bf94d4a943b2d04e2072ae7 and project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:17:14.391566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:17:14.393920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:17:14.436846 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4c2745a3-ffdb-4265-92bb-8d0f82c7bb0d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502904 Mar 12 21:17:14.437685 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4041/4809] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:17:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:17:14.448241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-05626df5-620a-4610-ae7c-f0183700d6aa tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:14.449299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-05626df5-620a-4610-ae7c-f0183700d6aa tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:14.463870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05626df5-620a-4610-ae7c-f0183700d6aa tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:14.464401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05626df5-620a-4610-ae7c-f0183700d6aa tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:14.465215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05626df5-620a-4610-ae7c-f0183700d6aa tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:14.466455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05626df5-620a-4610-ae7c-f0183700d6aa tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:14.709905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-05626df5-620a-4610-ae7c-f0183700d6aa tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:14.709905 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-05626df5-620a-4610-ae7c-f0183700d6aa tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1699 microversion: 2.1 time: 0.218496 Mar 12 21:17:14.709905 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4042/4810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:14 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1699 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:14.709905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa4f1045-08df-485c-bc14-21b0527794d3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:14.709905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aa4f1045-08df-485c-bc14-21b0527794d3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:14.720043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aa4f1045-08df-485c-bc14-21b0527794d3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:14.727062 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aa4f1045-08df-485c-bc14-21b0527794d3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1208 microversion: 2.1 time: 0.067588 Mar 12 21:17:14.733923 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4043/4811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:14 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1208 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:14.735407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9cfc5768-5eb4-4f98-8fb1-986acb6b8c06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:14.736183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9cfc5768-5eb4-4f98-8fb1-986acb6b8c06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:14.742936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cfc5768-5eb4-4f98-8fb1-986acb6b8c06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:14.743471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cfc5768-5eb4-4f98-8fb1-986acb6b8c06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:14.744398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cfc5768-5eb4-4f98-8fb1-986acb6b8c06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:14.745008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cfc5768-5eb4-4f98-8fb1-986acb6b8c06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:14.925560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9cfc5768-5eb4-4f98-8fb1-986acb6b8c06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:14.934360 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9cfc5768-5eb4-4f98-8fb1-986acb6b8c06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1267 microversion: 2.1 time: 0.205275 Mar 12 21:17:14.935377 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4044/4812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:14 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:15.676373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43f79821-4623-40b2-b621-7a29f61174be tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:15.677165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-43f79821-4623-40b2-b621-7a29f61174be tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:15.685165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43f79821-4623-40b2-b621-7a29f61174be tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:15.685804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43f79821-4623-40b2-b621-7a29f61174be tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:15.686745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43f79821-4623-40b2-b621-7a29f61174be tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:15.687310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43f79821-4623-40b2-b621-7a29f61174be tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:15.858347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-43f79821-4623-40b2-b621-7a29f61174be tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:15.867716 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-43f79821-4623-40b2-b621-7a29f61174be tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1684 microversion: 2.1 time: 0.196145 Mar 12 21:17:15.879837 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4045/4813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:15 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1684 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:15.885853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9453a341-22aa-499d-b91e-d1a10f3ce672 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:15.886924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9453a341-22aa-499d-b91e-d1a10f3ce672 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:15.894901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9453a341-22aa-499d-b91e-d1a10f3ce672 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:15.895737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9453a341-22aa-499d-b91e-d1a10f3ce672 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:15.897379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9453a341-22aa-499d-b91e-d1a10f3ce672 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:15.898038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9453a341-22aa-499d-b91e-d1a10f3ce672 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:15.971750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9453a341-22aa-499d-b91e-d1a10f3ce672 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:15.982118 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9453a341-22aa-499d-b91e-d1a10f3ce672 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1266 microversion: 2.1 time: 0.098702 Mar 12 21:17:15.982118 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4046/4814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:15 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:15.985925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c326d3b9-fc1f-468a-aa99-31417a9602c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:15.986714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c326d3b9-fc1f-468a-aa99-31417a9602c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:15.992530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c326d3b9-fc1f-468a-aa99-31417a9602c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:15.993128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c326d3b9-fc1f-468a-aa99-31417a9602c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:15.993999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c326d3b9-fc1f-468a-aa99-31417a9602c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:15.994460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c326d3b9-fc1f-468a-aa99-31417a9602c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:16.156153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c326d3b9-fc1f-468a-aa99-31417a9602c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:16.164821 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c326d3b9-fc1f-468a-aa99-31417a9602c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1267 microversion: 2.1 time: 0.181943 Mar 12 21:17:16.165615 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4047/4815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:15 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:16.731016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0035ad5b-f71c-4ed5-96ed-fdf5492a18a3 req-71021408-6ea7-44f7-8c23-44ea9a3aa0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2116b6a-ccc9-4993-8476-d53c16d9a896", "name": "network-vif-plugged", "status": "completed", "tag": "ccbb58f4-5ca0-4fd2-9c8e-3763d9182d52"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:16.740478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0035ad5b-f71c-4ed5-96ed-fdf5492a18a3 req-71021408-6ea7-44f7-8c23-44ea9a3aa0e9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:16.740943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0035ad5b-f71c-4ed5-96ed-fdf5492a18a3 req-71021408-6ea7-44f7-8c23-44ea9a3aa0e9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:16.754131 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0035ad5b-f71c-4ed5-96ed-fdf5492a18a3 req-71021408-6ea7-44f7-8c23-44ea9a3aa0e9 service nova] Creating event network-vif-plugged:ccbb58f4-5ca0-4fd2-9c8e-3763d9182d52 for instance a2116b6a-ccc9-4993-8476-d53c16d9a896 on nch2-master-1 Mar 12 21:17:16.759717 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0035ad5b-f71c-4ed5-96ed-fdf5492a18a3 req-71021408-6ea7-44f7-8c23-44ea9a3aa0e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032765 Mar 12 21:17:16.760516 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4048/4816] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:17:16.767723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bd412780-45b4-4224-9b58-25e614a8fedc req-5f8e2180-a9dc-40a0-a2ae-26eb4ac05be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03097d75-4672-45c3-b05f-b676ae95a98d", "tag": "2fb3299c-5dcd-492f-8c79-299f90313780"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:16.783821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bd412780-45b4-4224-9b58-25e614a8fedc req-5f8e2180-a9dc-40a0-a2ae-26eb4ac05be3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:16.784399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bd412780-45b4-4224-9b58-25e614a8fedc req-5f8e2180-a9dc-40a0-a2ae-26eb4ac05be3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:16.800031 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bd412780-45b4-4224-9b58-25e614a8fedc req-5f8e2180-a9dc-40a0-a2ae-26eb4ac05be3 service nova] Creating event network-changed:2fb3299c-5dcd-492f-8c79-299f90313780 for instance 03097d75-4672-45c3-b05f-b676ae95a98d on nch1-master-1 Mar 12 21:17:16.805291 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bd412780-45b4-4224-9b58-25e614a8fedc req-5f8e2180-a9dc-40a0-a2ae-26eb4ac05be3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043391 Mar 12 21:17:16.806430 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4049/4817] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:17:16.998368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f2167ca-f71d-4001-a5a5-2847c025ae09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:16.999793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6f2167ca-f71d-4001-a5a5-2847c025ae09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:17.007725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f2167ca-f71d-4001-a5a5-2847c025ae09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:17.008374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f2167ca-f71d-4001-a5a5-2847c025ae09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:17.009166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f2167ca-f71d-4001-a5a5-2847c025ae09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:17.009616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f2167ca-f71d-4001-a5a5-2847c025ae09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:17.156020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6f2167ca-f71d-4001-a5a5-2847c025ae09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:17.163480 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f2167ca-f71d-4001-a5a5-2847c025ae09 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1308 microversion: 2.1 time: 0.169623 Mar 12 21:17:17.164061 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4050/4818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:16 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:17.181107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e62cd766-58fb-4587-9ee5-6750d344e45d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:17.181734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e62cd766-58fb-4587-9ee5-6750d344e45d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:17.188400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e62cd766-58fb-4587-9ee5-6750d344e45d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:17.188908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e62cd766-58fb-4587-9ee5-6750d344e45d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:17.189838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e62cd766-58fb-4587-9ee5-6750d344e45d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:17.190305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e62cd766-58fb-4587-9ee5-6750d344e45d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:17.327371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e62cd766-58fb-4587-9ee5-6750d344e45d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:17.334845 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e62cd766-58fb-4587-9ee5-6750d344e45d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1267 microversion: 2.1 time: 0.157563 Mar 12 21:17:17.335454 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4051/4819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:17 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:18.180530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37fda8e0-d915-4d59-8de8-d7de12d48ed7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:18.181106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-37fda8e0-d915-4d59-8de8-d7de12d48ed7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:18.187898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37fda8e0-d915-4d59-8de8-d7de12d48ed7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:18.188344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37fda8e0-d915-4d59-8de8-d7de12d48ed7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:18.189173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37fda8e0-d915-4d59-8de8-d7de12d48ed7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:18.189624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37fda8e0-d915-4d59-8de8-d7de12d48ed7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:18.323994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-37fda8e0-d915-4d59-8de8-d7de12d48ed7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:18.332082 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-37fda8e0-d915-4d59-8de8-d7de12d48ed7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1308 microversion: 2.1 time: 0.155480 Mar 12 21:17:18.332702 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4052/4820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:18 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1308 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:18.351241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1588d266-4c2a-40da-a5fb-5ee4edda36c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:18.351862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1588d266-4c2a-40da-a5fb-5ee4edda36c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:18.358171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1588d266-4c2a-40da-a5fb-5ee4edda36c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:18.358638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1588d266-4c2a-40da-a5fb-5ee4edda36c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:18.359413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1588d266-4c2a-40da-a5fb-5ee4edda36c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:18.359870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1588d266-4c2a-40da-a5fb-5ee4edda36c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:18.490129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1588d266-4c2a-40da-a5fb-5ee4edda36c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:18.497409 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1588d266-4c2a-40da-a5fb-5ee4edda36c9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1267 microversion: 2.1 time: 0.149732 Mar 12 21:17:18.498007 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4053/4821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:18 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:18.796588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-df952858-53f1-4149-be4d-fccae1d909f3 req-9434d498-4919-42b0-afc1-20812ce875b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a823fc52-c4a2-438a-8d37-f43139baf443", "name": "network-vif-plugged", "status": "completed", "tag": "988c1269-00db-4f30-a158-3ab020b0dfa6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:18.805876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-df952858-53f1-4149-be4d-fccae1d909f3 req-9434d498-4919-42b0-afc1-20812ce875b2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:18.806352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-df952858-53f1-4149-be4d-fccae1d909f3 req-9434d498-4919-42b0-afc1-20812ce875b2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:18.818218 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-df952858-53f1-4149-be4d-fccae1d909f3 req-9434d498-4919-42b0-afc1-20812ce875b2 service nova] Creating event network-vif-plugged:988c1269-00db-4f30-a158-3ab020b0dfa6 for instance a823fc52-c4a2-438a-8d37-f43139baf443 on nch2-master-1 Mar 12 21:17:18.823031 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-df952858-53f1-4149-be4d-fccae1d909f3 req-9434d498-4919-42b0-afc1-20812ce875b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030273 Mar 12 21:17:18.823669 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4054/4822] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:17:19.350578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-666bcca1-631e-4aee-a316-2dfa4d1ed75c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:19.351284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-666bcca1-631e-4aee-a316-2dfa4d1ed75c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:19.357998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-666bcca1-631e-4aee-a316-2dfa4d1ed75c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:19.358442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-666bcca1-631e-4aee-a316-2dfa4d1ed75c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:19.359207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-666bcca1-631e-4aee-a316-2dfa4d1ed75c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:19.359651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-666bcca1-631e-4aee-a316-2dfa4d1ed75c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:19.782727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-666bcca1-631e-4aee-a316-2dfa4d1ed75c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:19.790354 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-666bcca1-631e-4aee-a316-2dfa4d1ed75c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1308 microversion: 2.1 time: 0.444885 Mar 12 21:17:19.790927 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4055/4823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:19 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:19.796289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20734da3-fbdf-433c-85d4-8d2d19cf5c49 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:19.796940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20734da3-fbdf-433c-85d4-8d2d19cf5c49 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:19.802976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20734da3-fbdf-433c-85d4-8d2d19cf5c49 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:19.803446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20734da3-fbdf-433c-85d4-8d2d19cf5c49 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:19.804241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20734da3-fbdf-433c-85d4-8d2d19cf5c49 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:19.804700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20734da3-fbdf-433c-85d4-8d2d19cf5c49 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:19.943877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-20734da3-fbdf-433c-85d4-8d2d19cf5c49 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:19.951414 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20734da3-fbdf-433c-85d4-8d2d19cf5c49 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1267 microversion: 2.1 time: 0.159456 Mar 12 21:17:19.951972 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4056/4824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:19 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:20.807486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a2134791-b36c-4742-86ad-d49d0d82a577 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:20.808116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a2134791-b36c-4742-86ad-d49d0d82a577 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:20.814908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2134791-b36c-4742-86ad-d49d0d82a577 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:20.815378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2134791-b36c-4742-86ad-d49d0d82a577 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:20.816155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2134791-b36c-4742-86ad-d49d0d82a577 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:20.816612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2134791-b36c-4742-86ad-d49d0d82a577 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:20.947507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a2134791-b36c-4742-86ad-d49d0d82a577 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:20.955404 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a2134791-b36c-4742-86ad-d49d0d82a577 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1308 microversion: 2.1 time: 0.151833 Mar 12 21:17:20.955967 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4057/4825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:20 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:20.967950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cf384b5c-7ef6-4cf5-9688-26244d6ccc04 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:20.968671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cf384b5c-7ef6-4cf5-9688-26244d6ccc04 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:20.974602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf384b5c-7ef6-4cf5-9688-26244d6ccc04 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:20.975072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf384b5c-7ef6-4cf5-9688-26244d6ccc04 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:20.975851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf384b5c-7ef6-4cf5-9688-26244d6ccc04 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:20.976305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf384b5c-7ef6-4cf5-9688-26244d6ccc04 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:21.120239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cf384b5c-7ef6-4cf5-9688-26244d6ccc04 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:21.128467 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cf384b5c-7ef6-4cf5-9688-26244d6ccc04 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1454 microversion: 2.1 time: 0.164730 Mar 12 21:17:21.129055 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4058/4826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:20 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:21.144911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c329ab79-ed48-4e9c-81f8-938039365a75 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:21.145534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c329ab79-ed48-4e9c-81f8-938039365a75 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:21.151415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c329ab79-ed48-4e9c-81f8-938039365a75 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:21.151888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c329ab79-ed48-4e9c-81f8-938039365a75 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:21.152756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c329ab79-ed48-4e9c-81f8-938039365a75 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:21.153215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c329ab79-ed48-4e9c-81f8-938039365a75 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:21.284938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c329ab79-ed48-4e9c-81f8-938039365a75 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:21.292566 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c329ab79-ed48-4e9c-81f8-938039365a75 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1454 microversion: 2.1 time: 0.151423 Mar 12 21:17:21.293184 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4059/4827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:21 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:21.972629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4d9871fd-9280-4df6-8e47-e2ed3387af44 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:21.973246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4d9871fd-9280-4df6-8e47-e2ed3387af44 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:21.979666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d9871fd-9280-4df6-8e47-e2ed3387af44 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:21.980136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d9871fd-9280-4df6-8e47-e2ed3387af44 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:21.981463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d9871fd-9280-4df6-8e47-e2ed3387af44 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:21.981939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d9871fd-9280-4df6-8e47-e2ed3387af44 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:22.502810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4d9871fd-9280-4df6-8e47-e2ed3387af44 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:22.510288 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4d9871fd-9280-4df6-8e47-e2ed3387af44 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1308 microversion: 2.1 time: 0.542008 Mar 12 21:17:22.510855 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4060/4828] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:21 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1308 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:23.074959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e1fb7aad-182f-4ac5-bd60-baed8ba85222 req-4fdb695a-b919-4554-8a16-f1fa9b215671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03097d75-4672-45c3-b05f-b676ae95a98d", "name": "network-vif-plugged", "status": "completed", "tag": "2fb3299c-5dcd-492f-8c79-299f90313780"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:23.085960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e1fb7aad-182f-4ac5-bd60-baed8ba85222 req-4fdb695a-b919-4554-8a16-f1fa9b215671 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:23.086565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e1fb7aad-182f-4ac5-bd60-baed8ba85222 req-4fdb695a-b919-4554-8a16-f1fa9b215671 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:23.100913 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e1fb7aad-182f-4ac5-bd60-baed8ba85222 req-4fdb695a-b919-4554-8a16-f1fa9b215671 service nova] Creating event network-vif-plugged:2fb3299c-5dcd-492f-8c79-299f90313780 for instance 03097d75-4672-45c3-b05f-b676ae95a98d on nch1-master-1 Mar 12 21:17:23.106541 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e1fb7aad-182f-4ac5-bd60-baed8ba85222 req-4fdb695a-b919-4554-8a16-f1fa9b215671 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035035 Mar 12 21:17:23.107350 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4061/4829] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:17:23.462436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f4d4072c-f201-469f-962b-10359fa4f4ca req-682f0afe-291f-480b-81c2-d79ca9ea6afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a823fc52-c4a2-438a-8d37-f43139baf443", "tag": "988c1269-00db-4f30-a158-3ab020b0dfa6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:23.471198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f4d4072c-f201-469f-962b-10359fa4f4ca req-682f0afe-291f-480b-81c2-d79ca9ea6afb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:23.471675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f4d4072c-f201-469f-962b-10359fa4f4ca req-682f0afe-291f-480b-81c2-d79ca9ea6afb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:23.484923 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f4d4072c-f201-469f-962b-10359fa4f4ca req-682f0afe-291f-480b-81c2-d79ca9ea6afb service nova] Creating event network-changed:988c1269-00db-4f30-a158-3ab020b0dfa6 for instance a823fc52-c4a2-438a-8d37-f43139baf443 on nch2-master-1 Mar 12 21:17:23.489749 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f4d4072c-f201-469f-962b-10359fa4f4ca req-682f0afe-291f-480b-81c2-d79ca9ea6afb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031450 Mar 12 21:17:23.490391 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4062/4830] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:17:23.530078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-11395807-1c9a-4eac-8f34-145f366c2b03 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:23.530860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-11395807-1c9a-4eac-8f34-145f366c2b03 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:23.537432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11395807-1c9a-4eac-8f34-145f366c2b03 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:23.537946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11395807-1c9a-4eac-8f34-145f366c2b03 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:23.538785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11395807-1c9a-4eac-8f34-145f366c2b03 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:23.539246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11395807-1c9a-4eac-8f34-145f366c2b03 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:23.680489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-11395807-1c9a-4eac-8f34-145f366c2b03 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:23.688277 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-11395807-1c9a-4eac-8f34-145f366c2b03 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1308 microversion: 2.1 time: 0.163648 Mar 12 21:17:23.688870 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4063/4831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:23 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:24.705042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c9fccf7-de19-47e7-99c6-c3ec74aa1a38 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:24.705693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c9fccf7-de19-47e7-99c6-c3ec74aa1a38 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:24.712881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c9fccf7-de19-47e7-99c6-c3ec74aa1a38 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:24.713354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c9fccf7-de19-47e7-99c6-c3ec74aa1a38 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:24.714248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c9fccf7-de19-47e7-99c6-c3ec74aa1a38 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:24.714707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c9fccf7-de19-47e7-99c6-c3ec74aa1a38 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:24.856050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0c9fccf7-de19-47e7-99c6-c3ec74aa1a38 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:24.863662 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c9fccf7-de19-47e7-99c6-c3ec74aa1a38 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1490 microversion: 2.1 time: 0.162452 Mar 12 21:17:24.864185 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4064/4832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:24 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1490 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:24.917104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-255890875", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "ee10e394-b9a4-4301-b170-a0cb0111bac0"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:24.966662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] validate_networks() for [('ee10e394-b9a4-4301-b170-a0cb0111bac0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:17:25.319812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:17:25.320258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:17:25.320776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:17:25.321206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:17:25.321638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:17:25.330479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:25.330952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:25.331777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:25.332232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:25.349232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:17:25.354450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for user 074c6de57bf94d4a943b2d04e2072ae7 and project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:17:25.367079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:17:25.369334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:17:25.432898 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a519d444-1da9-42df-94db-fdc7b574e668 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519420 Mar 12 21:17:25.433545 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4065/4833] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:17:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:17:25.449467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a677f4cb-7b68-42c8-ad10-0c77c66128dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:25.450135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a677f4cb-7b68-42c8-ad10-0c77c66128dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:25.502813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a677f4cb-7b68-42c8-ad10-0c77c66128dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:25.510009 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a677f4cb-7b68-42c8-ad10-0c77c66128dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1208 microversion: 2.1 time: 0.064966 Mar 12 21:17:25.511002 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4066/4834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:25 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1208 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:26.526436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-010b0fe2-895c-4826-aa9c-6be649969d62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:26.527087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-010b0fe2-895c-4826-aa9c-6be649969d62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:26.535655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-010b0fe2-895c-4826-aa9c-6be649969d62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:26.536130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-010b0fe2-895c-4826-aa9c-6be649969d62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:26.536962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-010b0fe2-895c-4826-aa9c-6be649969d62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:26.537420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-010b0fe2-895c-4826-aa9c-6be649969d62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:26.608192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-010b0fe2-895c-4826-aa9c-6be649969d62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:26.615542 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-010b0fe2-895c-4826-aa9c-6be649969d62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1266 microversion: 2.1 time: 0.093027 Mar 12 21:17:26.616123 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4067/4835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:26 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:27.609600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-25606ff6-18cd-4142-a47c-2ddb60dc4ba4 req-d409068b-39ff-4973-938d-2c7c3d7d5821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e5cb95b-1278-4730-9271-b05d6288efa7", "tag": "719e81ab-7935-42c1-9dc3-38e14c5b1e54"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:27.619375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-25606ff6-18cd-4142-a47c-2ddb60dc4ba4 req-d409068b-39ff-4973-938d-2c7c3d7d5821 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:27.620045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-25606ff6-18cd-4142-a47c-2ddb60dc4ba4 req-d409068b-39ff-4973-938d-2c7c3d7d5821 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:27.633262 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-25606ff6-18cd-4142-a47c-2ddb60dc4ba4 req-d409068b-39ff-4973-938d-2c7c3d7d5821 service nova] Creating event network-changed:719e81ab-7935-42c1-9dc3-38e14c5b1e54 for instance 5e5cb95b-1278-4730-9271-b05d6288efa7 on nch1-master-1 Mar 12 21:17:27.638058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-25606ff6-18cd-4142-a47c-2ddb60dc4ba4 req-d409068b-39ff-4973-938d-2c7c3d7d5821 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033059 Mar 12 21:17:27.638811 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4068/4836] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:17:27.644561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-15c22a06-5651-4f3f-b9ac-26046e9ba262 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:27.645424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-15c22a06-5651-4f3f-b9ac-26046e9ba262 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:27.651476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15c22a06-5651-4f3f-b9ac-26046e9ba262 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:27.651939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15c22a06-5651-4f3f-b9ac-26046e9ba262 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:27.652770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15c22a06-5651-4f3f-b9ac-26046e9ba262 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:27.653216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15c22a06-5651-4f3f-b9ac-26046e9ba262 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:27.939570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-15c22a06-5651-4f3f-b9ac-26046e9ba262 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:27.947021 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-15c22a06-5651-4f3f-b9ac-26046e9ba262 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1308 microversion: 2.1 time: 0.306932 Mar 12 21:17:27.947602 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4069/4837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:27 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1308 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:28.963012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f2da7ee-8699-4472-9784-14bb6bec5724 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:28.963708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f2da7ee-8699-4472-9784-14bb6bec5724 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:28.971268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f2da7ee-8699-4472-9784-14bb6bec5724 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:28.971723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f2da7ee-8699-4472-9784-14bb6bec5724 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:28.972548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f2da7ee-8699-4472-9784-14bb6bec5724 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:28.973011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f2da7ee-8699-4472-9784-14bb6bec5724 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:29.103983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f2da7ee-8699-4472-9784-14bb6bec5724 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:29.111268 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f2da7ee-8699-4472-9784-14bb6bec5724 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1308 microversion: 2.1 time: 0.152232 Mar 12 21:17:29.111839 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4070/4838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:28 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:30.128570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2a9ac21a-e477-4bfc-8e98-a6c6e93d1c40 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:30.129264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2a9ac21a-e477-4bfc-8e98-a6c6e93d1c40 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:30.136803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a9ac21a-e477-4bfc-8e98-a6c6e93d1c40 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:30.137484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a9ac21a-e477-4bfc-8e98-a6c6e93d1c40 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:30.138261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a9ac21a-e477-4bfc-8e98-a6c6e93d1c40 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:30.138725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a9ac21a-e477-4bfc-8e98-a6c6e93d1c40 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:30.280898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2a9ac21a-e477-4bfc-8e98-a6c6e93d1c40 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:30.288483 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2a9ac21a-e477-4bfc-8e98-a6c6e93d1c40 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1308 microversion: 2.1 time: 0.164270 Mar 12 21:17:30.289074 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4071/4839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:30 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:31.306105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f946113c-e6e0-4759-ad89-e8dd70dc37d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:31.306724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f946113c-e6e0-4759-ad89-e8dd70dc37d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:31.314213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f946113c-e6e0-4759-ad89-e8dd70dc37d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:31.314693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f946113c-e6e0-4759-ad89-e8dd70dc37d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:31.315489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f946113c-e6e0-4759-ad89-e8dd70dc37d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:31.315947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f946113c-e6e0-4759-ad89-e8dd70dc37d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:31.451553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f946113c-e6e0-4759-ad89-e8dd70dc37d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:31.458974 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f946113c-e6e0-4759-ad89-e8dd70dc37d5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1308 microversion: 2.1 time: 0.156860 Mar 12 21:17:31.459551 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4072/4840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:31 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:32.477107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5b545e42-ef58-4b85-a355-96e5daab7226 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:32.477751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5b545e42-ef58-4b85-a355-96e5daab7226 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:32.484626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b545e42-ef58-4b85-a355-96e5daab7226 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:32.485105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b545e42-ef58-4b85-a355-96e5daab7226 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:32.485915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b545e42-ef58-4b85-a355-96e5daab7226 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:32.486374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b545e42-ef58-4b85-a355-96e5daab7226 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:32.623806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5b545e42-ef58-4b85-a355-96e5daab7226 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:32.631621 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5b545e42-ef58-4b85-a355-96e5daab7226 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1308 microversion: 2.1 time: 0.158440 Mar 12 21:17:32.632194 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4073/4841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:32 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:33.096572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c7c001ff-30d2-43f8-b6f9-fb1fbc056876 req-e704509b-b1de-496f-814c-d978647332c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e5cb95b-1278-4730-9271-b05d6288efa7", "name": "network-vif-plugged", "status": "completed", "tag": "719e81ab-7935-42c1-9dc3-38e14c5b1e54"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:33.104933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c7c001ff-30d2-43f8-b6f9-fb1fbc056876 req-e704509b-b1de-496f-814c-d978647332c3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:33.105448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c7c001ff-30d2-43f8-b6f9-fb1fbc056876 req-e704509b-b1de-496f-814c-d978647332c3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:33.116781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c7c001ff-30d2-43f8-b6f9-fb1fbc056876 req-e704509b-b1de-496f-814c-d978647332c3 service nova] Creating event network-vif-plugged:719e81ab-7935-42c1-9dc3-38e14c5b1e54 for instance 5e5cb95b-1278-4730-9271-b05d6288efa7 on nch1-master-1 Mar 12 21:17:33.121502 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c7c001ff-30d2-43f8-b6f9-fb1fbc056876 req-e704509b-b1de-496f-814c-d978647332c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028698 Mar 12 21:17:33.122133 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4074/4842] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:17:33.650023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e820b352-f1cb-4caa-987a-db6796872129 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:33.650746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e820b352-f1cb-4caa-987a-db6796872129 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:33.657306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e820b352-f1cb-4caa-987a-db6796872129 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:33.657808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e820b352-f1cb-4caa-987a-db6796872129 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:33.658587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e820b352-f1cb-4caa-987a-db6796872129 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:33.659057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e820b352-f1cb-4caa-987a-db6796872129 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:33.789542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e820b352-f1cb-4caa-987a-db6796872129 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:33.797399 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e820b352-f1cb-4caa-987a-db6796872129 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1308 microversion: 2.1 time: 0.152534 Mar 12 21:17:33.798010 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4075/4843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:33 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:34.814420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d066fed1-6efd-4faa-a681-2dfe84d690c1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:34.815060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d066fed1-6efd-4faa-a681-2dfe84d690c1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:34.821824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d066fed1-6efd-4faa-a681-2dfe84d690c1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:34.822330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d066fed1-6efd-4faa-a681-2dfe84d690c1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:34.823116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d066fed1-6efd-4faa-a681-2dfe84d690c1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:34.823589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d066fed1-6efd-4faa-a681-2dfe84d690c1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:34.959140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d066fed1-6efd-4faa-a681-2dfe84d690c1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:34.967082 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d066fed1-6efd-4faa-a681-2dfe84d690c1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1490 microversion: 2.1 time: 0.156667 Mar 12 21:17:34.967659 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4076/4844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:34 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1490 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:34.982519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23d92b33-41e9-4366-a2b9-5e441a3e4183 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:34.983144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-23d92b33-41e9-4366-a2b9-5e441a3e4183 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:34.988666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23d92b33-41e9-4366-a2b9-5e441a3e4183 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:34.989163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23d92b33-41e9-4366-a2b9-5e441a3e4183 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:34.989987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23d92b33-41e9-4366-a2b9-5e441a3e4183 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:34.990440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23d92b33-41e9-4366-a2b9-5e441a3e4183 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:35.122670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-23d92b33-41e9-4366-a2b9-5e441a3e4183 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:35.130474 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-23d92b33-41e9-4366-a2b9-5e441a3e4183 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1490 microversion: 2.1 time: 0.151496 Mar 12 21:17:35.131046 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4077/4845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:34 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1490 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:35.146380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-092a90ea-052d-485f-9efb-309710ab6923 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:35.146999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-092a90ea-052d-485f-9efb-309710ab6923 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:35.153501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-092a90ea-052d-485f-9efb-309710ab6923 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:35.153996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-092a90ea-052d-485f-9efb-309710ab6923 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:35.154773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-092a90ea-052d-485f-9efb-309710ab6923 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:35.155222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-092a90ea-052d-485f-9efb-309710ab6923 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:35.289287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-092a90ea-052d-485f-9efb-309710ab6923 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:35.296708 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-092a90ea-052d-485f-9efb-309710ab6923 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1490 microversion: 2.1 time: 0.153940 Mar 12 21:17:35.297285 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4078/4846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:35 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1490 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:35.312796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce5efe6c-862b-4b60-bcdd-d6bc9357e3a0 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:35.313305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce5efe6c-862b-4b60-bcdd-d6bc9357e3a0 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:35.318918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce5efe6c-862b-4b60-bcdd-d6bc9357e3a0 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:35.319384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce5efe6c-862b-4b60-bcdd-d6bc9357e3a0 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:35.320163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce5efe6c-862b-4b60-bcdd-d6bc9357e3a0 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:35.320616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce5efe6c-862b-4b60-bcdd-d6bc9357e3a0 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:35.344299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce5efe6c-862b-4b60-bcdd-d6bc9357e3a0 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:17:35.415177 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce5efe6c-862b-4b60-bcdd-d6bc9357e3a0 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 204 len: 0 microversion: 2.1 time: 0.105721 Mar 12 21:17:35.415796 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4079/4847] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:17:35 2022] DELETE /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:17:35.424960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-091e5ffa-3708-4847-b0d7-51ff5861b2f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:35.425646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-091e5ffa-3708-4847-b0d7-51ff5861b2f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:35.431236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-091e5ffa-3708-4847-b0d7-51ff5861b2f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:35.431705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-091e5ffa-3708-4847-b0d7-51ff5861b2f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:35.432475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-091e5ffa-3708-4847-b0d7-51ff5861b2f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:35.432924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-091e5ffa-3708-4847-b0d7-51ff5861b2f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:35.566202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-091e5ffa-3708-4847-b0d7-51ff5861b2f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:35.573587 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-091e5ffa-3708-4847-b0d7-51ff5861b2f7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1496 microversion: 2.1 time: 0.152862 Mar 12 21:17:35.574838 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4080/4848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:35 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1496 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:36.591524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c44baf39-7002-4d36-b693-50e73ba1dcda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:36.592183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c44baf39-7002-4d36-b693-50e73ba1dcda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:36.600180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c44baf39-7002-4d36-b693-50e73ba1dcda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:36.600705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c44baf39-7002-4d36-b693-50e73ba1dcda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:36.601498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c44baf39-7002-4d36-b693-50e73ba1dcda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:36.601990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c44baf39-7002-4d36-b693-50e73ba1dcda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:36.733081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c44baf39-7002-4d36-b693-50e73ba1dcda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:36.740898 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c44baf39-7002-4d36-b693-50e73ba1dcda tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1496 microversion: 2.1 time: 0.153639 Mar 12 21:17:36.741473 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4081/4849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:36 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1496 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:37.460839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b1abb3a9-4915-49d6-b4a8-fb80b7156622 req-8bc4bde1-6d39-47f1-a9ee-77685353ac9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e5cb95b-1278-4730-9271-b05d6288efa7", "name": "network-vif-deleted", "tag": "719e81ab-7935-42c1-9dc3-38e14c5b1e54"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:37.472423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b1abb3a9-4915-49d6-b4a8-fb80b7156622 req-8bc4bde1-6d39-47f1-a9ee-77685353ac9f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:37.473039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b1abb3a9-4915-49d6-b4a8-fb80b7156622 req-8bc4bde1-6d39-47f1-a9ee-77685353ac9f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:37.485375 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b1abb3a9-4915-49d6-b4a8-fb80b7156622 req-8bc4bde1-6d39-47f1-a9ee-77685353ac9f service nova] Creating event network-vif-deleted:719e81ab-7935-42c1-9dc3-38e14c5b1e54 for instance 5e5cb95b-1278-4730-9271-b05d6288efa7 on nch1-master-1 Mar 12 21:17:37.491799 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b1abb3a9-4915-49d6-b4a8-fb80b7156622 req-8bc4bde1-6d39-47f1-a9ee-77685353ac9f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034601 Mar 12 21:17:37.492460 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4082/4850] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:17:37.758982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b0ce02f-d044-488f-86d8-d12927b67d54 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:37.759692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b0ce02f-d044-488f-86d8-d12927b67d54 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:37.766384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b0ce02f-d044-488f-86d8-d12927b67d54 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:37.766844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b0ce02f-d044-488f-86d8-d12927b67d54 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:37.767617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b0ce02f-d044-488f-86d8-d12927b67d54 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:37.768064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b0ce02f-d044-488f-86d8-d12927b67d54 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:37.798196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b0ce02f-d044-488f-86d8-d12927b67d54 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:37.798910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b0ce02f-d044-488f-86d8-d12927b67d54 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:37.799370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-6b0ce02f-d044-488f-86d8-d12927b67d54 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lazy-loading 'fault' on Instance uuid 5e5cb95b-1278-4730-9271-b05d6288efa7 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:17:37.843618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b0ce02f-d044-488f-86d8-d12927b67d54 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:37.852157 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b0ce02f-d044-488f-86d8-d12927b67d54 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 200 len: 1298 microversion: 2.1 time: 0.097463 Mar 12 21:17:37.852727 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4083/4851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:37 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:38.870131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b99aa9dd-f63c-49f0-8cab-145cdc318cd7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:38.870827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b99aa9dd-f63c-49f0-8cab-145cdc318cd7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:38.877654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b99aa9dd-f63c-49f0-8cab-145cdc318cd7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:38.878358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b99aa9dd-f63c-49f0-8cab-145cdc318cd7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:38.879495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b99aa9dd-f63c-49f0-8cab-145cdc318cd7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:38.880239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b99aa9dd-f63c-49f0-8cab-145cdc318cd7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:38.894592 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b99aa9dd-f63c-49f0-8cab-145cdc318cd7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 5e5cb95b-1278-4730-9271-b05d6288efa7 could not be found. Mar 12 21:17:38.895198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b99aa9dd-f63c-49f0-8cab-145cdc318cd7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 5e5cb95b-1278-4730-9271-b05d6288efa7 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:17:38.896060 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b99aa9dd-f63c-49f0-8cab-145cdc318cd7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 404 len: 111 microversion: 2.1 time: 0.030200 Mar 12 21:17:38.896571 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4084/4852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:38 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:17:38.905315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-578e84ce-40ac-4e35-ace8-21eab3fb3d2a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:38.905870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-578e84ce-40ac-4e35-ace8-21eab3fb3d2a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:38.912681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-578e84ce-40ac-4e35-ace8-21eab3fb3d2a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:38.913154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-578e84ce-40ac-4e35-ace8-21eab3fb3d2a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:38.913983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-578e84ce-40ac-4e35-ace8-21eab3fb3d2a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:38.914441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-578e84ce-40ac-4e35-ace8-21eab3fb3d2a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:38.941194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-578e84ce-40ac-4e35-ace8-21eab3fb3d2a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:17:39.019854 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-578e84ce-40ac-4e35-ace8-21eab3fb3d2a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 204 len: 0 microversion: 2.1 time: 0.118692 Mar 12 21:17:39.020459 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4085/4853] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:17:38 2022] DELETE /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:17:39.029553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb1a1189-db22-43e1-8e13-fd1d3a2b4e8e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:39.030285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb1a1189-db22-43e1-8e13-fd1d3a2b4e8e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:39.036332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb1a1189-db22-43e1-8e13-fd1d3a2b4e8e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:39.036739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb1a1189-db22-43e1-8e13-fd1d3a2b4e8e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:39.037558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb1a1189-db22-43e1-8e13-fd1d3a2b4e8e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:39.038041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb1a1189-db22-43e1-8e13-fd1d3a2b4e8e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:39.178224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bb1a1189-db22-43e1-8e13-fd1d3a2b4e8e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:39.185685 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb1a1189-db22-43e1-8e13-fd1d3a2b4e8e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1496 microversion: 2.1 time: 0.160948 Mar 12 21:17:39.186281 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4086/4854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:39 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1496 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:40.094264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1bd8820-9491-434d-8bab-ad4bb94d05d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:40.095202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1bd8820-9491-434d-8bab-ad4bb94d05d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:40.101961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1bd8820-9491-434d-8bab-ad4bb94d05d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:40.102428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1bd8820-9491-434d-8bab-ad4bb94d05d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:40.103203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1bd8820-9491-434d-8bab-ad4bb94d05d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:40.103652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1bd8820-9491-434d-8bab-ad4bb94d05d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:40.158409 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1bd8820-9491-434d-8bab-ad4bb94d05d3 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "POST /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896/action" status: 200 len: 24577 microversion: 2.1 time: 0.067970 Mar 12 21:17:40.158950 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4087/4855] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:17:40 2022] POST /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896/action => generated 24577 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:17:40.203774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c100d6ce-88c9-457c-9bf1-f35426843c1f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:40.204511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c100d6ce-88c9-457c-9bf1-f35426843c1f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:40.211416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c100d6ce-88c9-457c-9bf1-f35426843c1f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:40.211877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c100d6ce-88c9-457c-9bf1-f35426843c1f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:40.212650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c100d6ce-88c9-457c-9bf1-f35426843c1f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:40.213097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c100d6ce-88c9-457c-9bf1-f35426843c1f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:40.343625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c100d6ce-88c9-457c-9bf1-f35426843c1f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:40.351345 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c100d6ce-88c9-457c-9bf1-f35426843c1f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1496 microversion: 2.1 time: 0.151559 Mar 12 21:17:40.351912 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4088/4856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:40 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1496 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:41.098954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-aeaf226d-cccc-45df-9a32-299700bd3c76 req-7026d7e1-7a3f-4441-bfde-abeda1aebcf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03097d75-4672-45c3-b05f-b676ae95a98d", "name": "network-vif-deleted", "tag": "2fb3299c-5dcd-492f-8c79-299f90313780"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:41.113956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aeaf226d-cccc-45df-9a32-299700bd3c76 req-7026d7e1-7a3f-4441-bfde-abeda1aebcf9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:41.114419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aeaf226d-cccc-45df-9a32-299700bd3c76 req-7026d7e1-7a3f-4441-bfde-abeda1aebcf9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:41.132378 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-aeaf226d-cccc-45df-9a32-299700bd3c76 req-7026d7e1-7a3f-4441-bfde-abeda1aebcf9 service nova] Creating event network-vif-deleted:2fb3299c-5dcd-492f-8c79-299f90313780 for instance 03097d75-4672-45c3-b05f-b676ae95a98d on nch1-master-1 Mar 12 21:17:41.139417 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-aeaf226d-cccc-45df-9a32-299700bd3c76 req-7026d7e1-7a3f-4441-bfde-abeda1aebcf9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044333 Mar 12 21:17:41.140032 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4089/4857] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:17:41.369156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7336ac17-4e5b-49d0-bdf3-a0126cd8c926 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:41.369923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7336ac17-4e5b-49d0-bdf3-a0126cd8c926 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:41.376593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7336ac17-4e5b-49d0-bdf3-a0126cd8c926 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:41.377099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7336ac17-4e5b-49d0-bdf3-a0126cd8c926 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:41.377920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7336ac17-4e5b-49d0-bdf3-a0126cd8c926 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:41.378411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7336ac17-4e5b-49d0-bdf3-a0126cd8c926 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:41.408078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7336ac17-4e5b-49d0-bdf3-a0126cd8c926 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:41.408548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7336ac17-4e5b-49d0-bdf3-a0126cd8c926 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:41.409019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-7336ac17-4e5b-49d0-bdf3-a0126cd8c926 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lazy-loading 'fault' on Instance uuid 03097d75-4672-45c3-b05f-b676ae95a98d {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:17:41.450789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7336ac17-4e5b-49d0-bdf3-a0126cd8c926 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:41.458995 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7336ac17-4e5b-49d0-bdf3-a0126cd8c926 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 200 len: 1298 microversion: 2.1 time: 0.093747 Mar 12 21:17:41.459743 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4090/4858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:41 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:42.476780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a574ce97-3c37-4502-b33b-c7cd2442c8b2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:42.477451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a574ce97-3c37-4502-b33b-c7cd2442c8b2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:42.484813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a574ce97-3c37-4502-b33b-c7cd2442c8b2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:42.485278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a574ce97-3c37-4502-b33b-c7cd2442c8b2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:42.486088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a574ce97-3c37-4502-b33b-c7cd2442c8b2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:42.486538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a574ce97-3c37-4502-b33b-c7cd2442c8b2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:42.500061 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-a574ce97-3c37-4502-b33b-c7cd2442c8b2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 03097d75-4672-45c3-b05f-b676ae95a98d could not be found. Mar 12 21:17:42.500656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a574ce97-3c37-4502-b33b-c7cd2442c8b2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 03097d75-4672-45c3-b05f-b676ae95a98d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:17:42.501487 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a574ce97-3c37-4502-b33b-c7cd2442c8b2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 404 len: 111 microversion: 2.1 time: 0.029278 Mar 12 21:17:42.502057 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4091/4859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:42 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:17:42.554013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-697187026", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "ee10e394-b9a4-4301-b170-a0cb0111bac0"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:42.606289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] validate_networks() for [('ee10e394-b9a4-4301-b170-a0cb0111bac0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:17:42.974550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:17:42.974984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:17:42.975472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:17:42.975890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:17:42.976314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:17:42.985645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:42.986145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:42.986947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:42.987396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:43.004563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:17:43.014176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for user 074c6de57bf94d4a943b2d04e2072ae7 and project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:17:43.027090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:17:43.029675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:17:43.079151 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a33fd555-d32c-4760-9f71-805f0e484b62 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529500 Mar 12 21:17:43.079947 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4092/4860] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:17:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:17:43.089808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e8d0e327-9d78-4aad-9ff6-ddb09b249517 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:43.090463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e8d0e327-9d78-4aad-9ff6-ddb09b249517 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:43.144145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8d0e327-9d78-4aad-9ff6-ddb09b249517 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:43.153324 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e8d0e327-9d78-4aad-9ff6-ddb09b249517 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1208 microversion: 2.1 time: 0.067381 Mar 12 21:17:43.153916 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4093/4861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:43 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1208 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:44.170446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3fa330ba-9bfd-4423-ac28-2c2ceaaaa66e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:44.171097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3fa330ba-9bfd-4423-ac28-2c2ceaaaa66e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:44.178263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fa330ba-9bfd-4423-ac28-2c2ceaaaa66e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:44.178742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fa330ba-9bfd-4423-ac28-2c2ceaaaa66e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:44.179539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fa330ba-9bfd-4423-ac28-2c2ceaaaa66e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:44.179994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fa330ba-9bfd-4423-ac28-2c2ceaaaa66e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:44.251827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3fa330ba-9bfd-4423-ac28-2c2ceaaaa66e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:44.259257 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3fa330ba-9bfd-4423-ac28-2c2ceaaaa66e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1266 microversion: 2.1 time: 0.092925 Mar 12 21:17:44.259833 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4094/4862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:44 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:45.279135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f04dc47-9800-496b-bd45-a3e60db631a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:45.279792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f04dc47-9800-496b-bd45-a3e60db631a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:45.287895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f04dc47-9800-496b-bd45-a3e60db631a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:45.288355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f04dc47-9800-496b-bd45-a3e60db631a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:45.289390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f04dc47-9800-496b-bd45-a3e60db631a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:45.289932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f04dc47-9800-496b-bd45-a3e60db631a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:45.536457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9f04dc47-9800-496b-bd45-a3e60db631a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:45.547521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f04dc47-9800-496b-bd45-a3e60db631a9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1308 microversion: 2.1 time: 0.273948 Mar 12 21:17:45.557582 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4095/4863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:45 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1308 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:45.760249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7ca219d1-1b86-468b-948b-df3198b2414b req-405d921c-a4d8-42f0-87f5-c583466c55e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2073e46b-263b-40ee-8c89-3d84493b3f12", "tag": "632c3aef-fb9c-4e85-8174-055d01733a24"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:45.770367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7ca219d1-1b86-468b-948b-df3198b2414b req-405d921c-a4d8-42f0-87f5-c583466c55e8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:45.770812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7ca219d1-1b86-468b-948b-df3198b2414b req-405d921c-a4d8-42f0-87f5-c583466c55e8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:45.784630 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7ca219d1-1b86-468b-948b-df3198b2414b req-405d921c-a4d8-42f0-87f5-c583466c55e8 service nova] Creating event network-changed:632c3aef-fb9c-4e85-8174-055d01733a24 for instance 2073e46b-263b-40ee-8c89-3d84493b3f12 on nch1-master-1 Mar 12 21:17:45.790800 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7ca219d1-1b86-468b-948b-df3198b2414b req-405d921c-a4d8-42f0-87f5-c583466c55e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035260 Mar 12 21:17:45.792901 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4096/4864] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:17:46.567025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d33d9cc0-21ac-4516-a4a2-d8a76b3e954c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:46.567794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d33d9cc0-21ac-4516-a4a2-d8a76b3e954c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:46.576028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d33d9cc0-21ac-4516-a4a2-d8a76b3e954c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:46.576747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d33d9cc0-21ac-4516-a4a2-d8a76b3e954c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:46.577605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d33d9cc0-21ac-4516-a4a2-d8a76b3e954c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:46.579007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d33d9cc0-21ac-4516-a4a2-d8a76b3e954c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:46.942877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d33d9cc0-21ac-4516-a4a2-d8a76b3e954c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:46.951252 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d33d9cc0-21ac-4516-a4a2-d8a76b3e954c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1308 microversion: 2.1 time: 0.389523 Mar 12 21:17:46.960900 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4097/4865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:46 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1308 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:47.968992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2875a584-a16e-47ac-8e88-ffa064d0e2d4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:47.969627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2875a584-a16e-47ac-8e88-ffa064d0e2d4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:47.976461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2875a584-a16e-47ac-8e88-ffa064d0e2d4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:47.976932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2875a584-a16e-47ac-8e88-ffa064d0e2d4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:47.977725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2875a584-a16e-47ac-8e88-ffa064d0e2d4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:47.978229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2875a584-a16e-47ac-8e88-ffa064d0e2d4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:48.192693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2875a584-a16e-47ac-8e88-ffa064d0e2d4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:48.201011 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2875a584-a16e-47ac-8e88-ffa064d0e2d4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1308 microversion: 2.1 time: 0.236532 Mar 12 21:17:48.201954 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4098/4866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:47 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:49.220912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad94528b-97ad-4a0f-a85c-783cee9e2f4e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:49.222293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad94528b-97ad-4a0f-a85c-783cee9e2f4e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:49.229979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad94528b-97ad-4a0f-a85c-783cee9e2f4e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:49.231287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad94528b-97ad-4a0f-a85c-783cee9e2f4e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:49.232992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad94528b-97ad-4a0f-a85c-783cee9e2f4e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:49.233601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad94528b-97ad-4a0f-a85c-783cee9e2f4e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:49.381289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad94528b-97ad-4a0f-a85c-783cee9e2f4e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:49.395561 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad94528b-97ad-4a0f-a85c-783cee9e2f4e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1308 microversion: 2.1 time: 0.178964 Mar 12 21:17:49.396551 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4099/4867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:49 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:50.415262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7dc32af-edcf-4333-a0b5-86c9b904fe7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:50.416991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7dc32af-edcf-4333-a0b5-86c9b904fe7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:50.426613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7dc32af-edcf-4333-a0b5-86c9b904fe7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:50.427443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7dc32af-edcf-4333-a0b5-86c9b904fe7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:50.428332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7dc32af-edcf-4333-a0b5-86c9b904fe7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:50.429056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7dc32af-edcf-4333-a0b5-86c9b904fe7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:50.650151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c7dc32af-edcf-4333-a0b5-86c9b904fe7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:50.664384 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7dc32af-edcf-4333-a0b5-86c9b904fe7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1308 microversion: 2.1 time: 0.255337 Mar 12 21:17:50.665807 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4100/4868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:50 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:51.636249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0853c0da-5caf-4022-a340-72d8d53507a3 req-eb4d1149-257b-4a2c-ac8e-d296f674c8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2073e46b-263b-40ee-8c89-3d84493b3f12", "name": "network-vif-plugged", "status": "completed", "tag": "632c3aef-fb9c-4e85-8174-055d01733a24"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:51.661190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0853c0da-5caf-4022-a340-72d8d53507a3 req-eb4d1149-257b-4a2c-ac8e-d296f674c8d6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:51.661871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0853c0da-5caf-4022-a340-72d8d53507a3 req-eb4d1149-257b-4a2c-ac8e-d296f674c8d6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:51.685685 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0853c0da-5caf-4022-a340-72d8d53507a3 req-eb4d1149-257b-4a2c-ac8e-d296f674c8d6 service nova] Creating event network-vif-plugged:632c3aef-fb9c-4e85-8174-055d01733a24 for instance 2073e46b-263b-40ee-8c89-3d84493b3f12 on nch1-master-1 Mar 12 21:17:51.695735 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0853c0da-5caf-4022-a340-72d8d53507a3 req-eb4d1149-257b-4a2c-ac8e-d296f674c8d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066781 Mar 12 21:17:51.697104 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4101/4869] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:17:51.707433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-15cff13d-8107-4729-bf17-96ccaf2a4b96 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:51.708642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-15cff13d-8107-4729-bf17-96ccaf2a4b96 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:51.721481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15cff13d-8107-4729-bf17-96ccaf2a4b96 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:51.728324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15cff13d-8107-4729-bf17-96ccaf2a4b96 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:51.731127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15cff13d-8107-4729-bf17-96ccaf2a4b96 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:51.732245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-15cff13d-8107-4729-bf17-96ccaf2a4b96 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:52.172383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-15cff13d-8107-4729-bf17-96ccaf2a4b96 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:52.186462 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-15cff13d-8107-4729-bf17-96ccaf2a4b96 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1308 microversion: 2.1 time: 0.487020 Mar 12 21:17:52.188279 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4102/4870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:51 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1308 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:52.450143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a4ebac5-ec1c-4fa0-9fef-c0ad8e103b5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:52.450686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a4ebac5-ec1c-4fa0-9fef-c0ad8e103b5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:52.464600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a4ebac5-ec1c-4fa0-9fef-c0ad8e103b5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:52.465045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a4ebac5-ec1c-4fa0-9fef-c0ad8e103b5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:52.465897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a4ebac5-ec1c-4fa0-9fef-c0ad8e103b5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:52.466360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a4ebac5-ec1c-4fa0-9fef-c0ad8e103b5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:52.507407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a4ebac5-ec1c-4fa0-9fef-c0ad8e103b5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:17:52.614904 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a4ebac5-ec1c-4fa0-9fef-c0ad8e103b5e tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 204 len: 0 microversion: 2.1 time: 0.168907 Mar 12 21:17:52.618984 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4103/4871] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:17:52 2022] DELETE /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:17:52.622029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-45c59234-88e0-482b-9439-7b7663dfb558 req-f4d48ee3-23d3-4b41-b891-67cbd7ff1452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2116b6a-ccc9-4993-8476-d53c16d9a896", "tag": "ccbb58f4-5ca0-4fd2-9c8e-3763d9182d52"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:52.631388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-45c59234-88e0-482b-9439-7b7663dfb558 req-f4d48ee3-23d3-4b41-b891-67cbd7ff1452 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:52.631844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-45c59234-88e0-482b-9439-7b7663dfb558 req-f4d48ee3-23d3-4b41-b891-67cbd7ff1452 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:52.644797 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-45c59234-88e0-482b-9439-7b7663dfb558 req-f4d48ee3-23d3-4b41-b891-67cbd7ff1452 service nova] Creating event network-changed:ccbb58f4-5ca0-4fd2-9c8e-3763d9182d52 for instance a2116b6a-ccc9-4993-8476-d53c16d9a896 on nch2-master-1 Mar 12 21:17:52.650760 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-45c59234-88e0-482b-9439-7b7663dfb558 req-f4d48ee3-23d3-4b41-b891-67cbd7ff1452 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033874 Mar 12 21:17:52.651390 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4104/4872] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:17:52.660967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1983039317", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "24adfabc-2323-4a9b-87b7-b5a0bd1c009d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-603499308", "security_groups": []}, "os:scheduler_hints": {"different_host": ["0580517f-a6d7-45c0-a8f4-b9a00ae9891b"]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:52.739273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] validate_networks() for [('24adfabc-2323-4a9b-87b7-b5a0bd1c009d', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:17:53.556638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:17:53.557208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:17:53.557732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:17:53.558338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:17:53.558852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:17:53.578758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:53.581909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:53.583544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:53.584243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:53.615618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Getting quotas for project 69c756a4ad07449182f9786c376ed0f7. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:17:53.623773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Getting quotas for user 0060aa19407c4b7fb35e11846e467dec and project 69c756a4ad07449182f9786c376ed0f7. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:17:53.642048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:17:53.646696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:17:53.707350 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59e9b437-d7b8-4da1-89c6-41ac7ad91d78 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.051095 Mar 12 21:17:53.708420 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4105/4873] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:17:52 2022] POST /compute/v2.1/servers => generated 361 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:17:53.723723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c53087e4-a164-4a6f-a0f2-696216d77762 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:53.724491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c53087e4-a164-4a6f-a0f2-696216d77762 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:53.738481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c53087e4-a164-4a6f-a0f2-696216d77762 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:53.739179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c53087e4-a164-4a6f-a0f2-696216d77762 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:53.740132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c53087e4-a164-4a6f-a0f2-696216d77762 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:53.740757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c53087e4-a164-4a6f-a0f2-696216d77762 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:54.038492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c53087e4-a164-4a6f-a0f2-696216d77762 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:54.048411 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c53087e4-a164-4a6f-a0f2-696216d77762 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1571 microversion: 2.1 time: 0.338387 Mar 12 21:17:54.049158 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4106/4874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:53 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1571 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:54.069692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-62058f9a-f858-4ae7-8425-d87bc6ef88e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:54.071301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-62058f9a-f858-4ae7-8425-d87bc6ef88e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:54.092930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62058f9a-f858-4ae7-8425-d87bc6ef88e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:54.093695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62058f9a-f858-4ae7-8425-d87bc6ef88e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:54.095102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62058f9a-f858-4ae7-8425-d87bc6ef88e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:54.095852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62058f9a-f858-4ae7-8425-d87bc6ef88e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:54.345419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-62058f9a-f858-4ae7-8425-d87bc6ef88e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:54.354126 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-62058f9a-f858-4ae7-8425-d87bc6ef88e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1489 microversion: 2.1 time: 0.303696 Mar 12 21:17:54.356737 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4107/4875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:54 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1489 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:54.362306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8664ee8-120a-4823-83ac-cd75645f645d tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:54.363008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8664ee8-120a-4823-83ac-cd75645f645d tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:54.443518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a8664ee8-120a-4823-83ac-cd75645f645d tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:54.452603 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8664ee8-120a-4823-83ac-cd75645f645d tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1241 microversion: 2.1 time: 0.094581 Mar 12 21:17:54.453481 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4108/4876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:54 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:54.466372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2a90dd65-5447-4893-a87e-24eb79081bff tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:54.468001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2a90dd65-5447-4893-a87e-24eb79081bff tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:54.476717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a90dd65-5447-4893-a87e-24eb79081bff tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:54.479146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a90dd65-5447-4893-a87e-24eb79081bff tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:54.481643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a90dd65-5447-4893-a87e-24eb79081bff tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:54.482302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a90dd65-5447-4893-a87e-24eb79081bff tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:54.591852 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2a90dd65-5447-4893-a87e-24eb79081bff tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "PUT /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1084 microversion: 2.1 time: 0.137124 Mar 12 21:17:54.601857 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4109/4877] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Mar 12 21:17:54 2022] PUT /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1084 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:54.611027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a72db340-5fdc-4383-bd6c-4f1d6001bb6a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:54.614355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a72db340-5fdc-4383-bd6c-4f1d6001bb6a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:54.626752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a72db340-5fdc-4383-bd6c-4f1d6001bb6a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:54.626962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a72db340-5fdc-4383-bd6c-4f1d6001bb6a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:54.627875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a72db340-5fdc-4383-bd6c-4f1d6001bb6a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:54.628412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a72db340-5fdc-4383-bd6c-4f1d6001bb6a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:54.873086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a72db340-5fdc-4383-bd6c-4f1d6001bb6a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:54.887652 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a72db340-5fdc-4383-bd6c-4f1d6001bb6a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1510 microversion: 2.1 time: 0.284458 Mar 12 21:17:54.888434 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4110/4878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:54 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:54.904129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4b493d0f-3755-4616-a768-9873a60b99ff req-f0387138-d987-4526-afa7-34e47febe279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2116b6a-ccc9-4993-8476-d53c16d9a896", "name": "network-vif-deleted", "tag": "ccbb58f4-5ca0-4fd2-9c8e-3763d9182d52"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:54.916821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4b493d0f-3755-4616-a768-9873a60b99ff req-f0387138-d987-4526-afa7-34e47febe279 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:54.917732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4b493d0f-3755-4616-a768-9873a60b99ff req-f0387138-d987-4526-afa7-34e47febe279 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:54.935216 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4b493d0f-3755-4616-a768-9873a60b99ff req-f0387138-d987-4526-afa7-34e47febe279 service nova] Creating event network-vif-deleted:ccbb58f4-5ca0-4fd2-9c8e-3763d9182d52 for instance a2116b6a-ccc9-4993-8476-d53c16d9a896 on nch2-master-1 Mar 12 21:17:54.943027 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4b493d0f-3755-4616-a768-9873a60b99ff req-f0387138-d987-4526-afa7-34e47febe279 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052353 Mar 12 21:17:54.944804 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4111/4879] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:17:54.954169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09cc503c-6ab0-4343-915b-5048683740de tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:54.955136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-09cc503c-6ab0-4343-915b-5048683740de tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:54.963040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09cc503c-6ab0-4343-915b-5048683740de tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:54.964099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09cc503c-6ab0-4343-915b-5048683740de tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:54.965252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09cc503c-6ab0-4343-915b-5048683740de tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:54.965997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09cc503c-6ab0-4343-915b-5048683740de tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:55.153357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09cc503c-6ab0-4343-915b-5048683740de tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:55.172525 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09cc503c-6ab0-4343-915b-5048683740de tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1510 microversion: 2.1 time: 0.225450 Mar 12 21:17:55.174229 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4112/4880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:54 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:55.182083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca0c13b1-19a4-456d-a8f3-04fd59e433ab tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:55.184000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ca0c13b1-19a4-456d-a8f3-04fd59e433ab tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:55.195478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca0c13b1-19a4-456d-a8f3-04fd59e433ab tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:55.196355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca0c13b1-19a4-456d-a8f3-04fd59e433ab tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:55.198024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca0c13b1-19a4-456d-a8f3-04fd59e433ab tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:55.198995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca0c13b1-19a4-456d-a8f3-04fd59e433ab tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:55.284814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca0c13b1-19a4-456d-a8f3-04fd59e433ab tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:55.285708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca0c13b1-19a4-456d-a8f3-04fd59e433ab tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:55.286549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-ca0c13b1-19a4-456d-a8f3-04fd59e433ab tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lazy-loading 'fault' on Instance uuid a2116b6a-ccc9-4993-8476-d53c16d9a896 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:17:55.359198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca0c13b1-19a4-456d-a8f3-04fd59e433ab tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43f35f32a8064500a8d8412f19697b93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf66e00702594effaf99e35fcdcf05c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:55.377376 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca0c13b1-19a4-456d-a8f3-04fd59e433ab tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 200 len: 1357 microversion: 2.1 time: 0.201436 Mar 12 21:17:55.379732 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4113/4881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:55 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:55.387528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a547a24-578a-4083-9c83-34b58a7941ec tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:55.388277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a547a24-578a-4083-9c83-34b58a7941ec tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:55.397668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a547a24-578a-4083-9c83-34b58a7941ec tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:55.398228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a547a24-578a-4083-9c83-34b58a7941ec tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:55.399632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a547a24-578a-4083-9c83-34b58a7941ec tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:55.399880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a547a24-578a-4083-9c83-34b58a7941ec tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:55.437053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a547a24-578a-4083-9c83-34b58a7941ec tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:17:55.561908 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a547a24-578a-4083-9c83-34b58a7941ec tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 204 len: 0 microversion: 2.1 time: 0.180164 Mar 12 21:17:55.562655 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4114/4882] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:17:55 2022] DELETE /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:17:55.568603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-493f02cb-21aa-4222-8504-25e429e1b547 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:55.569444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-493f02cb-21aa-4222-8504-25e429e1b547 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:55.576505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-493f02cb-21aa-4222-8504-25e429e1b547 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:55.577071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-493f02cb-21aa-4222-8504-25e429e1b547 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:55.578222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-493f02cb-21aa-4222-8504-25e429e1b547 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:55.578663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-493f02cb-21aa-4222-8504-25e429e1b547 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:55.649372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-493f02cb-21aa-4222-8504-25e429e1b547 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:55.658891 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-493f02cb-21aa-4222-8504-25e429e1b547 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1299 microversion: 2.1 time: 0.094919 Mar 12 21:17:55.660662 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4115/4883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:55 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:55.666450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ef4a8d0-bcd8-4b6b-b1d7-3dad3cd9ca0c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:55.667836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5ef4a8d0-bcd8-4b6b-b1d7-3dad3cd9ca0c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:55.676926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ef4a8d0-bcd8-4b6b-b1d7-3dad3cd9ca0c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:55.677422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ef4a8d0-bcd8-4b6b-b1d7-3dad3cd9ca0c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:55.678344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ef4a8d0-bcd8-4b6b-b1d7-3dad3cd9ca0c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:55.679074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ef4a8d0-bcd8-4b6b-b1d7-3dad3cd9ca0c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:55.892795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5ef4a8d0-bcd8-4b6b-b1d7-3dad3cd9ca0c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:55.903423 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ef4a8d0-bcd8-4b6b-b1d7-3dad3cd9ca0c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1516 microversion: 2.1 time: 0.241473 Mar 12 21:17:55.905176 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4116/4884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:55 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1516 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:56.408245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20667e62-4fbb-4c05-811d-857cdbf59360 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:56.408966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20667e62-4fbb-4c05-811d-857cdbf59360 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] [instance: a2116b6a-ccc9-4993-8476-d53c16d9a896] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:56.419847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20667e62-4fbb-4c05-811d-857cdbf59360 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:56.420431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20667e62-4fbb-4c05-811d-857cdbf59360 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:56.421443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20667e62-4fbb-4c05-811d-857cdbf59360 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:56.422013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20667e62-4fbb-4c05-811d-857cdbf59360 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:56.441967 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-20667e62-4fbb-4c05-811d-857cdbf59360 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] HTTP exception thrown: Instance a2116b6a-ccc9-4993-8476-d53c16d9a896 could not be found. Mar 12 21:17:56.442825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20667e62-4fbb-4c05-811d-857cdbf59360 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Returning 404 to user: Instance a2116b6a-ccc9-4993-8476-d53c16d9a896 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:17:56.443536 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20667e62-4fbb-4c05-811d-857cdbf59360 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896" status: 404 len: 111 microversion: 2.1 time: 0.040885 Mar 12 21:17:56.445837 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4117/4885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:56 2022] GET /compute/v2.1/servers/a2116b6a-ccc9-4993-8476-d53c16d9a896 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:17:56.679561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cd5e753c-62ce-4012-a9ac-304da8762576 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:56.680204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cd5e753c-62ce-4012-a9ac-304da8762576 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:56.717183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd5e753c-62ce-4012-a9ac-304da8762576 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:56.717652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd5e753c-62ce-4012-a9ac-304da8762576 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:56.721662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd5e753c-62ce-4012-a9ac-304da8762576 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:56.723237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd5e753c-62ce-4012-a9ac-304da8762576 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:57.076346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd5e753c-62ce-4012-a9ac-304da8762576 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:57.113675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cd5e753c-62ce-4012-a9ac-304da8762576 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1299 microversion: 2.1 time: 0.437998 Mar 12 21:17:57.127368 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4118/4886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:56 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1299 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:57.136397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-24fe8273-9117-4b70-86c5-ecce4ddb6127 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:57.145845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-24fe8273-9117-4b70-86c5-ecce4ddb6127 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:57.166658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24fe8273-9117-4b70-86c5-ecce4ddb6127 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:57.168159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24fe8273-9117-4b70-86c5-ecce4ddb6127 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:57.170458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24fe8273-9117-4b70-86c5-ecce4ddb6127 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:57.172492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24fe8273-9117-4b70-86c5-ecce4ddb6127 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:57.598664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-24fe8273-9117-4b70-86c5-ecce4ddb6127 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:57.610458 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-24fe8273-9117-4b70-86c5-ecce4ddb6127 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1516 microversion: 2.1 time: 0.481022 Mar 12 21:17:57.621358 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4119/4887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:57 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1516 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:57.627608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d2bebaa1-327c-46e8-9987-164286ba8731 req-34fd10be-4dfe-431c-83d0-a1aa8b344fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33571532-c590-4c0d-93ff-fb8f92971c37", "tag": "068a1400-432b-4133-868c-bc22ba6e4fbd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:57.637455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d2bebaa1-327c-46e8-9987-164286ba8731 req-34fd10be-4dfe-431c-83d0-a1aa8b344fb0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:57.637455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d2bebaa1-327c-46e8-9987-164286ba8731 req-34fd10be-4dfe-431c-83d0-a1aa8b344fb0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:57.652993 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d2bebaa1-327c-46e8-9987-164286ba8731 req-34fd10be-4dfe-431c-83d0-a1aa8b344fb0 service nova] Creating event network-changed:068a1400-432b-4133-868c-bc22ba6e4fbd for instance 33571532-c590-4c0d-93ff-fb8f92971c37 on nch2-master-1 Mar 12 21:17:57.659191 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d2bebaa1-327c-46e8-9987-164286ba8731 req-34fd10be-4dfe-431c-83d0-a1aa8b344fb0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036239 Mar 12 21:17:57.660281 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4120/4888] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:17:58.134532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cd58cda1-c71d-4556-a132-35092f0b0879 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:58.136761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cd58cda1-c71d-4556-a132-35092f0b0879 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:58.149741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd58cda1-c71d-4556-a132-35092f0b0879 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:58.150371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd58cda1-c71d-4556-a132-35092f0b0879 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:58.151844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd58cda1-c71d-4556-a132-35092f0b0879 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:58.152361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd58cda1-c71d-4556-a132-35092f0b0879 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:58.516094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd58cda1-c71d-4556-a132-35092f0b0879 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:58.527140 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cd58cda1-c71d-4556-a132-35092f0b0879 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1299 microversion: 2.1 time: 0.398029 Mar 12 21:17:58.530002 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4121/4889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:58 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1299 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:58.577760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b5f71600-ad28-4d95-92db-eb73a5acba4f req-687ee47d-f9d9-4566-afd6-c1ca59dda2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2073e46b-263b-40ee-8c89-3d84493b3f12", "name": "network-vif-deleted", "tag": "632c3aef-fb9c-4e85-8174-055d01733a24"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:58.599365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b5f71600-ad28-4d95-92db-eb73a5acba4f req-687ee47d-f9d9-4566-afd6-c1ca59dda2c7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:58.599816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b5f71600-ad28-4d95-92db-eb73a5acba4f req-687ee47d-f9d9-4566-afd6-c1ca59dda2c7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:58.624162 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b5f71600-ad28-4d95-92db-eb73a5acba4f req-687ee47d-f9d9-4566-afd6-c1ca59dda2c7 service nova] Creating event network-vif-deleted:632c3aef-fb9c-4e85-8174-055d01733a24 for instance 2073e46b-263b-40ee-8c89-3d84493b3f12 on nch1-master-1 Mar 12 21:17:58.630920 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b5f71600-ad28-4d95-92db-eb73a5acba4f req-687ee47d-f9d9-4566-afd6-c1ca59dda2c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060902 Mar 12 21:17:58.631551 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4122/4890] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:17:58.656700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59fe236d-afda-4085-a304-29cdb55eb20d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:58.657447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59fe236d-afda-4085-a304-29cdb55eb20d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:58.666807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59fe236d-afda-4085-a304-29cdb55eb20d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:58.667293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59fe236d-afda-4085-a304-29cdb55eb20d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:58.668397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59fe236d-afda-4085-a304-29cdb55eb20d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:58.668576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59fe236d-afda-4085-a304-29cdb55eb20d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:58.758876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-59fe236d-afda-4085-a304-29cdb55eb20d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:58.767849 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59fe236d-afda-4085-a304-29cdb55eb20d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 200 len: 1314 microversion: 2.1 time: 0.134788 Mar 12 21:17:58.775403 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4123/4891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:58 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:17:59.550645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5012e360-b1ec-4af8-a3e1-5a5144685384 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:59.552143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5012e360-b1ec-4af8-a3e1-5a5144685384 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:59.566216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5012e360-b1ec-4af8-a3e1-5a5144685384 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:59.567041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5012e360-b1ec-4af8-a3e1-5a5144685384 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:59.568389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5012e360-b1ec-4af8-a3e1-5a5144685384 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:59.569344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5012e360-b1ec-4af8-a3e1-5a5144685384 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:59.746045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5012e360-b1ec-4af8-a3e1-5a5144685384 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:17:59.757059 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5012e360-b1ec-4af8-a3e1-5a5144685384 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1299 microversion: 2.1 time: 0.215792 Mar 12 21:17:59.771501 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4124/4892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:59 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1299 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:17:59.804576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94e7f8ef-2953-4878-852d-380cf98024da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:17:59.806206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94e7f8ef-2953-4878-852d-380cf98024da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:17:59.815784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94e7f8ef-2953-4878-852d-380cf98024da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:59.816476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94e7f8ef-2953-4878-852d-380cf98024da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:59.817513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94e7f8ef-2953-4878-852d-380cf98024da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:17:59.818285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94e7f8ef-2953-4878-852d-380cf98024da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:17:59.850046 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-94e7f8ef-2953-4878-852d-380cf98024da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 2073e46b-263b-40ee-8c89-3d84493b3f12 could not be found. Mar 12 21:17:59.850810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94e7f8ef-2953-4878-852d-380cf98024da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 2073e46b-263b-40ee-8c89-3d84493b3f12 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:17:59.851810 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94e7f8ef-2953-4878-852d-380cf98024da tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 404 len: 111 microversion: 2.1 time: 0.052023 Mar 12 21:17:59.862173 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4125/4893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:17:59 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:17:59.917933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-709413467", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "ee10e394-b9a4-4301-b170-a0cb0111bac0"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:17:59.994650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] validate_networks() for [('ee10e394-b9a4-4301-b170-a0cb0111bac0', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:18:00.628880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:18:00.629443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:18:00.629853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:18:00.630298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:18:00.630726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:18:00.652327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:00.653150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:00.654613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:00.655494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:00.681401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:18:00.689544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Getting quotas for user 074c6de57bf94d4a943b2d04e2072ae7 and project f3fffba5f19640b8bfaf5c10aa33ad70. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:18:00.705085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:18:00.707667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:18:00.757268 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-570acf9d-6554-497e-98e5-7c676e62c901 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844833 Mar 12 21:18:00.766478 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4126/4894] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:17:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:18:00.781373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5502bf87-805f-47da-be56-ee21ac11a87e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:00.782894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5502bf87-805f-47da-be56-ee21ac11a87e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:00.902208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5502bf87-805f-47da-be56-ee21ac11a87e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:00.917344 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5502bf87-805f-47da-be56-ee21ac11a87e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1208 microversion: 2.1 time: 0.141014 Mar 12 21:18:00.918376 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4127/4895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:00 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1208 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:00.937288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-38236b0f-23a0-42ae-a680-95df919ae786 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:00.941077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-38236b0f-23a0-42ae-a680-95df919ae786 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:00.959340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38236b0f-23a0-42ae-a680-95df919ae786 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:00.959830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38236b0f-23a0-42ae-a680-95df919ae786 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:00.960922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38236b0f-23a0-42ae-a680-95df919ae786 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:00.962016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-38236b0f-23a0-42ae-a680-95df919ae786 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:01.156807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-38236b0f-23a0-42ae-a680-95df919ae786 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:01.169115 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-38236b0f-23a0-42ae-a680-95df919ae786 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1299 microversion: 2.1 time: 0.249589 Mar 12 21:18:01.171546 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4128/4896] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:00 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1299 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:01.939941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-013ace76-1426-4435-afb7-e902c3d9235d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:01.940590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-013ace76-1426-4435-afb7-e902c3d9235d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:01.951207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-013ace76-1426-4435-afb7-e902c3d9235d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:01.951673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-013ace76-1426-4435-afb7-e902c3d9235d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:01.952488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-013ace76-1426-4435-afb7-e902c3d9235d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:01.952972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-013ace76-1426-4435-afb7-e902c3d9235d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:02.069292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-013ace76-1426-4435-afb7-e902c3d9235d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:02.078404 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-013ace76-1426-4435-afb7-e902c3d9235d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1260 microversion: 2.1 time: 0.142683 Mar 12 21:18:02.089486 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4129/4897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:01 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1260 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:02.089674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b4dcc62-98e3-499b-863d-46750f1a3937 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] Calling method '.version_select at 0x7f6e353ea3a0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:02.133118 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b4dcc62-98e3-499b-863d-46750f1a3937 tempest-TestNetworkAdvancedServerOps-524060788 tempest-TestNetworkAdvancedServerOps-524060788-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1271516711" status: 202 len: 0 microversion: 2.1 time: 0.052531 Mar 12 21:18:02.134102 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4130/4898] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Mar 12 21:18:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1271516711 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:18:02.190330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51c813f8-7eca-466a-a823-5c3607427147 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:02.191268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51c813f8-7eca-466a-a823-5c3607427147 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:02.199526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51c813f8-7eca-466a-a823-5c3607427147 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:02.200198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51c813f8-7eca-466a-a823-5c3607427147 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:02.201194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51c813f8-7eca-466a-a823-5c3607427147 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:02.202050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51c813f8-7eca-466a-a823-5c3607427147 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:02.382370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51c813f8-7eca-466a-a823-5c3607427147 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:02.392403 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51c813f8-7eca-466a-a823-5c3607427147 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1299 microversion: 2.1 time: 0.207785 Mar 12 21:18:02.393841 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4131/4899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:02 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1299 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:03.107136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a068da94-dfd9-43b4-afa8-e3174271987c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:03.109465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a068da94-dfd9-43b4-afa8-e3174271987c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:03.120709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a068da94-dfd9-43b4-afa8-e3174271987c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:03.121629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a068da94-dfd9-43b4-afa8-e3174271987c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:03.123498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a068da94-dfd9-43b4-afa8-e3174271987c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:03.124175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a068da94-dfd9-43b4-afa8-e3174271987c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:03.400236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a068da94-dfd9-43b4-afa8-e3174271987c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:03.410675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a068da94-dfd9-43b4-afa8-e3174271987c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1308 microversion: 2.1 time: 0.314370 Mar 12 21:18:03.411537 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4132/4900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:03 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:03.417414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-627b5a65-1b4b-43e7-8e8d-cd0191c6c4f7 req-f049b013-9372-4f14-b51c-cb24620dd1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33571532-c590-4c0d-93ff-fb8f92971c37", "name": "network-vif-plugged", "status": "completed", "tag": "068a1400-432b-4133-868c-bc22ba6e4fbd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:03.428327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-627b5a65-1b4b-43e7-8e8d-cd0191c6c4f7 req-f049b013-9372-4f14-b51c-cb24620dd1ab service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:03.428962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-627b5a65-1b4b-43e7-8e8d-cd0191c6c4f7 req-f049b013-9372-4f14-b51c-cb24620dd1ab service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:03.441345 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-627b5a65-1b4b-43e7-8e8d-cd0191c6c4f7 req-f049b013-9372-4f14-b51c-cb24620dd1ab service nova] Creating event network-vif-plugged:068a1400-432b-4133-868c-bc22ba6e4fbd for instance 33571532-c590-4c0d-93ff-fb8f92971c37 on nch2-master-1 Mar 12 21:18:03.449687 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-627b5a65-1b4b-43e7-8e8d-cd0191c6c4f7 req-f049b013-9372-4f14-b51c-cb24620dd1ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035209 Mar 12 21:18:03.450383 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4133/4901] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:18:03.458078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a2f55c1-ce85-4feb-8de2-c49a6f8f51f1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:03.458909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a2f55c1-ce85-4feb-8de2-c49a6f8f51f1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:03.469922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a2f55c1-ce85-4feb-8de2-c49a6f8f51f1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:03.470661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a2f55c1-ce85-4feb-8de2-c49a6f8f51f1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:03.472363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a2f55c1-ce85-4feb-8de2-c49a6f8f51f1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:03.473215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a2f55c1-ce85-4feb-8de2-c49a6f8f51f1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:03.650450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8a2f55c1-ce85-4feb-8de2-c49a6f8f51f1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:03.658964 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a2f55c1-ce85-4feb-8de2-c49a6f8f51f1 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1299 microversion: 2.1 time: 0.207448 Mar 12 21:18:03.660010 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4134/4902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:03 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1299 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:03.826289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f5a75ee6-9a79-4a05-9c0e-443ca1419e01 req-5d09261f-a730-449f-8061-82a82f88e51e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5cf5b7f-311c-4860-b61b-53c41ba18cda", "tag": "9ca73279-b59b-40c6-b793-0756bf60707d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:03.844944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f5a75ee6-9a79-4a05-9c0e-443ca1419e01 req-5d09261f-a730-449f-8061-82a82f88e51e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:03.846180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f5a75ee6-9a79-4a05-9c0e-443ca1419e01 req-5d09261f-a730-449f-8061-82a82f88e51e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:03.868557 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f5a75ee6-9a79-4a05-9c0e-443ca1419e01 req-5d09261f-a730-449f-8061-82a82f88e51e service nova] Creating event network-changed:9ca73279-b59b-40c6-b793-0756bf60707d for instance f5cf5b7f-311c-4860-b61b-53c41ba18cda on nch1-master-1 Mar 12 21:18:03.883875 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f5a75ee6-9a79-4a05-9c0e-443ca1419e01 req-5d09261f-a730-449f-8061-82a82f88e51e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062292 Mar 12 21:18:03.888435 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4135/4903] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:18:04.431444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f56032f-dee9-42b4-b568-512ec7792924 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:04.433189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4f56032f-dee9-42b4-b568-512ec7792924 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:04.444092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f56032f-dee9-42b4-b568-512ec7792924 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:04.444755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f56032f-dee9-42b4-b568-512ec7792924 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:04.446547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f56032f-dee9-42b4-b568-512ec7792924 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:04.448376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f56032f-dee9-42b4-b568-512ec7792924 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:04.739556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4f56032f-dee9-42b4-b568-512ec7792924 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:04.752313 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4f56032f-dee9-42b4-b568-512ec7792924 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1308 microversion: 2.1 time: 0.326929 Mar 12 21:18:04.758601 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4136/4904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:04 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:04.767417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d3967ab3-a701-45c5-89f1-59a88bde5adc tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:04.768816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d3967ab3-a701-45c5-89f1-59a88bde5adc tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:04.777574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3967ab3-a701-45c5-89f1-59a88bde5adc tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:04.778680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3967ab3-a701-45c5-89f1-59a88bde5adc tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:04.779846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3967ab3-a701-45c5-89f1-59a88bde5adc tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:04.780458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d3967ab3-a701-45c5-89f1-59a88bde5adc tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:04.939076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d3967ab3-a701-45c5-89f1-59a88bde5adc tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:04.948379 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d3967ab3-a701-45c5-89f1-59a88bde5adc tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1470 microversion: 2.1 time: 0.185675 Mar 12 21:18:04.953808 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4137/4905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:04 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1470 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:04.967685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c13011b2-f90e-4891-9d1e-f3b8616002d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:04.968302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c13011b2-f90e-4891-9d1e-f3b8616002d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:04.974857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c13011b2-f90e-4891-9d1e-f3b8616002d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:04.975328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c13011b2-f90e-4891-9d1e-f3b8616002d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:04.976124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c13011b2-f90e-4891-9d1e-f3b8616002d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:04.976578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c13011b2-f90e-4891-9d1e-f3b8616002d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:05.080566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c13011b2-f90e-4891-9d1e-f3b8616002d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:05.087991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c13011b2-f90e-4891-9d1e-f3b8616002d5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1470 microversion: 2.1 time: 0.126055 Mar 12 21:18:05.096429 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4138/4906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:04 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1470 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:05.104202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e1141871-f87e-453b-8024-aab4fe19adf1 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:05.104828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e1141871-f87e-453b-8024-aab4fe19adf1 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:05.110807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1141871-f87e-453b-8024-aab4fe19adf1 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:05.111272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1141871-f87e-453b-8024-aab4fe19adf1 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:05.112061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1141871-f87e-453b-8024-aab4fe19adf1 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:05.112563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1141871-f87e-453b-8024-aab4fe19adf1 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:05.199650 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e1141871-f87e-453b-8024-aab4fe19adf1 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1621 microversion: 2.1 time: 0.099006 Mar 12 21:18:05.200227 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4139/4907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:05 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1621 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:05.215585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-893e465f-c4f2-412d-aff4-eacc4eb660e4 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:05.216220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-893e465f-c4f2-412d-aff4-eacc4eb660e4 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:05.221963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-893e465f-c4f2-412d-aff4-eacc4eb660e4 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:05.222434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-893e465f-c4f2-412d-aff4-eacc4eb660e4 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:05.223214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-893e465f-c4f2-412d-aff4-eacc4eb660e4 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:05.223667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-893e465f-c4f2-412d-aff4-eacc4eb660e4 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:05.365449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-893e465f-c4f2-412d-aff4-eacc4eb660e4 tempest-TestSecurityGroupsBasicOps-1841402917 tempest-TestSecurityGroupsBasicOps-1841402917-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1911 microversion: 2.1 time: 0.153932 Mar 12 21:18:05.366031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4140/4908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:05 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1911 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:05.440333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7b2a95e-6738-426e-8847-c5548e52f067 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:05.440950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f7b2a95e-6738-426e-8847-c5548e52f067 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:05.447849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7b2a95e-6738-426e-8847-c5548e52f067 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:05.449059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7b2a95e-6738-426e-8847-c5548e52f067 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:05.450103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7b2a95e-6738-426e-8847-c5548e52f067 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:05.450677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7b2a95e-6738-426e-8847-c5548e52f067 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:05.478016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f7b2a95e-6738-426e-8847-c5548e52f067 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:18:05.560491 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f7b2a95e-6738-426e-8847-c5548e52f067 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "DELETE /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 204 len: 0 microversion: 2.1 time: 0.123744 Mar 12 21:18:05.561100 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4141/4909] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:18:05 2022] DELETE /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:18:05.571288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c48cc2d7-d258-4cd5-bdb3-20de2218579f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:05.571732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c48cc2d7-d258-4cd5-bdb3-20de2218579f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:05.580542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c48cc2d7-d258-4cd5-bdb3-20de2218579f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:05.581096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c48cc2d7-d258-4cd5-bdb3-20de2218579f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:05.582002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c48cc2d7-d258-4cd5-bdb3-20de2218579f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:05.582663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c48cc2d7-d258-4cd5-bdb3-20de2218579f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:05.676740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c48cc2d7-d258-4cd5-bdb3-20de2218579f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:05.685359 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c48cc2d7-d258-4cd5-bdb3-20de2218579f tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1476 microversion: 2.1 time: 0.119513 Mar 12 21:18:05.686213 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4142/4910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:05 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1476 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:05.770916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3f01d554-3fa0-4a06-9a5c-5405ab7ee81f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:05.771706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3f01d554-3fa0-4a06-9a5c-5405ab7ee81f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:05.777754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f01d554-3fa0-4a06-9a5c-5405ab7ee81f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:05.778288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f01d554-3fa0-4a06-9a5c-5405ab7ee81f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:05.779079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f01d554-3fa0-4a06-9a5c-5405ab7ee81f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:05.779546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f01d554-3fa0-4a06-9a5c-5405ab7ee81f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:05.918605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3f01d554-3fa0-4a06-9a5c-5405ab7ee81f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:05.923986 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3f01d554-3fa0-4a06-9a5c-5405ab7ee81f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1308 microversion: 2.1 time: 0.157003 Mar 12 21:18:05.924579 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4143/4911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:05 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:06.704665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a660109a-23c7-458f-abff-d36bb155adef tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:06.705291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a660109a-23c7-458f-abff-d36bb155adef tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:06.712029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a660109a-23c7-458f-abff-d36bb155adef tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:06.713089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a660109a-23c7-458f-abff-d36bb155adef tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:06.714557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a660109a-23c7-458f-abff-d36bb155adef tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:06.715016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a660109a-23c7-458f-abff-d36bb155adef tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:06.801157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a660109a-23c7-458f-abff-d36bb155adef tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:06.809233 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a660109a-23c7-458f-abff-d36bb155adef tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1476 microversion: 2.1 time: 0.108533 Mar 12 21:18:06.810022 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4144/4912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:06 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1476 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:06.940489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea0f85ce-51a6-4226-9615-158cfba8e8dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:06.941157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea0f85ce-51a6-4226-9615-158cfba8e8dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:06.948465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea0f85ce-51a6-4226-9615-158cfba8e8dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:06.949255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea0f85ce-51a6-4226-9615-158cfba8e8dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:06.949742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea0f85ce-51a6-4226-9615-158cfba8e8dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:06.950222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea0f85ce-51a6-4226-9615-158cfba8e8dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:07.117998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ea0f85ce-51a6-4226-9615-158cfba8e8dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:07.132751 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea0f85ce-51a6-4226-9615-158cfba8e8dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1308 microversion: 2.1 time: 0.195919 Mar 12 21:18:07.134158 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4145/4913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:06 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:07.508550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-06cfcd7f-ed35-4424-a653-bcd3b537184f req-6f7d9d6d-90d1-4faa-812b-fa9eb855c843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33571532-c590-4c0d-93ff-fb8f92971c37", "name": "network-vif-deleted", "tag": "068a1400-432b-4133-868c-bc22ba6e4fbd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:07.517838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-06cfcd7f-ed35-4424-a653-bcd3b537184f req-6f7d9d6d-90d1-4faa-812b-fa9eb855c843 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:07.518486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-06cfcd7f-ed35-4424-a653-bcd3b537184f req-6f7d9d6d-90d1-4faa-812b-fa9eb855c843 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:07.545860 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-06cfcd7f-ed35-4424-a653-bcd3b537184f req-6f7d9d6d-90d1-4faa-812b-fa9eb855c843 service nova] Creating event network-vif-deleted:068a1400-432b-4133-868c-bc22ba6e4fbd for instance 33571532-c590-4c0d-93ff-fb8f92971c37 on nch2-master-1 Mar 12 21:18:07.553058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-06cfcd7f-ed35-4424-a653-bcd3b537184f req-6f7d9d6d-90d1-4faa-812b-fa9eb855c843 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048218 Mar 12 21:18:07.556982 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4146/4914] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:18:07.834476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5b5cb583-8ad1-4078-b5cc-6f4188aaf94c tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:07.835251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5b5cb583-8ad1-4078-b5cc-6f4188aaf94c tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:07.844708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b5cb583-8ad1-4078-b5cc-6f4188aaf94c tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:07.845163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b5cb583-8ad1-4078-b5cc-6f4188aaf94c tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:07.846043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b5cb583-8ad1-4078-b5cc-6f4188aaf94c tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:07.846503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b5cb583-8ad1-4078-b5cc-6f4188aaf94c tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:07.891784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b5cb583-8ad1-4078-b5cc-6f4188aaf94c tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:07.893228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b5cb583-8ad1-4078-b5cc-6f4188aaf94c tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:07.894272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-5b5cb583-8ad1-4078-b5cc-6f4188aaf94c tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lazy-loading 'fault' on Instance uuid 33571532-c590-4c0d-93ff-fb8f92971c37 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:18:08.346215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5b5cb583-8ad1-4078-b5cc-6f4188aaf94c tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:08.354514 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5b5cb583-8ad1-4078-b5cc-6f4188aaf94c tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 200 len: 1331 microversion: 2.1 time: 0.531267 Mar 12 21:18:08.355312 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4147/4915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:07 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 1331 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:08.360947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0aaeb026-7622-4614-a5de-df163eabf20a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:08.362132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0aaeb026-7622-4614-a5de-df163eabf20a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:08.369035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0aaeb026-7622-4614-a5de-df163eabf20a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:08.370286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0aaeb026-7622-4614-a5de-df163eabf20a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:08.371865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0aaeb026-7622-4614-a5de-df163eabf20a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:08.372461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0aaeb026-7622-4614-a5de-df163eabf20a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:08.659596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0aaeb026-7622-4614-a5de-df163eabf20a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:08.673885 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0aaeb026-7622-4614-a5de-df163eabf20a tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1308 microversion: 2.1 time: 0.315904 Mar 12 21:18:08.674870 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4148/4916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:08 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:09.374009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94cac110-dd2e-444b-9f41-b484f5b3daba tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:09.375466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94cac110-dd2e-444b-9f41-b484f5b3daba tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 33571532-c590-4c0d-93ff-fb8f92971c37] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:09.388352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94cac110-dd2e-444b-9f41-b484f5b3daba tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:09.389298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94cac110-dd2e-444b-9f41-b484f5b3daba tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:09.390421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94cac110-dd2e-444b-9f41-b484f5b3daba tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:09.392577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94cac110-dd2e-444b-9f41-b484f5b3daba tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:09.424755 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-94cac110-dd2e-444b-9f41-b484f5b3daba tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] HTTP exception thrown: Instance 33571532-c590-4c0d-93ff-fb8f92971c37 could not be found. Mar 12 21:18:09.425473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94cac110-dd2e-444b-9f41-b484f5b3daba tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Returning 404 to user: Instance 33571532-c590-4c0d-93ff-fb8f92971c37 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:09.426473 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94cac110-dd2e-444b-9f41-b484f5b3daba tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37" status: 404 len: 111 microversion: 2.1 time: 0.058003 Mar 12 21:18:09.427061 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4149/4917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:09 2022] GET /compute/v2.1/servers/33571532-c590-4c0d-93ff-fb8f92971c37 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:09.693869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8d3ee8c7-0669-48d3-9adc-c7a647d51f68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:09.694915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8d3ee8c7-0669-48d3-9adc-c7a647d51f68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:09.710874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d3ee8c7-0669-48d3-9adc-c7a647d51f68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:09.713222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d3ee8c7-0669-48d3-9adc-c7a647d51f68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:09.715457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d3ee8c7-0669-48d3-9adc-c7a647d51f68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:09.716088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8d3ee8c7-0669-48d3-9adc-c7a647d51f68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:10.408185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8d3ee8c7-0669-48d3-9adc-c7a647d51f68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:10.423783 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8d3ee8c7-0669-48d3-9adc-c7a647d51f68 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1308 microversion: 2.1 time: 0.733631 Mar 12 21:18:10.425128 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4150/4918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:09 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1308 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:10.431495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0f7c16f8-fb31-45f1-8190-867c29504864 req-d700e506-d73c-48bc-bc40-7a6335c187c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cf5b7f-311c-4860-b61b-53c41ba18cda", "name": "network-vif-plugged", "status": "completed", "tag": "9ca73279-b59b-40c6-b793-0756bf60707d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:10.445315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0f7c16f8-fb31-45f1-8190-867c29504864 req-d700e506-d73c-48bc-bc40-7a6335c187c2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:10.446352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0f7c16f8-fb31-45f1-8190-867c29504864 req-d700e506-d73c-48bc-bc40-7a6335c187c2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:10.461307 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0f7c16f8-fb31-45f1-8190-867c29504864 req-d700e506-d73c-48bc-bc40-7a6335c187c2 service nova] Creating event network-vif-plugged:9ca73279-b59b-40c6-b793-0756bf60707d for instance f5cf5b7f-311c-4860-b61b-53c41ba18cda on nch1-master-1 Mar 12 21:18:10.468953 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0f7c16f8-fb31-45f1-8190-867c29504864 req-d700e506-d73c-48bc-bc40-7a6335c187c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042285 Mar 12 21:18:10.470346 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4151/4919] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:18:11.444458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1d69aad1-019a-4709-ac89-38fd93792d29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:11.445967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1d69aad1-019a-4709-ac89-38fd93792d29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:11.462780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d69aad1-019a-4709-ac89-38fd93792d29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:11.464537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d69aad1-019a-4709-ac89-38fd93792d29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:11.466316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d69aad1-019a-4709-ac89-38fd93792d29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:11.466777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d69aad1-019a-4709-ac89-38fd93792d29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:11.800147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1d69aad1-019a-4709-ac89-38fd93792d29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:11.811641 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1d69aad1-019a-4709-ac89-38fd93792d29 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1308 microversion: 2.1 time: 0.372752 Mar 12 21:18:11.822190 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4152/4920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:11 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:12.180204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23e3eab6-c7c7-403f-add6-acc633f44823 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Action: 'create', calling method: .version_select at 0x7f6e353ea3a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1602053234"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:12.219466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-23e3eab6-c7c7-403f-add6-acc633f44823 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for project 1940f5d7144c49758a742d34f71e9639. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:18:12.228452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-23e3eab6-c7c7-403f-add6-acc633f44823 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for user 75e4a2651a6e469491f271ced8ef9695 and project 1940f5d7144c49758a742d34f71e9639. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:18:12.458531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-23e3eab6-c7c7-403f-add6-acc633f44823 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for project 1940f5d7144c49758a742d34f71e9639. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:18:12.467742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-23e3eab6-c7c7-403f-add6-acc633f44823 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for user 75e4a2651a6e469491f271ced8ef9695 and project 1940f5d7144c49758a742d34f71e9639. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:18:12.488566 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-23e3eab6-c7c7-403f-add6-acc633f44823 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.328527 Mar 12 21:18:12.490156 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4153/4921] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:18:12 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:12.837361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-557c77d5-87bd-4d99-982b-13a6bec72048 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:12.838423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-557c77d5-87bd-4d99-982b-13a6bec72048 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:12.851416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-557c77d5-87bd-4d99-982b-13a6bec72048 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:12.854198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-557c77d5-87bd-4d99-982b-13a6bec72048 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:12.855387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-557c77d5-87bd-4d99-982b-13a6bec72048 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:12.856556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-557c77d5-87bd-4d99-982b-13a6bec72048 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:13.106764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-557c77d5-87bd-4d99-982b-13a6bec72048 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:13.118939 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-557c77d5-87bd-4d99-982b-13a6bec72048 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1490 microversion: 2.1 time: 0.285263 Mar 12 21:18:13.120879 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4154/4922] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:12 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1490 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:13.140144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-926ea899-9600-486b-9ae9-9fe20b678ebf tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1023203151"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:13.141631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-926ea899-9600-486b-9ae9-9fe20b678ebf tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:13.151762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-926ea899-9600-486b-9ae9-9fe20b678ebf tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:13.152444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-926ea899-9600-486b-9ae9-9fe20b678ebf tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:13.153501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-926ea899-9600-486b-9ae9-9fe20b678ebf tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:13.154009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-926ea899-9600-486b-9ae9-9fe20b678ebf tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:13.271071 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-926ea899-9600-486b-9ae9-9fe20b678ebf tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "PUT /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1076 microversion: 2.1 time: 0.137238 Mar 12 21:18:13.273627 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4155/4923] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Mar 12 21:18:13 2022] PUT /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1076 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:13.287167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1c8e8077-ead5-4e90-980f-a2f614253f20 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:13.287814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1c8e8077-ead5-4e90-980f-a2f614253f20 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:13.296394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c8e8077-ead5-4e90-980f-a2f614253f20 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:13.296977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c8e8077-ead5-4e90-980f-a2f614253f20 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:13.297932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c8e8077-ead5-4e90-980f-a2f614253f20 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:13.298574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c8e8077-ead5-4e90-980f-a2f614253f20 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:13.660892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1c8e8077-ead5-4e90-980f-a2f614253f20 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:13.670744 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1c8e8077-ead5-4e90-980f-a2f614253f20 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1502 microversion: 2.1 time: 0.388437 Mar 12 21:18:13.685371 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4156/4924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:13 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1502 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:13.699860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-47413fdf-7073-4207-96fc-3ea738823216 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:13.703649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-47413fdf-7073-4207-96fc-3ea738823216 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:13.717990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47413fdf-7073-4207-96fc-3ea738823216 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:13.720072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47413fdf-7073-4207-96fc-3ea738823216 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:13.723792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47413fdf-7073-4207-96fc-3ea738823216 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:13.725083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47413fdf-7073-4207-96fc-3ea738823216 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:14.092533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-47413fdf-7073-4207-96fc-3ea738823216 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:14.107450 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-47413fdf-7073-4207-96fc-3ea738823216 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1502 microversion: 2.1 time: 0.419648 Mar 12 21:18:14.118467 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4157/4925] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:13 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1502 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:14.127634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3eeae66-d895-4859-8498-0acd8a037c92 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:14.139429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3eeae66-d895-4859-8498-0acd8a037c92 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:14.140269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3eeae66-d895-4859-8498-0acd8a037c92 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:14.186567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c3eeae66-d895-4859-8498-0acd8a037c92 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Going to try to stop instance {{(pid=136302) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 12 21:18:14.271044 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3eeae66-d895-4859-8498-0acd8a037c92 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "POST /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda/action" status: 202 len: 0 microversion: 2.1 time: 0.147444 Mar 12 21:18:14.276598 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4158/4926] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:18:14 2022] POST /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:18:14.286042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-05bb2ca0-6822-487b-966d-e98330cd79dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:14.288005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-05bb2ca0-6822-487b-966d-e98330cd79dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:14.304612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05bb2ca0-6822-487b-966d-e98330cd79dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:14.305708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05bb2ca0-6822-487b-966d-e98330cd79dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:14.307506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05bb2ca0-6822-487b-966d-e98330cd79dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:14.311028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05bb2ca0-6822-487b-966d-e98330cd79dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:14.730431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-05bb2ca0-6822-487b-966d-e98330cd79dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:14.746792 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-05bb2ca0-6822-487b-966d-e98330cd79dc tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.467287 Mar 12 21:18:14.751027 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4159/4927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:14 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:14.953062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1863896246", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "29cfa326-4fdd-4f1a-9bd8-a338287d24b1"}], "key_name": "tempest-TestNetworkBasicOps-1602053234", "security_groups": [{"name": "tempest-secgroup-smoke-1465126689"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:15.140170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] validate_networks() for [('29cfa326-4fdd-4f1a-9bd8-a338287d24b1', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:18:15.800738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:18:15.805260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:18:15.805972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:18:15.806582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:18:15.807697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:18:15.820395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:15.820874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:15.821752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:15.822320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:15.842406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for project 1940f5d7144c49758a742d34f71e9639. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:18:15.848680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for user 75e4a2651a6e469491f271ced8ef9695 and project 1940f5d7144c49758a742d34f71e9639. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:18:15.863340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:18:15.865902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:18:15.920808 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b08f029a-7d22-471b-be6c-e107ed503dc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.971148 Mar 12 21:18:15.921961 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4160/4928] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:18:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:18:15.929212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7f39abcc-3e26-45ba-b6ec-0e379388f219 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:15.930259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7f39abcc-3e26-45ba-b6ec-0e379388f219 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:15.938427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f39abcc-3e26-45ba-b6ec-0e379388f219 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:15.939361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f39abcc-3e26-45ba-b6ec-0e379388f219 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:15.941129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f39abcc-3e26-45ba-b6ec-0e379388f219 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:15.941802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f39abcc-3e26-45ba-b6ec-0e379388f219 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:16.175406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7f39abcc-3e26-45ba-b6ec-0e379388f219 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:16.197053 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7f39abcc-3e26-45ba-b6ec-0e379388f219 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.273533 Mar 12 21:18:16.199707 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4161/4929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:15 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:16.204837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1ecb0e7-10e3-4355-bfe8-36d6db095c07 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:16.205721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f1ecb0e7-10e3-4355-bfe8-36d6db095c07 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:16.266835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f1ecb0e7-10e3-4355-bfe8-36d6db095c07 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:16.275514 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1ecb0e7-10e3-4355-bfe8-36d6db095c07 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 200 len: 1249 microversion: 2.1 time: 0.074487 Mar 12 21:18:16.276479 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4162/4930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:16 2022] GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 1249 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:16.635470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b646727-dd6f-4013-b1e7-4af0f32cf855 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:16.636005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b646727-dd6f-4013-b1e7-4af0f32cf855 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:16.644753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b646727-dd6f-4013-b1e7-4af0f32cf855 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:16.645246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b646727-dd6f-4013-b1e7-4af0f32cf855 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:16.646236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b646727-dd6f-4013-b1e7-4af0f32cf855 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:16.646687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b646727-dd6f-4013-b1e7-4af0f32cf855 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:16.679151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b646727-dd6f-4013-b1e7-4af0f32cf855 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:18:16.788377 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b646727-dd6f-4013-b1e7-4af0f32cf855 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 204 len: 0 microversion: 2.1 time: 0.157192 Mar 12 21:18:16.794048 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4163/4931] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:18:16 2022] DELETE /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:18:16.801687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fd0ee0ce-7fdc-4036-bce5-9a58fe94c98b req-2160a466-95b6-4e48-8395-922ef2c681e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0580517f-a6d7-45c0-a8f4-b9a00ae9891b", "tag": "6a9222df-2390-4790-b296-bd3aa877fefc"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:16.812243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fd0ee0ce-7fdc-4036-bce5-9a58fe94c98b req-2160a466-95b6-4e48-8395-922ef2c681e5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:16.812845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fd0ee0ce-7fdc-4036-bce5-9a58fe94c98b req-2160a466-95b6-4e48-8395-922ef2c681e5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:16.852298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fd0ee0ce-7fdc-4036-bce5-9a58fe94c98b req-2160a466-95b6-4e48-8395-922ef2c681e5 service nova] Creating event network-changed:6a9222df-2390-4790-b296-bd3aa877fefc for instance 0580517f-a6d7-45c0-a8f4-b9a00ae9891b on nch1-master-1 Mar 12 21:18:16.865560 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fd0ee0ce-7fdc-4036-bce5-9a58fe94c98b req-2160a466-95b6-4e48-8395-922ef2c681e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069788 Mar 12 21:18:16.866765 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4164/4932] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:18:16.873522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fc81d2e3-b28c-4e40-b707-8bb3099c7cbd tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:16.874428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fc81d2e3-b28c-4e40-b707-8bb3099c7cbd tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:16.892740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc81d2e3-b28c-4e40-b707-8bb3099c7cbd tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:16.893141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc81d2e3-b28c-4e40-b707-8bb3099c7cbd tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:16.894496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc81d2e3-b28c-4e40-b707-8bb3099c7cbd tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:16.895041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc81d2e3-b28c-4e40-b707-8bb3099c7cbd tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:17.169153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fc81d2e3-b28c-4e40-b707-8bb3099c7cbd tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:17.180424 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fc81d2e3-b28c-4e40-b707-8bb3099c7cbd tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1766 microversion: 2.1 time: 0.312258 Mar 12 21:18:17.182625 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4165/4933] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:16 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1766 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:17.230125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fbd50e4f-887f-4703-b23c-71b167a3a0e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:17.232092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fbd50e4f-887f-4703-b23c-71b167a3a0e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:17.251467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbd50e4f-887f-4703-b23c-71b167a3a0e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:17.253365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbd50e4f-887f-4703-b23c-71b167a3a0e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:17.254748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbd50e4f-887f-4703-b23c-71b167a3a0e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:17.255995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbd50e4f-887f-4703-b23c-71b167a3a0e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:17.518074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fbd50e4f-887f-4703-b23c-71b167a3a0e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:17.526513 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fbd50e4f-887f-4703-b23c-71b167a3a0e2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.308196 Mar 12 21:18:17.527849 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4166/4934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:17 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:17.532597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-78f31ca3-258b-4380-9f43-241e970f171b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:17.533490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-78f31ca3-258b-4380-9f43-241e970f171b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:17.541060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78f31ca3-258b-4380-9f43-241e970f171b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:17.541973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78f31ca3-258b-4380-9f43-241e970f171b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:17.542992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78f31ca3-258b-4380-9f43-241e970f171b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:17.543631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78f31ca3-258b-4380-9f43-241e970f171b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:17.651182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-78f31ca3-258b-4380-9f43-241e970f171b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:17.660067 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-78f31ca3-258b-4380-9f43-241e970f171b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 200 len: 1307 microversion: 2.1 time: 0.131368 Mar 12 21:18:17.661034 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4167/4935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:17 2022] GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 1307 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:18.201340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e1fd414-ea02-4b45-9e04-fb28db4deecf tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:18.202810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e1fd414-ea02-4b45-9e04-fb28db4deecf tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:18.209867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e1fd414-ea02-4b45-9e04-fb28db4deecf tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:18.210428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e1fd414-ea02-4b45-9e04-fb28db4deecf tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:18.211574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e1fd414-ea02-4b45-9e04-fb28db4deecf tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:18.212156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e1fd414-ea02-4b45-9e04-fb28db4deecf tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:18.425929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8e1fd414-ea02-4b45-9e04-fb28db4deecf tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:18.443893 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8e1fd414-ea02-4b45-9e04-fb28db4deecf tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1647 microversion: 2.1 time: 0.247803 Mar 12 21:18:18.444499 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4168/4936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:18 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1647 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:18.543648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb0525d4-387e-4c20-af96-57917b325095 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:18.544370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fb0525d4-387e-4c20-af96-57917b325095 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:18.552319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb0525d4-387e-4c20-af96-57917b325095 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:18.552883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb0525d4-387e-4c20-af96-57917b325095 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:18.554059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb0525d4-387e-4c20-af96-57917b325095 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:18.554526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb0525d4-387e-4c20-af96-57917b325095 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:18.829310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fb0525d4-387e-4c20-af96-57917b325095 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:18.837471 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb0525d4-387e-4c20-af96-57917b325095 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.297838 Mar 12 21:18:18.838653 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4169/4937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:18 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:18.851941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-18a70096-e43c-47b6-a5b1-5ef45fd43525 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:18.852848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-18a70096-e43c-47b6-a5b1-5ef45fd43525 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:18.863767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18a70096-e43c-47b6-a5b1-5ef45fd43525 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:18.864248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18a70096-e43c-47b6-a5b1-5ef45fd43525 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:18.865064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18a70096-e43c-47b6-a5b1-5ef45fd43525 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:18.865746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18a70096-e43c-47b6-a5b1-5ef45fd43525 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:19.495806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-18a70096-e43c-47b6-a5b1-5ef45fd43525 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:19.505029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-18a70096-e43c-47b6-a5b1-5ef45fd43525 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 200 len: 1375 microversion: 2.1 time: 0.664737 Mar 12 21:18:19.505558 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4170/4938] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:18 2022] GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 1375 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:19.510431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d25d4443-6ce7-40c9-8337-40fe74221654 req-33afa052-0c05-4dc3-97b5-34e4c2d387d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29cf4e73-7932-4ca9-bda4-067dc4ab587d", "tag": "c7de3107-5a64-4811-93a7-c850e1c66b22"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:19.522560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d25d4443-6ce7-40c9-8337-40fe74221654 req-33afa052-0c05-4dc3-97b5-34e4c2d387d7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:19.523037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d25d4443-6ce7-40c9-8337-40fe74221654 req-33afa052-0c05-4dc3-97b5-34e4c2d387d7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:19.535357 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d25d4443-6ce7-40c9-8337-40fe74221654 req-33afa052-0c05-4dc3-97b5-34e4c2d387d7 service nova] Creating event network-changed:c7de3107-5a64-4811-93a7-c850e1c66b22 for instance 29cf4e73-7932-4ca9-bda4-067dc4ab587d on nch2-master-1 Mar 12 21:18:19.540493 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d25d4443-6ce7-40c9-8337-40fe74221654 req-33afa052-0c05-4dc3-97b5-34e4c2d387d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033580 Mar 12 21:18:19.542875 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4171/4939] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:18:19.549546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4082422c-e3f4-4895-b9f7-31866e3af59d tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:19.550297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4082422c-e3f4-4895-b9f7-31866e3af59d tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:19.556864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4082422c-e3f4-4895-b9f7-31866e3af59d tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:19.557338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4082422c-e3f4-4895-b9f7-31866e3af59d tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:19.558162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4082422c-e3f4-4895-b9f7-31866e3af59d tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:19.558628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4082422c-e3f4-4895-b9f7-31866e3af59d tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:19.639075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4082422c-e3f4-4895-b9f7-31866e3af59d tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0060aa19407c4b7fb35e11846e467dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c756a4ad07449182f9786c376ed0f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:19.647004 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4082422c-e3f4-4895-b9f7-31866e3af59d tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 200 len: 1378 microversion: 2.1 time: 0.102669 Mar 12 21:18:19.647584 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4172/4940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:19 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 1378 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:19.653141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2d706fb1-f06a-41fd-ae30-933f6668b219 req-47353870-8341-412b-b435-1069f19931df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0580517f-a6d7-45c0-a8f4-b9a00ae9891b", "name": "network-vif-deleted", "tag": "6a9222df-2390-4790-b296-bd3aa877fefc"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:19.661042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2d706fb1-f06a-41fd-ae30-933f6668b219 req-47353870-8341-412b-b435-1069f19931df service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:19.661445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2d706fb1-f06a-41fd-ae30-933f6668b219 req-47353870-8341-412b-b435-1069f19931df service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:19.673093 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2d706fb1-f06a-41fd-ae30-933f6668b219 req-47353870-8341-412b-b435-1069f19931df service nova] Creating event network-vif-deleted:6a9222df-2390-4790-b296-bd3aa877fefc for instance 0580517f-a6d7-45c0-a8f4-b9a00ae9891b on nch1-master-1 Mar 12 21:18:19.678158 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2d706fb1-f06a-41fd-ae30-933f6668b219 req-47353870-8341-412b-b435-1069f19931df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029390 Mar 12 21:18:19.678925 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4173/4941] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:18:19.864988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-88acf9c6-8edf-4f58-85d3-e307fe98359f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:19.865720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-88acf9c6-8edf-4f58-85d3-e307fe98359f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:19.875303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88acf9c6-8edf-4f58-85d3-e307fe98359f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:19.875905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88acf9c6-8edf-4f58-85d3-e307fe98359f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:19.876917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88acf9c6-8edf-4f58-85d3-e307fe98359f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:19.877632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88acf9c6-8edf-4f58-85d3-e307fe98359f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:20.067835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-88acf9c6-8edf-4f58-85d3-e307fe98359f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:20.076753 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-88acf9c6-8edf-4f58-85d3-e307fe98359f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.226415 Mar 12 21:18:20.077364 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4174/4942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:19 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:20.522220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a507fff-9d4e-4928-9cc7-fad2bbd1fe36 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:20.522880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a507fff-9d4e-4928-9cc7-fad2bbd1fe36 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:20.529682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a507fff-9d4e-4928-9cc7-fad2bbd1fe36 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:20.530178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a507fff-9d4e-4928-9cc7-fad2bbd1fe36 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:20.530958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a507fff-9d4e-4928-9cc7-fad2bbd1fe36 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:20.531409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a507fff-9d4e-4928-9cc7-fad2bbd1fe36 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:20.669389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8a507fff-9d4e-4928-9cc7-fad2bbd1fe36 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:20.677090 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a507fff-9d4e-4928-9cc7-fad2bbd1fe36 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 200 len: 1375 microversion: 2.1 time: 0.158750 Mar 12 21:18:20.677668 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4175/4943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:20 2022] GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:20.682671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5975f87c-9091-413e-a7a6-15b7d508a54a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:20.683297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5975f87c-9091-413e-a7a6-15b7d508a54a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] [instance: 0580517f-a6d7-45c0-a8f4-b9a00ae9891b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:20.688734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5975f87c-9091-413e-a7a6-15b7d508a54a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:20.689208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5975f87c-9091-413e-a7a6-15b7d508a54a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:20.690030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5975f87c-9091-413e-a7a6-15b7d508a54a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:20.690490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5975f87c-9091-413e-a7a6-15b7d508a54a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:20.703781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-5975f87c-9091-413e-a7a6-15b7d508a54a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] HTTP exception thrown: Instance 0580517f-a6d7-45c0-a8f4-b9a00ae9891b could not be found. Mar 12 21:18:20.704382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5975f87c-9091-413e-a7a6-15b7d508a54a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Returning 404 to user: Instance 0580517f-a6d7-45c0-a8f4-b9a00ae9891b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:20.705211 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5975f87c-9091-413e-a7a6-15b7d508a54a tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b" status: 404 len: 111 microversion: 2.1 time: 0.026567 Mar 12 21:18:20.705744 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4176/4944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:20 2022] GET /compute/v2.1/servers/0580517f-a6d7-45c0-a8f4-b9a00ae9891b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:18:21.094862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-31cb96ca-772c-4d12-be84-f405f125dfa2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:21.095604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-31cb96ca-772c-4d12-be84-f405f125dfa2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:21.101829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31cb96ca-772c-4d12-be84-f405f125dfa2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:21.102390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31cb96ca-772c-4d12-be84-f405f125dfa2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:21.103432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31cb96ca-772c-4d12-be84-f405f125dfa2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:21.104633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31cb96ca-772c-4d12-be84-f405f125dfa2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:21.247265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-31cb96ca-772c-4d12-be84-f405f125dfa2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:21.255069 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-31cb96ca-772c-4d12-be84-f405f125dfa2 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.164474 Mar 12 21:18:21.255864 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4177/4945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:21 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:21.695013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b2a761bb-18ee-42a7-b0b5-f5839cb90787 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:21.695791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b2a761bb-18ee-42a7-b0b5-f5839cb90787 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:21.702799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2a761bb-18ee-42a7-b0b5-f5839cb90787 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:21.703278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2a761bb-18ee-42a7-b0b5-f5839cb90787 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:21.704072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2a761bb-18ee-42a7-b0b5-f5839cb90787 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:21.704536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2a761bb-18ee-42a7-b0b5-f5839cb90787 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:21.839799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b2a761bb-18ee-42a7-b0b5-f5839cb90787 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:21.847226 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b2a761bb-18ee-42a7-b0b5-f5839cb90787 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 200 len: 1375 microversion: 2.1 time: 0.156304 Mar 12 21:18:21.847842 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4178/4946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:21 2022] GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:22.272214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b1a859bf-57f0-4eb0-a3cd-3aae10910e87 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:22.272852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b1a859bf-57f0-4eb0-a3cd-3aae10910e87 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:22.279292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1a859bf-57f0-4eb0-a3cd-3aae10910e87 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:22.279762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1a859bf-57f0-4eb0-a3cd-3aae10910e87 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:22.280553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1a859bf-57f0-4eb0-a3cd-3aae10910e87 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:22.281014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1a859bf-57f0-4eb0-a3cd-3aae10910e87 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:22.414792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b1a859bf-57f0-4eb0-a3cd-3aae10910e87 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:22.422226 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b1a859bf-57f0-4eb0-a3cd-3aae10910e87 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.153965 Mar 12 21:18:22.423072 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4179/4947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:22 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:22.866406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-45b7f408-18ac-4ce5-9067-a032bcc82e23 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:22.867065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-45b7f408-18ac-4ce5-9067-a032bcc82e23 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:22.878124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45b7f408-18ac-4ce5-9067-a032bcc82e23 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:22.885815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45b7f408-18ac-4ce5-9067-a032bcc82e23 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:22.885815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45b7f408-18ac-4ce5-9067-a032bcc82e23 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:22.885815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45b7f408-18ac-4ce5-9067-a032bcc82e23 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:23.082330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-45b7f408-18ac-4ce5-9067-a032bcc82e23 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:23.095032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-45b7f408-18ac-4ce5-9067-a032bcc82e23 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 200 len: 1375 microversion: 2.1 time: 0.234720 Mar 12 21:18:23.106945 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4180/4948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:22 2022] GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 1375 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:23.316801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c5a4a4bb-3af8-4875-a8e7-11793a36df2d req-d0851229-1961-4c3b-afc8-a26e259f3c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29cf4e73-7932-4ca9-bda4-067dc4ab587d", "name": "network-vif-plugged", "status": "completed", "tag": "c7de3107-5a64-4811-93a7-c850e1c66b22"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:23.327349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c5a4a4bb-3af8-4875-a8e7-11793a36df2d req-d0851229-1961-4c3b-afc8-a26e259f3c20 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:23.327951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c5a4a4bb-3af8-4875-a8e7-11793a36df2d req-d0851229-1961-4c3b-afc8-a26e259f3c20 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:23.342227 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c5a4a4bb-3af8-4875-a8e7-11793a36df2d req-d0851229-1961-4c3b-afc8-a26e259f3c20 service nova] Creating event network-vif-plugged:c7de3107-5a64-4811-93a7-c850e1c66b22 for instance 29cf4e73-7932-4ca9-bda4-067dc4ab587d on nch2-master-1 Mar 12 21:18:23.348077 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c5a4a4bb-3af8-4875-a8e7-11793a36df2d req-d0851229-1961-4c3b-afc8-a26e259f3c20 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035425 Mar 12 21:18:23.349009 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4181/4949] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:18:23.440191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d41f0c69-8bf9-4a9c-ad64-6e1146078de9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:23.441089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d41f0c69-8bf9-4a9c-ad64-6e1146078de9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:23.447389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d41f0c69-8bf9-4a9c-ad64-6e1146078de9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:23.448066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d41f0c69-8bf9-4a9c-ad64-6e1146078de9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:23.448859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d41f0c69-8bf9-4a9c-ad64-6e1146078de9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:23.449311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d41f0c69-8bf9-4a9c-ad64-6e1146078de9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:23.592587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d41f0c69-8bf9-4a9c-ad64-6e1146078de9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:23.600372 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d41f0c69-8bf9-4a9c-ad64-6e1146078de9 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.164604 Mar 12 21:18:23.600968 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4182/4950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:23 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:24.112595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7757e6c-6c6d-4d24-94a2-c9eef29d0c6e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:24.113274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f7757e6c-6c6d-4d24-94a2-c9eef29d0c6e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:24.120202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7757e6c-6c6d-4d24-94a2-c9eef29d0c6e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:24.120670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7757e6c-6c6d-4d24-94a2-c9eef29d0c6e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:24.121460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7757e6c-6c6d-4d24-94a2-c9eef29d0c6e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:24.121950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7757e6c-6c6d-4d24-94a2-c9eef29d0c6e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:24.262576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f7757e6c-6c6d-4d24-94a2-c9eef29d0c6e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:24.272030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f7757e6c-6c6d-4d24-94a2-c9eef29d0c6e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 200 len: 1375 microversion: 2.1 time: 0.163336 Mar 12 21:18:24.272713 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4183/4951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:24 2022] GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:24.293616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d4ab450-fab9-4159-ab88-3e0021bc61f5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] Calling method '.version_select at 0x7f6e356a8d30>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:24.315584 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d4ab450-fab9-4159-ab88-3e0021bc61f5 tempest-TestSecurityGroupsBasicOps-521676658 tempest-TestSecurityGroupsBasicOps-521676658-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-603499308" status: 202 len: 0 microversion: 2.1 time: 0.028200 Mar 12 21:18:24.316183 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4184/4952] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 21:18:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-603499308 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:18:24.617050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c94a621f-70d6-4c0a-b097-7a24e0f7d7f6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:24.617681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c94a621f-70d6-4c0a-b097-7a24e0f7d7f6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:24.633785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c94a621f-70d6-4c0a-b097-7a24e0f7d7f6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:24.634235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c94a621f-70d6-4c0a-b097-7a24e0f7d7f6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:24.635638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c94a621f-70d6-4c0a-b097-7a24e0f7d7f6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:24.636195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c94a621f-70d6-4c0a-b097-7a24e0f7d7f6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:24.777022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c94a621f-70d6-4c0a-b097-7a24e0f7d7f6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:24.784553 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c94a621f-70d6-4c0a-b097-7a24e0f7d7f6 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.171684 Mar 12 21:18:24.785143 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4185/4953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:24 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:25.289887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-70cd23c4-2e52-4f87-89a7-9f2b6cca6df7 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:25.290531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-70cd23c4-2e52-4f87-89a7-9f2b6cca6df7 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:25.298240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70cd23c4-2e52-4f87-89a7-9f2b6cca6df7 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:25.298707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70cd23c4-2e52-4f87-89a7-9f2b6cca6df7 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:25.299492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70cd23c4-2e52-4f87-89a7-9f2b6cca6df7 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:25.299939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70cd23c4-2e52-4f87-89a7-9f2b6cca6df7 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:25.509450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-70cd23c4-2e52-4f87-89a7-9f2b6cca6df7 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:25.518066 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-70cd23c4-2e52-4f87-89a7-9f2b6cca6df7 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 200 len: 1548 microversion: 2.1 time: 0.232218 Mar 12 21:18:25.519014 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4186/4954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:25 2022] GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 1548 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:25.537187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c511d037-b16e-4429-b721-bd278418e146 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:25.538021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c511d037-b16e-4429-b721-bd278418e146 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:25.545164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c511d037-b16e-4429-b721-bd278418e146 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:25.545786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c511d037-b16e-4429-b721-bd278418e146 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:25.546678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c511d037-b16e-4429-b721-bd278418e146 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:25.547211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c511d037-b16e-4429-b721-bd278418e146 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:25.693608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c511d037-b16e-4429-b721-bd278418e146 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:25.701286 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c511d037-b16e-4429-b721-bd278418e146 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 200 len: 1548 microversion: 2.1 time: 0.168925 Mar 12 21:18:25.702037 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4187/4955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:25 2022] GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:25.801440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-41f3812a-f2dd-4f7a-93e8-6a0e253f4f59 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:25.802384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-41f3812a-f2dd-4f7a-93e8-6a0e253f4f59 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:25.808465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41f3812a-f2dd-4f7a-93e8-6a0e253f4f59 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:25.809012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41f3812a-f2dd-4f7a-93e8-6a0e253f4f59 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:25.810033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41f3812a-f2dd-4f7a-93e8-6a0e253f4f59 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:25.810677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41f3812a-f2dd-4f7a-93e8-6a0e253f4f59 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:26.022790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-41f3812a-f2dd-4f7a-93e8-6a0e253f4f59 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:26.031648 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-41f3812a-f2dd-4f7a-93e8-6a0e253f4f59 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.235038 Mar 12 21:18:26.032230 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4188/4956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:25 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:27.049505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aca80a9e-ad23-47ab-a5bd-4fd196a051c8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:27.050256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aca80a9e-ad23-47ab-a5bd-4fd196a051c8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:27.057544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aca80a9e-ad23-47ab-a5bd-4fd196a051c8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:27.065824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aca80a9e-ad23-47ab-a5bd-4fd196a051c8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:27.070271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aca80a9e-ad23-47ab-a5bd-4fd196a051c8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:27.078069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aca80a9e-ad23-47ab-a5bd-4fd196a051c8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:27.338835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aca80a9e-ad23-47ab-a5bd-4fd196a051c8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:27.346688 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aca80a9e-ad23-47ab-a5bd-4fd196a051c8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.301902 Mar 12 21:18:27.347495 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4189/4957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:27 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:27.595869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d871b689-f807-45b1-bf7e-375186ddbf78 req-19b3904b-9256-4036-98f2-762f2fae256a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29cf4e73-7932-4ca9-bda4-067dc4ab587d", "tag": "c7de3107-5a64-4811-93a7-c850e1c66b22"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:27.604947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d871b689-f807-45b1-bf7e-375186ddbf78 req-19b3904b-9256-4036-98f2-762f2fae256a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:27.605661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d871b689-f807-45b1-bf7e-375186ddbf78 req-19b3904b-9256-4036-98f2-762f2fae256a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:27.624093 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d871b689-f807-45b1-bf7e-375186ddbf78 req-19b3904b-9256-4036-98f2-762f2fae256a service nova] Creating event network-changed:c7de3107-5a64-4811-93a7-c850e1c66b22 for instance 29cf4e73-7932-4ca9-bda4-067dc4ab587d on nch2-master-1 Mar 12 21:18:27.632002 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d871b689-f807-45b1-bf7e-375186ddbf78 req-19b3904b-9256-4036-98f2-762f2fae256a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038549 Mar 12 21:18:27.633480 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4190/4958] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:18:28.365608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5161b72d-f342-4f4b-85c3-b30a982d2493 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:28.366881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5161b72d-f342-4f4b-85c3-b30a982d2493 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:28.375036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5161b72d-f342-4f4b-85c3-b30a982d2493 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:28.375499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5161b72d-f342-4f4b-85c3-b30a982d2493 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:28.376619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5161b72d-f342-4f4b-85c3-b30a982d2493 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:28.377078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5161b72d-f342-4f4b-85c3-b30a982d2493 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:28.553299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5161b72d-f342-4f4b-85c3-b30a982d2493 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:28.562622 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5161b72d-f342-4f4b-85c3-b30a982d2493 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.201384 Mar 12 21:18:28.563543 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4191/4959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:28 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:29.263714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1684159467", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "90f9379f-7b92-4f32-bab1-e7f1e226a014"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:29.313893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] validate_networks() for [('90f9379f-7b92-4f32-bab1-e7f1e226a014', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:18:29.644463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:18:29.645032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:18:29.645383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:18:29.645832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:18:29.646265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:18:29.655018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:29.655482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:29.656288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:29.656740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:29.673933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Getting quotas for project c2bc5ab9d272404d88c627804a2b2195. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:18:29.679191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Getting quotas for user d74876aa9a164848accb21eb850f011c and project c2bc5ab9d272404d88c627804a2b2195. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:18:29.692656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:18:29.694904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:18:29.738250 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-28fefea2-97ee-46e7-b4d0-9b2b6cfee16b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593286 Mar 12 21:18:29.738901 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4192/4960] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:18:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:18:29.749142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-258119d5-322f-4017-a72e-613bd6ba7d7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:29.749893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-258119d5-322f-4017-a72e-613bd6ba7d7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:29.756767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-258119d5-322f-4017-a72e-613bd6ba7d7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:29.757242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-258119d5-322f-4017-a72e-613bd6ba7d7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:29.758497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-258119d5-322f-4017-a72e-613bd6ba7d7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:29.761960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-258119d5-322f-4017-a72e-613bd6ba7d7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:29.925811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-258119d5-322f-4017-a72e-613bd6ba7d7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:29.939004 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-258119d5-322f-4017-a72e-613bd6ba7d7d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.193536 Mar 12 21:18:29.939892 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4193/4961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:29 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:29.945004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb354c3a-9239-4028-95fe-404d353a1291 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:29.945638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fb354c3a-9239-4028-95fe-404d353a1291 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:30.011093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fb354c3a-9239-4028-95fe-404d353a1291 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:30.020960 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb354c3a-9239-4028-95fe-404d353a1291 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1215 microversion: 2.1 time: 0.079321 Mar 12 21:18:30.022852 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4194/4962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:29 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:30.955137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d5bab3a3-5279-4284-a857-7f7c3f13372f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:30.955787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d5bab3a3-5279-4284-a857-7f7c3f13372f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:30.963273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5bab3a3-5279-4284-a857-7f7c3f13372f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:30.963735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5bab3a3-5279-4284-a857-7f7c3f13372f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:30.964512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5bab3a3-5279-4284-a857-7f7c3f13372f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:30.964957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5bab3a3-5279-4284-a857-7f7c3f13372f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:31.102051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d5bab3a3-5279-4284-a857-7f7c3f13372f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:31.109732 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d5bab3a3-5279-4284-a857-7f7c3f13372f tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.158514 Mar 12 21:18:31.115923 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4195/4963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:30 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:31.115923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9dadd2b3-ff82-4ac1-b39e-de5464ec9ca2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:31.115923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9dadd2b3-ff82-4ac1-b39e-de5464ec9ca2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:31.122063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9dadd2b3-ff82-4ac1-b39e-de5464ec9ca2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:31.122524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9dadd2b3-ff82-4ac1-b39e-de5464ec9ca2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:31.123301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9dadd2b3-ff82-4ac1-b39e-de5464ec9ca2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:31.123758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9dadd2b3-ff82-4ac1-b39e-de5464ec9ca2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:31.190315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9dadd2b3-ff82-4ac1-b39e-de5464ec9ca2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:31.197947 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9dadd2b3-ff82-4ac1-b39e-de5464ec9ca2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1273 microversion: 2.1 time: 0.086327 Mar 12 21:18:31.199286 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4196/4964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:31 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:32.029459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8f97ec04-700f-48f1-9e0d-ab859603fe53 req-cb40cb0a-3085-4d83-8966-7056346fc769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2f879e9-c561-471f-a2f9-88c919468351", "tag": "3e12ca66-bb04-4c07-a876-382b7fa4b46f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:32.040116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8f97ec04-700f-48f1-9e0d-ab859603fe53 req-cb40cb0a-3085-4d83-8966-7056346fc769 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:32.042047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8f97ec04-700f-48f1-9e0d-ab859603fe53 req-cb40cb0a-3085-4d83-8966-7056346fc769 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:32.055860 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8f97ec04-700f-48f1-9e0d-ab859603fe53 req-cb40cb0a-3085-4d83-8966-7056346fc769 service nova] Creating event network-changed:3e12ca66-bb04-4c07-a876-382b7fa4b46f for instance d2f879e9-c561-471f-a2f9-88c919468351 on nch2-master-1 Mar 12 21:18:32.061380 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8f97ec04-700f-48f1-9e0d-ab859603fe53 req-cb40cb0a-3085-4d83-8966-7056346fc769 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035533 Mar 12 21:18:32.062193 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4197/4965] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:18:32.128039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4e16d146-be33-418d-a00f-909919f75ab5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:32.129003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4e16d146-be33-418d-a00f-909919f75ab5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:32.135211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e16d146-be33-418d-a00f-909919f75ab5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:32.135680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e16d146-be33-418d-a00f-909919f75ab5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:32.136462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e16d146-be33-418d-a00f-909919f75ab5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:32.136909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e16d146-be33-418d-a00f-909919f75ab5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:32.272879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4e16d146-be33-418d-a00f-909919f75ab5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:32.281001 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4e16d146-be33-418d-a00f-909919f75ab5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.157439 Mar 12 21:18:32.281589 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4198/4966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:32 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:32.286149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86c7f147-40e1-4f8e-a532-e4115ae29ef7 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:32.286767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86c7f147-40e1-4f8e-a532-e4115ae29ef7 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:32.293046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86c7f147-40e1-4f8e-a532-e4115ae29ef7 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:32.293511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86c7f147-40e1-4f8e-a532-e4115ae29ef7 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:32.294323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86c7f147-40e1-4f8e-a532-e4115ae29ef7 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:32.294770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86c7f147-40e1-4f8e-a532-e4115ae29ef7 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:32.427711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86c7f147-40e1-4f8e-a532-e4115ae29ef7 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:32.437389 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86c7f147-40e1-4f8e-a532-e4115ae29ef7 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1315 microversion: 2.1 time: 0.154747 Mar 12 21:18:32.438020 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4199/4967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:32 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:33.121166 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:18:33.121678 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:18:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:18:33.297476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-76d05d3b-42ca-43df-bda4-5268eeb7c626 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:33.298132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-76d05d3b-42ca-43df-bda4-5268eeb7c626 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:33.304906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76d05d3b-42ca-43df-bda4-5268eeb7c626 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:33.305371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76d05d3b-42ca-43df-bda4-5268eeb7c626 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:33.306694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76d05d3b-42ca-43df-bda4-5268eeb7c626 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:33.307146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76d05d3b-42ca-43df-bda4-5268eeb7c626 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:33.437546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-76d05d3b-42ca-43df-bda4-5268eeb7c626 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:33.446012 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-76d05d3b-42ca-43df-bda4-5268eeb7c626 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.152668 Mar 12 21:18:33.446602 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4200/4968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:33 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:33.453891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e1c081dc-fa15-43c2-8f6b-6fe4d1d090d0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:33.454594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e1c081dc-fa15-43c2-8f6b-6fe4d1d090d0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:33.460335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1c081dc-fa15-43c2-8f6b-6fe4d1d090d0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:33.460800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1c081dc-fa15-43c2-8f6b-6fe4d1d090d0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:33.461582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1c081dc-fa15-43c2-8f6b-6fe4d1d090d0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:33.462060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1c081dc-fa15-43c2-8f6b-6fe4d1d090d0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:33.594223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e1c081dc-fa15-43c2-8f6b-6fe4d1d090d0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:33.601511 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e1c081dc-fa15-43c2-8f6b-6fe4d1d090d0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1315 microversion: 2.1 time: 0.151473 Mar 12 21:18:33.602117 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4201/4969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:33 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:34.464023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7073ccd0-3848-4976-be89-d44ff49537d7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:34.464676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7073ccd0-3848-4976-be89-d44ff49537d7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:34.471607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7073ccd0-3848-4976-be89-d44ff49537d7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:34.472073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7073ccd0-3848-4976-be89-d44ff49537d7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:34.472844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7073ccd0-3848-4976-be89-d44ff49537d7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:34.473294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7073ccd0-3848-4976-be89-d44ff49537d7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:34.602379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7073ccd0-3848-4976-be89-d44ff49537d7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:34.609726 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7073ccd0-3848-4976-be89-d44ff49537d7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.150343 Mar 12 21:18:34.610334 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4202/4970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:34 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:34.618255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9051273e-b2af-477b-8a8c-b5589fefa5cb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:34.619454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9051273e-b2af-477b-8a8c-b5589fefa5cb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:34.625059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9051273e-b2af-477b-8a8c-b5589fefa5cb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:34.625530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9051273e-b2af-477b-8a8c-b5589fefa5cb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:34.626347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9051273e-b2af-477b-8a8c-b5589fefa5cb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:34.626804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9051273e-b2af-477b-8a8c-b5589fefa5cb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:34.761837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9051273e-b2af-477b-8a8c-b5589fefa5cb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:34.769157 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9051273e-b2af-477b-8a8c-b5589fefa5cb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1315 microversion: 2.1 time: 0.154510 Mar 12 21:18:34.769735 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4203/4971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:34 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:35.574553 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:18:35.575098 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:18:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:18:35.627547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bde9eb9b-6089-4ce3-9178-04a327c92fb8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:35.628179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bde9eb9b-6089-4ce3-9178-04a327c92fb8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:35.635523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bde9eb9b-6089-4ce3-9178-04a327c92fb8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:35.635991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bde9eb9b-6089-4ce3-9178-04a327c92fb8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:35.636774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bde9eb9b-6089-4ce3-9178-04a327c92fb8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:35.637230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bde9eb9b-6089-4ce3-9178-04a327c92fb8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:35.768481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bde9eb9b-6089-4ce3-9178-04a327c92fb8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:35.776659 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bde9eb9b-6089-4ce3-9178-04a327c92fb8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.153076 Mar 12 21:18:35.777250 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4204/4972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:35 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:35.785357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9694b690-a83b-447e-951c-c3eef315782f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:35.786021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9694b690-a83b-447e-951c-c3eef315782f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:35.791909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9694b690-a83b-447e-951c-c3eef315782f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:35.792379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9694b690-a83b-447e-951c-c3eef315782f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:35.793160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9694b690-a83b-447e-951c-c3eef315782f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:35.793624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9694b690-a83b-447e-951c-c3eef315782f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:35.924576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9694b690-a83b-447e-951c-c3eef315782f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:35.931939 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9694b690-a83b-447e-951c-c3eef315782f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1315 microversion: 2.1 time: 0.150256 Mar 12 21:18:35.932525 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4205/4973] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:35 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:36.795047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-36a73b51-be00-4e97-8129-af34ba223061 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:36.795810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-36a73b51-be00-4e97-8129-af34ba223061 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:36.803102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36a73b51-be00-4e97-8129-af34ba223061 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:36.803573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36a73b51-be00-4e97-8129-af34ba223061 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:36.804376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36a73b51-be00-4e97-8129-af34ba223061 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:36.804830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36a73b51-be00-4e97-8129-af34ba223061 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:36.948389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-36a73b51-be00-4e97-8129-af34ba223061 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:36.955819 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-36a73b51-be00-4e97-8129-af34ba223061 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.165360 Mar 12 21:18:36.956391 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4206/4974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:36 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:36.960925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c6b11eb0-454c-4587-a607-8f693e6c0d83 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:36.961545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c6b11eb0-454c-4587-a607-8f693e6c0d83 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:36.967540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6b11eb0-454c-4587-a607-8f693e6c0d83 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:36.968008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6b11eb0-454c-4587-a607-8f693e6c0d83 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:36.968791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6b11eb0-454c-4587-a607-8f693e6c0d83 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:36.969247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6b11eb0-454c-4587-a607-8f693e6c0d83 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:37.105710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c6b11eb0-454c-4587-a607-8f693e6c0d83 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:37.113186 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c6b11eb0-454c-4587-a607-8f693e6c0d83 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1315 microversion: 2.1 time: 0.155832 Mar 12 21:18:37.113811 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4207/4975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:36 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:37.197940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fe181803-5ed1-4018-a0f6-07d6d90df3a5 req-eca1856c-544a-4eb8-aa19-5054fe51dfad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f879e9-c561-471f-a2f9-88c919468351", "name": "network-vif-plugged", "status": "completed", "tag": "3e12ca66-bb04-4c07-a876-382b7fa4b46f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:37.206362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fe181803-5ed1-4018-a0f6-07d6d90df3a5 req-eca1856c-544a-4eb8-aa19-5054fe51dfad service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:37.206826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fe181803-5ed1-4018-a0f6-07d6d90df3a5 req-eca1856c-544a-4eb8-aa19-5054fe51dfad service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:37.218766 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fe181803-5ed1-4018-a0f6-07d6d90df3a5 req-eca1856c-544a-4eb8-aa19-5054fe51dfad service nova] Creating event network-vif-plugged:3e12ca66-bb04-4c07-a876-382b7fa4b46f for instance d2f879e9-c561-471f-a2f9-88c919468351 on nch2-master-1 Mar 12 21:18:37.223534 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fe181803-5ed1-4018-a0f6-07d6d90df3a5 req-eca1856c-544a-4eb8-aa19-5054fe51dfad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030004 Mar 12 21:18:37.224134 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4208/4976] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:18:37.973911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ce085bc-d7c5-4c37-9fc7-b3d6f9a8010c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:37.974635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ce085bc-d7c5-4c37-9fc7-b3d6f9a8010c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:37.980833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ce085bc-d7c5-4c37-9fc7-b3d6f9a8010c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:37.981298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ce085bc-d7c5-4c37-9fc7-b3d6f9a8010c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:37.982111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ce085bc-d7c5-4c37-9fc7-b3d6f9a8010c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:37.982566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ce085bc-d7c5-4c37-9fc7-b3d6f9a8010c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:38.117219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6ce085bc-d7c5-4c37-9fc7-b3d6f9a8010c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:38.124949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ce085bc-d7c5-4c37-9fc7-b3d6f9a8010c tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.156189 Mar 12 21:18:38.125534 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4209/4977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:37 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:38.130410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71eb54ca-dc54-4991-81a6-ef1abe47891e tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:38.131025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71eb54ca-dc54-4991-81a6-ef1abe47891e tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:38.137504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71eb54ca-dc54-4991-81a6-ef1abe47891e tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:38.138078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71eb54ca-dc54-4991-81a6-ef1abe47891e tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:38.138858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71eb54ca-dc54-4991-81a6-ef1abe47891e tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:38.139312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71eb54ca-dc54-4991-81a6-ef1abe47891e tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:38.271761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-71eb54ca-dc54-4991-81a6-ef1abe47891e tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:38.279094 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71eb54ca-dc54-4991-81a6-ef1abe47891e tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1315 microversion: 2.1 time: 0.152585 Mar 12 21:18:38.279676 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4210/4978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:38 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:39.145961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-069aa2ea-cf06-40c4-a2f8-68bd8611353e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:39.146565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-069aa2ea-cf06-40c4-a2f8-68bd8611353e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:39.153849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-069aa2ea-cf06-40c4-a2f8-68bd8611353e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:39.154314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-069aa2ea-cf06-40c4-a2f8-68bd8611353e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:39.155106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-069aa2ea-cf06-40c4-a2f8-68bd8611353e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:39.155556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-069aa2ea-cf06-40c4-a2f8-68bd8611353e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:39.292075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-069aa2ea-cf06-40c4-a2f8-68bd8611353e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:39.300009 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-069aa2ea-cf06-40c4-a2f8-68bd8611353e tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1512 microversion: 2.1 time: 0.158627 Mar 12 21:18:39.300587 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4211/4979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:39 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:39.305177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dedc7678-a457-4d8b-9bc2-114420a6b8d3 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:39.305811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dedc7678-a457-4d8b-9bc2-114420a6b8d3 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:39.311897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dedc7678-a457-4d8b-9bc2-114420a6b8d3 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:39.312427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dedc7678-a457-4d8b-9bc2-114420a6b8d3 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:39.313262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dedc7678-a457-4d8b-9bc2-114420a6b8d3 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:39.313713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dedc7678-a457-4d8b-9bc2-114420a6b8d3 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:39.445763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dedc7678-a457-4d8b-9bc2-114420a6b8d3 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:39.453686 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dedc7678-a457-4d8b-9bc2-114420a6b8d3 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1501 microversion: 2.1 time: 0.152150 Mar 12 21:18:39.454304 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4212/4980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:39 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:39.469714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2fbdcb3-cebb-48d8-82f7-34842bff6748 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:39.470361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2fbdcb3-cebb-48d8-82f7-34842bff6748 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:39.475998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2fbdcb3-cebb-48d8-82f7-34842bff6748 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:39.476463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2fbdcb3-cebb-48d8-82f7-34842bff6748 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:39.477240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2fbdcb3-cebb-48d8-82f7-34842bff6748 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:39.477692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2fbdcb3-cebb-48d8-82f7-34842bff6748 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:39.610788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f2fbdcb3-cebb-48d8-82f7-34842bff6748 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:39.618179 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2fbdcb3-cebb-48d8-82f7-34842bff6748 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1501 microversion: 2.1 time: 0.152085 Mar 12 21:18:39.618781 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4213/4981] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:39 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:39.634763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-84017e7b-0038-496f-b3ba-730982d0ad13 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:39.635310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-84017e7b-0038-496f-b3ba-730982d0ad13 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:39.640976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84017e7b-0038-496f-b3ba-730982d0ad13 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:39.641438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84017e7b-0038-496f-b3ba-730982d0ad13 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:39.642244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84017e7b-0038-496f-b3ba-730982d0ad13 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:39.642723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84017e7b-0038-496f-b3ba-730982d0ad13 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:39.664927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-84017e7b-0038-496f-b3ba-730982d0ad13 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lazy-loading 'flavor' on Instance uuid d2f879e9-c561-471f-a2f9-88c919468351 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:18:39.728585 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-84017e7b-0038-496f-b3ba-730982d0ad13 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "POST /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351/action" status: 202 len: 0 microversion: 2.1 time: 0.097939 Mar 12 21:18:39.729231 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4214/4982] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:18:39 2022] POST /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:18:39.738352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a3120613-de28-4ac1-b222-2672f723226f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:39.739077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a3120613-de28-4ac1-b222-2672f723226f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:39.746483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3120613-de28-4ac1-b222-2672f723226f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:39.747016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3120613-de28-4ac1-b222-2672f723226f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:39.747851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3120613-de28-4ac1-b222-2672f723226f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:39.748312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3120613-de28-4ac1-b222-2672f723226f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:39.887489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a3120613-de28-4ac1-b222-2672f723226f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:39.895289 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a3120613-de28-4ac1-b222-2672f723226f tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1509 microversion: 2.1 time: 0.161168 Mar 12 21:18:39.895863 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4215/4983] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:39 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:40.316592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd470696-752c-4ee8-bf6e-d7cc32f921c4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:40.317347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dd470696-752c-4ee8-bf6e-d7cc32f921c4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:40.326317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd470696-752c-4ee8-bf6e-d7cc32f921c4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:40.326782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd470696-752c-4ee8-bf6e-d7cc32f921c4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:40.327607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd470696-752c-4ee8-bf6e-d7cc32f921c4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:40.328061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd470696-752c-4ee8-bf6e-d7cc32f921c4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:40.459396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dd470696-752c-4ee8-bf6e-d7cc32f921c4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:40.466719 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd470696-752c-4ee8-bf6e-d7cc32f921c4 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1489 microversion: 2.1 time: 0.154192 Mar 12 21:18:40.467299 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4216/4984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:40 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1489 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:40.482475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-42ea9ab2-734d-4898-a9cf-94dddbbc6849 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2086118344"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:40.483635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-42ea9ab2-734d-4898-a9cf-94dddbbc6849 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:40.489270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42ea9ab2-734d-4898-a9cf-94dddbbc6849 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:40.489692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42ea9ab2-734d-4898-a9cf-94dddbbc6849 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:40.490582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42ea9ab2-734d-4898-a9cf-94dddbbc6849 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:40.491035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42ea9ab2-734d-4898-a9cf-94dddbbc6849 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:40.551656 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-42ea9ab2-734d-4898-a9cf-94dddbbc6849 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "PUT /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1062 microversion: 2.1 time: 0.072662 Mar 12 21:18:40.552276 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4217/4985] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Mar 12 21:18:40 2022] PUT /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1062 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:40.565290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7a74831e-3afe-443e-849a-e5ee00369861 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:40.565955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7a74831e-3afe-443e-849a-e5ee00369861 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:40.571862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a74831e-3afe-443e-849a-e5ee00369861 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:40.572270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a74831e-3afe-443e-849a-e5ee00369861 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:40.573056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a74831e-3afe-443e-849a-e5ee00369861 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:40.573513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a74831e-3afe-443e-849a-e5ee00369861 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:40.706110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7a74831e-3afe-443e-849a-e5ee00369861 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:40.713974 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7a74831e-3afe-443e-849a-e5ee00369861 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1489 microversion: 2.1 time: 0.152212 Mar 12 21:18:40.714542 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4218/4986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:40 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1489 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:40.729479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2266a81-260a-43b9-8272-8de2baebd263 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:40.730126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2266a81-260a-43b9-8272-8de2baebd263 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:40.735742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2266a81-260a-43b9-8272-8de2baebd263 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:40.736209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2266a81-260a-43b9-8272-8de2baebd263 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:40.736983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2266a81-260a-43b9-8272-8de2baebd263 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:40.737430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2266a81-260a-43b9-8272-8de2baebd263 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:40.868568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f2266a81-260a-43b9-8272-8de2baebd263 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:40.876072 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2266a81-260a-43b9-8272-8de2baebd263 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1489 microversion: 2.1 time: 0.150716 Mar 12 21:18:40.876648 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4219/4987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:40 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1489 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:40.892436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9310683f-f837-4883-8a24-43e73260f013 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:40.892998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9310683f-f837-4883-8a24-43e73260f013 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:40.898756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9310683f-f837-4883-8a24-43e73260f013 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:40.899225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9310683f-f837-4883-8a24-43e73260f013 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:40.900577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9310683f-f837-4883-8a24-43e73260f013 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:40.901038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9310683f-f837-4883-8a24-43e73260f013 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:40.924912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9310683f-f837-4883-8a24-43e73260f013 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:18:40.998416 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9310683f-f837-4883-8a24-43e73260f013 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 204 len: 0 microversion: 2.1 time: 0.109055 Mar 12 21:18:40.999051 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4220/4988] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:18:40 2022] DELETE /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:18:41.005155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-05d10706-e74c-4246-845e-17362bf73b48 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:41.005924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-05d10706-e74c-4246-845e-17362bf73b48 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:41.012230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05d10706-e74c-4246-845e-17362bf73b48 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:41.012704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05d10706-e74c-4246-845e-17362bf73b48 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:41.013493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05d10706-e74c-4246-845e-17362bf73b48 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:41.013985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05d10706-e74c-4246-845e-17362bf73b48 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:41.143539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-05d10706-e74c-4246-845e-17362bf73b48 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:41.151884 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-05d10706-e74c-4246-845e-17362bf73b48 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1492 microversion: 2.1 time: 0.150980 Mar 12 21:18:41.152474 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4221/4989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:40 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1492 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:41.157092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ae4b1fe-d354-4e6d-a6a9-dc7692a72dce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:41.157721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8ae4b1fe-d354-4e6d-a6a9-dc7692a72dce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:41.163501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ae4b1fe-d354-4e6d-a6a9-dc7692a72dce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:41.163984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ae4b1fe-d354-4e6d-a6a9-dc7692a72dce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:41.164773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ae4b1fe-d354-4e6d-a6a9-dc7692a72dce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:41.165230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ae4b1fe-d354-4e6d-a6a9-dc7692a72dce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:41.297954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ae4b1fe-d354-4e6d-a6a9-dc7692a72dce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:41.305323 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ae4b1fe-d354-4e6d-a6a9-dc7692a72dce tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1495 microversion: 2.1 time: 0.151885 Mar 12 21:18:41.305923 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4222/4990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:41 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1495 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:41.311024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4271cae9-b41d-4dfc-83f6-696a5ae6c4f2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:41.311644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4271cae9-b41d-4dfc-83f6-696a5ae6c4f2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:41.317025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4271cae9-b41d-4dfc-83f6-696a5ae6c4f2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:41.317598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4271cae9-b41d-4dfc-83f6-696a5ae6c4f2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:41.318308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4271cae9-b41d-4dfc-83f6-696a5ae6c4f2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:41.318768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4271cae9-b41d-4dfc-83f6-696a5ae6c4f2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:41.384930 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4271cae9-b41d-4dfc-83f6-696a5ae6c4f2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "POST /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351/action" status: 202 len: 0 microversion: 2.1 time: 0.076578 Mar 12 21:18:41.385461 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4223/4991] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:18:41 2022] POST /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:18:41.394207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce01879b-6a37-4612-bd3c-d860c39d5536 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:41.394920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce01879b-6a37-4612-bd3c-d860c39d5536 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:41.402109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce01879b-6a37-4612-bd3c-d860c39d5536 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:41.402595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce01879b-6a37-4612-bd3c-d860c39d5536 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:41.403968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce01879b-6a37-4612-bd3c-d860c39d5536 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:41.404424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce01879b-6a37-4612-bd3c-d860c39d5536 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:41.540977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce01879b-6a37-4612-bd3c-d860c39d5536 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:41.549012 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce01879b-6a37-4612-bd3c-d860c39d5536 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1498 microversion: 2.1 time: 0.158949 Mar 12 21:18:41.549590 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4224/4992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:41 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:42.322816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abc4d074-ebe4-4d54-a1d3-3b3de030ef3d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:42.324065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-abc4d074-ebe4-4d54-a1d3-3b3de030ef3d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:42.330800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abc4d074-ebe4-4d54-a1d3-3b3de030ef3d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:42.331266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abc4d074-ebe4-4d54-a1d3-3b3de030ef3d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:42.332047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abc4d074-ebe4-4d54-a1d3-3b3de030ef3d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:42.332500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abc4d074-ebe4-4d54-a1d3-3b3de030ef3d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:42.916819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-abc4d074-ebe4-4d54-a1d3-3b3de030ef3d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:42.924615 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-abc4d074-ebe4-4d54-a1d3-3b3de030ef3d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 200 len: 1495 microversion: 2.1 time: 0.605813 Mar 12 21:18:42.925400 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4225/4993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:42 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 1495 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:42.929814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3fad8ef6-8029-4684-84cb-3b1ae9c7a881 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:42.930428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3fad8ef6-8029-4684-84cb-3b1ae9c7a881 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:42.936556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fad8ef6-8029-4684-84cb-3b1ae9c7a881 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:42.937024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fad8ef6-8029-4684-84cb-3b1ae9c7a881 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:42.937821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fad8ef6-8029-4684-84cb-3b1ae9c7a881 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:42.938275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fad8ef6-8029-4684-84cb-3b1ae9c7a881 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:43.170948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3fad8ef6-8029-4684-84cb-3b1ae9c7a881 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:43.186531 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3fad8ef6-8029-4684-84cb-3b1ae9c7a881 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1501 microversion: 2.1 time: 0.260048 Mar 12 21:18:43.187166 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4226/4994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:42 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1501 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:43.192358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-62c57253-81cb-42e0-9bff-dc4fb144a1b3 req-e6cd00e6-b96a-4ac4-8be0-f8735a446736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cf5b7f-311c-4860-b61b-53c41ba18cda", "name": "network-vif-deleted", "tag": "9ca73279-b59b-40c6-b793-0756bf60707d"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:43.200349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-62c57253-81cb-42e0-9bff-dc4fb144a1b3 req-e6cd00e6-b96a-4ac4-8be0-f8735a446736 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:43.201006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-62c57253-81cb-42e0-9bff-dc4fb144a1b3 req-e6cd00e6-b96a-4ac4-8be0-f8735a446736 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:43.212719 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-62c57253-81cb-42e0-9bff-dc4fb144a1b3 req-e6cd00e6-b96a-4ac4-8be0-f8735a446736 service nova] Creating event network-vif-deleted:9ca73279-b59b-40c6-b793-0756bf60707d for instance f5cf5b7f-311c-4860-b61b-53c41ba18cda on nch1-master-1 Mar 12 21:18:43.217603 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-62c57253-81cb-42e0-9bff-dc4fb144a1b3 req-e6cd00e6-b96a-4ac4-8be0-f8735a446736 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029164 Mar 12 21:18:43.218257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4227/4995] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:18:43.223423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0869f8df-6a9c-4b0a-8014-4a049b19ad04 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:43.224050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0869f8df-6a9c-4b0a-8014-4a049b19ad04 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:43.231437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0869f8df-6a9c-4b0a-8014-4a049b19ad04 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:43.231943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0869f8df-6a9c-4b0a-8014-4a049b19ad04 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:43.232681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0869f8df-6a9c-4b0a-8014-4a049b19ad04 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:43.233131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0869f8df-6a9c-4b0a-8014-4a049b19ad04 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:43.256814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-0869f8df-6a9c-4b0a-8014-4a049b19ad04 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lazy-loading 'flavor' on Instance uuid d2f879e9-c561-471f-a2f9-88c919468351 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:18:43.319311 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0869f8df-6a9c-4b0a-8014-4a049b19ad04 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "POST /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351/action" status: 202 len: 0 microversion: 2.1 time: 0.099080 Mar 12 21:18:43.319899 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4228/4996] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:18:43 2022] POST /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:18:43.328330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b55b5b3-cf12-4510-a3e1-4e3271c7e9d2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:43.329047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b55b5b3-cf12-4510-a3e1-4e3271c7e9d2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:43.336759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b55b5b3-cf12-4510-a3e1-4e3271c7e9d2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:43.337275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b55b5b3-cf12-4510-a3e1-4e3271c7e9d2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:43.338112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b55b5b3-cf12-4510-a3e1-4e3271c7e9d2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:43.338549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b55b5b3-cf12-4510-a3e1-4e3271c7e9d2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:43.470188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b55b5b3-cf12-4510-a3e1-4e3271c7e9d2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:43.477600 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b55b5b3-cf12-4510-a3e1-4e3271c7e9d2 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1509 microversion: 2.1 time: 0.153346 Mar 12 21:18:43.478838 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4229/4997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:43 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:43.942224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb2d0fe2-9c4a-428c-8a55-87afdfbc4ed3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:43.942850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fb2d0fe2-9c4a-428c-8a55-87afdfbc4ed3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:43.949467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb2d0fe2-9c4a-428c-8a55-87afdfbc4ed3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:43.949965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb2d0fe2-9c4a-428c-8a55-87afdfbc4ed3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:43.950754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb2d0fe2-9c4a-428c-8a55-87afdfbc4ed3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:43.951210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb2d0fe2-9c4a-428c-8a55-87afdfbc4ed3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:43.965173 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-fb2d0fe2-9c4a-428c-8a55-87afdfbc4ed3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance f5cf5b7f-311c-4860-b61b-53c41ba18cda could not be found. Mar 12 21:18:43.965792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb2d0fe2-9c4a-428c-8a55-87afdfbc4ed3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance f5cf5b7f-311c-4860-b61b-53c41ba18cda could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:43.966641 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb2d0fe2-9c4a-428c-8a55-87afdfbc4ed3 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 404 len: 111 microversion: 2.1 time: 0.028391 Mar 12 21:18:43.967186 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4230/4998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:43 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:43.981193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6d924ab4-151d-4673-a27f-26f823668336 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:43.981709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6d924ab4-151d-4673-a27f-26f823668336 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:43.987504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d924ab4-151d-4673-a27f-26f823668336 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:43.987973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d924ab4-151d-4673-a27f-26f823668336 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:43.988755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d924ab4-151d-4673-a27f-26f823668336 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:43.989209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d924ab4-151d-4673-a27f-26f823668336 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.004173 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-6d924ab4-151d-4673-a27f-26f823668336 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance f5cf5b7f-311c-4860-b61b-53c41ba18cda could not be found. Mar 12 21:18:44.004772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6d924ab4-151d-4673-a27f-26f823668336 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance f5cf5b7f-311c-4860-b61b-53c41ba18cda could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.005603 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6d924ab4-151d-4673-a27f-26f823668336 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 404 len: 111 microversion: 2.1 time: 0.028152 Mar 12 21:18:44.006159 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4231/4999] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:18:43 2022] DELETE /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.014222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fba8aa22-30ba-4812-9655-5c7d33533de5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.014865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fba8aa22-30ba-4812-9655-5c7d33533de5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: f5cf5b7f-311c-4860-b61b-53c41ba18cda] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.020440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fba8aa22-30ba-4812-9655-5c7d33533de5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.020903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fba8aa22-30ba-4812-9655-5c7d33533de5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.021672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fba8aa22-30ba-4812-9655-5c7d33533de5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.022152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fba8aa22-30ba-4812-9655-5c7d33533de5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.036737 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-fba8aa22-30ba-4812-9655-5c7d33533de5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance f5cf5b7f-311c-4860-b61b-53c41ba18cda could not be found. Mar 12 21:18:44.037343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fba8aa22-30ba-4812-9655-5c7d33533de5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance f5cf5b7f-311c-4860-b61b-53c41ba18cda could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.038238 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fba8aa22-30ba-4812-9655-5c7d33533de5 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda" status: 404 len: 111 microversion: 2.1 time: 0.027603 Mar 12 21:18:44.038800 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4232/5000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:44 2022] GET /compute/v2.1/servers/f5cf5b7f-311c-4860-b61b-53c41ba18cda => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.046811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2067633-6049-4cc7-82b5-ed0f55e22d0b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.048300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2067633-6049-4cc7-82b5-ed0f55e22d0b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.053491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2067633-6049-4cc7-82b5-ed0f55e22d0b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.054011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2067633-6049-4cc7-82b5-ed0f55e22d0b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.054802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2067633-6049-4cc7-82b5-ed0f55e22d0b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.055266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2067633-6049-4cc7-82b5-ed0f55e22d0b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.068343 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e2067633-6049-4cc7-82b5-ed0f55e22d0b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 2073e46b-263b-40ee-8c89-3d84493b3f12 could not be found. Mar 12 21:18:44.068947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2067633-6049-4cc7-82b5-ed0f55e22d0b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 2073e46b-263b-40ee-8c89-3d84493b3f12 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.069795 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2067633-6049-4cc7-82b5-ed0f55e22d0b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 404 len: 111 microversion: 2.1 time: 0.027034 Mar 12 21:18:44.070329 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4233/5001] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:18:44 2022] DELETE /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.078196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-330c058a-1caa-4ebe-90db-701b6afa1e5b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.078825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-330c058a-1caa-4ebe-90db-701b6afa1e5b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2073e46b-263b-40ee-8c89-3d84493b3f12] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.084531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-330c058a-1caa-4ebe-90db-701b6afa1e5b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.085039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-330c058a-1caa-4ebe-90db-701b6afa1e5b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.085854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-330c058a-1caa-4ebe-90db-701b6afa1e5b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.086320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-330c058a-1caa-4ebe-90db-701b6afa1e5b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.099984 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-330c058a-1caa-4ebe-90db-701b6afa1e5b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 2073e46b-263b-40ee-8c89-3d84493b3f12 could not be found. Mar 12 21:18:44.100585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-330c058a-1caa-4ebe-90db-701b6afa1e5b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 2073e46b-263b-40ee-8c89-3d84493b3f12 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.101418 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-330c058a-1caa-4ebe-90db-701b6afa1e5b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12" status: 404 len: 111 microversion: 2.1 time: 0.026747 Mar 12 21:18:44.101973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4234/5002] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:44 2022] GET /compute/v2.1/servers/2073e46b-263b-40ee-8c89-3d84493b3f12 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.109224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e57c3c4-fcbc-4c3f-a2ed-4ac62ab02b90 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.109732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5e57c3c4-fcbc-4c3f-a2ed-4ac62ab02b90 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.115308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e57c3c4-fcbc-4c3f-a2ed-4ac62ab02b90 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.115719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e57c3c4-fcbc-4c3f-a2ed-4ac62ab02b90 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.116500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e57c3c4-fcbc-4c3f-a2ed-4ac62ab02b90 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.116959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e57c3c4-fcbc-4c3f-a2ed-4ac62ab02b90 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.132708 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-5e57c3c4-fcbc-4c3f-a2ed-4ac62ab02b90 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 5e5cb95b-1278-4730-9271-b05d6288efa7 could not be found. Mar 12 21:18:44.133317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e57c3c4-fcbc-4c3f-a2ed-4ac62ab02b90 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 5e5cb95b-1278-4730-9271-b05d6288efa7 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.134690 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e57c3c4-fcbc-4c3f-a2ed-4ac62ab02b90 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 404 len: 111 microversion: 2.1 time: 0.028458 Mar 12 21:18:44.135226 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4235/5003] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:18:44 2022] DELETE /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.142634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-adf8abfe-1e0d-4ea3-85c8-4695a6ef6cc7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.143257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-adf8abfe-1e0d-4ea3-85c8-4695a6ef6cc7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 5e5cb95b-1278-4730-9271-b05d6288efa7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.148809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-adf8abfe-1e0d-4ea3-85c8-4695a6ef6cc7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.149282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-adf8abfe-1e0d-4ea3-85c8-4695a6ef6cc7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.150718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-adf8abfe-1e0d-4ea3-85c8-4695a6ef6cc7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.151179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-adf8abfe-1e0d-4ea3-85c8-4695a6ef6cc7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.164161 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-adf8abfe-1e0d-4ea3-85c8-4695a6ef6cc7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 5e5cb95b-1278-4730-9271-b05d6288efa7 could not be found. Mar 12 21:18:44.164756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-adf8abfe-1e0d-4ea3-85c8-4695a6ef6cc7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 5e5cb95b-1278-4730-9271-b05d6288efa7 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.165641 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-adf8abfe-1e0d-4ea3-85c8-4695a6ef6cc7 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7" status: 404 len: 111 microversion: 2.1 time: 0.026497 Mar 12 21:18:44.166197 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4236/5004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:44 2022] GET /compute/v2.1/servers/5e5cb95b-1278-4730-9271-b05d6288efa7 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.173538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-41d28975-554a-438e-9b61-ac25b391c945 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.174080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-41d28975-554a-438e-9b61-ac25b391c945 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.179469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41d28975-554a-438e-9b61-ac25b391c945 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.179944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41d28975-554a-438e-9b61-ac25b391c945 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.180725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41d28975-554a-438e-9b61-ac25b391c945 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.181219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41d28975-554a-438e-9b61-ac25b391c945 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.194011 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-41d28975-554a-438e-9b61-ac25b391c945 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 03097d75-4672-45c3-b05f-b676ae95a98d could not be found. Mar 12 21:18:44.194604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-41d28975-554a-438e-9b61-ac25b391c945 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 03097d75-4672-45c3-b05f-b676ae95a98d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.195422 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-41d28975-554a-438e-9b61-ac25b391c945 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 404 len: 111 microversion: 2.1 time: 0.025572 Mar 12 21:18:44.195939 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4237/5005] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:18:44 2022] DELETE /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.203457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-79d28071-9ec6-4602-9200-e6202b3f6063 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.204073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-79d28071-9ec6-4602-9200-e6202b3f6063 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 03097d75-4672-45c3-b05f-b676ae95a98d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.209428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79d28071-9ec6-4602-9200-e6202b3f6063 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.209944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79d28071-9ec6-4602-9200-e6202b3f6063 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.210726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79d28071-9ec6-4602-9200-e6202b3f6063 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.211187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-79d28071-9ec6-4602-9200-e6202b3f6063 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.227068 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-79d28071-9ec6-4602-9200-e6202b3f6063 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 03097d75-4672-45c3-b05f-b676ae95a98d could not be found. Mar 12 21:18:44.227679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-79d28071-9ec6-4602-9200-e6202b3f6063 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 03097d75-4672-45c3-b05f-b676ae95a98d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.228569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-79d28071-9ec6-4602-9200-e6202b3f6063 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d" status: 404 len: 111 microversion: 2.1 time: 0.028525 Mar 12 21:18:44.229124 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4238/5006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:44 2022] GET /compute/v2.1/servers/03097d75-4672-45c3-b05f-b676ae95a98d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.236666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-456a4e2c-9ae4-498d-b013-91ee199989aa tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.237180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-456a4e2c-9ae4-498d-b013-91ee199989aa tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.242905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-456a4e2c-9ae4-498d-b013-91ee199989aa tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.243903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-456a4e2c-9ae4-498d-b013-91ee199989aa tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.244694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-456a4e2c-9ae4-498d-b013-91ee199989aa tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.245154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-456a4e2c-9ae4-498d-b013-91ee199989aa tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.258134 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-456a4e2c-9ae4-498d-b013-91ee199989aa tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 74be7221-8403-44c6-8dcf-847be3cd826f could not be found. Mar 12 21:18:44.258732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-456a4e2c-9ae4-498d-b013-91ee199989aa tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 74be7221-8403-44c6-8dcf-847be3cd826f could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.260697 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-456a4e2c-9ae4-498d-b013-91ee199989aa tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 404 len: 111 microversion: 2.1 time: 0.027324 Mar 12 21:18:44.261622 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4239/5007] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:18:44 2022] DELETE /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.269163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ea0151d-795c-461b-b5f6-188ac9402c4d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.269788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ea0151d-795c-461b-b5f6-188ac9402c4d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 74be7221-8403-44c6-8dcf-847be3cd826f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.275517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ea0151d-795c-461b-b5f6-188ac9402c4d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.275979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ea0151d-795c-461b-b5f6-188ac9402c4d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.276746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ea0151d-795c-461b-b5f6-188ac9402c4d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.277196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ea0151d-795c-461b-b5f6-188ac9402c4d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.289992 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3ea0151d-795c-461b-b5f6-188ac9402c4d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 74be7221-8403-44c6-8dcf-847be3cd826f could not be found. Mar 12 21:18:44.290577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ea0151d-795c-461b-b5f6-188ac9402c4d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 74be7221-8403-44c6-8dcf-847be3cd826f could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.291389 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ea0151d-795c-461b-b5f6-188ac9402c4d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f" status: 404 len: 111 microversion: 2.1 time: 0.025812 Mar 12 21:18:44.291902 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4240/5008] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:44 2022] GET /compute/v2.1/servers/74be7221-8403-44c6-8dcf-847be3cd826f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.299394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-704fc972-a4f8-497b-a14b-b9d8773d1842 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.299892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-704fc972-a4f8-497b-a14b-b9d8773d1842 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.305349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-704fc972-a4f8-497b-a14b-b9d8773d1842 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.305847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-704fc972-a4f8-497b-a14b-b9d8773d1842 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.307183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-704fc972-a4f8-497b-a14b-b9d8773d1842 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.307720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-704fc972-a4f8-497b-a14b-b9d8773d1842 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.320851 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-704fc972-a4f8-497b-a14b-b9d8773d1842 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 3effa5c1-99ff-452e-9110-d5b83795fa4a could not be found. Mar 12 21:18:44.321449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-704fc972-a4f8-497b-a14b-b9d8773d1842 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 3effa5c1-99ff-452e-9110-d5b83795fa4a could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.322896 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-704fc972-a4f8-497b-a14b-b9d8773d1842 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 404 len: 111 microversion: 2.1 time: 0.027223 Mar 12 21:18:44.323438 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4241/5009] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:18:44 2022] DELETE /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.330970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1659c987-00e5-4c6d-9205-e5e396edc92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.331588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1659c987-00e5-4c6d-9205-e5e396edc92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 3effa5c1-99ff-452e-9110-d5b83795fa4a] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.338742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1659c987-00e5-4c6d-9205-e5e396edc92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.339201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1659c987-00e5-4c6d-9205-e5e396edc92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.339975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1659c987-00e5-4c6d-9205-e5e396edc92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.340424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1659c987-00e5-4c6d-9205-e5e396edc92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.353724 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-1659c987-00e5-4c6d-9205-e5e396edc92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 3effa5c1-99ff-452e-9110-d5b83795fa4a could not be found. Mar 12 21:18:44.354291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1659c987-00e5-4c6d-9205-e5e396edc92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 3effa5c1-99ff-452e-9110-d5b83795fa4a could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.355034 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1659c987-00e5-4c6d-9205-e5e396edc92d tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a" status: 404 len: 111 microversion: 2.1 time: 0.027707 Mar 12 21:18:44.355891 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4242/5010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:44 2022] GET /compute/v2.1/servers/3effa5c1-99ff-452e-9110-d5b83795fa4a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.364006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7713e0e-cb83-4e3d-b67b-290e4045030b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.364579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7713e0e-cb83-4e3d-b67b-290e4045030b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2d86c292-74e6-48af-9aa6-80213d366057] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.370629 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c7713e0e-cb83-4e3d-b67b-290e4045030b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 2d86c292-74e6-48af-9aa6-80213d366057 could not be found. Mar 12 21:18:44.371155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7713e0e-cb83-4e3d-b67b-290e4045030b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 2d86c292-74e6-48af-9aa6-80213d366057 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.371965 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7713e0e-cb83-4e3d-b67b-290e4045030b tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2d86c292-74e6-48af-9aa6-80213d366057" status: 404 len: 111 microversion: 2.1 time: 0.012544 Mar 12 21:18:44.372486 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4243/5011] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:18:44 2022] DELETE /compute/v2.1/servers/2d86c292-74e6-48af-9aa6-80213d366057 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.379996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6ee9f51-565f-4e55-9413-9c2bc14ef027 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.380601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d6ee9f51-565f-4e55-9413-9c2bc14ef027 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: 2d86c292-74e6-48af-9aa6-80213d366057] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.387132 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d6ee9f51-565f-4e55-9413-9c2bc14ef027 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance 2d86c292-74e6-48af-9aa6-80213d366057 could not be found. Mar 12 21:18:44.387707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6ee9f51-565f-4e55-9413-9c2bc14ef027 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance 2d86c292-74e6-48af-9aa6-80213d366057 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:44.388542 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d6ee9f51-565f-4e55-9413-9c2bc14ef027 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/2d86c292-74e6-48af-9aa6-80213d366057" status: 404 len: 111 microversion: 2.1 time: 0.012262 Mar 12 21:18:44.389048 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4244/5012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:44 2022] GET /compute/v2.1/servers/2d86c292-74e6-48af-9aa6-80213d366057 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:44.395970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-013c6dca-60de-4d55-9a78-aed785ba27a8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.396446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-013c6dca-60de-4d55-9a78-aed785ba27a8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.401856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-013c6dca-60de-4d55-9a78-aed785ba27a8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.402320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-013c6dca-60de-4d55-9a78-aed785ba27a8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.403095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-013c6dca-60de-4d55-9a78-aed785ba27a8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.403543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-013c6dca-60de-4d55-9a78-aed785ba27a8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.427131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-013c6dca-60de-4d55-9a78-aed785ba27a8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:18:44.500997 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-013c6dca-60de-4d55-9a78-aed785ba27a8 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 204 len: 0 microversion: 2.1 time: 0.107911 Mar 12 21:18:44.501635 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4245/5013] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:18:44 2022] DELETE /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:18:44.507260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a4841fec-e2d8-4b20-8492-eba3abe52f0b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.508019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a4841fec-e2d8-4b20-8492-eba3abe52f0b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.514325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4841fec-e2d8-4b20-8492-eba3abe52f0b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.514787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4841fec-e2d8-4b20-8492-eba3abe52f0b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.515559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4841fec-e2d8-4b20-8492-eba3abe52f0b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.516015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4841fec-e2d8-4b20-8492-eba3abe52f0b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.663026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a4841fec-e2d8-4b20-8492-eba3abe52f0b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:44.671112 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a4841fec-e2d8-4b20-8492-eba3abe52f0b tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1492 microversion: 2.1 time: 0.168169 Mar 12 21:18:44.671688 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4246/5014] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:44 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1492 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:44.676598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f62e71c-da45-4cb0-8db3-aaf968bea4ca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.677215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f62e71c-da45-4cb0-8db3-aaf968bea4ca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.684084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f62e71c-da45-4cb0-8db3-aaf968bea4ca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.684537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f62e71c-da45-4cb0-8db3-aaf968bea4ca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.685336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f62e71c-da45-4cb0-8db3-aaf968bea4ca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.685821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f62e71c-da45-4cb0-8db3-aaf968bea4ca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.816423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f62e71c-da45-4cb0-8db3-aaf968bea4ca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:44.824322 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f62e71c-da45-4cb0-8db3-aaf968bea4ca tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 200 len: 1480 microversion: 2.1 time: 0.151365 Mar 12 21:18:44.824896 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4247/5015] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:44 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 1480 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:44.829932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9d56bfcc-6124-40be-99bf-3d89ea5798fb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:44.830482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9d56bfcc-6124-40be-99bf-3d89ea5798fb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.836321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d56bfcc-6124-40be-99bf-3d89ea5798fb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.836825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d56bfcc-6124-40be-99bf-3d89ea5798fb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.837651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d56bfcc-6124-40be-99bf-3d89ea5798fb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.838130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9d56bfcc-6124-40be-99bf-3d89ea5798fb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.903494 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9d56bfcc-6124-40be-99bf-3d89ea5798fb tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "POST /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351/action" status: 202 len: 0 microversion: 2.1 time: 0.077370 Mar 12 21:18:44.904122 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4248/5016] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:18:44 2022] POST /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:18:44.912664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-192188f7-2ae8-4b76-98b9-df5d9b93d677 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:44.913322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-192188f7-2ae8-4b76-98b9-df5d9b93d677 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:44.920078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-192188f7-2ae8-4b76-98b9-df5d9b93d677 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.920531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-192188f7-2ae8-4b76-98b9-df5d9b93d677 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:44.921326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-192188f7-2ae8-4b76-98b9-df5d9b93d677 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:44.921892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-192188f7-2ae8-4b76-98b9-df5d9b93d677 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:45.059472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-192188f7-2ae8-4b76-98b9-df5d9b93d677 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:45.067361 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-192188f7-2ae8-4b76-98b9-df5d9b93d677 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1498 microversion: 2.1 time: 0.158949 Mar 12 21:18:45.067951 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4249/5017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:44 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:45.840551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b7fa53e1-b32f-42ca-bae7-ee868adb2b12 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:45.841174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b7fa53e1-b32f-42ca-bae7-ee868adb2b12 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:45.848043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7fa53e1-b32f-42ca-bae7-ee868adb2b12 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:45.848515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7fa53e1-b32f-42ca-bae7-ee868adb2b12 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:45.849307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7fa53e1-b32f-42ca-bae7-ee868adb2b12 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:45.849785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7fa53e1-b32f-42ca-bae7-ee868adb2b12 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:46.064410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b7fa53e1-b32f-42ca-bae7-ee868adb2b12 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074c6de57bf94d4a943b2d04e2072ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3fffba5f19640b8bfaf5c10aa33ad70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:46.074878 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b7fa53e1-b32f-42ca-bae7-ee868adb2b12 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 200 len: 1480 microversion: 2.1 time: 0.238175 Mar 12 21:18:46.084673 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4250/5018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:45 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 1480 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:46.087008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9dc6369e-969f-4abf-a8f4-f3e339586b66 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:46.087660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9dc6369e-969f-4abf-a8f4-f3e339586b66 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:46.097085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9dc6369e-969f-4abf-a8f4-f3e339586b66 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:46.097494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9dc6369e-969f-4abf-a8f4-f3e339586b66 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:46.098337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9dc6369e-969f-4abf-a8f4-f3e339586b66 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:46.098802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9dc6369e-969f-4abf-a8f4-f3e339586b66 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:46.338602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9dc6369e-969f-4abf-a8f4-f3e339586b66 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:46.346221 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9dc6369e-969f-4abf-a8f4-f3e339586b66 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1501 microversion: 2.1 time: 0.264571 Mar 12 21:18:46.346806 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4251/5019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:46 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1501 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:46.362905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b761263-91f2-4f5d-a79d-a5a2e486a798 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:46.363354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b761263-91f2-4f5d-a79d-a5a2e486a798 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:46.370042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b761263-91f2-4f5d-a79d-a5a2e486a798 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:46.370511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b761263-91f2-4f5d-a79d-a5a2e486a798 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:46.371295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b761263-91f2-4f5d-a79d-a5a2e486a798 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:46.371803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b761263-91f2-4f5d-a79d-a5a2e486a798 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:46.396599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b761263-91f2-4f5d-a79d-a5a2e486a798 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:18:46.488041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b761263-91f2-4f5d-a79d-a5a2e486a798 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 204 len: 0 microversion: 2.1 time: 0.128825 Mar 12 21:18:46.488842 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4252/5020] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:18:46 2022] DELETE /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:18:46.497936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2639e573-9fc3-4411-8831-b1b64934e2fe tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:46.498664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2639e573-9fc3-4411-8831-b1b64934e2fe tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:46.506116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2639e573-9fc3-4411-8831-b1b64934e2fe tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:46.506606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2639e573-9fc3-4411-8831-b1b64934e2fe tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:46.507441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2639e573-9fc3-4411-8831-b1b64934e2fe tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:46.507853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2639e573-9fc3-4411-8831-b1b64934e2fe tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:46.651772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2639e573-9fc3-4411-8831-b1b64934e2fe tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:46.659214 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2639e573-9fc3-4411-8831-b1b64934e2fe tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1507 microversion: 2.1 time: 0.166157 Mar 12 21:18:46.659797 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4253/5021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:46 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:46.664189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fd20c10b-980b-499a-987c-636bf739fd04 req-ede7e265-5ea2-4b77-a0ba-9458ae0e4d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66ec9fb-1980-47de-84ca-9edf47c1cb1f", "name": "network-vif-deleted", "tag": "ffc39159-6ca0-4504-bdc2-a66122d0bb59"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:46.672571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fd20c10b-980b-499a-987c-636bf739fd04 req-ede7e265-5ea2-4b77-a0ba-9458ae0e4d76 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:46.673030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fd20c10b-980b-499a-987c-636bf739fd04 req-ede7e265-5ea2-4b77-a0ba-9458ae0e4d76 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:46.683719 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fd20c10b-980b-499a-987c-636bf739fd04 req-ede7e265-5ea2-4b77-a0ba-9458ae0e4d76 service nova] Creating event network-vif-deleted:ffc39159-6ca0-4504-bdc2-a66122d0bb59 for instance b66ec9fb-1980-47de-84ca-9edf47c1cb1f on nch1-master-1 Mar 12 21:18:46.688682 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fd20c10b-980b-499a-987c-636bf739fd04 req-ede7e265-5ea2-4b77-a0ba-9458ae0e4d76 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027750 Mar 12 21:18:46.689344 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4254/5022] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:18:47.094331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-42c8eef4-2855-47b7-a93b-f947aa3406b1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:47.095054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-42c8eef4-2855-47b7-a93b-f947aa3406b1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] [instance: b66ec9fb-1980-47de-84ca-9edf47c1cb1f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:47.101281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42c8eef4-2855-47b7-a93b-f947aa3406b1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:47.101967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42c8eef4-2855-47b7-a93b-f947aa3406b1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:47.102795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42c8eef4-2855-47b7-a93b-f947aa3406b1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:47.103667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42c8eef4-2855-47b7-a93b-f947aa3406b1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:47.117680 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-42c8eef4-2855-47b7-a93b-f947aa3406b1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] HTTP exception thrown: Instance b66ec9fb-1980-47de-84ca-9edf47c1cb1f could not be found. Mar 12 21:18:47.118397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-42c8eef4-2855-47b7-a93b-f947aa3406b1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] Returning 404 to user: Instance b66ec9fb-1980-47de-84ca-9edf47c1cb1f could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:47.119241 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-42c8eef4-2855-47b7-a93b-f947aa3406b1 tempest-ServersTestJSON-993018928 tempest-ServersTestJSON-993018928-project] 10.222.0.30 "GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f" status: 404 len: 111 microversion: 2.1 time: 0.030098 Mar 12 21:18:47.119798 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4255/5023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:47 2022] GET /compute/v2.1/servers/b66ec9fb-1980-47de-84ca-9edf47c1cb1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:18:47.676604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cf0a4eaa-b67f-457d-b116-1b6b6e16a9c0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:47.677235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cf0a4eaa-b67f-457d-b116-1b6b6e16a9c0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:47.683194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf0a4eaa-b67f-457d-b116-1b6b6e16a9c0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:47.683662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf0a4eaa-b67f-457d-b116-1b6b6e16a9c0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:47.684444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf0a4eaa-b67f-457d-b116-1b6b6e16a9c0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:47.684892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cf0a4eaa-b67f-457d-b116-1b6b6e16a9c0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:47.823267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cf0a4eaa-b67f-457d-b116-1b6b6e16a9c0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:47.831011 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cf0a4eaa-b67f-457d-b116-1b6b6e16a9c0 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1507 microversion: 2.1 time: 0.158220 Mar 12 21:18:47.831785 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4256/5024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:47 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:48.848683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-004f0d3e-2eb2-47a7-a9eb-4956cde47834 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:48.849322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-004f0d3e-2eb2-47a7-a9eb-4956cde47834 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:48.857526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-004f0d3e-2eb2-47a7-a9eb-4956cde47834 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:48.858301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-004f0d3e-2eb2-47a7-a9eb-4956cde47834 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:48.859322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-004f0d3e-2eb2-47a7-a9eb-4956cde47834 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:48.860005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-004f0d3e-2eb2-47a7-a9eb-4956cde47834 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:48.949262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-004f0d3e-2eb2-47a7-a9eb-4956cde47834 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74876aa9a164848accb21eb850f011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2bc5ab9d272404d88c627804a2b2195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:48.957626 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-004f0d3e-2eb2-47a7-a9eb-4956cde47834 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 200 len: 1465 microversion: 2.1 time: 0.112753 Mar 12 21:18:48.958268 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4257/5025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:48 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 1465 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:48.966127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c3b85216-a1e3-415b-bc14-d9c1ed68f85d req-51e45d7d-303b-4a57-a299-c8aeb39868eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2f879e9-c561-471f-a2f9-88c919468351", "name": "network-vif-deleted", "tag": "3e12ca66-bb04-4c07-a876-382b7fa4b46f"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:48.980520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c3b85216-a1e3-415b-bc14-d9c1ed68f85d req-51e45d7d-303b-4a57-a299-c8aeb39868eb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:48.981183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c3b85216-a1e3-415b-bc14-d9c1ed68f85d req-51e45d7d-303b-4a57-a299-c8aeb39868eb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:48.995008 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c3b85216-a1e3-415b-bc14-d9c1ed68f85d req-51e45d7d-303b-4a57-a299-c8aeb39868eb service nova] Creating event network-vif-deleted:3e12ca66-bb04-4c07-a876-382b7fa4b46f for instance d2f879e9-c561-471f-a2f9-88c919468351 on nch2-master-1 Mar 12 21:18:49.000071 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c3b85216-a1e3-415b-bc14-d9c1ed68f85d req-51e45d7d-303b-4a57-a299-c8aeb39868eb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040279 Mar 12 21:18:49.004003 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4258/5026] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:18:49.686822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1537471290", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:49.736046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] validate_networks() for [('a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:18:50.074866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:18:50.075418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:18:50.075821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:18:50.076271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:18:50.076704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:18:50.085566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:50.086170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:50.086999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:50.087455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:50.105340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Getting quotas for project 13397eac7c854033a2e3c6faa8f8247e. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:18:50.110540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Getting quotas for user c2d43d7b235048dfbc773e69ae5ff75a and project 13397eac7c854033a2e3c6faa8f8247e. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:18:50.123202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:18:50.125567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:18:50.169627 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d8cd7d5d-fdee-422d-b77c-1b4c07546b5c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595394 Mar 12 21:18:50.170324 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4259/5027] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:18:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:18:50.175421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7e0cce0-5eaf-42a2-a25d-fb42ed2ba818 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:50.176133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e7e0cce0-5eaf-42a2-a25d-fb42ed2ba818 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:50.185323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7e0cce0-5eaf-42a2-a25d-fb42ed2ba818 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:50.185818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7e0cce0-5eaf-42a2-a25d-fb42ed2ba818 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:50.187565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7e0cce0-5eaf-42a2-a25d-fb42ed2ba818 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:50.188027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7e0cce0-5eaf-42a2-a25d-fb42ed2ba818 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:50.240404 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e7e0cce0-5eaf-42a2-a25d-fb42ed2ba818 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "POST /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d/action" status: 200 len: 24571 microversion: 2.1 time: 0.068851 Mar 12 21:18:50.241263 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4260/5028] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:18:50 2022] POST /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d/action => generated 24571 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 21:18:50.247173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fc6488a1-3c7a-4167-b2f7-cf6ea4d5eac1 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:50.247827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fc6488a1-3c7a-4167-b2f7-cf6ea4d5eac1 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] [instance: d2f879e9-c561-471f-a2f9-88c919468351] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:50.254861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc6488a1-3c7a-4167-b2f7-cf6ea4d5eac1 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:50.255397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc6488a1-3c7a-4167-b2f7-cf6ea4d5eac1 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:50.256255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc6488a1-3c7a-4167-b2f7-cf6ea4d5eac1 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:50.256778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc6488a1-3c7a-4167-b2f7-cf6ea4d5eac1 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:50.271350 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-fc6488a1-3c7a-4167-b2f7-cf6ea4d5eac1 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] HTTP exception thrown: Instance d2f879e9-c561-471f-a2f9-88c919468351 could not be found. Mar 12 21:18:50.271971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fc6488a1-3c7a-4167-b2f7-cf6ea4d5eac1 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] Returning 404 to user: Instance d2f879e9-c561-471f-a2f9-88c919468351 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:18:50.272826 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fc6488a1-3c7a-4167-b2f7-cf6ea4d5eac1 tempest-TestServerAdvancedOps-1857619204 tempest-TestServerAdvancedOps-1857619204-project] 10.222.0.30 "GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351" status: 404 len: 111 microversion: 2.1 time: 0.030585 Mar 12 21:18:50.273398 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4261/5029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:50 2022] GET /compute/v2.1/servers/d2f879e9-c561-471f-a2f9-88c919468351 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:18:50.280098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2955d4cd-2918-4061-9c23-1de7305da393 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:50.282294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2955d4cd-2918-4061-9c23-1de7305da393 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:50.341428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2955d4cd-2918-4061-9c23-1de7305da393 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:50.348285 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2955d4cd-2918-4061-9c23-1de7305da393 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1217 microversion: 2.1 time: 0.073867 Mar 12 21:18:50.352386 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4262/5030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:50 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:51.366224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1998a55b-ddb6-4428-9c4c-d64df13da4ec tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:51.366867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1998a55b-ddb6-4428-9c4c-d64df13da4ec tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:51.375869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1998a55b-ddb6-4428-9c4c-d64df13da4ec tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:51.376535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1998a55b-ddb6-4428-9c4c-d64df13da4ec tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:51.377533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1998a55b-ddb6-4428-9c4c-d64df13da4ec tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:51.378021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1998a55b-ddb6-4428-9c4c-d64df13da4ec tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:51.462934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1998a55b-ddb6-4428-9c4c-d64df13da4ec tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:51.471607 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1998a55b-ddb6-4428-9c4c-d64df13da4ec tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1275 microversion: 2.1 time: 0.109395 Mar 12 21:18:51.474840 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4263/5031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:51 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:52.488621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-844682de-b582-4465-ba0c-901256838c13 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:52.489262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-844682de-b582-4465-ba0c-901256838c13 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:52.496775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-844682de-b582-4465-ba0c-901256838c13 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:52.497252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-844682de-b582-4465-ba0c-901256838c13 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:52.498078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-844682de-b582-4465-ba0c-901256838c13 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:52.498700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-844682de-b582-4465-ba0c-901256838c13 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:52.750884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-844682de-b582-4465-ba0c-901256838c13 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:52.759604 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-844682de-b582-4465-ba0c-901256838c13 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1317 microversion: 2.1 time: 0.274759 Mar 12 21:18:52.760190 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4264/5032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:52 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:52.765202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c15175da-ca33-4c79-a26c-00cad5d4443e req-d6a689ca-c6cc-47c0-9551-d451bf69930b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e054fc3c-6e21-4333-a700-0c2254b6fa0e", "tag": "38bbbe31-f103-40ff-83fd-ad66bb739042"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:52.773462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c15175da-ca33-4c79-a26c-00cad5d4443e req-d6a689ca-c6cc-47c0-9551-d451bf69930b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:52.774142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c15175da-ca33-4c79-a26c-00cad5d4443e req-d6a689ca-c6cc-47c0-9551-d451bf69930b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:52.785808 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c15175da-ca33-4c79-a26c-00cad5d4443e req-d6a689ca-c6cc-47c0-9551-d451bf69930b service nova] Creating event network-changed:38bbbe31-f103-40ff-83fd-ad66bb739042 for instance e054fc3c-6e21-4333-a700-0c2254b6fa0e on nch1-master-1 Mar 12 21:18:52.791330 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c15175da-ca33-4c79-a26c-00cad5d4443e req-d6a689ca-c6cc-47c0-9551-d451bf69930b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029773 Mar 12 21:18:52.791936 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4265/5033] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:18:53.777960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7437dcca-c382-4392-a931-18050ace926d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:53.778780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7437dcca-c382-4392-a931-18050ace926d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:53.786040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7437dcca-c382-4392-a931-18050ace926d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:53.786596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7437dcca-c382-4392-a931-18050ace926d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:53.787474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7437dcca-c382-4392-a931-18050ace926d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:53.787997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7437dcca-c382-4392-a931-18050ace926d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:54.001703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7437dcca-c382-4392-a931-18050ace926d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:54.010965 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7437dcca-c382-4392-a931-18050ace926d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1317 microversion: 2.1 time: 0.238077 Mar 12 21:18:54.011625 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4266/5034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:53 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:55.029544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6d013002-41ca-4337-a59c-474bf083453a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:55.030691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6d013002-41ca-4337-a59c-474bf083453a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:55.037440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d013002-41ca-4337-a59c-474bf083453a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:55.037905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d013002-41ca-4337-a59c-474bf083453a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:55.038707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d013002-41ca-4337-a59c-474bf083453a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:55.039198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d013002-41ca-4337-a59c-474bf083453a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:55.263513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6d013002-41ca-4337-a59c-474bf083453a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:55.271254 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6d013002-41ca-4337-a59c-474bf083453a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1317 microversion: 2.1 time: 0.247352 Mar 12 21:18:55.271828 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4267/5035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:55 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:18:56.288663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-45364f2c-9942-4a22-a532-f340d0b458f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:56.289380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-45364f2c-9942-4a22-a532-f340d0b458f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:56.297045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45364f2c-9942-4a22-a532-f340d0b458f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:56.298006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45364f2c-9942-4a22-a532-f340d0b458f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:56.299010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45364f2c-9942-4a22-a532-f340d0b458f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:56.299463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-45364f2c-9942-4a22-a532-f340d0b458f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:56.453313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-45364f2c-9942-4a22-a532-f340d0b458f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:56.461656 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-45364f2c-9942-4a22-a532-f340d0b458f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1317 microversion: 2.1 time: 0.176998 Mar 12 21:18:56.462346 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4268/5036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:56 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:57.479299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5294b53e-1870-4206-803b-691d3f889360 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:57.481687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5294b53e-1870-4206-803b-691d3f889360 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:57.492540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5294b53e-1870-4206-803b-691d3f889360 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:57.493838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5294b53e-1870-4206-803b-691d3f889360 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:57.494817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5294b53e-1870-4206-803b-691d3f889360 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:57.495274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5294b53e-1870-4206-803b-691d3f889360 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:57.658356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5294b53e-1870-4206-803b-691d3f889360 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:57.668636 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5294b53e-1870-4206-803b-691d3f889360 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1317 microversion: 2.1 time: 0.194482 Mar 12 21:18:57.669510 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4269/5037] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:57 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:57.805116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7e979a6b-ddca-45e4-af49-105f868631a0 req-ae71e70c-4840-48c6-b4e5-2fa8d9cad100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e054fc3c-6e21-4333-a700-0c2254b6fa0e", "name": "network-vif-plugged", "status": "completed", "tag": "38bbbe31-f103-40ff-83fd-ad66bb739042"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:18:57.813714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7e979a6b-ddca-45e4-af49-105f868631a0 req-ae71e70c-4840-48c6-b4e5-2fa8d9cad100 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:57.814201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7e979a6b-ddca-45e4-af49-105f868631a0 req-ae71e70c-4840-48c6-b4e5-2fa8d9cad100 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:57.839822 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7e979a6b-ddca-45e4-af49-105f868631a0 req-ae71e70c-4840-48c6-b4e5-2fa8d9cad100 service nova] Creating event network-vif-plugged:38bbbe31-f103-40ff-83fd-ad66bb739042 for instance e054fc3c-6e21-4333-a700-0c2254b6fa0e on nch1-master-1 Mar 12 21:18:57.845198 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7e979a6b-ddca-45e4-af49-105f868631a0 req-ae71e70c-4840-48c6-b4e5-2fa8d9cad100 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044175 Mar 12 21:18:57.845952 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4270/5038] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:18:58.687543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-016b0741-c6be-4e42-8f7e-a49fb59cef7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:58.688269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-016b0741-c6be-4e42-8f7e-a49fb59cef7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:58.694935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-016b0741-c6be-4e42-8f7e-a49fb59cef7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:58.695404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-016b0741-c6be-4e42-8f7e-a49fb59cef7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:58.696287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-016b0741-c6be-4e42-8f7e-a49fb59cef7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:58.696747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-016b0741-c6be-4e42-8f7e-a49fb59cef7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:58.848099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-016b0741-c6be-4e42-8f7e-a49fb59cef7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:18:58.862695 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-016b0741-c6be-4e42-8f7e-a49fb59cef7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1317 microversion: 2.1 time: 0.180049 Mar 12 21:18:58.871656 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4271/5039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:58 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:18:59.879598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5b7cd13f-dd35-42a9-b631-d1c5dd46ba84 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:18:59.880266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5b7cd13f-dd35-42a9-b631-d1c5dd46ba84 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:18:59.888585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b7cd13f-dd35-42a9-b631-d1c5dd46ba84 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:59.889063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b7cd13f-dd35-42a9-b631-d1c5dd46ba84 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:18:59.890425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b7cd13f-dd35-42a9-b631-d1c5dd46ba84 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:18:59.891266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b7cd13f-dd35-42a9-b631-d1c5dd46ba84 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:00.043817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5b7cd13f-dd35-42a9-b631-d1c5dd46ba84 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:00.052745 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5b7cd13f-dd35-42a9-b631-d1c5dd46ba84 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.176905 Mar 12 21:19:00.053509 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4272/5040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:18:59 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:00.164236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1607455185", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:00.221146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] validate_networks() for [('a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:19:00.616638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:19:00.617077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:19:00.617567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:19:00.618059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:19:00.618491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:19:00.627812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:00.628277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:00.629297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:00.629748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:00.651504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Getting quotas for project 13397eac7c854033a2e3c6faa8f8247e. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:19:00.657577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Getting quotas for user c2d43d7b235048dfbc773e69ae5ff75a and project 13397eac7c854033a2e3c6faa8f8247e. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:19:00.672392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:19:00.674736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:19:00.724028 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b90265d5-384c-4a2e-a4cd-a2fe1f34d126 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563534 Mar 12 21:19:00.725037 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4273/5041] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:19:00.736049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c917fc2f-4f38-43c2-935f-29e1b734bcf6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:00.736689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c917fc2f-4f38-43c2-935f-29e1b734bcf6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:00.800445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c917fc2f-4f38-43c2-935f-29e1b734bcf6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:00.808793 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c917fc2f-4f38-43c2-935f-29e1b734bcf6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 200 len: 1217 microversion: 2.1 time: 0.077921 Mar 12 21:19:00.809807 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4274/5042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:00 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:01.825621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a3694a6-2dca-4eca-bb3b-282c5ea1007e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:01.826473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a3694a6-2dca-4eca-bb3b-282c5ea1007e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:01.849877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a3694a6-2dca-4eca-bb3b-282c5ea1007e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:01.853385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a3694a6-2dca-4eca-bb3b-282c5ea1007e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:01.869159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a3694a6-2dca-4eca-bb3b-282c5ea1007e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:01.871502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a3694a6-2dca-4eca-bb3b-282c5ea1007e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:01.954067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8a3694a6-2dca-4eca-bb3b-282c5ea1007e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:01.966858 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a3694a6-2dca-4eca-bb3b-282c5ea1007e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 200 len: 1275 microversion: 2.1 time: 0.145204 Mar 12 21:19:01.967681 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4275/5043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:01 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 1275 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:02.991602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e9119095-6d1b-40fb-94cf-88d65ca936ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:02.995197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e9119095-6d1b-40fb-94cf-88d65ca936ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:03.020295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9119095-6d1b-40fb-94cf-88d65ca936ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:03.022893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9119095-6d1b-40fb-94cf-88d65ca936ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:03.024549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9119095-6d1b-40fb-94cf-88d65ca936ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:03.026230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9119095-6d1b-40fb-94cf-88d65ca936ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:03.275332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e9119095-6d1b-40fb-94cf-88d65ca936ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:03.284110 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e9119095-6d1b-40fb-94cf-88d65ca936ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 200 len: 1317 microversion: 2.1 time: 0.302632 Mar 12 21:19:03.285215 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4276/5044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:02 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:03.474652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8731c36a-db84-4154-8341-5e9f4454f716 req-9676b59a-4e00-4ea3-969d-a85094be74f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b958bc0f-9c08-48d3-9ca5-e0593b930996", "tag": "e63a3538-5b06-4ff4-8a28-0ade8cc30f60"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:03.487461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8731c36a-db84-4154-8341-5e9f4454f716 req-9676b59a-4e00-4ea3-969d-a85094be74f5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:03.488214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8731c36a-db84-4154-8341-5e9f4454f716 req-9676b59a-4e00-4ea3-969d-a85094be74f5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:03.506793 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8731c36a-db84-4154-8341-5e9f4454f716 req-9676b59a-4e00-4ea3-969d-a85094be74f5 service nova] Creating event network-changed:e63a3538-5b06-4ff4-8a28-0ade8cc30f60 for instance b958bc0f-9c08-48d3-9ca5-e0593b930996 on nch1-master-1 Mar 12 21:19:03.512538 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8731c36a-db84-4154-8341-5e9f4454f716 req-9676b59a-4e00-4ea3-969d-a85094be74f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051712 Mar 12 21:19:03.513397 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4277/5045] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:19:04.304883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d26373d2-537e-4961-8db2-7a4ffbe74962 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:04.306832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d26373d2-537e-4961-8db2-7a4ffbe74962 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:04.316780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d26373d2-537e-4961-8db2-7a4ffbe74962 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:04.317489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d26373d2-537e-4961-8db2-7a4ffbe74962 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:04.318326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d26373d2-537e-4961-8db2-7a4ffbe74962 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:04.318959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d26373d2-537e-4961-8db2-7a4ffbe74962 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:04.955008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d26373d2-537e-4961-8db2-7a4ffbe74962 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:04.964215 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d26373d2-537e-4961-8db2-7a4ffbe74962 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 200 len: 1317 microversion: 2.1 time: 0.664862 Mar 12 21:19:04.965226 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4278/5046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:04 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 1317 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:05.535342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ce839c4-1eb8-4d0d-a6ad-8c52bf313238 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Action: 'create', calling method: .version_select at 0x7f6e37487f70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-396695384"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:05.551977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6ce839c4-1eb8-4d0d-a6ad-8c52bf313238 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for project 1940f5d7144c49758a742d34f71e9639. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:19:05.558627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6ce839c4-1eb8-4d0d-a6ad-8c52bf313238 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for user 75e4a2651a6e469491f271ced8ef9695 and project 1940f5d7144c49758a742d34f71e9639. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:19:05.712801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6ce839c4-1eb8-4d0d-a6ad-8c52bf313238 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for project 1940f5d7144c49758a742d34f71e9639. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:19:05.719827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-6ce839c4-1eb8-4d0d-a6ad-8c52bf313238 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for user 75e4a2651a6e469491f271ced8ef9695 and project 1940f5d7144c49758a742d34f71e9639. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:19:05.735822 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ce839c4-1eb8-4d0d-a6ad-8c52bf313238 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.204396 Mar 12 21:19:05.736524 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4279/5047] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:19:05 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:05.985992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-95881794-8256-4d98-a05b-57cb6102bbdd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:05.986671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-95881794-8256-4d98-a05b-57cb6102bbdd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:05.999182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95881794-8256-4d98-a05b-57cb6102bbdd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:06.000022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95881794-8256-4d98-a05b-57cb6102bbdd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:06.000978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95881794-8256-4d98-a05b-57cb6102bbdd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:06.001581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95881794-8256-4d98-a05b-57cb6102bbdd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:06.375418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-95881794-8256-4d98-a05b-57cb6102bbdd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:06.399041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-95881794-8256-4d98-a05b-57cb6102bbdd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 200 len: 1317 microversion: 2.1 time: 0.420548 Mar 12 21:19:06.414020 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4280/5048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:05 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:07.418781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-816046b7-8706-4cc2-8f0e-cad2e1a3a864 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:07.420217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-816046b7-8706-4cc2-8f0e-cad2e1a3a864 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:07.428838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-816046b7-8706-4cc2-8f0e-cad2e1a3a864 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:07.429930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-816046b7-8706-4cc2-8f0e-cad2e1a3a864 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:07.431018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-816046b7-8706-4cc2-8f0e-cad2e1a3a864 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:07.431703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-816046b7-8706-4cc2-8f0e-cad2e1a3a864 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:07.703832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-816046b7-8706-4cc2-8f0e-cad2e1a3a864 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:07.712321 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-816046b7-8706-4cc2-8f0e-cad2e1a3a864 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 200 len: 1317 microversion: 2.1 time: 0.297437 Mar 12 21:19:07.715908 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4281/5049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:07 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:08.223504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-338346582", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "1f44a7e2-a855-4b0e-8440-125620a19c1a"}], "key_name": "tempest-TestNetworkBasicOps-396695384", "security_groups": [{"name": "tempest-secgroup-smoke-88054257"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:08.475185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] validate_networks() for [('1f44a7e2-a855-4b0e-8440-125620a19c1a', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:19:09.100624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:19:09.101133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:19:09.101644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:19:09.102198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:19:09.102640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:19:09.115831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:09.116532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:09.118704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:09.119324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:09.143972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for project 1940f5d7144c49758a742d34f71e9639. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:19:09.150476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for user 75e4a2651a6e469491f271ced8ef9695 and project 1940f5d7144c49758a742d34f71e9639. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:19:09.166548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:19:09.168980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:19:09.224035 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-40967cdb-5fbe-4de7-97dd-07b414df47ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.005004 Mar 12 21:19:09.226025 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4282/5050] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:08 2022] POST /compute/v2.1/servers => generated 404 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:19:09.238457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5e85fda-6a9a-4314-ac36-6a1425f3feee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:09.239370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e5e85fda-6a9a-4314-ac36-6a1425f3feee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:09.248314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5e85fda-6a9a-4314-ac36-6a1425f3feee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:09.250137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5e85fda-6a9a-4314-ac36-6a1425f3feee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:09.252426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5e85fda-6a9a-4314-ac36-6a1425f3feee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:09.254664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5e85fda-6a9a-4314-ac36-6a1425f3feee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:09.496461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e5e85fda-6a9a-4314-ac36-6a1425f3feee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:09.509372 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e5e85fda-6a9a-4314-ac36-6a1425f3feee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 200 len: 1317 microversion: 2.1 time: 0.280857 Mar 12 21:19:09.519461 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4283/5051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:09 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:09.530528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1686b1de-f75e-48a4-a364-4e41118e3819 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:09.533885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1686b1de-f75e-48a4-a364-4e41118e3819 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:09.623828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1686b1de-f75e-48a4-a364-4e41118e3819 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:09.631972 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1686b1de-f75e-48a4-a364-4e41118e3819 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 200 len: 1247 microversion: 2.1 time: 0.113769 Mar 12 21:19:09.643339 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4284/5052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:09 2022] GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 1247 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:09.987190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0c0e0e9b-e859-40d3-a455-f711bc6fb59d req-2718adba-e81b-4122-8fc1-e0f4bf206378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b958bc0f-9c08-48d3-9ca5-e0593b930996", "name": "network-vif-plugged", "status": "completed", "tag": "e63a3538-5b06-4ff4-8a28-0ade8cc30f60"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:10.012272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0c0e0e9b-e859-40d3-a455-f711bc6fb59d req-2718adba-e81b-4122-8fc1-e0f4bf206378 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:10.013620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0c0e0e9b-e859-40d3-a455-f711bc6fb59d req-2718adba-e81b-4122-8fc1-e0f4bf206378 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:10.036416 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0c0e0e9b-e859-40d3-a455-f711bc6fb59d req-2718adba-e81b-4122-8fc1-e0f4bf206378 service nova] Creating event network-vif-plugged:e63a3538-5b06-4ff4-8a28-0ade8cc30f60 for instance b958bc0f-9c08-48d3-9ca5-e0593b930996 on nch1-master-1 Mar 12 21:19:10.047782 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0c0e0e9b-e859-40d3-a455-f711bc6fb59d req-2718adba-e81b-4122-8fc1-e0f4bf206378 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066873 Mar 12 21:19:10.048294 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4285/5053] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:19:10.528899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad7c6040-6610-448a-ba41-988eea7dc86e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:10.529711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad7c6040-6610-448a-ba41-988eea7dc86e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:10.536003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad7c6040-6610-448a-ba41-988eea7dc86e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:10.536475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad7c6040-6610-448a-ba41-988eea7dc86e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:10.537270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad7c6040-6610-448a-ba41-988eea7dc86e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:10.537730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad7c6040-6610-448a-ba41-988eea7dc86e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:10.681329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad7c6040-6610-448a-ba41-988eea7dc86e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:10.688867 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad7c6040-6610-448a-ba41-988eea7dc86e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 200 len: 1317 microversion: 2.1 time: 0.165316 Mar 12 21:19:10.689734 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4286/5054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:10 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:10.694550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b5b02bb-a3ff-4379-80c3-089a11761f7c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:10.695326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b5b02bb-a3ff-4379-80c3-089a11761f7c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:10.702203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b5b02bb-a3ff-4379-80c3-089a11761f7c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:10.702674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b5b02bb-a3ff-4379-80c3-089a11761f7c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:10.703462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b5b02bb-a3ff-4379-80c3-089a11761f7c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:10.703912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b5b02bb-a3ff-4379-80c3-089a11761f7c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:10.777193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b5b02bb-a3ff-4379-80c3-089a11761f7c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:10.794785 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b5b02bb-a3ff-4379-80c3-089a11761f7c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 200 len: 1299 microversion: 2.1 time: 0.103776 Mar 12 21:19:10.797609 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4287/5055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:10 2022] GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:11.706930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-daabb77a-106c-4e84-8100-6228ae408480 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:11.708203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-daabb77a-106c-4e84-8100-6228ae408480 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:11.719284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daabb77a-106c-4e84-8100-6228ae408480 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:11.719961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daabb77a-106c-4e84-8100-6228ae408480 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:11.721173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daabb77a-106c-4e84-8100-6228ae408480 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:11.730034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-daabb77a-106c-4e84-8100-6228ae408480 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:12.080389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-daabb77a-106c-4e84-8100-6228ae408480 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:12.095019 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-daabb77a-106c-4e84-8100-6228ae408480 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 200 len: 1506 microversion: 2.1 time: 0.392212 Mar 12 21:19:12.098096 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4288/5056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:11 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:12.105654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6dcb132b-9312-468a-bae7-6bc7a3ae7d8d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:12.107167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6dcb132b-9312-468a-bae7-6bc7a3ae7d8d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:12.117943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6dcb132b-9312-468a-bae7-6bc7a3ae7d8d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:12.118517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6dcb132b-9312-468a-bae7-6bc7a3ae7d8d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:12.119441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6dcb132b-9312-468a-bae7-6bc7a3ae7d8d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:12.119969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6dcb132b-9312-468a-bae7-6bc7a3ae7d8d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:12.395980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6dcb132b-9312-468a-bae7-6bc7a3ae7d8d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:12.409859 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6dcb132b-9312-468a-bae7-6bc7a3ae7d8d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 200 len: 1371 microversion: 2.1 time: 0.309009 Mar 12 21:19:12.411143 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4289/5057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:12 2022] GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 1371 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:12.428181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e047c728-c452-4ab0-8fb0-fc9215012036 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:12.431394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e047c728-c452-4ab0-8fb0-fc9215012036 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:12.445070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e047c728-c452-4ab0-8fb0-fc9215012036 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:12.446479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e047c728-c452-4ab0-8fb0-fc9215012036 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:12.448159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e047c728-c452-4ab0-8fb0-fc9215012036 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:12.448838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e047c728-c452-4ab0-8fb0-fc9215012036 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:12.488547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e047c728-c452-4ab0-8fb0-fc9215012036 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:19:12.632544 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e047c728-c452-4ab0-8fb0-fc9215012036 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 204 len: 0 microversion: 2.1 time: 0.219487 Mar 12 21:19:12.635084 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4290/5058] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:19:12 2022] DELETE /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:19:12.651991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-70b0ad45-a2f1-4071-b912-adc63b25bcb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:12.652826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-70b0ad45-a2f1-4071-b912-adc63b25bcb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:12.663587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70b0ad45-a2f1-4071-b912-adc63b25bcb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:12.664173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70b0ad45-a2f1-4071-b912-adc63b25bcb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:12.665617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70b0ad45-a2f1-4071-b912-adc63b25bcb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:12.666426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70b0ad45-a2f1-4071-b912-adc63b25bcb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:13.066960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-70b0ad45-a2f1-4071-b912-adc63b25bcb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:13.083957 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-70b0ad45-a2f1-4071-b912-adc63b25bcb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 200 len: 1512 microversion: 2.1 time: 0.439886 Mar 12 21:19:13.085966 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4291/5059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:12 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 1512 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:13.091175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-288ef71b-e7c5-49a0-b348-3b77dfac77e2 req-fecd1058-c84d-4d40-a18c-64b8e3f8d289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f530c787-a5c9-4b2b-b612-6e3eda410949", "tag": "4737d116-c616-4130-a724-4b17cd243254"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:13.104749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-288ef71b-e7c5-49a0-b348-3b77dfac77e2 req-fecd1058-c84d-4d40-a18c-64b8e3f8d289 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:13.106200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-288ef71b-e7c5-49a0-b348-3b77dfac77e2 req-fecd1058-c84d-4d40-a18c-64b8e3f8d289 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:13.131280 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-288ef71b-e7c5-49a0-b348-3b77dfac77e2 req-fecd1058-c84d-4d40-a18c-64b8e3f8d289 service nova] Creating event network-changed:4737d116-c616-4130-a724-4b17cd243254 for instance f530c787-a5c9-4b2b-b612-6e3eda410949 on nch2-master-1 Mar 12 21:19:13.154791 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-288ef71b-e7c5-49a0-b348-3b77dfac77e2 req-fecd1058-c84d-4d40-a18c-64b8e3f8d289 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062782 Mar 12 21:19:13.158863 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4292/5060] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:19:13.428089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-46757ee5-032c-4124-af8b-c60df8f9c294 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:13.428811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-46757ee5-032c-4124-af8b-c60df8f9c294 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:13.437010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46757ee5-032c-4124-af8b-c60df8f9c294 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:13.451742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46757ee5-032c-4124-af8b-c60df8f9c294 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:13.452810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46757ee5-032c-4124-af8b-c60df8f9c294 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:13.453279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46757ee5-032c-4124-af8b-c60df8f9c294 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:14.384818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-46757ee5-032c-4124-af8b-c60df8f9c294 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:14.406888 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-46757ee5-032c-4124-af8b-c60df8f9c294 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 200 len: 1371 microversion: 2.1 time: 0.982950 Mar 12 21:19:14.407494 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4293/5061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:13 2022] GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 1371 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:14.424147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30e9c3a9-fdab-4459-a460-e6958b5027c6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:14.424792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-30e9c3a9-fdab-4459-a460-e6958b5027c6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:14.438754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30e9c3a9-fdab-4459-a460-e6958b5027c6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:14.439160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30e9c3a9-fdab-4459-a460-e6958b5027c6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:14.440150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30e9c3a9-fdab-4459-a460-e6958b5027c6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:14.440614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30e9c3a9-fdab-4459-a460-e6958b5027c6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:14.889623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-30e9c3a9-fdab-4459-a460-e6958b5027c6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:14.902459 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30e9c3a9-fdab-4459-a460-e6958b5027c6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 200 len: 1512 microversion: 2.1 time: 0.483343 Mar 12 21:19:14.904704 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4294/5062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:14 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 1512 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:15.425987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-922e0201-6ffd-491e-9d0a-a60fac67223b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:15.427369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-922e0201-6ffd-491e-9d0a-a60fac67223b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:15.446777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-922e0201-6ffd-491e-9d0a-a60fac67223b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:15.448767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-922e0201-6ffd-491e-9d0a-a60fac67223b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:15.449864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-922e0201-6ffd-491e-9d0a-a60fac67223b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:15.452179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-922e0201-6ffd-491e-9d0a-a60fac67223b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:15.722568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-922e0201-6ffd-491e-9d0a-a60fac67223b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:15.731545 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-922e0201-6ffd-491e-9d0a-a60fac67223b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 200 len: 1371 microversion: 2.1 time: 0.310977 Mar 12 21:19:15.744627 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4295/5063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:15 2022] GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:15.750347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9246d9ab-b836-4402-9103-d8bcbed1dea9 req-8117d363-d469-4b8e-ae0f-089504053e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b958bc0f-9c08-48d3-9ca5-e0593b930996", "name": "network-vif-deleted", "tag": "e63a3538-5b06-4ff4-8a28-0ade8cc30f60"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:15.759434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9246d9ab-b836-4402-9103-d8bcbed1dea9 req-8117d363-d469-4b8e-ae0f-089504053e21 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:15.760253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9246d9ab-b836-4402-9103-d8bcbed1dea9 req-8117d363-d469-4b8e-ae0f-089504053e21 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:15.772381 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9246d9ab-b836-4402-9103-d8bcbed1dea9 req-8117d363-d469-4b8e-ae0f-089504053e21 service nova] Creating event network-vif-deleted:e63a3538-5b06-4ff4-8a28-0ade8cc30f60 for instance b958bc0f-9c08-48d3-9ca5-e0593b930996 on nch1-master-1 Mar 12 21:19:15.779051 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9246d9ab-b836-4402-9103-d8bcbed1dea9 req-8117d363-d469-4b8e-ae0f-089504053e21 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032448 Mar 12 21:19:15.779958 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4296/5064] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:19:15.925762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-58be31ff-60c1-49aa-bb56-3f28ad8b2c4b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:15.927030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-58be31ff-60c1-49aa-bb56-3f28ad8b2c4b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:15.945927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58be31ff-60c1-49aa-bb56-3f28ad8b2c4b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:15.946974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58be31ff-60c1-49aa-bb56-3f28ad8b2c4b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:15.953364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58be31ff-60c1-49aa-bb56-3f28ad8b2c4b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:15.954834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58be31ff-60c1-49aa-bb56-3f28ad8b2c4b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:16.111538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58be31ff-60c1-49aa-bb56-3f28ad8b2c4b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:16.112475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58be31ff-60c1-49aa-bb56-3f28ad8b2c4b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:16.116127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-58be31ff-60c1-49aa-bb56-3f28ad8b2c4b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lazy-loading 'fault' on Instance uuid b958bc0f-9c08-48d3-9ca5-e0593b930996 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:19:16.234960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-58be31ff-60c1-49aa-bb56-3f28ad8b2c4b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:16.248136 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-58be31ff-60c1-49aa-bb56-3f28ad8b2c4b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 200 len: 1307 microversion: 2.1 time: 0.330542 Mar 12 21:19:16.252629 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4297/5065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:15 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 1307 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:16.752195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0012be8b-25be-4447-bb3a-26bb057e9dd5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:16.753514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0012be8b-25be-4447-bb3a-26bb057e9dd5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:16.762289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0012be8b-25be-4447-bb3a-26bb057e9dd5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:16.762852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0012be8b-25be-4447-bb3a-26bb057e9dd5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:16.763874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0012be8b-25be-4447-bb3a-26bb057e9dd5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:16.764343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0012be8b-25be-4447-bb3a-26bb057e9dd5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:16.975757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0012be8b-25be-4447-bb3a-26bb057e9dd5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:16.986115 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0012be8b-25be-4447-bb3a-26bb057e9dd5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 200 len: 1371 microversion: 2.1 time: 0.238325 Mar 12 21:19:16.987501 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4298/5066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:16 2022] GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:17.266354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5150bc8c-1d1e-447b-b8f1-97d6714dfe53 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:17.267225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5150bc8c-1d1e-447b-b8f1-97d6714dfe53 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:17.274239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5150bc8c-1d1e-447b-b8f1-97d6714dfe53 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:17.274920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5150bc8c-1d1e-447b-b8f1-97d6714dfe53 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:17.275879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5150bc8c-1d1e-447b-b8f1-97d6714dfe53 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:17.276469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5150bc8c-1d1e-447b-b8f1-97d6714dfe53 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:17.295314 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-5150bc8c-1d1e-447b-b8f1-97d6714dfe53 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance b958bc0f-9c08-48d3-9ca5-e0593b930996 could not be found. Mar 12 21:19:17.296720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5150bc8c-1d1e-447b-b8f1-97d6714dfe53 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance b958bc0f-9c08-48d3-9ca5-e0593b930996 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:17.298039 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5150bc8c-1d1e-447b-b8f1-97d6714dfe53 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 404 len: 111 microversion: 2.1 time: 0.036877 Mar 12 21:19:17.298722 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4299/5067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:17 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:19:17.309647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5acc9b1-8717-4332-aecb-ba16dacdb21b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:17.311288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f5acc9b1-8717-4332-aecb-ba16dacdb21b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:17.318239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5acc9b1-8717-4332-aecb-ba16dacdb21b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:17.318528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5acc9b1-8717-4332-aecb-ba16dacdb21b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:17.319536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5acc9b1-8717-4332-aecb-ba16dacdb21b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:17.319992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5acc9b1-8717-4332-aecb-ba16dacdb21b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:17.517419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f5acc9b1-8717-4332-aecb-ba16dacdb21b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:17.526700 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5acc9b1-8717-4332-aecb-ba16dacdb21b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.221659 Mar 12 21:19:17.528408 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4300/5068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:17 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:17.844876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-27e5eec0-c304-4162-b616-56dc875d2d3e req-b77e0361-f37c-4ee7-9fe7-4b4a5f660c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f530c787-a5c9-4b2b-b612-6e3eda410949", "name": "network-vif-plugged", "status": "completed", "tag": "4737d116-c616-4130-a724-4b17cd243254"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:17.854329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-27e5eec0-c304-4162-b616-56dc875d2d3e req-b77e0361-f37c-4ee7-9fe7-4b4a5f660c35 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:17.855454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-27e5eec0-c304-4162-b616-56dc875d2d3e req-b77e0361-f37c-4ee7-9fe7-4b4a5f660c35 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:17.873861 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-27e5eec0-c304-4162-b616-56dc875d2d3e req-b77e0361-f37c-4ee7-9fe7-4b4a5f660c35 service nova] Creating event network-vif-plugged:4737d116-c616-4130-a724-4b17cd243254 for instance f530c787-a5c9-4b2b-b612-6e3eda410949 on nch2-master-1 Mar 12 21:19:17.879747 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-27e5eec0-c304-4162-b616-56dc875d2d3e req-b77e0361-f37c-4ee7-9fe7-4b4a5f660c35 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.349380 Mar 12 21:19:17.880785 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4301/5069] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:19:17.888884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-235dd92b-39ef-4fc7-8fd8-ab2fee60fe09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:17.890537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-235dd92b-39ef-4fc7-8fd8-ab2fee60fe09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:17.891605 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-235dd92b-39ef-4fc7-8fd8-ab2fee60fe09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.009550 Mar 12 21:19:17.893006 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4302/5070] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:17 2022] POST /compute/v2.1/servers => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:19:17.903389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1fe679b5-9a62-4f7b-a9dc-127540afafd3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:17.904142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1fe679b5-9a62-4f7b-a9dc-127540afafd3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:17.913222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fe679b5-9a62-4f7b-a9dc-127540afafd3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:17.913686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fe679b5-9a62-4f7b-a9dc-127540afafd3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:17.914565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fe679b5-9a62-4f7b-a9dc-127540afafd3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:17.915498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fe679b5-9a62-4f7b-a9dc-127540afafd3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:18.089747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1fe679b5-9a62-4f7b-a9dc-127540afafd3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:18.100019 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1fe679b5-9a62-4f7b-a9dc-127540afafd3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.202622 Mar 12 21:19:18.106132 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4303/5071] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:17 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:18.113783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30133a16-8995-4b0f-86be-747a02c6d716 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:18.114735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-30133a16-8995-4b0f-86be-747a02c6d716 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:18.121757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30133a16-8995-4b0f-86be-747a02c6d716 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:18.122297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30133a16-8995-4b0f-86be-747a02c6d716 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:18.123142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30133a16-8995-4b0f-86be-747a02c6d716 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:18.123749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30133a16-8995-4b0f-86be-747a02c6d716 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:18.265250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-30133a16-8995-4b0f-86be-747a02c6d716 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:18.272556 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30133a16-8995-4b0f-86be-747a02c6d716 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 200 len: 1371 microversion: 2.1 time: 0.165148 Mar 12 21:19:18.273126 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4304/5072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:18 2022] GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:18.278036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a602e962-06d4-47ab-9468-13391bea18ee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:18.278655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a602e962-06d4-47ab-9468-13391bea18ee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:18.284682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a602e962-06d4-47ab-9468-13391bea18ee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:18.285160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a602e962-06d4-47ab-9468-13391bea18ee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:18.285997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a602e962-06d4-47ab-9468-13391bea18ee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:18.286453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a602e962-06d4-47ab-9468-13391bea18ee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:18.435974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a602e962-06d4-47ab-9468-13391bea18ee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:18.443708 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a602e962-06d4-47ab-9468-13391bea18ee tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.169574 Mar 12 21:19:18.444293 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4305/5073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:18 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:19.291514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-36772b36-0720-4597-bf04-7906b1494e30 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:19.292360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-36772b36-0720-4597-bf04-7906b1494e30 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:19.300977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36772b36-0720-4597-bf04-7906b1494e30 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:19.301720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36772b36-0720-4597-bf04-7906b1494e30 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:19.302574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36772b36-0720-4597-bf04-7906b1494e30 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:19.303065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36772b36-0720-4597-bf04-7906b1494e30 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:19.472794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-36772b36-0720-4597-bf04-7906b1494e30 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:19.481627 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-36772b36-0720-4597-bf04-7906b1494e30 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 200 len: 1542 microversion: 2.1 time: 0.195375 Mar 12 21:19:19.482811 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4306/5074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:19 2022] GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 1542 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:19.501692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6943647e-041b-4e15-b082-9843e75dbcab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:19.502497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6943647e-041b-4e15-b082-9843e75dbcab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:19.511093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6943647e-041b-4e15-b082-9843e75dbcab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:19.511450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6943647e-041b-4e15-b082-9843e75dbcab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:19.512255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6943647e-041b-4e15-b082-9843e75dbcab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:19.512736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6943647e-041b-4e15-b082-9843e75dbcab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:19.748424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6943647e-041b-4e15-b082-9843e75dbcab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:19.760239 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6943647e-041b-4e15-b082-9843e75dbcab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 200 len: 1542 microversion: 2.1 time: 0.263287 Mar 12 21:19:19.778593 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4307/5075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:19 2022] GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 1542 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:20.079874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9480e654-79aa-4104-b669-811744973e6c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-275111298", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "16b7c90c-67e7-449d-9ad4-cbb9873bb77e", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:20.159424 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9480e654-79aa-4104-b669-811744973e6c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Block Device 16b7c90c-67e7-449d-9ad4-cbb9873bb77e is not bootable. Mar 12 21:19:20.160335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9480e654-79aa-4104-b669-811744973e6c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Block Device 16b7c90c-67e7-449d-9ad4-cbb9873bb77e is not bootable. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:20.167349 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9480e654-79aa-4104-b669-811744973e6c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.091563 Mar 12 21:19:20.173089 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4308/5076] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:20 2022] POST /compute/v2.1/servers => generated 110 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 12 21:19:20.179864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2685fa6f-8303-4dd4-8bbc-e1820a04da61 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:20.193431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2685fa6f-8303-4dd4-8bbc-e1820a04da61 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:20.208447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2685fa6f-8303-4dd4-8bbc-e1820a04da61 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:20.209044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2685fa6f-8303-4dd4-8bbc-e1820a04da61 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:20.210163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2685fa6f-8303-4dd4-8bbc-e1820a04da61 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:20.211710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2685fa6f-8303-4dd4-8bbc-e1820a04da61 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:20.452795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2685fa6f-8303-4dd4-8bbc-e1820a04da61 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:20.462346 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2685fa6f-8303-4dd4-8bbc-e1820a04da61 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.286788 Mar 12 21:19:20.464441 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4309/5077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:20 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:20.485439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce362624-591e-4fd6-9499-a29d15d24e7f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:20.486105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce362624-591e-4fd6-9499-a29d15d24e7f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:20.494031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce362624-591e-4fd6-9499-a29d15d24e7f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:20.494900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce362624-591e-4fd6-9499-a29d15d24e7f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:20.495708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce362624-591e-4fd6-9499-a29d15d24e7f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:20.496164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce362624-591e-4fd6-9499-a29d15d24e7f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:20.651609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce362624-591e-4fd6-9499-a29d15d24e7f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:20.660040 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce362624-591e-4fd6-9499-a29d15d24e7f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.180100 Mar 12 21:19:20.661410 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4310/5078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:20 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:22.155621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a940e8bb-8349-40e9-b808-df0d2360b908 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-703974172", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "539171db-0bd3-4f16-95fd-a7cd5530137d", "destination_type": "local"}, {"source_type": "volume", "uuid": "9696163c-b46a-4dff-99b8-15ac21e13208", "destination_type": "invalid"}], "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:22.159058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a940e8bb-8349-40e9-b808-df0d2360b908 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:22.160265 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a940e8bb-8349-40e9-b808-df0d2360b908 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010786 Mar 12 21:19:22.163288 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4311/5079] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:22 2022] POST /compute/v2.1/servers => generated 155 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:19:22.177309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0866e8d6-4e28-4c43-a4f9-99fa730c409a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:22.178785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0866e8d6-4e28-4c43-a4f9-99fa730c409a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:22.189908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0866e8d6-4e28-4c43-a4f9-99fa730c409a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:22.193843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0866e8d6-4e28-4c43-a4f9-99fa730c409a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:22.195226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0866e8d6-4e28-4c43-a4f9-99fa730c409a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:22.196049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0866e8d6-4e28-4c43-a4f9-99fa730c409a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:22.418686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0866e8d6-4e28-4c43-a4f9-99fa730c409a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:22.430217 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0866e8d6-4e28-4c43-a4f9-99fa730c409a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.258039 Mar 12 21:19:22.431217 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4312/5080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:22 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:22.459674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f701e28-1a73-4abf-b8e1-634fe02d9030 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:22.460397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f701e28-1a73-4abf-b8e1-634fe02d9030 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:22.468169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f701e28-1a73-4abf-b8e1-634fe02d9030 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:22.468643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f701e28-1a73-4abf-b8e1-634fe02d9030 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:22.469763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f701e28-1a73-4abf-b8e1-634fe02d9030 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:22.471414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f701e28-1a73-4abf-b8e1-634fe02d9030 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:22.658763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9f701e28-1a73-4abf-b8e1-634fe02d9030 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:22.670221 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f701e28-1a73-4abf-b8e1-634fe02d9030 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.225138 Mar 12 21:19:22.671923 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4313/5081] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:22 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:22.745505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4100d492-ed2d-4e3f-89c6-3b6e4f53d240 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-72423387", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:22.747197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4100d492-ed2d-4e3f-89c6-3b6e4f53d240 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:22.748128 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4100d492-ed2d-4e3f-89c6-3b6e4f53d240 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.007535 Mar 12 21:19:22.748844 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4314/5082] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:22 2022] POST /compute/v2.1/servers => generated 624 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:19:22.757993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0810894f-576f-43d8-acd1-414ba63562bf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:22.758736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0810894f-576f-43d8-acd1-414ba63562bf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:22.768073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0810894f-576f-43d8-acd1-414ba63562bf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:22.768829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0810894f-576f-43d8-acd1-414ba63562bf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:22.770136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0810894f-576f-43d8-acd1-414ba63562bf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:22.770915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0810894f-576f-43d8-acd1-414ba63562bf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:23.129046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0810894f-576f-43d8-acd1-414ba63562bf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:23.140358 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0810894f-576f-43d8-acd1-414ba63562bf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.386865 Mar 12 21:19:23.145902 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4315/5083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:22 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:23.161313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aff0a8fe-9510-4844-9fbf-5960819ec0f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:23.162733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aff0a8fe-9510-4844-9fbf-5960819ec0f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:23.177624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aff0a8fe-9510-4844-9fbf-5960819ec0f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:23.178829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aff0a8fe-9510-4844-9fbf-5960819ec0f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:23.181284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aff0a8fe-9510-4844-9fbf-5960819ec0f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:23.182076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aff0a8fe-9510-4844-9fbf-5960819ec0f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:23.341404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aff0a8fe-9510-4844-9fbf-5960819ec0f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:23.355360 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aff0a8fe-9510-4844-9fbf-5960819ec0f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.198470 Mar 12 21:19:23.356070 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4316/5084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:23 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:23.437958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c19fa371-0fdc-45fd-ad3c-74df280dd899 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:23.440475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c19fa371-0fdc-45fd-ad3c-74df280dd899 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:23.442325 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c19fa371-0fdc-45fd-ad3c-74df280dd899 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009036 Mar 12 21:19:23.443485 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4317/5085] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:23 2022] POST /compute/v2.1/servers => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 12 21:19:23.451667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6336b527-65fb-47f7-8548-7ba8ca17746e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:23.452458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6336b527-65fb-47f7-8548-7ba8ca17746e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:23.472974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6336b527-65fb-47f7-8548-7ba8ca17746e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:23.473452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6336b527-65fb-47f7-8548-7ba8ca17746e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:23.474304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6336b527-65fb-47f7-8548-7ba8ca17746e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:23.474761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6336b527-65fb-47f7-8548-7ba8ca17746e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:23.706387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6336b527-65fb-47f7-8548-7ba8ca17746e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:23.719586 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6336b527-65fb-47f7-8548-7ba8ca17746e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.271302 Mar 12 21:19:23.720870 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4318/5086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:23 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:23.738768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-afad3561-1711-41b4-be0e-d219bfd614f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:23.739686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-afad3561-1711-41b4-be0e-d219bfd614f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:23.748540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afad3561-1711-41b4-be0e-d219bfd614f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:23.749059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afad3561-1711-41b4-be0e-d219bfd614f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:23.750126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afad3561-1711-41b4-be0e-d219bfd614f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:23.750595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-afad3561-1711-41b4-be0e-d219bfd614f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:23.976329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-afad3561-1711-41b4-be0e-d219bfd614f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:23.985455 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-afad3561-1711-41b4-be0e-d219bfd614f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.250961 Mar 12 21:19:23.986404 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4319/5087] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:23 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:24.044013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b1ee7100-3c7f-4306-a6d8-46fda5b1cbdd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-494057184", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": -1, "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:24.056735 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b1ee7100-3c7f-4306-a6d8-46fda5b1cbdd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Flavor -1 could not be found. Mar 12 21:19:24.057718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b1ee7100-3c7f-4306-a6d8-46fda5b1cbdd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:24.062478 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b1ee7100-3c7f-4306-a6d8-46fda5b1cbdd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.021701 Mar 12 21:19:24.064237 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4320/5088] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:24 2022] POST /compute/v2.1/servers => generated 73 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Mar 12 21:19:24.073459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37ceaa6f-6b52-44c0-9cc0-1389560927c5 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:24.074388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-37ceaa6f-6b52-44c0-9cc0-1389560927c5 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:24.082385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37ceaa6f-6b52-44c0-9cc0-1389560927c5 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:24.082857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37ceaa6f-6b52-44c0-9cc0-1389560927c5 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:24.083655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37ceaa6f-6b52-44c0-9cc0-1389560927c5 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:24.084138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37ceaa6f-6b52-44c0-9cc0-1389560927c5 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:24.258820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-37ceaa6f-6b52-44c0-9cc0-1389560927c5 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:24.268085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-37ceaa6f-6b52-44c0-9cc0-1389560927c5 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.199619 Mar 12 21:19:24.269050 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4321/5089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:24 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:24.290692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b11802a-f665-4c18-bc69-b8e622b5f64f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:24.291614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b11802a-f665-4c18-bc69-b8e622b5f64f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:24.298714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b11802a-f665-4c18-bc69-b8e622b5f64f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:24.299186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b11802a-f665-4c18-bc69-b8e622b5f64f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:24.300004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b11802a-f665-4c18-bc69-b8e622b5f64f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:24.300444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b11802a-f665-4c18-bc69-b8e622b5f64f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:24.515258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b11802a-f665-4c18-bc69-b8e622b5f64f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:24.525795 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b11802a-f665-4c18-bc69-b8e622b5f64f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.239667 Mar 12 21:19:24.526692 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4322/5090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:24 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:24.607113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de6ec4ae-5b7f-4bf2-a032-2a1e50dfef63 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1090974789", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:24.608919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de6ec4ae-5b7f-4bf2-a032-2a1e50dfef63 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:24.610008 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de6ec4ae-5b7f-4bf2-a032-2a1e50dfef63 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.007983 Mar 12 21:19:24.610978 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4323/5091] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:24 2022] POST /compute/v2.1/servers => generated 145 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:19:24.620289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c657ee1e-52dd-47f1-8c04-13716ee9ba6c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:24.620984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c657ee1e-52dd-47f1-8c04-13716ee9ba6c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:24.628713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c657ee1e-52dd-47f1-8c04-13716ee9ba6c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:24.629186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c657ee1e-52dd-47f1-8c04-13716ee9ba6c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:24.630414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c657ee1e-52dd-47f1-8c04-13716ee9ba6c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:24.630545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c657ee1e-52dd-47f1-8c04-13716ee9ba6c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:24.805334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c657ee1e-52dd-47f1-8c04-13716ee9ba6c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:24.813435 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c657ee1e-52dd-47f1-8c04-13716ee9ba6c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.198088 Mar 12 21:19:24.814138 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4324/5092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:24 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:24.831574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b3f43ee7-2d43-4ad5-a09e-4af80e98c69b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:24.832205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b3f43ee7-2d43-4ad5-a09e-4af80e98c69b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:24.838380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3f43ee7-2d43-4ad5-a09e-4af80e98c69b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:24.838868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3f43ee7-2d43-4ad5-a09e-4af80e98c69b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:24.839670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3f43ee7-2d43-4ad5-a09e-4af80e98c69b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:24.840129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3f43ee7-2d43-4ad5-a09e-4af80e98c69b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:25.017935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b3f43ee7-2d43-4ad5-a09e-4af80e98c69b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:25.032677 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b3f43ee7-2d43-4ad5-a09e-4af80e98c69b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.205022 Mar 12 21:19:25.047232 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4325/5093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:24 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:25.116738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f74bcd06-12b9-43f2-b5c7-1c28bc093f34 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-384938031", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:25.123683 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f74bcd06-12b9-43f2-b5c7-1c28bc093f34 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Mar 12 21:19:25.123683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f74bcd06-12b9-43f2-b5c7-1c28bc093f34 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:25.124143 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f74bcd06-12b9-43f2-b5c7-1c28bc093f34 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.011709 Mar 12 21:19:25.125571 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4326/5094] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:25 2022] POST /compute/v2.1/servers => generated 123 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:19:25.140018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94c3fb70-6b60-48c2-bfc0-2d59b92c0eeb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:25.140808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94c3fb70-6b60-48c2-bfc0-2d59b92c0eeb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:25.154752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94c3fb70-6b60-48c2-bfc0-2d59b92c0eeb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:25.155490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94c3fb70-6b60-48c2-bfc0-2d59b92c0eeb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:25.156507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94c3fb70-6b60-48c2-bfc0-2d59b92c0eeb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:25.156974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94c3fb70-6b60-48c2-bfc0-2d59b92c0eeb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:25.528378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-94c3fb70-6b60-48c2-bfc0-2d59b92c0eeb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:25.557311 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94c3fb70-6b60-48c2-bfc0-2d59b92c0eeb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.417512 Mar 12 21:19:25.560574 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4327/5095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:25 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:25.605707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-795d0278-bc9e-4269-8b86-057fafb406ef tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:25.608596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-795d0278-bc9e-4269-8b86-057fafb406ef tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:25.626449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-795d0278-bc9e-4269-8b86-057fafb406ef tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:25.627431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-795d0278-bc9e-4269-8b86-057fafb406ef tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:25.628761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-795d0278-bc9e-4269-8b86-057fafb406ef tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:25.629442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-795d0278-bc9e-4269-8b86-057fafb406ef tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:25.865189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-795d0278-bc9e-4269-8b86-057fafb406ef tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:25.875041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-795d0278-bc9e-4269-8b86-057fafb406ef tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.299462 Mar 12 21:19:25.875679 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4328/5096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:25 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:25.970078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f158405-c514-4b8e-81e1-9147ca627b62 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2058789707", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "key_name": "tempest-key-1228677654", "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:26.048870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-1f158405-c514-4b8e-81e1-9147ca627b62 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] validate_networks() for [('a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:19:26.346542 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-1f158405-c514-4b8e-81e1-9147ca627b62 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Invalid key_name provided. Mar 12 21:19:26.347184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f158405-c514-4b8e-81e1-9147ca627b62 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Invalid key_name provided. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:26.348055 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f158405-c514-4b8e-81e1-9147ca627b62 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.382167 Mar 12 21:19:26.348840 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4329/5097] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:25 2022] POST /compute/v2.1/servers => generated 70 bytes in 384 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 12 21:19:26.361890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-07345041-fcd0-492f-b7f7-6757925528d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:26.362685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-07345041-fcd0-492f-b7f7-6757925528d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:26.369980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07345041-fcd0-492f-b7f7-6757925528d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:26.370533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07345041-fcd0-492f-b7f7-6757925528d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:26.371342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07345041-fcd0-492f-b7f7-6757925528d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:26.371887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07345041-fcd0-492f-b7f7-6757925528d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:26.573463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-07345041-fcd0-492f-b7f7-6757925528d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:26.583638 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-07345041-fcd0-492f-b7f7-6757925528d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.226807 Mar 12 21:19:26.584699 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4330/5098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:26 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:26.606235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5482a956-50a9-4ae3-bf92-6de200c4e9d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:26.607533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5482a956-50a9-4ae3-bf92-6de200c4e9d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:26.616469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5482a956-50a9-4ae3-bf92-6de200c4e9d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:26.617472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5482a956-50a9-4ae3-bf92-6de200c4e9d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:26.618458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5482a956-50a9-4ae3-bf92-6de200c4e9d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:26.618951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5482a956-50a9-4ae3-bf92-6de200c4e9d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:26.771608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5482a956-50a9-4ae3-bf92-6de200c4e9d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:26.781315 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5482a956-50a9-4ae3-bf92-6de200c4e9d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.180505 Mar 12 21:19:26.794407 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4331/5099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:26 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:26.868043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69e0e5a7-8ba9-4e00-b17a-030eb41d1000 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1327587776", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:27.015456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.security_group_api [None req-69e0e5a7-8ba9-4e00-b17a-030eb41d1000 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Neutron security group does_not_exist not found {{(pid=136302) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Mar 12 21:19:27.016179 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-69e0e5a7-8ba9-4e00-b17a-030eb41d1000 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Mar 12 21:19:27.016829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69e0e5a7-8ba9-4e00-b17a-030eb41d1000 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:27.018121 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-69e0e5a7-8ba9-4e00-b17a-030eb41d1000 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.156331 Mar 12 21:19:27.018685 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4332/5100] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:26 2022] POST /compute/v2.1/servers => generated 106 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:19:27.041830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-19400177-7045-497f-918f-7b900f3921a6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:27.041830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19400177-7045-497f-918f-7b900f3921a6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:27.048535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19400177-7045-497f-918f-7b900f3921a6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:27.049006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19400177-7045-497f-918f-7b900f3921a6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:27.049865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19400177-7045-497f-918f-7b900f3921a6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:27.050360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19400177-7045-497f-918f-7b900f3921a6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:27.213060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-19400177-7045-497f-918f-7b900f3921a6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:27.220833 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-19400177-7045-497f-918f-7b900f3921a6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.196477 Mar 12 21:19:27.221557 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4333/5101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:27 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:27.239724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-205bc849-0fb8-4f30-9491-a131d54b6619 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:27.240418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-205bc849-0fb8-4f30-9491-a131d54b6619 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:27.249928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-205bc849-0fb8-4f30-9491-a131d54b6619 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:27.250404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-205bc849-0fb8-4f30-9491-a131d54b6619 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:27.251484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-205bc849-0fb8-4f30-9491-a131d54b6619 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:27.251924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-205bc849-0fb8-4f30-9491-a131d54b6619 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:27.435861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-205bc849-0fb8-4f30-9491-a131d54b6619 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:27.444699 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-205bc849-0fb8-4f30-9491-a131d54b6619 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.209114 Mar 12 21:19:27.446149 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4334/5102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:27 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:27.463688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d60eae9e-3d07-4653-bcb3-50b0348465f4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:27.464333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d60eae9e-3d07-4653-bcb3-50b0348465f4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e6481da4-9428-48c0-9e69-6242e3acb925] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:27.470378 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d60eae9e-3d07-4653-bcb3-50b0348465f4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance e6481da4-9428-48c0-9e69-6242e3acb925 could not be found. Mar 12 21:19:27.471061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d60eae9e-3d07-4653-bcb3-50b0348465f4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance e6481da4-9428-48c0-9e69-6242e3acb925 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:27.472103 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d60eae9e-3d07-4653-bcb3-50b0348465f4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e6481da4-9428-48c0-9e69-6242e3acb925" status: 404 len: 111 microversion: 2.1 time: 0.013032 Mar 12 21:19:27.472507 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4335/5103] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:19:27 2022] DELETE /compute/v2.1/servers/e6481da4-9428-48c0-9e69-6242e3acb925 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:19:27.482010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb0cea40-609a-47f7-84be-55242c06bdb3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:27.482648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb0cea40-609a-47f7-84be-55242c06bdb3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:27.490003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb0cea40-609a-47f7-84be-55242c06bdb3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:27.490332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb0cea40-609a-47f7-84be-55242c06bdb3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:27.491381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb0cea40-609a-47f7-84be-55242c06bdb3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:27.492025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb0cea40-609a-47f7-84be-55242c06bdb3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:27.662532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bb0cea40-609a-47f7-84be-55242c06bdb3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:27.672948 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb0cea40-609a-47f7-84be-55242c06bdb3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.195646 Mar 12 21:19:27.673746 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4336/5104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:27 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:27.697115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fc5ebc1c-7759-4f94-8d53-52c28d637bc4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:27.697853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fc5ebc1c-7759-4f94-8d53-52c28d637bc4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:27.704819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc5ebc1c-7759-4f94-8d53-52c28d637bc4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:27.705295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc5ebc1c-7759-4f94-8d53-52c28d637bc4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:27.706173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc5ebc1c-7759-4f94-8d53-52c28d637bc4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:27.706629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fc5ebc1c-7759-4f94-8d53-52c28d637bc4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:27.877017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fc5ebc1c-7759-4f94-8d53-52c28d637bc4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:27.886160 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fc5ebc1c-7759-4f94-8d53-52c28d637bc4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.198718 Mar 12 21:19:27.886962 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4337/5105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:27 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:27.907518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4118fb7-140b-48ff-91ad-610e0ecf898b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:27.908351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b4118fb7-140b-48ff-91ad-610e0ecf898b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Failed to fetch instance by id 9223372036854775808 {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 12 21:19:27.908922 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b4118fb7-140b-48ff-91ad-610e0ecf898b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Mar 12 21:19:27.910050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4118fb7-140b-48ff-91ad-610e0ecf898b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:27.911156 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b4118fb7-140b-48ff-91ad-610e0ecf898b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008606 Mar 12 21:19:27.912073 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4338/5106] 10.222.0.30 () {58 vars in 1187 bytes} [Sat Mar 12 21:19:27 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 21:19:27.923858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fd15f5ae-7fa3-4180-9a1e-f00c7e457787 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:27.925221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fd15f5ae-7fa3-4180-9a1e-f00c7e457787 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:27.932056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd15f5ae-7fa3-4180-9a1e-f00c7e457787 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:27.932952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd15f5ae-7fa3-4180-9a1e-f00c7e457787 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:27.933876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd15f5ae-7fa3-4180-9a1e-f00c7e457787 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:27.934453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fd15f5ae-7fa3-4180-9a1e-f00c7e457787 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:28.096104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fd15f5ae-7fa3-4180-9a1e-f00c7e457787 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:28.106825 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fd15f5ae-7fa3-4180-9a1e-f00c7e457787 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.189191 Mar 12 21:19:28.107613 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4339/5107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:27 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:28.126568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c53fdf86-5e7f-404d-81b6-50008d90ad09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:28.127212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c53fdf86-5e7f-404d-81b6-50008d90ad09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:28.138778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c53fdf86-5e7f-404d-81b6-50008d90ad09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:28.139232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c53fdf86-5e7f-404d-81b6-50008d90ad09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:28.140210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c53fdf86-5e7f-404d-81b6-50008d90ad09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:28.140671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c53fdf86-5e7f-404d-81b6-50008d90ad09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:28.330095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c53fdf86-5e7f-404d-81b6-50008d90ad09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:28.338591 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c53fdf86-5e7f-404d-81b6-50008d90ad09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.216536 Mar 12 21:19:28.339620 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4340/5108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:28 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:28.356111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-231fd29a-d2c9-4f62-b6fd-04716a8802d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:28.356720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-231fd29a-d2c9-4f62-b6fd-04716a8802d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Failed to fetch instance by id -1 {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2924}} Mar 12 21:19:28.357337 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-231fd29a-d2c9-4f62-b6fd-04716a8802d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance -1 could not be found. Mar 12 21:19:28.358159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-231fd29a-d2c9-4f62-b6fd-04716a8802d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance -1 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:28.360419 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-231fd29a-d2c9-4f62-b6fd-04716a8802d0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008866 Mar 12 21:19:28.361000 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4341/5109] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Mar 12 21:19:28 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 12 21:19:28.373491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-95657c61-de86-4fe4-9a6a-aa798bf25d5a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:28.374234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-95657c61-de86-4fe4-9a6a-aa798bf25d5a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:28.382741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95657c61-de86-4fe4-9a6a-aa798bf25d5a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:28.383293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95657c61-de86-4fe4-9a6a-aa798bf25d5a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:28.384183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95657c61-de86-4fe4-9a6a-aa798bf25d5a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:28.384697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95657c61-de86-4fe4-9a6a-aa798bf25d5a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:28.551424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-95657c61-de86-4fe4-9a6a-aa798bf25d5a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:28.559771 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-95657c61-de86-4fe4-9a6a-aa798bf25d5a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.190074 Mar 12 21:19:28.560443 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4342/5110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:28 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:28.577376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-beff29dd-f605-4ef0-b566-de6dc4598d7c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:28.578113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-beff29dd-f605-4ef0-b566-de6dc4598d7c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:28.584519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-beff29dd-f605-4ef0-b566-de6dc4598d7c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:28.585065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-beff29dd-f605-4ef0-b566-de6dc4598d7c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:28.586964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-beff29dd-f605-4ef0-b566-de6dc4598d7c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:28.587836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-beff29dd-f605-4ef0-b566-de6dc4598d7c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:28.752567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-beff29dd-f605-4ef0-b566-de6dc4598d7c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:28.760311 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-beff29dd-f605-4ef0-b566-de6dc4598d7c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.186963 Mar 12 21:19:28.760900 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4343/5111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:28 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:28.776493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb68e7d9-c319-44eb-8e9b-0a34777078ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:28.777083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb68e7d9-c319-44eb-8e9b-0a34777078ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: 4b603beb-6249-475d-83ec-3dd4b571c4d5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:28.782331 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bb68e7d9-c319-44eb-8e9b-0a34777078ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance 4b603beb-6249-475d-83ec-3dd4b571c4d5 could not be found. Mar 12 21:19:28.782991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb68e7d9-c319-44eb-8e9b-0a34777078ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance 4b603beb-6249-475d-83ec-3dd4b571c4d5 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:28.783826 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb68e7d9-c319-44eb-8e9b-0a34777078ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/4b603beb-6249-475d-83ec-3dd4b571c4d5/action" status: 404 len: 111 microversion: 2.1 time: 0.011629 Mar 12 21:19:28.784375 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4344/5112] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:28 2022] POST /compute/v2.1/servers/4b603beb-6249-475d-83ec-3dd4b571c4d5/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:19:28.793925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea84a33f-14fe-422b-b36b-53788012668e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:28.794544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea84a33f-14fe-422b-b36b-53788012668e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:28.801339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea84a33f-14fe-422b-b36b-53788012668e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:28.801838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea84a33f-14fe-422b-b36b-53788012668e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:28.802633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea84a33f-14fe-422b-b36b-53788012668e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:28.803077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea84a33f-14fe-422b-b36b-53788012668e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:28.944212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ea84a33f-14fe-422b-b36b-53788012668e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:28.952613 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea84a33f-14fe-422b-b36b-53788012668e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.162490 Mar 12 21:19:28.953195 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4345/5113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:28 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:28.974057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7b0a5b3-1c75-46ee-aeef-3bed5a8ab95e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:28.974696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e7b0a5b3-1c75-46ee-aeef-3bed5a8ab95e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:28.981494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7b0a5b3-1c75-46ee-aeef-3bed5a8ab95e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:28.981978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7b0a5b3-1c75-46ee-aeef-3bed5a8ab95e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:28.982849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7b0a5b3-1c75-46ee-aeef-3bed5a8ab95e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:28.983532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7b0a5b3-1c75-46ee-aeef-3bed5a8ab95e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:29.128708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e7b0a5b3-1c75-46ee-aeef-3bed5a8ab95e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:29.136898 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e7b0a5b3-1c75-46ee-aeef-3bed5a8ab95e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.166936 Mar 12 21:19:29.137473 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4346/5114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:28 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:29.153162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a2d7898-bb66-4d57-bb77-2aabb8825bd0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:29.154222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a2d7898-bb66-4d57-bb77-2aabb8825bd0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: 6c453cd0-5a83-4731-b579-24b1104cf8eb] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:29.159289 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9a2d7898-bb66-4d57-bb77-2aabb8825bd0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance 6c453cd0-5a83-4731-b579-24b1104cf8eb could not be found. Mar 12 21:19:29.159879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a2d7898-bb66-4d57-bb77-2aabb8825bd0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance 6c453cd0-5a83-4731-b579-24b1104cf8eb could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:29.160688 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a2d7898-bb66-4d57-bb77-2aabb8825bd0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/6c453cd0-5a83-4731-b579-24b1104cf8eb/action" status: 404 len: 111 microversion: 2.1 time: 0.011261 Mar 12 21:19:29.161204 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4347/5115] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:29 2022] POST /compute/v2.1/servers/6c453cd0-5a83-4731-b579-24b1104cf8eb/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:19:29.168476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30622992-17a9-4851-9df1-b475f5de5d83 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:29.169136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-30622992-17a9-4851-9df1-b475f5de5d83 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:29.176054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30622992-17a9-4851-9df1-b475f5de5d83 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:29.176530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30622992-17a9-4851-9df1-b475f5de5d83 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:29.177323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30622992-17a9-4851-9df1-b475f5de5d83 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:29.177790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30622992-17a9-4851-9df1-b475f5de5d83 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:29.315910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-30622992-17a9-4851-9df1-b475f5de5d83 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:29.324750 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30622992-17a9-4851-9df1-b475f5de5d83 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.159643 Mar 12 21:19:29.325257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4348/5116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:29 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:29.346545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1425f7c1-b808-48d2-8d8f-6301be46bce9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:29.347167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1425f7c1-b808-48d2-8d8f-6301be46bce9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:29.353008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1425f7c1-b808-48d2-8d8f-6301be46bce9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:29.353471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1425f7c1-b808-48d2-8d8f-6301be46bce9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:29.354276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1425f7c1-b808-48d2-8d8f-6301be46bce9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:29.354729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1425f7c1-b808-48d2-8d8f-6301be46bce9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:29.494001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1425f7c1-b808-48d2-8d8f-6301be46bce9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:29.502028 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1425f7c1-b808-48d2-8d8f-6301be46bce9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.159101 Mar 12 21:19:29.502625 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4349/5117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:29 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:29.519274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af099985-452c-4cda-9cc3-97baa5f0019e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:29.519932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af099985-452c-4cda-9cc3-97baa5f0019e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: 157fdf0e-33a7-4bdf-aadc-7b18ff7ccd5d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:29.525568 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-af099985-452c-4cda-9cc3-97baa5f0019e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance 157fdf0e-33a7-4bdf-aadc-7b18ff7ccd5d could not be found. Mar 12 21:19:29.526208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af099985-452c-4cda-9cc3-97baa5f0019e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance 157fdf0e-33a7-4bdf-aadc-7b18ff7ccd5d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:29.527049 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af099985-452c-4cda-9cc3-97baa5f0019e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/157fdf0e-33a7-4bdf-aadc-7b18ff7ccd5d" status: 404 len: 111 microversion: 2.1 time: 0.011540 Mar 12 21:19:29.530813 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4350/5118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:29 2022] GET /compute/v2.1/servers/157fdf0e-33a7-4bdf-aadc-7b18ff7ccd5d => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:19:29.535597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e54f99f4-6799-461b-b90c-ecd31076c22a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:29.536250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e54f99f4-6799-461b-b90c-ecd31076c22a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:29.544217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e54f99f4-6799-461b-b90c-ecd31076c22a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:29.544217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e54f99f4-6799-461b-b90c-ecd31076c22a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:29.544602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e54f99f4-6799-461b-b90c-ecd31076c22a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:29.545092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e54f99f4-6799-461b-b90c-ecd31076c22a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:29.692818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e54f99f4-6799-461b-b90c-ecd31076c22a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:29.700803 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e54f99f4-6799-461b-b90c-ecd31076c22a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.168811 Mar 12 21:19:29.701423 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4351/5119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:29 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:29.719967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-06fec0d1-0752-41ad-ab33-3e3c2382a20a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:29.721143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-06fec0d1-0752-41ad-ab33-3e3c2382a20a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:29.728507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06fec0d1-0752-41ad-ab33-3e3c2382a20a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:29.728984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06fec0d1-0752-41ad-ab33-3e3c2382a20a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:29.729844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06fec0d1-0752-41ad-ab33-3e3c2382a20a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:29.730361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06fec0d1-0752-41ad-ab33-3e3c2382a20a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:29.888324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-06fec0d1-0752-41ad-ab33-3e3c2382a20a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:29.896295 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-06fec0d1-0752-41ad-ab33-3e3c2382a20a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.180359 Mar 12 21:19:29.896889 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4352/5120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:29 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:29.957422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51a7d6f0-0210-4eef-8e5d-6786528f7de2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1787240143", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:29.959120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51a7d6f0-0210-4eef-8e5d-6786528f7de2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:29.960005 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51a7d6f0-0210-4eef-8e5d-6786528f7de2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006840 Mar 12 21:19:29.960762 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4353/5121] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 12 21:19:29.968818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5331c284-6dc7-44a7-a24c-f9ead216dafd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:29.969607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5331c284-6dc7-44a7-a24c-f9ead216dafd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:29.979804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5331c284-6dc7-44a7-a24c-f9ead216dafd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:29.980310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5331c284-6dc7-44a7-a24c-f9ead216dafd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:29.981277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5331c284-6dc7-44a7-a24c-f9ead216dafd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:29.981806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5331c284-6dc7-44a7-a24c-f9ead216dafd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:30.132485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5331c284-6dc7-44a7-a24c-f9ead216dafd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:30.140161 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5331c284-6dc7-44a7-a24c-f9ead216dafd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.175289 Mar 12 21:19:30.140936 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4354/5122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:29 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:30.157624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ea3cf07-c993-4792-946e-6cb895d32463 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:30.158597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ea3cf07-c993-4792-946e-6cb895d32463 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:30.166531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ea3cf07-c993-4792-946e-6cb895d32463 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:30.167283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ea3cf07-c993-4792-946e-6cb895d32463 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:30.168637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ea3cf07-c993-4792-946e-6cb895d32463 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:30.169431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ea3cf07-c993-4792-946e-6cb895d32463 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:30.306350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6ea3cf07-c993-4792-946e-6cb895d32463 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:30.314323 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ea3cf07-c993-4792-946e-6cb895d32463 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.160474 Mar 12 21:19:30.314920 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4355/5123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:30 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:30.372317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce4af955-ddcc-4e19-860d-8835fe214500 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-822794601", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:30.374045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce4af955-ddcc-4e19-860d-8835fe214500 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:30.375014 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce4af955-ddcc-4e19-860d-8835fe214500 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.008061 Mar 12 21:19:30.375761 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4356/5124] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:30 2022] POST /compute/v2.1/servers => generated 133 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:19:30.385024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14d53616-82b0-4c04-851c-3d10b82b17c3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:30.385683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14d53616-82b0-4c04-851c-3d10b82b17c3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:30.395632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14d53616-82b0-4c04-851c-3d10b82b17c3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:30.396257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14d53616-82b0-4c04-851c-3d10b82b17c3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:30.397203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14d53616-82b0-4c04-851c-3d10b82b17c3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:30.397666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14d53616-82b0-4c04-851c-3d10b82b17c3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:30.548132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14d53616-82b0-4c04-851c-3d10b82b17c3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:30.557962 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14d53616-82b0-4c04-851c-3d10b82b17c3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.177673 Mar 12 21:19:30.558822 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4357/5125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:30 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:30.575316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b10b037b-ed71-48fb-9dff-ede2c5faef99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:30.576071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b10b037b-ed71-48fb-9dff-ede2c5faef99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:30.582025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b10b037b-ed71-48fb-9dff-ede2c5faef99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:30.582492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b10b037b-ed71-48fb-9dff-ede2c5faef99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:30.583278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b10b037b-ed71-48fb-9dff-ede2c5faef99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:30.583727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b10b037b-ed71-48fb-9dff-ede2c5faef99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:30.742967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b10b037b-ed71-48fb-9dff-ede2c5faef99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:30.753990 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b10b037b-ed71-48fb-9dff-ede2c5faef99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.182698 Mar 12 21:19:30.754706 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4358/5126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:30 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:30.772477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab40d06e-03f4-47b3-9e9f-340662be7676 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:30.773574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ab40d06e-03f4-47b3-9e9f-340662be7676 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: 46471583-e4dc-4070-900e-ed3355755ce0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:30.779261 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ab40d06e-03f4-47b3-9e9f-340662be7676 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance 46471583-e4dc-4070-900e-ed3355755ce0 could not be found. Mar 12 21:19:30.779926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab40d06e-03f4-47b3-9e9f-340662be7676 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance 46471583-e4dc-4070-900e-ed3355755ce0 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:30.780772 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ab40d06e-03f4-47b3-9e9f-340662be7676 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/46471583-e4dc-4070-900e-ed3355755ce0/action" status: 404 len: 111 microversion: 2.1 time: 0.012442 Mar 12 21:19:30.781355 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4359/5127] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:30 2022] POST /compute/v2.1/servers/46471583-e4dc-4070-900e-ed3355755ce0/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:19:30.792926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21e51168-b0b3-4106-a461-0492e45a00cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:30.792926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-21e51168-b0b3-4106-a461-0492e45a00cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:30.800509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21e51168-b0b3-4106-a461-0492e45a00cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:30.801123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21e51168-b0b3-4106-a461-0492e45a00cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:30.801949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21e51168-b0b3-4106-a461-0492e45a00cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:30.802732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21e51168-b0b3-4106-a461-0492e45a00cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:30.972661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21e51168-b0b3-4106-a461-0492e45a00cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:30.981265 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21e51168-b0b3-4106-a461-0492e45a00cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.195480 Mar 12 21:19:30.982595 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4360/5128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:30 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:30.998605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-87f32651-9570-4fd0-86e8-fb600127abb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:30.999367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-87f32651-9570-4fd0-86e8-fb600127abb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:31.006445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87f32651-9570-4fd0-86e8-fb600127abb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:31.006942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87f32651-9570-4fd0-86e8-fb600127abb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:31.007922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87f32651-9570-4fd0-86e8-fb600127abb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:31.008339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87f32651-9570-4fd0-86e8-fb600127abb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:31.159421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-87f32651-9570-4fd0-86e8-fb600127abb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:31.170485 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-87f32651-9570-4fd0-86e8-fb600127abb2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.176007 Mar 12 21:19:31.171916 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4361/5129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:30 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:31.190193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-feff1eae-2221-40fc-b3d8-80a006a2c7cb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:31.191247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-feff1eae-2221-40fc-b3d8-80a006a2c7cb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:31.197496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feff1eae-2221-40fc-b3d8-80a006a2c7cb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:31.198080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feff1eae-2221-40fc-b3d8-80a006a2c7cb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:31.198904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feff1eae-2221-40fc-b3d8-80a006a2c7cb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:31.199371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-feff1eae-2221-40fc-b3d8-80a006a2c7cb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:31.267623 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-feff1eae-2221-40fc-b3d8-80a006a2c7cb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 202 len: 0 microversion: 2.1 time: 0.081847 Mar 12 21:19:31.268278 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4362/5130] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:31 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:19:31.276568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-340b7dad-c49c-4020-a50e-9232b87c2a43 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:31.277297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-340b7dad-c49c-4020-a50e-9232b87c2a43 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:31.283687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-340b7dad-c49c-4020-a50e-9232b87c2a43 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:31.284263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-340b7dad-c49c-4020-a50e-9232b87c2a43 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:31.285102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-340b7dad-c49c-4020-a50e-9232b87c2a43 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:31.285545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-340b7dad-c49c-4020-a50e-9232b87c2a43 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:31.432103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-340b7dad-c49c-4020-a50e-9232b87c2a43 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:31.440956 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-340b7dad-c49c-4020-a50e-9232b87c2a43 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1511 microversion: 2.1 time: 0.168499 Mar 12 21:19:31.441559 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4363/5131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:31 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:32.458168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e19c10f4-61f8-4d09-93ee-585c4d892f90 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:32.458821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e19c10f4-61f8-4d09-93ee-585c4d892f90 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:32.466135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e19c10f4-61f8-4d09-93ee-585c4d892f90 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:32.466610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e19c10f4-61f8-4d09-93ee-585c4d892f90 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:32.467442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e19c10f4-61f8-4d09-93ee-585c4d892f90 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:32.467847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e19c10f4-61f8-4d09-93ee-585c4d892f90 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:32.603720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e19c10f4-61f8-4d09-93ee-585c4d892f90 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:32.611633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e19c10f4-61f8-4d09-93ee-585c4d892f90 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1491 microversion: 2.1 time: 0.157395 Mar 12 21:19:32.612218 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4364/5132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:32 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1491 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:32.627771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-972e9384-e358-47b3-9de7-e682be50fba1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:32.628328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-972e9384-e358-47b3-9de7-e682be50fba1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:32.635086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-972e9384-e358-47b3-9de7-e682be50fba1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:32.635632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-972e9384-e358-47b3-9de7-e682be50fba1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:32.636677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-972e9384-e358-47b3-9de7-e682be50fba1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:32.637261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-972e9384-e358-47b3-9de7-e682be50fba1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:32.661762 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-972e9384-e358-47b3-9de7-e682be50fba1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Cannot 'pause' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state paused Mar 12 21:19:32.662397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-972e9384-e358-47b3-9de7-e682be50fba1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 409 to user: Cannot 'pause' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state paused {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:32.663245 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-972e9384-e358-47b3-9de7-e682be50fba1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 409 len: 143 microversion: 2.1 time: 0.039473 Mar 12 21:19:32.663831 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4365/5133] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:32 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 143 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 12 21:19:32.672163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-040e3033-0703-499c-a772-5caed9116cd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:32.672709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-040e3033-0703-499c-a772-5caed9116cd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:32.678837 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-040e3033-0703-499c-a772-5caed9116cd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:32.679334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-040e3033-0703-499c-a772-5caed9116cd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:32.680119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-040e3033-0703-499c-a772-5caed9116cd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:32.680568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-040e3033-0703-499c-a772-5caed9116cd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:32.757063 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-040e3033-0703-499c-a772-5caed9116cd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 202 len: 0 microversion: 2.1 time: 0.088789 Mar 12 21:19:32.761704 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4366/5134] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:32 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:19:32.767143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27e71822-620c-4f0c-84d7-8c94a86836a0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:32.767935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27e71822-620c-4f0c-84d7-8c94a86836a0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:32.775227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27e71822-620c-4f0c-84d7-8c94a86836a0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:32.775777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27e71822-620c-4f0c-84d7-8c94a86836a0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:32.776588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27e71822-620c-4f0c-84d7-8c94a86836a0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:32.777071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27e71822-620c-4f0c-84d7-8c94a86836a0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:32.992280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27e71822-620c-4f0c-84d7-8c94a86836a0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:33.011913 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27e71822-620c-4f0c-84d7-8c94a86836a0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1498 microversion: 2.1 time: 0.248798 Mar 12 21:19:33.012916 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4367/5135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:32 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1498 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:34.030587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-441ada41-10de-481d-8ca7-30cadcf6fd6a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:34.031306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-441ada41-10de-481d-8ca7-30cadcf6fd6a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:34.039665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-441ada41-10de-481d-8ca7-30cadcf6fd6a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:34.040130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-441ada41-10de-481d-8ca7-30cadcf6fd6a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:34.040954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-441ada41-10de-481d-8ca7-30cadcf6fd6a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:34.041412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-441ada41-10de-481d-8ca7-30cadcf6fd6a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:34.201035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-441ada41-10de-481d-8ca7-30cadcf6fd6a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:34.209188 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-441ada41-10de-481d-8ca7-30cadcf6fd6a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.182535 Mar 12 21:19:34.210073 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4368/5136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:34 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:34.229328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-31acd256-779a-4ebf-b954-a57a5294f909 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:34.230018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-31acd256-779a-4ebf-b954-a57a5294f909 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:34.236694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31acd256-779a-4ebf-b954-a57a5294f909 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:34.237156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31acd256-779a-4ebf-b954-a57a5294f909 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:34.238065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31acd256-779a-4ebf-b954-a57a5294f909 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:34.238526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31acd256-779a-4ebf-b954-a57a5294f909 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:34.455747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-31acd256-779a-4ebf-b954-a57a5294f909 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:34.466882 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-31acd256-779a-4ebf-b954-a57a5294f909 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.241640 Mar 12 21:19:34.467741 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4369/5137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:34 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:34.487433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39141dc5-ea4b-4e30-b8a2-9d565a751d1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:34.488570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39141dc5-ea4b-4e30-b8a2-9d565a751d1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:34.497029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39141dc5-ea4b-4e30-b8a2-9d565a751d1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:34.498002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39141dc5-ea4b-4e30-b8a2-9d565a751d1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:34.498905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39141dc5-ea4b-4e30-b8a2-9d565a751d1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:34.499478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39141dc5-ea4b-4e30-b8a2-9d565a751d1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:34.518821 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-39141dc5-ea4b-4e30-b8a2-9d565a751d1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance b958bc0f-9c08-48d3-9ca5-e0593b930996 could not be found. Mar 12 21:19:34.519682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39141dc5-ea4b-4e30-b8a2-9d565a751d1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance b958bc0f-9c08-48d3-9ca5-e0593b930996 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:34.520694 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39141dc5-ea4b-4e30-b8a2-9d565a751d1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996/action" status: 404 len: 111 microversion: 2.1 time: 0.039913 Mar 12 21:19:34.521581 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4370/5138] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:34 2022] POST /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:19:34.531101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4303b750-9ff9-4bfd-a1ce-c0a2a972c7d9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:34.531995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4303b750-9ff9-4bfd-a1ce-c0a2a972c7d9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:34.559065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4303b750-9ff9-4bfd-a1ce-c0a2a972c7d9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:34.559570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4303b750-9ff9-4bfd-a1ce-c0a2a972c7d9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:34.560786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4303b750-9ff9-4bfd-a1ce-c0a2a972c7d9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:34.561548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4303b750-9ff9-4bfd-a1ce-c0a2a972c7d9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:34.736127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4303b750-9ff9-4bfd-a1ce-c0a2a972c7d9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:34.748090 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4303b750-9ff9-4bfd-a1ce-c0a2a972c7d9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.221520 Mar 12 21:19:34.748957 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4371/5139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:34 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:34.777171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c1edd0b-7e78-4e5c-bc5e-8913436e07b7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:34.777394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c1edd0b-7e78-4e5c-bc5e-8913436e07b7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:34.786038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1edd0b-7e78-4e5c-bc5e-8913436e07b7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:34.786734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1edd0b-7e78-4e5c-bc5e-8913436e07b7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:34.789070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1edd0b-7e78-4e5c-bc5e-8913436e07b7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:34.790105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c1edd0b-7e78-4e5c-bc5e-8913436e07b7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:34.978995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c1edd0b-7e78-4e5c-bc5e-8913436e07b7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:34.992575 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c1edd0b-7e78-4e5c-bc5e-8913436e07b7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.225408 Mar 12 21:19:34.993489 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4372/5140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:34 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:35.015534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf300b94-6804-4897-b7a7-611aa0a49e73 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:35.016507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bf300b94-6804-4897-b7a7-611aa0a49e73 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: be2a6ab0-c719-43b3-9188-446ed41b32b5] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:35.022665 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bf300b94-6804-4897-b7a7-611aa0a49e73 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance be2a6ab0-c719-43b3-9188-446ed41b32b5 could not be found. Mar 12 21:19:35.023324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf300b94-6804-4897-b7a7-611aa0a49e73 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance be2a6ab0-c719-43b3-9188-446ed41b32b5 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:35.024242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bf300b94-6804-4897-b7a7-611aa0a49e73 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/be2a6ab0-c719-43b3-9188-446ed41b32b5/action" status: 404 len: 111 microversion: 2.1 time: 0.013929 Mar 12 21:19:35.027988 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4373/5141] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:35 2022] POST /compute/v2.1/servers/be2a6ab0-c719-43b3-9188-446ed41b32b5/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:19:35.034123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c90d9b7c-2cde-4a91-942d-268a8cbcac1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:35.034123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c90d9b7c-2cde-4a91-942d-268a8cbcac1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:35.047678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c90d9b7c-2cde-4a91-942d-268a8cbcac1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:35.048442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c90d9b7c-2cde-4a91-942d-268a8cbcac1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:35.050454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c90d9b7c-2cde-4a91-942d-268a8cbcac1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:35.050998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c90d9b7c-2cde-4a91-942d-268a8cbcac1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:35.259144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c90d9b7c-2cde-4a91-942d-268a8cbcac1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:35.274458 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c90d9b7c-2cde-4a91-942d-268a8cbcac1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.244894 Mar 12 21:19:35.275434 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4374/5142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:35 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:35.304104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf4ddaa0-97b3-4f8a-86ca-bf208d90a008 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:35.305093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bf4ddaa0-97b3-4f8a-86ca-bf208d90a008 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:35.318485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf4ddaa0-97b3-4f8a-86ca-bf208d90a008 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:35.318996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf4ddaa0-97b3-4f8a-86ca-bf208d90a008 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:35.319939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf4ddaa0-97b3-4f8a-86ca-bf208d90a008 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:35.320631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf4ddaa0-97b3-4f8a-86ca-bf208d90a008 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:35.499619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bf4ddaa0-97b3-4f8a-86ca-bf208d90a008 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:35.510007 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bf4ddaa0-97b3-4f8a-86ca-bf208d90a008 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.212748 Mar 12 21:19:35.510643 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4375/5143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:35 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:35.530755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23cdde25-5c48-41e5-9ad0-35333941e1dd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:35.532949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-23cdde25-5c48-41e5-9ad0-35333941e1dd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:35.540260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23cdde25-5c48-41e5-9ad0-35333941e1dd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:35.540724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23cdde25-5c48-41e5-9ad0-35333941e1dd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:35.541715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23cdde25-5c48-41e5-9ad0-35333941e1dd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:35.542360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23cdde25-5c48-41e5-9ad0-35333941e1dd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:35.570609 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-23cdde25-5c48-41e5-9ad0-35333941e1dd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance b958bc0f-9c08-48d3-9ca5-e0593b930996 could not be found. Mar 12 21:19:35.571268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23cdde25-5c48-41e5-9ad0-35333941e1dd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance b958bc0f-9c08-48d3-9ca5-e0593b930996 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:35.572242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-23cdde25-5c48-41e5-9ad0-35333941e1dd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996/action" status: 404 len: 111 microversion: 2.1 time: 0.046569 Mar 12 21:19:35.577803 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4376/5144] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:35 2022] POST /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:19:35.583963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72d4060d-5813-4853-9916-c03bbd6bf7bb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:35.584617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-72d4060d-5813-4853-9916-c03bbd6bf7bb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:35.593622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72d4060d-5813-4853-9916-c03bbd6bf7bb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:35.595530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72d4060d-5813-4853-9916-c03bbd6bf7bb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:35.595530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72d4060d-5813-4853-9916-c03bbd6bf7bb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:35.595530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72d4060d-5813-4853-9916-c03bbd6bf7bb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:35.800267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-72d4060d-5813-4853-9916-c03bbd6bf7bb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:35.813378 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72d4060d-5813-4853-9916-c03bbd6bf7bb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.230615 Mar 12 21:19:35.814085 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4377/5145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:35 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:35.836603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c757ab8f-04ef-4252-ac31-9c63d89f669e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:35.837305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c757ab8f-04ef-4252-ac31-9c63d89f669e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:35.844442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c757ab8f-04ef-4252-ac31-9c63d89f669e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:35.844865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c757ab8f-04ef-4252-ac31-9c63d89f669e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:35.846975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c757ab8f-04ef-4252-ac31-9c63d89f669e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:35.846975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c757ab8f-04ef-4252-ac31-9c63d89f669e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:36.014882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c757ab8f-04ef-4252-ac31-9c63d89f669e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:36.023818 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c757ab8f-04ef-4252-ac31-9c63d89f669e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.191771 Mar 12 21:19:36.024408 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4378/5146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:35 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:36.043301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7df46357-7a08-458f-8430-18117e44574d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:36.044692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7df46357-7a08-458f-8430-18117e44574d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: 17ba7e18-9cc0-4d63-82db-dc2fd7e6bae4] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:36.052022 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-7df46357-7a08-458f-8430-18117e44574d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance 17ba7e18-9cc0-4d63-82db-dc2fd7e6bae4 could not be found. Mar 12 21:19:36.052585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7df46357-7a08-458f-8430-18117e44574d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance 17ba7e18-9cc0-4d63-82db-dc2fd7e6bae4 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:36.053514 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7df46357-7a08-458f-8430-18117e44574d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/17ba7e18-9cc0-4d63-82db-dc2fd7e6bae4/action" status: 404 len: 111 microversion: 2.1 time: 0.016508 Mar 12 21:19:36.054726 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4379/5147] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:36 2022] POST /compute/v2.1/servers/17ba7e18-9cc0-4d63-82db-dc2fd7e6bae4/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:19:36.063566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a48135d0-6d73-4a95-96f7-0d0ce755d99e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:36.064213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a48135d0-6d73-4a95-96f7-0d0ce755d99e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:36.072473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a48135d0-6d73-4a95-96f7-0d0ce755d99e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:36.072934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a48135d0-6d73-4a95-96f7-0d0ce755d99e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:36.073754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a48135d0-6d73-4a95-96f7-0d0ce755d99e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:36.074287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a48135d0-6d73-4a95-96f7-0d0ce755d99e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:36.210923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a48135d0-6d73-4a95-96f7-0d0ce755d99e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:36.218386 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a48135d0-6d73-4a95-96f7-0d0ce755d99e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.158886 Mar 12 21:19:36.219114 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4380/5148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:36 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:36.234824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49483403-4bb3-4a5a-8b9c-15d9f444287d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:36.235457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-49483403-4bb3-4a5a-8b9c-15d9f444287d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:36.241129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49483403-4bb3-4a5a-8b9c-15d9f444287d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:36.242125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49483403-4bb3-4a5a-8b9c-15d9f444287d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:36.242916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49483403-4bb3-4a5a-8b9c-15d9f444287d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:36.243371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49483403-4bb3-4a5a-8b9c-15d9f444287d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:36.693263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-49483403-4bb3-4a5a-8b9c-15d9f444287d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:36.703042 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-49483403-4bb3-4a5a-8b9c-15d9f444287d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.471806 Mar 12 21:19:36.703637 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4381/5149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:36 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:36.720213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-086fb092-6987-407a-8d34-9de209629202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:36.720782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-086fb092-6987-407a-8d34-9de209629202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: caf14e0d-8bd4-4a08-9465-f70bda9a2d67] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:36.726276 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-086fb092-6987-407a-8d34-9de209629202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance caf14e0d-8bd4-4a08-9465-f70bda9a2d67 could not be found. Mar 12 21:19:36.726836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-086fb092-6987-407a-8d34-9de209629202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance caf14e0d-8bd4-4a08-9465-f70bda9a2d67 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:36.727655 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-086fb092-6987-407a-8d34-9de209629202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/caf14e0d-8bd4-4a08-9465-f70bda9a2d67/action" status: 404 len: 111 microversion: 2.1 time: 0.011458 Mar 12 21:19:36.728191 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4382/5150] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:36 2022] POST /compute/v2.1/servers/caf14e0d-8bd4-4a08-9465-f70bda9a2d67/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:19:36.736424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7fdd7dfa-72bb-4517-9fa8-2a8b9e59fe1b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:36.737084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7fdd7dfa-72bb-4517-9fa8-2a8b9e59fe1b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:36.744879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7fdd7dfa-72bb-4517-9fa8-2a8b9e59fe1b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:36.745354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7fdd7dfa-72bb-4517-9fa8-2a8b9e59fe1b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:36.746257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7fdd7dfa-72bb-4517-9fa8-2a8b9e59fe1b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:36.746716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7fdd7dfa-72bb-4517-9fa8-2a8b9e59fe1b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:36.889560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7fdd7dfa-72bb-4517-9fa8-2a8b9e59fe1b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:36.897638 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7fdd7dfa-72bb-4517-9fa8-2a8b9e59fe1b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.164907 Mar 12 21:19:36.898253 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4383/5151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:36 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:36.916865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-234a12d0-79e0-4ab5-94f1-b458b7d997a7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:36.917512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-234a12d0-79e0-4ab5-94f1-b458b7d997a7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:36.924066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-234a12d0-79e0-4ab5-94f1-b458b7d997a7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:36.924545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-234a12d0-79e0-4ab5-94f1-b458b7d997a7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:36.925350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-234a12d0-79e0-4ab5-94f1-b458b7d997a7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:36.925844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-234a12d0-79e0-4ab5-94f1-b458b7d997a7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.064394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-234a12d0-79e0-4ab5-94f1-b458b7d997a7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:37.072558 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-234a12d0-79e0-4ab5-94f1-b458b7d997a7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.160498 Mar 12 21:19:37.073146 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4384/5152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:36 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:37.088268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-00c7814a-d2dd-4b97-8c63-ef01a99ac5f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:37.088823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-00c7814a-d2dd-4b97-8c63-ef01a99ac5f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:37.094656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-00c7814a-d2dd-4b97-8c63-ef01a99ac5f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.095131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-00c7814a-d2dd-4b97-8c63-ef01a99ac5f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.095929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-00c7814a-d2dd-4b97-8c63-ef01a99ac5f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.096389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-00c7814a-d2dd-4b97-8c63-ef01a99ac5f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.119386 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-00c7814a-d2dd-4b97-8c63-ef01a99ac5f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Cannot 'restore' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state active Mar 12 21:19:37.120009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-00c7814a-d2dd-4b97-8c63-ef01a99ac5f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 409 to user: Cannot 'restore' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state active {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:37.120865 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-00c7814a-d2dd-4b97-8c63-ef01a99ac5f8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 409 len: 145 microversion: 2.1 time: 0.036462 Mar 12 21:19:37.121433 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4385/5153] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:37 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 145 bytes in 37 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 12 21:19:37.129147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-964e2545-565d-4126-b402-fa07a3fd7db4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:37.129800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-964e2545-565d-4126-b402-fa07a3fd7db4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:37.136239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-964e2545-565d-4126-b402-fa07a3fd7db4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.136715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-964e2545-565d-4126-b402-fa07a3fd7db4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.137502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-964e2545-565d-4126-b402-fa07a3fd7db4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.137998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-964e2545-565d-4126-b402-fa07a3fd7db4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.266479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-964e2545-565d-4126-b402-fa07a3fd7db4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:37.274251 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-964e2545-565d-4126-b402-fa07a3fd7db4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.148618 Mar 12 21:19:37.274829 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4386/5154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:37 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:37.279331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f53b5187-d406-4c0d-a700-1dacddd8774e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:37.279854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f53b5187-d406-4c0d-a700-1dacddd8774e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:37.285426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f53b5187-d406-4c0d-a700-1dacddd8774e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.286184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f53b5187-d406-4c0d-a700-1dacddd8774e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.286988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f53b5187-d406-4c0d-a700-1dacddd8774e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.287453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f53b5187-d406-4c0d-a700-1dacddd8774e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.312405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f53b5187-d406-4c0d-a700-1dacddd8774e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:19:37.384281 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f53b5187-d406-4c0d-a700-1dacddd8774e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 204 len: 0 microversion: 2.1 time: 0.108033 Mar 12 21:19:37.385142 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4387/5155] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:19:37 2022] DELETE /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:19:37.390627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69f65858-3257-4ab1-b2e8-63c3eb17aa92 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:37.391437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-69f65858-3257-4ab1-b2e8-63c3eb17aa92 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:37.398304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69f65858-3257-4ab1-b2e8-63c3eb17aa92 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.398765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69f65858-3257-4ab1-b2e8-63c3eb17aa92 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.399548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69f65858-3257-4ab1-b2e8-63c3eb17aa92 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.400002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69f65858-3257-4ab1-b2e8-63c3eb17aa92 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.534964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-69f65858-3257-4ab1-b2e8-63c3eb17aa92 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:37.543084 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-69f65858-3257-4ab1-b2e8-63c3eb17aa92 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.156987 Mar 12 21:19:37.543667 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4388/5156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:37 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:37.548617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69c7eb15-f670-4114-ad4e-737b8c784f55 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:37.549238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-69c7eb15-f670-4114-ad4e-737b8c784f55 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:37.554847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69c7eb15-f670-4114-ad4e-737b8c784f55 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.555401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69c7eb15-f670-4114-ad4e-737b8c784f55 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.556190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69c7eb15-f670-4114-ad4e-737b8c784f55 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.556648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69c7eb15-f670-4114-ad4e-737b8c784f55 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.689490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-69c7eb15-f670-4114-ad4e-737b8c784f55 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:37.696932 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-69c7eb15-f670-4114-ad4e-737b8c784f55 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1579 microversion: 2.1 time: 0.152241 Mar 12 21:19:37.697513 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4389/5157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:37 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1579 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:37.701980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1685983-9875-4313-be17-be291752c5d2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:37.702521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1685983-9875-4313-be17-be291752c5d2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: 4dfc0398-ffc0-489a-871f-e16a8c2f41f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:37.707573 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d1685983-9875-4313-be17-be291752c5d2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance 4dfc0398-ffc0-489a-871f-e16a8c2f41f0 could not be found. Mar 12 21:19:37.708166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1685983-9875-4313-be17-be291752c5d2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance 4dfc0398-ffc0-489a-871f-e16a8c2f41f0 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:37.708982 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1685983-9875-4313-be17-be291752c5d2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/4dfc0398-ffc0-489a-871f-e16a8c2f41f0/action" status: 404 len: 111 microversion: 2.1 time: 0.010519 Mar 12 21:19:37.709572 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4390/5158] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:37 2022] POST /compute/v2.1/servers/4dfc0398-ffc0-489a-871f-e16a8c2f41f0/action => generated 111 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:19:37.717396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-862fb42d-07e6-47f2-93f1-e27c85e7a565 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:37.718035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-862fb42d-07e6-47f2-93f1-e27c85e7a565 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:37.724456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-862fb42d-07e6-47f2-93f1-e27c85e7a565 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.724919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-862fb42d-07e6-47f2-93f1-e27c85e7a565 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.725719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-862fb42d-07e6-47f2-93f1-e27c85e7a565 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.726769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-862fb42d-07e6-47f2-93f1-e27c85e7a565 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.856451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-862fb42d-07e6-47f2-93f1-e27c85e7a565 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:37.863883 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-862fb42d-07e6-47f2-93f1-e27c85e7a565 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.149791 Mar 12 21:19:37.864449 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4391/5159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:37 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:37.880000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f172cd93-971c-4bf5-85b1-3595f7dbc05e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:37.880625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f172cd93-971c-4bf5-85b1-3595f7dbc05e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:37.886929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f172cd93-971c-4bf5-85b1-3595f7dbc05e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.887395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f172cd93-971c-4bf5-85b1-3595f7dbc05e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:37.888174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f172cd93-971c-4bf5-85b1-3595f7dbc05e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:37.888657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f172cd93-971c-4bf5-85b1-3595f7dbc05e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:38.026288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f172cd93-971c-4bf5-85b1-3595f7dbc05e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:38.033970 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f172cd93-971c-4bf5-85b1-3595f7dbc05e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.157498 Mar 12 21:19:38.041873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4392/5160] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:37 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:38.050494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5398bd92-51f7-46b7-a399-d03ff06dcbe9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:38.051044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5398bd92-51f7-46b7-a399-d03ff06dcbe9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:38.057452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5398bd92-51f7-46b7-a399-d03ff06dcbe9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:38.057898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5398bd92-51f7-46b7-a399-d03ff06dcbe9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:38.058688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5398bd92-51f7-46b7-a399-d03ff06dcbe9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:38.059139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5398bd92-51f7-46b7-a399-d03ff06dcbe9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:38.082095 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-5398bd92-51f7-46b7-a399-d03ff06dcbe9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Cannot 'resume' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state active Mar 12 21:19:38.082856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5398bd92-51f7-46b7-a399-d03ff06dcbe9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 409 to user: Cannot 'resume' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state active {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:38.083566 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5398bd92-51f7-46b7-a399-d03ff06dcbe9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 409 len: 144 microversion: 2.1 time: 0.037556 Mar 12 21:19:38.084127 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4393/5161] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:38 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 144 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 12 21:19:38.093337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f13913dc-7c37-4dcb-a4bd-cb79cdc69dd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:38.094057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f13913dc-7c37-4dcb-a4bd-cb79cdc69dd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:38.100142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f13913dc-7c37-4dcb-a4bd-cb79cdc69dd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:38.100609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f13913dc-7c37-4dcb-a4bd-cb79cdc69dd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:38.101983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f13913dc-7c37-4dcb-a4bd-cb79cdc69dd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:38.102442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f13913dc-7c37-4dcb-a4bd-cb79cdc69dd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:38.234534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f13913dc-7c37-4dcb-a4bd-cb79cdc69dd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:38.242485 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f13913dc-7c37-4dcb-a4bd-cb79cdc69dd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.152579 Mar 12 21:19:38.243070 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4394/5162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:38 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:38.247661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2504367-ba1b-4ea3-8b09-779e76d791e1 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Action: 'create', calling method: .version_select at 0x7f6e374e2310>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-543788082"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:38.262032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f2504367-ba1b-4ea3-8b09-779e76d791e1 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Getting quotas for project 2e6a0660e45d4aea9ff4576abd1f0e56. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:19:38.267109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f2504367-ba1b-4ea3-8b09-779e76d791e1 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Getting quotas for user 62b74fe4246c415bbb401849ce000f9b and project 2e6a0660e45d4aea9ff4576abd1f0e56. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:19:38.495080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f2504367-ba1b-4ea3-8b09-779e76d791e1 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Getting quotas for project 2e6a0660e45d4aea9ff4576abd1f0e56. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:19:38.500065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f2504367-ba1b-4ea3-8b09-779e76d791e1 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Getting quotas for user 62b74fe4246c415bbb401849ce000f9b and project 2e6a0660e45d4aea9ff4576abd1f0e56. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:19:38.515220 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2504367-ba1b-4ea3-8b09-779e76d791e1 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.271132 Mar 12 21:19:38.515832 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4395/5163] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:19:38 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:38.520595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e6cd1517-7897-42ca-8b39-9def3911d4c7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:38.521436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e6cd1517-7897-42ca-8b39-9def3911d4c7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:38.527264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6cd1517-7897-42ca-8b39-9def3911d4c7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:38.527735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6cd1517-7897-42ca-8b39-9def3911d4c7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:38.528602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6cd1517-7897-42ca-8b39-9def3911d4c7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:38.529085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6cd1517-7897-42ca-8b39-9def3911d4c7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:38.678861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e6cd1517-7897-42ca-8b39-9def3911d4c7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:38.687647 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e6cd1517-7897-42ca-8b39-9def3911d4c7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.170803 Mar 12 21:19:38.688299 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4396/5164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:38 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:38.714412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2d1e959-ef93-4384-b8b2-5e40ac517d0b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:38.715391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2d1e959-ef93-4384-b8b2-5e40ac517d0b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:38.721511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d1e959-ef93-4384-b8b2-5e40ac517d0b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:38.722028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d1e959-ef93-4384-b8b2-5e40ac517d0b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:38.722861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d1e959-ef93-4384-b8b2-5e40ac517d0b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:38.723322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d1e959-ef93-4384-b8b2-5e40ac517d0b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:38.877359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f2d1e959-ef93-4384-b8b2-5e40ac517d0b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:38.885289 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2d1e959-ef93-4384-b8b2-5e40ac517d0b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 200 len: 1579 microversion: 2.1 time: 0.175513 Mar 12 21:19:38.886000 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4397/5165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:38 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:38.890585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f3284a74-b2e4-47c8-8866-967f436b2163 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "a9bdb9f7-2c77-4b12-9b3b-fe4edb955d6a"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:38.891818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f3284a74-b2e4-47c8-8866-967f436b2163 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:38.892764 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f3284a74-b2e4-47c8-8866-967f436b2163 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.005695 Mar 12 21:19:38.893514 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4398/5166] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:38 2022] POST /compute/v2.1/servers => generated 108 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 12 21:19:38.904246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-68da1b5b-b3d6-468d-9300-6bf3e98bd1cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:38.905186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-68da1b5b-b3d6-468d-9300-6bf3e98bd1cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:38.915479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68da1b5b-b3d6-468d-9300-6bf3e98bd1cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:38.916163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68da1b5b-b3d6-468d-9300-6bf3e98bd1cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:38.917333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68da1b5b-b3d6-468d-9300-6bf3e98bd1cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:38.917913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68da1b5b-b3d6-468d-9300-6bf3e98bd1cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:39.077092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-68da1b5b-b3d6-468d-9300-6bf3e98bd1cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:39.084787 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-68da1b5b-b3d6-468d-9300-6bf3e98bd1cd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.186289 Mar 12 21:19:39.086228 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4399/5167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:38 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:39.104576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90544fe5-5ede-4409-a85b-68a5585807f7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:39.105245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90544fe5-5ede-4409-a85b-68a5585807f7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:39.111377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90544fe5-5ede-4409-a85b-68a5585807f7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:39.111850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90544fe5-5ede-4409-a85b-68a5585807f7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:39.112706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90544fe5-5ede-4409-a85b-68a5585807f7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:39.113306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90544fe5-5ede-4409-a85b-68a5585807f7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:39.346670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90544fe5-5ede-4409-a85b-68a5585807f7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:39.355206 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90544fe5-5ede-4409-a85b-68a5585807f7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.256535 Mar 12 21:19:39.356344 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4400/5168] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:39 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:39.373008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d29966ed-64cb-4618-b494-2e3be2088a72 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:39.373572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d29966ed-64cb-4618-b494-2e3be2088a72 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: 310212a4-707d-4d36-b464-0e0896663d60] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:39.379374 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d29966ed-64cb-4618-b494-2e3be2088a72 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance 310212a4-707d-4d36-b464-0e0896663d60 could not be found. Mar 12 21:19:39.380197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d29966ed-64cb-4618-b494-2e3be2088a72 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance 310212a4-707d-4d36-b464-0e0896663d60 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:39.381062 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d29966ed-64cb-4618-b494-2e3be2088a72 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/310212a4-707d-4d36-b464-0e0896663d60/action" status: 404 len: 111 microversion: 2.1 time: 0.012988 Mar 12 21:19:39.381647 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4401/5169] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:39 2022] POST /compute/v2.1/servers/310212a4-707d-4d36-b464-0e0896663d60/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:19:39.390287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c173487-5761-4448-8210-92e9864673f3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:39.390924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c173487-5761-4448-8210-92e9864673f3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:39.398683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c173487-5761-4448-8210-92e9864673f3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:39.399159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c173487-5761-4448-8210-92e9864673f3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:39.399949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c173487-5761-4448-8210-92e9864673f3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:39.400635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c173487-5761-4448-8210-92e9864673f3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:39.643407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c173487-5761-4448-8210-92e9864673f3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:39.652191 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c173487-5761-4448-8210-92e9864673f3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.265391 Mar 12 21:19:39.653318 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4402/5170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:39 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:39.671906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8eb3058e-5a4f-4456-9eea-aee117bd9cae tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:39.672554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8eb3058e-5a4f-4456-9eea-aee117bd9cae tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:39.680224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8eb3058e-5a4f-4456-9eea-aee117bd9cae tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:39.680945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8eb3058e-5a4f-4456-9eea-aee117bd9cae tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:39.682162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8eb3058e-5a4f-4456-9eea-aee117bd9cae tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:39.682784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8eb3058e-5a4f-4456-9eea-aee117bd9cae tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:39.833814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8eb3058e-5a4f-4456-9eea-aee117bd9cae tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:39.842918 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8eb3058e-5a4f-4456-9eea-aee117bd9cae tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.175285 Mar 12 21:19:39.843740 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4403/5171] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:39 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:39.848366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-593379168", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e5912a2c-aeb4-40f4-a05e-781c6b342f11", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-543788082", "security_groups": [{"name": "tempest-secgroup-smoke-783970628"}], "networks": [{"uuid": "d4a972cb-728f-49ff-a2c0-634c882fb5ad"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:39.965438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] validate_networks() for [('d4a972cb-728f-49ff-a2c0-634c882fb5ad', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:19:40.417008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:19:40.417731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:19:40.418590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:19:40.419023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:19:40.419480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:19:40.432215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:40.432925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:40.434046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:40.434668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:40.461493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Getting quotas for project 2e6a0660e45d4aea9ff4576abd1f0e56. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:19:40.469067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Getting quotas for user 62b74fe4246c415bbb401849ce000f9b and project 2e6a0660e45d4aea9ff4576abd1f0e56. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:19:40.542873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:19:40.545278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e5912a2c-aeb4-40f4-a05e-781c6b342f11',volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:19:40.685410 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b07d407-3152-4055-b536-887713649d81 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.840602 Mar 12 21:19:40.690934 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4404/5172] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:19:40.690934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9188ae7b-3d12-4c6e-8cf4-a6b376731ab1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:40.691365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9188ae7b-3d12-4c6e-8cf4-a6b376731ab1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:40.698048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9188ae7b-3d12-4c6e-8cf4-a6b376731ab1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:40.698553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9188ae7b-3d12-4c6e-8cf4-a6b376731ab1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:40.699353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9188ae7b-3d12-4c6e-8cf4-a6b376731ab1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:40.699815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9188ae7b-3d12-4c6e-8cf4-a6b376731ab1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:40.728662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-9188ae7b-3d12-4c6e-8cf4-a6b376731ab1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lazy-loading 'flavor' on Instance uuid e054fc3c-6e21-4333-a700-0c2254b6fa0e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:19:41.024552 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9188ae7b-3d12-4c6e-8cf4-a6b376731ab1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 202 len: 0 microversion: 2.1 time: 0.336301 Mar 12 21:19:41.025680 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4405/5173] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:19:40 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:19:41.032777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4048c04b-fca5-4483-a87c-04a1e0ac93e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:41.034034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4048c04b-fca5-4483-a87c-04a1e0ac93e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:41.045512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4048c04b-fca5-4483-a87c-04a1e0ac93e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:41.046714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4048c04b-fca5-4483-a87c-04a1e0ac93e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:41.048193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4048c04b-fca5-4483-a87c-04a1e0ac93e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:41.048834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4048c04b-fca5-4483-a87c-04a1e0ac93e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:41.070271 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-4048c04b-fca5-4483-a87c-04a1e0ac93e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance a823fc52-c4a2-438a-8d37-f43139baf443 could not be found. Mar 12 21:19:41.071052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4048c04b-fca5-4483-a87c-04a1e0ac93e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance a823fc52-c4a2-438a-8d37-f43139baf443 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:41.072028 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4048c04b-fca5-4483-a87c-04a1e0ac93e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 404 len: 111 microversion: 2.1 time: 0.044924 Mar 12 21:19:41.072960 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4406/5174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:41 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:19:41.171968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b014186c-89f9-4c9d-976f-085011ec125a req-0edb19a7-655d-48df-a79e-02ae7937ad38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a823fc52-c4a2-438a-8d37-f43139baf443", "name": "network-vif-deleted", "tag": "988c1269-00db-4f30-a158-3ab020b0dfa6"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:41.183071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b014186c-89f9-4c9d-976f-085011ec125a req-0edb19a7-655d-48df-a79e-02ae7937ad38 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:41.183814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b014186c-89f9-4c9d-976f-085011ec125a req-0edb19a7-655d-48df-a79e-02ae7937ad38 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:41.197127 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b014186c-89f9-4c9d-976f-085011ec125a req-0edb19a7-655d-48df-a79e-02ae7937ad38 service nova] Creating event network-vif-deleted:988c1269-00db-4f30-a158-3ab020b0dfa6 for instance a823fc52-c4a2-438a-8d37-f43139baf443 on nch2-master-1 Mar 12 21:19:41.204815 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b014186c-89f9-4c9d-976f-085011ec125a req-0edb19a7-655d-48df-a79e-02ae7937ad38 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130298 Mar 12 21:19:41.206633 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4407/5175] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:19:41.214543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-178e562b-3124-4b93-9f71-26e3b46a08a3 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:41.216215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-178e562b-3124-4b93-9f71-26e3b46a08a3 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:41.224466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-178e562b-3124-4b93-9f71-26e3b46a08a3 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:41.225272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-178e562b-3124-4b93-9f71-26e3b46a08a3 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:41.226030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-178e562b-3124-4b93-9f71-26e3b46a08a3 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:41.226573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-178e562b-3124-4b93-9f71-26e3b46a08a3 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:41.301165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-178e562b-3124-4b93-9f71-26e3b46a08a3 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:41.310047 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-178e562b-3124-4b93-9f71-26e3b46a08a3 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1147 microversion: 2.1 time: 0.101932 Mar 12 21:19:41.310797 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4408/5176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:41 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1147 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:41.316074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2499dd11-a5dd-46a9-b7c9-bdf526ef499e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:41.317070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2499dd11-a5dd-46a9-b7c9-bdf526ef499e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:41.325033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2499dd11-a5dd-46a9-b7c9-bdf526ef499e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:41.325532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2499dd11-a5dd-46a9-b7c9-bdf526ef499e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:41.326794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2499dd11-a5dd-46a9-b7c9-bdf526ef499e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:41.327334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2499dd11-a5dd-46a9-b7c9-bdf526ef499e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:41.472533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2499dd11-a5dd-46a9-b7c9-bdf526ef499e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:41.480366 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2499dd11-a5dd-46a9-b7c9-bdf526ef499e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1512 microversion: 2.1 time: 0.168165 Mar 12 21:19:41.480962 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4409/5177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:41 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:41.492314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-412666100", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2016371990", "security_groups": [{"name": "tempest-secgroup-smoke-1247205612"}], "block_device_mapping_v2": [{"uuid": "feb089af-2825-4985-aa6e-09e75c64231e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9594c761-7638-4f69-b579-79baa62b3c38"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:41.604933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] validate_networks() for [('9594c761-7638-4f69-b579-79baa62b3c38', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:19:42.203292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:19:42.203732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:19:42.204500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:19:42.204953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:19:42.205382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:19:42.215563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:42.216052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:42.217258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:42.217727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:42.236175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:19:42.241791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for user 284a1908713c4b74a35a1d3b5cd10e80 and project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:19:42.308450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:19:42.310626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='feb089af-2825-4985-aa6e-09e75c64231e',volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:19:42.442901 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb0606dd-b58d-4850-9cf7-71f2e5a2d462 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.955868 Mar 12 21:19:42.450659 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4410/5178] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:19:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:19:42.457030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1bf9b6b-7fb0-49c0-99e7-a92dbb024260 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:42.459383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1bf9b6b-7fb0-49c0-99e7-a92dbb024260 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:42.466574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1bf9b6b-7fb0-49c0-99e7-a92dbb024260 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:42.467280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1bf9b6b-7fb0-49c0-99e7-a92dbb024260 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:42.468206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1bf9b6b-7fb0-49c0-99e7-a92dbb024260 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:42.469401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1bf9b6b-7fb0-49c0-99e7-a92dbb024260 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:42.555408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1bf9b6b-7fb0-49c0-99e7-a92dbb024260 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:42.563840 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1bf9b6b-7fb0-49c0-99e7-a92dbb024260 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1213 microversion: 2.1 time: 0.112803 Mar 12 21:19:42.574803 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4411/5179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:42 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:42.580168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8fbbe2d6-6984-4dd3-aae1-b0bd61b18391 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:42.581072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8fbbe2d6-6984-4dd3-aae1-b0bd61b18391 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:42.674667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8fbbe2d6-6984-4dd3-aae1-b0bd61b18391 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:42.684416 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8fbbe2d6-6984-4dd3-aae1-b0bd61b18391 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1094 microversion: 2.1 time: 0.108008 Mar 12 21:19:42.684568 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4412/5180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:42 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1094 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:42.703046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2f4be71-b2c5-4774-ba5c-5e248d168a93 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:42.703956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2f4be71-b2c5-4774-ba5c-5e248d168a93 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:42.711394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2f4be71-b2c5-4774-ba5c-5e248d168a93 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:42.712105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2f4be71-b2c5-4774-ba5c-5e248d168a93 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:42.718001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2f4be71-b2c5-4774-ba5c-5e248d168a93 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:42.718481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2f4be71-b2c5-4774-ba5c-5e248d168a93 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:43.039384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f2f4be71-b2c5-4774-ba5c-5e248d168a93 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:43.047389 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2f4be71-b2c5-4774-ba5c-5e248d168a93 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1512 microversion: 2.1 time: 0.348316 Mar 12 21:19:43.057861 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4413/5181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:42 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1512 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:43.542447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0d9eed12-5139-4551-9b43-21342d487723 req-fcc6fbb8-56d5-489e-af1c-88e54c5838ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b76b5d9-ae42-47fb-925a-b03a8401ccb9", "tag": "7d71bc93-c1b2-4330-9e3a-ca2541f7a935"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:43.569920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0d9eed12-5139-4551-9b43-21342d487723 req-fcc6fbb8-56d5-489e-af1c-88e54c5838ef service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:43.570562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0d9eed12-5139-4551-9b43-21342d487723 req-fcc6fbb8-56d5-489e-af1c-88e54c5838ef service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:43.605207 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0d9eed12-5139-4551-9b43-21342d487723 req-fcc6fbb8-56d5-489e-af1c-88e54c5838ef service nova] Creating event network-changed:7d71bc93-c1b2-4330-9e3a-ca2541f7a935 for instance 3b76b5d9-ae42-47fb-925a-b03a8401ccb9 on nch1-master-1 Mar 12 21:19:43.613421 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0d9eed12-5139-4551-9b43-21342d487723 req-fcc6fbb8-56d5-489e-af1c-88e54c5838ef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076323 Mar 12 21:19:43.615152 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4414/5182] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:19:43.624070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f87808b0-c4ab-43f4-bbce-35b7c4faa8a2 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:43.625199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f87808b0-c4ab-43f4-bbce-35b7c4faa8a2 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:43.635037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f87808b0-c4ab-43f4-bbce-35b7c4faa8a2 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:43.635646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f87808b0-c4ab-43f4-bbce-35b7c4faa8a2 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:43.636603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f87808b0-c4ab-43f4-bbce-35b7c4faa8a2 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:43.637179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f87808b0-c4ab-43f4-bbce-35b7c4faa8a2 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:43.880154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f87808b0-c4ab-43f4-bbce-35b7c4faa8a2 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:43.890146 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f87808b0-c4ab-43f4-bbce-35b7c4faa8a2 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1268 microversion: 2.1 time: 0.273449 Mar 12 21:19:43.891231 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4415/5183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:43 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1268 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:43.896550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eaa3f343-c05e-4db4-9de2-b30a26e93bf4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:43.897355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eaa3f343-c05e-4db4-9de2-b30a26e93bf4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:43.915449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eaa3f343-c05e-4db4-9de2-b30a26e93bf4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:43.916081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eaa3f343-c05e-4db4-9de2-b30a26e93bf4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:43.916989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eaa3f343-c05e-4db4-9de2-b30a26e93bf4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:43.917417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eaa3f343-c05e-4db4-9de2-b30a26e93bf4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:44.003814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eaa3f343-c05e-4db4-9de2-b30a26e93bf4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:44.012479 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eaa3f343-c05e-4db4-9de2-b30a26e93bf4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1210 microversion: 2.1 time: 0.120024 Mar 12 21:19:44.022829 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4416/5184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:43 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1210 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:44.068337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-509147d2-b473-481b-8905-bb3c5846c36b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:44.070533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-509147d2-b473-481b-8905-bb3c5846c36b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:44.077574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-509147d2-b473-481b-8905-bb3c5846c36b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:44.078520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-509147d2-b473-481b-8905-bb3c5846c36b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:44.079419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-509147d2-b473-481b-8905-bb3c5846c36b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:44.079962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-509147d2-b473-481b-8905-bb3c5846c36b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:44.371393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-509147d2-b473-481b-8905-bb3c5846c36b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:44.386903 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-509147d2-b473-481b-8905-bb3c5846c36b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1512 microversion: 2.1 time: 0.325351 Mar 12 21:19:44.389444 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4417/5185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:44 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1512 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:44.914682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1ce3e10-aa54-42e4-9efc-fe1270e857ff tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:44.915337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a1ce3e10-aa54-42e4-9efc-fe1270e857ff tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:44.924135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ce3e10-aa54-42e4-9efc-fe1270e857ff tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:44.927511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ce3e10-aa54-42e4-9efc-fe1270e857ff tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:44.928453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ce3e10-aa54-42e4-9efc-fe1270e857ff tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:44.929564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ce3e10-aa54-42e4-9efc-fe1270e857ff tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:45.688382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a1ce3e10-aa54-42e4-9efc-fe1270e857ff tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:45.711167 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1ce3e10-aa54-42e4-9efc-fe1270e857ff tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1268 microversion: 2.1 time: 0.803302 Mar 12 21:19:45.713868 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4418/5186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:44 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1268 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:45.717804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ba59dc0-1009-4438-982f-445122f0735f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:45.718451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ba59dc0-1009-4438-982f-445122f0735f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:45.725217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ba59dc0-1009-4438-982f-445122f0735f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:45.725922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ba59dc0-1009-4438-982f-445122f0735f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:45.726751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ba59dc0-1009-4438-982f-445122f0735f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:45.727422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ba59dc0-1009-4438-982f-445122f0735f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:45.947331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ba59dc0-1009-4438-982f-445122f0735f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:45.954833 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ba59dc0-1009-4438-982f-445122f0735f tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1266 microversion: 2.1 time: 0.241507 Mar 12 21:19:45.955258 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4419/5187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:45 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:45.959653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d6a1903e-dc4c-4d6d-8011-7b72352c1cc9 req-f1bba4d3-be2a-4525-acc7-151ce682de36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d83827c-2370-4722-805c-f08d06cfe228", "tag": "4bf1b21e-0896-4e40-89ad-d0048bb55a06"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:45.969522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d6a1903e-dc4c-4d6d-8011-7b72352c1cc9 req-f1bba4d3-be2a-4525-acc7-151ce682de36 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:45.970009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d6a1903e-dc4c-4d6d-8011-7b72352c1cc9 req-f1bba4d3-be2a-4525-acc7-151ce682de36 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:45.981023 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d6a1903e-dc4c-4d6d-8011-7b72352c1cc9 req-f1bba4d3-be2a-4525-acc7-151ce682de36 service nova] Creating event network-changed:4bf1b21e-0896-4e40-89ad-d0048bb55a06 for instance 3d83827c-2370-4722-805c-f08d06cfe228 on nch2-master-1 Mar 12 21:19:45.986014 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d6a1903e-dc4c-4d6d-8011-7b72352c1cc9 req-f1bba4d3-be2a-4525-acc7-151ce682de36 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029614 Mar 12 21:19:45.986607 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4420/5188] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:19:45.993035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a9a70469-e95e-4fef-a78a-16f7eb15afc1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:45.993960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a9a70469-e95e-4fef-a78a-16f7eb15afc1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:46.000363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9a70469-e95e-4fef-a78a-16f7eb15afc1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:46.000831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9a70469-e95e-4fef-a78a-16f7eb15afc1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:46.002157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9a70469-e95e-4fef-a78a-16f7eb15afc1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:46.002619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9a70469-e95e-4fef-a78a-16f7eb15afc1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:46.230076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a9a70469-e95e-4fef-a78a-16f7eb15afc1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:46.237473 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a9a70469-e95e-4fef-a78a-16f7eb15afc1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1512 microversion: 2.1 time: 0.249772 Mar 12 21:19:46.238306 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4421/5189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:45 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1512 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:46.731901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ecd8f66c-d052-4318-a958-e66a505edee5 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:46.732552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ecd8f66c-d052-4318-a958-e66a505edee5 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:46.741096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecd8f66c-d052-4318-a958-e66a505edee5 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:46.741724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecd8f66c-d052-4318-a958-e66a505edee5 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:46.742719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecd8f66c-d052-4318-a958-e66a505edee5 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:46.743323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecd8f66c-d052-4318-a958-e66a505edee5 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:46.986538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ecd8f66c-d052-4318-a958-e66a505edee5 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:46.994187 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ecd8f66c-d052-4318-a958-e66a505edee5 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1268 microversion: 2.1 time: 0.266215 Mar 12 21:19:46.994773 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4422/5190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:46 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1268 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:46.999308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4da68ca6-2b43-4032-9bfa-0b5036568632 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:46.999931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4da68ca6-2b43-4032-9bfa-0b5036568632 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:47.005801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da68ca6-2b43-4032-9bfa-0b5036568632 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:47.006125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da68ca6-2b43-4032-9bfa-0b5036568632 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:47.007526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da68ca6-2b43-4032-9bfa-0b5036568632 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:47.008064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da68ca6-2b43-4032-9bfa-0b5036568632 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:47.166007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4da68ca6-2b43-4032-9bfa-0b5036568632 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:47.173927 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4da68ca6-2b43-4032-9bfa-0b5036568632 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1266 microversion: 2.1 time: 0.178151 Mar 12 21:19:47.174520 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4423/5191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:46 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:47.179300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-47092fb0-37d7-4489-a906-e547976c8921 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:47.179819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-47092fb0-37d7-4489-a906-e547976c8921 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:47.185786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47092fb0-37d7-4489-a906-e547976c8921 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:47.186270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47092fb0-37d7-4489-a906-e547976c8921 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:47.187071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47092fb0-37d7-4489-a906-e547976c8921 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:47.187537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47092fb0-37d7-4489-a906-e547976c8921 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:47.212733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-47092fb0-37d7-4489-a906-e547976c8921 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:19:47.289818 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-47092fb0-37d7-4489-a906-e547976c8921 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 204 len: 0 microversion: 2.1 time: 0.113886 Mar 12 21:19:47.290467 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4424/5192] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:19:47 2022] DELETE /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:19:47.296400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71ef1368-8322-490f-b8a6-30b146e71d60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:47.297126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71ef1368-8322-490f-b8a6-30b146e71d60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:47.303226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71ef1368-8322-490f-b8a6-30b146e71d60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:47.303772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71ef1368-8322-490f-b8a6-30b146e71d60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:47.304639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71ef1368-8322-490f-b8a6-30b146e71d60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:47.305217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71ef1368-8322-490f-b8a6-30b146e71d60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:47.446946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-71ef1368-8322-490f-b8a6-30b146e71d60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:47.454460 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71ef1368-8322-490f-b8a6-30b146e71d60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1533 microversion: 2.1 time: 0.162758 Mar 12 21:19:47.455048 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4425/5193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:47 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1533 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:47.459566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8ee5374-f3b6-45a3-a606-d495418bae3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:47.460697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8ee5374-f3b6-45a3-a606-d495418bae3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:47.466419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8ee5374-f3b6-45a3-a606-d495418bae3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:47.466895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8ee5374-f3b6-45a3-a606-d495418bae3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:47.467698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8ee5374-f3b6-45a3-a606-d495418bae3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:47.468152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8ee5374-f3b6-45a3-a606-d495418bae3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:47.608861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a8ee5374-f3b6-45a3-a606-d495418bae3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:47.616363 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8ee5374-f3b6-45a3-a606-d495418bae3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 200 len: 1548 microversion: 2.1 time: 0.160307 Mar 12 21:19:47.616955 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4426/5194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:47 2022] GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:48.015373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4cbc9724-71b5-4683-8d8a-9d44f2c2ccac tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:48.016799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4cbc9724-71b5-4683-8d8a-9d44f2c2ccac tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:48.027945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cbc9724-71b5-4683-8d8a-9d44f2c2ccac tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:48.028427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cbc9724-71b5-4683-8d8a-9d44f2c2ccac tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:48.029244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cbc9724-71b5-4683-8d8a-9d44f2c2ccac tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:48.030033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cbc9724-71b5-4683-8d8a-9d44f2c2ccac tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:48.176484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4cbc9724-71b5-4683-8d8a-9d44f2c2ccac tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:48.185091 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4cbc9724-71b5-4683-8d8a-9d44f2c2ccac tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1268 microversion: 2.1 time: 0.178097 Mar 12 21:19:48.185954 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4427/5195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:48 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:48.190777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e8df9d5c-a8c1-488b-8930-cfe21c2eedca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:48.191405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e8df9d5c-a8c1-488b-8930-cfe21c2eedca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:48.197782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8df9d5c-a8c1-488b-8930-cfe21c2eedca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:48.198257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8df9d5c-a8c1-488b-8930-cfe21c2eedca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:48.199042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8df9d5c-a8c1-488b-8930-cfe21c2eedca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:48.199494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8df9d5c-a8c1-488b-8930-cfe21c2eedca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:48.339827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8df9d5c-a8c1-488b-8930-cfe21c2eedca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:48.347928 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e8df9d5c-a8c1-488b-8930-cfe21c2eedca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1266 microversion: 2.1 time: 0.160572 Mar 12 21:19:48.348816 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4428/5196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:48 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:48.472539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eb887ce8-60d0-45b8-a942-1260f60991f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:48.473333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eb887ce8-60d0-45b8-a942-1260f60991f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:48.480256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb887ce8-60d0-45b8-a942-1260f60991f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:48.480732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb887ce8-60d0-45b8-a942-1260f60991f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:48.481542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb887ce8-60d0-45b8-a942-1260f60991f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:48.482061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb887ce8-60d0-45b8-a942-1260f60991f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:48.627121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eb887ce8-60d0-45b8-a942-1260f60991f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:48.635013 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eb887ce8-60d0-45b8-a942-1260f60991f6 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1533 microversion: 2.1 time: 0.166690 Mar 12 21:19:48.635593 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4429/5197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:48 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1533 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:48.640124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7140ffca-4add-4141-ae1c-ab2523ecffd9 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:48.640740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7140ffca-4add-4141-ae1c-ab2523ecffd9 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:48.647135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7140ffca-4add-4141-ae1c-ab2523ecffd9 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:48.647533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7140ffca-4add-4141-ae1c-ab2523ecffd9 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:48.648848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7140ffca-4add-4141-ae1c-ab2523ecffd9 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:48.649305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7140ffca-4add-4141-ae1c-ab2523ecffd9 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:48.809922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7140ffca-4add-4141-ae1c-ab2523ecffd9 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:48.817787 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7140ffca-4add-4141-ae1c-ab2523ecffd9 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 200 len: 1548 microversion: 2.1 time: 0.181196 Mar 12 21:19:48.827620 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4430/5198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:48 2022] GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 1548 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:49.142402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1a71aa4a-0438-4667-9866-462e10537767 req-6ed022cd-f78b-4104-9bc8-27dd824dfb10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f530c787-a5c9-4b2b-b612-6e3eda410949", "name": "network-vif-deleted", "tag": "4737d116-c616-4130-a724-4b17cd243254"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:49.152323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1a71aa4a-0438-4667-9866-462e10537767 req-6ed022cd-f78b-4104-9bc8-27dd824dfb10 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:49.152714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1a71aa4a-0438-4667-9866-462e10537767 req-6ed022cd-f78b-4104-9bc8-27dd824dfb10 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:49.166794 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1a71aa4a-0438-4667-9866-462e10537767 req-6ed022cd-f78b-4104-9bc8-27dd824dfb10 service nova] Creating event network-vif-deleted:4737d116-c616-4130-a724-4b17cd243254 for instance f530c787-a5c9-4b2b-b612-6e3eda410949 on nch2-master-1 Mar 12 21:19:49.172606 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1a71aa4a-0438-4667-9866-462e10537767 req-6ed022cd-f78b-4104-9bc8-27dd824dfb10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033784 Mar 12 21:19:49.173243 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4431/5199] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:19:49.202454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37005e36-b43d-49b9-b7f3-b8c4c56e0480 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:49.203196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-37005e36-b43d-49b9-b7f3-b8c4c56e0480 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:49.209314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37005e36-b43d-49b9-b7f3-b8c4c56e0480 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:49.209892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37005e36-b43d-49b9-b7f3-b8c4c56e0480 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:49.211306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37005e36-b43d-49b9-b7f3-b8c4c56e0480 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:49.211896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37005e36-b43d-49b9-b7f3-b8c4c56e0480 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:49.351734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-37005e36-b43d-49b9-b7f3-b8c4c56e0480 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:49.359185 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-37005e36-b43d-49b9-b7f3-b8c4c56e0480 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1268 microversion: 2.1 time: 0.161042 Mar 12 21:19:49.359913 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4432/5200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:49 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:49.364295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee32cf74-3d79-48b5-8d56-9bc5d54f7de4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:49.364916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee32cf74-3d79-48b5-8d56-9bc5d54f7de4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:49.370436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee32cf74-3d79-48b5-8d56-9bc5d54f7de4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:49.370898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee32cf74-3d79-48b5-8d56-9bc5d54f7de4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:49.371674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee32cf74-3d79-48b5-8d56-9bc5d54f7de4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:49.372122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee32cf74-3d79-48b5-8d56-9bc5d54f7de4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:49.527917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee32cf74-3d79-48b5-8d56-9bc5d54f7de4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:49.536671 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee32cf74-3d79-48b5-8d56-9bc5d54f7de4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1266 microversion: 2.1 time: 0.175670 Mar 12 21:19:49.537601 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4433/5201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:49 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:49.651523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce7d4d7c-88e8-4d1d-b71d-1b695275552c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:49.652183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce7d4d7c-88e8-4d1d-b71d-1b695275552c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:49.658828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce7d4d7c-88e8-4d1d-b71d-1b695275552c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:49.659294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce7d4d7c-88e8-4d1d-b71d-1b695275552c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:49.660397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce7d4d7c-88e8-4d1d-b71d-1b695275552c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:49.660896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce7d4d7c-88e8-4d1d-b71d-1b695275552c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:49.803010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce7d4d7c-88e8-4d1d-b71d-1b695275552c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:49.811179 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce7d4d7c-88e8-4d1d-b71d-1b695275552c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1533 microversion: 2.1 time: 0.163586 Mar 12 21:19:49.812323 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4434/5202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:49 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1533 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:49.816998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fee4cacc-9f6b-4ace-8756-63f21772178b req-52754f56-bf72-4622-8448-2e182d28f41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e054fc3c-6e21-4333-a700-0c2254b6fa0e", "name": "network-vif-plugged", "status": "completed", "tag": "38bbbe31-f103-40ff-83fd-ad66bb739042"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:49.825517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fee4cacc-9f6b-4ace-8756-63f21772178b req-52754f56-bf72-4622-8448-2e182d28f41d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:49.826071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fee4cacc-9f6b-4ace-8756-63f21772178b req-52754f56-bf72-4622-8448-2e182d28f41d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:49.839723 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fee4cacc-9f6b-4ace-8756-63f21772178b req-52754f56-bf72-4622-8448-2e182d28f41d service nova] Creating event network-vif-plugged:38bbbe31-f103-40ff-83fd-ad66bb739042 for instance e054fc3c-6e21-4333-a700-0c2254b6fa0e on nch1-master-1 Mar 12 21:19:49.844905 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fee4cacc-9f6b-4ace-8756-63f21772178b req-52754f56-bf72-4622-8448-2e182d28f41d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031298 Mar 12 21:19:49.845689 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4435/5203] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:19:49.850800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1cb4810c-00af-4b66-a076-769f334c5f6d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:49.851537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1cb4810c-00af-4b66-a076-769f334c5f6d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: f530c787-a5c9-4b2b-b612-6e3eda410949] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:49.857725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cb4810c-00af-4b66-a076-769f334c5f6d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:49.858231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cb4810c-00af-4b66-a076-769f334c5f6d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:49.859054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cb4810c-00af-4b66-a076-769f334c5f6d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:49.859479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cb4810c-00af-4b66-a076-769f334c5f6d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:49.873610 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-1cb4810c-00af-4b66-a076-769f334c5f6d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] HTTP exception thrown: Instance f530c787-a5c9-4b2b-b612-6e3eda410949 could not be found. Mar 12 21:19:49.874292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1cb4810c-00af-4b66-a076-769f334c5f6d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Returning 404 to user: Instance f530c787-a5c9-4b2b-b612-6e3eda410949 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:49.875147 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1cb4810c-00af-4b66-a076-769f334c5f6d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949" status: 404 len: 111 microversion: 2.1 time: 0.028352 Mar 12 21:19:49.875705 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4436/5204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:49 2022] GET /compute/v2.1/servers/f530c787-a5c9-4b2b-b612-6e3eda410949 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:19:50.043074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96b48a8a-529e-4f82-bd21-c6024cafd4ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '.version_select at 0x7f6e37522c10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:50.066139 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96b48a8a-529e-4f82-bd21-c6024cafd4ed tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-396695384" status: 202 len: 0 microversion: 2.1 time: 0.026850 Mar 12 21:19:50.066740 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4437/5205] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Mar 12 21:19:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-396695384 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:19:50.376589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b34571ab-0809-422e-936e-bfbd0989ae99 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:50.377344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b34571ab-0809-422e-936e-bfbd0989ae99 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:50.384981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b34571ab-0809-422e-936e-bfbd0989ae99 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:50.385693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b34571ab-0809-422e-936e-bfbd0989ae99 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:50.386535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b34571ab-0809-422e-936e-bfbd0989ae99 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:50.386993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b34571ab-0809-422e-936e-bfbd0989ae99 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:50.580463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b34571ab-0809-422e-936e-bfbd0989ae99 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:50.589621 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b34571ab-0809-422e-936e-bfbd0989ae99 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1268 microversion: 2.1 time: 0.218107 Mar 12 21:19:50.590370 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4438/5206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:50 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1268 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:50.595422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cd29c0ad-4f15-4d22-bfa3-ad4204e1c93b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:50.596886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cd29c0ad-4f15-4d22-bfa3-ad4204e1c93b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:50.604281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd29c0ad-4f15-4d22-bfa3-ad4204e1c93b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:50.605073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd29c0ad-4f15-4d22-bfa3-ad4204e1c93b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:50.605911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd29c0ad-4f15-4d22-bfa3-ad4204e1c93b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:50.606365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd29c0ad-4f15-4d22-bfa3-ad4204e1c93b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:50.818673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd29c0ad-4f15-4d22-bfa3-ad4204e1c93b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:50.831479 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cd29c0ad-4f15-4d22-bfa3-ad4204e1c93b tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1266 microversion: 2.1 time: 0.235621 Mar 12 21:19:50.831479 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4439/5207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:50 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:50.833286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-44f18b6d-8506-41b2-a493-26e03b364084 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:50.834303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-44f18b6d-8506-41b2-a493-26e03b364084 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:50.848544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44f18b6d-8506-41b2-a493-26e03b364084 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:50.849009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44f18b6d-8506-41b2-a493-26e03b364084 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:50.849902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44f18b6d-8506-41b2-a493-26e03b364084 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:50.850359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44f18b6d-8506-41b2-a493-26e03b364084 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:51.127104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-44f18b6d-8506-41b2-a493-26e03b364084 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:51.153790 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-44f18b6d-8506-41b2-a493-26e03b364084 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1533 microversion: 2.1 time: 0.324748 Mar 12 21:19:51.154313 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4440/5208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:50 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1533 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:51.607038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1cc898f9-a2e8-4704-b2f4-7afccad436c6 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:51.607687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1cc898f9-a2e8-4704-b2f4-7afccad436c6 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:51.614738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cc898f9-a2e8-4704-b2f4-7afccad436c6 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:51.615580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cc898f9-a2e8-4704-b2f4-7afccad436c6 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:51.616602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cc898f9-a2e8-4704-b2f4-7afccad436c6 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:51.617271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cc898f9-a2e8-4704-b2f4-7afccad436c6 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:51.800397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1cc898f9-a2e8-4704-b2f4-7afccad436c6 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:51.810367 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1cc898f9-a2e8-4704-b2f4-7afccad436c6 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1268 microversion: 2.1 time: 0.207124 Mar 12 21:19:51.811272 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4441/5209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:51 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1268 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:51.848623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9208d269-059e-4a54-97b3-956fa411d1be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:51.849262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9208d269-059e-4a54-97b3-956fa411d1be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:51.863950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9208d269-059e-4a54-97b3-956fa411d1be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:51.864424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9208d269-059e-4a54-97b3-956fa411d1be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:51.865226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9208d269-059e-4a54-97b3-956fa411d1be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:51.865681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9208d269-059e-4a54-97b3-956fa411d1be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:52.039980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9208d269-059e-4a54-97b3-956fa411d1be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:52.048161 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9208d269-059e-4a54-97b3-956fa411d1be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1266 microversion: 2.1 time: 0.203517 Mar 12 21:19:52.048995 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4442/5210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:51 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:52.054460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f857ef81-04c2-4a49-a2ab-676de116b7e7 req-8e0c7f75-bea9-4bf4-95a9-f4846b36b0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d83827c-2370-4722-805c-f08d06cfe228", "name": "network-vif-plugged", "status": "completed", "tag": "4bf1b21e-0896-4e40-89ad-d0048bb55a06"}, {"server_uuid": "3b76b5d9-ae42-47fb-925a-b03a8401ccb9", "name": "network-vif-plugged", "status": "completed", "tag": "7d71bc93-c1b2-4330-9e3a-ca2541f7a935"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:52.065854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f857ef81-04c2-4a49-a2ab-676de116b7e7 req-8e0c7f75-bea9-4bf4-95a9-f4846b36b0a0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:52.067390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f857ef81-04c2-4a49-a2ab-676de116b7e7 req-8e0c7f75-bea9-4bf4-95a9-f4846b36b0a0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:52.089017 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f857ef81-04c2-4a49-a2ab-676de116b7e7 req-8e0c7f75-bea9-4bf4-95a9-f4846b36b0a0 service nova] Creating event network-vif-plugged:4bf1b21e-0896-4e40-89ad-d0048bb55a06 for instance 3d83827c-2370-4722-805c-f08d06cfe228 on nch2-master-1 Mar 12 21:19:52.089668 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f857ef81-04c2-4a49-a2ab-676de116b7e7 req-8e0c7f75-bea9-4bf4-95a9-f4846b36b0a0 service nova] Creating event network-vif-plugged:7d71bc93-c1b2-4330-9e3a-ca2541f7a935 for instance 3b76b5d9-ae42-47fb-925a-b03a8401ccb9 on nch1-master-1 Mar 12 21:19:52.100290 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f857ef81-04c2-4a49-a2ab-676de116b7e7 req-8e0c7f75-bea9-4bf4-95a9-f4846b36b0a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049887 Mar 12 21:19:52.102741 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4443/5211] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:19:52.127378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7aa03d4c-b6d1-452f-9aa1-e4711e7b1407 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:52.128226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7aa03d4c-b6d1-452f-9aa1-e4711e7b1407 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:52.137023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7aa03d4c-b6d1-452f-9aa1-e4711e7b1407 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:52.137889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7aa03d4c-b6d1-452f-9aa1-e4711e7b1407 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:52.139158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7aa03d4c-b6d1-452f-9aa1-e4711e7b1407 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:52.140743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7aa03d4c-b6d1-452f-9aa1-e4711e7b1407 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:52.187729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7aa03d4c-b6d1-452f-9aa1-e4711e7b1407 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:19:52.321198 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7aa03d4c-b6d1-452f-9aa1-e4711e7b1407 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "DELETE /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 204 len: 0 microversion: 2.1 time: 0.198148 Mar 12 21:19:52.322587 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4444/5212] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:19:52 2022] DELETE /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:19:52.341282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2ce2945c-6143-457a-b416-e3c6c49d9c55 req-9a14e3e1-1ae5-41b2-91ee-e1e681aae240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29cf4e73-7932-4ca9-bda4-067dc4ab587d", "tag": "c7de3107-5a64-4811-93a7-c850e1c66b22"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:52.372831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2ce2945c-6143-457a-b416-e3c6c49d9c55 req-9a14e3e1-1ae5-41b2-91ee-e1e681aae240 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:52.373318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2ce2945c-6143-457a-b416-e3c6c49d9c55 req-9a14e3e1-1ae5-41b2-91ee-e1e681aae240 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:52.388207 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2ce2945c-6143-457a-b416-e3c6c49d9c55 req-9a14e3e1-1ae5-41b2-91ee-e1e681aae240 service nova] Creating event network-changed:c7de3107-5a64-4811-93a7-c850e1c66b22 for instance 29cf4e73-7932-4ca9-bda4-067dc4ab587d on nch2-master-1 Mar 12 21:19:52.396110 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2ce2945c-6143-457a-b416-e3c6c49d9c55 req-9a14e3e1-1ae5-41b2-91ee-e1e681aae240 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058809 Mar 12 21:19:52.396960 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4445/5213] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:19:52.402283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b7d79d88-c35e-43ea-8617-8ac9943a40ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:52.403005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b7d79d88-c35e-43ea-8617-8ac9943a40ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:52.410431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7d79d88-c35e-43ea-8617-8ac9943a40ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:52.410902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7d79d88-c35e-43ea-8617-8ac9943a40ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:52.411700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7d79d88-c35e-43ea-8617-8ac9943a40ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:52.412155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b7d79d88-c35e-43ea-8617-8ac9943a40ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:52.612501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b7d79d88-c35e-43ea-8617-8ac9943a40ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:52.622553 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b7d79d88-c35e-43ea-8617-8ac9943a40ff tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1528 microversion: 2.1 time: 0.222771 Mar 12 21:19:52.624180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4446/5214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:52 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1528 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:52.631945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14d446c2-b17e-42b9-8775-90b05e5f3882 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:52.633003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14d446c2-b17e-42b9-8775-90b05e5f3882 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:52.641047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14d446c2-b17e-42b9-8775-90b05e5f3882 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:52.641944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14d446c2-b17e-42b9-8775-90b05e5f3882 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:52.642932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14d446c2-b17e-42b9-8775-90b05e5f3882 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:52.644549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14d446c2-b17e-42b9-8775-90b05e5f3882 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:52.827912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14d446c2-b17e-42b9-8775-90b05e5f3882 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:52.837573 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14d446c2-b17e-42b9-8775-90b05e5f3882 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 200 len: 1672 microversion: 2.1 time: 0.212102 Mar 12 21:19:52.848455 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4447/5215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:52 2022] GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 1672 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:52.855002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3bc58dc5-fbe0-435c-96fa-72f86f3b4192 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:52.855869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3bc58dc5-fbe0-435c-96fa-72f86f3b4192 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:52.870823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3bc58dc5-fbe0-435c-96fa-72f86f3b4192 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:52.871565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3bc58dc5-fbe0-435c-96fa-72f86f3b4192 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:52.873111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3bc58dc5-fbe0-435c-96fa-72f86f3b4192 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:52.873730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3bc58dc5-fbe0-435c-96fa-72f86f3b4192 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:53.060921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3bc58dc5-fbe0-435c-96fa-72f86f3b4192 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:53.069714 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3bc58dc5-fbe0-435c-96fa-72f86f3b4192 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1268 microversion: 2.1 time: 0.219151 Mar 12 21:19:53.084022 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4448/5216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:52 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1268 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:53.089806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96d50132-7d19-4237-94f2-6dd03e5ebf48 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:53.090666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96d50132-7d19-4237-94f2-6dd03e5ebf48 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:53.103348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96d50132-7d19-4237-94f2-6dd03e5ebf48 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:53.103827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96d50132-7d19-4237-94f2-6dd03e5ebf48 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:53.104640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96d50132-7d19-4237-94f2-6dd03e5ebf48 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:53.105097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96d50132-7d19-4237-94f2-6dd03e5ebf48 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:53.297639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96d50132-7d19-4237-94f2-6dd03e5ebf48 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:53.309132 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96d50132-7d19-4237-94f2-6dd03e5ebf48 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1266 microversion: 2.1 time: 0.222940 Mar 12 21:19:53.310086 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4449/5217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:53 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:53.640413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-078dc32b-34fa-4e99-a57c-619bec03e39e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:53.641044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-078dc32b-34fa-4e99-a57c-619bec03e39e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:53.652055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-078dc32b-34fa-4e99-a57c-619bec03e39e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:53.652761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-078dc32b-34fa-4e99-a57c-619bec03e39e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:53.653603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-078dc32b-34fa-4e99-a57c-619bec03e39e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:53.654071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-078dc32b-34fa-4e99-a57c-619bec03e39e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:53.838620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-078dc32b-34fa-4e99-a57c-619bec03e39e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:53.846488 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-078dc32b-34fa-4e99-a57c-619bec03e39e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1528 microversion: 2.1 time: 0.211097 Mar 12 21:19:53.847623 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4450/5218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:53 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1528 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:53.855945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7a7dd6fa-8ae9-4dae-933f-248cad684954 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:53.857890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7a7dd6fa-8ae9-4dae-933f-248cad684954 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:53.869547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a7dd6fa-8ae9-4dae-933f-248cad684954 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:53.870162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a7dd6fa-8ae9-4dae-933f-248cad684954 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:53.871092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a7dd6fa-8ae9-4dae-933f-248cad684954 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:53.871599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7a7dd6fa-8ae9-4dae-933f-248cad684954 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:54.060821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7a7dd6fa-8ae9-4dae-933f-248cad684954 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:54.070873 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7a7dd6fa-8ae9-4dae-933f-248cad684954 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 200 len: 1554 microversion: 2.1 time: 0.218268 Mar 12 21:19:54.081151 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4451/5219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:53 2022] GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:19:54.094942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7455b626-8ef7-4333-b67c-8a18013e969b tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:54.094942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7455b626-8ef7-4333-b67c-8a18013e969b tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:54.102983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7455b626-8ef7-4333-b67c-8a18013e969b tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:54.103843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7455b626-8ef7-4333-b67c-8a18013e969b tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:54.104826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7455b626-8ef7-4333-b67c-8a18013e969b tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:54.105478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7455b626-8ef7-4333-b67c-8a18013e969b tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:54.277499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7455b626-8ef7-4333-b67c-8a18013e969b tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:54.285848 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7455b626-8ef7-4333-b67c-8a18013e969b tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1458 microversion: 2.1 time: 0.198043 Mar 12 21:19:54.298526 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4452/5220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:54 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1458 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:54.303548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-28160d34-c0e2-4d57-9e9b-3f43864ff064 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:54.304196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-28160d34-c0e2-4d57-9e9b-3f43864ff064 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:54.312289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28160d34-c0e2-4d57-9e9b-3f43864ff064 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:54.312769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28160d34-c0e2-4d57-9e9b-3f43864ff064 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:54.314851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28160d34-c0e2-4d57-9e9b-3f43864ff064 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:54.314851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28160d34-c0e2-4d57-9e9b-3f43864ff064 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:54.483366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-28160d34-c0e2-4d57-9e9b-3f43864ff064 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:54.492837 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-28160d34-c0e2-4d57-9e9b-3f43864ff064 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1458 microversion: 2.1 time: 0.193119 Mar 12 21:19:54.493722 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4453/5221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:54 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1458 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:54.499142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-29515fa1-9122-45d6-80f5-13d4b8e488e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:54.499857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-29515fa1-9122-45d6-80f5-13d4b8e488e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:54.508034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29515fa1-9122-45d6-80f5-13d4b8e488e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:54.508523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29515fa1-9122-45d6-80f5-13d4b8e488e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:54.510045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29515fa1-9122-45d6-80f5-13d4b8e488e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:54.510559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29515fa1-9122-45d6-80f5-13d4b8e488e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:54.681970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-29515fa1-9122-45d6-80f5-13d4b8e488e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:54.698552 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-29515fa1-9122-45d6-80f5-13d4b8e488e7 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1452 microversion: 2.1 time: 0.202904 Mar 12 21:19:54.699407 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4454/5222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:54 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:54.721754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-54ec4e0a-72d0-49c2-a544-45020defbafe req-d6f9e2d5-b4b6-450f-8208-fbe8b108dedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29cf4e73-7932-4ca9-bda4-067dc4ab587d", "name": "network-vif-deleted", "tag": "c7de3107-5a64-4811-93a7-c850e1c66b22"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:54.802728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-54ec4e0a-72d0-49c2-a544-45020defbafe req-d6f9e2d5-b4b6-450f-8208-fbe8b108dedc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:54.806886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-54ec4e0a-72d0-49c2-a544-45020defbafe req-d6f9e2d5-b4b6-450f-8208-fbe8b108dedc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:54.849195 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-54ec4e0a-72d0-49c2-a544-45020defbafe req-d6f9e2d5-b4b6-450f-8208-fbe8b108dedc service nova] Creating event network-vif-deleted:c7de3107-5a64-4811-93a7-c850e1c66b22 for instance 29cf4e73-7932-4ca9-bda4-067dc4ab587d on nch2-master-1 Mar 12 21:19:54.858915 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-54ec4e0a-72d0-49c2-a544-45020defbafe req-d6f9e2d5-b4b6-450f-8208-fbe8b108dedc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142676 Mar 12 21:19:54.859139 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4455/5223] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:19:54.880142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-93da8b61-026d-41ae-b2e2-58d6df8d47be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:54.880900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-93da8b61-026d-41ae-b2e2-58d6df8d47be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:54.931110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93da8b61-026d-41ae-b2e2-58d6df8d47be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:54.932535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93da8b61-026d-41ae-b2e2-58d6df8d47be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:54.933643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93da8b61-026d-41ae-b2e2-58d6df8d47be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:54.935269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93da8b61-026d-41ae-b2e2-58d6df8d47be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:55.194207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-93da8b61-026d-41ae-b2e2-58d6df8d47be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:55.210164 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-93da8b61-026d-41ae-b2e2-58d6df8d47be tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1452 microversion: 2.1 time: 0.345208 Mar 12 21:19:55.211019 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4456/5224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:54 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1452 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:55.215790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f29320b4-3580-4753-a903-79361084afb4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:55.218638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f29320b4-3580-4753-a903-79361084afb4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:55.231290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f29320b4-3580-4753-a903-79361084afb4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:55.247743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f29320b4-3580-4753-a903-79361084afb4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:55.248635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f29320b4-3580-4753-a903-79361084afb4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:55.249178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f29320b4-3580-4753-a903-79361084afb4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:55.428023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f29320b4-3580-4753-a903-79361084afb4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:55.436523 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f29320b4-3580-4753-a903-79361084afb4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1528 microversion: 2.1 time: 0.224402 Mar 12 21:19:55.438045 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4457/5225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:55 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1528 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:55.442947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04c43d63-4a46-4723-9293-f24716b579b4 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:55.443706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04c43d63-4a46-4723-9293-f24716b579b4 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 29cf4e73-7932-4ca9-bda4-067dc4ab587d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:55.454936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04c43d63-4a46-4723-9293-f24716b579b4 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:55.455500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04c43d63-4a46-4723-9293-f24716b579b4 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:55.457063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04c43d63-4a46-4723-9293-f24716b579b4 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:55.457738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04c43d63-4a46-4723-9293-f24716b579b4 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:55.483637 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-04c43d63-4a46-4723-9293-f24716b579b4 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] HTTP exception thrown: Instance 29cf4e73-7932-4ca9-bda4-067dc4ab587d could not be found. Mar 12 21:19:55.485066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04c43d63-4a46-4723-9293-f24716b579b4 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Returning 404 to user: Instance 29cf4e73-7932-4ca9-bda4-067dc4ab587d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:19:55.486319 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04c43d63-4a46-4723-9293-f24716b579b4 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d" status: 404 len: 111 microversion: 2.1 time: 0.046963 Mar 12 21:19:55.490294 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4458/5226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:55 2022] GET /compute/v2.1/servers/29cf4e73-7932-4ca9-bda4-067dc4ab587d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:19:55.727685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-82a46227-bddd-4c45-9ecc-d791d7c3f218 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '.version_select at 0x7f6e35caf9d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:55.760350 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-82a46227-bddd-4c45-9ecc-d791d7c3f218 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1602053234" status: 202 len: 0 microversion: 2.1 time: 0.036767 Mar 12 21:19:55.761277 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4459/5227] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Mar 12 21:19:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1602053234 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:19:56.455434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b5b02eea-f13f-45e6-8ed6-727f52dabbcb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:56.456501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b5b02eea-f13f-45e6-8ed6-727f52dabbcb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:56.465094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5b02eea-f13f-45e6-8ed6-727f52dabbcb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:56.465937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5b02eea-f13f-45e6-8ed6-727f52dabbcb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:56.467047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5b02eea-f13f-45e6-8ed6-727f52dabbcb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:56.467718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b5b02eea-f13f-45e6-8ed6-727f52dabbcb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:56.729996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b5b02eea-f13f-45e6-8ed6-727f52dabbcb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:56.739999 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b5b02eea-f13f-45e6-8ed6-727f52dabbcb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1528 microversion: 2.1 time: 0.289745 Mar 12 21:19:56.740598 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4460/5228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:56 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1528 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:57.759046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-826defe8-9489-4cb1-8c1c-8bcdbb835889 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:57.760399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-826defe8-9489-4cb1-8c1c-8bcdbb835889 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:57.771376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-826defe8-9489-4cb1-8c1c-8bcdbb835889 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:57.771918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-826defe8-9489-4cb1-8c1c-8bcdbb835889 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:57.778006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-826defe8-9489-4cb1-8c1c-8bcdbb835889 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:57.779093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-826defe8-9489-4cb1-8c1c-8bcdbb835889 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:58.202482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-826defe8-9489-4cb1-8c1c-8bcdbb835889 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:19:58.211174 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-826defe8-9489-4cb1-8c1c-8bcdbb835889 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1528 microversion: 2.1 time: 0.457534 Mar 12 21:19:58.211776 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4461/5229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:57 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1528 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:19:58.391764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9877db88-e501-4d0a-8c93-a19285bcc9c1 req-e15273a9-672c-4944-8317-1748c8d62eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b76b5d9-ae42-47fb-925a-b03a8401ccb9", "tag": "7d71bc93-c1b2-4330-9e3a-ca2541f7a935"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:19:58.408949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9877db88-e501-4d0a-8c93-a19285bcc9c1 req-e15273a9-672c-4944-8317-1748c8d62eee service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:58.414761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9877db88-e501-4d0a-8c93-a19285bcc9c1 req-e15273a9-672c-4944-8317-1748c8d62eee service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:58.434826 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9877db88-e501-4d0a-8c93-a19285bcc9c1 req-e15273a9-672c-4944-8317-1748c8d62eee service nova] Creating event network-changed:7d71bc93-c1b2-4330-9e3a-ca2541f7a935 for instance 3b76b5d9-ae42-47fb-925a-b03a8401ccb9 on nch1-master-1 Mar 12 21:19:58.441723 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9877db88-e501-4d0a-8c93-a19285bcc9c1 req-e15273a9-672c-4944-8317-1748c8d62eee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053562 Mar 12 21:19:58.449015 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4462/5230] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:19:59.233087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-28b466c5-20fe-433c-81cf-f0d05db283f0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:19:59.240614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-28b466c5-20fe-433c-81cf-f0d05db283f0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:19:59.252414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28b466c5-20fe-433c-81cf-f0d05db283f0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:59.253036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28b466c5-20fe-433c-81cf-f0d05db283f0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:19:59.253993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28b466c5-20fe-433c-81cf-f0d05db283f0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:19:59.255248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28b466c5-20fe-433c-81cf-f0d05db283f0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:00.229919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-28b466c5-20fe-433c-81cf-f0d05db283f0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:00.241378 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-28b466c5-20fe-433c-81cf-f0d05db283f0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1528 microversion: 2.1 time: 1.016922 Mar 12 21:20:00.252183 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4463/5231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:19:59 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1528 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:00.485711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b28f49f9-f7bd-4896-8a05-cbd6964afa37 req-2297f860-00bb-4883-b95c-e9ec1d83b376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d83827c-2370-4722-805c-f08d06cfe228", "tag": "4bf1b21e-0896-4e40-89ad-d0048bb55a06"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:00.526972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b28f49f9-f7bd-4896-8a05-cbd6964afa37 req-2297f860-00bb-4883-b95c-e9ec1d83b376 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:00.528060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b28f49f9-f7bd-4896-8a05-cbd6964afa37 req-2297f860-00bb-4883-b95c-e9ec1d83b376 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:00.566068 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b28f49f9-f7bd-4896-8a05-cbd6964afa37 req-2297f860-00bb-4883-b95c-e9ec1d83b376 service nova] Creating event network-changed:4bf1b21e-0896-4e40-89ad-d0048bb55a06 for instance 3d83827c-2370-4722-805c-f08d06cfe228 on nch2-master-1 Mar 12 21:20:00.577273 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b28f49f9-f7bd-4896-8a05-cbd6964afa37 req-2297f860-00bb-4883-b95c-e9ec1d83b376 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095317 Mar 12 21:20:00.578788 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4464/5232] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:20:01.269198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce8e8ed5-fa7f-4def-8bd3-4f9797ed161a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:01.270958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce8e8ed5-fa7f-4def-8bd3-4f9797ed161a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:01.290779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce8e8ed5-fa7f-4def-8bd3-4f9797ed161a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:01.291622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce8e8ed5-fa7f-4def-8bd3-4f9797ed161a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:01.293195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce8e8ed5-fa7f-4def-8bd3-4f9797ed161a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:01.293835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce8e8ed5-fa7f-4def-8bd3-4f9797ed161a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:02.366628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce8e8ed5-fa7f-4def-8bd3-4f9797ed161a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:02.375824 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce8e8ed5-fa7f-4def-8bd3-4f9797ed161a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1528 microversion: 2.1 time: 1.111027 Mar 12 21:20:02.387116 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4465/5233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:01 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1528 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:02.797286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fc0c70be-b318-4cbf-9e7d-0cf1364aaf2e req-c2949ae4-48a0-4940-8109-684c8a6a8355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b76b5d9-ae42-47fb-925a-b03a8401ccb9", "tag": "7d71bc93-c1b2-4330-9e3a-ca2541f7a935"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:02.808296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fc0c70be-b318-4cbf-9e7d-0cf1364aaf2e req-c2949ae4-48a0-4940-8109-684c8a6a8355 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:02.808760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fc0c70be-b318-4cbf-9e7d-0cf1364aaf2e req-c2949ae4-48a0-4940-8109-684c8a6a8355 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:02.841057 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fc0c70be-b318-4cbf-9e7d-0cf1364aaf2e req-c2949ae4-48a0-4940-8109-684c8a6a8355 service nova] Creating event network-changed:7d71bc93-c1b2-4330-9e3a-ca2541f7a935 for instance 3b76b5d9-ae42-47fb-925a-b03a8401ccb9 on nch1-master-1 Mar 12 21:20:02.854967 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fc0c70be-b318-4cbf-9e7d-0cf1364aaf2e req-c2949ae4-48a0-4940-8109-684c8a6a8355 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061471 Mar 12 21:20:02.856443 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4466/5234] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:20:03.396209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bc983113-c554-49f2-80ae-bca68a0fe8b0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:03.398415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bc983113-c554-49f2-80ae-bca68a0fe8b0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:03.405542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc983113-c554-49f2-80ae-bca68a0fe8b0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:03.406453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc983113-c554-49f2-80ae-bca68a0fe8b0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:03.407537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc983113-c554-49f2-80ae-bca68a0fe8b0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:03.408211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bc983113-c554-49f2-80ae-bca68a0fe8b0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:03.775017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bc983113-c554-49f2-80ae-bca68a0fe8b0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:03.801859 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bc983113-c554-49f2-80ae-bca68a0fe8b0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1528 microversion: 2.1 time: 0.409793 Mar 12 21:20:03.804849 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4467/5235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:03 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1528 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:04.828171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aee8185a-52b5-4095-883f-bd7b83a0120b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:04.841365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aee8185a-52b5-4095-883f-bd7b83a0120b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:04.855086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aee8185a-52b5-4095-883f-bd7b83a0120b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:04.857275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aee8185a-52b5-4095-883f-bd7b83a0120b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:04.863663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aee8185a-52b5-4095-883f-bd7b83a0120b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:04.864024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aee8185a-52b5-4095-883f-bd7b83a0120b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:05.083033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aee8185a-52b5-4095-883f-bd7b83a0120b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:05.093853 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aee8185a-52b5-4095-883f-bd7b83a0120b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1528 microversion: 2.1 time: 0.269657 Mar 12 21:20:05.095099 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4468/5236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:04 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1528 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:05.111368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c4862d4f-29ac-4f6b-ac9a-af9edb5ad0ce req-78dd44cf-c474-4041-8956-a697d8c9bf50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b76b5d9-ae42-47fb-925a-b03a8401ccb9", "tag": "7d71bc93-c1b2-4330-9e3a-ca2541f7a935"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:05.123222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c4862d4f-29ac-4f6b-ac9a-af9edb5ad0ce req-78dd44cf-c474-4041-8956-a697d8c9bf50 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:05.124020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c4862d4f-29ac-4f6b-ac9a-af9edb5ad0ce req-78dd44cf-c474-4041-8956-a697d8c9bf50 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:05.139984 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c4862d4f-29ac-4f6b-ac9a-af9edb5ad0ce req-78dd44cf-c474-4041-8956-a697d8c9bf50 service nova] Creating event network-changed:7d71bc93-c1b2-4330-9e3a-ca2541f7a935 for instance 3b76b5d9-ae42-47fb-925a-b03a8401ccb9 on nch1-master-1 Mar 12 21:20:05.149008 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c4862d4f-29ac-4f6b-ac9a-af9edb5ad0ce req-78dd44cf-c474-4041-8956-a697d8c9bf50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048092 Mar 12 21:20:05.150302 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4469/5237] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:20:06.113316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ead16a00-f822-493e-ba7b-33774e5af47e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:06.114160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ead16a00-f822-493e-ba7b-33774e5af47e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:06.122560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ead16a00-f822-493e-ba7b-33774e5af47e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:06.123270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ead16a00-f822-493e-ba7b-33774e5af47e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:06.124192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ead16a00-f822-493e-ba7b-33774e5af47e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:06.124801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ead16a00-f822-493e-ba7b-33774e5af47e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:06.380556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ead16a00-f822-493e-ba7b-33774e5af47e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:06.389387 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ead16a00-f822-493e-ba7b-33774e5af47e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1528 microversion: 2.1 time: 0.281379 Mar 12 21:20:06.394030 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4470/5238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:06 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1528 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:07.408319 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:20:07.408895 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:20:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:20:07.418801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aab19d2b-bf9d-4173-9c8b-bb857a81bcd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:07.419456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aab19d2b-bf9d-4173-9c8b-bb857a81bcd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:07.427169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aab19d2b-bf9d-4173-9c8b-bb857a81bcd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:07.427651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aab19d2b-bf9d-4173-9c8b-bb857a81bcd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:07.428531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aab19d2b-bf9d-4173-9c8b-bb857a81bcd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:07.429000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aab19d2b-bf9d-4173-9c8b-bb857a81bcd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:07.619440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aab19d2b-bf9d-4173-9c8b-bb857a81bcd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:07.632928 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aab19d2b-bf9d-4173-9c8b-bb857a81bcd9 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1510 microversion: 2.1 time: 0.230234 Mar 12 21:20:07.633600 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4471/5239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:07 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:08.650615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cdbc1920-dad0-4c3c-9571-9ace291045ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:08.651259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cdbc1920-dad0-4c3c-9571-9ace291045ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:08.668517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdbc1920-dad0-4c3c-9571-9ace291045ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:08.669007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdbc1920-dad0-4c3c-9571-9ace291045ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:08.673454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdbc1920-dad0-4c3c-9571-9ace291045ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:08.674160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdbc1920-dad0-4c3c-9571-9ace291045ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:08.900900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cdbc1920-dad0-4c3c-9571-9ace291045ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:08.911147 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cdbc1920-dad0-4c3c-9571-9ace291045ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1510 microversion: 2.1 time: 0.264693 Mar 12 21:20:08.921791 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4472/5240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:08 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:09.714819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5bdaccf-f5d4-44e4-a145-ea559bf620f6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Action: 'create', calling method: .version_select at 0x7f6e36f3c4c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1396953839"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:09.732207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c5bdaccf-f5d4-44e4-a145-ea559bf620f6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for project 1940f5d7144c49758a742d34f71e9639. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:20:09.738740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c5bdaccf-f5d4-44e4-a145-ea559bf620f6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for user 75e4a2651a6e469491f271ced8ef9695 and project 1940f5d7144c49758a742d34f71e9639. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:20:10.240344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c5bdaccf-f5d4-44e4-a145-ea559bf620f6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for project 1940f5d7144c49758a742d34f71e9639. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:20:10.245730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-c5bdaccf-f5d4-44e4-a145-ea559bf620f6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for user 75e4a2651a6e469491f271ced8ef9695 and project 1940f5d7144c49758a742d34f71e9639. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:20:10.261073 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c5bdaccf-f5d4-44e4-a145-ea559bf620f6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.551312 Mar 12 21:20:10.261550 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4473/5241] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:20:09 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:10.274899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4442e8a5-66a3-4915-b50f-962ae5f1a9e1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:10.276380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4442e8a5-66a3-4915-b50f-962ae5f1a9e1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:10.282921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4442e8a5-66a3-4915-b50f-962ae5f1a9e1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:10.283546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4442e8a5-66a3-4915-b50f-962ae5f1a9e1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:10.284351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4442e8a5-66a3-4915-b50f-962ae5f1a9e1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:10.284803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4442e8a5-66a3-4915-b50f-962ae5f1a9e1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:10.490219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4442e8a5-66a3-4915-b50f-962ae5f1a9e1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:10.500451 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4442e8a5-66a3-4915-b50f-962ae5f1a9e1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1453 microversion: 2.1 time: 0.237824 Mar 12 21:20:10.512127 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4474/5242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:10 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1453 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:10.512127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4d0457dd-301b-463f-a342-ad74af1e3c2b req-1cd308eb-6d5f-42db-afb3-0029bb663241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e054fc3c-6e21-4333-a700-0c2254b6fa0e", "name": "network-vif-unplugged", "status": "completed", "tag": "38bbbe31-f103-40ff-83fd-ad66bb739042"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:10.517075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4d0457dd-301b-463f-a342-ad74af1e3c2b req-1cd308eb-6d5f-42db-afb3-0029bb663241 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:10.517203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4d0457dd-301b-463f-a342-ad74af1e3c2b req-1cd308eb-6d5f-42db-afb3-0029bb663241 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:10.528460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.compute.server_external_events [req-4d0457dd-301b-463f-a342-ad74af1e3c2b req-1cd308eb-6d5f-42db-afb3-0029bb663241 service nova] Unable to find a host for instance e054fc3c-6e21-4333-a700-0c2254b6fa0e. Dropping event network-vif-unplugged {{(pid=136302) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 12 21:20:10.529394 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4d0457dd-301b-463f-a342-ad74af1e3c2b req-1cd308eb-6d5f-42db-afb3-0029bb663241 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027296 Mar 12 21:20:10.530173 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4475/5243] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 12 21:20:10.534623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-43cae974-f4a5-4f3a-9335-47f83ffbdb7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:10.535250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-43cae974-f4a5-4f3a-9335-47f83ffbdb7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:10.542493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43cae974-f4a5-4f3a-9335-47f83ffbdb7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:10.543483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43cae974-f4a5-4f3a-9335-47f83ffbdb7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:10.543765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43cae974-f4a5-4f3a-9335-47f83ffbdb7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:10.544228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-43cae974-f4a5-4f3a-9335-47f83ffbdb7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:10.750319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-43cae974-f4a5-4f3a-9335-47f83ffbdb7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:10.760542 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-43cae974-f4a5-4f3a-9335-47f83ffbdb7d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1453 microversion: 2.1 time: 0.229393 Mar 12 21:20:10.761586 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4476/5244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:10 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1453 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:10.817943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-87dc521c-f480-4200-b9a7-7d8894a9922a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:10.818708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-87dc521c-f480-4200-b9a7-7d8894a9922a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:10.835852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87dc521c-f480-4200-b9a7-7d8894a9922a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:10.837250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87dc521c-f480-4200-b9a7-7d8894a9922a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:10.838185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87dc521c-f480-4200-b9a7-7d8894a9922a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:10.838653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87dc521c-f480-4200-b9a7-7d8894a9922a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:10.871039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-87dc521c-f480-4200-b9a7-7d8894a9922a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lazy-loading 'flavor' on Instance uuid e054fc3c-6e21-4333-a700-0c2254b6fa0e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:20:10.906315 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-87dc521c-f480-4200-b9a7-7d8894a9922a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Cannot 'shelve' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state shelved_offloaded Mar 12 21:20:10.907200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-87dc521c-f480-4200-b9a7-7d8894a9922a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 409 to user: Cannot 'shelve' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state shelved_offloaded {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:10.908279 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-87dc521c-f480-4200-b9a7-7d8894a9922a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 409 len: 155 microversion: 2.1 time: 0.094730 Mar 12 21:20:10.910044 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4477/5245] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:20:10 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 155 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 12 21:20:10.918599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52845e67-64bf-4c45-b0b4-55b78a925ad8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:10.919310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-52845e67-64bf-4c45-b0b4-55b78a925ad8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:10.927798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52845e67-64bf-4c45-b0b4-55b78a925ad8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:10.928301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52845e67-64bf-4c45-b0b4-55b78a925ad8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:10.934906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52845e67-64bf-4c45-b0b4-55b78a925ad8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:10.935813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52845e67-64bf-4c45-b0b4-55b78a925ad8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:11.061677 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-52845e67-64bf-4c45-b0b4-55b78a925ad8 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 202 len: 0 microversion: 2.1 time: 0.147716 Mar 12 21:20:11.065659 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4478/5246] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:20:10 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:20:11.070815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cff9f5e7-0993-4be5-a3e2-6d679b8bd7ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:11.071454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cff9f5e7-0993-4be5-a3e2-6d679b8bd7ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:11.077823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cff9f5e7-0993-4be5-a3e2-6d679b8bd7ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:11.078392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cff9f5e7-0993-4be5-a3e2-6d679b8bd7ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:11.079204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cff9f5e7-0993-4be5-a3e2-6d679b8bd7ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:11.079666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cff9f5e7-0993-4be5-a3e2-6d679b8bd7ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:11.310256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cff9f5e7-0993-4be5-a3e2-6d679b8bd7ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:11.321154 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cff9f5e7-0993-4be5-a3e2-6d679b8bd7ce tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1461 microversion: 2.1 time: 0.253407 Mar 12 21:20:11.323453 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4479/5247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:11 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1461 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:11.906530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-32008448", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "45640eda-93d5-4308-9332-9aea9ce63b68"}], "key_name": "tempest-TestNetworkBasicOps-1396953839", "security_groups": [{"name": "tempest-secgroup-smoke-473983290"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:12.052660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] validate_networks() for [('45640eda-93d5-4308-9332-9aea9ce63b68', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:20:12.579171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:20:12.579616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:20:12.580124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:20:12.580554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:20:12.581204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:20:12.596056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:12.596997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:12.598075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:12.598510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:12.629814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for project 1940f5d7144c49758a742d34f71e9639. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:20:12.637645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Getting quotas for user 75e4a2651a6e469491f271ced8ef9695 and project 1940f5d7144c49758a742d34f71e9639. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:20:12.655814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:20:12.658821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:20:12.710340 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1ad9851-19ef-49e8-bd03-13d9a04e730c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.809753 Mar 12 21:20:12.711628 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4480/5248] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:20:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:20:12.717018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7719571b-4d59-44f4-85c7-29f8c9df8ff0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:12.718077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7719571b-4d59-44f4-85c7-29f8c9df8ff0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:12.724953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7719571b-4d59-44f4-85c7-29f8c9df8ff0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:12.725534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7719571b-4d59-44f4-85c7-29f8c9df8ff0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:12.726737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7719571b-4d59-44f4-85c7-29f8c9df8ff0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:12.727201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7719571b-4d59-44f4-85c7-29f8c9df8ff0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:12.908267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7719571b-4d59-44f4-85c7-29f8c9df8ff0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:12.918465 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7719571b-4d59-44f4-85c7-29f8c9df8ff0 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.205512 Mar 12 21:20:12.919428 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4481/5249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:12 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:12.925918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39a0e6b1-bd40-4e09-bd46-84a31bf7e6a2 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:12.926873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39a0e6b1-bd40-4e09-bd46-84a31bf7e6a2 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:13.024794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39a0e6b1-bd40-4e09-bd46-84a31bf7e6a2 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:13.034991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39a0e6b1-bd40-4e09-bd46-84a31bf7e6a2 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1247 microversion: 2.1 time: 0.113806 Mar 12 21:20:13.035790 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4482/5250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:12 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1247 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:13.695137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9f8c207b-48e9-481b-982a-d451c5b12f98 req-5f033724-b987-4ab4-9d95-c9d0e9cac0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e054fc3c-6e21-4333-a700-0c2254b6fa0e", "tag": "38bbbe31-f103-40ff-83fd-ad66bb739042"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:13.704309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9f8c207b-48e9-481b-982a-d451c5b12f98 req-5f033724-b987-4ab4-9d95-c9d0e9cac0e8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:13.704787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9f8c207b-48e9-481b-982a-d451c5b12f98 req-5f033724-b987-4ab4-9d95-c9d0e9cac0e8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:13.715629 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9f8c207b-48e9-481b-982a-d451c5b12f98 req-5f033724-b987-4ab4-9d95-c9d0e9cac0e8 service nova] Creating event network-changed:38bbbe31-f103-40ff-83fd-ad66bb739042 for instance e054fc3c-6e21-4333-a700-0c2254b6fa0e on nch2-master-1 Mar 12 21:20:13.720890 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9f8c207b-48e9-481b-982a-d451c5b12f98 req-5f033724-b987-4ab4-9d95-c9d0e9cac0e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030845 Mar 12 21:20:13.721465 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4483/5251] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:20:13.946484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-971df189-e393-409a-948d-6375383cf6fb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:13.947227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-971df189-e393-409a-948d-6375383cf6fb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:13.955569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-971df189-e393-409a-948d-6375383cf6fb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:13.956455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-971df189-e393-409a-948d-6375383cf6fb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:13.957565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-971df189-e393-409a-948d-6375383cf6fb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:13.958270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-971df189-e393-409a-948d-6375383cf6fb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:14.121277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-971df189-e393-409a-948d-6375383cf6fb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:14.130725 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-971df189-e393-409a-948d-6375383cf6fb tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.192132 Mar 12 21:20:14.131362 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4484/5252] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:13 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:14.145321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04907efd-0b96-42e5-998d-bfb43d1c02f5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:14.145974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04907efd-0b96-42e5-998d-bfb43d1c02f5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:14.151961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04907efd-0b96-42e5-998d-bfb43d1c02f5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:14.152486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04907efd-0b96-42e5-998d-bfb43d1c02f5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:14.153289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04907efd-0b96-42e5-998d-bfb43d1c02f5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:14.153746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04907efd-0b96-42e5-998d-bfb43d1c02f5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:14.215041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04907efd-0b96-42e5-998d-bfb43d1c02f5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:14.222835 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04907efd-0b96-42e5-998d-bfb43d1c02f5 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1305 microversion: 2.1 time: 0.081283 Mar 12 21:20:14.223425 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4485/5253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:14 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1305 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:15.152473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-451f2e1a-be2c-4b00-b29c-fb064caf42d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:15.153169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-451f2e1a-be2c-4b00-b29c-fb064caf42d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:15.179735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-451f2e1a-be2c-4b00-b29c-fb064caf42d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:15.180214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-451f2e1a-be2c-4b00-b29c-fb064caf42d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:15.181038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-451f2e1a-be2c-4b00-b29c-fb064caf42d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:15.184404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-451f2e1a-be2c-4b00-b29c-fb064caf42d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:15.427737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-451f2e1a-be2c-4b00-b29c-fb064caf42d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:15.442115 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-451f2e1a-be2c-4b00-b29c-fb064caf42d1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.295706 Mar 12 21:20:15.443871 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4486/5254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:15 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:15.461009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a2c8ead-fb39-47d8-9d67-4dc00818114e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:15.462205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0a2c8ead-fb39-47d8-9d67-4dc00818114e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:15.471286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a2c8ead-fb39-47d8-9d67-4dc00818114e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:15.472015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a2c8ead-fb39-47d8-9d67-4dc00818114e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:15.473924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a2c8ead-fb39-47d8-9d67-4dc00818114e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:15.474393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a2c8ead-fb39-47d8-9d67-4dc00818114e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:15.684160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0a2c8ead-fb39-47d8-9d67-4dc00818114e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:15.694487 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0a2c8ead-fb39-47d8-9d67-4dc00818114e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1372 microversion: 2.1 time: 0.248153 Mar 12 21:20:15.696002 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4487/5255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:15 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:16.463068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a1dfa41-302c-498a-94bf-74108ef53c8b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:16.464493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a1dfa41-302c-498a-94bf-74108ef53c8b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:16.473189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a1dfa41-302c-498a-94bf-74108ef53c8b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:16.473903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a1dfa41-302c-498a-94bf-74108ef53c8b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:16.475383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a1dfa41-302c-498a-94bf-74108ef53c8b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:16.476008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a1dfa41-302c-498a-94bf-74108ef53c8b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:16.725920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5a1dfa41-302c-498a-94bf-74108ef53c8b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:16.734902 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a1dfa41-302c-498a-94bf-74108ef53c8b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.276042 Mar 12 21:20:16.735550 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4488/5256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:16 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:16.741252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-28625c36-a2d7-4c4a-94ec-b00d6d02be3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:16.742087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-28625c36-a2d7-4c4a-94ec-b00d6d02be3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:16.750807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28625c36-a2d7-4c4a-94ec-b00d6d02be3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:16.751276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28625c36-a2d7-4c4a-94ec-b00d6d02be3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:16.752112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28625c36-a2d7-4c4a-94ec-b00d6d02be3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:16.752567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28625c36-a2d7-4c4a-94ec-b00d6d02be3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:16.920641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-28625c36-a2d7-4c4a-94ec-b00d6d02be3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:16.928753 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-28625c36-a2d7-4c4a-94ec-b00d6d02be3d tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1372 microversion: 2.1 time: 0.191772 Mar 12 21:20:16.936489 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4489/5257] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:16 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:17.753614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2d4beef-8b3b-491a-a42c-c785492d403e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:17.755039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2d4beef-8b3b-491a-a42c-c785492d403e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:17.762250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d4beef-8b3b-491a-a42c-c785492d403e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:17.762728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d4beef-8b3b-491a-a42c-c785492d403e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:17.763704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d4beef-8b3b-491a-a42c-c785492d403e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:17.764158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2d4beef-8b3b-491a-a42c-c785492d403e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:17.956670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f2d4beef-8b3b-491a-a42c-c785492d403e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:17.966934 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2d4beef-8b3b-491a-a42c-c785492d403e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.218421 Mar 12 21:20:17.968193 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4490/5258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:17 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:17.973400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a0304ec3-2876-4bb5-ba25-0466a6712dfc tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:17.974348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a0304ec3-2876-4bb5-ba25-0466a6712dfc tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:17.981649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0304ec3-2876-4bb5-ba25-0466a6712dfc tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:17.982384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0304ec3-2876-4bb5-ba25-0466a6712dfc tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:17.983715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0304ec3-2876-4bb5-ba25-0466a6712dfc tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:17.984471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a0304ec3-2876-4bb5-ba25-0466a6712dfc tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:18.199659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a0304ec3-2876-4bb5-ba25-0466a6712dfc tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:18.213275 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a0304ec3-2876-4bb5-ba25-0466a6712dfc tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1372 microversion: 2.1 time: 0.243667 Mar 12 21:20:18.213913 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4491/5259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:17 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1372 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:18.987777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d63fcb5c-35e8-41ec-b9fe-724a36e477d3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:18.989059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d63fcb5c-35e8-41ec-b9fe-724a36e477d3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:18.998440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d63fcb5c-35e8-41ec-b9fe-724a36e477d3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:18.998995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d63fcb5c-35e8-41ec-b9fe-724a36e477d3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:18.999901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d63fcb5c-35e8-41ec-b9fe-724a36e477d3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:19.000538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d63fcb5c-35e8-41ec-b9fe-724a36e477d3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:19.664228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d63fcb5c-35e8-41ec-b9fe-724a36e477d3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:19.674867 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d63fcb5c-35e8-41ec-b9fe-724a36e477d3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.691882 Mar 12 21:20:19.676497 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4492/5260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:18 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:19.694852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-07550f16-1a0f-42f1-b4c7-59a4afe8c2ab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:19.695874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-07550f16-1a0f-42f1-b4c7-59a4afe8c2ab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:19.704861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07550f16-1a0f-42f1-b4c7-59a4afe8c2ab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:19.705373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07550f16-1a0f-42f1-b4c7-59a4afe8c2ab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:19.706454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07550f16-1a0f-42f1-b4c7-59a4afe8c2ab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:19.707086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07550f16-1a0f-42f1-b4c7-59a4afe8c2ab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:20.009849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-07550f16-1a0f-42f1-b4c7-59a4afe8c2ab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:20.019334 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-07550f16-1a0f-42f1-b4c7-59a4afe8c2ab tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1372 microversion: 2.1 time: 0.341414 Mar 12 21:20:20.020310 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4493/5261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:19 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1372 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:20.693912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3749ebbd-8d38-4727-8073-7ff0ba452b9d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:20.694771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3749ebbd-8d38-4727-8073-7ff0ba452b9d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:20.707253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3749ebbd-8d38-4727-8073-7ff0ba452b9d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:20.707949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3749ebbd-8d38-4727-8073-7ff0ba452b9d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:20.709373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3749ebbd-8d38-4727-8073-7ff0ba452b9d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:20.710138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3749ebbd-8d38-4727-8073-7ff0ba452b9d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:20.885147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3749ebbd-8d38-4727-8073-7ff0ba452b9d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:20.888454 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3749ebbd-8d38-4727-8073-7ff0ba452b9d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.199503 Mar 12 21:20:20.889522 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4494/5262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:20 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:21.038418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6a290ad4-6740-46d3-b7ff-9403d1dec3cb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:21.039256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6a290ad4-6740-46d3-b7ff-9403d1dec3cb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:21.046717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a290ad4-6740-46d3-b7ff-9403d1dec3cb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:21.047093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a290ad4-6740-46d3-b7ff-9403d1dec3cb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:21.047903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a290ad4-6740-46d3-b7ff-9403d1dec3cb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:21.048357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a290ad4-6740-46d3-b7ff-9403d1dec3cb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:21.258315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6a290ad4-6740-46d3-b7ff-9403d1dec3cb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:21.267909 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6a290ad4-6740-46d3-b7ff-9403d1dec3cb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1372 microversion: 2.1 time: 0.234212 Mar 12 21:20:21.268975 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4495/5263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:21 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1372 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:21.914722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ed0fc2e9-c0c0-470d-8391-0f68a44f2a16 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:21.915509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ed0fc2e9-c0c0-470d-8391-0f68a44f2a16 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:21.922770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed0fc2e9-c0c0-470d-8391-0f68a44f2a16 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:21.923245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed0fc2e9-c0c0-470d-8391-0f68a44f2a16 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:21.924094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed0fc2e9-c0c0-470d-8391-0f68a44f2a16 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:21.925207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed0fc2e9-c0c0-470d-8391-0f68a44f2a16 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:22.092032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ed0fc2e9-c0c0-470d-8391-0f68a44f2a16 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:22.101202 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ed0fc2e9-c0c0-470d-8391-0f68a44f2a16 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.191209 Mar 12 21:20:22.101821 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4496/5264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:21 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:22.289368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-289a8dd5-bb9f-4294-8297-c9f1586d807b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:22.290184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-289a8dd5-bb9f-4294-8297-c9f1586d807b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:22.297373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-289a8dd5-bb9f-4294-8297-c9f1586d807b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:22.297915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-289a8dd5-bb9f-4294-8297-c9f1586d807b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:22.298686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-289a8dd5-bb9f-4294-8297-c9f1586d807b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:22.299143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-289a8dd5-bb9f-4294-8297-c9f1586d807b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:22.454488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-289a8dd5-bb9f-4294-8297-c9f1586d807b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:22.463261 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-289a8dd5-bb9f-4294-8297-c9f1586d807b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1372 microversion: 2.1 time: 0.179182 Mar 12 21:20:22.464027 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4497/5265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:22 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:23.122706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71b1138a-ef10-43ce-9d0b-f5723b533a1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:23.124130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71b1138a-ef10-43ce-9d0b-f5723b533a1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:23.132259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71b1138a-ef10-43ce-9d0b-f5723b533a1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:23.132770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71b1138a-ef10-43ce-9d0b-f5723b533a1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:23.133622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71b1138a-ef10-43ce-9d0b-f5723b533a1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:23.134321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71b1138a-ef10-43ce-9d0b-f5723b533a1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:23.310771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-71b1138a-ef10-43ce-9d0b-f5723b533a1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:23.320981 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71b1138a-ef10-43ce-9d0b-f5723b533a1f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.202484 Mar 12 21:20:23.330848 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4498/5266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:23 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:23.445636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c1ba2fa1-d6e0-4b79-b4c7-c61d2c50c8f8 req-2f01ddd1-75b0-4a3c-a184-b1c8d33b8988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692d0bd9-b0f2-4102-b5d5-7d95e36dfca6", "tag": "cf9ae6bc-82ef-469f-9e88-01c63ce1131e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:23.470998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c1ba2fa1-d6e0-4b79-b4c7-c61d2c50c8f8 req-2f01ddd1-75b0-4a3c-a184-b1c8d33b8988 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:23.472174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c1ba2fa1-d6e0-4b79-b4c7-c61d2c50c8f8 req-2f01ddd1-75b0-4a3c-a184-b1c8d33b8988 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:23.504974 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c1ba2fa1-d6e0-4b79-b4c7-c61d2c50c8f8 req-2f01ddd1-75b0-4a3c-a184-b1c8d33b8988 service nova] Creating event network-changed:cf9ae6bc-82ef-469f-9e88-01c63ce1131e for instance 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 on nch2-master-1 Mar 12 21:20:23.512155 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c1ba2fa1-d6e0-4b79-b4c7-c61d2c50c8f8 req-2f01ddd1-75b0-4a3c-a184-b1c8d33b8988 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071377 Mar 12 21:20:23.513473 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4499/5267] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:20:23.521822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14977b76-0f44-4d9b-a318-b813b5d02800 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:23.523220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14977b76-0f44-4d9b-a318-b813b5d02800 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:23.531639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14977b76-0f44-4d9b-a318-b813b5d02800 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:23.532208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14977b76-0f44-4d9b-a318-b813b5d02800 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:23.533239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14977b76-0f44-4d9b-a318-b813b5d02800 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:23.533748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14977b76-0f44-4d9b-a318-b813b5d02800 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:23.719079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14977b76-0f44-4d9b-a318-b813b5d02800 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:23.733965 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14977b76-0f44-4d9b-a318-b813b5d02800 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1372 microversion: 2.1 time: 0.218189 Mar 12 21:20:23.735457 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4500/5268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:23 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:24.339186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b2f0c033-2e6b-4e14-8625-cbe8f7f57e4d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:24.339832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b2f0c033-2e6b-4e14-8625-cbe8f7f57e4d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:24.346657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2f0c033-2e6b-4e14-8625-cbe8f7f57e4d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:24.347126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2f0c033-2e6b-4e14-8625-cbe8f7f57e4d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:24.347922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2f0c033-2e6b-4e14-8625-cbe8f7f57e4d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:24.348380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2f0c033-2e6b-4e14-8625-cbe8f7f57e4d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:24.514417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b2f0c033-2e6b-4e14-8625-cbe8f7f57e4d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:24.524105 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b2f0c033-2e6b-4e14-8625-cbe8f7f57e4d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.188895 Mar 12 21:20:24.524710 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4501/5269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:24 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:24.752707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-91663ceb-a890-47d9-92d8-a3c0768841ad tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:24.753469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-91663ceb-a890-47d9-92d8-a3c0768841ad tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:24.760724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91663ceb-a890-47d9-92d8-a3c0768841ad tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:24.761227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91663ceb-a890-47d9-92d8-a3c0768841ad tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:24.762332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91663ceb-a890-47d9-92d8-a3c0768841ad tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:24.762831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91663ceb-a890-47d9-92d8-a3c0768841ad tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:24.922328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-91663ceb-a890-47d9-92d8-a3c0768841ad tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:24.930817 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-91663ceb-a890-47d9-92d8-a3c0768841ad tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1372 microversion: 2.1 time: 0.182369 Mar 12 21:20:24.931414 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4502/5270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:24 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:25.544657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fcb8e826-9030-4310-974c-3417c8509f54 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:25.545659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fcb8e826-9030-4310-974c-3417c8509f54 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:25.555163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcb8e826-9030-4310-974c-3417c8509f54 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:25.555848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcb8e826-9030-4310-974c-3417c8509f54 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:25.556854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcb8e826-9030-4310-974c-3417c8509f54 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:25.557466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fcb8e826-9030-4310-974c-3417c8509f54 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:25.713236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fcb8e826-9030-4310-974c-3417c8509f54 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:25.725865 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fcb8e826-9030-4310-974c-3417c8509f54 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.187331 Mar 12 21:20:25.726750 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4503/5271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:25 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:25.949600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1fb057a3-e004-45c2-9bc3-4ed81e75514c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:25.951424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1fb057a3-e004-45c2-9bc3-4ed81e75514c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:25.961543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fb057a3-e004-45c2-9bc3-4ed81e75514c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:25.962058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fb057a3-e004-45c2-9bc3-4ed81e75514c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:25.963052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fb057a3-e004-45c2-9bc3-4ed81e75514c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:25.963522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1fb057a3-e004-45c2-9bc3-4ed81e75514c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:26.103632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1fb057a3-e004-45c2-9bc3-4ed81e75514c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:26.111442 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1fb057a3-e004-45c2-9bc3-4ed81e75514c tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1372 microversion: 2.1 time: 0.166517 Mar 12 21:20:26.112037 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4504/5272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:25 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:26.746010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ab662ee-29d8-403c-a260-bf16f281e7df tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:26.746704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ab662ee-29d8-403c-a260-bf16f281e7df tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:26.753384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ab662ee-29d8-403c-a260-bf16f281e7df tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:26.753885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ab662ee-29d8-403c-a260-bf16f281e7df tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:26.754662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ab662ee-29d8-403c-a260-bf16f281e7df tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:26.755115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ab662ee-29d8-403c-a260-bf16f281e7df tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:26.901588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ab662ee-29d8-403c-a260-bf16f281e7df tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:26.911201 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ab662ee-29d8-403c-a260-bf16f281e7df tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.169061 Mar 12 21:20:26.914562 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4505/5273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:26 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:27.129579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-47fdcdfa-e72f-4225-8e01-01c5d3275389 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:27.130177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-47fdcdfa-e72f-4225-8e01-01c5d3275389 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:27.136977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47fdcdfa-e72f-4225-8e01-01c5d3275389 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:27.137553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47fdcdfa-e72f-4225-8e01-01c5d3275389 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:27.138483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47fdcdfa-e72f-4225-8e01-01c5d3275389 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:27.139090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47fdcdfa-e72f-4225-8e01-01c5d3275389 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:27.298833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-47fdcdfa-e72f-4225-8e01-01c5d3275389 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:27.307208 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-47fdcdfa-e72f-4225-8e01-01c5d3275389 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1372 microversion: 2.1 time: 0.182328 Mar 12 21:20:27.308759 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4506/5274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:27 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:27.739400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5469c116-52aa-4078-aef0-f508d4510f21 req-ce716af7-1ffb-44d8-85a9-d92958f63928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692d0bd9-b0f2-4102-b5d5-7d95e36dfca6", "name": "network-vif-plugged", "status": "completed", "tag": "cf9ae6bc-82ef-469f-9e88-01c63ce1131e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:27.749830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5469c116-52aa-4078-aef0-f508d4510f21 req-ce716af7-1ffb-44d8-85a9-d92958f63928 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:27.750757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5469c116-52aa-4078-aef0-f508d4510f21 req-ce716af7-1ffb-44d8-85a9-d92958f63928 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:27.764214 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5469c116-52aa-4078-aef0-f508d4510f21 req-ce716af7-1ffb-44d8-85a9-d92958f63928 service nova] Creating event network-vif-plugged:cf9ae6bc-82ef-469f-9e88-01c63ce1131e for instance 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 on nch2-master-1 Mar 12 21:20:27.770148 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5469c116-52aa-4078-aef0-f508d4510f21 req-ce716af7-1ffb-44d8-85a9-d92958f63928 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034864 Mar 12 21:20:27.770900 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4507/5275] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:20:27.933925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e1851ae-3065-47cc-8a4b-ae2c0717d13e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:27.934842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e1851ae-3065-47cc-8a4b-ae2c0717d13e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:27.943925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e1851ae-3065-47cc-8a4b-ae2c0717d13e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:27.944598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e1851ae-3065-47cc-8a4b-ae2c0717d13e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:27.945423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e1851ae-3065-47cc-8a4b-ae2c0717d13e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:27.946103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e1851ae-3065-47cc-8a4b-ae2c0717d13e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:28.095907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8e1851ae-3065-47cc-8a4b-ae2c0717d13e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:28.105027 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8e1851ae-3065-47cc-8a4b-ae2c0717d13e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.178505 Mar 12 21:20:28.106172 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4508/5276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:27 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:28.325064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e8d7f07-0691-4d94-b920-bb56b2348308 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:28.325702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5e8d7f07-0691-4d94-b920-bb56b2348308 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:28.331979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e8d7f07-0691-4d94-b920-bb56b2348308 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:28.332472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e8d7f07-0691-4d94-b920-bb56b2348308 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:28.333259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e8d7f07-0691-4d94-b920-bb56b2348308 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:28.333732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e8d7f07-0691-4d94-b920-bb56b2348308 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:28.482904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5e8d7f07-0691-4d94-b920-bb56b2348308 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:28.492249 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e8d7f07-0691-4d94-b920-bb56b2348308 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1372 microversion: 2.1 time: 0.171061 Mar 12 21:20:28.492808 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4509/5277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:28 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:29.123573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea4874f3-346d-4ccd-b35a-0b8d3359cdcf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:29.124317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea4874f3-346d-4ccd-b35a-0b8d3359cdcf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:29.132499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea4874f3-346d-4ccd-b35a-0b8d3359cdcf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:29.132969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea4874f3-346d-4ccd-b35a-0b8d3359cdcf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:29.133791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea4874f3-346d-4ccd-b35a-0b8d3359cdcf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:29.134246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea4874f3-346d-4ccd-b35a-0b8d3359cdcf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:29.282108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ea4874f3-346d-4ccd-b35a-0b8d3359cdcf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:29.290305 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea4874f3-346d-4ccd-b35a-0b8d3359cdcf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.171234 Mar 12 21:20:29.290973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4510/5278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:29 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:29.510934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-be3f04a0-40cc-4026-99e7-d0994668d6ca tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:29.511840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-be3f04a0-40cc-4026-99e7-d0994668d6ca tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:29.519358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be3f04a0-40cc-4026-99e7-d0994668d6ca tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:29.519827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be3f04a0-40cc-4026-99e7-d0994668d6ca tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:29.521002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be3f04a0-40cc-4026-99e7-d0994668d6ca tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:29.521537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-be3f04a0-40cc-4026-99e7-d0994668d6ca tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:29.666400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-be3f04a0-40cc-4026-99e7-d0994668d6ca tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:29.676295 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-be3f04a0-40cc-4026-99e7-d0994668d6ca tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1545 microversion: 2.1 time: 0.170881 Mar 12 21:20:29.677002 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4511/5279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:29 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1545 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:29.694920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af641b81-be2d-453c-8b3a-2359453bc46f tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:29.695554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af641b81-be2d-453c-8b3a-2359453bc46f tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:29.702205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af641b81-be2d-453c-8b3a-2359453bc46f tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:29.702678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af641b81-be2d-453c-8b3a-2359453bc46f tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:29.703463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af641b81-be2d-453c-8b3a-2359453bc46f tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:29.703924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af641b81-be2d-453c-8b3a-2359453bc46f tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:29.846588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-af641b81-be2d-453c-8b3a-2359453bc46f tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:29.854626 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af641b81-be2d-453c-8b3a-2359453bc46f tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1545 microversion: 2.1 time: 0.164061 Mar 12 21:20:29.855222 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4512/5280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:29 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1545 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:29.926749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fbce2fa4-5332-4bed-a8e4-6b9bec2ab14b req-a9d25130-aaa7-4ebd-aad0-30d5942db110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e054fc3c-6e21-4333-a700-0c2254b6fa0e", "name": "network-vif-plugged", "status": "completed", "tag": "38bbbe31-f103-40ff-83fd-ad66bb739042"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:29.935272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fbce2fa4-5332-4bed-a8e4-6b9bec2ab14b req-a9d25130-aaa7-4ebd-aad0-30d5942db110 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:29.935747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fbce2fa4-5332-4bed-a8e4-6b9bec2ab14b req-a9d25130-aaa7-4ebd-aad0-30d5942db110 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:29.949994 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fbce2fa4-5332-4bed-a8e4-6b9bec2ab14b req-a9d25130-aaa7-4ebd-aad0-30d5942db110 service nova] Creating event network-vif-plugged:38bbbe31-f103-40ff-83fd-ad66bb739042 for instance e054fc3c-6e21-4333-a700-0c2254b6fa0e on nch2-master-1 Mar 12 21:20:29.955894 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fbce2fa4-5332-4bed-a8e4-6b9bec2ab14b req-a9d25130-aaa7-4ebd-aad0-30d5942db110 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032634 Mar 12 21:20:29.956813 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4513/5281] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:20:30.310428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7363610c-0ab3-43a6-9709-b69c3fe24b9f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:30.311191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7363610c-0ab3-43a6-9709-b69c3fe24b9f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:30.320224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7363610c-0ab3-43a6-9709-b69c3fe24b9f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:30.320764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7363610c-0ab3-43a6-9709-b69c3fe24b9f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:30.321739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7363610c-0ab3-43a6-9709-b69c3fe24b9f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:30.322365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7363610c-0ab3-43a6-9709-b69c3fe24b9f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:30.610999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7363610c-0ab3-43a6-9709-b69c3fe24b9f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:30.624551 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7363610c-0ab3-43a6-9709-b69c3fe24b9f tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.319058 Mar 12 21:20:30.625335 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4514/5282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:30 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:31.644011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35ae5774-6507-4989-8e08-6ddfdb0b2e99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:31.645169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-35ae5774-6507-4989-8e08-6ddfdb0b2e99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:31.654090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35ae5774-6507-4989-8e08-6ddfdb0b2e99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:31.655153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35ae5774-6507-4989-8e08-6ddfdb0b2e99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:31.656254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35ae5774-6507-4989-8e08-6ddfdb0b2e99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:31.656870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35ae5774-6507-4989-8e08-6ddfdb0b2e99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:31.886247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-35ae5774-6507-4989-8e08-6ddfdb0b2e99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:31.895078 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-35ae5774-6507-4989-8e08-6ddfdb0b2e99 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1519 microversion: 2.1 time: 0.255864 Mar 12 21:20:31.900593 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4515/5283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:31 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:31.999238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9bda80e0-1417-4404-9640-37f66a81972d req-df71ea05-33b7-466f-a7b3-700734cd8bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692d0bd9-b0f2-4102-b5d5-7d95e36dfca6", "tag": "cf9ae6bc-82ef-469f-9e88-01c63ce1131e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:32.008329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9bda80e0-1417-4404-9640-37f66a81972d req-df71ea05-33b7-466f-a7b3-700734cd8bfe service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:32.008938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9bda80e0-1417-4404-9640-37f66a81972d req-df71ea05-33b7-466f-a7b3-700734cd8bfe service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:32.020572 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9bda80e0-1417-4404-9640-37f66a81972d req-df71ea05-33b7-466f-a7b3-700734cd8bfe service nova] Creating event network-changed:cf9ae6bc-82ef-469f-9e88-01c63ce1131e for instance 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 on nch2-master-1 Mar 12 21:20:32.026383 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9bda80e0-1417-4404-9640-37f66a81972d req-df71ea05-33b7-466f-a7b3-700734cd8bfe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123649 Mar 12 21:20:32.027198 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4516/5284] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:20:32.916410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c9ca4865-3065-42b1-8179-4ef73ec5f57b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:32.916901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c9ca4865-3065-42b1-8179-4ef73ec5f57b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:32.927618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9ca4865-3065-42b1-8179-4ef73ec5f57b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:32.928052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9ca4865-3065-42b1-8179-4ef73ec5f57b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:32.929559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9ca4865-3065-42b1-8179-4ef73ec5f57b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:32.930740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9ca4865-3065-42b1-8179-4ef73ec5f57b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:33.102842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c9ca4865-3065-42b1-8179-4ef73ec5f57b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:33.110571 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c9ca4865-3065-42b1-8179-4ef73ec5f57b tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.200605 Mar 12 21:20:33.111166 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4517/5285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:32 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:33.127222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-209aec79-c3f1-4ae6-870f-e65ccb70f715 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:33.127853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-209aec79-c3f1-4ae6-870f-e65ccb70f715 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:33.134560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-209aec79-c3f1-4ae6-870f-e65ccb70f715 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:33.135007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-209aec79-c3f1-4ae6-870f-e65ccb70f715 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:33.135795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-209aec79-c3f1-4ae6-870f-e65ccb70f715 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:33.136254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-209aec79-c3f1-4ae6-870f-e65ccb70f715 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:33.295977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-209aec79-c3f1-4ae6-870f-e65ccb70f715 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:33.304916 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-209aec79-c3f1-4ae6-870f-e65ccb70f715 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.181525 Mar 12 21:20:33.305613 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4518/5286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:33 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:33.328551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-64150cdb-acec-4d70-b0b2-2922844665e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:33.329174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-64150cdb-acec-4d70-b0b2-2922844665e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:33.335408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64150cdb-acec-4d70-b0b2-2922844665e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:33.335874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64150cdb-acec-4d70-b0b2-2922844665e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:33.336698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64150cdb-acec-4d70-b0b2-2922844665e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:33.337154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-64150cdb-acec-4d70-b0b2-2922844665e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:33.489520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-64150cdb-acec-4d70-b0b2-2922844665e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:33.498091 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-64150cdb-acec-4d70-b0b2-2922844665e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.173196 Mar 12 21:20:33.498676 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4519/5287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:33 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:33.520324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a2b8dd5-8c16-4966-94e8-173c83f903b3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:33.528642 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8a2b8dd5-8c16-4966-94e8-173c83f903b3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance a46d1ae6-a864-420d-8128-82d6680fa886 has no mapping to a cell. Mar 12 21:20:33.529525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a2b8dd5-8c16-4966-94e8-173c83f903b3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance a46d1ae6-a864-420d-8128-82d6680fa886 has no mapping to a cell. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:33.530401 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a2b8dd5-8c16-4966-94e8-173c83f903b3 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/a46d1ae6-a864-420d-8128-82d6680fa886/action" status: 404 len: 117 microversion: 2.1 time: 0.018181 Mar 12 21:20:33.530986 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4520/5288] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:20:33 2022] POST /compute/v2.1/servers/a46d1ae6-a864-420d-8128-82d6680fa886/action => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:20:33.540197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c3acd27-cc78-4b88-a305-eadda0be7b09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:33.540984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c3acd27-cc78-4b88-a305-eadda0be7b09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:33.548986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3acd27-cc78-4b88-a305-eadda0be7b09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:33.549590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3acd27-cc78-4b88-a305-eadda0be7b09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:33.550247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3acd27-cc78-4b88-a305-eadda0be7b09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:33.550767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c3acd27-cc78-4b88-a305-eadda0be7b09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:33.696017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c3acd27-cc78-4b88-a305-eadda0be7b09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:33.703414 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c3acd27-cc78-4b88-a305-eadda0be7b09 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.167515 Mar 12 21:20:33.703987 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4521/5289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:33 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:33.721584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d4199b7b-52b4-4a86-a33a-ed0bc3deb68c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:33.722240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d4199b7b-52b4-4a86-a33a-ed0bc3deb68c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:33.729041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4199b7b-52b4-4a86-a33a-ed0bc3deb68c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:33.729510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4199b7b-52b4-4a86-a33a-ed0bc3deb68c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:33.730364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4199b7b-52b4-4a86-a33a-ed0bc3deb68c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:33.730868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4199b7b-52b4-4a86-a33a-ed0bc3deb68c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:33.882245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d4199b7b-52b4-4a86-a33a-ed0bc3deb68c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:33.891784 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d4199b7b-52b4-4a86-a33a-ed0bc3deb68c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.173927 Mar 12 21:20:33.892915 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4522/5290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:33 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:33.924572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-11b2a866-4b3f-44f6-8ac1-56b8c0e6e40a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:33.925236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-11b2a866-4b3f-44f6-8ac1-56b8c0e6e40a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: d227a7f6-5877-4a1a-a15a-7ce40ed508dc] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:33.932810 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-11b2a866-4b3f-44f6-8ac1-56b8c0e6e40a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance d227a7f6-5877-4a1a-a15a-7ce40ed508dc could not be found. Mar 12 21:20:33.933555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-11b2a866-4b3f-44f6-8ac1-56b8c0e6e40a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance d227a7f6-5877-4a1a-a15a-7ce40ed508dc could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:33.934585 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-11b2a866-4b3f-44f6-8ac1-56b8c0e6e40a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/d227a7f6-5877-4a1a-a15a-7ce40ed508dc/action" status: 404 len: 111 microversion: 2.1 time: 0.015096 Mar 12 21:20:33.935227 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4523/5291] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:20:33 2022] POST /compute/v2.1/servers/d227a7f6-5877-4a1a-a15a-7ce40ed508dc/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:20:33.944103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9558b29f-cd77-4cf8-8dba-0657c1f8cfed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:33.946648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9558b29f-cd77-4cf8-8dba-0657c1f8cfed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:33.953446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9558b29f-cd77-4cf8-8dba-0657c1f8cfed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:33.953999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9558b29f-cd77-4cf8-8dba-0657c1f8cfed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:33.954799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9558b29f-cd77-4cf8-8dba-0657c1f8cfed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:33.955254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9558b29f-cd77-4cf8-8dba-0657c1f8cfed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:34.115548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9558b29f-cd77-4cf8-8dba-0657c1f8cfed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:34.126570 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9558b29f-cd77-4cf8-8dba-0657c1f8cfed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.186806 Mar 12 21:20:34.127351 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4524/5292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:33 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:34.147203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71ade651-de07-4611-a820-eaf045d320a4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:34.147915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71ade651-de07-4611-a820-eaf045d320a4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:34.154857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71ade651-de07-4611-a820-eaf045d320a4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:34.155426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71ade651-de07-4611-a820-eaf045d320a4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:34.156545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71ade651-de07-4611-a820-eaf045d320a4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:34.157039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71ade651-de07-4611-a820-eaf045d320a4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:34.301415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-71ade651-de07-4611-a820-eaf045d320a4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:34.310251 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71ade651-de07-4611-a820-eaf045d320a4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.167979 Mar 12 21:20:34.310928 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4525/5293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:34 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:34.327921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-61bccc97-376b-4308-a4ae-315629ba0050 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:34.328494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-61bccc97-376b-4308-a4ae-315629ba0050 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:34.335188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61bccc97-376b-4308-a4ae-315629ba0050 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:34.335597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61bccc97-376b-4308-a4ae-315629ba0050 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:34.336497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61bccc97-376b-4308-a4ae-315629ba0050 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:34.336848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61bccc97-376b-4308-a4ae-315629ba0050 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:34.359949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-61bccc97-376b-4308-a4ae-315629ba0050 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lazy-loading 'flavor' on Instance uuid e054fc3c-6e21-4333-a700-0c2254b6fa0e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:20:34.428696 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-61bccc97-376b-4308-a4ae-315629ba0050 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 202 len: 0 microversion: 2.1 time: 0.104393 Mar 12 21:20:34.429488 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4526/5294] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:20:34 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:20:34.438310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-73cb44d1-5884-4927-b35d-e75e45f90215 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:34.439062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-73cb44d1-5884-4927-b35d-e75e45f90215 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:34.447047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73cb44d1-5884-4927-b35d-e75e45f90215 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:34.447524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73cb44d1-5884-4927-b35d-e75e45f90215 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:34.448335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73cb44d1-5884-4927-b35d-e75e45f90215 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:34.448802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73cb44d1-5884-4927-b35d-e75e45f90215 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:34.595168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-73cb44d1-5884-4927-b35d-e75e45f90215 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:34.605195 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-73cb44d1-5884-4927-b35d-e75e45f90215 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1514 microversion: 2.1 time: 0.171115 Mar 12 21:20:34.605973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4527/5295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:34 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:35.625621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dcae7642-bce6-4616-a698-6bf70e003202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:35.626480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dcae7642-bce6-4616-a698-6bf70e003202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:35.632895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcae7642-bce6-4616-a698-6bf70e003202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:35.633370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcae7642-bce6-4616-a698-6bf70e003202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:35.634275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcae7642-bce6-4616-a698-6bf70e003202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:35.634774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcae7642-bce6-4616-a698-6bf70e003202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:35.776962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dcae7642-bce6-4616-a698-6bf70e003202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:35.785442 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dcae7642-bce6-4616-a698-6bf70e003202 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1497 microversion: 2.1 time: 0.164455 Mar 12 21:20:35.786063 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4528/5296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:35 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:35.802258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f43ead1-f0f4-49be-8adb-30b2a27c7e60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:35.802891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f43ead1-f0f4-49be-8adb-30b2a27c7e60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:35.809283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f43ead1-f0f4-49be-8adb-30b2a27c7e60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:35.809753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f43ead1-f0f4-49be-8adb-30b2a27c7e60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:35.810576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f43ead1-f0f4-49be-8adb-30b2a27c7e60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:35.811084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f43ead1-f0f4-49be-8adb-30b2a27c7e60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:35.836162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-9f43ead1-f0f4-49be-8adb-30b2a27c7e60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lazy-loading 'flavor' on Instance uuid e054fc3c-6e21-4333-a700-0c2254b6fa0e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:20:35.848934 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9f43ead1-f0f4-49be-8adb-30b2a27c7e60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Cannot 'suspend' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state suspended Mar 12 21:20:35.849553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f43ead1-f0f4-49be-8adb-30b2a27c7e60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 409 to user: Cannot 'suspend' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state suspended {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:35.850444 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f43ead1-f0f4-49be-8adb-30b2a27c7e60 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 409 len: 148 microversion: 2.1 time: 0.052185 Mar 12 21:20:35.851047 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4529/5297] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:20:35 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 148 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 12 21:20:35.859210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-06cecb2c-de2d-43b6-ae7f-00fbff3b8314 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:35.859768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-06cecb2c-de2d-43b6-ae7f-00fbff3b8314 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:35.866081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06cecb2c-de2d-43b6-ae7f-00fbff3b8314 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:35.866632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06cecb2c-de2d-43b6-ae7f-00fbff3b8314 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:35.867423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06cecb2c-de2d-43b6-ae7f-00fbff3b8314 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:35.867950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-06cecb2c-de2d-43b6-ae7f-00fbff3b8314 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:35.943136 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-06cecb2c-de2d-43b6-ae7f-00fbff3b8314 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 202 len: 0 microversion: 2.1 time: 0.086811 Mar 12 21:20:35.943736 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4530/5298] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:20:35 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:20:35.952388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-160777db-8792-4f25-ab8a-1e22975bceab tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:35.953118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-160777db-8792-4f25-ab8a-1e22975bceab tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:35.960332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-160777db-8792-4f25-ab8a-1e22975bceab tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:35.960827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-160777db-8792-4f25-ab8a-1e22975bceab tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:35.961618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-160777db-8792-4f25-ab8a-1e22975bceab tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:35.962120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-160777db-8792-4f25-ab8a-1e22975bceab tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:36.110438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-160777db-8792-4f25-ab8a-1e22975bceab tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:36.118682 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-160777db-8792-4f25-ab8a-1e22975bceab tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1503 microversion: 2.1 time: 0.170633 Mar 12 21:20:36.119253 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4531/5299] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:35 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:37.136224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fb163357-7078-4ce0-822d-d7fe0cc056e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:37.136873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fb163357-7078-4ce0-822d-d7fe0cc056e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:37.143350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb163357-7078-4ce0-822d-d7fe0cc056e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:37.143827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb163357-7078-4ce0-822d-d7fe0cc056e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:37.144621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb163357-7078-4ce0-822d-d7fe0cc056e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:37.145085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fb163357-7078-4ce0-822d-d7fe0cc056e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:37.276915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fb163357-7078-4ce0-822d-d7fe0cc056e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:37.284400 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fb163357-7078-4ce0-822d-d7fe0cc056e2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.152481 Mar 12 21:20:37.284979 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4532/5300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:37 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:37.301194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b198379-d251-4ec9-880e-39e4e368110e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:37.301845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b198379-d251-4ec9-880e-39e4e368110e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:37.307561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b198379-d251-4ec9-880e-39e4e368110e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:37.308034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b198379-d251-4ec9-880e-39e4e368110e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:37.308818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b198379-d251-4ec9-880e-39e4e368110e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:37.309277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b198379-d251-4ec9-880e-39e4e368110e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:37.441588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8b198379-d251-4ec9-880e-39e4e368110e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:37.449600 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b198379-d251-4ec9-880e-39e4e368110e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.152044 Mar 12 21:20:37.450229 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4533/5301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:37 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:37.465489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1c90422c-b9f7-4a49-a445-6756d37a7cda tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:37.466073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1c90422c-b9f7-4a49-a445-6756d37a7cda tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: 1afa6906-c68a-43cc-aafb-25036cb78062] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:37.471087 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-1c90422c-b9f7-4a49-a445-6756d37a7cda tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance 1afa6906-c68a-43cc-aafb-25036cb78062 could not be found. Mar 12 21:20:37.471689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1c90422c-b9f7-4a49-a445-6756d37a7cda tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance 1afa6906-c68a-43cc-aafb-25036cb78062 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:37.472507 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1c90422c-b9f7-4a49-a445-6756d37a7cda tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/1afa6906-c68a-43cc-aafb-25036cb78062/action" status: 404 len: 111 microversion: 2.1 time: 0.010681 Mar 12 21:20:37.473030 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4534/5302] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:20:37 2022] POST /compute/v2.1/servers/1afa6906-c68a-43cc-aafb-25036cb78062/action => generated 111 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:20:37.480201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2b5ecb5-3a6d-4504-a33f-013b7a5aa5bd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:37.480840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2b5ecb5-3a6d-4504-a33f-013b7a5aa5bd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:37.487392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2b5ecb5-3a6d-4504-a33f-013b7a5aa5bd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:37.487852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2b5ecb5-3a6d-4504-a33f-013b7a5aa5bd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:37.488628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2b5ecb5-3a6d-4504-a33f-013b7a5aa5bd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:37.489080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2b5ecb5-3a6d-4504-a33f-013b7a5aa5bd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:37.619622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e2b5ecb5-3a6d-4504-a33f-013b7a5aa5bd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:37.627312 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2b5ecb5-3a6d-4504-a33f-013b7a5aa5bd tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.150233 Mar 12 21:20:37.628065 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4535/5303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:37 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:37.645173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-775d4cb5-38b8-4c13-b221-8de415e4ddd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:37.645802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-775d4cb5-38b8-4c13-b221-8de415e4ddd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:37.651960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-775d4cb5-38b8-4c13-b221-8de415e4ddd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:37.652433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-775d4cb5-38b8-4c13-b221-8de415e4ddd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:37.653227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-775d4cb5-38b8-4c13-b221-8de415e4ddd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:37.653686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-775d4cb5-38b8-4c13-b221-8de415e4ddd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:37.793911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-775d4cb5-38b8-4c13-b221-8de415e4ddd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:37.801547 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-775d4cb5-38b8-4c13-b221-8de415e4ddd4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.160328 Mar 12 21:20:37.802676 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4536/5304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:37 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:37.818213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a179a7e-ef2b-4d6c-a19f-504b42639223 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:37.818782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a179a7e-ef2b-4d6c-a19f-504b42639223 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:37.824443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a179a7e-ef2b-4d6c-a19f-504b42639223 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:37.824910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a179a7e-ef2b-4d6c-a19f-504b42639223 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:37.825691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a179a7e-ef2b-4d6c-a19f-504b42639223 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:37.826173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a179a7e-ef2b-4d6c-a19f-504b42639223 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:37.848341 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8a179a7e-ef2b-4d6c-a19f-504b42639223 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Cannot 'unpause' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state active Mar 12 21:20:37.849470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a179a7e-ef2b-4d6c-a19f-504b42639223 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 409 to user: Cannot 'unpause' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state active {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:37.850367 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a179a7e-ef2b-4d6c-a19f-504b42639223 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 409 len: 145 microversion: 2.1 time: 0.036458 Mar 12 21:20:37.850918 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4537/5305] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:20:37 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 145 bytes in 37 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 12 21:20:37.858488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-07093278-0d26-41aa-9b86-a0da1f149402 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:37.859115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-07093278-0d26-41aa-9b86-a0da1f149402 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:37.865493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07093278-0d26-41aa-9b86-a0da1f149402 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:37.866000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07093278-0d26-41aa-9b86-a0da1f149402 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:37.866787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07093278-0d26-41aa-9b86-a0da1f149402 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:37.867241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07093278-0d26-41aa-9b86-a0da1f149402 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.000619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-07093278-0d26-41aa-9b86-a0da1f149402 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:38.008165 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-07093278-0d26-41aa-9b86-a0da1f149402 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.153171 Mar 12 21:20:38.008741 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4538/5306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:37 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:38.024696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0857330a-2256-4535-841c-32f45d4a48d7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:38.025319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0857330a-2256-4535-841c-32f45d4a48d7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:38.032006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0857330a-2256-4535-841c-32f45d4a48d7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.032755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0857330a-2256-4535-841c-32f45d4a48d7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.033569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0857330a-2256-4535-841c-32f45d4a48d7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.034066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0857330a-2256-4535-841c-32f45d4a48d7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.174358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0857330a-2256-4535-841c-32f45d4a48d7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:38.182499 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0857330a-2256-4535-841c-32f45d4a48d7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.161651 Mar 12 21:20:38.183082 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4539/5307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:38 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:38.198522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3df02dfa-77b5-4fb8-bd04-2f050c21a66c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:38.199161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3df02dfa-77b5-4fb8-bd04-2f050c21a66c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: 38b1b4c9-0965-426b-bfe3-88997c48ed75] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:38.204160 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3df02dfa-77b5-4fb8-bd04-2f050c21a66c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance 38b1b4c9-0965-426b-bfe3-88997c48ed75 could not be found. Mar 12 21:20:38.204755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3df02dfa-77b5-4fb8-bd04-2f050c21a66c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance 38b1b4c9-0965-426b-bfe3-88997c48ed75 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:38.205578 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3df02dfa-77b5-4fb8-bd04-2f050c21a66c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/38b1b4c9-0965-426b-bfe3-88997c48ed75/action" status: 404 len: 111 microversion: 2.1 time: 0.010709 Mar 12 21:20:38.206139 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4540/5308] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:20:38 2022] POST /compute/v2.1/servers/38b1b4c9-0965-426b-bfe3-88997c48ed75/action => generated 111 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:20:38.213737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8287b1d-89c0-4f3e-93f8-1831766b26a2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:38.214389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8287b1d-89c0-4f3e-93f8-1831766b26a2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:38.221015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8287b1d-89c0-4f3e-93f8-1831766b26a2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.221487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8287b1d-89c0-4f3e-93f8-1831766b26a2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.222315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8287b1d-89c0-4f3e-93f8-1831766b26a2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.222782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8287b1d-89c0-4f3e-93f8-1831766b26a2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.353081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a8287b1d-89c0-4f3e-93f8-1831766b26a2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:38.360619 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8287b1d-89c0-4f3e-93f8-1831766b26a2 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.150175 Mar 12 21:20:38.361203 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4541/5309] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:38 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:38.377479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d7c2831-29a0-4b8c-a781-eab77d0f3f48 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:38.378152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2d7c2831-29a0-4b8c-a781-eab77d0f3f48 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:38.384610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d7c2831-29a0-4b8c-a781-eab77d0f3f48 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.385086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d7c2831-29a0-4b8c-a781-eab77d0f3f48 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.385909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d7c2831-29a0-4b8c-a781-eab77d0f3f48 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.386375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d7c2831-29a0-4b8c-a781-eab77d0f3f48 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.515671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2d7c2831-29a0-4b8c-a781-eab77d0f3f48 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:38.523284 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d7c2831-29a0-4b8c-a781-eab77d0f3f48 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.149446 Mar 12 21:20:38.523865 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4542/5310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:38 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:38.539109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-50122cbb-cab8-425f-ac4c-23386fd87825 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:38.539712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-50122cbb-cab8-425f-ac4c-23386fd87825 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:38.545632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50122cbb-cab8-425f-ac4c-23386fd87825 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.546140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50122cbb-cab8-425f-ac4c-23386fd87825 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.546925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50122cbb-cab8-425f-ac4c-23386fd87825 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.547378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50122cbb-cab8-425f-ac4c-23386fd87825 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.570987 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-50122cbb-cab8-425f-ac4c-23386fd87825 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Cannot 'unshelve' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state active Mar 12 21:20:38.571591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-50122cbb-cab8-425f-ac4c-23386fd87825 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 409 to user: Cannot 'unshelve' instance e054fc3c-6e21-4333-a700-0c2254b6fa0e while it is in vm_state active {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:38.572425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-50122cbb-cab8-425f-ac4c-23386fd87825 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action" status: 409 len: 146 microversion: 2.1 time: 0.037055 Mar 12 21:20:38.572978 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4543/5311] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:20:38 2022] POST /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e/action => generated 146 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 12 21:20:38.580848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-651e5d1e-0572-4c6d-b5eb-c390d3537942 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:38.581468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-651e5d1e-0572-4c6d-b5eb-c390d3537942 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:38.587374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-651e5d1e-0572-4c6d-b5eb-c390d3537942 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.587873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-651e5d1e-0572-4c6d-b5eb-c390d3537942 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.588656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-651e5d1e-0572-4c6d-b5eb-c390d3537942 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.589112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-651e5d1e-0572-4c6d-b5eb-c390d3537942 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.725811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-651e5d1e-0572-4c6d-b5eb-c390d3537942 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:38.733349 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-651e5d1e-0572-4c6d-b5eb-c390d3537942 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.156023 Mar 12 21:20:38.733955 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4544/5312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:38 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:38.750746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3edff582-daf1-45a0-a13e-a1a25dfc0cf1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:38.751365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3edff582-daf1-45a0-a13e-a1a25dfc0cf1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:38.757206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3edff582-daf1-45a0-a13e-a1a25dfc0cf1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.757670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3edff582-daf1-45a0-a13e-a1a25dfc0cf1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.758466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3edff582-daf1-45a0-a13e-a1a25dfc0cf1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.758947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3edff582-daf1-45a0-a13e-a1a25dfc0cf1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.890405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3edff582-daf1-45a0-a13e-a1a25dfc0cf1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:38.898214 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3edff582-daf1-45a0-a13e-a1a25dfc0cf1 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.150964 Mar 12 21:20:38.898992 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4545/5313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:38 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:38.914733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ae0b28b-334b-4c73-aac7-a692a0a85c4a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-175599298_updated"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:38.915928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8ae0b28b-334b-4c73-aac7-a692a0a85c4a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: a08166a6-876d-40af-990e-ee0590952ab1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:38.921454 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8ae0b28b-334b-4c73-aac7-a692a0a85c4a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance a08166a6-876d-40af-990e-ee0590952ab1 could not be found. Mar 12 21:20:38.922090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ae0b28b-334b-4c73-aac7-a692a0a85c4a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance a08166a6-876d-40af-990e-ee0590952ab1 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:38.922919 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ae0b28b-334b-4c73-aac7-a692a0a85c4a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "PUT /compute/v2.1/servers/a08166a6-876d-40af-990e-ee0590952ab1" status: 404 len: 111 microversion: 2.1 time: 0.012560 Mar 12 21:20:38.923469 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4546/5314] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Mar 12 21:20:38 2022] PUT /compute/v2.1/servers/a08166a6-876d-40af-990e-ee0590952ab1 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:20:38.931380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e3241fc3-fd96-466f-bd9d-806f9bdcac8d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:38.931994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e3241fc3-fd96-466f-bd9d-806f9bdcac8d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:38.938586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3241fc3-fd96-466f-bd9d-806f9bdcac8d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.939059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3241fc3-fd96-466f-bd9d-806f9bdcac8d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:38.939851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3241fc3-fd96-466f-bd9d-806f9bdcac8d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:38.940311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3241fc3-fd96-466f-bd9d-806f9bdcac8d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:39.080927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e3241fc3-fd96-466f-bd9d-806f9bdcac8d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:39.088971 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e3241fc3-fd96-466f-bd9d-806f9bdcac8d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.160972 Mar 12 21:20:39.089537 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4547/5315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:38 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:39.105971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6a08ea06-70cc-42f8-ac46-dd6cb948a0c4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:39.106600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6a08ea06-70cc-42f8-ac46-dd6cb948a0c4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:39.112410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a08ea06-70cc-42f8-ac46-dd6cb948a0c4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:39.112874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a08ea06-70cc-42f8-ac46-dd6cb948a0c4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:39.113653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a08ea06-70cc-42f8-ac46-dd6cb948a0c4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:39.114136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a08ea06-70cc-42f8-ac46-dd6cb948a0c4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:39.244888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6a08ea06-70cc-42f8-ac46-dd6cb948a0c4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:39.252301 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6a08ea06-70cc-42f8-ac46-dd6cb948a0c4 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.149951 Mar 12 21:20:39.252870 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4548/5316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:39 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:39.267752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99e21d60-320e-46c0-a77d-ad6d61b7a59e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:39.268950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99e21d60-320e-46c0-a77d-ad6d61b7a59e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:39.269741 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99e21d60-320e-46c0-a77d-ad6d61b7a59e tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "PUT /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 400 len: 619 microversion: 2.1 time: 0.005650 Mar 12 21:20:39.270272 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4549/5317] 10.222.0.30 () {60 vars in 1256 bytes} [Sat Mar 12 21:20:39 2022] PUT /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 619 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 12 21:20:39.277711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-78278f3d-ecdc-43e8-8ca1-7280104a5711 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:39.278330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-78278f3d-ecdc-43e8-8ca1-7280104a5711 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:39.286191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78278f3d-ecdc-43e8-8ca1-7280104a5711 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:39.286661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78278f3d-ecdc-43e8-8ca1-7280104a5711 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:39.288060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78278f3d-ecdc-43e8-8ca1-7280104a5711 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:39.288511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-78278f3d-ecdc-43e8-8ca1-7280104a5711 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:39.419364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-78278f3d-ecdc-43e8-8ca1-7280104a5711 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:39.427058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-78278f3d-ecdc-43e8-8ca1-7280104a5711 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.152574 Mar 12 21:20:39.427636 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4550/5318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:39 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:39.444516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7450a61f-084f-461a-a81b-22299f12852c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:39.445148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7450a61f-084f-461a-a81b-22299f12852c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:39.451556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7450a61f-084f-461a-a81b-22299f12852c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:39.452112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7450a61f-084f-461a-a81b-22299f12852c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:39.453064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7450a61f-084f-461a-a81b-22299f12852c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:39.453570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7450a61f-084f-461a-a81b-22299f12852c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:39.594654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7450a61f-084f-461a-a81b-22299f12852c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:39.602082 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7450a61f-084f-461a-a81b-22299f12852c tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.162325 Mar 12 21:20:39.602667 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4551/5319] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:39 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:39.617490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69221c7c-fee9-4173-8366-2c4ce9a9daa7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:39.618706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69221c7c-fee9-4173-8366-2c4ce9a9daa7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:39.619514 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-69221c7c-fee9-4173-8366-2c4ce9a9daa7 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "PUT /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 400 len: 108 microversion: 2.1 time: 0.005753 Mar 12 21:20:39.620025 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4552/5320] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Mar 12 21:20:39 2022] PUT /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 108 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 12 21:20:39.627080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56c723c0-f9c3-4786-a4e2-f7b99bd1f8ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:39.627702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-56c723c0-f9c3-4786-a4e2-f7b99bd1f8ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:39.635044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56c723c0-f9c3-4786-a4e2-f7b99bd1f8ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:39.635514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56c723c0-f9c3-4786-a4e2-f7b99bd1f8ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:39.636296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56c723c0-f9c3-4786-a4e2-f7b99bd1f8ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:39.636746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56c723c0-f9c3-4786-a4e2-f7b99bd1f8ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:39.767768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-56c723c0-f9c3-4786-a4e2-f7b99bd1f8ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:39.775172 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56c723c0-f9c3-4786-a4e2-f7b99bd1f8ed tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1506 microversion: 2.1 time: 0.151415 Mar 12 21:20:39.775750 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4553/5321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:39 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:42.054438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3d5865b5-9fde-48a1-a761-83178c2c648a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:42.055047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3d5865b5-9fde-48a1-a761-83178c2c648a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:42.062229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d5865b5-9fde-48a1-a761-83178c2c648a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:42.062631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d5865b5-9fde-48a1-a761-83178c2c648a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:42.063437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d5865b5-9fde-48a1-a761-83178c2c648a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:42.063903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3d5865b5-9fde-48a1-a761-83178c2c648a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:42.077612 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3d5865b5-9fde-48a1-a761-83178c2c648a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance b958bc0f-9c08-48d3-9ca5-e0593b930996 could not be found. Mar 12 21:20:42.078294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3d5865b5-9fde-48a1-a761-83178c2c648a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance b958bc0f-9c08-48d3-9ca5-e0593b930996 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:42.079120 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3d5865b5-9fde-48a1-a761-83178c2c648a tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 404 len: 111 microversion: 2.1 time: 0.028638 Mar 12 21:20:42.079914 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4554/5322] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:20:42 2022] DELETE /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:20:42.088639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d54de32b-8d3c-45c3-89cf-80ff4795b6ca tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:42.089256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d54de32b-8d3c-45c3-89cf-80ff4795b6ca tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: b958bc0f-9c08-48d3-9ca5-e0593b930996] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:42.095512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d54de32b-8d3c-45c3-89cf-80ff4795b6ca tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:42.096011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d54de32b-8d3c-45c3-89cf-80ff4795b6ca tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:42.096808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d54de32b-8d3c-45c3-89cf-80ff4795b6ca tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:42.097266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d54de32b-8d3c-45c3-89cf-80ff4795b6ca tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:42.112036 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-d54de32b-8d3c-45c3-89cf-80ff4795b6ca tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance b958bc0f-9c08-48d3-9ca5-e0593b930996 could not be found. Mar 12 21:20:42.112585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d54de32b-8d3c-45c3-89cf-80ff4795b6ca tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance b958bc0f-9c08-48d3-9ca5-e0593b930996 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:42.113433 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d54de32b-8d3c-45c3-89cf-80ff4795b6ca tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996" status: 404 len: 111 microversion: 2.1 time: 0.028507 Mar 12 21:20:42.114038 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4555/5323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:42 2022] GET /compute/v2.1/servers/b958bc0f-9c08-48d3-9ca5-e0593b930996 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:20:42.121792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4ffaced6-35cb-4f2e-b3ca-297e9527c6cf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:42.122394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4ffaced6-35cb-4f2e-b3ca-297e9527c6cf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:42.128872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ffaced6-35cb-4f2e-b3ca-297e9527c6cf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:42.129352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ffaced6-35cb-4f2e-b3ca-297e9527c6cf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:42.130195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ffaced6-35cb-4f2e-b3ca-297e9527c6cf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:42.130713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4ffaced6-35cb-4f2e-b3ca-297e9527c6cf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:42.156769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4ffaced6-35cb-4f2e-b3ca-297e9527c6cf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:20:42.235975 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4ffaced6-35cb-4f2e-b3ca-297e9527c6cf tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 204 len: 0 microversion: 2.1 time: 0.117574 Mar 12 21:20:42.236576 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4556/5324] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:20:42 2022] DELETE /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:20:42.244924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-197131c1-5228-47a2-96e7-f2afdec7fc3d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:42.245655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-197131c1-5228-47a2-96e7-f2afdec7fc3d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:42.251810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197131c1-5228-47a2-96e7-f2afdec7fc3d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:42.252255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197131c1-5228-47a2-96e7-f2afdec7fc3d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:42.253048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197131c1-5228-47a2-96e7-f2afdec7fc3d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:42.253511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197131c1-5228-47a2-96e7-f2afdec7fc3d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:42.397197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-197131c1-5228-47a2-96e7-f2afdec7fc3d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:42.405497 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-197131c1-5228-47a2-96e7-f2afdec7fc3d tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1512 microversion: 2.1 time: 0.164668 Mar 12 21:20:42.406194 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4557/5325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:42 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:43.423178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99922b57-7170-44ff-82f3-a4674b5b8ead tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:43.424110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-99922b57-7170-44ff-82f3-a4674b5b8ead tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:43.433688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99922b57-7170-44ff-82f3-a4674b5b8ead tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:43.434859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99922b57-7170-44ff-82f3-a4674b5b8ead tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:43.435241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99922b57-7170-44ff-82f3-a4674b5b8ead tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:43.435701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99922b57-7170-44ff-82f3-a4674b5b8ead tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:43.603023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-99922b57-7170-44ff-82f3-a4674b5b8ead tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:43.612950 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99922b57-7170-44ff-82f3-a4674b5b8ead tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1512 microversion: 2.1 time: 0.193800 Mar 12 21:20:43.623769 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4558/5326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:43 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:44.354984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cc64ae76-34f0-418b-bedf-294438e8f695 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:44.355507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc64ae76-34f0-418b-bedf-294438e8f695 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:44.370429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc64ae76-34f0-418b-bedf-294438e8f695 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:44.371019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc64ae76-34f0-418b-bedf-294438e8f695 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:44.372336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc64ae76-34f0-418b-bedf-294438e8f695 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:44.372775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc64ae76-34f0-418b-bedf-294438e8f695 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:44.414906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc64ae76-34f0-418b-bedf-294438e8f695 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:20:44.508576 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cc64ae76-34f0-418b-bedf-294438e8f695 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 204 len: 0 microversion: 2.1 time: 0.156763 Mar 12 21:20:44.514384 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4559/5327] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:20:44 2022] DELETE /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:20:44.521537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6bba7ffb-a986-4540-8b4e-028fa2e1b24b req-2c27ea5c-3995-4287-a78f-a93e0c7396a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b76b5d9-ae42-47fb-925a-b03a8401ccb9", "tag": "7d71bc93-c1b2-4330-9e3a-ca2541f7a935"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:44.533586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6bba7ffb-a986-4540-8b4e-028fa2e1b24b req-2c27ea5c-3995-4287-a78f-a93e0c7396a6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:44.534248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6bba7ffb-a986-4540-8b4e-028fa2e1b24b req-2c27ea5c-3995-4287-a78f-a93e0c7396a6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:44.549887 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6bba7ffb-a986-4540-8b4e-028fa2e1b24b req-2c27ea5c-3995-4287-a78f-a93e0c7396a6 service nova] Creating event network-changed:7d71bc93-c1b2-4330-9e3a-ca2541f7a935 for instance 3b76b5d9-ae42-47fb-925a-b03a8401ccb9 on nch1-master-1 Mar 12 21:20:44.557318 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6bba7ffb-a986-4540-8b4e-028fa2e1b24b req-2c27ea5c-3995-4287-a78f-a93e0c7396a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040632 Mar 12 21:20:44.558602 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4560/5328] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:20:44.564539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-97b0a607-bc85-48b1-90da-772eb3559a97 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:44.566083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-97b0a607-bc85-48b1-90da-772eb3559a97 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:44.574687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97b0a607-bc85-48b1-90da-772eb3559a97 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:44.575679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97b0a607-bc85-48b1-90da-772eb3559a97 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:44.577292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97b0a607-bc85-48b1-90da-772eb3559a97 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:44.578006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97b0a607-bc85-48b1-90da-772eb3559a97 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:44.907065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-97b0a607-bc85-48b1-90da-772eb3559a97 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:44.920246 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-97b0a607-bc85-48b1-90da-772eb3559a97 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1583 microversion: 2.1 time: 0.359723 Mar 12 21:20:44.931172 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4561/5329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:44 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1583 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:44.931172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f4a7770-c7aa-431f-b350-f422474b3c67 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:44.931172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6f4a7770-c7aa-431f-b350-f422474b3c67 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:44.935037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f4a7770-c7aa-431f-b350-f422474b3c67 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:44.935466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f4a7770-c7aa-431f-b350-f422474b3c67 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:44.936579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f4a7770-c7aa-431f-b350-f422474b3c67 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:44.937841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f4a7770-c7aa-431f-b350-f422474b3c67 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:44.985643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f4a7770-c7aa-431f-b350-f422474b3c67 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:44.986158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f4a7770-c7aa-431f-b350-f422474b3c67 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:44.986786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-6f4a7770-c7aa-431f-b350-f422474b3c67 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lazy-loading 'fault' on Instance uuid e054fc3c-6e21-4333-a700-0c2254b6fa0e {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:20:45.036933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6f4a7770-c7aa-431f-b350-f422474b3c67 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d43d7b235048dfbc773e69ae5ff75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13397eac7c854033a2e3c6faa8f8247e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:45.045435 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f4a7770-c7aa-431f-b350-f422474b3c67 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 200 len: 1307 microversion: 2.1 time: 0.122468 Mar 12 21:20:45.046371 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4562/5330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:44 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 1307 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:45.938910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-012e3442-b9f5-4510-bfb5-fba86de20f10 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:45.939536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-012e3442-b9f5-4510-bfb5-fba86de20f10 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:45.947127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-012e3442-b9f5-4510-bfb5-fba86de20f10 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:45.947638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-012e3442-b9f5-4510-bfb5-fba86de20f10 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:45.948471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-012e3442-b9f5-4510-bfb5-fba86de20f10 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:45.949003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-012e3442-b9f5-4510-bfb5-fba86de20f10 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:46.523922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-012e3442-b9f5-4510-bfb5-fba86de20f10 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62b74fe4246c415bbb401849ce000f9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6a0660e45d4aea9ff4576abd1f0e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:46.531586 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-012e3442-b9f5-4510-bfb5-fba86de20f10 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 200 len: 1464 microversion: 2.1 time: 0.596599 Mar 12 21:20:46.532188 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4563/5331] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:45 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 1464 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:46.546740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2460ac45-d8f1-45f2-9f0a-a06e41d95a47 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:46.547380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2460ac45-d8f1-45f2-9f0a-a06e41d95a47 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] [instance: e054fc3c-6e21-4333-a700-0c2254b6fa0e] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:46.553490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2460ac45-d8f1-45f2-9f0a-a06e41d95a47 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:46.554059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2460ac45-d8f1-45f2-9f0a-a06e41d95a47 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:46.554800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2460ac45-d8f1-45f2-9f0a-a06e41d95a47 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:46.555260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2460ac45-d8f1-45f2-9f0a-a06e41d95a47 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:46.570549 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-2460ac45-d8f1-45f2-9f0a-a06e41d95a47 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] HTTP exception thrown: Instance e054fc3c-6e21-4333-a700-0c2254b6fa0e could not be found. Mar 12 21:20:46.571182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2460ac45-d8f1-45f2-9f0a-a06e41d95a47 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] Returning 404 to user: Instance e054fc3c-6e21-4333-a700-0c2254b6fa0e could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:46.572050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2460ac45-d8f1-45f2-9f0a-a06e41d95a47 tempest-ServersNegativeTestJSON-1340284216 tempest-ServersNegativeTestJSON-1340284216-project] 10.222.0.30 "GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e" status: 404 len: 111 microversion: 2.1 time: 0.029457 Mar 12 21:20:46.572635 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4564/5332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:46 2022] GET /compute/v2.1/servers/e054fc3c-6e21-4333-a700-0c2254b6fa0e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:20:46.579393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-93e88e21-6fac-4ed0-b0ab-b9a884e2c847 req-a6b4be54-7533-4e57-9e08-71fb7dc194e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e054fc3c-6e21-4333-a700-0c2254b6fa0e", "name": "network-vif-deleted", "tag": "38bbbe31-f103-40ff-83fd-ad66bb739042"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:46.588986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-93e88e21-6fac-4ed0-b0ab-b9a884e2c847 req-a6b4be54-7533-4e57-9e08-71fb7dc194e8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:46.589499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-93e88e21-6fac-4ed0-b0ab-b9a884e2c847 req-a6b4be54-7533-4e57-9e08-71fb7dc194e8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:46.605426 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-93e88e21-6fac-4ed0-b0ab-b9a884e2c847 req-a6b4be54-7533-4e57-9e08-71fb7dc194e8 service nova] Creating event network-vif-deleted:38bbbe31-f103-40ff-83fd-ad66bb739042 for instance e054fc3c-6e21-4333-a700-0c2254b6fa0e on nch2-master-1 Mar 12 21:20:46.611225 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-93e88e21-6fac-4ed0-b0ab-b9a884e2c847 req-a6b4be54-7533-4e57-9e08-71fb7dc194e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037140 Mar 12 21:20:46.612743 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4565/5333] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:20:46.971032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-56a1c83e-4a78-4af8-87a9-989482b4be8d req-9d4a80d4-a755-4866-a128-63f1abc63ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b76b5d9-ae42-47fb-925a-b03a8401ccb9", "name": "network-vif-deleted", "tag": "7d71bc93-c1b2-4330-9e3a-ca2541f7a935"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:46.980890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-56a1c83e-4a78-4af8-87a9-989482b4be8d req-9d4a80d4-a755-4866-a128-63f1abc63ec2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:46.981344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-56a1c83e-4a78-4af8-87a9-989482b4be8d req-9d4a80d4-a755-4866-a128-63f1abc63ec2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:46.993077 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-56a1c83e-4a78-4af8-87a9-989482b4be8d req-9d4a80d4-a755-4866-a128-63f1abc63ec2 service nova] Creating event network-vif-deleted:7d71bc93-c1b2-4330-9e3a-ca2541f7a935 for instance 3b76b5d9-ae42-47fb-925a-b03a8401ccb9 on nch1-master-1 Mar 12 21:20:46.998200 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-56a1c83e-4a78-4af8-87a9-989482b4be8d req-9d4a80d4-a755-4866-a128-63f1abc63ec2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033555 Mar 12 21:20:46.999091 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4566/5334] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:20:47.549847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e3263bc3-57c1-4c86-98f2-9fe4f7fd574f tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:47.550563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e3263bc3-57c1-4c86-98f2-9fe4f7fd574f tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] [instance: 3b76b5d9-ae42-47fb-925a-b03a8401ccb9] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:47.560688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3263bc3-57c1-4c86-98f2-9fe4f7fd574f tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:47.562194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3263bc3-57c1-4c86-98f2-9fe4f7fd574f tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:47.563604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3263bc3-57c1-4c86-98f2-9fe4f7fd574f tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:47.564651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e3263bc3-57c1-4c86-98f2-9fe4f7fd574f tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:47.585895 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e3263bc3-57c1-4c86-98f2-9fe4f7fd574f tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] HTTP exception thrown: Instance 3b76b5d9-ae42-47fb-925a-b03a8401ccb9 could not be found. Mar 12 21:20:47.587060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e3263bc3-57c1-4c86-98f2-9fe4f7fd574f tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Returning 404 to user: Instance 3b76b5d9-ae42-47fb-925a-b03a8401ccb9 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:20:47.589281 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e3263bc3-57c1-4c86-98f2-9fe4f7fd574f tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9" status: 404 len: 111 microversion: 2.1 time: 0.043314 Mar 12 21:20:47.590974 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4567/5335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:47 2022] GET /compute/v2.1/servers/3b76b5d9-ae42-47fb-925a-b03a8401ccb9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:20:47.789737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7587f66-826f-4c20-b64b-0046a2d02a19 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] Calling method '.version_select at 0x7f6e35549b80>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:47.816576 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7587f66-826f-4c20-b64b-0046a2d02a19 tempest-TestVolumeBackupRestore-1490532501 tempest-TestVolumeBackupRestore-1490532501-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-543788082" status: 202 len: 0 microversion: 2.1 time: 0.030629 Mar 12 21:20:47.818640 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4568/5336] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Mar 12 21:20:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-543788082 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:20:50.925620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1638694412", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "3ef8bea5-0992-4fbb-84c1-0689d0125d84"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:50.990887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] validate_networks() for [('3ef8bea5-0992-4fbb-84c1-0689d0125d84', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:20:51.379189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:20:51.379954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:20:51.380573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:20:51.381117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:20:51.381744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:20:51.393312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:51.394537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:51.396603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:51.397328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:51.421258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Getting quotas for project 428c73a9576f4fe3833d7ffe995eefe2. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:20:51.428590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Getting quotas for user 668322e75f2e429885700219e1a80264 and project 428c73a9576f4fe3833d7ffe995eefe2. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:20:51.443154 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:20:51.446074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:20:51.498216 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d87a5e95-5d5b-411e-8195-23adfd35ffa6 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714813 Mar 12 21:20:51.499633 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4569/5337] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:20:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:20:51.511566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-919dc469-c494-40e6-99ad-7f41031305cd tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:51.511950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-919dc469-c494-40e6-99ad-7f41031305cd tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:51.586312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-919dc469-c494-40e6-99ad-7f41031305cd tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:51.597874 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-919dc469-c494-40e6-99ad-7f41031305cd tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1228 microversion: 2.1 time: 0.091310 Mar 12 21:20:51.608891 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4570/5338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:51 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1228 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:52.616030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b162db5-878c-4201-a4dd-6a525df084b3 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:52.617419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3b162db5-878c-4201-a4dd-6a525df084b3 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:52.625298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b162db5-878c-4201-a4dd-6a525df084b3 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:52.626037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b162db5-878c-4201-a4dd-6a525df084b3 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:52.627094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b162db5-878c-4201-a4dd-6a525df084b3 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:52.628296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b162db5-878c-4201-a4dd-6a525df084b3 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:52.719972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3b162db5-878c-4201-a4dd-6a525df084b3 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:52.728660 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b162db5-878c-4201-a4dd-6a525df084b3 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1286 microversion: 2.1 time: 0.116808 Mar 12 21:20:52.733649 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4571/5339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:52 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:53.749225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f495ba81-e6f4-4e3f-a4e0-edf93980b737 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:53.751038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f495ba81-e6f4-4e3f-a4e0-edf93980b737 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:53.759111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f495ba81-e6f4-4e3f-a4e0-edf93980b737 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:53.759909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f495ba81-e6f4-4e3f-a4e0-edf93980b737 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:53.761184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f495ba81-e6f4-4e3f-a4e0-edf93980b737 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:53.762151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f495ba81-e6f4-4e3f-a4e0-edf93980b737 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:54.072795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f495ba81-e6f4-4e3f-a4e0-edf93980b737 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:54.080757 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f495ba81-e6f4-4e3f-a4e0-edf93980b737 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1328 microversion: 2.1 time: 0.337504 Mar 12 21:20:54.086274 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4572/5340] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:53 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1328 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:54.094464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3552b323-5ad9-4116-b022-3ff9ed2b6850 req-d224f57e-03b6-441f-b971-095de2b365ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58663ca1-e716-4663-881d-1afb773b5089", "tag": "858de6bf-23fe-4c5e-99eb-9910edf31dd2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:54.105186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3552b323-5ad9-4116-b022-3ff9ed2b6850 req-d224f57e-03b6-441f-b971-095de2b365ed service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:54.105953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3552b323-5ad9-4116-b022-3ff9ed2b6850 req-d224f57e-03b6-441f-b971-095de2b365ed service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:54.119411 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3552b323-5ad9-4116-b022-3ff9ed2b6850 req-d224f57e-03b6-441f-b971-095de2b365ed service nova] Creating event network-changed:858de6bf-23fe-4c5e-99eb-9910edf31dd2 for instance 58663ca1-e716-4663-881d-1afb773b5089 on nch1-master-1 Mar 12 21:20:54.134746 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3552b323-5ad9-4116-b022-3ff9ed2b6850 req-d224f57e-03b6-441f-b971-095de2b365ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046620 Mar 12 21:20:54.136044 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4573/5341] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:20:55.105405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b473f73-9a05-4253-adfd-02325c185e6c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:55.107732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b473f73-9a05-4253-adfd-02325c185e6c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:55.118869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b473f73-9a05-4253-adfd-02325c185e6c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:55.119792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b473f73-9a05-4253-adfd-02325c185e6c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:55.122377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b473f73-9a05-4253-adfd-02325c185e6c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:55.123537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b473f73-9a05-4253-adfd-02325c185e6c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:55.278595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b473f73-9a05-4253-adfd-02325c185e6c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:55.286849 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b473f73-9a05-4253-adfd-02325c185e6c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1328 microversion: 2.1 time: 0.187705 Mar 12 21:20:55.287499 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4574/5342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:55 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1328 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:56.198396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1d41b644-74cb-46da-b1c1-8d314651454e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:20:56.199468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1d41b644-74cb-46da-b1c1-8d314651454e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:56.206386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d41b644-74cb-46da-b1c1-8d314651454e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:56.206861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d41b644-74cb-46da-b1c1-8d314651454e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:56.207655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d41b644-74cb-46da-b1c1-8d314651454e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:56.208733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d41b644-74cb-46da-b1c1-8d314651454e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:56.264554 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1d41b644-74cb-46da-b1c1-8d314651454e tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "POST /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6/action" status: 200 len: 24568 microversion: 2.1 time: 0.069834 Mar 12 21:20:56.265374 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4575/5343] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:20:56 2022] POST /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6/action => generated 24568 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:20:56.305203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce7ff9dd-0f29-45b7-bf3b-c64b07498312 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:56.305950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce7ff9dd-0f29-45b7-bf3b-c64b07498312 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:56.313459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce7ff9dd-0f29-45b7-bf3b-c64b07498312 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:56.313953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce7ff9dd-0f29-45b7-bf3b-c64b07498312 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:56.314754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce7ff9dd-0f29-45b7-bf3b-c64b07498312 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:56.315206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce7ff9dd-0f29-45b7-bf3b-c64b07498312 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:56.465041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce7ff9dd-0f29-45b7-bf3b-c64b07498312 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:56.472937 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce7ff9dd-0f29-45b7-bf3b-c64b07498312 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1328 microversion: 2.1 time: 0.172788 Mar 12 21:20:56.473541 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4576/5344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:56 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1328 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:57.491419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-92537832-93f5-4efe-bb26-da4e4d2e957a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:57.492213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-92537832-93f5-4efe-bb26-da4e4d2e957a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:57.500611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92537832-93f5-4efe-bb26-da4e4d2e957a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:57.501278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92537832-93f5-4efe-bb26-da4e4d2e957a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:57.502484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92537832-93f5-4efe-bb26-da4e4d2e957a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:57.503075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92537832-93f5-4efe-bb26-da4e4d2e957a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:57.715673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-92537832-93f5-4efe-bb26-da4e4d2e957a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:57.724627 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-92537832-93f5-4efe-bb26-da4e4d2e957a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1328 microversion: 2.1 time: 0.238420 Mar 12 21:20:57.725298 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4577/5345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:57 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1328 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:20:58.741414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e44d1eb5-55dd-4c93-9ed1-21455ee4a347 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:58.742283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e44d1eb5-55dd-4c93-9ed1-21455ee4a347 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:58.752818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e44d1eb5-55dd-4c93-9ed1-21455ee4a347 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:58.753555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e44d1eb5-55dd-4c93-9ed1-21455ee4a347 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:58.754469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e44d1eb5-55dd-4c93-9ed1-21455ee4a347 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:58.755278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e44d1eb5-55dd-4c93-9ed1-21455ee4a347 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:58.918879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e44d1eb5-55dd-4c93-9ed1-21455ee4a347 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:20:58.927467 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e44d1eb5-55dd-4c93-9ed1-21455ee4a347 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1328 microversion: 2.1 time: 0.190269 Mar 12 21:20:58.928068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4578/5346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:58 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1328 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:20:59.946978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96357a36-c48d-40b1-b739-3a7887c45d89 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:20:59.948443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96357a36-c48d-40b1-b739-3a7887c45d89 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:20:59.957052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96357a36-c48d-40b1-b739-3a7887c45d89 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:59.957527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96357a36-c48d-40b1-b739-3a7887c45d89 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:20:59.959966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96357a36-c48d-40b1-b739-3a7887c45d89 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:20:59.960521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96357a36-c48d-40b1-b739-3a7887c45d89 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:00.126109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96357a36-c48d-40b1-b739-3a7887c45d89 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:00.135648 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96357a36-c48d-40b1-b739-3a7887c45d89 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1328 microversion: 2.1 time: 0.194555 Mar 12 21:21:00.136244 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4579/5347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:20:59 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1328 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:21:00.141227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1751c6f4-32c7-4a3b-8674-d13007c78801 req-b53b1d8c-3959-4df1-857e-9805a2bc5218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58663ca1-e716-4663-881d-1afb773b5089", "name": "network-vif-plugged", "status": "completed", "tag": "858de6bf-23fe-4c5e-99eb-9910edf31dd2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:00.150573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1751c6f4-32c7-4a3b-8674-d13007c78801 req-b53b1d8c-3959-4df1-857e-9805a2bc5218 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:00.151147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1751c6f4-32c7-4a3b-8674-d13007c78801 req-b53b1d8c-3959-4df1-857e-9805a2bc5218 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:00.164230 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1751c6f4-32c7-4a3b-8674-d13007c78801 req-b53b1d8c-3959-4df1-857e-9805a2bc5218 service nova] Creating event network-vif-plugged:858de6bf-23fe-4c5e-99eb-9910edf31dd2 for instance 58663ca1-e716-4663-881d-1afb773b5089 on nch1-master-1 Mar 12 21:21:00.169972 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1751c6f4-32c7-4a3b-8674-d13007c78801 req-b53b1d8c-3959-4df1-857e-9805a2bc5218 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032278 Mar 12 21:21:00.170575 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4580/5348] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:21:01.154290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b6c85c0-6904-422a-839f-b04626b9d453 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:01.155069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b6c85c0-6904-422a-839f-b04626b9d453 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:01.162938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b6c85c0-6904-422a-839f-b04626b9d453 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:01.163465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b6c85c0-6904-422a-839f-b04626b9d453 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:01.164255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b6c85c0-6904-422a-839f-b04626b9d453 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:01.164740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b6c85c0-6904-422a-839f-b04626b9d453 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:01.313498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b6c85c0-6904-422a-839f-b04626b9d453 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:01.321591 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b6c85c0-6904-422a-839f-b04626b9d453 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1328 microversion: 2.1 time: 0.172335 Mar 12 21:21:01.322222 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4581/5349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:01 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1328 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:02.340135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-313ab9e8-6969-409a-8376-3c21f3013b0c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:02.340816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-313ab9e8-6969-409a-8376-3c21f3013b0c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:02.349608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-313ab9e8-6969-409a-8376-3c21f3013b0c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:02.350145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-313ab9e8-6969-409a-8376-3c21f3013b0c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:02.351082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-313ab9e8-6969-409a-8376-3c21f3013b0c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:02.351656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-313ab9e8-6969-409a-8376-3c21f3013b0c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:02.500533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-313ab9e8-6969-409a-8376-3c21f3013b0c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:02.509375 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-313ab9e8-6969-409a-8376-3c21f3013b0c tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1528 microversion: 2.1 time: 0.173726 Mar 12 21:21:02.510151 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4582/5350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:02 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1528 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:21:02.527644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-634da7e2-9a1d-410a-9813-77a5813e2959 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:02.528329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-634da7e2-9a1d-410a-9813-77a5813e2959 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:02.535048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-634da7e2-9a1d-410a-9813-77a5813e2959 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:02.535514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-634da7e2-9a1d-410a-9813-77a5813e2959 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:02.536452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-634da7e2-9a1d-410a-9813-77a5813e2959 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:02.537014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-634da7e2-9a1d-410a-9813-77a5813e2959 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:02.683211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-634da7e2-9a1d-410a-9813-77a5813e2959 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:02.692888 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-634da7e2-9a1d-410a-9813-77a5813e2959 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1528 microversion: 2.1 time: 0.169252 Mar 12 21:21:02.693618 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4583/5351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:02 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1528 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:02.972163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e55afdd4-bfd9-464f-999e-f907a71b3339 tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:02.972692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e55afdd4-bfd9-464f-999e-f907a71b3339 tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:02.979922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e55afdd4-bfd9-464f-999e-f907a71b3339 tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:02.980392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e55afdd4-bfd9-464f-999e-f907a71b3339 tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:02.981264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e55afdd4-bfd9-464f-999e-f907a71b3339 tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:02.981752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e55afdd4-bfd9-464f-999e-f907a71b3339 tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:02.995548 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e55afdd4-bfd9-464f-999e-f907a71b3339 tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] HTTP exception thrown: Instance 58663ca1-e716-4663-881d-1afb773b5089 could not be found. Mar 12 21:21:02.996533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e55afdd4-bfd9-464f-999e-f907a71b3339 tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] Returning 404 to user: Instance 58663ca1-e716-4663-881d-1afb773b5089 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:21:02.997392 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e55afdd4-bfd9-464f-999e-f907a71b3339 tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] 10.222.0.30 "DELETE /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 404 len: 111 microversion: 2.1 time: 0.291469 Mar 12 21:21:02.997983 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4584/5352] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:21:02 2022] DELETE /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 111 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:21:03.009391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-46293a9a-2500-4ede-b4e8-34d373fef5ef tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:03.013444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-46293a9a-2500-4ede-b4e8-34d373fef5ef tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:03.017625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46293a9a-2500-4ede-b4e8-34d373fef5ef tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:03.018124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46293a9a-2500-4ede-b4e8-34d373fef5ef tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:03.018935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46293a9a-2500-4ede-b4e8-34d373fef5ef tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:03.019393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-46293a9a-2500-4ede-b4e8-34d373fef5ef tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:03.163087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-46293a9a-2500-4ede-b4e8-34d373fef5ef tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:03.172747 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-46293a9a-2500-4ede-b4e8-34d373fef5ef tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1528 microversion: 2.1 time: 0.168597 Mar 12 21:21:03.173657 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4585/5353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:03 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1528 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:03.189651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c3b7636-09bf-4ff6-b585-e31c2f813b7a tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] Action: 'update', calling method: >, body: {"server": {"name": "58663ca1-e716-4663-881d-1afb773b5089_new"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:03.190841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c3b7636-09bf-4ff6-b585-e31c2f813b7a tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:03.196756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c3b7636-09bf-4ff6-b585-e31c2f813b7a tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:03.197235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c3b7636-09bf-4ff6-b585-e31c2f813b7a tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:03.198046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c3b7636-09bf-4ff6-b585-e31c2f813b7a tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:03.198505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c3b7636-09bf-4ff6-b585-e31c2f813b7a tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:03.212284 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-4c3b7636-09bf-4ff6-b585-e31c2f813b7a tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] HTTP exception thrown: Instance 58663ca1-e716-4663-881d-1afb773b5089 could not be found. Mar 12 21:21:03.212884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c3b7636-09bf-4ff6-b585-e31c2f813b7a tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] Returning 404 to user: Instance 58663ca1-e716-4663-881d-1afb773b5089 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:21:03.213708 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4c3b7636-09bf-4ff6-b585-e31c2f813b7a tempest-ServersNegativeTestMultiTenantJSON-1102268445 tempest-ServersNegativeTestMultiTenantJSON-1102268445-project] 10.222.0.30 "PUT /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 404 len: 111 microversion: 2.1 time: 0.027815 Mar 12 21:21:03.214275 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4586/5354] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Mar 12 21:21:03 2022] PUT /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:21:03.222399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ef4ef4c8-f954-4493-8caa-79ef0851d76a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:03.222911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ef4ef4c8-f954-4493-8caa-79ef0851d76a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:03.229022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef4ef4c8-f954-4493-8caa-79ef0851d76a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:03.229496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef4ef4c8-f954-4493-8caa-79ef0851d76a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:03.230310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef4ef4c8-f954-4493-8caa-79ef0851d76a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:03.230765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef4ef4c8-f954-4493-8caa-79ef0851d76a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:03.254132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ef4ef4c8-f954-4493-8caa-79ef0851d76a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:21:03.331018 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ef4ef4c8-f954-4493-8caa-79ef0851d76a tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "DELETE /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 204 len: 0 microversion: 2.1 time: 0.111731 Mar 12 21:21:03.331803 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4587/5355] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:21:03 2022] DELETE /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:21:03.340897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ebb7f8d-dfdf-4942-b511-0ae5c1ddcea8 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:03.341676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5ebb7f8d-dfdf-4942-b511-0ae5c1ddcea8 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:03.349230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ebb7f8d-dfdf-4942-b511-0ae5c1ddcea8 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:03.349706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ebb7f8d-dfdf-4942-b511-0ae5c1ddcea8 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:03.350537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ebb7f8d-dfdf-4942-b511-0ae5c1ddcea8 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:03.350999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ebb7f8d-dfdf-4942-b511-0ae5c1ddcea8 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:03.496125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5ebb7f8d-dfdf-4942-b511-0ae5c1ddcea8 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:03.503572 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ebb7f8d-dfdf-4942-b511-0ae5c1ddcea8 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1534 microversion: 2.1 time: 0.167015 Mar 12 21:21:03.504159 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4588/5356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:03 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1534 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:04.520522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-237e89ab-05dc-4740-ab82-b0a800655221 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:04.521208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-237e89ab-05dc-4740-ab82-b0a800655221 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:04.528034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-237e89ab-05dc-4740-ab82-b0a800655221 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:04.528509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-237e89ab-05dc-4740-ab82-b0a800655221 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:04.529310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-237e89ab-05dc-4740-ab82-b0a800655221 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:04.529791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-237e89ab-05dc-4740-ab82-b0a800655221 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:04.660854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-237e89ab-05dc-4740-ab82-b0a800655221 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:04.668264 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-237e89ab-05dc-4740-ab82-b0a800655221 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1534 microversion: 2.1 time: 0.151722 Mar 12 21:21:04.668839 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4589/5357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:04 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1534 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:21:05.553818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4a422710-65a1-46f4-845f-522b775a1b41 req-648bacbe-3195-4048-bd43-55e270df4a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58663ca1-e716-4663-881d-1afb773b5089", "name": "network-vif-deleted", "tag": "858de6bf-23fe-4c5e-99eb-9910edf31dd2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:05.566479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4a422710-65a1-46f4-845f-522b775a1b41 req-648bacbe-3195-4048-bd43-55e270df4a45 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:05.567592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4a422710-65a1-46f4-845f-522b775a1b41 req-648bacbe-3195-4048-bd43-55e270df4a45 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:05.579720 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4a422710-65a1-46f4-845f-522b775a1b41 req-648bacbe-3195-4048-bd43-55e270df4a45 service nova] Creating event network-vif-deleted:858de6bf-23fe-4c5e-99eb-9910edf31dd2 for instance 58663ca1-e716-4663-881d-1afb773b5089 on nch1-master-1 Mar 12 21:21:05.584991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4a422710-65a1-46f4-845f-522b775a1b41 req-648bacbe-3195-4048-bd43-55e270df4a45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035181 Mar 12 21:21:05.585602 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4590/5358] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:21:05.686251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd2e6c5c-60bf-43cd-86f5-d54f69de33f9 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:05.686968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd2e6c5c-60bf-43cd-86f5-d54f69de33f9 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:05.693721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd2e6c5c-60bf-43cd-86f5-d54f69de33f9 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:05.694202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd2e6c5c-60bf-43cd-86f5-d54f69de33f9 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:05.694978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd2e6c5c-60bf-43cd-86f5-d54f69de33f9 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:05.695429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd2e6c5c-60bf-43cd-86f5-d54f69de33f9 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:05.727071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd2e6c5c-60bf-43cd-86f5-d54f69de33f9 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:05.727537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd2e6c5c-60bf-43cd-86f5-d54f69de33f9 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:05.727999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-bd2e6c5c-60bf-43cd-86f5-d54f69de33f9 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lazy-loading 'fault' on Instance uuid 58663ca1-e716-4663-881d-1afb773b5089 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:21:05.768111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bd2e6c5c-60bf-43cd-86f5-d54f69de33f9 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668322e75f2e429885700219e1a80264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428c73a9576f4fe3833d7ffe995eefe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:05.776098 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd2e6c5c-60bf-43cd-86f5-d54f69de33f9 tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 200 len: 1318 microversion: 2.1 time: 0.094172 Mar 12 21:21:05.776672 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4591/5359] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:05 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:06.793134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cb616227-aa8a-4934-97ed-b178cf4626db tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:06.793822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cb616227-aa8a-4934-97ed-b178cf4626db tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] [instance: 58663ca1-e716-4663-881d-1afb773b5089] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:06.800794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb616227-aa8a-4934-97ed-b178cf4626db tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:06.801259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb616227-aa8a-4934-97ed-b178cf4626db tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:06.802079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb616227-aa8a-4934-97ed-b178cf4626db tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:06.802531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cb616227-aa8a-4934-97ed-b178cf4626db tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:06.818551 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-cb616227-aa8a-4934-97ed-b178cf4626db tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] HTTP exception thrown: Instance 58663ca1-e716-4663-881d-1afb773b5089 could not be found. Mar 12 21:21:06.819162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cb616227-aa8a-4934-97ed-b178cf4626db tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] Returning 404 to user: Instance 58663ca1-e716-4663-881d-1afb773b5089 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:21:06.820007 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cb616227-aa8a-4934-97ed-b178cf4626db tempest-ServersNegativeTestMultiTenantJSON-279508019 tempest-ServersNegativeTestMultiTenantJSON-279508019-project] 10.222.0.30 "GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089" status: 404 len: 111 microversion: 2.1 time: 0.030892 Mar 12 21:21:06.820760 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4592/5360] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:06 2022] GET /compute/v2.1/servers/58663ca1-e716-4663-881d-1afb773b5089 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:21:07.288383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f1e76fd2-7fa6-4d33-ac14-e9db0b684cdb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:07.289434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f1e76fd2-7fa6-4d33-ac14-e9db0b684cdb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:07.296565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1e76fd2-7fa6-4d33-ac14-e9db0b684cdb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:07.297081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1e76fd2-7fa6-4d33-ac14-e9db0b684cdb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:07.297996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1e76fd2-7fa6-4d33-ac14-e9db0b684cdb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:07.298514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f1e76fd2-7fa6-4d33-ac14-e9db0b684cdb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:07.352534 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f1e76fd2-7fa6-4d33-ac14-e9db0b684cdb tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "POST /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6/action" status: 200 len: 32640 microversion: 2.1 time: 0.067926 Mar 12 21:21:07.353493 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4593/5361] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:21:07 2022] POST /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6/action => generated 32640 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:21:08.751451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-944c443f-814a-4a1f-977b-a0b29c4a763b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:08.752132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-944c443f-814a-4a1f-977b-a0b29c4a763b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:08.760185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-944c443f-814a-4a1f-977b-a0b29c4a763b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:08.760740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-944c443f-814a-4a1f-977b-a0b29c4a763b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:08.761602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-944c443f-814a-4a1f-977b-a0b29c4a763b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:08.762172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-944c443f-814a-4a1f-977b-a0b29c4a763b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:08.789181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-944c443f-814a-4a1f-977b-a0b29c4a763b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:21:08.882204 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-944c443f-814a-4a1f-977b-a0b29c4a763b tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "DELETE /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 204 len: 0 microversion: 2.1 time: 0.134942 Mar 12 21:21:08.886803 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4594/5362] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:21:08 2022] DELETE /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:21:08.892146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c9900485-8a80-429c-a920-44b8c85c2d0c req-b0e57d11-3570-4b0f-bbd8-a13a0829ea45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692d0bd9-b0f2-4102-b5d5-7d95e36dfca6", "tag": "cf9ae6bc-82ef-469f-9e88-01c63ce1131e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:08.901051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c9900485-8a80-429c-a920-44b8c85c2d0c req-b0e57d11-3570-4b0f-bbd8-a13a0829ea45 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:08.901757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c9900485-8a80-429c-a920-44b8c85c2d0c req-b0e57d11-3570-4b0f-bbd8-a13a0829ea45 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:08.914533 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c9900485-8a80-429c-a920-44b8c85c2d0c req-b0e57d11-3570-4b0f-bbd8-a13a0829ea45 service nova] Creating event network-changed:cf9ae6bc-82ef-469f-9e88-01c63ce1131e for instance 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 on nch2-master-1 Mar 12 21:21:08.922303 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c9900485-8a80-429c-a920-44b8c85c2d0c req-b0e57d11-3570-4b0f-bbd8-a13a0829ea45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034021 Mar 12 21:21:08.923412 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4595/5363] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:21:08.929943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6a185c0-ec56-448c-b263-727e340227b2 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:08.930872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d6a185c0-ec56-448c-b263-727e340227b2 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:08.937400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6a185c0-ec56-448c-b263-727e340227b2 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:08.938179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6a185c0-ec56-448c-b263-727e340227b2 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:08.938984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6a185c0-ec56-448c-b263-727e340227b2 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:08.939442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6a185c0-ec56-448c-b263-727e340227b2 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:09.171342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d6a185c0-ec56-448c-b263-727e340227b2 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:09.181594 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d6a185c0-ec56-448c-b263-727e340227b2 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1669 microversion: 2.1 time: 0.256827 Mar 12 21:21:09.182856 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4596/5364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:08 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1669 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:21:10.200948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a930df90-574c-47c7-8496-6eb72c885a61 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:10.202247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a930df90-574c-47c7-8496-6eb72c885a61 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:10.209971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a930df90-574c-47c7-8496-6eb72c885a61 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:10.210788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a930df90-574c-47c7-8496-6eb72c885a61 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:10.211743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a930df90-574c-47c7-8496-6eb72c885a61 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:10.212445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a930df90-574c-47c7-8496-6eb72c885a61 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:10.371909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a930df90-574c-47c7-8496-6eb72c885a61 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75e4a2651a6e469491f271ced8ef9695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1940f5d7144c49758a742d34f71e9639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:10.390332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a930df90-574c-47c7-8496-6eb72c885a61 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 200 len: 1551 microversion: 2.1 time: 0.182992 Mar 12 21:21:10.391276 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4597/5365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:10 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 1551 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:10.938478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-215e8719-6c03-4f8e-81a2-5014da5e0150 req-68f373eb-6bb0-4078-a153-48a9907429f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692d0bd9-b0f2-4102-b5d5-7d95e36dfca6", "name": "network-vif-deleted", "tag": "cf9ae6bc-82ef-469f-9e88-01c63ce1131e"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:10.949716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-215e8719-6c03-4f8e-81a2-5014da5e0150 req-68f373eb-6bb0-4078-a153-48a9907429f6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:10.950245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-215e8719-6c03-4f8e-81a2-5014da5e0150 req-68f373eb-6bb0-4078-a153-48a9907429f6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:10.969763 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-215e8719-6c03-4f8e-81a2-5014da5e0150 req-68f373eb-6bb0-4078-a153-48a9907429f6 service nova] Creating event network-vif-deleted:cf9ae6bc-82ef-469f-9e88-01c63ce1131e for instance 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 on nch2-master-1 Mar 12 21:21:10.975759 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-215e8719-6c03-4f8e-81a2-5014da5e0150 req-68f373eb-6bb0-4078-a153-48a9907429f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041472 Mar 12 21:21:10.976412 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4598/5366] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:21:11.410675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ca09ac0-1855-4ff1-a7bd-56c04639abc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:11.412905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5ca09ac0-1855-4ff1-a7bd-56c04639abc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] [instance: 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:11.419663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ca09ac0-1855-4ff1-a7bd-56c04639abc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:11.420157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ca09ac0-1855-4ff1-a7bd-56c04639abc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:11.420951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ca09ac0-1855-4ff1-a7bd-56c04639abc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:11.421415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ca09ac0-1855-4ff1-a7bd-56c04639abc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:11.437052 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-5ca09ac0-1855-4ff1-a7bd-56c04639abc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] HTTP exception thrown: Instance 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 could not be found. Mar 12 21:21:11.437670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ca09ac0-1855-4ff1-a7bd-56c04639abc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Returning 404 to user: Instance 692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:21:11.438669 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ca09ac0-1855-4ff1-a7bd-56c04639abc6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6" status: 404 len: 111 microversion: 2.1 time: 0.033731 Mar 12 21:21:11.439233 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4599/5367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:11 2022] GET /compute/v2.1/servers/692d0bd9-b0f2-4102-b5d5-7d95e36dfca6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:21:11.599728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f684a03c-9222-42c8-9da7-53edf7dd65a6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] Calling method '.version_select at 0x7f6e354d7040>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:11.622918 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f684a03c-9222-42c8-9da7-53edf7dd65a6 tempest-TestNetworkBasicOps-1904873382 tempest-TestNetworkBasicOps-1904873382-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1396953839" status: 202 len: 0 microversion: 2.1 time: 0.027561 Mar 12 21:21:11.623528 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4600/5368] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Mar 12 21:21:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1396953839 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:21:28.575680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59a75e5a-5466-40c2-b8ac-6aad24548d2c tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Action: 'create', calling method: .version_select at 0x7f6e3554d0d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1150650549"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:28.593637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-59a75e5a-5466-40c2-b8ac-6aad24548d2c tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Getting quotas for project 543574c83c5d4914ac6cc448c29946bb. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:21:28.600333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-59a75e5a-5466-40c2-b8ac-6aad24548d2c tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Getting quotas for user b74beca575bc4580b9cec0669d608395 and project 543574c83c5d4914ac6cc448c29946bb. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:21:29.006563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-59a75e5a-5466-40c2-b8ac-6aad24548d2c tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Getting quotas for project 543574c83c5d4914ac6cc448c29946bb. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:21:29.011975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-59a75e5a-5466-40c2-b8ac-6aad24548d2c tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Getting quotas for user b74beca575bc4580b9cec0669d608395 and project 543574c83c5d4914ac6cc448c29946bb. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:21:29.048307 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59a75e5a-5466-40c2-b8ac-6aad24548d2c tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.697091 Mar 12 21:21:29.048918 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4601/5369] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:21:28 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:30.386684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-583954683", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1150650549", "security_groups": [{"name": "tempest-secgroup-smoke-1963028316"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "d834a048-09f3-4fa5-83f5-547cbef66595"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:30.497918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] validate_networks() for [('d834a048-09f3-4fa5-83f5-547cbef66595', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:21:30.917809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Getting quotas for project 543574c83c5d4914ac6cc448c29946bb. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:21:30.923899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Getting quotas for user b74beca575bc4580b9cec0669d608395 and project 543574c83c5d4914ac6cc448c29946bb. Resources: dict_keys(['metadata_items']) {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:21:30.937157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:21:30.937674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:21:30.938399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:21:30.939016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:21:30.939643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:21:30.948510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:30.949239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:30.950108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:30.950791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:30.975520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Getting quotas for project 543574c83c5d4914ac6cc448c29946bb. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:21:30.990790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Getting quotas for user b74beca575bc4580b9cec0669d608395 and project 543574c83c5d4914ac6cc448c29946bb. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:21:31.008438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:21:31.010899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:21:31.090821 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-790fdefd-a749-46c1-b49a-3c3c085d9e20 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.705960 Mar 12 21:21:31.093943 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4602/5370] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:21:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:21:31.103985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a686985f-620e-46e0-b1a0-e30953410a9a tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:31.104271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a686985f-620e-46e0-b1a0-e30953410a9a tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:31.200436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a686985f-620e-46e0-b1a0-e30953410a9a tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:31.212684 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a686985f-620e-46e0-b1a0-e30953410a9a tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1302 microversion: 2.1 time: 0.110745 Mar 12 21:21:31.214347 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4603/5371] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:31 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1302 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:32.231287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80b81e11-39a6-4852-a457-a76c2b0fac18 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:32.232615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80b81e11-39a6-4852-a457-a76c2b0fac18 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:32.251057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80b81e11-39a6-4852-a457-a76c2b0fac18 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:32.251938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80b81e11-39a6-4852-a457-a76c2b0fac18 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:32.252957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80b81e11-39a6-4852-a457-a76c2b0fac18 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:32.253598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80b81e11-39a6-4852-a457-a76c2b0fac18 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:32.421386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80b81e11-39a6-4852-a457-a76c2b0fac18 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:32.432079 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80b81e11-39a6-4852-a457-a76c2b0fac18 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1362 microversion: 2.1 time: 0.204945 Mar 12 21:21:32.434180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4604/5372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:32 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:33.452400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-42cb3f93-b033-4a5e-b717-1e14d30757e2 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:33.453742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-42cb3f93-b033-4a5e-b717-1e14d30757e2 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:33.462186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42cb3f93-b033-4a5e-b717-1e14d30757e2 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:33.462936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42cb3f93-b033-4a5e-b717-1e14d30757e2 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:33.464301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42cb3f93-b033-4a5e-b717-1e14d30757e2 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:33.464767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42cb3f93-b033-4a5e-b717-1e14d30757e2 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:33.702492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-42cb3f93-b033-4a5e-b717-1e14d30757e2 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:33.711519 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-42cb3f93-b033-4a5e-b717-1e14d30757e2 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1428 microversion: 2.1 time: 0.264736 Mar 12 21:21:33.714113 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4605/5373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:33 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1428 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:34.004366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9cba6741-9292-4ac8-9425-4c5ba09611b8 req-f5448d0c-3d8a-407c-a5f9-a61e344b09b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fc4fddc-9708-4ba4-b374-4d201202907d", "tag": "1d7b6291-417b-4373-a31b-8355a20596fa"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:34.024739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9cba6741-9292-4ac8-9425-4c5ba09611b8 req-f5448d0c-3d8a-407c-a5f9-a61e344b09b6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:34.025449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9cba6741-9292-4ac8-9425-4c5ba09611b8 req-f5448d0c-3d8a-407c-a5f9-a61e344b09b6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:34.059212 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9cba6741-9292-4ac8-9425-4c5ba09611b8 req-f5448d0c-3d8a-407c-a5f9-a61e344b09b6 service nova] Creating event network-changed:1d7b6291-417b-4373-a31b-8355a20596fa for instance 6fc4fddc-9708-4ba4-b374-4d201202907d on nch1-master-1 Mar 12 21:21:34.064944 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9cba6741-9292-4ac8-9425-4c5ba09611b8 req-f5448d0c-3d8a-407c-a5f9-a61e344b09b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066117 Mar 12 21:21:34.067600 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4606/5374] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:21:34.729516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96644c88-34a4-4ca3-9d89-822fd6bf67aa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:34.731120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96644c88-34a4-4ca3-9d89-822fd6bf67aa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:34.739382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96644c88-34a4-4ca3-9d89-822fd6bf67aa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:34.739931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96644c88-34a4-4ca3-9d89-822fd6bf67aa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:34.740805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96644c88-34a4-4ca3-9d89-822fd6bf67aa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:34.741249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96644c88-34a4-4ca3-9d89-822fd6bf67aa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:34.986326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96644c88-34a4-4ca3-9d89-822fd6bf67aa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:34.994616 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96644c88-34a4-4ca3-9d89-822fd6bf67aa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1428 microversion: 2.1 time: 0.269328 Mar 12 21:21:35.004668 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4607/5375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:34 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1428 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:36.011251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-36197007-b30d-437b-8892-36e5e11f48c5 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:36.012002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-36197007-b30d-437b-8892-36e5e11f48c5 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:36.018841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36197007-b30d-437b-8892-36e5e11f48c5 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:36.019992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36197007-b30d-437b-8892-36e5e11f48c5 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:36.020810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36197007-b30d-437b-8892-36e5e11f48c5 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:36.021265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36197007-b30d-437b-8892-36e5e11f48c5 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:36.162310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-36197007-b30d-437b-8892-36e5e11f48c5 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:36.174320 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-36197007-b30d-437b-8892-36e5e11f48c5 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1428 microversion: 2.1 time: 0.166767 Mar 12 21:21:36.174932 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4608/5376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:36 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1428 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:37.192793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d5f8b4a5-6d06-4e6c-945c-b4f368b0cd02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:37.193748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d5f8b4a5-6d06-4e6c-945c-b4f368b0cd02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:37.202905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5f8b4a5-6d06-4e6c-945c-b4f368b0cd02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:37.203644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5f8b4a5-6d06-4e6c-945c-b4f368b0cd02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:37.204450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5f8b4a5-6d06-4e6c-945c-b4f368b0cd02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:37.205095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5f8b4a5-6d06-4e6c-945c-b4f368b0cd02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:37.403779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d5f8b4a5-6d06-4e6c-945c-b4f368b0cd02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:37.411792 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d5f8b4a5-6d06-4e6c-945c-b4f368b0cd02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1428 microversion: 2.1 time: 0.224020 Mar 12 21:21:37.412376 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4609/5377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:37 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1428 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:38.431797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a4ef194d-bec7-4b11-9942-74284fdbc745 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:38.432594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a4ef194d-bec7-4b11-9942-74284fdbc745 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:38.442029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4ef194d-bec7-4b11-9942-74284fdbc745 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:38.442585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4ef194d-bec7-4b11-9942-74284fdbc745 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:38.444594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4ef194d-bec7-4b11-9942-74284fdbc745 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:38.444594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4ef194d-bec7-4b11-9942-74284fdbc745 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:38.605894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a4ef194d-bec7-4b11-9942-74284fdbc745 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:38.614578 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a4ef194d-bec7-4b11-9942-74284fdbc745 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1428 microversion: 2.1 time: 0.186931 Mar 12 21:21:38.615185 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4610/5378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:38 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1428 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:39.633363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0984a746-1807-4d24-98dd-978e14ea7ccd tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:39.634100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0984a746-1807-4d24-98dd-978e14ea7ccd tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:39.641551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0984a746-1807-4d24-98dd-978e14ea7ccd tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:39.642048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0984a746-1807-4d24-98dd-978e14ea7ccd tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:39.643014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0984a746-1807-4d24-98dd-978e14ea7ccd tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:39.643637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0984a746-1807-4d24-98dd-978e14ea7ccd tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:39.791916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0984a746-1807-4d24-98dd-978e14ea7ccd tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:39.799621 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0984a746-1807-4d24-98dd-978e14ea7ccd tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1428 microversion: 2.1 time: 0.171604 Mar 12 21:21:39.800816 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4611/5379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:39 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1428 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:40.162492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-aa1d4da2-0edd-4aac-a134-fc1b477c8f21 req-24eb58b0-0c89-4fe9-a337-6384838e2d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc4fddc-9708-4ba4-b374-4d201202907d", "name": "network-vif-plugged", "status": "completed", "tag": "1d7b6291-417b-4373-a31b-8355a20596fa"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:40.172858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aa1d4da2-0edd-4aac-a134-fc1b477c8f21 req-24eb58b0-0c89-4fe9-a337-6384838e2d78 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:40.173554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aa1d4da2-0edd-4aac-a134-fc1b477c8f21 req-24eb58b0-0c89-4fe9-a337-6384838e2d78 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:40.185669 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-aa1d4da2-0edd-4aac-a134-fc1b477c8f21 req-24eb58b0-0c89-4fe9-a337-6384838e2d78 service nova] Creating event network-vif-plugged:1d7b6291-417b-4373-a31b-8355a20596fa for instance 6fc4fddc-9708-4ba4-b374-4d201202907d on nch1-master-1 Mar 12 21:21:40.190850 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-aa1d4da2-0edd-4aac-a134-fc1b477c8f21 req-24eb58b0-0c89-4fe9-a337-6384838e2d78 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033390 Mar 12 21:21:40.191577 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4612/5380] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:21:40.819589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8da000d6-d61a-4991-91e3-75f9c91e2731 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:40.820343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8da000d6-d61a-4991-91e3-75f9c91e2731 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:40.827970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8da000d6-d61a-4991-91e3-75f9c91e2731 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:40.828655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8da000d6-d61a-4991-91e3-75f9c91e2731 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:40.829650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8da000d6-d61a-4991-91e3-75f9c91e2731 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:40.830137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8da000d6-d61a-4991-91e3-75f9c91e2731 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:40.980149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8da000d6-d61a-4991-91e3-75f9c91e2731 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:40.987784 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8da000d6-d61a-4991-91e3-75f9c91e2731 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1428 microversion: 2.1 time: 0.172319 Mar 12 21:21:40.988381 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4613/5381] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:40 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1428 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:42.005183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-74a55847-95dd-4d10-b890-7fa38f87d003 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:42.005874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-74a55847-95dd-4d10-b890-7fa38f87d003 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:42.014340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74a55847-95dd-4d10-b890-7fa38f87d003 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:42.015037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74a55847-95dd-4d10-b890-7fa38f87d003 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:42.016040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74a55847-95dd-4d10-b890-7fa38f87d003 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:42.016661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74a55847-95dd-4d10-b890-7fa38f87d003 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:42.181971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-74a55847-95dd-4d10-b890-7fa38f87d003 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:42.190821 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-74a55847-95dd-4d10-b890-7fa38f87d003 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1608 microversion: 2.1 time: 0.190119 Mar 12 21:21:42.191983 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4614/5382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:41 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1608 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:42.207596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-861ad5e1-bec8-45af-9fce-483b42031236 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:42.208157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-861ad5e1-bec8-45af-9fce-483b42031236 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:42.214087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-861ad5e1-bec8-45af-9fce-483b42031236 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:42.214984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-861ad5e1-bec8-45af-9fce-483b42031236 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:42.215790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-861ad5e1-bec8-45af-9fce-483b42031236 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:42.216250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-861ad5e1-bec8-45af-9fce-483b42031236 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:42.375199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-861ad5e1-bec8-45af-9fce-483b42031236 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:42.384195 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-861ad5e1-bec8-45af-9fce-483b42031236 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1608 microversion: 2.1 time: 0.180519 Mar 12 21:21:42.384789 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4615/5383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:42 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1608 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:42.403178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2fc3b77b-3c69-4a19-bba1-7e49e31df5c4 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:42.403917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2fc3b77b-3c69-4a19-bba1-7e49e31df5c4 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:42.412059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fc3b77b-3c69-4a19-bba1-7e49e31df5c4 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:42.412757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fc3b77b-3c69-4a19-bba1-7e49e31df5c4 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:42.413952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fc3b77b-3c69-4a19-bba1-7e49e31df5c4 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:42.414478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2fc3b77b-3c69-4a19-bba1-7e49e31df5c4 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:42.575052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2fc3b77b-3c69-4a19-bba1-7e49e31df5c4 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:42.583876 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2fc3b77b-3c69-4a19-bba1-7e49e31df5c4 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1608 microversion: 2.1 time: 0.184573 Mar 12 21:21:42.584625 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4616/5384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:42 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1608 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:43.239969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1809978527", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2016371990", "security_groups": [{"name": "tempest-secgroup-smoke-1247205612"}], "block_device_mapping_v2": [{"uuid": "173c91e0-dfb4-4b99-9b0f-7ae1f06598da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9594c761-7638-4f69-b579-79baa62b3c38"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:43.371910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] validate_networks() for [('9594c761-7638-4f69-b579-79baa62b3c38', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:21:43.779322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:21:43.779974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:21:43.780627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:21:43.781959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:21:43.782556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:21:43.793242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:43.794019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:43.794844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:43.795630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:43.813358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:21:43.818791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Getting quotas for user 284a1908713c4b74a35a1d3b5cd10e80 and project 62f54fe17dd142b4be6d7d09de31d63b. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:21:43.882339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:21:43.885008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='173c91e0-dfb4-4b99-9b0f-7ae1f06598da',volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:21:44.042352 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-89136318-c3d6-4e95-9045-f2bebdde192c tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.807311 Mar 12 21:21:44.043196 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4617/5385] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:21:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:21:44.053449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-edd684ed-a6f1-46e4-8ab6-42a0eb412a1a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:44.054372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-edd684ed-a6f1-46e4-8ab6-42a0eb412a1a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:44.109721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-edd684ed-a6f1-46e4-8ab6-42a0eb412a1a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:44.117522 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-edd684ed-a6f1-46e4-8ab6-42a0eb412a1a tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1095 microversion: 2.1 time: 0.067681 Mar 12 21:21:44.118722 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4618/5386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:44 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:44.869889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2c622440-0398-436b-8ad9-b83639459a36 req-7bd618b6-0052-4ded-a580-2d0319165c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fc4fddc-9708-4ba4-b374-4d201202907d", "tag": "1d7b6291-417b-4373-a31b-8355a20596fa"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:44.879746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2c622440-0398-436b-8ad9-b83639459a36 req-7bd618b6-0052-4ded-a580-2d0319165c51 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:44.880219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2c622440-0398-436b-8ad9-b83639459a36 req-7bd618b6-0052-4ded-a580-2d0319165c51 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:44.891655 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2c622440-0398-436b-8ad9-b83639459a36 req-7bd618b6-0052-4ded-a580-2d0319165c51 service nova] Creating event network-changed:1d7b6291-417b-4373-a31b-8355a20596fa for instance 6fc4fddc-9708-4ba4-b374-4d201202907d on nch1-master-1 Mar 12 21:21:44.896775 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2c622440-0398-436b-8ad9-b83639459a36 req-7bd618b6-0052-4ded-a580-2d0319165c51 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030558 Mar 12 21:21:44.897545 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4619/5387] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:21:45.134791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9e94e4f8-0a5e-43df-b84f-7c3a718e862e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:45.135991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9e94e4f8-0a5e-43df-b84f-7c3a718e862e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:45.146779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e94e4f8-0a5e-43df-b84f-7c3a718e862e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:45.151033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e94e4f8-0a5e-43df-b84f-7c3a718e862e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:45.152879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e94e4f8-0a5e-43df-b84f-7c3a718e862e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:45.154576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e94e4f8-0a5e-43df-b84f-7c3a718e862e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:45.250678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9e94e4f8-0a5e-43df-b84f-7c3a718e862e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:45.260560 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9e94e4f8-0a5e-43df-b84f-7c3a718e862e tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1201 microversion: 2.1 time: 0.129498 Mar 12 21:21:45.273699 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4620/5388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:45 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1201 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:46.280933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1869406d-75e7-4f62-ac72-d74885d69132 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:46.281691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1869406d-75e7-4f62-ac72-d74885d69132 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:46.294013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1869406d-75e7-4f62-ac72-d74885d69132 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:46.294489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1869406d-75e7-4f62-ac72-d74885d69132 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:46.295296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1869406d-75e7-4f62-ac72-d74885d69132 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:46.295751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1869406d-75e7-4f62-ac72-d74885d69132 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:46.522077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1869406d-75e7-4f62-ac72-d74885d69132 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:46.532112 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1869406d-75e7-4f62-ac72-d74885d69132 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1279 microversion: 2.1 time: 0.255397 Mar 12 21:21:46.533068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4621/5389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:46 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1279 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:46.959565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ca8b5c4e-e56e-4eb2-a44e-cd284bce71e2 req-24788a36-0d1e-4ebf-bb4f-5360d7d5f913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f8ef63-6479-4116-9819-e07b5cd5d521", "tag": "773518ff-13e7-4d12-8a3a-551610c6b4a4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:46.970114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ca8b5c4e-e56e-4eb2-a44e-cd284bce71e2 req-24788a36-0d1e-4ebf-bb4f-5360d7d5f913 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:46.970969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ca8b5c4e-e56e-4eb2-a44e-cd284bce71e2 req-24788a36-0d1e-4ebf-bb4f-5360d7d5f913 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:46.987062 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ca8b5c4e-e56e-4eb2-a44e-cd284bce71e2 req-24788a36-0d1e-4ebf-bb4f-5360d7d5f913 service nova] Creating event network-changed:773518ff-13e7-4d12-8a3a-551610c6b4a4 for instance 82f8ef63-6479-4116-9819-e07b5cd5d521 on nch2-master-1 Mar 12 21:21:46.997702 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ca8b5c4e-e56e-4eb2-a44e-cd284bce71e2 req-24788a36-0d1e-4ebf-bb4f-5360d7d5f913 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043233 Mar 12 21:21:46.999231 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4622/5390] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:21:47.553225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de61e540-a2d9-430b-a0da-7dc6e4d6a812 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:47.553998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-de61e540-a2d9-430b-a0da-7dc6e4d6a812 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:47.560239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de61e540-a2d9-430b-a0da-7dc6e4d6a812 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:47.560925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de61e540-a2d9-430b-a0da-7dc6e4d6a812 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:47.561922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de61e540-a2d9-430b-a0da-7dc6e4d6a812 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:47.562388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de61e540-a2d9-430b-a0da-7dc6e4d6a812 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:47.708592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-de61e540-a2d9-430b-a0da-7dc6e4d6a812 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:47.716724 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de61e540-a2d9-430b-a0da-7dc6e4d6a812 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1267 microversion: 2.1 time: 0.169851 Mar 12 21:21:47.717586 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4623/5391] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:47 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:48.735497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1b05671-a1a9-4ca7-aed2-12425f861f64 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:48.736261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1b05671-a1a9-4ca7-aed2-12425f861f64 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:48.744077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1b05671-a1a9-4ca7-aed2-12425f861f64 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:48.744576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1b05671-a1a9-4ca7-aed2-12425f861f64 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:48.745372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1b05671-a1a9-4ca7-aed2-12425f861f64 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:48.746061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1b05671-a1a9-4ca7-aed2-12425f861f64 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:48.926832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1b05671-a1a9-4ca7-aed2-12425f861f64 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:48.934895 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1b05671-a1a9-4ca7-aed2-12425f861f64 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1267 microversion: 2.1 time: 0.205041 Mar 12 21:21:48.935489 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4624/5392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:48 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:49.952109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f7b5042-66dd-46a3-9fcb-1b624d191718 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:49.952770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6f7b5042-66dd-46a3-9fcb-1b624d191718 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:49.959631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f7b5042-66dd-46a3-9fcb-1b624d191718 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:49.960106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f7b5042-66dd-46a3-9fcb-1b624d191718 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:49.960912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f7b5042-66dd-46a3-9fcb-1b624d191718 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:49.961351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f7b5042-66dd-46a3-9fcb-1b624d191718 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:50.102928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6f7b5042-66dd-46a3-9fcb-1b624d191718 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:50.110296 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f7b5042-66dd-46a3-9fcb-1b624d191718 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1267 microversion: 2.1 time: 0.162061 Mar 12 21:21:50.110886 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4625/5393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:49 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:51.128043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c6843da8-d931-4083-9827-e7eca93ba94d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:51.129331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c6843da8-d931-4083-9827-e7eca93ba94d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:51.136220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6843da8-d931-4083-9827-e7eca93ba94d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:51.136695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6843da8-d931-4083-9827-e7eca93ba94d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:51.137498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6843da8-d931-4083-9827-e7eca93ba94d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:51.137994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c6843da8-d931-4083-9827-e7eca93ba94d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:51.363337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c6843da8-d931-4083-9827-e7eca93ba94d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:51.371555 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c6843da8-d931-4083-9827-e7eca93ba94d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1267 microversion: 2.1 time: 0.247423 Mar 12 21:21:51.372234 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4626/5394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:51 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:52.388430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cebbd264-caec-4d7f-8412-f2959fc9bcca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:52.389256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cebbd264-caec-4d7f-8412-f2959fc9bcca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:52.396368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cebbd264-caec-4d7f-8412-f2959fc9bcca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:52.396936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cebbd264-caec-4d7f-8412-f2959fc9bcca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:52.397723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cebbd264-caec-4d7f-8412-f2959fc9bcca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:52.398332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cebbd264-caec-4d7f-8412-f2959fc9bcca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:52.552459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cebbd264-caec-4d7f-8412-f2959fc9bcca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:52.559918 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cebbd264-caec-4d7f-8412-f2959fc9bcca tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1267 microversion: 2.1 time: 0.175560 Mar 12 21:21:52.560505 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4627/5395] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:52 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:53.129592 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:21:53.130134 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:21:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:21:53.576833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-120300bb-dc4b-46e7-8530-69bcbac82856 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:53.577340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-120300bb-dc4b-46e7-8530-69bcbac82856 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:53.584301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-120300bb-dc4b-46e7-8530-69bcbac82856 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:53.584781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-120300bb-dc4b-46e7-8530-69bcbac82856 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:53.585570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-120300bb-dc4b-46e7-8530-69bcbac82856 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:53.586093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-120300bb-dc4b-46e7-8530-69bcbac82856 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:53.722921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-120300bb-dc4b-46e7-8530-69bcbac82856 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:53.734504 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-120300bb-dc4b-46e7-8530-69bcbac82856 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1267 microversion: 2.1 time: 0.161877 Mar 12 21:21:53.735092 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4628/5396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:53 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:54.368861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b844b9c4-673b-4b6c-9f6e-f8cf59250a4b req-693b43fd-71ec-46b5-a2e2-0c428a7d2ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f8ef63-6479-4116-9819-e07b5cd5d521", "name": "network-vif-plugged", "status": "completed", "tag": "773518ff-13e7-4d12-8a3a-551610c6b4a4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:54.379711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b844b9c4-673b-4b6c-9f6e-f8cf59250a4b req-693b43fd-71ec-46b5-a2e2-0c428a7d2ad8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:54.380571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b844b9c4-673b-4b6c-9f6e-f8cf59250a4b req-693b43fd-71ec-46b5-a2e2-0c428a7d2ad8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:54.394435 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b844b9c4-673b-4b6c-9f6e-f8cf59250a4b req-693b43fd-71ec-46b5-a2e2-0c428a7d2ad8 service nova] Creating event network-vif-plugged:773518ff-13e7-4d12-8a3a-551610c6b4a4 for instance 82f8ef63-6479-4116-9819-e07b5cd5d521 on nch2-master-1 Mar 12 21:21:54.400777 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b844b9c4-673b-4b6c-9f6e-f8cf59250a4b req-693b43fd-71ec-46b5-a2e2-0c428a7d2ad8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035510 Mar 12 21:21:54.401724 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4629/5397] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:21:54.752272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0fe4f3c3-dc0a-4ff5-ab52-3fff56aca06d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:54.753614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0fe4f3c3-dc0a-4ff5-ab52-3fff56aca06d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:54.760785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fe4f3c3-dc0a-4ff5-ab52-3fff56aca06d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:54.761255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fe4f3c3-dc0a-4ff5-ab52-3fff56aca06d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:54.762156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fe4f3c3-dc0a-4ff5-ab52-3fff56aca06d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:54.762619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0fe4f3c3-dc0a-4ff5-ab52-3fff56aca06d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:54.912175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0fe4f3c3-dc0a-4ff5-ab52-3fff56aca06d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:54.920093 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0fe4f3c3-dc0a-4ff5-ab52-3fff56aca06d tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1267 microversion: 2.1 time: 0.172256 Mar 12 21:21:54.920681 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4630/5398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:54 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:55.582570 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:21:55.583089 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:21:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:21:55.937007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c3333c3-8eb0-4307-94b1-df1e1fe6e7df tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:55.937664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2c3333c3-8eb0-4307-94b1-df1e1fe6e7df tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:55.944400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c3333c3-8eb0-4307-94b1-df1e1fe6e7df tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:55.944871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c3333c3-8eb0-4307-94b1-df1e1fe6e7df tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:55.945662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c3333c3-8eb0-4307-94b1-df1e1fe6e7df tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:55.946149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c3333c3-8eb0-4307-94b1-df1e1fe6e7df tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:56.082948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c3333c3-8eb0-4307-94b1-df1e1fe6e7df tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:56.090623 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c3333c3-8eb0-4307-94b1-df1e1fe6e7df tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1453 microversion: 2.1 time: 0.157539 Mar 12 21:21:56.091207 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4631/5399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:55 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:56.106798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7f0d03a1-de31-4699-963d-499ccaadb188 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:21:56.107439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7f0d03a1-de31-4699-963d-499ccaadb188 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:21:56.114107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f0d03a1-de31-4699-963d-499ccaadb188 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:56.114565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f0d03a1-de31-4699-963d-499ccaadb188 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:56.115382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f0d03a1-de31-4699-963d-499ccaadb188 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:56.115843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7f0d03a1-de31-4699-963d-499ccaadb188 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:56.251842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7f0d03a1-de31-4699-963d-499ccaadb188 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:21:56.259233 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7f0d03a1-de31-4699-963d-499ccaadb188 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1453 microversion: 2.1 time: 0.156037 Mar 12 21:21:56.259814 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4632/5400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:21:56 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:21:57.893200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-124d5862-99ec-4db4-b10a-15618df83305 req-7df29c98-0799-4a30-986c-0c754c36d170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f8ef63-6479-4116-9819-e07b5cd5d521", "tag": "773518ff-13e7-4d12-8a3a-551610c6b4a4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:21:57.904738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-124d5862-99ec-4db4-b10a-15618df83305 req-7df29c98-0799-4a30-986c-0c754c36d170 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:21:57.904738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-124d5862-99ec-4db4-b10a-15618df83305 req-7df29c98-0799-4a30-986c-0c754c36d170 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:21:57.922038 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-124d5862-99ec-4db4-b10a-15618df83305 req-7df29c98-0799-4a30-986c-0c754c36d170 service nova] Creating event network-changed:773518ff-13e7-4d12-8a3a-551610c6b4a4 for instance 82f8ef63-6479-4116-9819-e07b5cd5d521 on nch2-master-1 Mar 12 21:21:57.927145 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-124d5862-99ec-4db4-b10a-15618df83305 req-7df29c98-0799-4a30-986c-0c754c36d170 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037760 Mar 12 21:21:57.927761 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4633/5401] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:22:52.884777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56a67d06-58f2-446b-9e38-26d13589bffa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:22:52.885433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-56a67d06-58f2-446b-9e38-26d13589bffa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:22:52.892882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56a67d06-58f2-446b-9e38-26d13589bffa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:22:52.893757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56a67d06-58f2-446b-9e38-26d13589bffa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:22:52.894852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56a67d06-58f2-446b-9e38-26d13589bffa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:22:52.895322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56a67d06-58f2-446b-9e38-26d13589bffa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:22:52.924679 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56a67d06-58f2-446b-9e38-26d13589bffa tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.046213 Mar 12 21:22:52.925587 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4634/5402] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Mar 12 21:22:52 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d/os-server-password => generated 116 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:23:24.101091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-6049610", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "abee3caf-ede4-4156-a856-b915173ea616"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:23:24.258353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] validate_networks() for [('abee3caf-ede4-4156-a856-b915173ea616', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:23:24.718944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:23:24.719390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:23:24.719886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:23:24.720402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:23:24.720842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:23:24.732094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:24.732772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:24.734036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:24.735405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:24.762038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Getting quotas for project 9f6671ee1ef84f14bfc9ad7998fc2398. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:23:24.770393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Getting quotas for user f7685737370a493596376a744d5fb4b3 and project 9f6671ee1ef84f14bfc9ad7998fc2398. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:23:24.784802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:23:24.787514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:23:24.834018 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-faaf9dea-a27c-434b-b46e-bfe125359ddc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860146 Mar 12 21:23:24.834860 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4635/5403] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:23:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:23:24.845374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8a0cadc-587d-4840-8f57-db8f462d5723 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:24.846337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8a0cadc-587d-4840-8f57-db8f462d5723 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:24.915180 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c8a0cadc-587d-4840-8f57-db8f462d5723 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:24.923064 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8a0cadc-587d-4840-8f57-db8f462d5723 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1211 microversion: 2.1 time: 0.082535 Mar 12 21:23:24.929747 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4636/5404] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:24 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:25.940492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f9995b9-d1d8-4447-b8c4-45e1f86859bd tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:25.941229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f9995b9-d1d8-4447-b8c4-45e1f86859bd tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:25.948975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f9995b9-d1d8-4447-b8c4-45e1f86859bd tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:25.949530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f9995b9-d1d8-4447-b8c4-45e1f86859bd tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:25.950437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f9995b9-d1d8-4447-b8c4-45e1f86859bd tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:25.950973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f9995b9-d1d8-4447-b8c4-45e1f86859bd tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:26.045017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9f9995b9-d1d8-4447-b8c4-45e1f86859bd tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:26.053274 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f9995b9-d1d8-4447-b8c4-45e1f86859bd tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1269 microversion: 2.1 time: 0.116667 Mar 12 21:23:26.053889 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4637/5405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:25 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:27.069732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a21b4a39-e23b-4613-aca9-3736a0ec1c86 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:27.070439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a21b4a39-e23b-4613-aca9-3736a0ec1c86 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:27.077060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a21b4a39-e23b-4613-aca9-3736a0ec1c86 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:27.077526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a21b4a39-e23b-4613-aca9-3736a0ec1c86 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:27.078388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a21b4a39-e23b-4613-aca9-3736a0ec1c86 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:27.078846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a21b4a39-e23b-4613-aca9-3736a0ec1c86 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:27.303079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a21b4a39-e23b-4613-aca9-3736a0ec1c86 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:27.310951 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a21b4a39-e23b-4613-aca9-3736a0ec1c86 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1311 microversion: 2.1 time: 0.245055 Mar 12 21:23:27.311639 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4638/5406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:27 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1311 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:27.389520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-49e00d87-ab9e-424e-a60e-66cc2b5d47db req-19c468da-3ce4-43ff-8477-eca83102dfeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc60117a-c031-4145-8525-202f717ad781", "tag": "e246e733-3095-434e-9955-0045e8a3d5a9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:23:27.399535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-49e00d87-ab9e-424e-a60e-66cc2b5d47db req-19c468da-3ce4-43ff-8477-eca83102dfeb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:27.399996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-49e00d87-ab9e-424e-a60e-66cc2b5d47db req-19c468da-3ce4-43ff-8477-eca83102dfeb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:27.414050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-49e00d87-ab9e-424e-a60e-66cc2b5d47db req-19c468da-3ce4-43ff-8477-eca83102dfeb service nova] Creating event network-changed:e246e733-3095-434e-9955-0045e8a3d5a9 for instance fc60117a-c031-4145-8525-202f717ad781 on nch1-master-1 Mar 12 21:23:27.422520 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-49e00d87-ab9e-424e-a60e-66cc2b5d47db req-19c468da-3ce4-43ff-8477-eca83102dfeb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036638 Mar 12 21:23:27.423186 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4639/5407] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:23:27.424213 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:23:27.424666 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:23:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:23:28.329705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e79b59c-3671-4512-99cb-9692411e8813 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:28.330528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5e79b59c-3671-4512-99cb-9692411e8813 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:28.336785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e79b59c-3671-4512-99cb-9692411e8813 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:28.337253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e79b59c-3671-4512-99cb-9692411e8813 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:28.338060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e79b59c-3671-4512-99cb-9692411e8813 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:28.338517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e79b59c-3671-4512-99cb-9692411e8813 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:28.476652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5e79b59c-3671-4512-99cb-9692411e8813 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:28.484085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e79b59c-3671-4512-99cb-9692411e8813 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1311 microversion: 2.1 time: 0.159666 Mar 12 21:23:28.484664 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4640/5408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:28 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1311 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:29.500472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25229dcc-09e7-4e2d-bfa1-19135be029e4 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:29.501141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-25229dcc-09e7-4e2d-bfa1-19135be029e4 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:29.508547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25229dcc-09e7-4e2d-bfa1-19135be029e4 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:29.509025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25229dcc-09e7-4e2d-bfa1-19135be029e4 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:29.510188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25229dcc-09e7-4e2d-bfa1-19135be029e4 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:29.510649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25229dcc-09e7-4e2d-bfa1-19135be029e4 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:29.640829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-25229dcc-09e7-4e2d-bfa1-19135be029e4 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:29.648107 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-25229dcc-09e7-4e2d-bfa1-19135be029e4 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1311 microversion: 2.1 time: 0.151624 Mar 12 21:23:29.648682 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4641/5409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:29 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1311 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:30.664918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26024c64-8fff-4b59-bb94-e88b10370005 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:30.665615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-26024c64-8fff-4b59-bb94-e88b10370005 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:30.672749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26024c64-8fff-4b59-bb94-e88b10370005 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:30.673219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26024c64-8fff-4b59-bb94-e88b10370005 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:30.674654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26024c64-8fff-4b59-bb94-e88b10370005 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:30.675110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26024c64-8fff-4b59-bb94-e88b10370005 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:30.807757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-26024c64-8fff-4b59-bb94-e88b10370005 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:30.815071 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-26024c64-8fff-4b59-bb94-e88b10370005 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1311 microversion: 2.1 time: 0.154141 Mar 12 21:23:30.815654 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4642/5410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:30 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1311 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:31.832888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4e94d2cd-4333-4c1c-8a2c-ad64e9f80a44 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:31.833551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4e94d2cd-4333-4c1c-8a2c-ad64e9f80a44 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:31.840536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e94d2cd-4333-4c1c-8a2c-ad64e9f80a44 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:31.841005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e94d2cd-4333-4c1c-8a2c-ad64e9f80a44 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:31.841816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e94d2cd-4333-4c1c-8a2c-ad64e9f80a44 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:31.842276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e94d2cd-4333-4c1c-8a2c-ad64e9f80a44 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:31.977145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4e94d2cd-4333-4c1c-8a2c-ad64e9f80a44 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:31.984500 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4e94d2cd-4333-4c1c-8a2c-ad64e9f80a44 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1311 microversion: 2.1 time: 0.156276 Mar 12 21:23:31.985081 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4643/5411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:31 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1311 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:33.001178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-02db1ed6-5fb1-44a4-aded-9e74f310ab40 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:33.002427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-02db1ed6-5fb1-44a4-aded-9e74f310ab40 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:33.009244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02db1ed6-5fb1-44a4-aded-9e74f310ab40 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:33.009706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02db1ed6-5fb1-44a4-aded-9e74f310ab40 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:33.010505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02db1ed6-5fb1-44a4-aded-9e74f310ab40 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:33.010955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-02db1ed6-5fb1-44a4-aded-9e74f310ab40 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:33.146402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-02db1ed6-5fb1-44a4-aded-9e74f310ab40 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:33.153974 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-02db1ed6-5fb1-44a4-aded-9e74f310ab40 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1311 microversion: 2.1 time: 0.156707 Mar 12 21:23:33.154562 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4644/5412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:32 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1311 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:34.171108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-012ebbbe-1225-4c0f-b59e-040b77a458bb tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:34.171737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-012ebbbe-1225-4c0f-b59e-040b77a458bb tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:34.178468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-012ebbbe-1225-4c0f-b59e-040b77a458bb tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:34.178939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-012ebbbe-1225-4c0f-b59e-040b77a458bb tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:34.179724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-012ebbbe-1225-4c0f-b59e-040b77a458bb tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:34.180179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-012ebbbe-1225-4c0f-b59e-040b77a458bb tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:34.311192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-012ebbbe-1225-4c0f-b59e-040b77a458bb tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:34.319029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-012ebbbe-1225-4c0f-b59e-040b77a458bb tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1311 microversion: 2.1 time: 0.151956 Mar 12 21:23:34.319610 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4645/5413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:34 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1311 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:34.717027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1f1cae49-97f9-4517-860c-cecd1d46ff8b req-21d17c28-a63c-4112-82ed-0d33299ee74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc60117a-c031-4145-8525-202f717ad781", "name": "network-vif-plugged", "status": "completed", "tag": "e246e733-3095-434e-9955-0045e8a3d5a9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:23:34.725579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1f1cae49-97f9-4517-860c-cecd1d46ff8b req-21d17c28-a63c-4112-82ed-0d33299ee74b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:34.726093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1f1cae49-97f9-4517-860c-cecd1d46ff8b req-21d17c28-a63c-4112-82ed-0d33299ee74b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:34.741697 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1f1cae49-97f9-4517-860c-cecd1d46ff8b req-21d17c28-a63c-4112-82ed-0d33299ee74b service nova] Creating event network-vif-plugged:e246e733-3095-434e-9955-0045e8a3d5a9 for instance fc60117a-c031-4145-8525-202f717ad781 on nch1-master-1 Mar 12 21:23:34.746911 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1f1cae49-97f9-4517-860c-cecd1d46ff8b req-21d17c28-a63c-4112-82ed-0d33299ee74b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033607 Mar 12 21:23:34.747515 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4646/5414] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:23:35.335354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-76e9162c-a42b-4b69-ac70-0993aa4ce5c9 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:35.336075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-76e9162c-a42b-4b69-ac70-0993aa4ce5c9 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:35.343152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76e9162c-a42b-4b69-ac70-0993aa4ce5c9 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:35.343629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76e9162c-a42b-4b69-ac70-0993aa4ce5c9 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:35.344421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76e9162c-a42b-4b69-ac70-0993aa4ce5c9 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:35.344910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76e9162c-a42b-4b69-ac70-0993aa4ce5c9 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:35.479817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-76e9162c-a42b-4b69-ac70-0993aa4ce5c9 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:35.487839 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-76e9162c-a42b-4b69-ac70-0993aa4ce5c9 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1311 microversion: 2.1 time: 0.156789 Mar 12 21:23:35.488422 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4647/5415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:35 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1311 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:36.504360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ab70418-cdae-4fa5-a788-bfe087c8fbbc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:36.505040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ab70418-cdae-4fa5-a788-bfe087c8fbbc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:36.511765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ab70418-cdae-4fa5-a788-bfe087c8fbbc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:36.512226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ab70418-cdae-4fa5-a788-bfe087c8fbbc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:36.512998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ab70418-cdae-4fa5-a788-bfe087c8fbbc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:36.513447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ab70418-cdae-4fa5-a788-bfe087c8fbbc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:36.644726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ab70418-cdae-4fa5-a788-bfe087c8fbbc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:36.652323 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ab70418-cdae-4fa5-a788-bfe087c8fbbc tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1495 microversion: 2.1 time: 0.152416 Mar 12 21:23:36.652893 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4648/5416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:36 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1495 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:38.749687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd06c091-c439-4874-b1c5-c19b63a6cca8 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:38.750383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd06c091-c439-4874-b1c5-c19b63a6cca8 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:38.757205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd06c091-c439-4874-b1c5-c19b63a6cca8 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:38.757669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd06c091-c439-4874-b1c5-c19b63a6cca8 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:38.758468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd06c091-c439-4874-b1c5-c19b63a6cca8 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:38.758918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd06c091-c439-4874-b1c5-c19b63a6cca8 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:38.783879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd06c091-c439-4874-b1c5-c19b63a6cca8 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:23:38.857899 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd06c091-c439-4874-b1c5-c19b63a6cca8 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 204 len: 0 microversion: 2.1 time: 0.111816 Mar 12 21:23:38.858391 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4649/5417] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:23:38 2022] DELETE /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:23:38.867935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d48f2d6-408b-41fb-8700-bcfd4ad95aa7 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:38.868823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0d48f2d6-408b-41fb-8700-bcfd4ad95aa7 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:38.875083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d48f2d6-408b-41fb-8700-bcfd4ad95aa7 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:38.875464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d48f2d6-408b-41fb-8700-bcfd4ad95aa7 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:38.876242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d48f2d6-408b-41fb-8700-bcfd4ad95aa7 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:38.877228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d48f2d6-408b-41fb-8700-bcfd4ad95aa7 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:39.012602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0d48f2d6-408b-41fb-8700-bcfd4ad95aa7 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:39.019904 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d48f2d6-408b-41fb-8700-bcfd4ad95aa7 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1501 microversion: 2.1 time: 0.156427 Mar 12 21:23:39.020480 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4650/5418] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:38 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:40.037738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d4107e5f-98b6-46a5-986d-ae358791e7c1 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:40.038393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d4107e5f-98b6-46a5-986d-ae358791e7c1 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:40.045469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4107e5f-98b6-46a5-986d-ae358791e7c1 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:40.045983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4107e5f-98b6-46a5-986d-ae358791e7c1 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:40.046758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4107e5f-98b6-46a5-986d-ae358791e7c1 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:40.047207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d4107e5f-98b6-46a5-986d-ae358791e7c1 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:40.190575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d4107e5f-98b6-46a5-986d-ae358791e7c1 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7685737370a493596376a744d5fb4b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6671ee1ef84f14bfc9ad7998fc2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:40.198085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d4107e5f-98b6-46a5-986d-ae358791e7c1 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 200 len: 1501 microversion: 2.1 time: 0.164237 Mar 12 21:23:40.198668 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4651/5419] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:40 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:40.700613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-df2ae272-5342-4cb9-aef6-fa23c8aa4e7a req-3c871964-b28e-4c2e-ad98-06473590ae3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc60117a-c031-4145-8525-202f717ad781", "name": "network-vif-deleted", "tag": "e246e733-3095-434e-9955-0045e8a3d5a9"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:23:40.709281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-df2ae272-5342-4cb9-aef6-fa23c8aa4e7a req-3c871964-b28e-4c2e-ad98-06473590ae3b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:40.709749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-df2ae272-5342-4cb9-aef6-fa23c8aa4e7a req-3c871964-b28e-4c2e-ad98-06473590ae3b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:40.723823 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-df2ae272-5342-4cb9-aef6-fa23c8aa4e7a req-3c871964-b28e-4c2e-ad98-06473590ae3b service nova] Creating event network-vif-deleted:e246e733-3095-434e-9955-0045e8a3d5a9 for instance fc60117a-c031-4145-8525-202f717ad781 on nch1-master-1 Mar 12 21:23:40.729059 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-df2ae272-5342-4cb9-aef6-fa23c8aa4e7a req-3c871964-b28e-4c2e-ad98-06473590ae3b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032102 Mar 12 21:23:40.729760 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4652/5420] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:23:41.217234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67e6b8cb-d6a0-4aee-84f1-3a35b35da070 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:41.217999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-67e6b8cb-d6a0-4aee-84f1-3a35b35da070 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] [instance: fc60117a-c031-4145-8525-202f717ad781] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:41.224746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67e6b8cb-d6a0-4aee-84f1-3a35b35da070 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:41.225272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67e6b8cb-d6a0-4aee-84f1-3a35b35da070 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:41.226086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67e6b8cb-d6a0-4aee-84f1-3a35b35da070 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:41.226537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67e6b8cb-d6a0-4aee-84f1-3a35b35da070 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:41.239844 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-67e6b8cb-d6a0-4aee-84f1-3a35b35da070 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] HTTP exception thrown: Instance fc60117a-c031-4145-8525-202f717ad781 could not be found. Mar 12 21:23:41.240449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67e6b8cb-d6a0-4aee-84f1-3a35b35da070 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] Returning 404 to user: Instance fc60117a-c031-4145-8525-202f717ad781 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:23:41.241287 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67e6b8cb-d6a0-4aee-84f1-3a35b35da070 tempest-VolumesActionsTest-2007513843 tempest-VolumesActionsTest-2007513843-project] 10.222.0.30 "GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781" status: 404 len: 111 microversion: 2.1 time: 0.029284 Mar 12 21:23:41.241853 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4653/5421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:41 2022] GET /compute/v2.1/servers/fc60117a-c031-4145-8525-202f717ad781 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:23:47.718212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-84072dea-f6ea-4c6a-911a-ef02ef180495 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:47.719409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-84072dea-f6ea-4c6a-911a-ef02ef180495 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:47.727065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84072dea-f6ea-4c6a-911a-ef02ef180495 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:47.727730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84072dea-f6ea-4c6a-911a-ef02ef180495 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:47.728688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84072dea-f6ea-4c6a-911a-ef02ef180495 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:47.729341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84072dea-f6ea-4c6a-911a-ef02ef180495 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:47.759129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-84072dea-f6ea-4c6a-911a-ef02ef180495 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:23:47.874209 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-84072dea-f6ea-4c6a-911a-ef02ef180495 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "DELETE /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 204 len: 0 microversion: 2.1 time: 0.160581 Mar 12 21:23:47.874822 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4654/5422] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:23:47 2022] DELETE /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:23:47.881006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6de5a84f-81cb-48d3-a3ce-23f207a09ed1 req-f3dc4309-4ef5-4c4a-8a1c-d7016816f64c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f8ef63-6479-4116-9819-e07b5cd5d521", "tag": "773518ff-13e7-4d12-8a3a-551610c6b4a4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:23:47.889401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6de5a84f-81cb-48d3-a3ce-23f207a09ed1 req-f3dc4309-4ef5-4c4a-8a1c-d7016816f64c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:47.889896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6de5a84f-81cb-48d3-a3ce-23f207a09ed1 req-f3dc4309-4ef5-4c4a-8a1c-d7016816f64c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:47.901310 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6de5a84f-81cb-48d3-a3ce-23f207a09ed1 req-f3dc4309-4ef5-4c4a-8a1c-d7016816f64c service nova] Creating event network-changed:773518ff-13e7-4d12-8a3a-551610c6b4a4 for instance 82f8ef63-6479-4116-9819-e07b5cd5d521 on nch2-master-1 Mar 12 21:23:47.906777 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6de5a84f-81cb-48d3-a3ce-23f207a09ed1 req-f3dc4309-4ef5-4c4a-8a1c-d7016816f64c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030656 Mar 12 21:23:47.908163 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4655/5423] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:23:47.917510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-153281e3-8c7a-417a-a971-dc9a28dbeb97 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:47.918504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-153281e3-8c7a-417a-a971-dc9a28dbeb97 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:47.926550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-153281e3-8c7a-417a-a971-dc9a28dbeb97 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:47.927125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-153281e3-8c7a-417a-a971-dc9a28dbeb97 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:47.927830 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-153281e3-8c7a-417a-a971-dc9a28dbeb97 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:47.928496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-153281e3-8c7a-417a-a971-dc9a28dbeb97 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:48.103318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-153281e3-8c7a-417a-a971-dc9a28dbeb97 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:48.114663 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-153281e3-8c7a-417a-a971-dc9a28dbeb97 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1577 microversion: 2.1 time: 0.202186 Mar 12 21:23:48.116222 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4656/5424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:47 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:23:49.133540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-89ad44a1-dfc1-4763-9300-3fafc278d5e4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:49.134245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89ad44a1-dfc1-4763-9300-3fafc278d5e4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:49.141005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89ad44a1-dfc1-4763-9300-3fafc278d5e4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:49.141470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89ad44a1-dfc1-4763-9300-3fafc278d5e4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:49.142879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89ad44a1-dfc1-4763-9300-3fafc278d5e4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:49.143332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89ad44a1-dfc1-4763-9300-3fafc278d5e4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:49.291383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-89ad44a1-dfc1-4763-9300-3fafc278d5e4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:49.299640 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-89ad44a1-dfc1-4763-9300-3fafc278d5e4 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1459 microversion: 2.1 time: 0.170049 Mar 12 21:23:49.300220 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4657/5425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:49 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1459 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:49.855675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0d91d77c-96df-49c3-b97c-d7eaf232e796 req-109083ca-b059-4617-ba01-686a347ef614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f8ef63-6479-4116-9819-e07b5cd5d521", "name": "network-vif-deleted", "tag": "773518ff-13e7-4d12-8a3a-551610c6b4a4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:23:49.864258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0d91d77c-96df-49c3-b97c-d7eaf232e796 req-109083ca-b059-4617-ba01-686a347ef614 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:49.864717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0d91d77c-96df-49c3-b97c-d7eaf232e796 req-109083ca-b059-4617-ba01-686a347ef614 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:49.876525 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0d91d77c-96df-49c3-b97c-d7eaf232e796 req-109083ca-b059-4617-ba01-686a347ef614 service nova] Creating event network-vif-deleted:773518ff-13e7-4d12-8a3a-551610c6b4a4 for instance 82f8ef63-6479-4116-9819-e07b5cd5d521 on nch2-master-1 Mar 12 21:23:49.882139 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0d91d77c-96df-49c3-b97c-d7eaf232e796 req-109083ca-b059-4617-ba01-686a347ef614 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030232 Mar 12 21:23:49.882765 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4658/5426] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:23:50.329357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75672056-3430-4954-8c93-1ca673a6ce06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:50.330070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75672056-3430-4954-8c93-1ca673a6ce06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:50.339590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75672056-3430-4954-8c93-1ca673a6ce06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:50.340085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75672056-3430-4954-8c93-1ca673a6ce06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:50.340888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75672056-3430-4954-8c93-1ca673a6ce06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:50.341348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75672056-3430-4954-8c93-1ca673a6ce06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:50.387155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75672056-3430-4954-8c93-1ca673a6ce06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:50.387637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75672056-3430-4954-8c93-1ca673a6ce06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:50.388207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-75672056-3430-4954-8c93-1ca673a6ce06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lazy-loading 'fault' on Instance uuid 82f8ef63-6479-4116-9819-e07b5cd5d521 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:23:50.431772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-75672056-3430-4954-8c93-1ca673a6ce06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:23:50.439669 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75672056-3430-4954-8c93-1ca673a6ce06 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 200 len: 1185 microversion: 2.1 time: 0.126621 Mar 12 21:23:50.441946 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4659/5427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:50 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 1185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:23:51.456353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9e942fb-8c6d-478b-a2c6-ecfbcd826093 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:23:51.457024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9e942fb-8c6d-478b-a2c6-ecfbcd826093 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 82f8ef63-6479-4116-9819-e07b5cd5d521] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:23:51.463975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e942fb-8c6d-478b-a2c6-ecfbcd826093 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:51.464435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e942fb-8c6d-478b-a2c6-ecfbcd826093 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:51.465214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e942fb-8c6d-478b-a2c6-ecfbcd826093 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:23:51.465661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9e942fb-8c6d-478b-a2c6-ecfbcd826093 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:23:51.479192 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f9e942fb-8c6d-478b-a2c6-ecfbcd826093 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance 82f8ef63-6479-4116-9819-e07b5cd5d521 could not be found. Mar 12 21:23:51.479789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9e942fb-8c6d-478b-a2c6-ecfbcd826093 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance 82f8ef63-6479-4116-9819-e07b5cd5d521 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:23:51.480620 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9e942fb-8c6d-478b-a2c6-ecfbcd826093 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521" status: 404 len: 111 microversion: 2.1 time: 0.028214 Mar 12 21:23:51.481161 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4660/5428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:23:51 2022] GET /compute/v2.1/servers/82f8ef63-6479-4116-9819-e07b5cd5d521 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:24:24.591772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-70071ff2-9cc9-4c8f-b80c-0b1a89bfd959 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:24:24.592430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-70071ff2-9cc9-4c8f-b80c-0b1a89bfd959 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:24:24.599985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70071ff2-9cc9-4c8f-b80c-0b1a89bfd959 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:24.600458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70071ff2-9cc9-4c8f-b80c-0b1a89bfd959 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:24.601267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70071ff2-9cc9-4c8f-b80c-0b1a89bfd959 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:24.601803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70071ff2-9cc9-4c8f-b80c-0b1a89bfd959 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:24.632354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-70071ff2-9cc9-4c8f-b80c-0b1a89bfd959 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:24:24.719906 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-70071ff2-9cc9-4c8f-b80c-0b1a89bfd959 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 204 len: 0 microversion: 2.1 time: 0.130912 Mar 12 21:24:24.720983 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4661/5429] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:24:24 2022] DELETE /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:24:24.727864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4e3cb687-2570-4552-8800-0ad7ce530963 req-56a7d83e-0ca3-4a6e-a2f8-7ccfe92f16c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d83827c-2370-4722-805c-f08d06cfe228", "tag": "4bf1b21e-0896-4e40-89ad-d0048bb55a06"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:24:24.736001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4e3cb687-2570-4552-8800-0ad7ce530963 req-56a7d83e-0ca3-4a6e-a2f8-7ccfe92f16c1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:24.736578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4e3cb687-2570-4552-8800-0ad7ce530963 req-56a7d83e-0ca3-4a6e-a2f8-7ccfe92f16c1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:24.748526 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4e3cb687-2570-4552-8800-0ad7ce530963 req-56a7d83e-0ca3-4a6e-a2f8-7ccfe92f16c1 service nova] Creating event network-changed:4bf1b21e-0896-4e40-89ad-d0048bb55a06 for instance 3d83827c-2370-4722-805c-f08d06cfe228 on nch2-master-1 Mar 12 21:24:24.753826 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4e3cb687-2570-4552-8800-0ad7ce530963 req-56a7d83e-0ca3-4a6e-a2f8-7ccfe92f16c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030733 Mar 12 21:24:24.754510 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4662/5430] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:24:24.759730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cfc1df19-609b-455e-a049-93e17ba98ab9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:24:24.760434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cfc1df19-609b-455e-a049-93e17ba98ab9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:24:24.767206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfc1df19-609b-455e-a049-93e17ba98ab9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:24.767667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfc1df19-609b-455e-a049-93e17ba98ab9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:24.768658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfc1df19-609b-455e-a049-93e17ba98ab9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:24.769274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cfc1df19-609b-455e-a049-93e17ba98ab9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:25.021370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cfc1df19-609b-455e-a049-93e17ba98ab9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:24:25.033500 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cfc1df19-609b-455e-a049-93e17ba98ab9 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1576 microversion: 2.1 time: 0.277549 Mar 12 21:24:25.034839 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4663/5431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:24:24 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1576 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:24:26.053084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee7583ca-9765-47d8-b893-ddd7a9948cf6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:24:26.053735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee7583ca-9765-47d8-b893-ddd7a9948cf6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:24:26.061253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee7583ca-9765-47d8-b893-ddd7a9948cf6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:26.061718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee7583ca-9765-47d8-b893-ddd7a9948cf6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:26.062613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee7583ca-9765-47d8-b893-ddd7a9948cf6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:26.063066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee7583ca-9765-47d8-b893-ddd7a9948cf6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:26.200393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ee7583ca-9765-47d8-b893-ddd7a9948cf6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:24:26.208519 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee7583ca-9765-47d8-b893-ddd7a9948cf6 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1458 microversion: 2.1 time: 0.159696 Mar 12 21:24:26.209094 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4664/5432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:24:26 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1458 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:24:27.004874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-00c9232e-e202-4c5e-8ab8-a19a0e3ad697 req-6730e468-6b62-4911-9a27-782297997d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d83827c-2370-4722-805c-f08d06cfe228", "name": "network-vif-deleted", "tag": "4bf1b21e-0896-4e40-89ad-d0048bb55a06"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:24:27.013160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-00c9232e-e202-4c5e-8ab8-a19a0e3ad697 req-6730e468-6b62-4911-9a27-782297997d63 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:27.013634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-00c9232e-e202-4c5e-8ab8-a19a0e3ad697 req-6730e468-6b62-4911-9a27-782297997d63 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:27.024951 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-00c9232e-e202-4c5e-8ab8-a19a0e3ad697 req-6730e468-6b62-4911-9a27-782297997d63 service nova] Creating event network-vif-deleted:4bf1b21e-0896-4e40-89ad-d0048bb55a06 for instance 3d83827c-2370-4722-805c-f08d06cfe228 on nch2-master-1 Mar 12 21:24:27.029730 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-00c9232e-e202-4c5e-8ab8-a19a0e3ad697 req-6730e468-6b62-4911-9a27-782297997d63 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028713 Mar 12 21:24:27.030365 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4665/5433] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:24:27.229128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49b1aa52-a856-4cda-9dc5-e4aa5f938b77 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:24:27.229875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-49b1aa52-a856-4cda-9dc5-e4aa5f938b77 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:24:27.236525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49b1aa52-a856-4cda-9dc5-e4aa5f938b77 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:27.236993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49b1aa52-a856-4cda-9dc5-e4aa5f938b77 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:27.237804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49b1aa52-a856-4cda-9dc5-e4aa5f938b77 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:27.238255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49b1aa52-a856-4cda-9dc5-e4aa5f938b77 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:27.267945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49b1aa52-a856-4cda-9dc5-e4aa5f938b77 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:27.268414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49b1aa52-a856-4cda-9dc5-e4aa5f938b77 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:27.268882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-49b1aa52-a856-4cda-9dc5-e4aa5f938b77 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lazy-loading 'fault' on Instance uuid 3d83827c-2370-4722-805c-f08d06cfe228 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:24:27.311519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-49b1aa52-a856-4cda-9dc5-e4aa5f938b77 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284a1908713c4b74a35a1d3b5cd10e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f54fe17dd142b4be6d7d09de31d63b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:24:27.319261 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-49b1aa52-a856-4cda-9dc5-e4aa5f938b77 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 200 len: 1230 microversion: 2.1 time: 0.095305 Mar 12 21:24:27.319858 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4666/5434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:24:27 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:24:28.335833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6438e276-057d-4c2c-a57a-545d754a16d2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:24:28.336534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6438e276-057d-4c2c-a57a-545d754a16d2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: 3d83827c-2370-4722-805c-f08d06cfe228] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:24:28.343286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6438e276-057d-4c2c-a57a-545d754a16d2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:28.343754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6438e276-057d-4c2c-a57a-545d754a16d2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:28.344530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6438e276-057d-4c2c-a57a-545d754a16d2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:28.345011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6438e276-057d-4c2c-a57a-545d754a16d2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:28.359932 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-6438e276-057d-4c2c-a57a-545d754a16d2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance 3d83827c-2370-4722-805c-f08d06cfe228 could not be found. Mar 12 21:24:28.360532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6438e276-057d-4c2c-a57a-545d754a16d2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance 3d83827c-2370-4722-805c-f08d06cfe228 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:24:28.361350 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6438e276-057d-4c2c-a57a-545d754a16d2 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228" status: 404 len: 111 microversion: 2.1 time: 0.029496 Mar 12 21:24:28.361991 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4667/5435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:24:28 2022] GET /compute/v2.1/servers/3d83827c-2370-4722-805c-f08d06cfe228 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:24:28.798205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0c8440b-a86e-48ef-95f7-41048116b9cd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:24:28.798725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b0c8440b-a86e-48ef-95f7-41048116b9cd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:24:28.804688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0c8440b-a86e-48ef-95f7-41048116b9cd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:28.805161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0c8440b-a86e-48ef-95f7-41048116b9cd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:28.805995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0c8440b-a86e-48ef-95f7-41048116b9cd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:28.806454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0c8440b-a86e-48ef-95f7-41048116b9cd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:28.821004 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-b0c8440b-a86e-48ef-95f7-41048116b9cd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance a823fc52-c4a2-438a-8d37-f43139baf443 could not be found. Mar 12 21:24:28.821613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0c8440b-a86e-48ef-95f7-41048116b9cd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance a823fc52-c4a2-438a-8d37-f43139baf443 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:24:28.822694 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0c8440b-a86e-48ef-95f7-41048116b9cd tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 404 len: 111 microversion: 2.1 time: 0.029048 Mar 12 21:24:28.823231 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4668/5436] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:24:28 2022] DELETE /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:24:28.833516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1094c958-b88e-4691-aafc-08f02e6233ea tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:24:28.834298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1094c958-b88e-4691-aafc-08f02e6233ea tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [instance: a823fc52-c4a2-438a-8d37-f43139baf443] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:24:28.840378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1094c958-b88e-4691-aafc-08f02e6233ea tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:28.840859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1094c958-b88e-4691-aafc-08f02e6233ea tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:28.841641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1094c958-b88e-4691-aafc-08f02e6233ea tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:24:28.842155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1094c958-b88e-4691-aafc-08f02e6233ea tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:24:28.856048 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-1094c958-b88e-4691-aafc-08f02e6233ea tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] HTTP exception thrown: Instance a823fc52-c4a2-438a-8d37-f43139baf443 could not be found. Mar 12 21:24:28.856701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1094c958-b88e-4691-aafc-08f02e6233ea tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Returning 404 to user: Instance a823fc52-c4a2-438a-8d37-f43139baf443 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:24:28.857537 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1094c958-b88e-4691-aafc-08f02e6233ea tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443" status: 404 len: 111 microversion: 2.1 time: 0.028209 Mar 12 21:24:28.858119 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4669/5437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:24:28 2022] GET /compute/v2.1/servers/a823fc52-c4a2-438a-8d37-f43139baf443 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:24:30.142849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ca7a087-5cbc-4790-a286-9f8a3b763709 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] Calling method '.version_select at 0x7f6e3552f550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:24:30.149950 ncdv-master-1 devstack@n-api.service[136302]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5ca7a087-5cbc-4790-a286-9f8a3b763709 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [dc2711d0-b970-4e22-a0bc-4f44e34def77] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 12 21:24:31.159659 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [None req-5ca7a087-5cbc-4790-a286-9f8a3b763709 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] [dc2711d0-b970-4e22-a0bc-4f44e34def77] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 55300. Mar 12 21:24:31.180421 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ca7a087-5cbc-4790-a286-9f8a3b763709 tempest-TestVolumeBootPattern-1001263199 tempest-TestVolumeBootPattern-1001263199-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2016371990" status: 202 len: 0 microversion: 2.1 time: 1.041502 Mar 12 21:24:31.180997 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4670/5438] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Mar 12 21:24:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2016371990 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:25:13.138721 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:25:13.139167 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:25:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:25:15.590085 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:25:15.590725 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:25:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:26:25.190814 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:26:25.191300 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 21:26:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 21:26:47.437218 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:26:47.437843 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:26:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:26:56.499701 ncdv-master-1 devstack@n-api.service[136302]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b3a5e23-4d61-4ee0-b93f-1df1716bb266] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 12 21:26:56.501806 ncdv-master-1 devstack@n-api.service[136302]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6333ff2d-0072-4370-9794-f5297b7a2156] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Mar 12 21:26:56.665213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ff7143a8-73c2-47cd-9e2d-45e3ce3c5c0a tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:26:56.665787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ff7143a8-73c2-47cd-9e2d-45e3ce3c5c0a tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:26:56.671798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff7143a8-73c2-47cd-9e2d-45e3ce3c5c0a tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:56.672275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff7143a8-73c2-47cd-9e2d-45e3ce3c5c0a tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:56.673071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff7143a8-73c2-47cd-9e2d-45e3ce3c5c0a tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:56.673531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff7143a8-73c2-47cd-9e2d-45e3ce3c5c0a tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:56.698566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ff7143a8-73c2-47cd-9e2d-45e3ce3c5c0a tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:26:56.773164 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ff7143a8-73c2-47cd-9e2d-45e3ce3c5c0a tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 204 len: 0 microversion: 2.1 time: 0.275275 Mar 12 21:26:56.777373 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4671/5439] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:26:56 2022] DELETE /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:26:56.783023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-82cf5b48-a9a2-452f-809b-a21372624393 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:26:56.783718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-82cf5b48-a9a2-452f-809b-a21372624393 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:26:56.790110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82cf5b48-a9a2-452f-809b-a21372624393 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:56.790577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82cf5b48-a9a2-452f-809b-a21372624393 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:56.791352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82cf5b48-a9a2-452f-809b-a21372624393 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:56.791802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82cf5b48-a9a2-452f-809b-a21372624393 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:56.927225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-82cf5b48-a9a2-452f-809b-a21372624393 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:26:56.935042 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-82cf5b48-a9a2-452f-809b-a21372624393 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1732 microversion: 2.1 time: 0.156262 Mar 12 21:26:56.935613 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4672/5440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:26:56 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:26:57.952960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ba2a1fc-d7ce-4099-b18a-9101b8aa9a02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:26:57.953598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ba2a1fc-d7ce-4099-b18a-9101b8aa9a02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:26:57.969396 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] [6333ff2d-0072-4370-9794-f5297b7a2156] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 55434. Mar 12 21:26:57.973081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ba2a1fc-d7ce-4099-b18a-9101b8aa9a02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:57.973551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ba2a1fc-d7ce-4099-b18a-9101b8aa9a02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:57.974381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ba2a1fc-d7ce-4099-b18a-9101b8aa9a02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:57.974839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ba2a1fc-d7ce-4099-b18a-9101b8aa9a02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:57.980849 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b3a5e23-4d61-4ee0-b93f-1df1716bb266] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 55432. Mar 12 21:26:58.246335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ba2a1fc-d7ce-4099-b18a-9101b8aa9a02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b74beca575bc4580b9cec0669d608395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543574c83c5d4914ac6cc448c29946bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:26:58.253625 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ba2a1fc-d7ce-4099-b18a-9101b8aa9a02 tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 200 len: 1732 microversion: 2.1 time: 0.304639 Mar 12 21:26:58.254257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4673/5441] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:26:57 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 1732 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:26:58.549196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c5b90b33-ee57-48e4-bb84-9e6de4914898 req-54411b3f-a7fe-43b1-938b-99831f0870cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc4fddc-9708-4ba4-b374-4d201202907d", "name": "network-vif-deleted", "tag": "1d7b6291-417b-4373-a31b-8355a20596fa"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:26:58.565813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c5b90b33-ee57-48e4-bb84-9e6de4914898 req-54411b3f-a7fe-43b1-938b-99831f0870cd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:58.567930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c5b90b33-ee57-48e4-bb84-9e6de4914898 req-54411b3f-a7fe-43b1-938b-99831f0870cd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:58.588760 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c5b90b33-ee57-48e4-bb84-9e6de4914898 req-54411b3f-a7fe-43b1-938b-99831f0870cd service nova] Creating event network-vif-deleted:1d7b6291-417b-4373-a31b-8355a20596fa for instance 6fc4fddc-9708-4ba4-b374-4d201202907d on nch1-master-1 Mar 12 21:26:58.595576 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c5b90b33-ee57-48e4-bb84-9e6de4914898 req-54411b3f-a7fe-43b1-938b-99831f0870cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136219 Mar 12 21:26:58.596029 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4674/5442] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:26:59.272443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35f43305-45b2-4ceb-b491-a0bef27fc32b tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:26:59.273185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-35f43305-45b2-4ceb-b491-a0bef27fc32b tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:26:59.279788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35f43305-45b2-4ceb-b491-a0bef27fc32b tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:59.280141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35f43305-45b2-4ceb-b491-a0bef27fc32b tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:59.280967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35f43305-45b2-4ceb-b491-a0bef27fc32b tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:59.281420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35f43305-45b2-4ceb-b491-a0bef27fc32b tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:59.298561 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-35f43305-45b2-4ceb-b491-a0bef27fc32b tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] HTTP exception thrown: Instance 6fc4fddc-9708-4ba4-b374-4d201202907d could not be found. Mar 12 21:26:59.299189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35f43305-45b2-4ceb-b491-a0bef27fc32b tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Returning 404 to user: Instance 6fc4fddc-9708-4ba4-b374-4d201202907d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:26:59.300074 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-35f43305-45b2-4ceb-b491-a0bef27fc32b tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 404 len: 111 microversion: 2.1 time: 0.032848 Mar 12 21:26:59.300638 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4675/5443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:26:59 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:26:59.769785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-909ef26f-b19d-4576-972c-79e4796c21dc tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:26:59.770324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-909ef26f-b19d-4576-972c-79e4796c21dc tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:26:59.776206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-909ef26f-b19d-4576-972c-79e4796c21dc tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:59.776672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-909ef26f-b19d-4576-972c-79e4796c21dc tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:59.777450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-909ef26f-b19d-4576-972c-79e4796c21dc tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:59.777941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-909ef26f-b19d-4576-972c-79e4796c21dc tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:59.791245 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-909ef26f-b19d-4576-972c-79e4796c21dc tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] HTTP exception thrown: Instance 6fc4fddc-9708-4ba4-b374-4d201202907d could not be found. Mar 12 21:26:59.791865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-909ef26f-b19d-4576-972c-79e4796c21dc tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Returning 404 to user: Instance 6fc4fddc-9708-4ba4-b374-4d201202907d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:26:59.792686 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-909ef26f-b19d-4576-972c-79e4796c21dc tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 404 len: 111 microversion: 2.1 time: 0.026873 Mar 12 21:26:59.793216 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4676/5444] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:26:59 2022] DELETE /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:26:59.801123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9cd0089d-4ba7-4d82-bb75-611399cb3dac tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:26:59.801732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9cd0089d-4ba7-4d82-bb75-611399cb3dac tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] [instance: 6fc4fddc-9708-4ba4-b374-4d201202907d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:26:59.807262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cd0089d-4ba7-4d82-bb75-611399cb3dac tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:59.807723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cd0089d-4ba7-4d82-bb75-611399cb3dac tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:59.808490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cd0089d-4ba7-4d82-bb75-611399cb3dac tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:26:59.808946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cd0089d-4ba7-4d82-bb75-611399cb3dac tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:26:59.822289 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9cd0089d-4ba7-4d82-bb75-611399cb3dac tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] HTTP exception thrown: Instance 6fc4fddc-9708-4ba4-b374-4d201202907d could not be found. Mar 12 21:26:59.822873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9cd0089d-4ba7-4d82-bb75-611399cb3dac tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Returning 404 to user: Instance 6fc4fddc-9708-4ba4-b374-4d201202907d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:26:59.823680 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9cd0089d-4ba7-4d82-bb75-611399cb3dac tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d" status: 404 len: 111 microversion: 2.1 time: 0.025959 Mar 12 21:26:59.824197 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4677/5445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:26:59 2022] GET /compute/v2.1/servers/6fc4fddc-9708-4ba4-b374-4d201202907d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:26:59.986901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86433145-977b-40ea-b277-1ec74a92e7ec tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] Calling method '.version_select at 0x7f6e354a05e0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:00.005803 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86433145-977b-40ea-b277-1ec74a92e7ec tempest-TestServerBasicOps-1476885866 tempest-TestServerBasicOps-1476885866-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1150650549" status: 202 len: 0 microversion: 2.1 time: 0.023368 Mar 12 21:27:00.006316 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4678/5446] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Mar 12 21:26:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1150650549 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:27:18.927055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-221078923", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:27:18.977923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] validate_networks() for None {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:27:19.244185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:27:19.244635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:27:19.245131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:27:19.245567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:27:19.246043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:27:19.255208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:19.255676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:19.256495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:19.256950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:19.274385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Getting quotas for project 72445a84d6334a19a8d858db38092121. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:27:19.279649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Getting quotas for user 8463907c90aa45b08e07972b32b04fa2 and project 72445a84d6334a19a8d858db38092121. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:27:19.292556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:27:19.294878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:27:19.340806 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ccc2cb95-e626-4a55-a1e1-24de054ee2a4 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527730 Mar 12 21:27:19.341605 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4679/5447] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:27:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:27:19.352220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ba58ac82-f5f7-4103-b16b-b0d132e32d59 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:19.352855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ba58ac82-f5f7-4103-b16b-b0d132e32d59 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:19.403816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ba58ac82-f5f7-4103-b16b-b0d132e32d59 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463907c90aa45b08e07972b32b04fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72445a84d6334a19a8d858db38092121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:19.411306 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ba58ac82-f5f7-4103-b16b-b0d132e32d59 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 200 len: 1221 microversion: 2.1 time: 0.063099 Mar 12 21:27:19.411887 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4680/5448] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:19 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 1221 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:20.428096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-190a45d6-be66-47c1-8e92-7be0a6d10992 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:20.429443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-190a45d6-be66-47c1-8e92-7be0a6d10992 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:20.436829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-190a45d6-be66-47c1-8e92-7be0a6d10992 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:20.437322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-190a45d6-be66-47c1-8e92-7be0a6d10992 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:20.438346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-190a45d6-be66-47c1-8e92-7be0a6d10992 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:20.439382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-190a45d6-be66-47c1-8e92-7be0a6d10992 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:20.502227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-190a45d6-be66-47c1-8e92-7be0a6d10992 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463907c90aa45b08e07972b32b04fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72445a84d6334a19a8d858db38092121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:20.509605 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-190a45d6-be66-47c1-8e92-7be0a6d10992 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 200 len: 1279 microversion: 2.1 time: 0.085434 Mar 12 21:27:20.510212 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4681/5449] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:20 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:21.527319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-68b8f289-92ba-4613-bcd2-970695951716 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:21.528274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-68b8f289-92ba-4613-bcd2-970695951716 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:21.535535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68b8f289-92ba-4613-bcd2-970695951716 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:21.535946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68b8f289-92ba-4613-bcd2-970695951716 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:21.536857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68b8f289-92ba-4613-bcd2-970695951716 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:21.537320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68b8f289-92ba-4613-bcd2-970695951716 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:21.689313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-68b8f289-92ba-4613-bcd2-970695951716 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463907c90aa45b08e07972b32b04fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72445a84d6334a19a8d858db38092121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:21.696789 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-68b8f289-92ba-4613-bcd2-970695951716 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 200 len: 1321 microversion: 2.1 time: 0.173545 Mar 12 21:27:21.697373 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4682/5450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:21 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:27:21.848509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7d113a2b-6861-4587-bea0-ae54bf28aee6 req-c358b88b-2017-4d4e-a87a-88ef4770fef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e53f6f1-8146-4128-b8c5-30d489328dd0", "tag": "ded24cba-23f4-484f-b827-ef3a6ddbd8e7"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:27:21.860156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7d113a2b-6861-4587-bea0-ae54bf28aee6 req-c358b88b-2017-4d4e-a87a-88ef4770fef0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:21.862226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7d113a2b-6861-4587-bea0-ae54bf28aee6 req-c358b88b-2017-4d4e-a87a-88ef4770fef0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:21.874247 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7d113a2b-6861-4587-bea0-ae54bf28aee6 req-c358b88b-2017-4d4e-a87a-88ef4770fef0 service nova] Creating event network-changed:ded24cba-23f4-484f-b827-ef3a6ddbd8e7 for instance 4e53f6f1-8146-4128-b8c5-30d489328dd0 on nch2-master-1 Mar 12 21:27:21.880214 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7d113a2b-6861-4587-bea0-ae54bf28aee6 req-c358b88b-2017-4d4e-a87a-88ef4770fef0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112858 Mar 12 21:27:21.881024 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4683/5451] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:27:22.715937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c514c7ea-18e4-4c0c-9086-f0a57effced5 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:22.716739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c514c7ea-18e4-4c0c-9086-f0a57effced5 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:22.723224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c514c7ea-18e4-4c0c-9086-f0a57effced5 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:22.723705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c514c7ea-18e4-4c0c-9086-f0a57effced5 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:22.724526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c514c7ea-18e4-4c0c-9086-f0a57effced5 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:22.724990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c514c7ea-18e4-4c0c-9086-f0a57effced5 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:22.856651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c514c7ea-18e4-4c0c-9086-f0a57effced5 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463907c90aa45b08e07972b32b04fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72445a84d6334a19a8d858db38092121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:22.864213 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c514c7ea-18e4-4c0c-9086-f0a57effced5 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 200 len: 1321 microversion: 2.1 time: 0.153816 Mar 12 21:27:22.864791 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4684/5452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:22 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:23.880665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8fef9bca-e933-4a62-b0ce-d6acbf7c31d8 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:23.881299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8fef9bca-e933-4a62-b0ce-d6acbf7c31d8 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:23.888148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fef9bca-e933-4a62-b0ce-d6acbf7c31d8 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:23.888617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fef9bca-e933-4a62-b0ce-d6acbf7c31d8 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:23.889397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fef9bca-e933-4a62-b0ce-d6acbf7c31d8 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:23.889880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fef9bca-e933-4a62-b0ce-d6acbf7c31d8 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:24.028575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8fef9bca-e933-4a62-b0ce-d6acbf7c31d8 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463907c90aa45b08e07972b32b04fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72445a84d6334a19a8d858db38092121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:24.036382 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8fef9bca-e933-4a62-b0ce-d6acbf7c31d8 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 200 len: 1321 microversion: 2.1 time: 0.159817 Mar 12 21:27:24.036963 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4685/5453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:23 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:25.053921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5b98a7b-f416-4e48-88cb-01f6a1c7941a tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:25.054580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f5b98a7b-f416-4e48-88cb-01f6a1c7941a tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:25.061757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5b98a7b-f416-4e48-88cb-01f6a1c7941a tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:25.062250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5b98a7b-f416-4e48-88cb-01f6a1c7941a tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:25.063040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5b98a7b-f416-4e48-88cb-01f6a1c7941a tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:25.063487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5b98a7b-f416-4e48-88cb-01f6a1c7941a tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:25.192157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f5b98a7b-f416-4e48-88cb-01f6a1c7941a tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463907c90aa45b08e07972b32b04fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72445a84d6334a19a8d858db38092121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:25.199381 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5b98a7b-f416-4e48-88cb-01f6a1c7941a tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 200 len: 1321 microversion: 2.1 time: 0.149405 Mar 12 21:27:25.199951 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4686/5454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:25 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:26.216115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3cbb6324-4f88-4c24-a76b-f4a563ee2802 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:26.216749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3cbb6324-4f88-4c24-a76b-f4a563ee2802 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:26.223956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cbb6324-4f88-4c24-a76b-f4a563ee2802 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:26.224429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cbb6324-4f88-4c24-a76b-f4a563ee2802 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:26.225200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cbb6324-4f88-4c24-a76b-f4a563ee2802 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:26.225650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cbb6324-4f88-4c24-a76b-f4a563ee2802 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:26.357923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3cbb6324-4f88-4c24-a76b-f4a563ee2802 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463907c90aa45b08e07972b32b04fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72445a84d6334a19a8d858db38092121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:26.365848 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3cbb6324-4f88-4c24-a76b-f4a563ee2802 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 200 len: 1321 microversion: 2.1 time: 0.153766 Mar 12 21:27:26.366427 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4687/5455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:26 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:27.382599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e033ec7a-1875-45df-b719-ea597758077d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:27.383247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e033ec7a-1875-45df-b719-ea597758077d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:27.390037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e033ec7a-1875-45df-b719-ea597758077d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:27.390515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e033ec7a-1875-45df-b719-ea597758077d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:27.391305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e033ec7a-1875-45df-b719-ea597758077d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:27.391768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e033ec7a-1875-45df-b719-ea597758077d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:27.519979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e033ec7a-1875-45df-b719-ea597758077d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463907c90aa45b08e07972b32b04fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72445a84d6334a19a8d858db38092121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:27.527366 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e033ec7a-1875-45df-b719-ea597758077d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 200 len: 1321 microversion: 2.1 time: 0.148596 Mar 12 21:27:27.528889 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4688/5456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:27 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:27.757564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d9bcf37e-faac-49c9-8cac-d4cd40e574a3 req-b11b3de0-108c-4b42-8025-c17087fd9731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e53f6f1-8146-4128-b8c5-30d489328dd0", "name": "network-vif-plugged", "status": "completed", "tag": "ded24cba-23f4-484f-b827-ef3a6ddbd8e7"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:27:27.767795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d9bcf37e-faac-49c9-8cac-d4cd40e574a3 req-b11b3de0-108c-4b42-8025-c17087fd9731 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:27.768259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d9bcf37e-faac-49c9-8cac-d4cd40e574a3 req-b11b3de0-108c-4b42-8025-c17087fd9731 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:27.778882 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d9bcf37e-faac-49c9-8cac-d4cd40e574a3 req-b11b3de0-108c-4b42-8025-c17087fd9731 service nova] Creating event network-vif-plugged:ded24cba-23f4-484f-b827-ef3a6ddbd8e7 for instance 4e53f6f1-8146-4128-b8c5-30d489328dd0 on nch2-master-1 Mar 12 21:27:27.784484 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d9bcf37e-faac-49c9-8cac-d4cd40e574a3 req-b11b3de0-108c-4b42-8025-c17087fd9731 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091856 Mar 12 21:27:27.785072 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4689/5457] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:27:28.547530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b78a5b93-b2d8-4b2e-b771-fe3993667dc0 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:28.548801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b78a5b93-b2d8-4b2e-b771-fe3993667dc0 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:28.555280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b78a5b93-b2d8-4b2e-b771-fe3993667dc0 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:28.556306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b78a5b93-b2d8-4b2e-b771-fe3993667dc0 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:28.556542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b78a5b93-b2d8-4b2e-b771-fe3993667dc0 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:28.556995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b78a5b93-b2d8-4b2e-b771-fe3993667dc0 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:28.690330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b78a5b93-b2d8-4b2e-b771-fe3993667dc0 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463907c90aa45b08e07972b32b04fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72445a84d6334a19a8d858db38092121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:28.697650 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b78a5b93-b2d8-4b2e-b771-fe3993667dc0 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 200 len: 1321 microversion: 2.1 time: 0.155450 Mar 12 21:27:28.698256 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4690/5458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:28 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:29.714288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ac969009-126b-45d9-9fef-6e7cdf34fa0e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:29.714952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ac969009-126b-45d9-9fef-6e7cdf34fa0e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:29.722197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac969009-126b-45d9-9fef-6e7cdf34fa0e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:29.722664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac969009-126b-45d9-9fef-6e7cdf34fa0e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:29.723449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac969009-126b-45d9-9fef-6e7cdf34fa0e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:29.723907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac969009-126b-45d9-9fef-6e7cdf34fa0e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:29.854727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ac969009-126b-45d9-9fef-6e7cdf34fa0e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463907c90aa45b08e07972b32b04fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72445a84d6334a19a8d858db38092121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:29.862802 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ac969009-126b-45d9-9fef-6e7cdf34fa0e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 200 len: 1471 microversion: 2.1 time: 0.152480 Mar 12 21:27:29.863386 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4691/5459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:29 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:29.930344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33339c86-0030-4160-b176-d90c22fbeca8 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Calling method '.version_select at 0x7f6e355d61f0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:29.996589 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-33339c86-0030-4160-b176-d90c22fbeca8 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/b9748dc6da1f44cf8aceb8457729c5f5" status: 200 len: 371 microversion: 2.1 time: 0.119465 Mar 12 21:27:29.997179 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4692/5460] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Mar 12 21:27:29 2022] GET /compute/v2.1/os-quota-sets/b9748dc6da1f44cf8aceb8457729c5f5 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:27:30.006945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abebbe53-08fa-4844-a8bb-d3f51d3bee3d tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-698110534", "id": 363941234, "os-flavor-access:is_public": "True"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:27:30.008554 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:27:30.008554 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:27:30.023351 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-abebbe53-08fa-4844-a8bb-d3f51d3bee3d tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.019783 Mar 12 21:27:30.023918 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4693/5461] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:27:30 2022] POST /compute/v2.1/flavors => generated 434 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:27:30.034479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "363941234"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:27:30.035413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:30.041058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:30.041522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:30.042327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:30.042780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:30.226501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4954380d1d8041f18a62f91d303428bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9748dc6da1f44cf8aceb8457729c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:30.232913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-698110534 {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 21:27:30.239390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:30.239863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:30.240730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:30.241193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:30.264008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Getting quotas for project 72445a84d6334a19a8d858db38092121. Resources: {'ram', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:27:30.269739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Getting quotas for user 8463907c90aa45b08e07972b32b04fa2 and project 72445a84d6334a19a8d858db38092121. Resources: {'ram', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:27:30.283074 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.api [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] ram quota exceeded for b9748dc6da1f44cf8aceb8457729c5f5, tried to resize instance. Mar 12 21:27:30.283633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Mar 12 21:27:30.284256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:27:30.285122 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd3bbc3c-2247-4ec2-94dc-1db5d1fee080 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0/action" status: 403 len: 118 microversion: 2.1 time: 0.254987 Mar 12 21:27:30.285724 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4694/5462] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:27:30 2022] POST /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0/action => generated 118 bytes in 256 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:27:30.294068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a35804a-9aab-4c5b-9ed0-88236e4856e0 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:30.294839 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:27:30.294839 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:27:30.311572 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a35804a-9aab-4c5b-9ed0-88236e4856e0 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/363941234" status: 202 len: 0 microversion: 2.1 time: 0.020930 Mar 12 21:27:30.312147 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4695/5463] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 21:27:30 2022] DELETE /compute/v2.1/flavors/363941234 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:27:30.320215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34784cbb-ebc4-4888-ac58-e894dc8e41b6 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:30.338751 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34784cbb-ebc4-4888-ac58-e894dc8e41b6 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021913 Mar 12 21:27:30.339316 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4696/5464] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 21:27:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:30.354819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a71ebfd-9d50-43a8-9553-e6b407057376 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Calling method '.version_select at 0x7f6e354da790>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:30.420847 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a71ebfd-9d50-43a8-9553-e6b407057376 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/b9748dc6da1f44cf8aceb8457729c5f5" status: 200 len: 371 microversion: 2.1 time: 0.069340 Mar 12 21:27:30.421430 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4697/5465] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Mar 12 21:27:30 2022] GET /compute/v2.1/os-quota-sets/b9748dc6da1f44cf8aceb8457729c5f5 => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:27:30.431528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-47f15135-8bd1-478b-a33d-b61630c38f2c tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1775191745", "id": 379561248, "os-flavor-access:is_public": "True"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:27:30.433072 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:27:30.433072 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:27:30.447923 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-47f15135-8bd1-478b-a33d-b61630c38f2c tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.019900 Mar 12 21:27:30.448556 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4698/5466] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:27:30 2022] POST /compute/v2.1/flavors => generated 434 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:27:30.459444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "379561248"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:27:30.460392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:30.465996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:30.466463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:30.467241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:30.467693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:30.493746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4954380d1d8041f18a62f91d303428bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9748dc6da1f44cf8aceb8457729c5f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:30.499293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1775191745 {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 21:27:30.506040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:30.506508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:30.507320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:30.507774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:30.527805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Getting quotas for project 72445a84d6334a19a8d858db38092121. Resources: {'ram', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:27:30.532802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Getting quotas for user 8463907c90aa45b08e07972b32b04fa2 and project 72445a84d6334a19a8d858db38092121. Resources: {'ram', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:27:30.544852 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.api [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] cores quota exceeded for b9748dc6da1f44cf8aceb8457729c5f5, tried to resize instance. Mar 12 21:27:30.545399 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Mar 12 21:27:30.546033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:27:30.546885 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5391e99-0df1-4652-9269-f3d3b2899e0b tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0/action" status: 403 len: 113 microversion: 2.1 time: 0.090975 Mar 12 21:27:30.547466 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4699/5467] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:27:30 2022] POST /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0/action => generated 113 bytes in 93 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:27:30.555051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f35e3e5-eb2a-46a9-9a4a-99a3e39a10e2 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:30.555809 ncdv-master-1 devstack@n-api.service[136302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 12 21:27:30.555809 ncdv-master-1 devstack@n-api.service[136302]: warnings.warn(msg) Mar 12 21:27:30.571960 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f35e3e5-eb2a-46a9-9a4a-99a3e39a10e2 tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/379561248" status: 202 len: 0 microversion: 2.1 time: 0.020235 Mar 12 21:27:30.572511 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4700/5468] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Mar 12 21:27:30 2022] DELETE /compute/v2.1/flavors/379561248 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:27:30.580232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4060d130-9ed4-4eb3-94a8-f14a58fed73f tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:30.598093 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4060d130-9ed4-4eb3-94a8-f14a58fed73f tempest-ServersAdminNegativeTestJSON-784393830 tempest-ServersAdminNegativeTestJSON-784393830-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021650 Mar 12 21:27:30.598667 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4701/5469] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Mar 12 21:27:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:30.618979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c44f0bb-358e-4faf-a446-4a48e653646e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:30.619510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c44f0bb-358e-4faf-a446-4a48e653646e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:30.625647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c44f0bb-358e-4faf-a446-4a48e653646e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:30.626153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c44f0bb-358e-4faf-a446-4a48e653646e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:30.627492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c44f0bb-358e-4faf-a446-4a48e653646e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:30.627950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c44f0bb-358e-4faf-a446-4a48e653646e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:30.652016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c44f0bb-358e-4faf-a446-4a48e653646e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:27:30.726456 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c44f0bb-358e-4faf-a446-4a48e653646e tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 204 len: 0 microversion: 2.1 time: 0.114724 Mar 12 21:27:30.727753 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4702/5470] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:27:30 2022] DELETE /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:27:30.736970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3fb19f79-ab10-43e3-ab61-9764e7a0d06d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:30.737687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3fb19f79-ab10-43e3-ab61-9764e7a0d06d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:30.743541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fb19f79-ab10-43e3-ab61-9764e7a0d06d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:30.744063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fb19f79-ab10-43e3-ab61-9764e7a0d06d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:30.744792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fb19f79-ab10-43e3-ab61-9764e7a0d06d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:30.745246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3fb19f79-ab10-43e3-ab61-9764e7a0d06d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:30.879469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3fb19f79-ab10-43e3-ab61-9764e7a0d06d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463907c90aa45b08e07972b32b04fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72445a84d6334a19a8d858db38092121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:30.886968 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3fb19f79-ab10-43e3-ab61-9764e7a0d06d tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 200 len: 1477 microversion: 2.1 time: 0.154472 Mar 12 21:27:30.887553 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4703/5471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:30 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:31.904333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8594e45-1747-47dc-b439-3ac112e31121 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:31.904990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8594e45-1747-47dc-b439-3ac112e31121 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:31.912351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8594e45-1747-47dc-b439-3ac112e31121 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:31.912816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8594e45-1747-47dc-b439-3ac112e31121 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:31.913877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8594e45-1747-47dc-b439-3ac112e31121 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:31.914331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8594e45-1747-47dc-b439-3ac112e31121 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:32.049285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c8594e45-1747-47dc-b439-3ac112e31121 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8463907c90aa45b08e07972b32b04fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72445a84d6334a19a8d858db38092121', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:32.057250 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8594e45-1747-47dc-b439-3ac112e31121 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 200 len: 1477 microversion: 2.1 time: 0.156803 Mar 12 21:27:32.057844 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4704/5472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:31 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:32.425794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-92b3f484-44a3-4e19-b664-172fce7c2cf7 req-49931c8e-1881-41e3-ad9a-fa7b64f37785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e53f6f1-8146-4128-b8c5-30d489328dd0", "name": "network-vif-deleted", "tag": "ded24cba-23f4-484f-b827-ef3a6ddbd8e7"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:27:32.434019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-92b3f484-44a3-4e19-b664-172fce7c2cf7 req-49931c8e-1881-41e3-ad9a-fa7b64f37785 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:32.434594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-92b3f484-44a3-4e19-b664-172fce7c2cf7 req-49931c8e-1881-41e3-ad9a-fa7b64f37785 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:32.448188 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-92b3f484-44a3-4e19-b664-172fce7c2cf7 req-49931c8e-1881-41e3-ad9a-fa7b64f37785 service nova] Creating event network-vif-deleted:ded24cba-23f4-484f-b827-ef3a6ddbd8e7 for instance 4e53f6f1-8146-4128-b8c5-30d489328dd0 on nch2-master-1 Mar 12 21:27:32.455638 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-92b3f484-44a3-4e19-b664-172fce7c2cf7 req-49931c8e-1881-41e3-ad9a-fa7b64f37785 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033660 Mar 12 21:27:32.456313 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4705/5473] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:27:33.075514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94b04bdc-6f57-4f1f-95c9-0c710d7a01d6 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:33.076172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94b04bdc-6f57-4f1f-95c9-0c710d7a01d6 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] [instance: 4e53f6f1-8146-4128-b8c5-30d489328dd0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:33.083919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94b04bdc-6f57-4f1f-95c9-0c710d7a01d6 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:33.084388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94b04bdc-6f57-4f1f-95c9-0c710d7a01d6 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:33.085163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94b04bdc-6f57-4f1f-95c9-0c710d7a01d6 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:33.085615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94b04bdc-6f57-4f1f-95c9-0c710d7a01d6 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:33.099173 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-94b04bdc-6f57-4f1f-95c9-0c710d7a01d6 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] HTTP exception thrown: Instance 4e53f6f1-8146-4128-b8c5-30d489328dd0 could not be found. Mar 12 21:27:33.099771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94b04bdc-6f57-4f1f-95c9-0c710d7a01d6 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] Returning 404 to user: Instance 4e53f6f1-8146-4128-b8c5-30d489328dd0 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:27:33.100623 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94b04bdc-6f57-4f1f-95c9-0c710d7a01d6 tempest-ServersAdminNegativeTestJSON-2003687976 tempest-ServersAdminNegativeTestJSON-2003687976-project] 10.222.0.30 "GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0" status: 404 len: 111 microversion: 2.1 time: 0.029506 Mar 12 21:27:33.101151 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4706/5474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:33 2022] GET /compute/v2.1/servers/4e53f6f1-8146-4128-b8c5-30d489328dd0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:27:35.693289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1870340136", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "41a0a57d-30bb-450f-ab45-97e7481c7629"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:27:35.742954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] validate_networks() for [('41a0a57d-30bb-450f-ab45-97e7481c7629', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:27:36.072078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:27:36.072541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:27:36.073032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:27:36.073456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:27:36.073908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:27:36.083288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:36.083751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:36.084564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:36.085015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:36.101301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Getting quotas for project 8dc1fb023e604f36882c6fe6ad417474. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:27:36.106624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Getting quotas for user f1a722d95edb4a37bf6e754bad95655d and project 8dc1fb023e604f36882c6fe6ad417474. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:27:36.119536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:27:36.121955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:27:36.166600 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8fcfd88f-2ede-4814-bda6-3d540c81e4dd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589694 Mar 12 21:27:36.167381 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4707/5475] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:27:36.177377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2f5002b6-aab8-4504-a8fd-5695bf012ece tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:36.178022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2f5002b6-aab8-4504-a8fd-5695bf012ece tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:36.231660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2f5002b6-aab8-4504-a8fd-5695bf012ece tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:36.238466 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2f5002b6-aab8-4504-a8fd-5695bf012ece tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1215 microversion: 2.1 time: 0.064810 Mar 12 21:27:36.239044 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4708/5476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:36 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:37.255664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1302c296-9c7f-45e3-8fcd-9e2dbebdba50 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:37.256311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1302c296-9c7f-45e3-8fcd-9e2dbebdba50 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:37.263050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1302c296-9c7f-45e3-8fcd-9e2dbebdba50 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:37.263521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1302c296-9c7f-45e3-8fcd-9e2dbebdba50 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:37.264321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1302c296-9c7f-45e3-8fcd-9e2dbebdba50 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:37.264783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1302c296-9c7f-45e3-8fcd-9e2dbebdba50 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:37.325710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1302c296-9c7f-45e3-8fcd-9e2dbebdba50 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:37.334226 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1302c296-9c7f-45e3-8fcd-9e2dbebdba50 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1273 microversion: 2.1 time: 0.082953 Mar 12 21:27:37.334821 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4709/5477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:37 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:38.247338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-299494a3-68c2-4438-925c-fb9d2195b214 req-091e0820-0ad3-4cf2-b9c3-c4b2304d97e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a464dbd-8095-4155-866f-4fb1490928fe", "tag": "aafff24f-788d-449a-84bc-f5216ef29159"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:27:38.257321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-299494a3-68c2-4438-925c-fb9d2195b214 req-091e0820-0ad3-4cf2-b9c3-c4b2304d97e8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:38.258499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-299494a3-68c2-4438-925c-fb9d2195b214 req-091e0820-0ad3-4cf2-b9c3-c4b2304d97e8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:38.272995 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-299494a3-68c2-4438-925c-fb9d2195b214 req-091e0820-0ad3-4cf2-b9c3-c4b2304d97e8 service nova] Creating event network-changed:aafff24f-788d-449a-84bc-f5216ef29159 for instance 9a464dbd-8095-4155-866f-4fb1490928fe on nch2-master-1 Mar 12 21:27:38.278005 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-299494a3-68c2-4438-925c-fb9d2195b214 req-091e0820-0ad3-4cf2-b9c3-c4b2304d97e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034488 Mar 12 21:27:38.278700 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4710/5478] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:27:38.352433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2072e2c1-6714-430f-ade8-832aab85962c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:38.353276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2072e2c1-6714-430f-ade8-832aab85962c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:38.359671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2072e2c1-6714-430f-ade8-832aab85962c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:38.360141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2072e2c1-6714-430f-ade8-832aab85962c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:38.360928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2072e2c1-6714-430f-ade8-832aab85962c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:38.361386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2072e2c1-6714-430f-ade8-832aab85962c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:38.498053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2072e2c1-6714-430f-ade8-832aab85962c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:38.506215 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2072e2c1-6714-430f-ade8-832aab85962c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1315 microversion: 2.1 time: 0.157917 Mar 12 21:27:38.506805 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4711/5479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:38 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:39.523153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-689e5edd-54a1-46c2-88f4-eeae29b167f5 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:39.523826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-689e5edd-54a1-46c2-88f4-eeae29b167f5 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:39.530497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-689e5edd-54a1-46c2-88f4-eeae29b167f5 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:39.530971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-689e5edd-54a1-46c2-88f4-eeae29b167f5 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:39.531750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-689e5edd-54a1-46c2-88f4-eeae29b167f5 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:39.532208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-689e5edd-54a1-46c2-88f4-eeae29b167f5 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:39.661011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-689e5edd-54a1-46c2-88f4-eeae29b167f5 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:39.668600 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-689e5edd-54a1-46c2-88f4-eeae29b167f5 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1315 microversion: 2.1 time: 0.149951 Mar 12 21:27:39.669178 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4712/5480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:39 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:40.685447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e98367e6-560e-49aa-ab59-6c95cbc46ffb tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:40.686125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e98367e6-560e-49aa-ab59-6c95cbc46ffb tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:40.693516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e98367e6-560e-49aa-ab59-6c95cbc46ffb tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:40.694020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e98367e6-560e-49aa-ab59-6c95cbc46ffb tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:40.694808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e98367e6-560e-49aa-ab59-6c95cbc46ffb tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:40.695263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e98367e6-560e-49aa-ab59-6c95cbc46ffb tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:40.827293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e98367e6-560e-49aa-ab59-6c95cbc46ffb tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:40.835411 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e98367e6-560e-49aa-ab59-6c95cbc46ffb tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1315 microversion: 2.1 time: 0.153816 Mar 12 21:27:40.835994 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4713/5481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:40 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:41.852899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6d61d96b-2dd8-48d5-a3a6-fc35fd971f7d tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:41.853499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6d61d96b-2dd8-48d5-a3a6-fc35fd971f7d tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:41.860515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d61d96b-2dd8-48d5-a3a6-fc35fd971f7d tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:41.860867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d61d96b-2dd8-48d5-a3a6-fc35fd971f7d tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:41.861661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d61d96b-2dd8-48d5-a3a6-fc35fd971f7d tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:41.862147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d61d96b-2dd8-48d5-a3a6-fc35fd971f7d tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:41.995270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6d61d96b-2dd8-48d5-a3a6-fc35fd971f7d tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:42.002719 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6d61d96b-2dd8-48d5-a3a6-fc35fd971f7d tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1315 microversion: 2.1 time: 0.153903 Mar 12 21:27:42.003294 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4714/5482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:41 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:43.020445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1d0fc3c8-70fc-409b-84f7-80af97ee0ec0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:43.021111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1d0fc3c8-70fc-409b-84f7-80af97ee0ec0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:43.027976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d0fc3c8-70fc-409b-84f7-80af97ee0ec0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:43.028449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d0fc3c8-70fc-409b-84f7-80af97ee0ec0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:43.029262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d0fc3c8-70fc-409b-84f7-80af97ee0ec0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:43.029719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d0fc3c8-70fc-409b-84f7-80af97ee0ec0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:43.159242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1d0fc3c8-70fc-409b-84f7-80af97ee0ec0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:43.166928 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1d0fc3c8-70fc-409b-84f7-80af97ee0ec0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1315 microversion: 2.1 time: 0.151196 Mar 12 21:27:43.167504 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4715/5483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:43 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:43.862275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3e92fbd1-8068-4004-8384-2aea611f07e7 req-60673873-43c1-464e-8f8f-d40b7d94b396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a464dbd-8095-4155-866f-4fb1490928fe", "name": "network-vif-plugged", "status": "completed", "tag": "aafff24f-788d-449a-84bc-f5216ef29159"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:27:43.871237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3e92fbd1-8068-4004-8384-2aea611f07e7 req-60673873-43c1-464e-8f8f-d40b7d94b396 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:43.871765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3e92fbd1-8068-4004-8384-2aea611f07e7 req-60673873-43c1-464e-8f8f-d40b7d94b396 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:43.882790 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3e92fbd1-8068-4004-8384-2aea611f07e7 req-60673873-43c1-464e-8f8f-d40b7d94b396 service nova] Creating event network-vif-plugged:aafff24f-788d-449a-84bc-f5216ef29159 for instance 9a464dbd-8095-4155-866f-4fb1490928fe on nch2-master-1 Mar 12 21:27:43.887554 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3e92fbd1-8068-4004-8384-2aea611f07e7 req-60673873-43c1-464e-8f8f-d40b7d94b396 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029064 Mar 12 21:27:43.888147 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4716/5484] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:27:44.184365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e498406b-e18a-4c34-a414-e50e69bb1523 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:44.184992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e498406b-e18a-4c34-a414-e50e69bb1523 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:44.191962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e498406b-e18a-4c34-a414-e50e69bb1523 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:44.192478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e498406b-e18a-4c34-a414-e50e69bb1523 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:44.193262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e498406b-e18a-4c34-a414-e50e69bb1523 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:44.193715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e498406b-e18a-4c34-a414-e50e69bb1523 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:44.333714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e498406b-e18a-4c34-a414-e50e69bb1523 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:44.341047 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e498406b-e18a-4c34-a414-e50e69bb1523 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1315 microversion: 2.1 time: 0.161816 Mar 12 21:27:44.341626 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4717/5485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:44 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:45.357689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d2dbc121-9aa2-42ff-9c18-a3a95186dcc3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:45.358386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d2dbc121-9aa2-42ff-9c18-a3a95186dcc3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:45.365168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2dbc121-9aa2-42ff-9c18-a3a95186dcc3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:45.365644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2dbc121-9aa2-42ff-9c18-a3a95186dcc3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:45.366462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2dbc121-9aa2-42ff-9c18-a3a95186dcc3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:45.366922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d2dbc121-9aa2-42ff-9c18-a3a95186dcc3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:45.497395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d2dbc121-9aa2-42ff-9c18-a3a95186dcc3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:45.505355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d2dbc121-9aa2-42ff-9c18-a3a95186dcc3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1503 microversion: 2.1 time: 0.151485 Mar 12 21:27:45.506005 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4718/5486] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:45 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:45.522033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:27:45.523012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:45.529248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:45.529731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:45.530600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:45.531063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:45.561426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:45.568964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Old instance type m1.heat2, new instance type m1.heat {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 21:27:45.575177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:27:45.575612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:27:45.576100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:27:45.576521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:27:45.576946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:27:45.637324 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-854d3689-80df-40a5-902f-9ab872ef7dbf tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "POST /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe/action" status: 202 len: 0 microversion: 2.1 time: 0.119767 Mar 12 21:27:45.638274 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4719/5487] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:27:45 2022] POST /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:27:45.645755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e0763610-a741-4946-8139-3f85774d6042 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:45.646448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e0763610-a741-4946-8139-3f85774d6042 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:45.652355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0763610-a741-4946-8139-3f85774d6042 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:45.652819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0763610-a741-4946-8139-3f85774d6042 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:45.653607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0763610-a741-4946-8139-3f85774d6042 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:45.654080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0763610-a741-4946-8139-3f85774d6042 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:45.791902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e0763610-a741-4946-8139-3f85774d6042 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:45.799894 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e0763610-a741-4946-8139-3f85774d6042 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1512 microversion: 2.1 time: 0.157836 Mar 12 21:27:45.800476 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4720/5488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:45 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:46.817668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c4e2a1b6-0422-4c11-bd61-6d288a44a049 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:46.818348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c4e2a1b6-0422-4c11-bd61-6d288a44a049 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:46.825052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4e2a1b6-0422-4c11-bd61-6d288a44a049 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:46.825518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4e2a1b6-0422-4c11-bd61-6d288a44a049 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:46.826315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4e2a1b6-0422-4c11-bd61-6d288a44a049 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:46.826833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c4e2a1b6-0422-4c11-bd61-6d288a44a049 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:46.961742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c4e2a1b6-0422-4c11-bd61-6d288a44a049 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:46.970377 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c4e2a1b6-0422-4c11-bd61-6d288a44a049 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1512 microversion: 2.1 time: 0.156230 Mar 12 21:27:46.971032 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4721/5489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:46 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:47.988115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-189a0ea9-6a7a-4fa8-84bb-29d25248fdd2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:47.988780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-189a0ea9-6a7a-4fa8-84bb-29d25248fdd2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:47.995493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-189a0ea9-6a7a-4fa8-84bb-29d25248fdd2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:47.995959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-189a0ea9-6a7a-4fa8-84bb-29d25248fdd2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:47.996732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-189a0ea9-6a7a-4fa8-84bb-29d25248fdd2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:47.997183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-189a0ea9-6a7a-4fa8-84bb-29d25248fdd2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:48.135928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-189a0ea9-6a7a-4fa8-84bb-29d25248fdd2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:48.143239 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-189a0ea9-6a7a-4fa8-84bb-29d25248fdd2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.159029 Mar 12 21:27:48.143815 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4722/5490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:47 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:49.162312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ed51aa5-77e6-4cc5-a3f5-0227fdaeb267 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:49.162943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8ed51aa5-77e6-4cc5-a3f5-0227fdaeb267 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:49.169970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ed51aa5-77e6-4cc5-a3f5-0227fdaeb267 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:49.170435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ed51aa5-77e6-4cc5-a3f5-0227fdaeb267 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:49.171207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ed51aa5-77e6-4cc5-a3f5-0227fdaeb267 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:49.171657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ed51aa5-77e6-4cc5-a3f5-0227fdaeb267 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:49.303029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ed51aa5-77e6-4cc5-a3f5-0227fdaeb267 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:49.310248 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ed51aa5-77e6-4cc5-a3f5-0227fdaeb267 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.152444 Mar 12 21:27:49.310817 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4723/5491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:49 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:50.327191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-922664ec-9a04-436b-adc4-781e269ac66f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:50.327882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-922664ec-9a04-436b-adc4-781e269ac66f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:50.334651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-922664ec-9a04-436b-adc4-781e269ac66f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:50.335120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-922664ec-9a04-436b-adc4-781e269ac66f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:50.335899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-922664ec-9a04-436b-adc4-781e269ac66f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:50.336353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-922664ec-9a04-436b-adc4-781e269ac66f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:50.466325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-922664ec-9a04-436b-adc4-781e269ac66f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:50.474209 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-922664ec-9a04-436b-adc4-781e269ac66f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.150309 Mar 12 21:27:50.474791 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4724/5492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:50 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:51.491363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27957e02-10d7-41c4-9d19-83ae908f2efd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:51.491990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27957e02-10d7-41c4-9d19-83ae908f2efd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:51.498867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27957e02-10d7-41c4-9d19-83ae908f2efd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:51.499338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27957e02-10d7-41c4-9d19-83ae908f2efd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:51.500129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27957e02-10d7-41c4-9d19-83ae908f2efd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:51.500588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27957e02-10d7-41c4-9d19-83ae908f2efd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:51.639536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27957e02-10d7-41c4-9d19-83ae908f2efd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:51.646942 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27957e02-10d7-41c4-9d19-83ae908f2efd tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.159523 Mar 12 21:27:51.647520 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4725/5493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:51 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:52.664912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e4e2d9a4-4471-4d2a-9695-4ad59d70a340 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:52.665556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e4e2d9a4-4471-4d2a-9695-4ad59d70a340 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:52.672334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4e2d9a4-4471-4d2a-9695-4ad59d70a340 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:52.672808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4e2d9a4-4471-4d2a-9695-4ad59d70a340 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:52.673895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4e2d9a4-4471-4d2a-9695-4ad59d70a340 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:52.674381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4e2d9a4-4471-4d2a-9695-4ad59d70a340 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:52.802168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e4e2d9a4-4471-4d2a-9695-4ad59d70a340 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:52.809483 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e4e2d9a4-4471-4d2a-9695-4ad59d70a340 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.149359 Mar 12 21:27:52.810092 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4726/5494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:52 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:53.826944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9862e82-7563-4fd3-89e1-650b7b272881 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:53.827631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9862e82-7563-4fd3-89e1-650b7b272881 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:53.834948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9862e82-7563-4fd3-89e1-650b7b272881 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:53.835409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9862e82-7563-4fd3-89e1-650b7b272881 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:53.836206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9862e82-7563-4fd3-89e1-650b7b272881 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:53.836653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9862e82-7563-4fd3-89e1-650b7b272881 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:53.975191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f9862e82-7563-4fd3-89e1-650b7b272881 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:53.982704 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9862e82-7563-4fd3-89e1-650b7b272881 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.159629 Mar 12 21:27:53.991618 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4727/5495] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:53 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:54.999597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dcef2e2c-1036-4264-b830-c737e6723b8c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:55.000268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dcef2e2c-1036-4264-b830-c737e6723b8c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:55.007072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcef2e2c-1036-4264-b830-c737e6723b8c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:55.007535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcef2e2c-1036-4264-b830-c737e6723b8c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:55.008305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcef2e2c-1036-4264-b830-c737e6723b8c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:55.008759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcef2e2c-1036-4264-b830-c737e6723b8c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:55.136810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dcef2e2c-1036-4264-b830-c737e6723b8c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:55.144061 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dcef2e2c-1036-4264-b830-c737e6723b8c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.148383 Mar 12 21:27:55.144628 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4728/5496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:54 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:56.162539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7ad5b05-109b-4fcc-9625-036c44f20494 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:56.163162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a7ad5b05-109b-4fcc-9625-036c44f20494 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:56.170133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7ad5b05-109b-4fcc-9625-036c44f20494 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:56.170602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7ad5b05-109b-4fcc-9625-036c44f20494 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:56.171403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7ad5b05-109b-4fcc-9625-036c44f20494 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:56.171853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7ad5b05-109b-4fcc-9625-036c44f20494 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:56.304591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a7ad5b05-109b-4fcc-9625-036c44f20494 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:56.311861 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7ad5b05-109b-4fcc-9625-036c44f20494 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.153929 Mar 12 21:27:56.312448 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4729/5497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:56 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:57.329411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c5b4c35-704c-410e-a640-69c19245853f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:57.330059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c5b4c35-704c-410e-a640-69c19245853f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:57.337302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c5b4c35-704c-410e-a640-69c19245853f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:57.337760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c5b4c35-704c-410e-a640-69c19245853f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:57.338560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c5b4c35-704c-410e-a640-69c19245853f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:57.339004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c5b4c35-704c-410e-a640-69c19245853f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:57.741661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4c5b4c35-704c-410e-a640-69c19245853f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:57.748997 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4c5b4c35-704c-410e-a640-69c19245853f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.423451 Mar 12 21:27:57.749576 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4730/5498] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:57 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:58.766224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf4f4503-ce83-4192-a789-2b41fd849f0f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:58.766906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bf4f4503-ce83-4192-a789-2b41fd849f0f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:58.772889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf4f4503-ce83-4192-a789-2b41fd849f0f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:58.773352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf4f4503-ce83-4192-a789-2b41fd849f0f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:58.774162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf4f4503-ce83-4192-a789-2b41fd849f0f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:58.774609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf4f4503-ce83-4192-a789-2b41fd849f0f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:58.905954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bf4f4503-ce83-4192-a789-2b41fd849f0f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:27:58.913238 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bf4f4503-ce83-4192-a789-2b41fd849f0f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.151213 Mar 12 21:27:58.914098 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4731/5499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:58 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:27:59.930156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b38a3490-af4b-461d-9f4e-485c98ef1ec8 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:27:59.930863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b38a3490-af4b-461d-9f4e-485c98ef1ec8 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:27:59.938698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b38a3490-af4b-461d-9f4e-485c98ef1ec8 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:59.939165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b38a3490-af4b-461d-9f4e-485c98ef1ec8 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:27:59.939958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b38a3490-af4b-461d-9f4e-485c98ef1ec8 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:27:59.940414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b38a3490-af4b-461d-9f4e-485c98ef1ec8 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:00.072508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b38a3490-af4b-461d-9f4e-485c98ef1ec8 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:00.079947 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b38a3490-af4b-461d-9f4e-485c98ef1ec8 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.154247 Mar 12 21:28:00.080536 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4732/5500] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:27:59 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:01.097683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-41e7720b-c9fc-4bd6-8953-54a0b0653bd7 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:01.098342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-41e7720b-c9fc-4bd6-8953-54a0b0653bd7 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:01.105577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41e7720b-c9fc-4bd6-8953-54a0b0653bd7 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:01.106086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41e7720b-c9fc-4bd6-8953-54a0b0653bd7 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:01.106862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41e7720b-c9fc-4bd6-8953-54a0b0653bd7 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:01.107317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41e7720b-c9fc-4bd6-8953-54a0b0653bd7 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:01.240695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-41e7720b-c9fc-4bd6-8953-54a0b0653bd7 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:01.249003 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-41e7720b-c9fc-4bd6-8953-54a0b0653bd7 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.155077 Mar 12 21:28:01.249590 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4733/5501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:01 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:02.266303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ac5c8bc7-b5c0-471b-b8c6-e9ef45e838f0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:02.266973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ac5c8bc7-b5c0-471b-b8c6-e9ef45e838f0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:02.276116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac5c8bc7-b5c0-471b-b8c6-e9ef45e838f0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:02.276942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac5c8bc7-b5c0-471b-b8c6-e9ef45e838f0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:02.277985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac5c8bc7-b5c0-471b-b8c6-e9ef45e838f0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:02.278454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ac5c8bc7-b5c0-471b-b8c6-e9ef45e838f0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:02.412094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ac5c8bc7-b5c0-471b-b8c6-e9ef45e838f0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:02.419730 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ac5c8bc7-b5c0-471b-b8c6-e9ef45e838f0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.157452 Mar 12 21:28:02.420344 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4734/5502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:02 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:03.436110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9e15679-6137-4b99-a84c-ab802628df3e tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:03.436783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9e15679-6137-4b99-a84c-ab802628df3e tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:03.444033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9e15679-6137-4b99-a84c-ab802628df3e tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:03.444496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9e15679-6137-4b99-a84c-ab802628df3e tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:03.445275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9e15679-6137-4b99-a84c-ab802628df3e tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:03.445719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9e15679-6137-4b99-a84c-ab802628df3e tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:03.582117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9e15679-6137-4b99-a84c-ab802628df3e tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:03.589420 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9e15679-6137-4b99-a84c-ab802628df3e tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.157208 Mar 12 21:28:03.590037 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4735/5503] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:03 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:04.606842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-32ad0415-93b5-4e24-9b3b-51b2a03c403f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:04.607526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-32ad0415-93b5-4e24-9b3b-51b2a03c403f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:04.614194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32ad0415-93b5-4e24-9b3b-51b2a03c403f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:04.614662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32ad0415-93b5-4e24-9b3b-51b2a03c403f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:04.615501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32ad0415-93b5-4e24-9b3b-51b2a03c403f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:04.615990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32ad0415-93b5-4e24-9b3b-51b2a03c403f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:04.749607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-32ad0415-93b5-4e24-9b3b-51b2a03c403f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:04.757842 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-32ad0415-93b5-4e24-9b3b-51b2a03c403f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.154959 Mar 12 21:28:04.758455 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4736/5504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:04 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:05.775829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-109f055b-0948-494f-8bd2-bb58b5d9810f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:05.776503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-109f055b-0948-494f-8bd2-bb58b5d9810f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:05.783529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-109f055b-0948-494f-8bd2-bb58b5d9810f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:05.783993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-109f055b-0948-494f-8bd2-bb58b5d9810f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:05.784767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-109f055b-0948-494f-8bd2-bb58b5d9810f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:05.785217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-109f055b-0948-494f-8bd2-bb58b5d9810f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:05.917307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-109f055b-0948-494f-8bd2-bb58b5d9810f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:05.924682 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-109f055b-0948-494f-8bd2-bb58b5d9810f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.153368 Mar 12 21:28:05.925243 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4737/5505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:05 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:06.942160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37c129f3-9cd2-402f-909d-8f821f83e0e9 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:06.942801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-37c129f3-9cd2-402f-909d-8f821f83e0e9 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:06.949505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37c129f3-9cd2-402f-909d-8f821f83e0e9 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:06.950008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37c129f3-9cd2-402f-909d-8f821f83e0e9 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:06.950780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37c129f3-9cd2-402f-909d-8f821f83e0e9 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:06.951229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37c129f3-9cd2-402f-909d-8f821f83e0e9 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:07.081739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-37c129f3-9cd2-402f-909d-8f821f83e0e9 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:07.089677 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-37c129f3-9cd2-402f-909d-8f821f83e0e9 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.151497 Mar 12 21:28:07.090283 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4738/5506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:06 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:08.106829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4db66693-0ab0-41ab-ba5b-4feca8ae0a85 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:08.107494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4db66693-0ab0-41ab-ba5b-4feca8ae0a85 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:08.114270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4db66693-0ab0-41ab-ba5b-4feca8ae0a85 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:08.114682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4db66693-0ab0-41ab-ba5b-4feca8ae0a85 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:08.115498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4db66693-0ab0-41ab-ba5b-4feca8ae0a85 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:08.115945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4db66693-0ab0-41ab-ba5b-4feca8ae0a85 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:08.248769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4db66693-0ab0-41ab-ba5b-4feca8ae0a85 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:08.256110 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4db66693-0ab0-41ab-ba5b-4feca8ae0a85 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.153199 Mar 12 21:28:08.256684 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4739/5507] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:08 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:09.272728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cdb678d2-6411-4693-9767-87c41880cc9f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:09.273400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cdb678d2-6411-4693-9767-87c41880cc9f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:09.280128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdb678d2-6411-4693-9767-87c41880cc9f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:09.280592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdb678d2-6411-4693-9767-87c41880cc9f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:09.281367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdb678d2-6411-4693-9767-87c41880cc9f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:09.281839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cdb678d2-6411-4693-9767-87c41880cc9f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:09.411002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cdb678d2-6411-4693-9767-87c41880cc9f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:09.419206 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cdb678d2-6411-4693-9767-87c41880cc9f tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.150429 Mar 12 21:28:09.419775 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4740/5508] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:09 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:10.436534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-89c4b4f0-29ed-43c9-8b16-1992d4c55f46 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:10.437225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89c4b4f0-29ed-43c9-8b16-1992d4c55f46 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:10.444656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89c4b4f0-29ed-43c9-8b16-1992d4c55f46 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:10.445134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89c4b4f0-29ed-43c9-8b16-1992d4c55f46 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:10.445953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89c4b4f0-29ed-43c9-8b16-1992d4c55f46 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:10.446413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89c4b4f0-29ed-43c9-8b16-1992d4c55f46 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:10.582944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-89c4b4f0-29ed-43c9-8b16-1992d4c55f46 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:10.590349 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-89c4b4f0-29ed-43c9-8b16-1992d4c55f46 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.157849 Mar 12 21:28:10.590926 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4741/5509] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:10 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:11.607374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2a86cf52-a123-416b-9499-39e0c4dbe823 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:11.608044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2a86cf52-a123-416b-9499-39e0c4dbe823 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:11.614870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a86cf52-a123-416b-9499-39e0c4dbe823 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:11.615345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a86cf52-a123-416b-9499-39e0c4dbe823 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:11.616138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a86cf52-a123-416b-9499-39e0c4dbe823 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:11.616599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a86cf52-a123-416b-9499-39e0c4dbe823 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:11.749662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2a86cf52-a123-416b-9499-39e0c4dbe823 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:11.757676 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2a86cf52-a123-416b-9499-39e0c4dbe823 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.154236 Mar 12 21:28:11.758287 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4742/5510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:11 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:12.775148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3850dc18-cc32-4b27-8b88-bbe60d6baf2c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:12.775777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3850dc18-cc32-4b27-8b88-bbe60d6baf2c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:12.782656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3850dc18-cc32-4b27-8b88-bbe60d6baf2c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:12.783130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3850dc18-cc32-4b27-8b88-bbe60d6baf2c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:12.783923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3850dc18-cc32-4b27-8b88-bbe60d6baf2c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:12.784385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3850dc18-cc32-4b27-8b88-bbe60d6baf2c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:12.923579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3850dc18-cc32-4b27-8b88-bbe60d6baf2c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:12.931076 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3850dc18-cc32-4b27-8b88-bbe60d6baf2c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.160440 Mar 12 21:28:12.931666 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4743/5511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:12 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:13.948877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-017e76f2-758a-42f3-88af-5a74aa1ea35c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:13.949536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-017e76f2-758a-42f3-88af-5a74aa1ea35c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:13.956292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-017e76f2-758a-42f3-88af-5a74aa1ea35c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:13.956764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-017e76f2-758a-42f3-88af-5a74aa1ea35c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:13.957547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-017e76f2-758a-42f3-88af-5a74aa1ea35c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:13.958042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-017e76f2-758a-42f3-88af-5a74aa1ea35c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:14.094547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-017e76f2-758a-42f3-88af-5a74aa1ea35c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:14.102182 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-017e76f2-758a-42f3-88af-5a74aa1ea35c tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1517 microversion: 2.1 time: 0.157178 Mar 12 21:28:14.102759 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4744/5512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:13 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:14.791657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f27633b1-169d-4150-baf6-959d9ebdb251 req-40f394ac-2ce8-4b76-8daf-bcc71a0c9a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a464dbd-8095-4155-866f-4fb1490928fe", "name": "network-vif-unplugged", "status": "completed", "tag": "aafff24f-788d-449a-84bc-f5216ef29159"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:28:14.799891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f27633b1-169d-4150-baf6-959d9ebdb251 req-40f394ac-2ce8-4b76-8daf-bcc71a0c9a8e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:14.800401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f27633b1-169d-4150-baf6-959d9ebdb251 req-40f394ac-2ce8-4b76-8daf-bcc71a0c9a8e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:14.813065 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f27633b1-169d-4150-baf6-959d9ebdb251 req-40f394ac-2ce8-4b76-8daf-bcc71a0c9a8e service nova] Creating event network-vif-unplugged:aafff24f-788d-449a-84bc-f5216ef29159 for instance 9a464dbd-8095-4155-866f-4fb1490928fe on nch1-master-1 Mar 12 21:28:14.819172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-f27633b1-169d-4150-baf6-959d9ebdb251 req-40f394ac-2ce8-4b76-8daf-bcc71a0c9a8e service nova] Instance 9a464dbd-8095-4155-866f-4fb1490928fe is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:28:14.834258 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f27633b1-169d-4150-baf6-959d9ebdb251 req-40f394ac-2ce8-4b76-8daf-bcc71a0c9a8e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046522 Mar 12 21:28:14.835064 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4745/5513] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:28:15.120899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5b5646e-983e-465a-afb7-d56a0002c13b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:15.121690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e5b5646e-983e-465a-afb7-d56a0002c13b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:15.127958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5b5646e-983e-465a-afb7-d56a0002c13b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:15.128518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5b5646e-983e-465a-afb7-d56a0002c13b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:15.129367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5b5646e-983e-465a-afb7-d56a0002c13b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:15.129915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5b5646e-983e-465a-afb7-d56a0002c13b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:15.364356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e5b5646e-983e-465a-afb7-d56a0002c13b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:15.371901 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e5b5646e-983e-465a-afb7-d56a0002c13b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1516 microversion: 2.1 time: 0.256463 Mar 12 21:28:15.372394 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4746/5514] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:15 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1516 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:16.388966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25601e93-505c-4247-b2d4-2297f67a1d75 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:16.389643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-25601e93-505c-4247-b2d4-2297f67a1d75 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:16.396877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25601e93-505c-4247-b2d4-2297f67a1d75 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:16.397348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25601e93-505c-4247-b2d4-2297f67a1d75 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:16.398155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25601e93-505c-4247-b2d4-2297f67a1d75 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:16.398623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25601e93-505c-4247-b2d4-2297f67a1d75 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:16.531536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-25601e93-505c-4247-b2d4-2297f67a1d75 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:16.540050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-25601e93-505c-4247-b2d4-2297f67a1d75 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1514 microversion: 2.1 time: 0.155003 Mar 12 21:28:16.540646 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4747/5515] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:16 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:16.850183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-607fb6a4-a96f-45bc-bbf8-fff773ec7aa1 req-b2e4281a-ae09-4417-97b4-00f4a3479836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a464dbd-8095-4155-866f-4fb1490928fe", "tag": "aafff24f-788d-449a-84bc-f5216ef29159"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:28:16.858151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-607fb6a4-a96f-45bc-bbf8-fff773ec7aa1 req-b2e4281a-ae09-4417-97b4-00f4a3479836 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:16.858611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-607fb6a4-a96f-45bc-bbf8-fff773ec7aa1 req-b2e4281a-ae09-4417-97b4-00f4a3479836 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:16.870363 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-607fb6a4-a96f-45bc-bbf8-fff773ec7aa1 req-b2e4281a-ae09-4417-97b4-00f4a3479836 service nova] Creating event network-changed:aafff24f-788d-449a-84bc-f5216ef29159 for instance 9a464dbd-8095-4155-866f-4fb1490928fe on nch1-master-1 Mar 12 21:28:16.875641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-607fb6a4-a96f-45bc-bbf8-fff773ec7aa1 req-b2e4281a-ae09-4417-97b4-00f4a3479836 service nova] Instance 9a464dbd-8095-4155-866f-4fb1490928fe is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:28:16.887076 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-607fb6a4-a96f-45bc-bbf8-fff773ec7aa1 req-b2e4281a-ae09-4417-97b4-00f4a3479836 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040504 Mar 12 21:28:16.887675 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4748/5516] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:28:17.558355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-21d0cddf-f15a-4762-bbfd-1b0fb85f0f0b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:17.559158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-21d0cddf-f15a-4762-bbfd-1b0fb85f0f0b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:17.566123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21d0cddf-f15a-4762-bbfd-1b0fb85f0f0b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:17.566586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21d0cddf-f15a-4762-bbfd-1b0fb85f0f0b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:17.567370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21d0cddf-f15a-4762-bbfd-1b0fb85f0f0b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:17.567821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-21d0cddf-f15a-4762-bbfd-1b0fb85f0f0b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:17.708079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-21d0cddf-f15a-4762-bbfd-1b0fb85f0f0b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:17.715705 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-21d0cddf-f15a-4762-bbfd-1b0fb85f0f0b tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1514 microversion: 2.1 time: 0.162161 Mar 12 21:28:17.716291 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4749/5517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:17 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:18.732516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4e17e62a-40d5-4633-8a3a-6f36796b7ec6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:18.733187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4e17e62a-40d5-4633-8a3a-6f36796b7ec6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:18.739817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e17e62a-40d5-4633-8a3a-6f36796b7ec6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:18.740968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e17e62a-40d5-4633-8a3a-6f36796b7ec6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:18.742236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e17e62a-40d5-4633-8a3a-6f36796b7ec6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:18.742912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e17e62a-40d5-4633-8a3a-6f36796b7ec6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:18.889112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4e17e62a-40d5-4633-8a3a-6f36796b7ec6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:18.896652 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4e17e62a-40d5-4633-8a3a-6f36796b7ec6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1511 microversion: 2.1 time: 0.167967 Mar 12 21:28:18.897233 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4750/5518] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:18 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:18.912501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-151fc9ac-563e-4da8-9c1d-5fecd87e9cf0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:18.913049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-151fc9ac-563e-4da8-9c1d-5fecd87e9cf0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:18.918903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-151fc9ac-563e-4da8-9c1d-5fecd87e9cf0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:18.919366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-151fc9ac-563e-4da8-9c1d-5fecd87e9cf0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:18.920143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-151fc9ac-563e-4da8-9c1d-5fecd87e9cf0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:18.920597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-151fc9ac-563e-4da8-9c1d-5fecd87e9cf0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:18.945905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-151fc9ac-563e-4da8-9c1d-5fecd87e9cf0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:28:18.994289 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.api [None req-151fc9ac-563e-4da8-9c1d-5fecd87e9cf0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Found an unconfirmed migration during delete, id: 16, status: finished Mar 12 21:28:20.306157 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-151fc9ac-563e-4da8-9c1d-5fecd87e9cf0 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 204 len: 0 microversion: 2.1 time: 1.397102 Mar 12 21:28:20.307157 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4751/5519] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:28:18 2022] DELETE /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 0 bytes in 1399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:28:20.319986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f9536fa0-552e-4c9e-93c0-ffe2a0a821d6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:20.320724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f9536fa0-552e-4c9e-93c0-ffe2a0a821d6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:20.328721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9536fa0-552e-4c9e-93c0-ffe2a0a821d6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:20.329191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9536fa0-552e-4c9e-93c0-ffe2a0a821d6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:20.330041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9536fa0-552e-4c9e-93c0-ffe2a0a821d6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:20.330495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f9536fa0-552e-4c9e-93c0-ffe2a0a821d6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:20.464873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f9536fa0-552e-4c9e-93c0-ffe2a0a821d6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:20.472331 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f9536fa0-552e-4c9e-93c0-ffe2a0a821d6 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1503 microversion: 2.1 time: 0.160575 Mar 12 21:28:20.472923 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4752/5520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:20 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:28:21.489873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9cebe61b-a877-4f9e-b3b8-bba9fd7ea896 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:21.491201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9cebe61b-a877-4f9e-b3b8-bba9fd7ea896 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:21.497992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cebe61b-a877-4f9e-b3b8-bba9fd7ea896 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:21.498459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cebe61b-a877-4f9e-b3b8-bba9fd7ea896 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:21.499242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cebe61b-a877-4f9e-b3b8-bba9fd7ea896 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:21.499697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9cebe61b-a877-4f9e-b3b8-bba9fd7ea896 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:21.636790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9cebe61b-a877-4f9e-b3b8-bba9fd7ea896 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1a722d95edb4a37bf6e754bad95655d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc1fb023e604f36882c6fe6ad417474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:21.644295 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9cebe61b-a877-4f9e-b3b8-bba9fd7ea896 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 200 len: 1503 microversion: 2.1 time: 0.158428 Mar 12 21:28:21.644883 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4753/5521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:21 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:21.858371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-be07faa1-dc8a-49e3-9579-a483aadc7160 req-debeb7a0-cd0e-4ff8-95a1-8981bd569507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a464dbd-8095-4155-866f-4fb1490928fe", "name": "network-vif-plugged", "status": "completed", "tag": "aafff24f-788d-449a-84bc-f5216ef29159"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:28:21.865111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-be07faa1-dc8a-49e3-9579-a483aadc7160 req-debeb7a0-cd0e-4ff8-95a1-8981bd569507 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:21.865655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-be07faa1-dc8a-49e3-9579-a483aadc7160 req-debeb7a0-cd0e-4ff8-95a1-8981bd569507 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:21.879514 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-be07faa1-dc8a-49e3-9579-a483aadc7160 req-debeb7a0-cd0e-4ff8-95a1-8981bd569507 service nova] Creating event network-vif-plugged:aafff24f-788d-449a-84bc-f5216ef29159 for instance 9a464dbd-8095-4155-866f-4fb1490928fe on nch1-master-1 Mar 12 21:28:21.884874 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-be07faa1-dc8a-49e3-9579-a483aadc7160 req-debeb7a0-cd0e-4ff8-95a1-8981bd569507 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034835 Mar 12 21:28:21.885865 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4754/5522] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:28:22.176885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-58210587-7505-45c2-be64-89ef3f0888bd req-49ff9245-4859-4484-9521-24fc5dc67e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a464dbd-8095-4155-866f-4fb1490928fe", "name": "network-vif-deleted", "tag": "aafff24f-788d-449a-84bc-f5216ef29159"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:28:22.185801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-58210587-7505-45c2-be64-89ef3f0888bd req-49ff9245-4859-4484-9521-24fc5dc67e44 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:22.186351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-58210587-7505-45c2-be64-89ef3f0888bd req-49ff9245-4859-4484-9521-24fc5dc67e44 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:22.200877 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-58210587-7505-45c2-be64-89ef3f0888bd req-49ff9245-4859-4484-9521-24fc5dc67e44 service nova] Creating event network-vif-deleted:aafff24f-788d-449a-84bc-f5216ef29159 for instance 9a464dbd-8095-4155-866f-4fb1490928fe on nch1-master-1 Mar 12 21:28:22.205506 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-58210587-7505-45c2-be64-89ef3f0888bd req-49ff9245-4859-4484-9521-24fc5dc67e44 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032688 Mar 12 21:28:22.206156 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4755/5523] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:28:22.662886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-19b375c2-ccb9-485f-b7cb-065b8a930d88 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:22.663578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19b375c2-ccb9-485f-b7cb-065b8a930d88 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:22.670078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19b375c2-ccb9-485f-b7cb-065b8a930d88 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:22.670550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19b375c2-ccb9-485f-b7cb-065b8a930d88 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:22.671332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19b375c2-ccb9-485f-b7cb-065b8a930d88 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:22.671877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19b375c2-ccb9-485f-b7cb-065b8a930d88 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:22.685527 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-19b375c2-ccb9-485f-b7cb-065b8a930d88 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] HTTP exception thrown: Instance 9a464dbd-8095-4155-866f-4fb1490928fe could not be found. Mar 12 21:28:22.686159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-19b375c2-ccb9-485f-b7cb-065b8a930d88 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Returning 404 to user: Instance 9a464dbd-8095-4155-866f-4fb1490928fe could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:28:22.686988 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-19b375c2-ccb9-485f-b7cb-065b8a930d88 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 404 len: 111 microversion: 2.1 time: 0.029775 Mar 12 21:28:22.687551 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4756/5524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:22 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:28:22.701913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-05eb8e17-7100-4b6f-bfba-0475c0d058b2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:22.702423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-05eb8e17-7100-4b6f-bfba-0475c0d058b2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:22.708223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05eb8e17-7100-4b6f-bfba-0475c0d058b2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:22.708701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05eb8e17-7100-4b6f-bfba-0475c0d058b2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:22.709693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05eb8e17-7100-4b6f-bfba-0475c0d058b2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:22.710179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-05eb8e17-7100-4b6f-bfba-0475c0d058b2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:22.723003 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-05eb8e17-7100-4b6f-bfba-0475c0d058b2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] HTTP exception thrown: Instance 9a464dbd-8095-4155-866f-4fb1490928fe could not be found. Mar 12 21:28:22.723597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-05eb8e17-7100-4b6f-bfba-0475c0d058b2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Returning 404 to user: Instance 9a464dbd-8095-4155-866f-4fb1490928fe could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:28:22.724425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-05eb8e17-7100-4b6f-bfba-0475c0d058b2 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 404 len: 111 microversion: 2.1 time: 0.026368 Mar 12 21:28:22.725491 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4757/5525] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:28:22 2022] DELETE /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:28:22.732716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0e9e299c-25be-490a-a83e-ee7a3ada4db3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:22.733334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0e9e299c-25be-490a-a83e-ee7a3ada4db3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] [instance: 9a464dbd-8095-4155-866f-4fb1490928fe] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:22.738888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e9e299c-25be-490a-a83e-ee7a3ada4db3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:22.739354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e9e299c-25be-490a-a83e-ee7a3ada4db3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:22.740798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e9e299c-25be-490a-a83e-ee7a3ada4db3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:22.741296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e9e299c-25be-490a-a83e-ee7a3ada4db3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:22.753910 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-0e9e299c-25be-490a-a83e-ee7a3ada4db3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] HTTP exception thrown: Instance 9a464dbd-8095-4155-866f-4fb1490928fe could not be found. Mar 12 21:28:22.754504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0e9e299c-25be-490a-a83e-ee7a3ada4db3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] Returning 404 to user: Instance 9a464dbd-8095-4155-866f-4fb1490928fe could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:28:22.755342 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0e9e299c-25be-490a-a83e-ee7a3ada4db3 tempest-DeleteServersTestJSON-730221061 tempest-DeleteServersTestJSON-730221061-project] 10.222.0.30 "GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe" status: 404 len: 111 microversion: 2.1 time: 0.026024 Mar 12 21:28:22.755906 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4758/5526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:22 2022] GET /compute/v2.1/servers/9a464dbd-8095-4155-866f-4fb1490928fe => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:28:25.119985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-349318584", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "f53cac57-f620-4a89-9f23-54e5aa7d78b3"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:28:25.273786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] validate_networks() for [('f53cac57-f620-4a89-9f23-54e5aa7d78b3', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:28:25.609891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:28:25.610333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:28:25.610820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:28:25.611248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:28:25.611875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:28:25.621115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:25.621570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:25.622414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:25.622864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:25.639593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Getting quotas for project ea2f836d50bd49c5a645811b2485b2a4. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:28:25.644670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Getting quotas for user a02a0271902d4745bd2ffc5de3c0c72b and project ea2f836d50bd49c5a645811b2485b2a4. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:28:25.656536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:28:25.658812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:28:25.701615 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cafc223e-4464-4639-8b52-1655036919cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702207 Mar 12 21:28:25.702289 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4759/5527] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:28:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:28:25.712222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b437e49e-9dd3-43b0-8ed4-4678b35f626e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:25.712930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b437e49e-9dd3-43b0-8ed4-4678b35f626e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:25.765187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b437e49e-9dd3-43b0-8ed4-4678b35f626e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:25.772781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b437e49e-9dd3-43b0-8ed4-4678b35f626e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1217 microversion: 2.1 time: 0.064289 Mar 12 21:28:25.773341 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4760/5528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:25 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:26.788544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-caed46ef-f37c-47ee-8026-4983bcdc6f5e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:26.789510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-caed46ef-f37c-47ee-8026-4983bcdc6f5e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:26.796426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caed46ef-f37c-47ee-8026-4983bcdc6f5e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:26.796895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caed46ef-f37c-47ee-8026-4983bcdc6f5e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:26.797696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caed46ef-f37c-47ee-8026-4983bcdc6f5e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:26.798193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caed46ef-f37c-47ee-8026-4983bcdc6f5e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:26.860116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-caed46ef-f37c-47ee-8026-4983bcdc6f5e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:26.868357 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-caed46ef-f37c-47ee-8026-4983bcdc6f5e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1275 microversion: 2.1 time: 0.083740 Mar 12 21:28:26.868959 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4761/5529] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:26 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:27.797827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-22f496d5-eb30-4700-ac2c-4a6b09e015d7 req-fa17e960-b716-4db8-9cad-ebfe6056ea3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724f8487-047d-458b-bded-a8768b0ca1c0", "tag": "6b0cf3a2-c471-4534-9b50-19752100c82a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:28:27.807588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-22f496d5-eb30-4700-ac2c-4a6b09e015d7 req-fa17e960-b716-4db8-9cad-ebfe6056ea3f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:27.808114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-22f496d5-eb30-4700-ac2c-4a6b09e015d7 req-fa17e960-b716-4db8-9cad-ebfe6056ea3f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:27.820076 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-22f496d5-eb30-4700-ac2c-4a6b09e015d7 req-fa17e960-b716-4db8-9cad-ebfe6056ea3f service nova] Creating event network-changed:6b0cf3a2-c471-4534-9b50-19752100c82a for instance 724f8487-047d-458b-bded-a8768b0ca1c0 on nch2-master-1 Mar 12 21:28:27.824789 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-22f496d5-eb30-4700-ac2c-4a6b09e015d7 req-fa17e960-b716-4db8-9cad-ebfe6056ea3f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030742 Mar 12 21:28:27.825397 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4762/5530] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:28:27.886417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6933ce70-5cdd-43e9-bdb5-ec51be75f70a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:27.887153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6933ce70-5cdd-43e9-bdb5-ec51be75f70a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:27.893650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6933ce70-5cdd-43e9-bdb5-ec51be75f70a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:27.894149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6933ce70-5cdd-43e9-bdb5-ec51be75f70a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:27.894977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6933ce70-5cdd-43e9-bdb5-ec51be75f70a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:27.895438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6933ce70-5cdd-43e9-bdb5-ec51be75f70a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:28.034337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6933ce70-5cdd-43e9-bdb5-ec51be75f70a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:28.042535 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6933ce70-5cdd-43e9-bdb5-ec51be75f70a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1317 microversion: 2.1 time: 0.161349 Mar 12 21:28:28.043115 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4763/5531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:27 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:29.058754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de191fac-64ca-4442-a496-948a382cb276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:29.059389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-de191fac-64ca-4442-a496-948a382cb276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:29.066121 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de191fac-64ca-4442-a496-948a382cb276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:29.066584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de191fac-64ca-4442-a496-948a382cb276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:29.067359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de191fac-64ca-4442-a496-948a382cb276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:29.067806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de191fac-64ca-4442-a496-948a382cb276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:29.202003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-de191fac-64ca-4442-a496-948a382cb276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:29.209476 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de191fac-64ca-4442-a496-948a382cb276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1317 microversion: 2.1 time: 0.154662 Mar 12 21:28:29.210082 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4764/5532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:29 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:30.226345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c34d92a-e905-4575-bdad-14b877bd767f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:30.226985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c34d92a-e905-4575-bdad-14b877bd767f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:30.233688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c34d92a-e905-4575-bdad-14b877bd767f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:30.234190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c34d92a-e905-4575-bdad-14b877bd767f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:30.234974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c34d92a-e905-4575-bdad-14b877bd767f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:30.235430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c34d92a-e905-4575-bdad-14b877bd767f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:30.368117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8c34d92a-e905-4575-bdad-14b877bd767f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:30.375340 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c34d92a-e905-4575-bdad-14b877bd767f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1317 microversion: 2.1 time: 0.153485 Mar 12 21:28:30.375916 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4765/5533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:30 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:31.392133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12994252-bc91-479b-8d94-7fea119fc429 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:31.392761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-12994252-bc91-479b-8d94-7fea119fc429 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:31.400218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12994252-bc91-479b-8d94-7fea119fc429 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:31.400679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12994252-bc91-479b-8d94-7fea119fc429 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:31.401456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12994252-bc91-479b-8d94-7fea119fc429 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:31.401969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12994252-bc91-479b-8d94-7fea119fc429 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:31.536498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-12994252-bc91-479b-8d94-7fea119fc429 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:31.544905 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-12994252-bc91-479b-8d94-7fea119fc429 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1317 microversion: 2.1 time: 0.156694 Mar 12 21:28:31.545525 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4766/5534] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:31 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:32.562060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ee2bcdd-8167-47b4-b0bc-03dcd1da69ba tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:32.562723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ee2bcdd-8167-47b4-b0bc-03dcd1da69ba tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:32.570034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee2bcdd-8167-47b4-b0bc-03dcd1da69ba tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:32.570499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee2bcdd-8167-47b4-b0bc-03dcd1da69ba tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:32.571285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee2bcdd-8167-47b4-b0bc-03dcd1da69ba tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:32.571738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ee2bcdd-8167-47b4-b0bc-03dcd1da69ba tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:32.701334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2ee2bcdd-8167-47b4-b0bc-03dcd1da69ba tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:32.708657 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ee2bcdd-8167-47b4-b0bc-03dcd1da69ba tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1317 microversion: 2.1 time: 0.150654 Mar 12 21:28:32.709886 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4767/5535] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:32 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:33.146763 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:28:33.147326 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:28:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:28:33.726919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1dc9d87d-86fe-4cf5-bbd0-f6a3b6eaad2f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:33.727585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1dc9d87d-86fe-4cf5-bbd0-f6a3b6eaad2f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:33.734309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1dc9d87d-86fe-4cf5-bbd0-f6a3b6eaad2f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:33.734781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1dc9d87d-86fe-4cf5-bbd0-f6a3b6eaad2f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:33.735567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1dc9d87d-86fe-4cf5-bbd0-f6a3b6eaad2f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:33.736024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1dc9d87d-86fe-4cf5-bbd0-f6a3b6eaad2f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:33.869214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1dc9d87d-86fe-4cf5-bbd0-f6a3b6eaad2f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:33.876543 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1dc9d87d-86fe-4cf5-bbd0-f6a3b6eaad2f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1317 microversion: 2.1 time: 0.154213 Mar 12 21:28:33.877129 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4768/5536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:33 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:34.057951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-69c5e4ca-cc33-4e7b-8c7d-30ad9db3a7f0 req-24175e30-8237-4723-b2a5-2f835f59e09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724f8487-047d-458b-bded-a8768b0ca1c0", "name": "network-vif-plugged", "status": "completed", "tag": "6b0cf3a2-c471-4534-9b50-19752100c82a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:28:34.066241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-69c5e4ca-cc33-4e7b-8c7d-30ad9db3a7f0 req-24175e30-8237-4723-b2a5-2f835f59e09e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:34.066711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-69c5e4ca-cc33-4e7b-8c7d-30ad9db3a7f0 req-24175e30-8237-4723-b2a5-2f835f59e09e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:34.078637 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-69c5e4ca-cc33-4e7b-8c7d-30ad9db3a7f0 req-24175e30-8237-4723-b2a5-2f835f59e09e service nova] Creating event network-vif-plugged:6b0cf3a2-c471-4534-9b50-19752100c82a for instance 724f8487-047d-458b-bded-a8768b0ca1c0 on nch2-master-1 Mar 12 21:28:34.083879 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-69c5e4ca-cc33-4e7b-8c7d-30ad9db3a7f0 req-24175e30-8237-4723-b2a5-2f835f59e09e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029704 Mar 12 21:28:34.085276 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4769/5537] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:28:34.893963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3397a0ba-c4e6-4a47-b0b6-47d855e73ac5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:34.894706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3397a0ba-c4e6-4a47-b0b6-47d855e73ac5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:34.901024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3397a0ba-c4e6-4a47-b0b6-47d855e73ac5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:34.901498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3397a0ba-c4e6-4a47-b0b6-47d855e73ac5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:34.902314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3397a0ba-c4e6-4a47-b0b6-47d855e73ac5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:34.902776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3397a0ba-c4e6-4a47-b0b6-47d855e73ac5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:35.038777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3397a0ba-c4e6-4a47-b0b6-47d855e73ac5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:35.046265 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3397a0ba-c4e6-4a47-b0b6-47d855e73ac5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1317 microversion: 2.1 time: 0.157529 Mar 12 21:28:35.046840 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4770/5538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:34 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:35.597587 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:28:35.598201 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:28:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:28:36.062950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1ec103e-292b-4420-af3e-4c8db86ba7d5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:36.063581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a1ec103e-292b-4420-af3e-4c8db86ba7d5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:36.071001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ec103e-292b-4420-af3e-4c8db86ba7d5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.071473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ec103e-292b-4420-af3e-4c8db86ba7d5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.072259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ec103e-292b-4420-af3e-4c8db86ba7d5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.072714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1ec103e-292b-4420-af3e-4c8db86ba7d5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.205971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a1ec103e-292b-4420-af3e-4c8db86ba7d5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:36.214275 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1ec103e-292b-4420-af3e-4c8db86ba7d5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1507 microversion: 2.1 time: 0.155213 Mar 12 21:28:36.214846 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4771/5539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:36 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:36.229556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d8a7bbb8-2a32-4e3d-8a57-8576a9b973b8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:36.230193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d8a7bbb8-2a32-4e3d-8a57-8576a9b973b8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:36.235719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8a7bbb8-2a32-4e3d-8a57-8576a9b973b8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.236181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8a7bbb8-2a32-4e3d-8a57-8576a9b973b8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.236950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8a7bbb8-2a32-4e3d-8a57-8576a9b973b8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.237396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8a7bbb8-2a32-4e3d-8a57-8576a9b973b8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.369113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d8a7bbb8-2a32-4e3d-8a57-8576a9b973b8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:36.377896 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d8a7bbb8-2a32-4e3d-8a57-8576a9b973b8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1507 microversion: 2.1 time: 0.151774 Mar 12 21:28:36.378514 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4772/5540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:36 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:36.393616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-18dce8ae-a2d8-4218-9668-94486dc9cee0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:28:36.394834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-18dce8ae-a2d8-4218-9668-94486dc9cee0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:36.401030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18dce8ae-a2d8-4218-9668-94486dc9cee0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.401503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18dce8ae-a2d8-4218-9668-94486dc9cee0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.402309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18dce8ae-a2d8-4218-9668-94486dc9cee0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.402771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18dce8ae-a2d8-4218-9668-94486dc9cee0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.463126 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-18dce8ae-a2d8-4218-9668-94486dc9cee0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "PUT /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1079 microversion: 2.1 time: 0.072915 Mar 12 21:28:36.463719 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4773/5541] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Mar 12 21:28:36 2022] PUT /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1079 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:36.476822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a06bf723-bb7b-4a3b-935f-3f0e6d8da957 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:36.477440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a06bf723-bb7b-4a3b-935f-3f0e6d8da957 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:36.483440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a06bf723-bb7b-4a3b-935f-3f0e6d8da957 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.483909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a06bf723-bb7b-4a3b-935f-3f0e6d8da957 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.484692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a06bf723-bb7b-4a3b-935f-3f0e6d8da957 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.485147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a06bf723-bb7b-4a3b-935f-3f0e6d8da957 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.617293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a06bf723-bb7b-4a3b-935f-3f0e6d8da957 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:36.624730 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a06bf723-bb7b-4a3b-935f-3f0e6d8da957 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1505 microversion: 2.1 time: 0.151601 Mar 12 21:28:36.625332 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4774/5542] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:36 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:36.640652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f292bc3-8574-4bb8-9922-01bf6b114384 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:36.641302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f292bc3-8574-4bb8-9922-01bf6b114384 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:36.646919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f292bc3-8574-4bb8-9922-01bf6b114384 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.647385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f292bc3-8574-4bb8-9922-01bf6b114384 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.648164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f292bc3-8574-4bb8-9922-01bf6b114384 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.648616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f292bc3-8574-4bb8-9922-01bf6b114384 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.777247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9f292bc3-8574-4bb8-9922-01bf6b114384 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:36.784591 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f292bc3-8574-4bb8-9922-01bf6b114384 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1505 microversion: 2.1 time: 0.147466 Mar 12 21:28:36.785175 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4775/5543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:36 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:36.800664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:28:36.801638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:36.807700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.808164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.808948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.809400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.836636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:36.842490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Old instance type m1.heat2, new instance type m1.heat {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 21:28:36.848633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:28:36.849070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:28:36.849562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:28:36.850010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:28:36.850438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:28:36.912767 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-58bbaf46-7b55-48d3-b82a-7ec7e744aebb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "POST /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0/action" status: 202 len: 0 microversion: 2.1 time: 0.115518 Mar 12 21:28:36.914050 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4776/5544] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:28:36 2022] POST /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:28:36.922271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-579664f8-3e18-456e-8da3-a136dad79ec4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:36.922842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-579664f8-3e18-456e-8da3-a136dad79ec4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:36.928669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-579664f8-3e18-456e-8da3-a136dad79ec4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.929691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-579664f8-3e18-456e-8da3-a136dad79ec4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:36.930516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-579664f8-3e18-456e-8da3-a136dad79ec4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:36.930965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-579664f8-3e18-456e-8da3-a136dad79ec4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:37.071301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-579664f8-3e18-456e-8da3-a136dad79ec4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:37.079258 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-579664f8-3e18-456e-8da3-a136dad79ec4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1516 microversion: 2.1 time: 0.160673 Mar 12 21:28:37.079986 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4777/5545] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:36 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:38.099601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30e7a4f5-4599-49c1-aaa6-e2da55854a9e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:38.101453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-30e7a4f5-4599-49c1-aaa6-e2da55854a9e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:38.109249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30e7a4f5-4599-49c1-aaa6-e2da55854a9e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:38.109714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30e7a4f5-4599-49c1-aaa6-e2da55854a9e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:38.110523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30e7a4f5-4599-49c1-aaa6-e2da55854a9e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:38.110975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30e7a4f5-4599-49c1-aaa6-e2da55854a9e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:38.250609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-30e7a4f5-4599-49c1-aaa6-e2da55854a9e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:38.258142 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30e7a4f5-4599-49c1-aaa6-e2da55854a9e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1516 microversion: 2.1 time: 0.164769 Mar 12 21:28:38.258732 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4778/5546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:38 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:39.275243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-acefe48a-6aa7-47ba-9804-9ed82e636985 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:39.275885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-acefe48a-6aa7-47ba-9804-9ed82e636985 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:39.282623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acefe48a-6aa7-47ba-9804-9ed82e636985 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:39.283084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acefe48a-6aa7-47ba-9804-9ed82e636985 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:39.283856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acefe48a-6aa7-47ba-9804-9ed82e636985 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:39.284307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acefe48a-6aa7-47ba-9804-9ed82e636985 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:39.419917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-acefe48a-6aa7-47ba-9804-9ed82e636985 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:39.427238 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-acefe48a-6aa7-47ba-9804-9ed82e636985 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.155949 Mar 12 21:28:39.427810 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4779/5547] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:39 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:40.445359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4fe8c37c-1f1e-41f2-9525-d795a9e44ead tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:40.446056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4fe8c37c-1f1e-41f2-9525-d795a9e44ead tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:40.452876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fe8c37c-1f1e-41f2-9525-d795a9e44ead tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:40.453351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fe8c37c-1f1e-41f2-9525-d795a9e44ead tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:40.454170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fe8c37c-1f1e-41f2-9525-d795a9e44ead tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:40.454629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fe8c37c-1f1e-41f2-9525-d795a9e44ead tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:40.583233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4fe8c37c-1f1e-41f2-9525-d795a9e44ead tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:40.590665 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4fe8c37c-1f1e-41f2-9525-d795a9e44ead tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.149913 Mar 12 21:28:40.591243 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4780/5548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:40 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:41.607477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-025736ca-a00c-4d1b-a4c6-e2584ead5625 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:41.608118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-025736ca-a00c-4d1b-a4c6-e2584ead5625 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:41.614942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-025736ca-a00c-4d1b-a4c6-e2584ead5625 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:41.615415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-025736ca-a00c-4d1b-a4c6-e2584ead5625 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:41.616204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-025736ca-a00c-4d1b-a4c6-e2584ead5625 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:41.616664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-025736ca-a00c-4d1b-a4c6-e2584ead5625 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:41.749624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-025736ca-a00c-4d1b-a4c6-e2584ead5625 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:41.757667 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-025736ca-a00c-4d1b-a4c6-e2584ead5625 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.153471 Mar 12 21:28:41.758269 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4781/5549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:41 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:42.775147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-860e74a4-d2c8-4156-8a29-e1ba3bb6e48d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:42.775821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-860e74a4-d2c8-4156-8a29-e1ba3bb6e48d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:42.782890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-860e74a4-d2c8-4156-8a29-e1ba3bb6e48d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:42.783360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-860e74a4-d2c8-4156-8a29-e1ba3bb6e48d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:42.784148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-860e74a4-d2c8-4156-8a29-e1ba3bb6e48d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:42.784608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-860e74a4-d2c8-4156-8a29-e1ba3bb6e48d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:42.917456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-860e74a4-d2c8-4156-8a29-e1ba3bb6e48d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:42.924768 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-860e74a4-d2c8-4156-8a29-e1ba3bb6e48d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.154103 Mar 12 21:28:42.925342 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4782/5550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:42 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:43.941779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-556aa191-2649-49bd-9b5a-e82ce43ddc43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:43.942470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-556aa191-2649-49bd-9b5a-e82ce43ddc43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:43.949641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-556aa191-2649-49bd-9b5a-e82ce43ddc43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:43.950143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-556aa191-2649-49bd-9b5a-e82ce43ddc43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:43.950919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-556aa191-2649-49bd-9b5a-e82ce43ddc43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:43.951365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-556aa191-2649-49bd-9b5a-e82ce43ddc43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:44.084961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-556aa191-2649-49bd-9b5a-e82ce43ddc43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:44.092230 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-556aa191-2649-49bd-9b5a-e82ce43ddc43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.154332 Mar 12 21:28:44.092810 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4783/5551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:43 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:28:45.108446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b29679d4-ae78-40d1-80b7-e44e1ce4068a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:45.109114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b29679d4-ae78-40d1-80b7-e44e1ce4068a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:45.115889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b29679d4-ae78-40d1-80b7-e44e1ce4068a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:45.116894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b29679d4-ae78-40d1-80b7-e44e1ce4068a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:45.117672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b29679d4-ae78-40d1-80b7-e44e1ce4068a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:45.118150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b29679d4-ae78-40d1-80b7-e44e1ce4068a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:45.251280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b29679d4-ae78-40d1-80b7-e44e1ce4068a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:45.258638 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b29679d4-ae78-40d1-80b7-e44e1ce4068a tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.154131 Mar 12 21:28:45.259212 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4784/5552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:45 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:46.275753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6d6dc6d1-fb2e-4dcc-ba11-4f7902d88734 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:46.276428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6d6dc6d1-fb2e-4dcc-ba11-4f7902d88734 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:46.283247 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d6dc6d1-fb2e-4dcc-ba11-4f7902d88734 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:46.283708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d6dc6d1-fb2e-4dcc-ba11-4f7902d88734 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:46.284482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d6dc6d1-fb2e-4dcc-ba11-4f7902d88734 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:46.284934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6d6dc6d1-fb2e-4dcc-ba11-4f7902d88734 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:46.416537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6d6dc6d1-fb2e-4dcc-ba11-4f7902d88734 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:46.424023 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6d6dc6d1-fb2e-4dcc-ba11-4f7902d88734 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.152175 Mar 12 21:28:46.424603 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4785/5553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:46 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:47.441636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e1de94cb-e971-4e40-9aa9-4b9aeb66a552 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:47.442304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e1de94cb-e971-4e40-9aa9-4b9aeb66a552 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:47.450004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1de94cb-e971-4e40-9aa9-4b9aeb66a552 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:47.450503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1de94cb-e971-4e40-9aa9-4b9aeb66a552 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:47.451296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1de94cb-e971-4e40-9aa9-4b9aeb66a552 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:47.451745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1de94cb-e971-4e40-9aa9-4b9aeb66a552 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:47.865522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e1de94cb-e971-4e40-9aa9-4b9aeb66a552 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:47.873508 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e1de94cb-e971-4e40-9aa9-4b9aeb66a552 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.435888 Mar 12 21:28:47.874136 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4786/5554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:47 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:48.891078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27874361-e45b-4511-bac3-b927cfcd02ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:48.891715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27874361-e45b-4511-bac3-b927cfcd02ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:48.898623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27874361-e45b-4511-bac3-b927cfcd02ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:48.899114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27874361-e45b-4511-bac3-b927cfcd02ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:48.899898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27874361-e45b-4511-bac3-b927cfcd02ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:48.900370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27874361-e45b-4511-bac3-b927cfcd02ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:49.029040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27874361-e45b-4511-bac3-b927cfcd02ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:49.036486 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27874361-e45b-4511-bac3-b927cfcd02ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.149305 Mar 12 21:28:49.037006 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4787/5555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:48 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:50.054193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf8318de-cfd3-4012-9e43-15371192bfdd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:50.054878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bf8318de-cfd3-4012-9e43-15371192bfdd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:50.062367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf8318de-cfd3-4012-9e43-15371192bfdd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:50.062840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf8318de-cfd3-4012-9e43-15371192bfdd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:50.063644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf8318de-cfd3-4012-9e43-15371192bfdd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:50.064101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf8318de-cfd3-4012-9e43-15371192bfdd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:50.204170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bf8318de-cfd3-4012-9e43-15371192bfdd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:50.212145 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bf8318de-cfd3-4012-9e43-15371192bfdd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.161939 Mar 12 21:28:50.212713 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4788/5556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:50 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:51.229422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-369ffe44-010d-40d0-a6ef-9022296cf582 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:51.230095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-369ffe44-010d-40d0-a6ef-9022296cf582 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:51.236832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-369ffe44-010d-40d0-a6ef-9022296cf582 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:51.237301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-369ffe44-010d-40d0-a6ef-9022296cf582 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:51.238106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-369ffe44-010d-40d0-a6ef-9022296cf582 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:51.238559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-369ffe44-010d-40d0-a6ef-9022296cf582 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:51.375130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-369ffe44-010d-40d0-a6ef-9022296cf582 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:51.382625 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-369ffe44-010d-40d0-a6ef-9022296cf582 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.157686 Mar 12 21:28:51.383207 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4789/5557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:51 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:52.399287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-87ce942b-542d-44d3-b81f-9e96b6f740e0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:52.399957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-87ce942b-542d-44d3-b81f-9e96b6f740e0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:52.406759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87ce942b-542d-44d3-b81f-9e96b6f740e0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:52.407220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87ce942b-542d-44d3-b81f-9e96b6f740e0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:52.407990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87ce942b-542d-44d3-b81f-9e96b6f740e0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:52.408438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87ce942b-542d-44d3-b81f-9e96b6f740e0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:52.540476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-87ce942b-542d-44d3-b81f-9e96b6f740e0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:52.547781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-87ce942b-542d-44d3-b81f-9e96b6f740e0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.152424 Mar 12 21:28:52.548352 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4790/5558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:52 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:53.565899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30bd0b1d-bd59-4377-8bd8-355a211168b1 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:53.566560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-30bd0b1d-bd59-4377-8bd8-355a211168b1 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:53.573791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30bd0b1d-bd59-4377-8bd8-355a211168b1 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:53.574287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30bd0b1d-bd59-4377-8bd8-355a211168b1 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:53.575085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30bd0b1d-bd59-4377-8bd8-355a211168b1 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:53.575538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30bd0b1d-bd59-4377-8bd8-355a211168b1 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:53.707469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-30bd0b1d-bd59-4377-8bd8-355a211168b1 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:53.715517 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30bd0b1d-bd59-4377-8bd8-355a211168b1 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.153670 Mar 12 21:28:53.716099 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4791/5559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:53 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:54.733024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f39a6b98-000c-47ec-bb04-5fed57b70a87 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:54.733697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f39a6b98-000c-47ec-bb04-5fed57b70a87 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:54.740379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f39a6b98-000c-47ec-bb04-5fed57b70a87 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:54.740841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f39a6b98-000c-47ec-bb04-5fed57b70a87 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:54.741610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f39a6b98-000c-47ec-bb04-5fed57b70a87 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:54.742089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f39a6b98-000c-47ec-bb04-5fed57b70a87 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:54.872122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f39a6b98-000c-47ec-bb04-5fed57b70a87 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:54.879437 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f39a6b98-000c-47ec-bb04-5fed57b70a87 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.150316 Mar 12 21:28:54.880031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4792/5560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:54 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:55.896506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f88c02cd-486d-4f4b-b4bd-451aeaa9f15e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:55.897140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f88c02cd-486d-4f4b-b4bd-451aeaa9f15e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:55.904005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f88c02cd-486d-4f4b-b4bd-451aeaa9f15e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:55.904476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f88c02cd-486d-4f4b-b4bd-451aeaa9f15e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:55.905260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f88c02cd-486d-4f4b-b4bd-451aeaa9f15e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:55.905713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f88c02cd-486d-4f4b-b4bd-451aeaa9f15e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:56.040673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f88c02cd-486d-4f4b-b4bd-451aeaa9f15e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:56.048213 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f88c02cd-486d-4f4b-b4bd-451aeaa9f15e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.155568 Mar 12 21:28:56.048806 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4793/5561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:55 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:57.064998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-520baa6f-b1cd-4f8a-b90e-d95a78055021 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:57.065661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-520baa6f-b1cd-4f8a-b90e-d95a78055021 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:57.072988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-520baa6f-b1cd-4f8a-b90e-d95a78055021 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:57.073450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-520baa6f-b1cd-4f8a-b90e-d95a78055021 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:57.074259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-520baa6f-b1cd-4f8a-b90e-d95a78055021 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:57.074704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-520baa6f-b1cd-4f8a-b90e-d95a78055021 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:57.202729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-520baa6f-b1cd-4f8a-b90e-d95a78055021 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:57.209994 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-520baa6f-b1cd-4f8a-b90e-d95a78055021 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.148883 Mar 12 21:28:57.210566 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4794/5562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:57 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:58.226576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c5cbbe2-e6f6-4153-96a1-f861a9a540bf tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:58.227244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c5cbbe2-e6f6-4153-96a1-f861a9a540bf tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:58.233511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c5cbbe2-e6f6-4153-96a1-f861a9a540bf tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:58.234020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c5cbbe2-e6f6-4153-96a1-f861a9a540bf tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:58.234804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c5cbbe2-e6f6-4153-96a1-f861a9a540bf tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:58.235256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c5cbbe2-e6f6-4153-96a1-f861a9a540bf tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:58.367486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4c5cbbe2-e6f6-4153-96a1-f861a9a540bf tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:58.374735 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4c5cbbe2-e6f6-4153-96a1-f861a9a540bf tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.152079 Mar 12 21:28:58.375310 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4795/5563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:58 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:28:59.392425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6fedc2ad-0ea3-4741-a108-7b1ca8fdbb95 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:28:59.393047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6fedc2ad-0ea3-4741-a108-7b1ca8fdbb95 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:28:59.399874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fedc2ad-0ea3-4741-a108-7b1ca8fdbb95 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:59.400347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fedc2ad-0ea3-4741-a108-7b1ca8fdbb95 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:59.401136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fedc2ad-0ea3-4741-a108-7b1ca8fdbb95 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:28:59.401598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6fedc2ad-0ea3-4741-a108-7b1ca8fdbb95 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:28:59.539808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6fedc2ad-0ea3-4741-a108-7b1ca8fdbb95 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:28:59.547388 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6fedc2ad-0ea3-4741-a108-7b1ca8fdbb95 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.158962 Mar 12 21:28:59.547997 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4796/5564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:28:59 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:00.564886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b45e06c-1164-4304-86b8-c107882598f7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:00.565538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b45e06c-1164-4304-86b8-c107882598f7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:00.572901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b45e06c-1164-4304-86b8-c107882598f7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:00.573368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b45e06c-1164-4304-86b8-c107882598f7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:00.574166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b45e06c-1164-4304-86b8-c107882598f7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:00.574621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b45e06c-1164-4304-86b8-c107882598f7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:00.702104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8b45e06c-1164-4304-86b8-c107882598f7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:00.709337 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b45e06c-1164-4304-86b8-c107882598f7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.148313 Mar 12 21:29:00.709936 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4797/5565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:00 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:01.727492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-62b43df8-702b-4e80-be6e-030993337eb0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:01.728701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-62b43df8-702b-4e80-be6e-030993337eb0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:01.737741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62b43df8-702b-4e80-be6e-030993337eb0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:01.738241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62b43df8-702b-4e80-be6e-030993337eb0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:01.739038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62b43df8-702b-4e80-be6e-030993337eb0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:01.739492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-62b43df8-702b-4e80-be6e-030993337eb0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:01.884237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-62b43df8-702b-4e80-be6e-030993337eb0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:01.891539 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-62b43df8-702b-4e80-be6e-030993337eb0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.169125 Mar 12 21:29:01.892115 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4798/5566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:01 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:02.908568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6997aea3-c171-4153-b9f6-2bfcffbb27a0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:02.909209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6997aea3-c171-4153-b9f6-2bfcffbb27a0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:02.916357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6997aea3-c171-4153-b9f6-2bfcffbb27a0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:02.916824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6997aea3-c171-4153-b9f6-2bfcffbb27a0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:02.917601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6997aea3-c171-4153-b9f6-2bfcffbb27a0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:02.918088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6997aea3-c171-4153-b9f6-2bfcffbb27a0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:03.052232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6997aea3-c171-4153-b9f6-2bfcffbb27a0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:03.060197 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6997aea3-c171-4153-b9f6-2bfcffbb27a0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.155568 Mar 12 21:29:03.060772 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4799/5567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:02 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:04.077339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c36abe5d-2231-48a5-9514-903ee9a44162 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:04.078117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c36abe5d-2231-48a5-9514-903ee9a44162 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:04.084838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c36abe5d-2231-48a5-9514-903ee9a44162 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:04.085312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c36abe5d-2231-48a5-9514-903ee9a44162 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:04.086949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c36abe5d-2231-48a5-9514-903ee9a44162 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:04.087413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c36abe5d-2231-48a5-9514-903ee9a44162 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:04.234526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c36abe5d-2231-48a5-9514-903ee9a44162 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:04.241851 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c36abe5d-2231-48a5-9514-903ee9a44162 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.168523 Mar 12 21:29:04.242945 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4800/5568] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:04 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:05.259885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c84fa122-b7d8-461a-8e9b-7fa613ae5d62 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:05.260512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c84fa122-b7d8-461a-8e9b-7fa613ae5d62 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:05.267216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c84fa122-b7d8-461a-8e9b-7fa613ae5d62 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:05.267679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c84fa122-b7d8-461a-8e9b-7fa613ae5d62 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:05.268452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c84fa122-b7d8-461a-8e9b-7fa613ae5d62 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:05.268900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c84fa122-b7d8-461a-8e9b-7fa613ae5d62 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:05.407219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c84fa122-b7d8-461a-8e9b-7fa613ae5d62 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:05.416434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c84fa122-b7d8-461a-8e9b-7fa613ae5d62 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1521 microversion: 2.1 time: 0.160975 Mar 12 21:29:05.417051 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4801/5569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:05 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:05.972015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f11a04f9-ee62-4199-a7fa-abad92bb4daa req-0be6ca75-b4ec-4610-9ca9-a4834d1381cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724f8487-047d-458b-bded-a8768b0ca1c0", "name": "network-vif-unplugged", "status": "completed", "tag": "6b0cf3a2-c471-4534-9b50-19752100c82a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:05.981030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f11a04f9-ee62-4199-a7fa-abad92bb4daa req-0be6ca75-b4ec-4610-9ca9-a4834d1381cf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:05.981596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f11a04f9-ee62-4199-a7fa-abad92bb4daa req-0be6ca75-b4ec-4610-9ca9-a4834d1381cf service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:05.994584 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f11a04f9-ee62-4199-a7fa-abad92bb4daa req-0be6ca75-b4ec-4610-9ca9-a4834d1381cf service nova] Creating event network-vif-unplugged:6b0cf3a2-c471-4534-9b50-19752100c82a for instance 724f8487-047d-458b-bded-a8768b0ca1c0 on nch1-master-1 Mar 12 21:29:05.999961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-f11a04f9-ee62-4199-a7fa-abad92bb4daa req-0be6ca75-b4ec-4610-9ca9-a4834d1381cf service nova] Instance 724f8487-047d-458b-bded-a8768b0ca1c0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:29:06.012658 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f11a04f9-ee62-4199-a7fa-abad92bb4daa req-0be6ca75-b4ec-4610-9ca9-a4834d1381cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045158 Mar 12 21:29:06.013282 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4802/5570] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:29:06.434408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-050708ab-8e6c-4629-896e-d58d4652e878 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:06.435017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-050708ab-8e6c-4629-896e-d58d4652e878 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:06.441848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-050708ab-8e6c-4629-896e-d58d4652e878 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:06.442319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-050708ab-8e6c-4629-896e-d58d4652e878 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:06.443098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-050708ab-8e6c-4629-896e-d58d4652e878 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:06.443548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-050708ab-8e6c-4629-896e-d58d4652e878 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:06.694272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-050708ab-8e6c-4629-896e-d58d4652e878 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:06.701553 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-050708ab-8e6c-4629-896e-d58d4652e878 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1520 microversion: 2.1 time: 0.271470 Mar 12 21:29:06.702162 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4803/5571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:06 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:29:07.719560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a80ba447-4d59-4f3f-b4b5-546b21c734c0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:07.720184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a80ba447-4d59-4f3f-b4b5-546b21c734c0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:07.727691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a80ba447-4d59-4f3f-b4b5-546b21c734c0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:07.728161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a80ba447-4d59-4f3f-b4b5-546b21c734c0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:07.728941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a80ba447-4d59-4f3f-b4b5-546b21c734c0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:07.729394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a80ba447-4d59-4f3f-b4b5-546b21c734c0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:07.865886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a80ba447-4d59-4f3f-b4b5-546b21c734c0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:07.873835 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a80ba447-4d59-4f3f-b4b5-546b21c734c0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1518 microversion: 2.1 time: 0.158296 Mar 12 21:29:07.874417 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4804/5572] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:07 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:08.031405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3c48e15f-9272-495b-8b37-7972e47472b4 req-23e25a79-146a-428c-9c7e-79d996980655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724f8487-047d-458b-bded-a8768b0ca1c0", "tag": "6b0cf3a2-c471-4534-9b50-19752100c82a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:08.040546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3c48e15f-9272-495b-8b37-7972e47472b4 req-23e25a79-146a-428c-9c7e-79d996980655 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:08.041004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3c48e15f-9272-495b-8b37-7972e47472b4 req-23e25a79-146a-428c-9c7e-79d996980655 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:08.052000 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3c48e15f-9272-495b-8b37-7972e47472b4 req-23e25a79-146a-428c-9c7e-79d996980655 service nova] Creating event network-changed:6b0cf3a2-c471-4534-9b50-19752100c82a for instance 724f8487-047d-458b-bded-a8768b0ca1c0 on nch1-master-1 Mar 12 21:29:08.057139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-3c48e15f-9272-495b-8b37-7972e47472b4 req-23e25a79-146a-428c-9c7e-79d996980655 service nova] Instance 724f8487-047d-458b-bded-a8768b0ca1c0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:29:08.068580 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3c48e15f-9272-495b-8b37-7972e47472b4 req-23e25a79-146a-428c-9c7e-79d996980655 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040751 Mar 12 21:29:08.069363 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4805/5573] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:29:08.892004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-478cef0e-d12c-4cb4-a2f0-1e489688ff03 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:08.892720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-478cef0e-d12c-4cb4-a2f0-1e489688ff03 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:08.900125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-478cef0e-d12c-4cb4-a2f0-1e489688ff03 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:08.900586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-478cef0e-d12c-4cb4-a2f0-1e489688ff03 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:08.901364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-478cef0e-d12c-4cb4-a2f0-1e489688ff03 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:08.901839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-478cef0e-d12c-4cb4-a2f0-1e489688ff03 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:09.037552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-478cef0e-d12c-4cb4-a2f0-1e489688ff03 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:09.045871 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-478cef0e-d12c-4cb4-a2f0-1e489688ff03 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1518 microversion: 2.1 time: 0.158258 Mar 12 21:29:09.046478 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4806/5574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:08 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:10.062428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb7d9978-5734-41de-b277-26b26b0d534b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:10.063123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb7d9978-5734-41de-b277-26b26b0d534b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:10.069790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb7d9978-5734-41de-b277-26b26b0d534b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:10.070799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb7d9978-5734-41de-b277-26b26b0d534b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:10.071595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb7d9978-5734-41de-b277-26b26b0d534b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:10.072052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb7d9978-5734-41de-b277-26b26b0d534b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:10.210471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bb7d9978-5734-41de-b277-26b26b0d534b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:10.218747 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb7d9978-5734-41de-b277-26b26b0d534b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1515 microversion: 2.1 time: 0.160312 Mar 12 21:29:10.219332 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4807/5575] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:10 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:10.234598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80b63cf5-66c3-45e2-b9fb-8d41b95df780 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:10.235145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80b63cf5-66c3-45e2-b9fb-8d41b95df780 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:10.241145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80b63cf5-66c3-45e2-b9fb-8d41b95df780 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:10.241617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80b63cf5-66c3-45e2-b9fb-8d41b95df780 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:10.242996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80b63cf5-66c3-45e2-b9fb-8d41b95df780 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:10.243452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80b63cf5-66c3-45e2-b9fb-8d41b95df780 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:10.300205 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80b63cf5-66c3-45e2-b9fb-8d41b95df780 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "POST /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0/action" status: 204 len: 0 microversion: 2.1 time: 0.069047 Mar 12 21:29:10.300821 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4808/5576] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:29:10 2022] POST /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:29:10.309724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1162fa30-eb24-4cc2-a882-408b2b6d26b7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:10.310475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1162fa30-eb24-4cc2-a882-408b2b6d26b7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:10.316481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1162fa30-eb24-4cc2-a882-408b2b6d26b7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:10.317017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1162fa30-eb24-4cc2-a882-408b2b6d26b7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:10.318005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1162fa30-eb24-4cc2-a882-408b2b6d26b7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:10.318461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1162fa30-eb24-4cc2-a882-408b2b6d26b7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:10.457182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1162fa30-eb24-4cc2-a882-408b2b6d26b7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:10.465032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1162fa30-eb24-4cc2-a882-408b2b6d26b7 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1515 microversion: 2.1 time: 0.159278 Mar 12 21:29:10.465631 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4809/5577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:10 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:11.484124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ae331dae-7a99-4ee7-b390-a6eb5a5682ae tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:11.484824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ae331dae-7a99-4ee7-b390-a6eb5a5682ae tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:11.493665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae331dae-7a99-4ee7-b390-a6eb5a5682ae tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:11.494158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae331dae-7a99-4ee7-b390-a6eb5a5682ae tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:11.494946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae331dae-7a99-4ee7-b390-a6eb5a5682ae tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:11.495943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae331dae-7a99-4ee7-b390-a6eb5a5682ae tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:11.628958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ae331dae-7a99-4ee7-b390-a6eb5a5682ae tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:11.636857 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ae331dae-7a99-4ee7-b390-a6eb5a5682ae tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1507 microversion: 2.1 time: 0.156731 Mar 12 21:29:11.637433 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4810/5578] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:11 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:11.652871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-97ea8b0d-d241-4ded-b020-a3bc6dab81a8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:11.653482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-97ea8b0d-d241-4ded-b020-a3bc6dab81a8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:11.658891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97ea8b0d-d241-4ded-b020-a3bc6dab81a8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:11.659351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97ea8b0d-d241-4ded-b020-a3bc6dab81a8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:11.660123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97ea8b0d-d241-4ded-b020-a3bc6dab81a8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:11.660580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97ea8b0d-d241-4ded-b020-a3bc6dab81a8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:11.795274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-97ea8b0d-d241-4ded-b020-a3bc6dab81a8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:11.802553 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-97ea8b0d-d241-4ded-b020-a3bc6dab81a8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1507 microversion: 2.1 time: 0.153776 Mar 12 21:29:11.803130 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4811/5579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:11 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:11.817868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-836b4bcf-6744-4b29-96a8-57f0e024a3f5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:11.818482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-836b4bcf-6744-4b29-96a8-57f0e024a3f5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:11.824609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-836b4bcf-6744-4b29-96a8-57f0e024a3f5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:11.825079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-836b4bcf-6744-4b29-96a8-57f0e024a3f5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:11.825883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-836b4bcf-6744-4b29-96a8-57f0e024a3f5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:11.826335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-836b4bcf-6744-4b29-96a8-57f0e024a3f5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:11.963093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-836b4bcf-6744-4b29-96a8-57f0e024a3f5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:11.970891 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-836b4bcf-6744-4b29-96a8-57f0e024a3f5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 200 len: 1507 microversion: 2.1 time: 0.156398 Mar 12 21:29:11.971520 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4812/5580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:11 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:11.987400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d408066b-bbc5-4310-8042-e860537af065 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:11.987920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d408066b-bbc5-4310-8042-e860537af065 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:11.994323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d408066b-bbc5-4310-8042-e860537af065 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:11.994797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d408066b-bbc5-4310-8042-e860537af065 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:11.995586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d408066b-bbc5-4310-8042-e860537af065 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:11.996044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d408066b-bbc5-4310-8042-e860537af065 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:12.020519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d408066b-bbc5-4310-8042-e860537af065 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:29:12.097830 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d408066b-bbc5-4310-8042-e860537af065 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 204 len: 0 microversion: 2.1 time: 0.113804 Mar 12 21:29:12.098644 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4813/5581] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:29:11 2022] DELETE /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:29:12.113953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e2347e86-1825-4eea-9f04-4399ff75a7f7 req-7d8d5993-136e-4ade-8ff0-a19aab912632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724f8487-047d-458b-bded-a8768b0ca1c0", "name": "network-vif-plugged", "status": "completed", "tag": "6b0cf3a2-c471-4534-9b50-19752100c82a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:12.119644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e2347e86-1825-4eea-9f04-4399ff75a7f7 req-7d8d5993-136e-4ade-8ff0-a19aab912632 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:12.120319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e2347e86-1825-4eea-9f04-4399ff75a7f7 req-7d8d5993-136e-4ade-8ff0-a19aab912632 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:12.132085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e2347e86-1825-4eea-9f04-4399ff75a7f7 req-7d8d5993-136e-4ade-8ff0-a19aab912632 service nova] Creating event network-vif-plugged:6b0cf3a2-c471-4534-9b50-19752100c82a for instance 724f8487-047d-458b-bded-a8768b0ca1c0 on nch1-master-1 Mar 12 21:29:12.137680 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e2347e86-1825-4eea-9f04-4399ff75a7f7 req-7d8d5993-136e-4ade-8ff0-a19aab912632 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034793 Mar 12 21:29:12.138840 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4814/5582] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:29:12.156187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-820808757", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "f53cac57-f620-4a89-9f23-54e5aa7d78b3"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:12.205923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] validate_networks() for [('f53cac57-f620-4a89-9f23-54e5aa7d78b3', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:29:12.555337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:29:12.555915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:29:12.556316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:29:12.556742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:29:12.557162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:29:12.565819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:12.566286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:12.567093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:12.567538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:12.584065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Getting quotas for project ea2f836d50bd49c5a645811b2485b2a4. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:29:12.589734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Getting quotas for user a02a0271902d4745bd2ffc5de3c0c72b and project ea2f836d50bd49c5a645811b2485b2a4. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:29:12.601538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:29:12.604484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:29:12.646817 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-126b762a-7ef2-42a7-8473-c7d711fc7266 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494806 Mar 12 21:29:12.647670 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4815/5583] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:29:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:29:12.657945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e34107b8-7a38-460f-81ab-5da6e477a9a1 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:12.658579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e34107b8-7a38-460f-81ab-5da6e477a9a1 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:12.710893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e34107b8-7a38-460f-81ab-5da6e477a9a1 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:12.718047 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e34107b8-7a38-460f-81ab-5da6e477a9a1 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1217 microversion: 2.1 time: 0.063960 Mar 12 21:29:12.718669 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4816/5584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:12 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:13.736276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b0e0f325-29e8-4d7c-bf04-90dce32e1b91 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:13.737164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b0e0f325-29e8-4d7c-bf04-90dce32e1b91 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:13.747174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0e0f325-29e8-4d7c-bf04-90dce32e1b91 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:13.747772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0e0f325-29e8-4d7c-bf04-90dce32e1b91 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:13.748672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0e0f325-29e8-4d7c-bf04-90dce32e1b91 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:13.749254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b0e0f325-29e8-4d7c-bf04-90dce32e1b91 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:13.845498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b0e0f325-29e8-4d7c-bf04-90dce32e1b91 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:13.862652 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b0e0f325-29e8-4d7c-bf04-90dce32e1b91 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1275 microversion: 2.1 time: 0.130998 Mar 12 21:29:13.863305 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4817/5585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:13 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1275 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:29:13.916396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-506080df-563c-4c80-9225-a3f27be02450 req-26c78542-73b3-4733-abb7-b90025f89239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724f8487-047d-458b-bded-a8768b0ca1c0", "name": "network-vif-deleted", "tag": "6b0cf3a2-c471-4534-9b50-19752100c82a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:13.926519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-506080df-563c-4c80-9225-a3f27be02450 req-26c78542-73b3-4733-abb7-b90025f89239 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:13.927161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-506080df-563c-4c80-9225-a3f27be02450 req-26c78542-73b3-4733-abb7-b90025f89239 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:13.943086 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-506080df-563c-4c80-9225-a3f27be02450 req-26c78542-73b3-4733-abb7-b90025f89239 service nova] Creating event network-vif-deleted:6b0cf3a2-c471-4534-9b50-19752100c82a for instance 724f8487-047d-458b-bded-a8768b0ca1c0 on nch1-master-1 Mar 12 21:29:13.949455 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-506080df-563c-4c80-9225-a3f27be02450 req-26c78542-73b3-4733-abb7-b90025f89239 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037842 Mar 12 21:29:13.950629 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4818/5586] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:29:14.881337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-040f3584-f2c1-416b-8479-07bea29bf943 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:14.882094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-040f3584-f2c1-416b-8479-07bea29bf943 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:14.888252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-040f3584-f2c1-416b-8479-07bea29bf943 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:14.888725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-040f3584-f2c1-416b-8479-07bea29bf943 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:14.889544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-040f3584-f2c1-416b-8479-07bea29bf943 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:14.890105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-040f3584-f2c1-416b-8479-07bea29bf943 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:15.024324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-040f3584-f2c1-416b-8479-07bea29bf943 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:15.032457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-040f3584-f2c1-416b-8479-07bea29bf943 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1317 microversion: 2.1 time: 0.156116 Mar 12 21:29:15.042654 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4819/5587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:14 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:15.242079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b88324f0-2880-4383-93fd-52285e02dbaa req-f50252a0-c885-433c-81a7-7ab87ec19f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e5cba3d-2110-4122-980b-84597506800b", "tag": "e1ccac32-84c6-4302-b4f9-b8210f02aa34"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:15.250595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b88324f0-2880-4383-93fd-52285e02dbaa req-f50252a0-c885-433c-81a7-7ab87ec19f32 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:15.251309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b88324f0-2880-4383-93fd-52285e02dbaa req-f50252a0-c885-433c-81a7-7ab87ec19f32 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:15.263040 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b88324f0-2880-4383-93fd-52285e02dbaa req-f50252a0-c885-433c-81a7-7ab87ec19f32 service nova] Creating event network-changed:e1ccac32-84c6-4302-b4f9-b8210f02aa34 for instance 5e5cba3d-2110-4122-980b-84597506800b on nch1-master-1 Mar 12 21:29:15.267646 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b88324f0-2880-4383-93fd-52285e02dbaa req-f50252a0-c885-433c-81a7-7ab87ec19f32 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029281 Mar 12 21:29:15.268136 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4820/5588] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:29:16.050804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b58027ea-3020-4ac7-95c8-9e8dbc789190 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:16.051519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b58027ea-3020-4ac7-95c8-9e8dbc789190 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:16.058360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b58027ea-3020-4ac7-95c8-9e8dbc789190 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:16.058777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b58027ea-3020-4ac7-95c8-9e8dbc789190 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:16.059569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b58027ea-3020-4ac7-95c8-9e8dbc789190 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:16.060028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b58027ea-3020-4ac7-95c8-9e8dbc789190 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:16.195232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b58027ea-3020-4ac7-95c8-9e8dbc789190 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:16.202558 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b58027ea-3020-4ac7-95c8-9e8dbc789190 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1317 microversion: 2.1 time: 0.156895 Mar 12 21:29:16.203135 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4821/5589] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:16 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:17.219555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-610d7f5f-5d88-4585-be47-526b44989204 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:17.220173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-610d7f5f-5d88-4585-be47-526b44989204 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:17.227271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-610d7f5f-5d88-4585-be47-526b44989204 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:17.227732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-610d7f5f-5d88-4585-be47-526b44989204 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:17.229076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-610d7f5f-5d88-4585-be47-526b44989204 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:17.229553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-610d7f5f-5d88-4585-be47-526b44989204 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:17.358355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-610d7f5f-5d88-4585-be47-526b44989204 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:17.365550 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-610d7f5f-5d88-4585-be47-526b44989204 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1317 microversion: 2.1 time: 0.150158 Mar 12 21:29:17.366152 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4822/5590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:17 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:18.382536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a813b55e-7920-4e49-8cfc-d4f549aa2101 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:18.383134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a813b55e-7920-4e49-8cfc-d4f549aa2101 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:18.389916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a813b55e-7920-4e49-8cfc-d4f549aa2101 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:18.390397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a813b55e-7920-4e49-8cfc-d4f549aa2101 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:18.391272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a813b55e-7920-4e49-8cfc-d4f549aa2101 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:18.391740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a813b55e-7920-4e49-8cfc-d4f549aa2101 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:18.523921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a813b55e-7920-4e49-8cfc-d4f549aa2101 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:18.531797 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a813b55e-7920-4e49-8cfc-d4f549aa2101 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1317 microversion: 2.1 time: 0.153342 Mar 12 21:29:18.532382 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4823/5591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:18 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:19.550416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-223eeced-d3c6-4574-b1bc-c7c46925288c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:19.551040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-223eeced-d3c6-4574-b1bc-c7c46925288c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:19.557744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-223eeced-d3c6-4574-b1bc-c7c46925288c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:19.558239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-223eeced-d3c6-4574-b1bc-c7c46925288c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:19.559023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-223eeced-d3c6-4574-b1bc-c7c46925288c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:19.559476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-223eeced-d3c6-4574-b1bc-c7c46925288c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:19.692540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-223eeced-d3c6-4574-b1bc-c7c46925288c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:19.700366 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-223eeced-d3c6-4574-b1bc-c7c46925288c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1317 microversion: 2.1 time: 0.154013 Mar 12 21:29:19.700951 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4824/5592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:19 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:20.179856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7204c209-3494-4e3c-8f87-460d8dc70f19 req-fa26d111-c9c8-4a40-b471-fbb0310b6c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e5cba3d-2110-4122-980b-84597506800b", "name": "network-vif-plugged", "status": "completed", "tag": "e1ccac32-84c6-4302-b4f9-b8210f02aa34"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:20.188428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7204c209-3494-4e3c-8f87-460d8dc70f19 req-fa26d111-c9c8-4a40-b471-fbb0310b6c8b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:20.188895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7204c209-3494-4e3c-8f87-460d8dc70f19 req-fa26d111-c9c8-4a40-b471-fbb0310b6c8b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:20.202837 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7204c209-3494-4e3c-8f87-460d8dc70f19 req-fa26d111-c9c8-4a40-b471-fbb0310b6c8b service nova] Creating event network-vif-plugged:e1ccac32-84c6-4302-b4f9-b8210f02aa34 for instance 5e5cba3d-2110-4122-980b-84597506800b on nch1-master-1 Mar 12 21:29:20.207979 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7204c209-3494-4e3c-8f87-460d8dc70f19 req-fa26d111-c9c8-4a40-b471-fbb0310b6c8b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031814 Mar 12 21:29:20.208591 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4825/5593] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:29:20.718702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-74951203-33e0-4e17-9f59-c79f68425970 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:20.719413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-74951203-33e0-4e17-9f59-c79f68425970 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:20.725568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74951203-33e0-4e17-9f59-c79f68425970 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:20.726063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74951203-33e0-4e17-9f59-c79f68425970 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:20.726845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74951203-33e0-4e17-9f59-c79f68425970 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:20.727301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-74951203-33e0-4e17-9f59-c79f68425970 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:20.857305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-74951203-33e0-4e17-9f59-c79f68425970 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:20.864696 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-74951203-33e0-4e17-9f59-c79f68425970 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1317 microversion: 2.1 time: 0.151184 Mar 12 21:29:20.865275 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4826/5594] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:20 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:21.882218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-24df2de8-8cea-42cf-9f5e-90941b8d5f6c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:21.882855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-24df2de8-8cea-42cf-9f5e-90941b8d5f6c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:21.889577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24df2de8-8cea-42cf-9f5e-90941b8d5f6c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:21.890074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24df2de8-8cea-42cf-9f5e-90941b8d5f6c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:21.890855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24df2de8-8cea-42cf-9f5e-90941b8d5f6c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:21.891308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24df2de8-8cea-42cf-9f5e-90941b8d5f6c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:22.023435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-24df2de8-8cea-42cf-9f5e-90941b8d5f6c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:22.030736 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-24df2de8-8cea-42cf-9f5e-90941b8d5f6c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1507 microversion: 2.1 time: 0.152560 Mar 12 21:29:22.031362 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4827/5595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:21 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:22.047151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dad5972c-565f-4865-8df8-b5d807e5f4bb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:22.047768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dad5972c-565f-4865-8df8-b5d807e5f4bb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:22.053288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dad5972c-565f-4865-8df8-b5d807e5f4bb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:22.053755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dad5972c-565f-4865-8df8-b5d807e5f4bb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:22.054560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dad5972c-565f-4865-8df8-b5d807e5f4bb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:22.055009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dad5972c-565f-4865-8df8-b5d807e5f4bb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:22.184632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dad5972c-565f-4865-8df8-b5d807e5f4bb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:22.192047 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dad5972c-565f-4865-8df8-b5d807e5f4bb tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1507 microversion: 2.1 time: 0.148454 Mar 12 21:29:22.192625 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4828/5596] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:22 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:22.207462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:22.208450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:22.214746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:22.215214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:22.215987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:22.216443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:22.243847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:22.249442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Old instance type m1.heat2, new instance type m1.heat {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 21:29:22.255609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:29:22.256041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:29:22.256526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:29:22.256947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:29:22.257364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:29:22.318024 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6c2ee3ec-0c4e-4fa3-a511-03c7560de5fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "POST /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b/action" status: 202 len: 0 microversion: 2.1 time: 0.114028 Mar 12 21:29:22.318958 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4829/5597] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:29:22 2022] POST /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:29:22.326584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c121423d-8569-4b60-b053-79957ce8de64 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:22.327215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c121423d-8569-4b60-b053-79957ce8de64 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:22.333147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c121423d-8569-4b60-b053-79957ce8de64 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:22.333625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c121423d-8569-4b60-b053-79957ce8de64 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:22.334452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c121423d-8569-4b60-b053-79957ce8de64 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:22.334913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c121423d-8569-4b60-b053-79957ce8de64 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:22.470029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c121423d-8569-4b60-b053-79957ce8de64 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:22.478499 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c121423d-8569-4b60-b053-79957ce8de64 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1514 microversion: 2.1 time: 0.154950 Mar 12 21:29:22.479162 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4830/5598] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:22 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:23.495793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-54f8545f-5195-4fc4-bb90-2781b4d29336 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:23.496465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-54f8545f-5195-4fc4-bb90-2781b4d29336 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:23.503276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54f8545f-5195-4fc4-bb90-2781b4d29336 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:23.503784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54f8545f-5195-4fc4-bb90-2781b4d29336 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:23.504641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54f8545f-5195-4fc4-bb90-2781b4d29336 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:23.505023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-54f8545f-5195-4fc4-bb90-2781b4d29336 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:23.644971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-54f8545f-5195-4fc4-bb90-2781b4d29336 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:23.653394 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-54f8545f-5195-4fc4-bb90-2781b4d29336 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1514 microversion: 2.1 time: 0.161921 Mar 12 21:29:23.654232 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4831/5599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:23 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:24.670797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c1a24cb-461a-404a-8275-68377671f4fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:24.671468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c1a24cb-461a-404a-8275-68377671f4fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:24.678134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c1a24cb-461a-404a-8275-68377671f4fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:24.678599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c1a24cb-461a-404a-8275-68377671f4fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:24.679376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c1a24cb-461a-404a-8275-68377671f4fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:24.679825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c1a24cb-461a-404a-8275-68377671f4fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:24.809638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9c1a24cb-461a-404a-8275-68377671f4fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:24.817183 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c1a24cb-461a-404a-8275-68377671f4fd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.150292 Mar 12 21:29:24.817756 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4832/5600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:24 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:25.834157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d97e3df-3843-4f0c-b851-9b0ee4cf441f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:25.834799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5d97e3df-3843-4f0c-b851-9b0ee4cf441f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:25.842228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d97e3df-3843-4f0c-b851-9b0ee4cf441f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:25.842672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d97e3df-3843-4f0c-b851-9b0ee4cf441f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:25.843448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d97e3df-3843-4f0c-b851-9b0ee4cf441f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:25.843900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d97e3df-3843-4f0c-b851-9b0ee4cf441f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:25.977737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5d97e3df-3843-4f0c-b851-9b0ee4cf441f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:25.985216 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5d97e3df-3843-4f0c-b851-9b0ee4cf441f tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.155028 Mar 12 21:29:25.985804 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4833/5601] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:25 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:27.002811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5b4c5c6f-6a6b-47c4-9610-2395e85311cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:27.003443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5b4c5c6f-6a6b-47c4-9610-2395e85311cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:27.010244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b4c5c6f-6a6b-47c4-9610-2395e85311cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:27.010709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b4c5c6f-6a6b-47c4-9610-2395e85311cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:27.011486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b4c5c6f-6a6b-47c4-9610-2395e85311cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:27.011942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5b4c5c6f-6a6b-47c4-9610-2395e85311cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:27.141968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5b4c5c6f-6a6b-47c4-9610-2395e85311cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:27.149231 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5b4c5c6f-6a6b-47c4-9610-2395e85311cd tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.150317 Mar 12 21:29:27.150452 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4834/5602] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:26 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:28.167429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1ebe997c-720d-4127-8c89-05abf52c9160 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:28.168092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1ebe997c-720d-4127-8c89-05abf52c9160 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:28.173970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ebe997c-720d-4127-8c89-05abf52c9160 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:28.174441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ebe997c-720d-4127-8c89-05abf52c9160 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:28.175224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ebe997c-720d-4127-8c89-05abf52c9160 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:28.175680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ebe997c-720d-4127-8c89-05abf52c9160 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:28.307553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1ebe997c-720d-4127-8c89-05abf52c9160 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:28.314872 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1ebe997c-720d-4127-8c89-05abf52c9160 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.152038 Mar 12 21:29:28.315445 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4835/5603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:28 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:29.332244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d0e3389d-b956-453f-b2a6-020bc42edc6d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:29.332875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d0e3389d-b956-453f-b2a6-020bc42edc6d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:29.339914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0e3389d-b956-453f-b2a6-020bc42edc6d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:29.340383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0e3389d-b956-453f-b2a6-020bc42edc6d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:29.341167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0e3389d-b956-453f-b2a6-020bc42edc6d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:29.341620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0e3389d-b956-453f-b2a6-020bc42edc6d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:29.470779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d0e3389d-b956-453f-b2a6-020bc42edc6d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:29.478600 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d0e3389d-b956-453f-b2a6-020bc42edc6d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.149724 Mar 12 21:29:29.479180 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4836/5604] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:29 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:30.495729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ae132652-6664-47be-8973-087b25ea73c2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:30.496428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ae132652-6664-47be-8973-087b25ea73c2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:30.503001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae132652-6664-47be-8973-087b25ea73c2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:30.503580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae132652-6664-47be-8973-087b25ea73c2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:30.504370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae132652-6664-47be-8973-087b25ea73c2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:30.504818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae132652-6664-47be-8973-087b25ea73c2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:30.634054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ae132652-6664-47be-8973-087b25ea73c2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:30.641368 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ae132652-6664-47be-8973-087b25ea73c2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.149736 Mar 12 21:29:30.641974 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4837/5605] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:30 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:31.659132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e3b364e-5401-4690-a5c7-4748e5bd1276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:31.659807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e3b364e-5401-4690-a5c7-4748e5bd1276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:31.667296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e3b364e-5401-4690-a5c7-4748e5bd1276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:31.667770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e3b364e-5401-4690-a5c7-4748e5bd1276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:31.668569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e3b364e-5401-4690-a5c7-4748e5bd1276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:31.669030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e3b364e-5401-4690-a5c7-4748e5bd1276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:31.811333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8e3b364e-5401-4690-a5c7-4748e5bd1276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:31.818861 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8e3b364e-5401-4690-a5c7-4748e5bd1276 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.163665 Mar 12 21:29:31.819456 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4838/5606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:31 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:32.835836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b1b3457-507e-4d46-b76b-454d89c39583 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:32.836470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b1b3457-507e-4d46-b76b-454d89c39583 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:32.843345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b1b3457-507e-4d46-b76b-454d89c39583 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:32.843809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b1b3457-507e-4d46-b76b-454d89c39583 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:32.844587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b1b3457-507e-4d46-b76b-454d89c39583 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:32.845042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b1b3457-507e-4d46-b76b-454d89c39583 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:32.979490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b1b3457-507e-4d46-b76b-454d89c39583 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:32.986927 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b1b3457-507e-4d46-b76b-454d89c39583 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.154994 Mar 12 21:29:32.987511 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4839/5607] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:32 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:34.003442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b00e62aa-c90c-434f-93ee-7f6ccd9b7b2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:34.004132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b00e62aa-c90c-434f-93ee-7f6ccd9b7b2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:34.011301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b00e62aa-c90c-434f-93ee-7f6ccd9b7b2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:34.011769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b00e62aa-c90c-434f-93ee-7f6ccd9b7b2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:34.012556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b00e62aa-c90c-434f-93ee-7f6ccd9b7b2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:34.013011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b00e62aa-c90c-434f-93ee-7f6ccd9b7b2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:34.149348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b00e62aa-c90c-434f-93ee-7f6ccd9b7b2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:34.157295 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b00e62aa-c90c-434f-93ee-7f6ccd9b7b2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.157789 Mar 12 21:29:34.157953 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4840/5608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:33 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:35.174736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-660adaa2-1a37-4385-a6eb-5369e75f3faa tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:35.175466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-660adaa2-1a37-4385-a6eb-5369e75f3faa tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:35.182124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-660adaa2-1a37-4385-a6eb-5369e75f3faa tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:35.182583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-660adaa2-1a37-4385-a6eb-5369e75f3faa tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:35.183351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-660adaa2-1a37-4385-a6eb-5369e75f3faa tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:35.183800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-660adaa2-1a37-4385-a6eb-5369e75f3faa tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:35.313660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-660adaa2-1a37-4385-a6eb-5369e75f3faa tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:35.321147 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-660adaa2-1a37-4385-a6eb-5369e75f3faa tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.150392 Mar 12 21:29:35.322351 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4841/5609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:35 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:36.338834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99a8b97d-b40f-4bc1-9d69-2b6af6d4afc5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:36.339506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-99a8b97d-b40f-4bc1-9d69-2b6af6d4afc5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:36.346179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99a8b97d-b40f-4bc1-9d69-2b6af6d4afc5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:36.346644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99a8b97d-b40f-4bc1-9d69-2b6af6d4afc5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:36.347413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99a8b97d-b40f-4bc1-9d69-2b6af6d4afc5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:36.347864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99a8b97d-b40f-4bc1-9d69-2b6af6d4afc5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:36.477651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-99a8b97d-b40f-4bc1-9d69-2b6af6d4afc5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:36.485498 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99a8b97d-b40f-4bc1-9d69-2b6af6d4afc5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.150618 Mar 12 21:29:36.486100 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4842/5610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:36 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:37.501965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dee2ebcd-7839-4fe3-a996-9f4b4aa1abd9 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:37.502564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dee2ebcd-7839-4fe3-a996-9f4b4aa1abd9 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:37.509974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dee2ebcd-7839-4fe3-a996-9f4b4aa1abd9 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:37.510437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dee2ebcd-7839-4fe3-a996-9f4b4aa1abd9 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:37.511209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dee2ebcd-7839-4fe3-a996-9f4b4aa1abd9 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:37.511660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dee2ebcd-7839-4fe3-a996-9f4b4aa1abd9 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:37.645403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dee2ebcd-7839-4fe3-a996-9f4b4aa1abd9 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:37.652736 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dee2ebcd-7839-4fe3-a996-9f4b4aa1abd9 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.154757 Mar 12 21:29:37.653308 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4843/5611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:37 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:38.669872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1cda2018-9654-4d81-8aef-718c0cb1da2e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:38.670587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1cda2018-9654-4d81-8aef-718c0cb1da2e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:38.677212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cda2018-9654-4d81-8aef-718c0cb1da2e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:38.677674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cda2018-9654-4d81-8aef-718c0cb1da2e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:38.678480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cda2018-9654-4d81-8aef-718c0cb1da2e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:38.678930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1cda2018-9654-4d81-8aef-718c0cb1da2e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:38.810042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1cda2018-9654-4d81-8aef-718c0cb1da2e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:38.817558 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1cda2018-9654-4d81-8aef-718c0cb1da2e tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.151593 Mar 12 21:29:38.818381 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4844/5612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:38 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:39.835206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-157e2124-9020-4dec-8b3d-919f6a78a5b0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:39.835876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-157e2124-9020-4dec-8b3d-919f6a78a5b0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:39.843598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-157e2124-9020-4dec-8b3d-919f6a78a5b0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:39.844076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-157e2124-9020-4dec-8b3d-919f6a78a5b0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:39.844868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-157e2124-9020-4dec-8b3d-919f6a78a5b0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:39.845330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-157e2124-9020-4dec-8b3d-919f6a78a5b0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:39.981164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-157e2124-9020-4dec-8b3d-919f6a78a5b0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:39.988645 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-157e2124-9020-4dec-8b3d-919f6a78a5b0 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.157373 Mar 12 21:29:39.989224 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4845/5613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:39 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:41.005277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-60d20905-fb15-4bcf-9acf-f9a4b34dee4b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:41.005943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-60d20905-fb15-4bcf-9acf-f9a4b34dee4b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:41.013481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60d20905-fb15-4bcf-9acf-f9a4b34dee4b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:41.014003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60d20905-fb15-4bcf-9acf-f9a4b34dee4b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:41.014803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60d20905-fb15-4bcf-9acf-f9a4b34dee4b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:41.015266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60d20905-fb15-4bcf-9acf-f9a4b34dee4b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:41.146426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-60d20905-fb15-4bcf-9acf-f9a4b34dee4b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:41.154449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-60d20905-fb15-4bcf-9acf-f9a4b34dee4b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.153080 Mar 12 21:29:41.155032 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4846/5614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:41 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:42.171841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-40ca2b31-f7a5-408f-adda-49ee35ab2e00 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:42.172478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-40ca2b31-f7a5-408f-adda-49ee35ab2e00 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:42.179161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40ca2b31-f7a5-408f-adda-49ee35ab2e00 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:42.179633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40ca2b31-f7a5-408f-adda-49ee35ab2e00 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:42.180413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40ca2b31-f7a5-408f-adda-49ee35ab2e00 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:42.180873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40ca2b31-f7a5-408f-adda-49ee35ab2e00 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:42.313716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-40ca2b31-f7a5-408f-adda-49ee35ab2e00 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:42.321025 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-40ca2b31-f7a5-408f-adda-49ee35ab2e00 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.153249 Mar 12 21:29:42.322149 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4847/5615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:42 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:43.338915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c9a52cc7-0889-4e7c-a067-88b33b444e43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:43.339537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c9a52cc7-0889-4e7c-a067-88b33b444e43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:43.346277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9a52cc7-0889-4e7c-a067-88b33b444e43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:43.346743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9a52cc7-0889-4e7c-a067-88b33b444e43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:43.347519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9a52cc7-0889-4e7c-a067-88b33b444e43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:43.347973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9a52cc7-0889-4e7c-a067-88b33b444e43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:43.478617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c9a52cc7-0889-4e7c-a067-88b33b444e43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:43.485942 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c9a52cc7-0889-4e7c-a067-88b33b444e43 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.151367 Mar 12 21:29:43.486522 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4848/5616] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:43 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:44.502370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f64cfdb9-f368-4d5f-a509-fe5ad8511b53 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:44.503016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f64cfdb9-f368-4d5f-a509-fe5ad8511b53 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:44.509728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f64cfdb9-f368-4d5f-a509-fe5ad8511b53 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:44.510220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f64cfdb9-f368-4d5f-a509-fe5ad8511b53 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:44.510995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f64cfdb9-f368-4d5f-a509-fe5ad8511b53 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:44.511446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f64cfdb9-f368-4d5f-a509-fe5ad8511b53 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:44.642212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f64cfdb9-f368-4d5f-a509-fe5ad8511b53 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:44.649577 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f64cfdb9-f368-4d5f-a509-fe5ad8511b53 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.151110 Mar 12 21:29:44.650191 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4849/5617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:44 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:45.090673 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:29:45.090900 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 21:29:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 21:29:45.668298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-30468c35-149b-47f8-997c-9afe1c51879c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:45.668975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-30468c35-149b-47f8-997c-9afe1c51879c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:45.675651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30468c35-149b-47f8-997c-9afe1c51879c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:45.676117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30468c35-149b-47f8-997c-9afe1c51879c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:45.676893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30468c35-149b-47f8-997c-9afe1c51879c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:45.677345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-30468c35-149b-47f8-997c-9afe1c51879c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:45.814056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-30468c35-149b-47f8-997c-9afe1c51879c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:45.821372 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-30468c35-149b-47f8-997c-9afe1c51879c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.158195 Mar 12 21:29:45.822473 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4850/5618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:45 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:29:46.839442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-072cd627-1c80-4409-bd5e-674bee2a378b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:46.840061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-072cd627-1c80-4409-bd5e-674bee2a378b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:46.846881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-072cd627-1c80-4409-bd5e-674bee2a378b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:46.847349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-072cd627-1c80-4409-bd5e-674bee2a378b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:46.848132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-072cd627-1c80-4409-bd5e-674bee2a378b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:46.848589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-072cd627-1c80-4409-bd5e-674bee2a378b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:46.979013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-072cd627-1c80-4409-bd5e-674bee2a378b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:46.986434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-072cd627-1c80-4409-bd5e-674bee2a378b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.151631 Mar 12 21:29:46.987002 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4851/5619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:46 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:48.003912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cee25efd-f70b-4c60-a095-a76549336356 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:48.004660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cee25efd-f70b-4c60-a095-a76549336356 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:48.011554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cee25efd-f70b-4c60-a095-a76549336356 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:48.012017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cee25efd-f70b-4c60-a095-a76549336356 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:48.012793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cee25efd-f70b-4c60-a095-a76549336356 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:48.013239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cee25efd-f70b-4c60-a095-a76549336356 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:48.153679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cee25efd-f70b-4c60-a095-a76549336356 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:48.163932 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cee25efd-f70b-4c60-a095-a76549336356 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.163905 Mar 12 21:29:48.164493 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4852/5620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:47 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:49.182004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-07919660-ba41-45a5-9382-f4cda711fbe3 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:49.182634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-07919660-ba41-45a5-9382-f4cda711fbe3 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:49.189356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07919660-ba41-45a5-9382-f4cda711fbe3 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:49.189867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07919660-ba41-45a5-9382-f4cda711fbe3 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:49.190668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07919660-ba41-45a5-9382-f4cda711fbe3 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:49.191131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-07919660-ba41-45a5-9382-f4cda711fbe3 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:49.319900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-07919660-ba41-45a5-9382-f4cda711fbe3 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:49.328384 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-07919660-ba41-45a5-9382-f4cda711fbe3 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.151000 Mar 12 21:29:49.329323 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4853/5621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:49 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:50.346346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0103c17d-db5f-4c89-9e60-7b22e8bc6874 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:50.347015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0103c17d-db5f-4c89-9e60-7b22e8bc6874 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:50.354189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0103c17d-db5f-4c89-9e60-7b22e8bc6874 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:50.354652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0103c17d-db5f-4c89-9e60-7b22e8bc6874 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:50.355426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0103c17d-db5f-4c89-9e60-7b22e8bc6874 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:50.355872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0103c17d-db5f-4c89-9e60-7b22e8bc6874 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:50.484443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0103c17d-db5f-4c89-9e60-7b22e8bc6874 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:50.491748 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0103c17d-db5f-4c89-9e60-7b22e8bc6874 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1519 microversion: 2.1 time: 0.149385 Mar 12 21:29:50.492315 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4854/5622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:50 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:51.348428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-be638865-5641-4d34-804c-02c586a8f45e req-9430e720-afc3-4ce5-853a-c6127ad897d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e5cba3d-2110-4122-980b-84597506800b", "name": "network-vif-unplugged", "status": "completed", "tag": "e1ccac32-84c6-4302-b4f9-b8210f02aa34"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:51.358265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-be638865-5641-4d34-804c-02c586a8f45e req-9430e720-afc3-4ce5-853a-c6127ad897d9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:51.358799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-be638865-5641-4d34-804c-02c586a8f45e req-9430e720-afc3-4ce5-853a-c6127ad897d9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:51.371442 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-be638865-5641-4d34-804c-02c586a8f45e req-9430e720-afc3-4ce5-853a-c6127ad897d9 service nova] Creating event network-vif-unplugged:e1ccac32-84c6-4302-b4f9-b8210f02aa34 for instance 5e5cba3d-2110-4122-980b-84597506800b on nch2-master-1 Mar 12 21:29:51.377746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-be638865-5641-4d34-804c-02c586a8f45e req-9430e720-afc3-4ce5-853a-c6127ad897d9 service nova] Instance 5e5cba3d-2110-4122-980b-84597506800b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:29:51.390290 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-be638865-5641-4d34-804c-02c586a8f45e req-9430e720-afc3-4ce5-853a-c6127ad897d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045807 Mar 12 21:29:51.391179 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4855/5623] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:29:51.509560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-600f8633-652f-48a6-9070-0029dc9735ac tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:51.510309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-600f8633-652f-48a6-9070-0029dc9735ac tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:51.516362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-600f8633-652f-48a6-9070-0029dc9735ac tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:51.516829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-600f8633-652f-48a6-9070-0029dc9735ac tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:51.517609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-600f8633-652f-48a6-9070-0029dc9735ac tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:51.518112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-600f8633-652f-48a6-9070-0029dc9735ac tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:51.676145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-600f8633-652f-48a6-9070-0029dc9735ac tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:51.684085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-600f8633-652f-48a6-9070-0029dc9735ac tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1518 microversion: 2.1 time: 0.179367 Mar 12 21:29:51.684662 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4856/5624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:51 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:52.701236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-810da076-f10d-49cc-82d1-8a5ea225d0ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:52.701950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-810da076-f10d-49cc-82d1-8a5ea225d0ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:52.708688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810da076-f10d-49cc-82d1-8a5ea225d0ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:52.709159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810da076-f10d-49cc-82d1-8a5ea225d0ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:52.709967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810da076-f10d-49cc-82d1-8a5ea225d0ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:52.710423 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-810da076-f10d-49cc-82d1-8a5ea225d0ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:53.136645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-810da076-f10d-49cc-82d1-8a5ea225d0ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:53.143963 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-810da076-f10d-49cc-82d1-8a5ea225d0ef tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1516 microversion: 2.1 time: 0.446644 Mar 12 21:29:53.144537 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4857/5625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:52 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1516 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:53.405607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-32716790-c1ca-4db4-93b3-5228e0045e23 req-e72c2f43-c4f7-4532-85ef-46603cc5a17a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e5cba3d-2110-4122-980b-84597506800b", "tag": "e1ccac32-84c6-4302-b4f9-b8210f02aa34"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:53.413456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-32716790-c1ca-4db4-93b3-5228e0045e23 req-e72c2f43-c4f7-4532-85ef-46603cc5a17a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:53.413950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-32716790-c1ca-4db4-93b3-5228e0045e23 req-e72c2f43-c4f7-4532-85ef-46603cc5a17a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:53.425567 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-32716790-c1ca-4db4-93b3-5228e0045e23 req-e72c2f43-c4f7-4532-85ef-46603cc5a17a service nova] Creating event network-changed:e1ccac32-84c6-4302-b4f9-b8210f02aa34 for instance 5e5cba3d-2110-4122-980b-84597506800b on nch2-master-1 Mar 12 21:29:53.431060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-32716790-c1ca-4db4-93b3-5228e0045e23 req-e72c2f43-c4f7-4532-85ef-46603cc5a17a service nova] Instance 5e5cba3d-2110-4122-980b-84597506800b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:29:53.441200 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-32716790-c1ca-4db4-93b3-5228e0045e23 req-e72c2f43-c4f7-4532-85ef-46603cc5a17a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039220 Mar 12 21:29:53.441822 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4858/5626] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:29:54.163341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bbb182a6-faaf-42b2-9c9e-00ca4f989de4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:54.164827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bbb182a6-faaf-42b2-9c9e-00ca4f989de4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:54.172096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbb182a6-faaf-42b2-9c9e-00ca4f989de4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:54.172575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbb182a6-faaf-42b2-9c9e-00ca4f989de4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:54.173370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbb182a6-faaf-42b2-9c9e-00ca4f989de4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:54.174024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbb182a6-faaf-42b2-9c9e-00ca4f989de4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:54.315879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bbb182a6-faaf-42b2-9c9e-00ca4f989de4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:54.323535 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bbb182a6-faaf-42b2-9c9e-00ca4f989de4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1513 microversion: 2.1 time: 0.165247 Mar 12 21:29:54.334408 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4859/5627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:54 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:54.339480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a299f855-e498-4f87-84bb-633b33b2c442 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:54.340042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a299f855-e498-4f87-84bb-633b33b2c442 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:54.345870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a299f855-e498-4f87-84bb-633b33b2c442 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:54.346344 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a299f855-e498-4f87-84bb-633b33b2c442 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:54.347136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a299f855-e498-4f87-84bb-633b33b2c442 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:54.347771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a299f855-e498-4f87-84bb-633b33b2c442 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:54.406582 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a299f855-e498-4f87-84bb-633b33b2c442 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "POST /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b/action" status: 204 len: 0 microversion: 2.1 time: 0.070585 Mar 12 21:29:54.410257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4860/5628] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:29:54 2022] POST /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:29:54.422838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f6f35bcd-7f84-48bd-8a82-5aecdde53ef5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:54.423578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f6f35bcd-7f84-48bd-8a82-5aecdde53ef5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:54.431757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6f35bcd-7f84-48bd-8a82-5aecdde53ef5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:54.432229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6f35bcd-7f84-48bd-8a82-5aecdde53ef5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:54.433050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6f35bcd-7f84-48bd-8a82-5aecdde53ef5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:54.433574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6f35bcd-7f84-48bd-8a82-5aecdde53ef5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:54.581797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f6f35bcd-7f84-48bd-8a82-5aecdde53ef5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:54.590285 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f6f35bcd-7f84-48bd-8a82-5aecdde53ef5 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1513 microversion: 2.1 time: 0.178552 Mar 12 21:29:54.590949 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4861/5629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:54 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:29:55.608315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b7473e9-12c4-4f60-86d5-33cb834b3de8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:55.608984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b7473e9-12c4-4f60-86d5-33cb834b3de8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:55.615635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b7473e9-12c4-4f60-86d5-33cb834b3de8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:55.616116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b7473e9-12c4-4f60-86d5-33cb834b3de8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:55.616921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b7473e9-12c4-4f60-86d5-33cb834b3de8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:55.617387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b7473e9-12c4-4f60-86d5-33cb834b3de8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:55.750818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8b7473e9-12c4-4f60-86d5-33cb834b3de8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:55.758215 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b7473e9-12c4-4f60-86d5-33cb834b3de8 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1505 microversion: 2.1 time: 0.153944 Mar 12 21:29:55.758793 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4862/5630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:55 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:55.773685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e12e4678-6f70-48aa-9b9d-b48547422956 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:55.774387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e12e4678-6f70-48aa-9b9d-b48547422956 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:55.779973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12e4678-6f70-48aa-9b9d-b48547422956 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:55.780456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12e4678-6f70-48aa-9b9d-b48547422956 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:55.781262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12e4678-6f70-48aa-9b9d-b48547422956 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:55.781730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e12e4678-6f70-48aa-9b9d-b48547422956 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:55.912095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e12e4678-6f70-48aa-9b9d-b48547422956 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:55.920062 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e12e4678-6f70-48aa-9b9d-b48547422956 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1505 microversion: 2.1 time: 0.149875 Mar 12 21:29:55.920638 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4863/5631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:55 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:55.935806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b697c3a-821c-42d6-bfbc-dd4ac18daa70 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:55.936431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4b697c3a-821c-42d6-bfbc-dd4ac18daa70 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:55.942185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b697c3a-821c-42d6-bfbc-dd4ac18daa70 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:55.942690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b697c3a-821c-42d6-bfbc-dd4ac18daa70 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:55.943648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b697c3a-821c-42d6-bfbc-dd4ac18daa70 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:55.944190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4b697c3a-821c-42d6-bfbc-dd4ac18daa70 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:56.075806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4b697c3a-821c-42d6-bfbc-dd4ac18daa70 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:56.083126 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b697c3a-821c-42d6-bfbc-dd4ac18daa70 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1505 microversion: 2.1 time: 0.150876 Mar 12 21:29:56.083694 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4864/5632] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:55 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:56.099130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af2629be-54fe-4c34-8234-cce3d6bfbbe2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:56.099646 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af2629be-54fe-4c34-8234-cce3d6bfbbe2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:56.106183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af2629be-54fe-4c34-8234-cce3d6bfbbe2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:56.106655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af2629be-54fe-4c34-8234-cce3d6bfbbe2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:56.107432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af2629be-54fe-4c34-8234-cce3d6bfbbe2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:56.107917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af2629be-54fe-4c34-8234-cce3d6bfbbe2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:56.131124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af2629be-54fe-4c34-8234-cce3d6bfbbe2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:29:56.203058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af2629be-54fe-4c34-8234-cce3d6bfbbe2 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 204 len: 0 microversion: 2.1 time: 0.107192 Mar 12 21:29:56.203661 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4865/5633] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:29:56 2022] DELETE /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:29:56.220101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ae7ac2c-5e05-4e93-ae14-c1aec64131f6 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:56.220712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ae7ac2c-5e05-4e93-ae14-c1aec64131f6 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:56.226671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ae7ac2c-5e05-4e93-ae14-c1aec64131f6 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:56.227150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ae7ac2c-5e05-4e93-ae14-c1aec64131f6 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:56.228723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ae7ac2c-5e05-4e93-ae14-c1aec64131f6 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:56.229191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ae7ac2c-5e05-4e93-ae14-c1aec64131f6 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:56.253063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ae7ac2c-5e05-4e93-ae14-c1aec64131f6 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:29:56.296156 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.compute.api [None req-3ae7ac2c-5e05-4e93-ae14-c1aec64131f6 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Instance is already in deleting state, ignoring this request Mar 12 21:29:56.297004 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ae7ac2c-5e05-4e93-ae14-c1aec64131f6 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 204 len: 0 microversion: 2.1 time: 0.081026 Mar 12 21:29:56.297580 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4866/5634] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:29:56 2022] DELETE /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:29:56.305138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-560c6f43-a93b-439c-ad16-ea2be5aee58c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:56.305815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-560c6f43-a93b-439c-ad16-ea2be5aee58c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:56.311435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-560c6f43-a93b-439c-ad16-ea2be5aee58c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:56.311914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-560c6f43-a93b-439c-ad16-ea2be5aee58c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:56.312852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-560c6f43-a93b-439c-ad16-ea2be5aee58c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:56.313193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-560c6f43-a93b-439c-ad16-ea2be5aee58c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:56.451353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-560c6f43-a93b-439c-ad16-ea2be5aee58c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:56.458892 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-560c6f43-a93b-439c-ad16-ea2be5aee58c tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1511 microversion: 2.1 time: 0.157287 Mar 12 21:29:56.459568 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4867/5635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:56 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:56.480818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-42440697-614b-4a63-bf56-e67955b731d6 req-24e659d9-56cd-4357-ab52-e5ff28b67e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e5cba3d-2110-4122-980b-84597506800b", "name": "network-vif-plugged", "status": "completed", "tag": "e1ccac32-84c6-4302-b4f9-b8210f02aa34"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:56.489716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-42440697-614b-4a63-bf56-e67955b731d6 req-24e659d9-56cd-4357-ab52-e5ff28b67e71 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:56.490210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-42440697-614b-4a63-bf56-e67955b731d6 req-24e659d9-56cd-4357-ab52-e5ff28b67e71 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:56.502027 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-42440697-614b-4a63-bf56-e67955b731d6 req-24e659d9-56cd-4357-ab52-e5ff28b67e71 service nova] Creating event network-vif-plugged:e1ccac32-84c6-4302-b4f9-b8210f02aa34 for instance 5e5cba3d-2110-4122-980b-84597506800b on nch2-master-1 Mar 12 21:29:56.507010 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-42440697-614b-4a63-bf56-e67955b731d6 req-24e659d9-56cd-4357-ab52-e5ff28b67e71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030099 Mar 12 21:29:56.507601 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4868/5636] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:29:57.476724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d5c0f97-82f6-470c-a9a9-2c8fb866d90b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:57.477454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5d5c0f97-82f6-470c-a9a9-2c8fb866d90b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:57.484629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d5c0f97-82f6-470c-a9a9-2c8fb866d90b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:57.485099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d5c0f97-82f6-470c-a9a9-2c8fb866d90b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:57.485940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d5c0f97-82f6-470c-a9a9-2c8fb866d90b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:57.486404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d5c0f97-82f6-470c-a9a9-2c8fb866d90b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:57.620215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5d5c0f97-82f6-470c-a9a9-2c8fb866d90b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02a0271902d4745bd2ffc5de3c0c72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2f836d50bd49c5a645811b2485b2a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:29:57.630376 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5d5c0f97-82f6-470c-a9a9-2c8fb866d90b tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 200 len: 1511 microversion: 2.1 time: 0.157385 Mar 12 21:29:57.631751 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4869/5637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:57 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:29:57.932299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-74481322-3348-4454-8996-780a4f0f9114 req-92d4a9a3-539b-4c97-bf5d-c3247adad158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e5cba3d-2110-4122-980b-84597506800b", "name": "network-vif-deleted", "tag": "e1ccac32-84c6-4302-b4f9-b8210f02aa34"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:29:57.940641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-74481322-3348-4454-8996-780a4f0f9114 req-92d4a9a3-539b-4c97-bf5d-c3247adad158 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:57.941120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-74481322-3348-4454-8996-780a4f0f9114 req-92d4a9a3-539b-4c97-bf5d-c3247adad158 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:57.954613 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-74481322-3348-4454-8996-780a4f0f9114 req-92d4a9a3-539b-4c97-bf5d-c3247adad158 service nova] Creating event network-vif-deleted:e1ccac32-84c6-4302-b4f9-b8210f02aa34 for instance 5e5cba3d-2110-4122-980b-84597506800b on nch2-master-1 Mar 12 21:29:57.959633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-74481322-3348-4454-8996-780a4f0f9114 req-92d4a9a3-539b-4c97-bf5d-c3247adad158 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031674 Mar 12 21:29:57.960233 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4870/5638] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:29:58.649726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-151df43a-e047-4323-9507-693a16322c2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:58.650456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-151df43a-e047-4323-9507-693a16322c2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 5e5cba3d-2110-4122-980b-84597506800b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:58.657581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-151df43a-e047-4323-9507-693a16322c2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:58.658065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-151df43a-e047-4323-9507-693a16322c2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:58.658854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-151df43a-e047-4323-9507-693a16322c2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:58.659303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-151df43a-e047-4323-9507-693a16322c2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:58.673155 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-151df43a-e047-4323-9507-693a16322c2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] HTTP exception thrown: Instance 5e5cba3d-2110-4122-980b-84597506800b could not be found. Mar 12 21:29:58.673753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-151df43a-e047-4323-9507-693a16322c2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Returning 404 to user: Instance 5e5cba3d-2110-4122-980b-84597506800b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:29:58.674617 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-151df43a-e047-4323-9507-693a16322c2d tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b" status: 404 len: 111 microversion: 2.1 time: 0.030142 Mar 12 21:29:58.675151 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4871/5639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:58 2022] GET /compute/v2.1/servers/5e5cba3d-2110-4122-980b-84597506800b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:29:58.683502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-381b480a-14ad-4cb6-af07-6bc4c8de05f4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:58.684011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-381b480a-14ad-4cb6-af07-6bc4c8de05f4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:58.689629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-381b480a-14ad-4cb6-af07-6bc4c8de05f4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:58.690133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-381b480a-14ad-4cb6-af07-6bc4c8de05f4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:58.690915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-381b480a-14ad-4cb6-af07-6bc4c8de05f4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:58.691371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-381b480a-14ad-4cb6-af07-6bc4c8de05f4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:58.704264 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-381b480a-14ad-4cb6-af07-6bc4c8de05f4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] HTTP exception thrown: Instance 724f8487-047d-458b-bded-a8768b0ca1c0 could not be found. Mar 12 21:29:58.704855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-381b480a-14ad-4cb6-af07-6bc4c8de05f4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Returning 404 to user: Instance 724f8487-047d-458b-bded-a8768b0ca1c0 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:29:58.705665 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-381b480a-14ad-4cb6-af07-6bc4c8de05f4 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "DELETE /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 404 len: 111 microversion: 2.1 time: 0.026464 Mar 12 21:29:58.706204 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4872/5640] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:29:58 2022] DELETE /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:29:58.713276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-77646fdc-b887-46c6-9e1c-1f3886c33208 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:29:58.713994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-77646fdc-b887-46c6-9e1c-1f3886c33208 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] [instance: 724f8487-047d-458b-bded-a8768b0ca1c0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:29:58.719355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77646fdc-b887-46c6-9e1c-1f3886c33208 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:58.719815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77646fdc-b887-46c6-9e1c-1f3886c33208 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:58.720578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77646fdc-b887-46c6-9e1c-1f3886c33208 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:29:58.721030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77646fdc-b887-46c6-9e1c-1f3886c33208 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:29:58.734061 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-77646fdc-b887-46c6-9e1c-1f3886c33208 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] HTTP exception thrown: Instance 724f8487-047d-458b-bded-a8768b0ca1c0 could not be found. Mar 12 21:29:58.734647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-77646fdc-b887-46c6-9e1c-1f3886c33208 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] Returning 404 to user: Instance 724f8487-047d-458b-bded-a8768b0ca1c0 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:29:58.735449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-77646fdc-b887-46c6-9e1c-1f3886c33208 tempest-ServerDiskConfigTestJSON-477904238 tempest-ServerDiskConfigTestJSON-477904238-project] 10.222.0.30 "GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0" status: 404 len: 111 microversion: 2.1 time: 0.025613 Mar 12 21:29:58.735958 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4873/5641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:29:58 2022] GET /compute/v2.1/servers/724f8487-047d-458b-bded-a8768b0ca1c0 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:30:05.025403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4b5f6ae1-53fb-4702-9f38-dd887b2705ff tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'create', calling method: .version_select at 0x7f6e341e6a60>, body: {"keypair": {"name": "tempest-keypair-366629006"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:30:05.039177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4b5f6ae1-53fb-4702-9f38-dd887b2705ff tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:30:05.045323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4b5f6ae1-53fb-4702-9f38-dd887b2705ff tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for user 2dc99cab406e42d6b6cd00fddedaf960 and project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:30:05.358930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4b5f6ae1-53fb-4702-9f38-dd887b2705ff tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:30:05.364490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4b5f6ae1-53fb-4702-9f38-dd887b2705ff tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for user 2dc99cab406e42d6b6cd00fddedaf960 and project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:30:05.380232 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4b5f6ae1-53fb-4702-9f38-dd887b2705ff tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.500843 Mar 12 21:30:05.381010 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4874/5642] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:30:04 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:06.698658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-736471003", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12f207f9-0639-4c0e-8e71-ff9d17b74d28"}], "security_groups": [{"name": "tempest-securitygroup--132650578"}], "key_name": "tempest-keypair-366629006", "user_data": "}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:30:06.820040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] validate_networks() for [('12f207f9-0639-4c0e-8e71-ff9d17b74d28', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:30:07.216106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:30:07.216576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:30:07.217071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:30:07.217497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:30:07.217956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:30:07.230207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:07.230664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:07.231518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:07.231974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:07.248890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:30:07.254174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for user 2dc99cab406e42d6b6cd00fddedaf960 and project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:30:07.269226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:30:07.272082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:30:07.324107 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d45ffa74-8483-43e9-9106-1de83e26553d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.631246 Mar 12 21:30:07.324854 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4875/5643] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:30:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:30:07.339542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-071f54ff-3aba-401c-98b4-7ae8df00d8d3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:07.342542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-071f54ff-3aba-401c-98b4-7ae8df00d8d3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:07.398982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-071f54ff-3aba-401c-98b4-7ae8df00d8d3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:07.407330 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-071f54ff-3aba-401c-98b4-7ae8df00d8d3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1237 microversion: 2.1 time: 0.072064 Mar 12 21:30:07.408547 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4876/5644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:07 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:30:07.455188 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:30:07.455664 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:30:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:30:08.425426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-31bdb29e-0621-406b-a321-ef47c9f1e106 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:08.426099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-31bdb29e-0621-406b-a321-ef47c9f1e106 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:08.434535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31bdb29e-0621-406b-a321-ef47c9f1e106 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:08.435111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31bdb29e-0621-406b-a321-ef47c9f1e106 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:08.436108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31bdb29e-0621-406b-a321-ef47c9f1e106 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:08.436642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31bdb29e-0621-406b-a321-ef47c9f1e106 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:08.507822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-31bdb29e-0621-406b-a321-ef47c9f1e106 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:08.516422 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-31bdb29e-0621-406b-a321-ef47c9f1e106 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1295 microversion: 2.1 time: 0.095664 Mar 12 21:30:08.516938 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4877/5645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:08 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1295 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:09.533318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b507c7e-8cc9-4967-848e-9ceca4e0f551 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:09.534236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3b507c7e-8cc9-4967-848e-9ceca4e0f551 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:09.542089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b507c7e-8cc9-4967-848e-9ceca4e0f551 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:09.542689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b507c7e-8cc9-4967-848e-9ceca4e0f551 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:09.543638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b507c7e-8cc9-4967-848e-9ceca4e0f551 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:09.544226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b507c7e-8cc9-4967-848e-9ceca4e0f551 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:09.717649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3b507c7e-8cc9-4967-848e-9ceca4e0f551 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:09.725755 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b507c7e-8cc9-4967-848e-9ceca4e0f551 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1362 microversion: 2.1 time: 0.197044 Mar 12 21:30:09.726379 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4878/5646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:09 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:30:09.731958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2eee8fcf-c734-4276-832d-eed90168d2b7 req-e8c3a1dc-3f56-4cfe-bdc1-3fcd5ff9df74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed26d2b9-3e26-4339-83ab-d3879d00b2c3", "tag": "5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:30:09.740570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2eee8fcf-c734-4276-832d-eed90168d2b7 req-e8c3a1dc-3f56-4cfe-bdc1-3fcd5ff9df74 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:09.741080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2eee8fcf-c734-4276-832d-eed90168d2b7 req-e8c3a1dc-3f56-4cfe-bdc1-3fcd5ff9df74 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:09.752374 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2eee8fcf-c734-4276-832d-eed90168d2b7 req-e8c3a1dc-3f56-4cfe-bdc1-3fcd5ff9df74 service nova] Creating event network-changed:5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a for instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 on nch2-master-1 Mar 12 21:30:09.757563 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2eee8fcf-c734-4276-832d-eed90168d2b7 req-e8c3a1dc-3f56-4cfe-bdc1-3fcd5ff9df74 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029759 Mar 12 21:30:09.758417 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4879/5647] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:30:10.744961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fee39955-e36c-4f2a-bb4d-05e3d1c3d2e3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:10.745721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fee39955-e36c-4f2a-bb4d-05e3d1c3d2e3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:10.752002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fee39955-e36c-4f2a-bb4d-05e3d1c3d2e3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:10.752478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fee39955-e36c-4f2a-bb4d-05e3d1c3d2e3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:10.753274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fee39955-e36c-4f2a-bb4d-05e3d1c3d2e3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:10.753735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fee39955-e36c-4f2a-bb4d-05e3d1c3d2e3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:10.886958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fee39955-e36c-4f2a-bb4d-05e3d1c3d2e3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:10.894740 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fee39955-e36c-4f2a-bb4d-05e3d1c3d2e3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1362 microversion: 2.1 time: 0.154628 Mar 12 21:30:10.895144 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4880/5648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:10 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:11.911711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-58839c54-f4c5-4d5c-8471-45eb91991710 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:11.912349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-58839c54-f4c5-4d5c-8471-45eb91991710 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:11.919977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58839c54-f4c5-4d5c-8471-45eb91991710 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:11.920447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58839c54-f4c5-4d5c-8471-45eb91991710 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:11.921233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58839c54-f4c5-4d5c-8471-45eb91991710 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:11.921701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58839c54-f4c5-4d5c-8471-45eb91991710 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:12.057417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-58839c54-f4c5-4d5c-8471-45eb91991710 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:12.064831 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-58839c54-f4c5-4d5c-8471-45eb91991710 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1362 microversion: 2.1 time: 0.157043 Mar 12 21:30:12.065413 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4881/5649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:11 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:13.081691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-579a80d4-7687-46e9-97c3-21f3e754e351 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:13.082369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-579a80d4-7687-46e9-97c3-21f3e754e351 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:13.089636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-579a80d4-7687-46e9-97c3-21f3e754e351 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:13.090162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-579a80d4-7687-46e9-97c3-21f3e754e351 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:13.090935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-579a80d4-7687-46e9-97c3-21f3e754e351 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:13.091391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-579a80d4-7687-46e9-97c3-21f3e754e351 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:13.222531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-579a80d4-7687-46e9-97c3-21f3e754e351 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:13.230508 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-579a80d4-7687-46e9-97c3-21f3e754e351 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1362 microversion: 2.1 time: 0.152830 Mar 12 21:30:13.231079 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4882/5650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:13 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:14.246902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2f7f1782-8737-4194-bbc8-904ab450e58c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:14.247553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2f7f1782-8737-4194-bbc8-904ab450e58c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:14.254445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2f7f1782-8737-4194-bbc8-904ab450e58c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:14.254923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2f7f1782-8737-4194-bbc8-904ab450e58c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:14.255719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2f7f1782-8737-4194-bbc8-904ab450e58c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:14.256181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2f7f1782-8737-4194-bbc8-904ab450e58c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:14.393239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2f7f1782-8737-4194-bbc8-904ab450e58c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:14.401295 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2f7f1782-8737-4194-bbc8-904ab450e58c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1362 microversion: 2.1 time: 0.157837 Mar 12 21:30:14.401894 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4883/5651] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:14 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:14.586483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e2eeb011-6274-4bb2-ba86-18fc9b2ae3e5 req-77d9a15d-8053-43a3-9bc7-67d74d1f3ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed26d2b9-3e26-4339-83ab-d3879d00b2c3", "name": "network-vif-plugged", "status": "completed", "tag": "5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:30:14.595941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e2eeb011-6274-4bb2-ba86-18fc9b2ae3e5 req-77d9a15d-8053-43a3-9bc7-67d74d1f3ed4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:14.596444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e2eeb011-6274-4bb2-ba86-18fc9b2ae3e5 req-77d9a15d-8053-43a3-9bc7-67d74d1f3ed4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:14.607344 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e2eeb011-6274-4bb2-ba86-18fc9b2ae3e5 req-77d9a15d-8053-43a3-9bc7-67d74d1f3ed4 service nova] Creating event network-vif-plugged:5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a for instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 on nch2-master-1 Mar 12 21:30:14.612313 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e2eeb011-6274-4bb2-ba86-18fc9b2ae3e5 req-77d9a15d-8053-43a3-9bc7-67d74d1f3ed4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029866 Mar 12 21:30:14.612927 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4884/5652] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:30:15.421092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c98ec138-a998-434b-9b8a-5eff861741cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:15.421847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c98ec138-a998-434b-9b8a-5eff861741cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:15.428223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c98ec138-a998-434b-9b8a-5eff861741cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:15.428635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c98ec138-a998-434b-9b8a-5eff861741cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:15.429430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c98ec138-a998-434b-9b8a-5eff861741cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:15.429920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c98ec138-a998-434b-9b8a-5eff861741cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:15.562985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c98ec138-a998-434b-9b8a-5eff861741cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:15.570424 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c98ec138-a998-434b-9b8a-5eff861741cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1362 microversion: 2.1 time: 0.155884 Mar 12 21:30:15.571003 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4885/5653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:15 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:16.589095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-92ccfc32-8dab-4635-9377-f38401990c11 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:16.589815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-92ccfc32-8dab-4635-9377-f38401990c11 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:16.596694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92ccfc32-8dab-4635-9377-f38401990c11 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:16.597167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92ccfc32-8dab-4635-9377-f38401990c11 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:16.597988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92ccfc32-8dab-4635-9377-f38401990c11 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:16.598451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-92ccfc32-8dab-4635-9377-f38401990c11 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:16.730245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-92ccfc32-8dab-4635-9377-f38401990c11 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:16.737560 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-92ccfc32-8dab-4635-9377-f38401990c11 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1549 microversion: 2.1 time: 0.152880 Mar 12 21:30:16.738167 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4886/5654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:16 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:30:16.756389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc6b06bd-5269-43d1-a8c8-8bf3b04e5b86 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:16.756911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc6b06bd-5269-43d1-a8c8-8bf3b04e5b86 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:16.763005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc6b06bd-5269-43d1-a8c8-8bf3b04e5b86 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:16.763486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc6b06bd-5269-43d1-a8c8-8bf3b04e5b86 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:16.764283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc6b06bd-5269-43d1-a8c8-8bf3b04e5b86 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:16.764742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc6b06bd-5269-43d1-a8c8-8bf3b04e5b86 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:16.851306 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc6b06bd-5269-43d1-a8c8-8bf3b04e5b86 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099374 Mar 12 21:30:16.851953 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4887/5655] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 21:30:16 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:30:18.084362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aaf4ec76-cd3e-4149-b713-d29e529dd6c8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:18.085029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aaf4ec76-cd3e-4149-b713-d29e529dd6c8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:18.091962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aaf4ec76-cd3e-4149-b713-d29e529dd6c8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:18.092468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aaf4ec76-cd3e-4149-b713-d29e529dd6c8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:18.093306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aaf4ec76-cd3e-4149-b713-d29e529dd6c8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:18.093821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aaf4ec76-cd3e-4149-b713-d29e529dd6c8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:18.225944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aaf4ec76-cd3e-4149-b713-d29e529dd6c8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:18.233868 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aaf4ec76-cd3e-4149-b713-d29e529dd6c8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1549 microversion: 2.1 time: 0.156869 Mar 12 21:30:18.234448 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4888/5656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:18 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:30:18.238869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-87324d16-0748-427f-ba9a-29c0644ff219 req-dc69d6c6-150c-487f-a4f9-44ee51d35831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed26d2b9-3e26-4339-83ab-d3879d00b2c3", "tag": "5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:30:18.247080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-87324d16-0748-427f-ba9a-29c0644ff219 req-dc69d6c6-150c-487f-a4f9-44ee51d35831 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:18.247543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-87324d16-0748-427f-ba9a-29c0644ff219 req-dc69d6c6-150c-487f-a4f9-44ee51d35831 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:18.258644 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-87324d16-0748-427f-ba9a-29c0644ff219 req-dc69d6c6-150c-487f-a4f9-44ee51d35831 service nova] Creating event network-changed:5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a for instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 on nch2-master-1 Mar 12 21:30:18.264299 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-87324d16-0748-427f-ba9a-29c0644ff219 req-dc69d6c6-150c-487f-a4f9-44ee51d35831 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028727 Mar 12 21:30:18.264938 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4889/5657] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:30:18.271077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec206aa1-15e6-4370-9bf3-f4fbba39a39b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:18.274936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec206aa1-15e6-4370-9bf3-f4fbba39a39b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:18.282072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec206aa1-15e6-4370-9bf3-f4fbba39a39b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:18.282554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec206aa1-15e6-4370-9bf3-f4fbba39a39b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:18.283362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec206aa1-15e6-4370-9bf3-f4fbba39a39b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:18.283822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec206aa1-15e6-4370-9bf3-f4fbba39a39b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:18.438560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ec206aa1-15e6-4370-9bf3-f4fbba39a39b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:18.446596 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec206aa1-15e6-4370-9bf3-f4fbba39a39b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1549 microversion: 2.1 time: 0.179588 Mar 12 21:30:18.447386 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4890/5658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:18 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1549 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:30:19.464945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6935604e-d3e4-4e8b-aeae-33baacb0a8b2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:19.465555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6935604e-d3e4-4e8b-aeae-33baacb0a8b2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:19.472387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6935604e-d3e4-4e8b-aeae-33baacb0a8b2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:19.472858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6935604e-d3e4-4e8b-aeae-33baacb0a8b2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:19.473641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6935604e-d3e4-4e8b-aeae-33baacb0a8b2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:19.474128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6935604e-d3e4-4e8b-aeae-33baacb0a8b2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:19.610395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6935604e-d3e4-4e8b-aeae-33baacb0a8b2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:19.618043 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6935604e-d3e4-4e8b-aeae-33baacb0a8b2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1668 microversion: 2.1 time: 0.157743 Mar 12 21:30:19.618619 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4891/5659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:19 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:19.633543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c75e3008-9535-4d1d-ab34-560271fa8c8c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:19.634205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c75e3008-9535-4d1d-ab34-560271fa8c8c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:19.640312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c75e3008-9535-4d1d-ab34-560271fa8c8c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:19.640788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c75e3008-9535-4d1d-ab34-560271fa8c8c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:19.641579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c75e3008-9535-4d1d-ab34-560271fa8c8c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:19.642060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c75e3008-9535-4d1d-ab34-560271fa8c8c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:19.774456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c75e3008-9535-4d1d-ab34-560271fa8c8c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:19.781811 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c75e3008-9535-4d1d-ab34-560271fa8c8c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1668 microversion: 2.1 time: 0.151885 Mar 12 21:30:19.782395 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4892/5660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:19 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:30:19.798057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:30:19.799036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:19.804690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:19.805162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:19.806014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:19.806474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:19.833677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:19.839670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Old instance type m1.heat2, new instance type m1.heat {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 21:30:19.845876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:30:19.846318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:30:19.846817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:30:19.847244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:30:19.847671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:30:19.911465 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-015a339f-f9ca-4d33-aefc-90810e7a07f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3/action" status: 202 len: 0 microversion: 2.1 time: 0.116980 Mar 12 21:30:19.912082 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4893/5661] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:30:19 2022] POST /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:30:19.920081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12a86874-cb43-4be5-85e6-892493c56eb8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:19.920707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-12a86874-cb43-4be5-85e6-892493c56eb8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:19.926557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12a86874-cb43-4be5-85e6-892493c56eb8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:19.927036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12a86874-cb43-4be5-85e6-892493c56eb8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:19.927831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12a86874-cb43-4be5-85e6-892493c56eb8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:19.928299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12a86874-cb43-4be5-85e6-892493c56eb8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:20.074162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-12a86874-cb43-4be5-85e6-892493c56eb8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:20.083166 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-12a86874-cb43-4be5-85e6-892493c56eb8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1677 microversion: 2.1 time: 0.166691 Mar 12 21:30:20.083769 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4894/5662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:19 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:21.102856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3816752a-adaa-4991-9a97-ac42ff3004a2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:21.103491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3816752a-adaa-4991-9a97-ac42ff3004a2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:21.111806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3816752a-adaa-4991-9a97-ac42ff3004a2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:21.112284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3816752a-adaa-4991-9a97-ac42ff3004a2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:21.113095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3816752a-adaa-4991-9a97-ac42ff3004a2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:21.113563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3816752a-adaa-4991-9a97-ac42ff3004a2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:21.254330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3816752a-adaa-4991-9a97-ac42ff3004a2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:21.261987 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3816752a-adaa-4991-9a97-ac42ff3004a2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1677 microversion: 2.1 time: 0.163131 Mar 12 21:30:21.262766 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4895/5663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:21 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:22.279077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-95aa8cf1-8cc0-4f4a-81e1-8c8b609cfef8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:22.279747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-95aa8cf1-8cc0-4f4a-81e1-8c8b609cfef8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:22.286631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95aa8cf1-8cc0-4f4a-81e1-8c8b609cfef8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:22.287112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95aa8cf1-8cc0-4f4a-81e1-8c8b609cfef8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:22.287932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95aa8cf1-8cc0-4f4a-81e1-8c8b609cfef8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:22.288392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95aa8cf1-8cc0-4f4a-81e1-8c8b609cfef8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:22.423490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-95aa8cf1-8cc0-4f4a-81e1-8c8b609cfef8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:22.431061 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-95aa8cf1-8cc0-4f4a-81e1-8c8b609cfef8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.155873 Mar 12 21:30:22.431702 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4896/5664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:22 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:23.448432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99d71f27-907b-47ab-b61f-dc25a466908d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:23.449101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-99d71f27-907b-47ab-b61f-dc25a466908d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:23.456306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99d71f27-907b-47ab-b61f-dc25a466908d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:23.456785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99d71f27-907b-47ab-b61f-dc25a466908d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:23.457578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99d71f27-907b-47ab-b61f-dc25a466908d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:23.458076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99d71f27-907b-47ab-b61f-dc25a466908d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:23.589384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-99d71f27-907b-47ab-b61f-dc25a466908d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:23.597018 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99d71f27-907b-47ab-b61f-dc25a466908d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.152549 Mar 12 21:30:23.597600 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4897/5665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:23 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:24.614716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8659924-72cd-416c-a1e5-9e93ab92bafa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:24.615384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8659924-72cd-416c-a1e5-9e93ab92bafa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:24.622189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8659924-72cd-416c-a1e5-9e93ab92bafa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:24.622676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8659924-72cd-416c-a1e5-9e93ab92bafa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:24.623477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8659924-72cd-416c-a1e5-9e93ab92bafa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:24.623940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8659924-72cd-416c-a1e5-9e93ab92bafa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:24.753965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a8659924-72cd-416c-a1e5-9e93ab92bafa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:24.761418 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8659924-72cd-416c-a1e5-9e93ab92bafa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.150708 Mar 12 21:30:24.762035 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4898/5666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:24 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:25.778107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-28ae230d-06b5-4c7e-8461-60669b6ddf4b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:25.778783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-28ae230d-06b5-4c7e-8461-60669b6ddf4b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:25.785602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28ae230d-06b5-4c7e-8461-60669b6ddf4b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:25.786116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28ae230d-06b5-4c7e-8461-60669b6ddf4b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:25.786906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28ae230d-06b5-4c7e-8461-60669b6ddf4b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:25.787368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-28ae230d-06b5-4c7e-8461-60669b6ddf4b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:25.924987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-28ae230d-06b5-4c7e-8461-60669b6ddf4b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:25.933087 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-28ae230d-06b5-4c7e-8461-60669b6ddf4b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.159020 Mar 12 21:30:25.933678 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4899/5667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:25 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:26.950869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-809bd32d-37d3-41fa-b34f-e8fa2976a3df tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:26.951530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-809bd32d-37d3-41fa-b34f-e8fa2976a3df tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:26.958265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-809bd32d-37d3-41fa-b34f-e8fa2976a3df tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:26.958746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-809bd32d-37d3-41fa-b34f-e8fa2976a3df tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:26.959547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-809bd32d-37d3-41fa-b34f-e8fa2976a3df tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:26.960009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-809bd32d-37d3-41fa-b34f-e8fa2976a3df tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:27.091157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-809bd32d-37d3-41fa-b34f-e8fa2976a3df tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:27.098585 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-809bd32d-37d3-41fa-b34f-e8fa2976a3df tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.152056 Mar 12 21:30:27.099166 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4900/5668] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:26 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:28.115693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0b9dda04-6024-46be-9876-568d15abc4f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:28.116325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0b9dda04-6024-46be-9876-568d15abc4f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:28.123531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b9dda04-6024-46be-9876-568d15abc4f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:28.124429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b9dda04-6024-46be-9876-568d15abc4f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:28.125278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b9dda04-6024-46be-9876-568d15abc4f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:28.125749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0b9dda04-6024-46be-9876-568d15abc4f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:28.265432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0b9dda04-6024-46be-9876-568d15abc4f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:28.272877 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0b9dda04-6024-46be-9876-568d15abc4f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.161428 Mar 12 21:30:28.273460 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4901/5669] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:28 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:29.290995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ae96a703-c68a-4838-b9e9-1103ddbb3ad1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:29.292251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ae96a703-c68a-4838-b9e9-1103ddbb3ad1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:29.299085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae96a703-c68a-4838-b9e9-1103ddbb3ad1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:29.299559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae96a703-c68a-4838-b9e9-1103ddbb3ad1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:29.300353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae96a703-c68a-4838-b9e9-1103ddbb3ad1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:29.300817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae96a703-c68a-4838-b9e9-1103ddbb3ad1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:29.432171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ae96a703-c68a-4838-b9e9-1103ddbb3ad1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:29.439533 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ae96a703-c68a-4838-b9e9-1103ddbb3ad1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.152785 Mar 12 21:30:29.440125 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4902/5670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:29 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:30.456471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-41a8d081-ec90-4dbe-8549-ca4894668c16 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:30.457079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-41a8d081-ec90-4dbe-8549-ca4894668c16 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:30.464315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41a8d081-ec90-4dbe-8549-ca4894668c16 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:30.464785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41a8d081-ec90-4dbe-8549-ca4894668c16 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:30.465564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41a8d081-ec90-4dbe-8549-ca4894668c16 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:30.466044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-41a8d081-ec90-4dbe-8549-ca4894668c16 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:30.599810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-41a8d081-ec90-4dbe-8549-ca4894668c16 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:30.607236 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-41a8d081-ec90-4dbe-8549-ca4894668c16 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.154768 Mar 12 21:30:30.607823 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4903/5671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:30 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:31.624474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9fa3fcc3-1c66-4f2c-a0e7-c3ed0fac0b6b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:31.625089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9fa3fcc3-1c66-4f2c-a0e7-c3ed0fac0b6b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:31.631861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9fa3fcc3-1c66-4f2c-a0e7-c3ed0fac0b6b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:31.632341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9fa3fcc3-1c66-4f2c-a0e7-c3ed0fac0b6b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:31.633129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9fa3fcc3-1c66-4f2c-a0e7-c3ed0fac0b6b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:31.633596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9fa3fcc3-1c66-4f2c-a0e7-c3ed0fac0b6b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:31.764260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9fa3fcc3-1c66-4f2c-a0e7-c3ed0fac0b6b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:31.771675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9fa3fcc3-1c66-4f2c-a0e7-c3ed0fac0b6b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.151342 Mar 12 21:30:31.772257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4904/5672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:31 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:32.788537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52d4f3c1-a3ef-48a7-83bf-590b27f34315 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:32.789217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-52d4f3c1-a3ef-48a7-83bf-590b27f34315 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:32.796253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52d4f3c1-a3ef-48a7-83bf-590b27f34315 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:32.796726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52d4f3c1-a3ef-48a7-83bf-590b27f34315 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:32.797519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52d4f3c1-a3ef-48a7-83bf-590b27f34315 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:32.798012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52d4f3c1-a3ef-48a7-83bf-590b27f34315 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:32.932568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-52d4f3c1-a3ef-48a7-83bf-590b27f34315 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:32.940032 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-52d4f3c1-a3ef-48a7-83bf-590b27f34315 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.155510 Mar 12 21:30:32.940619 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4905/5673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:32 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:33.958856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a33e96fe-b8d1-4394-8364-adb720e01a75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:33.959494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a33e96fe-b8d1-4394-8364-adb720e01a75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:33.966936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a33e96fe-b8d1-4394-8364-adb720e01a75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:33.967413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a33e96fe-b8d1-4394-8364-adb720e01a75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:33.968212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a33e96fe-b8d1-4394-8364-adb720e01a75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:33.968677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a33e96fe-b8d1-4394-8364-adb720e01a75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:34.111762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a33e96fe-b8d1-4394-8364-adb720e01a75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:34.122067 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a33e96fe-b8d1-4394-8364-adb720e01a75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.167054 Mar 12 21:30:34.122993 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4906/5674] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:33 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:35.140273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-29b3ad9e-1116-49f0-b658-4af88b0c502c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:35.140939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-29b3ad9e-1116-49f0-b658-4af88b0c502c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:35.147779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29b3ad9e-1116-49f0-b658-4af88b0c502c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:35.148258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29b3ad9e-1116-49f0-b658-4af88b0c502c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:35.149088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29b3ad9e-1116-49f0-b658-4af88b0c502c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:35.149552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29b3ad9e-1116-49f0-b658-4af88b0c502c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:35.280552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-29b3ad9e-1116-49f0-b658-4af88b0c502c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:35.287992 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-29b3ad9e-1116-49f0-b658-4af88b0c502c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.151804 Mar 12 21:30:35.288565 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4907/5675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:35 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:36.305188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80605d12-7a50-4833-b438-eed34f42619b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:36.306014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80605d12-7a50-4833-b438-eed34f42619b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:36.313997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80605d12-7a50-4833-b438-eed34f42619b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:36.314481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80605d12-7a50-4833-b438-eed34f42619b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:36.315281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80605d12-7a50-4833-b438-eed34f42619b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:36.315745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80605d12-7a50-4833-b438-eed34f42619b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:36.456115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80605d12-7a50-4833-b438-eed34f42619b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:36.464842 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80605d12-7a50-4833-b438-eed34f42619b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.163611 Mar 12 21:30:36.465439 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4908/5676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:36 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:37.482574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-286a034a-2e31-40d2-a16e-ae3c0e290730 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:37.483235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-286a034a-2e31-40d2-a16e-ae3c0e290730 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:37.490009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-286a034a-2e31-40d2-a16e-ae3c0e290730 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:37.490481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-286a034a-2e31-40d2-a16e-ae3c0e290730 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:37.491275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-286a034a-2e31-40d2-a16e-ae3c0e290730 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:37.491742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-286a034a-2e31-40d2-a16e-ae3c0e290730 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:37.627052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-286a034a-2e31-40d2-a16e-ae3c0e290730 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:37.634486 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-286a034a-2e31-40d2-a16e-ae3c0e290730 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.156523 Mar 12 21:30:37.635070 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4909/5677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:37 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:38.651964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fe979a47-eb74-47f9-8594-e4af681e4233 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:38.652581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fe979a47-eb74-47f9-8594-e4af681e4233 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:38.659283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe979a47-eb74-47f9-8594-e4af681e4233 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:38.659759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe979a47-eb74-47f9-8594-e4af681e4233 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:38.660549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe979a47-eb74-47f9-8594-e4af681e4233 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:38.661008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fe979a47-eb74-47f9-8594-e4af681e4233 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:38.793156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fe979a47-eb74-47f9-8594-e4af681e4233 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:38.800533 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fe979a47-eb74-47f9-8594-e4af681e4233 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.152792 Mar 12 21:30:38.801117 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4910/5678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:38 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:39.818082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c0b6d1d6-00ba-4e64-9e64-f2728302ed5b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:39.818733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c0b6d1d6-00ba-4e64-9e64-f2728302ed5b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:39.826230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0b6d1d6-00ba-4e64-9e64-f2728302ed5b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:39.826711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0b6d1d6-00ba-4e64-9e64-f2728302ed5b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:39.827512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0b6d1d6-00ba-4e64-9e64-f2728302ed5b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:39.827969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c0b6d1d6-00ba-4e64-9e64-f2728302ed5b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:39.965462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c0b6d1d6-00ba-4e64-9e64-f2728302ed5b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:39.972938 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c0b6d1d6-00ba-4e64-9e64-f2728302ed5b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.158777 Mar 12 21:30:39.973525 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4911/5679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:39 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:40.990263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a5b7358c-881f-426d-985c-7a4f7004a4b5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:40.990916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a5b7358c-881f-426d-985c-7a4f7004a4b5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:40.997687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5b7358c-881f-426d-985c-7a4f7004a4b5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:40.998204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5b7358c-881f-426d-985c-7a4f7004a4b5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:40.998995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5b7358c-881f-426d-985c-7a4f7004a4b5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:40.999454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5b7358c-881f-426d-985c-7a4f7004a4b5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:41.132571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a5b7358c-881f-426d-985c-7a4f7004a4b5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:41.139924 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a5b7358c-881f-426d-985c-7a4f7004a4b5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.153617 Mar 12 21:30:41.140504 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4912/5680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:40 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:42.156449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f313a18e-5073-4c50-88dd-d3ac88ab4157 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:42.157125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f313a18e-5073-4c50-88dd-d3ac88ab4157 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:42.163906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f313a18e-5073-4c50-88dd-d3ac88ab4157 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:42.164390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f313a18e-5073-4c50-88dd-d3ac88ab4157 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:42.165193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f313a18e-5073-4c50-88dd-d3ac88ab4157 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:42.165960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f313a18e-5073-4c50-88dd-d3ac88ab4157 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:42.300477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f313a18e-5073-4c50-88dd-d3ac88ab4157 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:42.308549 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f313a18e-5073-4c50-88dd-d3ac88ab4157 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.156156 Mar 12 21:30:42.309349 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4913/5681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:42 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:43.326220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f00ae86-d986-4c3b-878e-94b927dae253 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:43.326853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f00ae86-d986-4c3b-878e-94b927dae253 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:43.333586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f00ae86-d986-4c3b-878e-94b927dae253 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:43.334119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f00ae86-d986-4c3b-878e-94b927dae253 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:43.334901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f00ae86-d986-4c3b-878e-94b927dae253 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:43.335358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f00ae86-d986-4c3b-878e-94b927dae253 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:43.470244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9f00ae86-d986-4c3b-878e-94b927dae253 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:43.477651 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f00ae86-d986-4c3b-878e-94b927dae253 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.156079 Mar 12 21:30:43.478274 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4914/5682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:43 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:44.494801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0754e822-50ac-4c95-930f-41cc95ace920 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:44.495457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0754e822-50ac-4c95-930f-41cc95ace920 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:44.502273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0754e822-50ac-4c95-930f-41cc95ace920 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:44.502743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0754e822-50ac-4c95-930f-41cc95ace920 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:44.503549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0754e822-50ac-4c95-930f-41cc95ace920 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:44.503986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0754e822-50ac-4c95-930f-41cc95ace920 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:44.642193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0754e822-50ac-4c95-930f-41cc95ace920 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:44.649740 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0754e822-50ac-4c95-930f-41cc95ace920 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.158954 Mar 12 21:30:44.650407 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4915/5683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:44 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:45.668352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b283cef-25a6-4a9e-8038-40c2d46a1194 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:45.668987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b283cef-25a6-4a9e-8038-40c2d46a1194 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:45.675676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b283cef-25a6-4a9e-8038-40c2d46a1194 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:45.676143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b283cef-25a6-4a9e-8038-40c2d46a1194 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:45.676924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b283cef-25a6-4a9e-8038-40c2d46a1194 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:45.677379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b283cef-25a6-4a9e-8038-40c2d46a1194 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:45.806831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b283cef-25a6-4a9e-8038-40c2d46a1194 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:45.814251 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b283cef-25a6-4a9e-8038-40c2d46a1194 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.150766 Mar 12 21:30:45.814836 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4916/5684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:45 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:46.832564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca928b47-8c44-4bd1-852a-5d3d2875d9da tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:46.833178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ca928b47-8c44-4bd1-852a-5d3d2875d9da tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:46.839988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca928b47-8c44-4bd1-852a-5d3d2875d9da tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:46.840457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca928b47-8c44-4bd1-852a-5d3d2875d9da tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:46.841244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca928b47-8c44-4bd1-852a-5d3d2875d9da tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:46.841699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca928b47-8c44-4bd1-852a-5d3d2875d9da tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:46.977846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca928b47-8c44-4bd1-852a-5d3d2875d9da tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:46.985255 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca928b47-8c44-4bd1-852a-5d3d2875d9da tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.156908 Mar 12 21:30:46.985846 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4917/5685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:46 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:48.003301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-88a7103a-ef65-4961-b5e7-75214669108e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:48.003938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-88a7103a-ef65-4961-b5e7-75214669108e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:48.010775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88a7103a-ef65-4961-b5e7-75214669108e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:48.011249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88a7103a-ef65-4961-b5e7-75214669108e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:48.012040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88a7103a-ef65-4961-b5e7-75214669108e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:48.012504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-88a7103a-ef65-4961-b5e7-75214669108e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:48.150570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-88a7103a-ef65-4961-b5e7-75214669108e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:48.158522 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-88a7103a-ef65-4961-b5e7-75214669108e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.159276 Mar 12 21:30:48.159097 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4918/5686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:47 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:49.175822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c09c914-bc3f-4c8d-9e43-26c8356682ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:49.176468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c09c914-bc3f-4c8d-9e43-26c8356682ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:49.183249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c09c914-bc3f-4c8d-9e43-26c8356682ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:49.183724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c09c914-bc3f-4c8d-9e43-26c8356682ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:49.184511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c09c914-bc3f-4c8d-9e43-26c8356682ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:49.184970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c09c914-bc3f-4c8d-9e43-26c8356682ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:49.314514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0c09c914-bc3f-4c8d-9e43-26c8356682ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:49.321991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c09c914-bc3f-4c8d-9e43-26c8356682ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.150355 Mar 12 21:30:49.322573 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4919/5687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:49 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:50.339858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eec3f4b2-4276-4787-b24e-f3818ffad6bd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:50.340558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eec3f4b2-4276-4787-b24e-f3818ffad6bd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:50.347391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eec3f4b2-4276-4787-b24e-f3818ffad6bd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:50.347867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eec3f4b2-4276-4787-b24e-f3818ffad6bd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:50.348664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eec3f4b2-4276-4787-b24e-f3818ffad6bd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:50.349126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eec3f4b2-4276-4787-b24e-f3818ffad6bd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:50.490519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eec3f4b2-4276-4787-b24e-f3818ffad6bd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:50.497963 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eec3f4b2-4276-4787-b24e-f3818ffad6bd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.162702 Mar 12 21:30:50.498542 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4920/5688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:50 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:51.515964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d323171a-27d5-4dae-9cd0-039bd2d79f6d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:51.516632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d323171a-27d5-4dae-9cd0-039bd2d79f6d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:51.523494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d323171a-27d5-4dae-9cd0-039bd2d79f6d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:51.523972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d323171a-27d5-4dae-9cd0-039bd2d79f6d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:51.524775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d323171a-27d5-4dae-9cd0-039bd2d79f6d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:51.525238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d323171a-27d5-4dae-9cd0-039bd2d79f6d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:51.660590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d323171a-27d5-4dae-9cd0-039bd2d79f6d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:51.668392 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d323171a-27d5-4dae-9cd0-039bd2d79f6d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.156527 Mar 12 21:30:51.669549 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4921/5689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:51 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:52.686682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c65617b1-4ce8-46ef-b907-c6e35e492973 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:52.687367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c65617b1-4ce8-46ef-b907-c6e35e492973 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:52.694138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65617b1-4ce8-46ef-b907-c6e35e492973 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:52.694621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65617b1-4ce8-46ef-b907-c6e35e492973 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:52.695420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65617b1-4ce8-46ef-b907-c6e35e492973 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:52.695887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65617b1-4ce8-46ef-b907-c6e35e492973 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:52.825579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c65617b1-4ce8-46ef-b907-c6e35e492973 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:52.833133 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c65617b1-4ce8-46ef-b907-c6e35e492973 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1682 microversion: 2.1 time: 0.151063 Mar 12 21:30:52.833722 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4922/5690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:52 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:53.849543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9e5c90be-3d87-4220-8cc1-e4c355a3e60f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:53.850301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9e5c90be-3d87-4220-8cc1-e4c355a3e60f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:53.857071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e5c90be-3d87-4220-8cc1-e4c355a3e60f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:53.857551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e5c90be-3d87-4220-8cc1-e4c355a3e60f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:53.858422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e5c90be-3d87-4220-8cc1-e4c355a3e60f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:53.858886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e5c90be-3d87-4220-8cc1-e4c355a3e60f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:53.998309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9e5c90be-3d87-4220-8cc1-e4c355a3e60f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:54.005764 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9e5c90be-3d87-4220-8cc1-e4c355a3e60f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1681 microversion: 2.1 time: 0.160273 Mar 12 21:30:54.006368 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4923/5691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:53 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:54.491015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6b6c2ce3-a654-4b2a-badd-358344038c38 req-c0c7b02b-aa89-41fa-8d5f-c004aa6dbd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed26d2b9-3e26-4339-83ab-d3879d00b2c3", "name": "network-vif-unplugged", "status": "completed", "tag": "5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:30:54.499790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6b6c2ce3-a654-4b2a-badd-358344038c38 req-c0c7b02b-aa89-41fa-8d5f-c004aa6dbd18 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:54.500266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6b6c2ce3-a654-4b2a-badd-358344038c38 req-c0c7b02b-aa89-41fa-8d5f-c004aa6dbd18 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:54.515178 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6b6c2ce3-a654-4b2a-badd-358344038c38 req-c0c7b02b-aa89-41fa-8d5f-c004aa6dbd18 service nova] Creating event network-vif-unplugged:5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a for instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 on nch1-master-1 Mar 12 21:30:54.520663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-6b6c2ce3-a654-4b2a-badd-358344038c38 req-c0c7b02b-aa89-41fa-8d5f-c004aa6dbd18 service nova] Instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:30:54.531674 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6b6c2ce3-a654-4b2a-badd-358344038c38 req-c0c7b02b-aa89-41fa-8d5f-c004aa6dbd18 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044397 Mar 12 21:30:54.532579 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4924/5692] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:30:55.024009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7df04f0-2c67-4d89-b9ce-ff0f91805925 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:55.024963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a7df04f0-2c67-4d89-b9ce-ff0f91805925 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:55.032976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7df04f0-2c67-4d89-b9ce-ff0f91805925 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:55.033512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7df04f0-2c67-4d89-b9ce-ff0f91805925 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:55.034362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7df04f0-2c67-4d89-b9ce-ff0f91805925 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:55.034823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7df04f0-2c67-4d89-b9ce-ff0f91805925 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:55.176750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a7df04f0-2c67-4d89-b9ce-ff0f91805925 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:55.184235 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7df04f0-2c67-4d89-b9ce-ff0f91805925 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1681 microversion: 2.1 time: 0.164561 Mar 12 21:30:55.184835 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4925/5693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:55 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:56.201132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c4240b9-2e16-4c14-ae0e-463b449f6daa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:56.201848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c4240b9-2e16-4c14-ae0e-463b449f6daa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:56.208805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c4240b9-2e16-4c14-ae0e-463b449f6daa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:56.209293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c4240b9-2e16-4c14-ae0e-463b449f6daa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:56.210153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c4240b9-2e16-4c14-ae0e-463b449f6daa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:56.210623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c4240b9-2e16-4c14-ae0e-463b449f6daa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:56.345316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9c4240b9-2e16-4c14-ae0e-463b449f6daa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:56.352772 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c4240b9-2e16-4c14-ae0e-463b449f6daa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1679 microversion: 2.1 time: 0.156240 Mar 12 21:30:56.353363 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4926/5694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:56 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:56.551338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-43d00d3a-048e-47f1-b843-8008c71b5b3c req-28677feb-28f0-46fa-addd-f26c51477506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed26d2b9-3e26-4339-83ab-d3879d00b2c3", "tag": "5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:30:56.559923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-43d00d3a-048e-47f1-b843-8008c71b5b3c req-28677feb-28f0-46fa-addd-f26c51477506 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:56.560384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-43d00d3a-048e-47f1-b843-8008c71b5b3c req-28677feb-28f0-46fa-addd-f26c51477506 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:56.571538 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-43d00d3a-048e-47f1-b843-8008c71b5b3c req-28677feb-28f0-46fa-addd-f26c51477506 service nova] Creating event network-changed:5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a for instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 on nch1-master-1 Mar 12 21:30:56.576981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-43d00d3a-048e-47f1-b843-8008c71b5b3c req-28677feb-28f0-46fa-addd-f26c51477506 service nova] Instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:30:56.588923 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-43d00d3a-048e-47f1-b843-8008c71b5b3c req-28677feb-28f0-46fa-addd-f26c51477506 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041183 Mar 12 21:30:56.589534 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4927/5695] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:30:57.371194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12d5b2c5-1c35-4b67-a6e8-8ea5afedfadf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:57.372470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-12d5b2c5-1c35-4b67-a6e8-8ea5afedfadf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:57.379505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12d5b2c5-1c35-4b67-a6e8-8ea5afedfadf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:57.379986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12d5b2c5-1c35-4b67-a6e8-8ea5afedfadf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:57.380792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12d5b2c5-1c35-4b67-a6e8-8ea5afedfadf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:57.381262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12d5b2c5-1c35-4b67-a6e8-8ea5afedfadf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:57.517150 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-12d5b2c5-1c35-4b67-a6e8-8ea5afedfadf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:57.524550 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-12d5b2c5-1c35-4b67-a6e8-8ea5afedfadf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1679 microversion: 2.1 time: 0.157641 Mar 12 21:30:57.525128 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4928/5696] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:57 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:58.542300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8cbf3f01-c579-4137-927a-e1b663c443db tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:58.543005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8cbf3f01-c579-4137-927a-e1b663c443db tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:58.549415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cbf3f01-c579-4137-927a-e1b663c443db tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:58.549929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cbf3f01-c579-4137-927a-e1b663c443db tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:58.550725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cbf3f01-c579-4137-927a-e1b663c443db tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:58.551219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8cbf3f01-c579-4137-927a-e1b663c443db tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:58.689268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8cbf3f01-c579-4137-927a-e1b663c443db tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:58.696651 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8cbf3f01-c579-4137-927a-e1b663c443db tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1676 microversion: 2.1 time: 0.158834 Mar 12 21:30:58.697239 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4929/5697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:58 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:30:58.712746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2ec476f-539a-440e-ae75-c87d91c9935c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:30:58.713307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2ec476f-539a-440e-ae75-c87d91c9935c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:58.719115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2ec476f-539a-440e-ae75-c87d91c9935c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:58.719589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2ec476f-539a-440e-ae75-c87d91c9935c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:58.720383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2ec476f-539a-440e-ae75-c87d91c9935c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:58.720842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2ec476f-539a-440e-ae75-c87d91c9935c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:58.779758 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2ec476f-539a-440e-ae75-c87d91c9935c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3/action" status: 204 len: 0 microversion: 2.1 time: 0.070482 Mar 12 21:30:58.780566 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4930/5698] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:30:58 2022] POST /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:30:58.790433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-57d3156a-bd2a-4b46-b5c1-f749891707ea tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:58.791350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-57d3156a-bd2a-4b46-b5c1-f749891707ea tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:58.798495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57d3156a-bd2a-4b46-b5c1-f749891707ea tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:58.798963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57d3156a-bd2a-4b46-b5c1-f749891707ea tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:58.799768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57d3156a-bd2a-4b46-b5c1-f749891707ea tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:58.800220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57d3156a-bd2a-4b46-b5c1-f749891707ea tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:58.946316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-57d3156a-bd2a-4b46-b5c1-f749891707ea tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:30:58.954083 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-57d3156a-bd2a-4b46-b5c1-f749891707ea tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1676 microversion: 2.1 time: 0.169083 Mar 12 21:30:58.955033 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4931/5699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:58 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:30:59.971564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90413b6b-b44e-4676-8a67-567d21b2d007 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:30:59.972294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90413b6b-b44e-4676-8a67-567d21b2d007 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:30:59.979173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90413b6b-b44e-4676-8a67-567d21b2d007 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:59.979736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90413b6b-b44e-4676-8a67-567d21b2d007 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:30:59.980528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90413b6b-b44e-4676-8a67-567d21b2d007 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:30:59.981532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90413b6b-b44e-4676-8a67-567d21b2d007 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:00.118379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90413b6b-b44e-4676-8a67-567d21b2d007 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:00.126782 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90413b6b-b44e-4676-8a67-567d21b2d007 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1668 microversion: 2.1 time: 0.159132 Mar 12 21:31:00.127564 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4932/5700] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:30:59 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:00.143348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a32c1791-d691-4d0a-94eb-03b74008fe32 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:00.143983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a32c1791-d691-4d0a-94eb-03b74008fe32 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:00.149953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a32c1791-d691-4d0a-94eb-03b74008fe32 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:00.150431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a32c1791-d691-4d0a-94eb-03b74008fe32 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:00.151217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a32c1791-d691-4d0a-94eb-03b74008fe32 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:00.151676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a32c1791-d691-4d0a-94eb-03b74008fe32 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:00.287923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a32c1791-d691-4d0a-94eb-03b74008fe32 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:00.296040 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a32c1791-d691-4d0a-94eb-03b74008fe32 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1668 microversion: 2.1 time: 0.156554 Mar 12 21:31:00.296624 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4933/5701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:00 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:00.312185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec474cd7-a389-4627-9399-00da2a8dcf25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:00.312801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec474cd7-a389-4627-9399-00da2a8dcf25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:00.318436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec474cd7-a389-4627-9399-00da2a8dcf25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:00.318904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec474cd7-a389-4627-9399-00da2a8dcf25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:00.319691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec474cd7-a389-4627-9399-00da2a8dcf25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:00.320149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec474cd7-a389-4627-9399-00da2a8dcf25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:00.449574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ec474cd7-a389-4627-9399-00da2a8dcf25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:00.456941 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec474cd7-a389-4627-9399-00da2a8dcf25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1668 microversion: 2.1 time: 0.148911 Mar 12 21:31:00.457518 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4934/5702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:00 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:00.472938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c01bdf87-8303-428f-91a3-6aef89ce609b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:00.473452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c01bdf87-8303-428f-91a3-6aef89ce609b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:00.479050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c01bdf87-8303-428f-91a3-6aef89ce609b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:00.479519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c01bdf87-8303-428f-91a3-6aef89ce609b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:00.480303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c01bdf87-8303-428f-91a3-6aef89ce609b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:00.480756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c01bdf87-8303-428f-91a3-6aef89ce609b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:00.504653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c01bdf87-8303-428f-91a3-6aef89ce609b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:31:00.580363 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c01bdf87-8303-428f-91a3-6aef89ce609b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 204 len: 0 microversion: 2.1 time: 0.110664 Mar 12 21:31:00.581185 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4935/5703] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:31:00 2022] DELETE /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:31:00.589663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9af3f16a-7f85-4c84-9a84-b406bfcdebb3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:00.590924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9af3f16a-7f85-4c84-9a84-b406bfcdebb3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:00.597332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9af3f16a-7f85-4c84-9a84-b406bfcdebb3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:00.597828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9af3f16a-7f85-4c84-9a84-b406bfcdebb3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:00.598623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9af3f16a-7f85-4c84-9a84-b406bfcdebb3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:00.599079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9af3f16a-7f85-4c84-9a84-b406bfcdebb3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:00.738137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9af3f16a-7f85-4c84-9a84-b406bfcdebb3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:00.745644 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9af3f16a-7f85-4c84-9a84-b406bfcdebb3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1674 microversion: 2.1 time: 0.160126 Mar 12 21:31:00.746265 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4936/5704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:00 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:00.751547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b9f8f82c-eb20-4d68-989e-a88f95ae00ee req-23479799-1c91-4736-a0ea-20ad25a42e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed26d2b9-3e26-4339-83ab-d3879d00b2c3", "name": "network-vif-plugged", "status": "completed", "tag": "5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:00.759356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b9f8f82c-eb20-4d68-989e-a88f95ae00ee req-23479799-1c91-4736-a0ea-20ad25a42e75 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:00.759854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b9f8f82c-eb20-4d68-989e-a88f95ae00ee req-23479799-1c91-4736-a0ea-20ad25a42e75 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:00.772897 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b9f8f82c-eb20-4d68-989e-a88f95ae00ee req-23479799-1c91-4736-a0ea-20ad25a42e75 service nova] Creating event network-vif-plugged:5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a for instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 on nch1-master-1 Mar 12 21:31:00.779249 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b9f8f82c-eb20-4d68-989e-a88f95ae00ee req-23479799-1c91-4736-a0ea-20ad25a42e75 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030337 Mar 12 21:31:00.779972 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4937/5705] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:31:01.763250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dbe71dc3-9fdf-4f2e-93d9-dceab70c9525 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:01.764230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dbe71dc3-9fdf-4f2e-93d9-dceab70c9525 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:01.771185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbe71dc3-9fdf-4f2e-93d9-dceab70c9525 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:01.771654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbe71dc3-9fdf-4f2e-93d9-dceab70c9525 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:01.772437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbe71dc3-9fdf-4f2e-93d9-dceab70c9525 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:01.772893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dbe71dc3-9fdf-4f2e-93d9-dceab70c9525 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:01.905311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dbe71dc3-9fdf-4f2e-93d9-dceab70c9525 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:01.912770 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dbe71dc3-9fdf-4f2e-93d9-dceab70c9525 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1674 microversion: 2.1 time: 0.153831 Mar 12 21:31:01.913363 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4938/5706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:01 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:02.855364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7f2bc46e-3944-4aa2-83b2-34fd940a1fd1 req-bb6323b3-3afd-41ef-94f2-b3d004645cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed26d2b9-3e26-4339-83ab-d3879d00b2c3", "name": "network-vif-deleted", "tag": "5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:02.865928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7f2bc46e-3944-4aa2-83b2-34fd940a1fd1 req-bb6323b3-3afd-41ef-94f2-b3d004645cd9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:02.866419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7f2bc46e-3944-4aa2-83b2-34fd940a1fd1 req-bb6323b3-3afd-41ef-94f2-b3d004645cd9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:02.878726 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7f2bc46e-3944-4aa2-83b2-34fd940a1fd1 req-bb6323b3-3afd-41ef-94f2-b3d004645cd9 service nova] Creating event network-vif-deleted:5f06a6b4-93a2-48ab-b3c8-3b0ad1e4647a for instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 on nch1-master-1 Mar 12 21:31:02.884039 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7f2bc46e-3944-4aa2-83b2-34fd940a1fd1 req-bb6323b3-3afd-41ef-94f2-b3d004645cd9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032475 Mar 12 21:31:02.884656 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4939/5707] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:31:02.932973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de520258-d1fe-4800-b137-eb31019cbead tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:02.933861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-de520258-d1fe-4800-b137-eb31019cbead tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:02.942266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de520258-d1fe-4800-b137-eb31019cbead tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:02.942811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de520258-d1fe-4800-b137-eb31019cbead tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:02.943709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de520258-d1fe-4800-b137-eb31019cbead tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:02.944278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de520258-d1fe-4800-b137-eb31019cbead tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:02.978448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de520258-d1fe-4800-b137-eb31019cbead tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:02.979309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de520258-d1fe-4800-b137-eb31019cbead tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:02.980280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-de520258-d1fe-4800-b137-eb31019cbead tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lazy-loading 'fault' on Instance uuid ed26d2b9-3e26-4339-83ab-d3879d00b2c3 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:31:03.024093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-de520258-d1fe-4800-b137-eb31019cbead tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:03.031812 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de520258-d1fe-4800-b137-eb31019cbead tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 200 len: 1327 microversion: 2.1 time: 0.103879 Mar 12 21:31:03.032742 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4940/5708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:02 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:31:04.049067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7e053193-0c2b-41d5-bf3f-4afa993da2cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:04.049709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7e053193-0c2b-41d5-bf3f-4afa993da2cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:04.056626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e053193-0c2b-41d5-bf3f-4afa993da2cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:04.057106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e053193-0c2b-41d5-bf3f-4afa993da2cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:04.057947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e053193-0c2b-41d5-bf3f-4afa993da2cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:04.058415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e053193-0c2b-41d5-bf3f-4afa993da2cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:04.073132 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-7e053193-0c2b-41d5-bf3f-4afa993da2cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 could not be found. Mar 12 21:31:04.073689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7e053193-0c2b-41d5-bf3f-4afa993da2cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:31:04.075109 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7e053193-0c2b-41d5-bf3f-4afa993da2cd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 404 len: 111 microversion: 2.1 time: 0.029557 Mar 12 21:31:04.075659 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4941/5709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:04 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:31:04.092126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85632c36-6bf5-40e3-9618-0e77aadd515a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:04.092749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85632c36-6bf5-40e3-9618-0e77aadd515a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:04.098628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85632c36-6bf5-40e3-9618-0e77aadd515a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:04.099099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85632c36-6bf5-40e3-9618-0e77aadd515a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:04.099874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85632c36-6bf5-40e3-9618-0e77aadd515a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:04.100326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85632c36-6bf5-40e3-9618-0e77aadd515a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:04.113694 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-85632c36-6bf5-40e3-9618-0e77aadd515a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 could not be found. Mar 12 21:31:04.114333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85632c36-6bf5-40e3-9618-0e77aadd515a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:31:04.115175 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85632c36-6bf5-40e3-9618-0e77aadd515a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 404 len: 111 microversion: 2.1 time: 0.027457 Mar 12 21:31:04.115715 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4942/5710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:04 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:31:04.163129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1915101471", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "12f207f9-0639-4c0e-8e71-ff9d17b74d28"}], "security_groups": [{"name": "tempest-securitygroup--132650578"}], "key_name": "tempest-keypair-366629006", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:04.260631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] validate_networks() for [('12f207f9-0639-4c0e-8e71-ff9d17b74d28', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:31:04.630876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:31:04.631320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:31:04.631813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:31:04.632243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:31:04.632668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:31:04.641349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:04.641838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:04.642663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:04.643113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:04.659463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:31:04.664659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for user 2dc99cab406e42d6b6cd00fddedaf960 and project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:31:04.677514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:31:04.679829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:31:04.731595 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b04a939d-b9bd-4d53-8d10-99960de8c527 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.571853 Mar 12 21:31:04.732259 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4943/5711] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:31:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:31:04.742251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-269283e2-9959-4d1e-b046-b5d58ce57f51 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:04.742882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-269283e2-9959-4d1e-b046-b5d58ce57f51 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:04.795790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-269283e2-9959-4d1e-b046-b5d58ce57f51 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:04.802693 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-269283e2-9959-4d1e-b046-b5d58ce57f51 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1238 microversion: 2.1 time: 0.064256 Mar 12 21:31:04.803283 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4944/5712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:04 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:05.821218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f0c14b49-2d3e-4ecf-ada6-26c8fb8ac107 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:05.821922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f0c14b49-2d3e-4ecf-ada6-26c8fb8ac107 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:05.833727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0c14b49-2d3e-4ecf-ada6-26c8fb8ac107 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:05.834244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0c14b49-2d3e-4ecf-ada6-26c8fb8ac107 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:05.835051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0c14b49-2d3e-4ecf-ada6-26c8fb8ac107 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:05.835509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0c14b49-2d3e-4ecf-ada6-26c8fb8ac107 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:05.907399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f0c14b49-2d3e-4ecf-ada6-26c8fb8ac107 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:05.916381 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f0c14b49-2d3e-4ecf-ada6-26c8fb8ac107 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1296 microversion: 2.1 time: 0.099356 Mar 12 21:31:05.923626 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4945/5713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:05 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:06.924024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-652d93ae-7c02-47ee-84f2-e7a713b286ba req-d0bd19fe-89d9-4992-bb66-2435858bdbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da16de87-fb6f-4d4a-8243-54261f560ec6", "tag": "2b970d05-dcc5-434e-b084-7d1b4f1f4903"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:06.935819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-652d93ae-7c02-47ee-84f2-e7a713b286ba req-d0bd19fe-89d9-4992-bb66-2435858bdbe0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:06.936745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-652d93ae-7c02-47ee-84f2-e7a713b286ba req-d0bd19fe-89d9-4992-bb66-2435858bdbe0 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:06.954029 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-652d93ae-7c02-47ee-84f2-e7a713b286ba req-d0bd19fe-89d9-4992-bb66-2435858bdbe0 service nova] Creating event network-changed:2b970d05-dcc5-434e-b084-7d1b4f1f4903 for instance da16de87-fb6f-4d4a-8243-54261f560ec6 on nch1-master-1 Mar 12 21:31:06.967736 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-652d93ae-7c02-47ee-84f2-e7a713b286ba req-d0bd19fe-89d9-4992-bb66-2435858bdbe0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047401 Mar 12 21:31:06.968447 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4946/5714] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:31:06.975684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a5758ec5-3345-4080-840c-583d8422f3d5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:06.976414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a5758ec5-3345-4080-840c-583d8422f3d5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:06.983704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5758ec5-3345-4080-840c-583d8422f3d5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:06.984421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5758ec5-3345-4080-840c-583d8422f3d5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:06.985413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5758ec5-3345-4080-840c-583d8422f3d5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:06.986044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5758ec5-3345-4080-840c-583d8422f3d5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:07.137111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a5758ec5-3345-4080-840c-583d8422f3d5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:07.144596 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a5758ec5-3345-4080-840c-583d8422f3d5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1363 microversion: 2.1 time: 0.174264 Mar 12 21:31:07.145186 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4947/5715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:06 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:31:08.161970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a80614a1-8de6-48a4-b4b8-2c9eaf2faa33 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:08.162679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a80614a1-8de6-48a4-b4b8-2c9eaf2faa33 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:08.169555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a80614a1-8de6-48a4-b4b8-2c9eaf2faa33 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:08.170059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a80614a1-8de6-48a4-b4b8-2c9eaf2faa33 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:08.170851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a80614a1-8de6-48a4-b4b8-2c9eaf2faa33 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:08.171302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a80614a1-8de6-48a4-b4b8-2c9eaf2faa33 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:08.299800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a80614a1-8de6-48a4-b4b8-2c9eaf2faa33 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:08.307350 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a80614a1-8de6-48a4-b4b8-2c9eaf2faa33 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1363 microversion: 2.1 time: 0.149475 Mar 12 21:31:08.307935 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4948/5716] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:08 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:09.325699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a029fc91-ef7b-4d2f-adb5-1f02be9e24f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:09.326361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a029fc91-ef7b-4d2f-adb5-1f02be9e24f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:09.333216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a029fc91-ef7b-4d2f-adb5-1f02be9e24f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:09.333685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a029fc91-ef7b-4d2f-adb5-1f02be9e24f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:09.334493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a029fc91-ef7b-4d2f-adb5-1f02be9e24f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:09.334947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a029fc91-ef7b-4d2f-adb5-1f02be9e24f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:09.471185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a029fc91-ef7b-4d2f-adb5-1f02be9e24f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:09.478523 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a029fc91-ef7b-4d2f-adb5-1f02be9e24f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1363 microversion: 2.1 time: 0.157415 Mar 12 21:31:09.479095 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4949/5717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:09 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:10.495879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d68838ac-8462-49c0-97b2-9bef54099192 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:10.497147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d68838ac-8462-49c0-97b2-9bef54099192 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:10.504022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d68838ac-8462-49c0-97b2-9bef54099192 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:10.504497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d68838ac-8462-49c0-97b2-9bef54099192 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:10.505286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d68838ac-8462-49c0-97b2-9bef54099192 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:10.505746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d68838ac-8462-49c0-97b2-9bef54099192 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:10.643702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d68838ac-8462-49c0-97b2-9bef54099192 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:10.651187 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d68838ac-8462-49c0-97b2-9bef54099192 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1363 microversion: 2.1 time: 0.159249 Mar 12 21:31:10.651773 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4950/5718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:10 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:11.668510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b7c4594-5ab8-4151-922a-10b6e603a0dc tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:11.669193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b7c4594-5ab8-4151-922a-10b6e603a0dc tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:11.675969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b7c4594-5ab8-4151-922a-10b6e603a0dc tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:11.676443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b7c4594-5ab8-4151-922a-10b6e603a0dc tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:11.677231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b7c4594-5ab8-4151-922a-10b6e603a0dc tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:11.677691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b7c4594-5ab8-4151-922a-10b6e603a0dc tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:11.810902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6b7c4594-5ab8-4151-922a-10b6e603a0dc tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:11.818215 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b7c4594-5ab8-4151-922a-10b6e603a0dc tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1363 microversion: 2.1 time: 0.153942 Mar 12 21:31:11.818806 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4951/5719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:11 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:12.742299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c026bc39-8361-49ab-b383-b59e0a5b1c4d req-cdbee7bd-17c9-4a97-a177-ec959b5b4633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da16de87-fb6f-4d4a-8243-54261f560ec6", "name": "network-vif-plugged", "status": "completed", "tag": "2b970d05-dcc5-434e-b084-7d1b4f1f4903"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:12.751768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c026bc39-8361-49ab-b383-b59e0a5b1c4d req-cdbee7bd-17c9-4a97-a177-ec959b5b4633 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:12.752245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c026bc39-8361-49ab-b383-b59e0a5b1c4d req-cdbee7bd-17c9-4a97-a177-ec959b5b4633 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:12.763820 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c026bc39-8361-49ab-b383-b59e0a5b1c4d req-cdbee7bd-17c9-4a97-a177-ec959b5b4633 service nova] Creating event network-vif-plugged:2b970d05-dcc5-434e-b084-7d1b4f1f4903 for instance da16de87-fb6f-4d4a-8243-54261f560ec6 on nch1-master-1 Mar 12 21:31:12.768781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c026bc39-8361-49ab-b383-b59e0a5b1c4d req-cdbee7bd-17c9-4a97-a177-ec959b5b4633 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030430 Mar 12 21:31:12.769386 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4952/5720] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:31:12.836724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-31865ad6-744b-4a45-ab1d-397b335f5d35 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:12.837368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-31865ad6-744b-4a45-ab1d-397b335f5d35 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:12.844158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31865ad6-744b-4a45-ab1d-397b335f5d35 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:12.844638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31865ad6-744b-4a45-ab1d-397b335f5d35 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:12.845427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31865ad6-744b-4a45-ab1d-397b335f5d35 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:12.845918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-31865ad6-744b-4a45-ab1d-397b335f5d35 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:12.983047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-31865ad6-744b-4a45-ab1d-397b335f5d35 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:12.990507 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-31865ad6-744b-4a45-ab1d-397b335f5d35 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1363 microversion: 2.1 time: 0.158161 Mar 12 21:31:12.991089 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4953/5721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:12 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:14.007874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c2eee699-5946-4f92-a575-4f13e6ed4ff0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:14.008547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c2eee699-5946-4f92-a575-4f13e6ed4ff0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:14.016298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2eee699-5946-4f92-a575-4f13e6ed4ff0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:14.016773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2eee699-5946-4f92-a575-4f13e6ed4ff0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:14.017619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2eee699-5946-4f92-a575-4f13e6ed4ff0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:14.018158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2eee699-5946-4f92-a575-4f13e6ed4ff0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:14.153825 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c2eee699-5946-4f92-a575-4f13e6ed4ff0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:14.161212 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c2eee699-5946-4f92-a575-4f13e6ed4ff0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1363 microversion: 2.1 time: 0.157335 Mar 12 21:31:14.161810 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4954/5722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:14 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:15.178938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d99bfdf4-1a9e-4d40-825a-9bbe3761827d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:15.179573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d99bfdf4-1a9e-4d40-825a-9bbe3761827d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:15.186913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d99bfdf4-1a9e-4d40-825a-9bbe3761827d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:15.187381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d99bfdf4-1a9e-4d40-825a-9bbe3761827d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:15.188161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d99bfdf4-1a9e-4d40-825a-9bbe3761827d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:15.188613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d99bfdf4-1a9e-4d40-825a-9bbe3761827d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:15.321295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d99bfdf4-1a9e-4d40-825a-9bbe3761827d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:15.328830 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d99bfdf4-1a9e-4d40-825a-9bbe3761827d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1551 microversion: 2.1 time: 0.153898 Mar 12 21:31:15.329400 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4955/5723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:15 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:15.344808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12ac035a-7f04-422f-a6e8-ae93f609c997 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:15.345318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-12ac035a-7f04-422f-a6e8-ae93f609c997 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:15.350950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12ac035a-7f04-422f-a6e8-ae93f609c997 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:15.351420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12ac035a-7f04-422f-a6e8-ae93f609c997 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:15.352206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12ac035a-7f04-422f-a6e8-ae93f609c997 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:15.352657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12ac035a-7f04-422f-a6e8-ae93f609c997 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:15.433365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-12ac035a-7f04-422f-a6e8-ae93f609c997 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092018 Mar 12 21:31:15.434027 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4956/5724] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 21:31:15 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:31:16.366285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75909d99-edbc-4303-92ca-f55939046b95 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:16.373054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75909d99-edbc-4303-92ca-f55939046b95 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:16.373534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75909d99-edbc-4303-92ca-f55939046b95 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:16.406134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75909d99-edbc-4303-92ca-f55939046b95 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Going to try to stop instance {{(pid=136302) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 12 21:31:16.448251 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75909d99-edbc-4303-92ca-f55939046b95 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6/action" status: 202 len: 0 microversion: 2.1 time: 0.086989 Mar 12 21:31:16.448887 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4957/5725] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:31:16 2022] POST /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:31:16.455586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-597c9f8d-d016-4832-8d73-6e84c5fa3cbb req-a4208e11-ce53-4212-977f-46178e0703b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da16de87-fb6f-4d4a-8243-54261f560ec6", "tag": "2b970d05-dcc5-434e-b084-7d1b4f1f4903"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:16.464507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-597c9f8d-d016-4832-8d73-6e84c5fa3cbb req-a4208e11-ce53-4212-977f-46178e0703b2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:16.464985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-597c9f8d-d016-4832-8d73-6e84c5fa3cbb req-a4208e11-ce53-4212-977f-46178e0703b2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:16.476731 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-597c9f8d-d016-4832-8d73-6e84c5fa3cbb req-a4208e11-ce53-4212-977f-46178e0703b2 service nova] Creating event network-changed:2b970d05-dcc5-434e-b084-7d1b4f1f4903 for instance da16de87-fb6f-4d4a-8243-54261f560ec6 on nch1-master-1 Mar 12 21:31:16.482351 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-597c9f8d-d016-4832-8d73-6e84c5fa3cbb req-a4208e11-ce53-4212-977f-46178e0703b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031340 Mar 12 21:31:16.482968 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4958/5726] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:31:16.487979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f213a0ec-7fa8-4077-b201-cd448afbc7fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:16.488724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f213a0ec-7fa8-4077-b201-cd448afbc7fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:16.494991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f213a0ec-7fa8-4077-b201-cd448afbc7fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:16.495463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f213a0ec-7fa8-4077-b201-cd448afbc7fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:16.496266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f213a0ec-7fa8-4077-b201-cd448afbc7fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:16.497448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f213a0ec-7fa8-4077-b201-cd448afbc7fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:16.646115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f213a0ec-7fa8-4077-b201-cd448afbc7fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:16.654380 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f213a0ec-7fa8-4077-b201-cd448afbc7fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1561 microversion: 2.1 time: 0.170233 Mar 12 21:31:16.655243 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4959/5727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:16 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:31:17.672173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c22ed72-36a4-4459-b22d-2966d9c94cb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:17.672849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c22ed72-36a4-4459-b22d-2966d9c94cb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:17.679631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c22ed72-36a4-4459-b22d-2966d9c94cb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:17.680109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c22ed72-36a4-4459-b22d-2966d9c94cb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:17.680905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c22ed72-36a4-4459-b22d-2966d9c94cb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:17.681369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c22ed72-36a4-4459-b22d-2966d9c94cb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:18.104967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c22ed72-36a4-4459-b22d-2966d9c94cb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:18.112863 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c22ed72-36a4-4459-b22d-2966d9c94cb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.444747 Mar 12 21:31:18.113429 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4960/5728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:17 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:19.129846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de6ba225-4c03-4def-a6ce-79f978260fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:19.130495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-de6ba225-4c03-4def-a6ce-79f978260fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:19.138089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de6ba225-4c03-4def-a6ce-79f978260fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:19.138564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de6ba225-4c03-4def-a6ce-79f978260fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:19.139359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de6ba225-4c03-4def-a6ce-79f978260fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:19.139820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de6ba225-4c03-4def-a6ce-79f978260fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:19.267662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-de6ba225-4c03-4def-a6ce-79f978260fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:19.275113 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de6ba225-4c03-4def-a6ce-79f978260fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.149367 Mar 12 21:31:19.275703 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4961/5729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:19 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:20.292965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80a8ec93-340a-4c6b-b4ed-67175e199fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:20.293679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80a8ec93-340a-4c6b-b4ed-67175e199fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:20.300542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80a8ec93-340a-4c6b-b4ed-67175e199fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:20.301020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80a8ec93-340a-4c6b-b4ed-67175e199fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:20.301841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80a8ec93-340a-4c6b-b4ed-67175e199fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:20.302310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80a8ec93-340a-4c6b-b4ed-67175e199fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:20.432743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80a8ec93-340a-4c6b-b4ed-67175e199fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:20.440229 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80a8ec93-340a-4c6b-b4ed-67175e199fb5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.151553 Mar 12 21:31:20.440812 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4962/5730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:20 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:21.458050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5465c3b4-8f7f-452f-8d63-47598bf47975 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:21.458725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5465c3b4-8f7f-452f-8d63-47598bf47975 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:21.465921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5465c3b4-8f7f-452f-8d63-47598bf47975 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:21.466387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5465c3b4-8f7f-452f-8d63-47598bf47975 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:21.467165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5465c3b4-8f7f-452f-8d63-47598bf47975 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:21.467616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5465c3b4-8f7f-452f-8d63-47598bf47975 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:21.601334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5465c3b4-8f7f-452f-8d63-47598bf47975 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:21.609409 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5465c3b4-8f7f-452f-8d63-47598bf47975 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.155312 Mar 12 21:31:21.610019 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4963/5731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:21 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:22.627267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5447c54d-113f-46e3-95d8-8413e5e708ef tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:22.627893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5447c54d-113f-46e3-95d8-8413e5e708ef tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:22.634716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5447c54d-113f-46e3-95d8-8413e5e708ef tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:22.635190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5447c54d-113f-46e3-95d8-8413e5e708ef tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:22.635976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5447c54d-113f-46e3-95d8-8413e5e708ef tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:22.636436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5447c54d-113f-46e3-95d8-8413e5e708ef tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:22.769688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5447c54d-113f-46e3-95d8-8413e5e708ef tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:22.777033 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5447c54d-113f-46e3-95d8-8413e5e708ef tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.153904 Mar 12 21:31:22.777613 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4964/5732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:22 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:23.795013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-504cdbf0-e3ea-4ac5-9737-ade03974f771 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:23.795662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-504cdbf0-e3ea-4ac5-9737-ade03974f771 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:23.802564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-504cdbf0-e3ea-4ac5-9737-ade03974f771 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:23.803038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-504cdbf0-e3ea-4ac5-9737-ade03974f771 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:23.803827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-504cdbf0-e3ea-4ac5-9737-ade03974f771 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:23.804287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-504cdbf0-e3ea-4ac5-9737-ade03974f771 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:23.935243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-504cdbf0-e3ea-4ac5-9737-ade03974f771 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:23.942528 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-504cdbf0-e3ea-4ac5-9737-ade03974f771 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.152407 Mar 12 21:31:23.943111 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4965/5733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:23 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:24.960364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-42237d70-a257-4981-8fb4-0b9b6843fc59 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:24.960982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-42237d70-a257-4981-8fb4-0b9b6843fc59 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:24.968415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42237d70-a257-4981-8fb4-0b9b6843fc59 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:24.968880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42237d70-a257-4981-8fb4-0b9b6843fc59 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:24.969688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42237d70-a257-4981-8fb4-0b9b6843fc59 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:24.970237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42237d70-a257-4981-8fb4-0b9b6843fc59 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:25.105209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-42237d70-a257-4981-8fb4-0b9b6843fc59 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:25.112803 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-42237d70-a257-4981-8fb4-0b9b6843fc59 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.156400 Mar 12 21:31:25.113315 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4966/5734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:24 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:26.130508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-93e0201c-3e97-47c7-a163-a7dfbaa2fcbb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:26.131130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-93e0201c-3e97-47c7-a163-a7dfbaa2fcbb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:26.138469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93e0201c-3e97-47c7-a163-a7dfbaa2fcbb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:26.138944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93e0201c-3e97-47c7-a163-a7dfbaa2fcbb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:26.139730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93e0201c-3e97-47c7-a163-a7dfbaa2fcbb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:26.140189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-93e0201c-3e97-47c7-a163-a7dfbaa2fcbb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:26.270138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-93e0201c-3e97-47c7-a163-a7dfbaa2fcbb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:26.277495 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-93e0201c-3e97-47c7-a163-a7dfbaa2fcbb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.151059 Mar 12 21:31:26.278143 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4967/5735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:26 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:27.294214 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3cc8b936-fd30-45cb-8d3a-57aed0cea3ee tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:27.294885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3cc8b936-fd30-45cb-8d3a-57aed0cea3ee tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:27.301725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cc8b936-fd30-45cb-8d3a-57aed0cea3ee tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:27.302226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cc8b936-fd30-45cb-8d3a-57aed0cea3ee tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:27.303021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cc8b936-fd30-45cb-8d3a-57aed0cea3ee tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:27.303482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cc8b936-fd30-45cb-8d3a-57aed0cea3ee tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:27.436603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3cc8b936-fd30-45cb-8d3a-57aed0cea3ee tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:27.444086 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3cc8b936-fd30-45cb-8d3a-57aed0cea3ee tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.154093 Mar 12 21:31:27.444664 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4968/5736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:27 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:28.462148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-734fcf73-b2eb-49f4-a694-b9bfff551fc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:28.462812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-734fcf73-b2eb-49f4-a694-b9bfff551fc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:28.469342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-734fcf73-b2eb-49f4-a694-b9bfff551fc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:28.469834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-734fcf73-b2eb-49f4-a694-b9bfff551fc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:28.470616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-734fcf73-b2eb-49f4-a694-b9bfff551fc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:28.471074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-734fcf73-b2eb-49f4-a694-b9bfff551fc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:28.609256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-734fcf73-b2eb-49f4-a694-b9bfff551fc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:28.616788 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-734fcf73-b2eb-49f4-a694-b9bfff551fc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.158844 Mar 12 21:31:28.617376 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4969/5737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:28 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:29.634276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34138b6b-381d-48a9-9d01-920c8de801e2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:29.634934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34138b6b-381d-48a9-9d01-920c8de801e2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:29.641886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34138b6b-381d-48a9-9d01-920c8de801e2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:29.642723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34138b6b-381d-48a9-9d01-920c8de801e2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:29.643536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34138b6b-381d-48a9-9d01-920c8de801e2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:29.643998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34138b6b-381d-48a9-9d01-920c8de801e2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:29.777108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34138b6b-381d-48a9-9d01-920c8de801e2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:29.785150 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34138b6b-381d-48a9-9d01-920c8de801e2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.154915 Mar 12 21:31:29.785730 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4970/5738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:29 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:30.803245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-548940d2-b3ae-44b0-947b-707a95ba5c07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:30.803952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-548940d2-b3ae-44b0-947b-707a95ba5c07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:30.811276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-548940d2-b3ae-44b0-947b-707a95ba5c07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:30.811741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-548940d2-b3ae-44b0-947b-707a95ba5c07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:30.812522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-548940d2-b3ae-44b0-947b-707a95ba5c07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:30.812976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-548940d2-b3ae-44b0-947b-707a95ba5c07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:30.945352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-548940d2-b3ae-44b0-947b-707a95ba5c07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:30.953010 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-548940d2-b3ae-44b0-947b-707a95ba5c07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.153775 Mar 12 21:31:30.953591 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4971/5739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:30 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:31.970506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc53c39c-dba4-49e4-b9fc-116576d85c62 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:31.971329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc53c39c-dba4-49e4-b9fc-116576d85c62 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:31.978552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc53c39c-dba4-49e4-b9fc-116576d85c62 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:31.979022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc53c39c-dba4-49e4-b9fc-116576d85c62 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:31.979828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc53c39c-dba4-49e4-b9fc-116576d85c62 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:31.980289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc53c39c-dba4-49e4-b9fc-116576d85c62 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:32.113616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dc53c39c-dba4-49e4-b9fc-116576d85c62 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:32.121146 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc53c39c-dba4-49e4-b9fc-116576d85c62 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.154685 Mar 12 21:31:32.122276 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4972/5740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:31 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:33.139120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c43d619-8b8c-4f39-8cab-d5ddffd46d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:33.139758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c43d619-8b8c-4f39-8cab-d5ddffd46d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:33.146478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c43d619-8b8c-4f39-8cab-d5ddffd46d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:33.146953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c43d619-8b8c-4f39-8cab-d5ddffd46d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:33.147734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c43d619-8b8c-4f39-8cab-d5ddffd46d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:33.148184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c43d619-8b8c-4f39-8cab-d5ddffd46d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:33.276983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c43d619-8b8c-4f39-8cab-d5ddffd46d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:33.284374 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c43d619-8b8c-4f39-8cab-d5ddffd46d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.149350 Mar 12 21:31:33.284960 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4973/5741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:33 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:34.302338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9959f26b-41bb-4fba-931b-9d512c8d235a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:34.303079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9959f26b-41bb-4fba-931b-9d512c8d235a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:34.309764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9959f26b-41bb-4fba-931b-9d512c8d235a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:34.310263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9959f26b-41bb-4fba-931b-9d512c8d235a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:34.311040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9959f26b-41bb-4fba-931b-9d512c8d235a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:34.311492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9959f26b-41bb-4fba-931b-9d512c8d235a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:34.447720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9959f26b-41bb-4fba-931b-9d512c8d235a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:34.455755 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9959f26b-41bb-4fba-931b-9d512c8d235a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.157284 Mar 12 21:31:34.456340 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4974/5742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:34 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:35.473364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ec53fea5-f275-4b53-8c70-c4ecc2b92bf2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:35.474026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ec53fea5-f275-4b53-8c70-c4ecc2b92bf2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:35.481459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec53fea5-f275-4b53-8c70-c4ecc2b92bf2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:35.481960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec53fea5-f275-4b53-8c70-c4ecc2b92bf2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:35.482735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec53fea5-f275-4b53-8c70-c4ecc2b92bf2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:35.483189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ec53fea5-f275-4b53-8c70-c4ecc2b92bf2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:35.616832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ec53fea5-f275-4b53-8c70-c4ecc2b92bf2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:35.624849 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ec53fea5-f275-4b53-8c70-c4ecc2b92bf2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.155388 Mar 12 21:31:35.625439 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4975/5743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:35 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:36.642913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a70e6471-0f64-41b2-bb19-52405b089451 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:36.643594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a70e6471-0f64-41b2-bb19-52405b089451 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:36.654561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a70e6471-0f64-41b2-bb19-52405b089451 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:36.655455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a70e6471-0f64-41b2-bb19-52405b089451 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:36.656266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a70e6471-0f64-41b2-bb19-52405b089451 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:36.656719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a70e6471-0f64-41b2-bb19-52405b089451 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:36.793796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a70e6471-0f64-41b2-bb19-52405b089451 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:36.801136 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a70e6471-0f64-41b2-bb19-52405b089451 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.162192 Mar 12 21:31:36.801714 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4976/5744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:36 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:37.818688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-17a53553-21b8-45b6-89b9-853256d22fc3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:37.819351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-17a53553-21b8-45b6-89b9-853256d22fc3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:37.826141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17a53553-21b8-45b6-89b9-853256d22fc3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:37.826622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17a53553-21b8-45b6-89b9-853256d22fc3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:37.827412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17a53553-21b8-45b6-89b9-853256d22fc3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:37.827873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-17a53553-21b8-45b6-89b9-853256d22fc3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:37.964343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-17a53553-21b8-45b6-89b9-853256d22fc3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:37.972907 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-17a53553-21b8-45b6-89b9-853256d22fc3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.158197 Mar 12 21:31:37.973498 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4977/5745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:37 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:38.990947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-093ca547-da07-43dd-a908-bb2a952036ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:38.991631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-093ca547-da07-43dd-a908-bb2a952036ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:38.998353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-093ca547-da07-43dd-a908-bb2a952036ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:38.998820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-093ca547-da07-43dd-a908-bb2a952036ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:38.999600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-093ca547-da07-43dd-a908-bb2a952036ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:39.000055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-093ca547-da07-43dd-a908-bb2a952036ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:39.135426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-093ca547-da07-43dd-a908-bb2a952036ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:39.143465 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-093ca547-da07-43dd-a908-bb2a952036ad tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.156466 Mar 12 21:31:39.144044 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4978/5746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:38 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:40.162271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-36d08d01-9406-48c8-b6f2-308b62281fec tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:40.162900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-36d08d01-9406-48c8-b6f2-308b62281fec tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:40.171353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36d08d01-9406-48c8-b6f2-308b62281fec tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:40.171820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36d08d01-9406-48c8-b6f2-308b62281fec tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:40.172608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36d08d01-9406-48c8-b6f2-308b62281fec tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:40.173139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-36d08d01-9406-48c8-b6f2-308b62281fec tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:40.302744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-36d08d01-9406-48c8-b6f2-308b62281fec tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:40.310136 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-36d08d01-9406-48c8-b6f2-308b62281fec tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.152267 Mar 12 21:31:40.310725 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4979/5747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:40 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:31:41.327532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-95858536-bc1b-49a6-be6e-a64b4c7cd738 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:41.328166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-95858536-bc1b-49a6-be6e-a64b4c7cd738 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:41.334994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95858536-bc1b-49a6-be6e-a64b4c7cd738 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:41.335462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95858536-bc1b-49a6-be6e-a64b4c7cd738 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:41.336250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95858536-bc1b-49a6-be6e-a64b4c7cd738 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:41.336707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-95858536-bc1b-49a6-be6e-a64b4c7cd738 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:41.465327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-95858536-bc1b-49a6-be6e-a64b4c7cd738 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:41.472711 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-95858536-bc1b-49a6-be6e-a64b4c7cd738 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.149239 Mar 12 21:31:41.473293 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4980/5748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:41 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:42.490454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3e78d47a-3466-4c7e-94dc-1b14f1a069af tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:42.491184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3e78d47a-3466-4c7e-94dc-1b14f1a069af tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:42.498430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e78d47a-3466-4c7e-94dc-1b14f1a069af tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:42.498906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e78d47a-3466-4c7e-94dc-1b14f1a069af tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:42.499693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e78d47a-3466-4c7e-94dc-1b14f1a069af tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:42.500179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e78d47a-3466-4c7e-94dc-1b14f1a069af tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:42.642355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3e78d47a-3466-4c7e-94dc-1b14f1a069af tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:42.650026 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3e78d47a-3466-4c7e-94dc-1b14f1a069af tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1657 microversion: 2.1 time: 0.163427 Mar 12 21:31:42.650630 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4981/5749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:42 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1657 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:42.667275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:42.668894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:42.675103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:42.675647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:42.676449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:42.676907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:42.704770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:42.710799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Old instance type m1.heat2, new instance type m1.heat {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 21:31:42.717781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:31:42.718239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:31:42.718740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:31:42.719171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:31:42.719604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:31:42.788909 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-441f38c7-a11d-4adb-b616-2e2cf9446ff9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6/action" status: 202 len: 0 microversion: 2.1 time: 0.125749 Mar 12 21:31:42.789425 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4982/5750] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:31:42 2022] POST /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:31:42.797561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b982cbe-8ba2-4dc1-a314-748af039e366 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:42.798318 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b982cbe-8ba2-4dc1-a314-748af039e366 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:42.804371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b982cbe-8ba2-4dc1-a314-748af039e366 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:42.804934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b982cbe-8ba2-4dc1-a314-748af039e366 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:42.805847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b982cbe-8ba2-4dc1-a314-748af039e366 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:42.806303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b982cbe-8ba2-4dc1-a314-748af039e366 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:42.952781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b982cbe-8ba2-4dc1-a314-748af039e366 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:42.961849 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b982cbe-8ba2-4dc1-a314-748af039e366 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.167990 Mar 12 21:31:42.962434 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4983/5751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:42 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:43.980013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8a20e769-2ed5-429c-a9e9-69627d3fc78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:43.980805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8a20e769-2ed5-429c-a9e9-69627d3fc78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:43.987956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a20e769-2ed5-429c-a9e9-69627d3fc78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:43.988507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a20e769-2ed5-429c-a9e9-69627d3fc78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:43.989254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a20e769-2ed5-429c-a9e9-69627d3fc78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:43.989741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8a20e769-2ed5-429c-a9e9-69627d3fc78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:44.131558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8a20e769-2ed5-429c-a9e9-69627d3fc78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:44.139627 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8a20e769-2ed5-429c-a9e9-69627d3fc78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1680 microversion: 2.1 time: 0.163634 Mar 12 21:31:44.140231 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4984/5752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:43 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:45.157307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a71bc793-0d44-4c45-a192-aaac737d1023 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:45.158035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a71bc793-0d44-4c45-a192-aaac737d1023 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:45.164841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a71bc793-0d44-4c45-a192-aaac737d1023 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:45.165315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a71bc793-0d44-4c45-a192-aaac737d1023 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:45.166399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a71bc793-0d44-4c45-a192-aaac737d1023 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:45.166860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a71bc793-0d44-4c45-a192-aaac737d1023 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:45.296861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a71bc793-0d44-4c45-a192-aaac737d1023 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:45.304366 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a71bc793-0d44-4c45-a192-aaac737d1023 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1685 microversion: 2.1 time: 0.151697 Mar 12 21:31:45.304941 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4985/5753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:45 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:46.321712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e4fca144-50f4-499b-8659-8cef08c5e78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:46.322370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e4fca144-50f4-499b-8659-8cef08c5e78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:46.329758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4fca144-50f4-499b-8659-8cef08c5e78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:46.330267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4fca144-50f4-499b-8659-8cef08c5e78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:46.331063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4fca144-50f4-499b-8659-8cef08c5e78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:46.331522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e4fca144-50f4-499b-8659-8cef08c5e78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:46.465570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e4fca144-50f4-499b-8659-8cef08c5e78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:46.474097 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e4fca144-50f4-499b-8659-8cef08c5e78d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1685 microversion: 2.1 time: 0.156275 Mar 12 21:31:46.474691 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4986/5754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:46 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:46.960668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-60d5dd2c-9aae-4643-ab60-659060de3b3a req-22adb456-4a26-490e-b0f2-9d773bcf8171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da16de87-fb6f-4d4a-8243-54261f560ec6", "name": "network-vif-unplugged", "status": "completed", "tag": "2b970d05-dcc5-434e-b084-7d1b4f1f4903"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:46.970042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-60d5dd2c-9aae-4643-ab60-659060de3b3a req-22adb456-4a26-490e-b0f2-9d773bcf8171 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:46.970591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-60d5dd2c-9aae-4643-ab60-659060de3b3a req-22adb456-4a26-490e-b0f2-9d773bcf8171 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:46.986084 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-60d5dd2c-9aae-4643-ab60-659060de3b3a req-22adb456-4a26-490e-b0f2-9d773bcf8171 service nova] Creating event network-vif-unplugged:2b970d05-dcc5-434e-b084-7d1b4f1f4903 for instance da16de87-fb6f-4d4a-8243-54261f560ec6 on nch2-master-1 Mar 12 21:31:46.991629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-60d5dd2c-9aae-4643-ab60-659060de3b3a req-22adb456-4a26-490e-b0f2-9d773bcf8171 service nova] Instance da16de87-fb6f-4d4a-8243-54261f560ec6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:31:47.002469 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-60d5dd2c-9aae-4643-ab60-659060de3b3a req-22adb456-4a26-490e-b0f2-9d773bcf8171 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045552 Mar 12 21:31:47.003755 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4987/5755] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:31:47.494902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26c34cff-cec2-460d-9689-87c180a09553 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:47.495625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-26c34cff-cec2-460d-9689-87c180a09553 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:47.502242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26c34cff-cec2-460d-9689-87c180a09553 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:47.502929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26c34cff-cec2-460d-9689-87c180a09553 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:47.503928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26c34cff-cec2-460d-9689-87c180a09553 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:47.504384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26c34cff-cec2-460d-9689-87c180a09553 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:47.650108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-26c34cff-cec2-460d-9689-87c180a09553 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:47.657719 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-26c34cff-cec2-460d-9689-87c180a09553 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1684 microversion: 2.1 time: 0.167931 Mar 12 21:31:47.658333 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4988/5756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:47 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:48.675020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b3a2fe7c-9ff9-4bd4-a29e-70809e546a1b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:48.675668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b3a2fe7c-9ff9-4bd4-a29e-70809e546a1b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:48.682454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3a2fe7c-9ff9-4bd4-a29e-70809e546a1b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:48.682930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3a2fe7c-9ff9-4bd4-a29e-70809e546a1b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:48.684236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3a2fe7c-9ff9-4bd4-a29e-70809e546a1b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:48.684694 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b3a2fe7c-9ff9-4bd4-a29e-70809e546a1b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:48.816185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b3a2fe7c-9ff9-4bd4-a29e-70809e546a1b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:48.825535 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b3a2fe7c-9ff9-4bd4-a29e-70809e546a1b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1682 microversion: 2.1 time: 0.153496 Mar 12 21:31:48.826236 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4989/5757] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:48 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:49.019547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8a4f56a4-5d05-4270-b00a-ccb9509adba6 req-104aa247-7b5c-45e8-a9b0-22ec0c0ff752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da16de87-fb6f-4d4a-8243-54261f560ec6", "tag": "2b970d05-dcc5-434e-b084-7d1b4f1f4903"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:49.027709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8a4f56a4-5d05-4270-b00a-ccb9509adba6 req-104aa247-7b5c-45e8-a9b0-22ec0c0ff752 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:49.028172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8a4f56a4-5d05-4270-b00a-ccb9509adba6 req-104aa247-7b5c-45e8-a9b0-22ec0c0ff752 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:49.040580 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8a4f56a4-5d05-4270-b00a-ccb9509adba6 req-104aa247-7b5c-45e8-a9b0-22ec0c0ff752 service nova] Creating event network-changed:2b970d05-dcc5-434e-b084-7d1b4f1f4903 for instance da16de87-fb6f-4d4a-8243-54261f560ec6 on nch2-master-1 Mar 12 21:31:49.047024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-8a4f56a4-5d05-4270-b00a-ccb9509adba6 req-104aa247-7b5c-45e8-a9b0-22ec0c0ff752 service nova] Instance da16de87-fb6f-4d4a-8243-54261f560ec6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:31:49.058304 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8a4f56a4-5d05-4270-b00a-ccb9509adba6 req-104aa247-7b5c-45e8-a9b0-22ec0c0ff752 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042355 Mar 12 21:31:49.059530 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4990/5758] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:31:49.845463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c7c8365-1c07-49b4-9284-c3472a7d339c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:49.846223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c7c8365-1c07-49b4-9284-c3472a7d339c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:49.852364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c7c8365-1c07-49b4-9284-c3472a7d339c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:49.852834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c7c8365-1c07-49b4-9284-c3472a7d339c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:49.853616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c7c8365-1c07-49b4-9284-c3472a7d339c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:49.854115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c7c8365-1c07-49b4-9284-c3472a7d339c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:50.014399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4c7c8365-1c07-49b4-9284-c3472a7d339c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:50.021910 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4c7c8365-1c07-49b4-9284-c3472a7d339c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1678 microversion: 2.1 time: 0.182591 Mar 12 21:31:50.022486 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4991/5759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:49 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:31:50.038716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-680b0195-2060-4a84-8c52-3e2f23c4d1b9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:50.039266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-680b0195-2060-4a84-8c52-3e2f23c4d1b9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:50.045409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-680b0195-2060-4a84-8c52-3e2f23c4d1b9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:50.045913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-680b0195-2060-4a84-8c52-3e2f23c4d1b9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:50.046773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-680b0195-2060-4a84-8c52-3e2f23c4d1b9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:50.047480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-680b0195-2060-4a84-8c52-3e2f23c4d1b9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:50.107205 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-680b0195-2060-4a84-8c52-3e2f23c4d1b9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6/action" status: 204 len: 0 microversion: 2.1 time: 0.072132 Mar 12 21:31:50.107910 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4992/5760] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:31:50 2022] POST /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:31:50.116753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e933b351-12de-4ea7-95f3-07a3a5632c72 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:50.117478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e933b351-12de-4ea7-95f3-07a3a5632c72 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:50.124794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e933b351-12de-4ea7-95f3-07a3a5632c72 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:50.125258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e933b351-12de-4ea7-95f3-07a3a5632c72 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:50.126270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e933b351-12de-4ea7-95f3-07a3a5632c72 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:50.126884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e933b351-12de-4ea7-95f3-07a3a5632c72 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:50.277713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e933b351-12de-4ea7-95f3-07a3a5632c72 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:50.285322 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e933b351-12de-4ea7-95f3-07a3a5632c72 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1678 microversion: 2.1 time: 0.173083 Mar 12 21:31:50.286302 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4993/5761] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:50 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:51.304569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-44be51be-dd8f-4eed-b7c5-8903da096c10 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:51.305636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-44be51be-dd8f-4eed-b7c5-8903da096c10 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:51.312958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44be51be-dd8f-4eed-b7c5-8903da096c10 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:51.313571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44be51be-dd8f-4eed-b7c5-8903da096c10 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:51.314415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44be51be-dd8f-4eed-b7c5-8903da096c10 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:51.315066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-44be51be-dd8f-4eed-b7c5-8903da096c10 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:51.478861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-44be51be-dd8f-4eed-b7c5-8903da096c10 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:51.486388 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-44be51be-dd8f-4eed-b7c5-8903da096c10 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1657 microversion: 2.1 time: 0.186495 Mar 12 21:31:51.486973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4994/5762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:51 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1657 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:51.502706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b3f4c97-a040-4760-ba4e-32f8d4116ffb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:51.503325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b3f4c97-a040-4760-ba4e-32f8d4116ffb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:51.508860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b3f4c97-a040-4760-ba4e-32f8d4116ffb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:51.509326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b3f4c97-a040-4760-ba4e-32f8d4116ffb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:51.510133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b3f4c97-a040-4760-ba4e-32f8d4116ffb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:51.510583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b3f4c97-a040-4760-ba4e-32f8d4116ffb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:51.653406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8b3f4c97-a040-4760-ba4e-32f8d4116ffb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:51.661046 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b3f4c97-a040-4760-ba4e-32f8d4116ffb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1657 microversion: 2.1 time: 0.161895 Mar 12 21:31:51.661670 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4995/5763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:51 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1657 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:51.677562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-735e6ac5-01b5-4a04-ba0f-081c3e520ace tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:51.683547 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-735e6ac5-01b5-4a04-ba0f-081c3e520ace tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:51.684022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-735e6ac5-01b5-4a04-ba0f-081c3e520ace tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:51.707087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-735e6ac5-01b5-4a04-ba0f-081c3e520ace tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Going to try to start instance {{(pid=136302) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 12 21:31:51.746764 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-735e6ac5-01b5-4a04-ba0f-081c3e520ace tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6/action" status: 202 len: 0 microversion: 2.1 time: 0.072645 Mar 12 21:31:51.747899 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4996/5764] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:31:51 2022] POST /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:31:51.756919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-245f22e4-8290-4cca-aa01-183236129cc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:51.757638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-245f22e4-8290-4cca-aa01-183236129cc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:51.764975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-245f22e4-8290-4cca-aa01-183236129cc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:51.765498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-245f22e4-8290-4cca-aa01-183236129cc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:51.766322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-245f22e4-8290-4cca-aa01-183236129cc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:51.766878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-245f22e4-8290-4cca-aa01-183236129cc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:51.903906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-245f22e4-8290-4cca-aa01-183236129cc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:51.911499 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-245f22e4-8290-4cca-aa01-183236129cc2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1666 microversion: 2.1 time: 0.158727 Mar 12 21:31:51.912092 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4997/5765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:51 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:52.929903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b26d6c9-a07b-47a0-b683-96b063102ee2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:52.930549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b26d6c9-a07b-47a0-b683-96b063102ee2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:52.937871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b26d6c9-a07b-47a0-b683-96b063102ee2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:52.938361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b26d6c9-a07b-47a0-b683-96b063102ee2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:52.939156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b26d6c9-a07b-47a0-b683-96b063102ee2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:52.939618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b26d6c9-a07b-47a0-b683-96b063102ee2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:53.079658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b26d6c9-a07b-47a0-b683-96b063102ee2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:53.087263 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b26d6c9-a07b-47a0-b683-96b063102ee2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1670 microversion: 2.1 time: 0.161398 Mar 12 21:31:53.087849 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4998/5766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:52 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:53.099638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5f27f293-49cc-45bf-a2f7-8255780c6a93 req-0c26a20b-a8a4-4279-8d1f-6ecd7d03271e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da16de87-fb6f-4d4a-8243-54261f560ec6", "name": "network-vif-plugged", "status": "completed", "tag": "2b970d05-dcc5-434e-b084-7d1b4f1f4903"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:53.107778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5f27f293-49cc-45bf-a2f7-8255780c6a93 req-0c26a20b-a8a4-4279-8d1f-6ecd7d03271e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:53.108313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5f27f293-49cc-45bf-a2f7-8255780c6a93 req-0c26a20b-a8a4-4279-8d1f-6ecd7d03271e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:53.121445 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5f27f293-49cc-45bf-a2f7-8255780c6a93 req-0c26a20b-a8a4-4279-8d1f-6ecd7d03271e service nova] Creating event network-vif-plugged:2b970d05-dcc5-434e-b084-7d1b4f1f4903 for instance da16de87-fb6f-4d4a-8243-54261f560ec6 on nch2-master-1 Mar 12 21:31:53.126847 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5f27f293-49cc-45bf-a2f7-8255780c6a93 req-0c26a20b-a8a4-4279-8d1f-6ecd7d03271e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037886 Mar 12 21:31:53.127447 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 4999/5767] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:31:53.132407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-064a413e-09a9-487d-841f-982590166089 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:53.133007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-064a413e-09a9-487d-841f-982590166089 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:53.139657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-064a413e-09a9-487d-841f-982590166089 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:53.140126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-064a413e-09a9-487d-841f-982590166089 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:53.140907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-064a413e-09a9-487d-841f-982590166089 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:53.141361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-064a413e-09a9-487d-841f-982590166089 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:53.154357 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:31:53.154866 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:31:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:31:53.166501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-064a413e-09a9-487d-841f-982590166089 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:31:53.239184 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-064a413e-09a9-487d-841f-982590166089 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "DELETE /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 204 len: 0 microversion: 2.1 time: 0.110266 Mar 12 21:31:53.239789 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5000/5768] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:31:53 2022] DELETE /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:31:53.248731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b2233f64-981c-4f55-b606-b633cff3bd07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:53.249451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b2233f64-981c-4f55-b606-b633cff3bd07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:53.255277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2233f64-981c-4f55-b606-b633cff3bd07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:53.255746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2233f64-981c-4f55-b606-b633cff3bd07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:53.256532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2233f64-981c-4f55-b606-b633cff3bd07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:53.256989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b2233f64-981c-4f55-b606-b633cff3bd07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:53.392270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b2233f64-981c-4f55-b606-b633cff3bd07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:53.399787 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b2233f64-981c-4f55-b606-b633cff3bd07 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1676 microversion: 2.1 time: 0.155682 Mar 12 21:31:53.400368 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5001/5769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:53 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:54.417181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-531b90d7-9288-4370-87c2-197d45bd7021 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:54.417883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-531b90d7-9288-4370-87c2-197d45bd7021 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:54.424699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-531b90d7-9288-4370-87c2-197d45bd7021 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:54.425169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-531b90d7-9288-4370-87c2-197d45bd7021 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:54.426018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-531b90d7-9288-4370-87c2-197d45bd7021 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:54.426500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-531b90d7-9288-4370-87c2-197d45bd7021 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:54.567816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-531b90d7-9288-4370-87c2-197d45bd7021 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:54.581863 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-531b90d7-9288-4370-87c2-197d45bd7021 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 200 len: 1676 microversion: 2.1 time: 0.168827 Mar 12 21:31:54.584110 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5002/5770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:54 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:55.361357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-1a17a44e-be75-4bbe-9943-b557949bfe10 req-b353f072-3926-4209-ac43-24eb1ba89cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da16de87-fb6f-4d4a-8243-54261f560ec6", "name": "network-vif-deleted", "tag": "2b970d05-dcc5-434e-b084-7d1b4f1f4903"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:55.380853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1a17a44e-be75-4bbe-9943-b557949bfe10 req-b353f072-3926-4209-ac43-24eb1ba89cd1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:55.381916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-1a17a44e-be75-4bbe-9943-b557949bfe10 req-b353f072-3926-4209-ac43-24eb1ba89cd1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:55.394648 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-1a17a44e-be75-4bbe-9943-b557949bfe10 req-b353f072-3926-4209-ac43-24eb1ba89cd1 service nova] Creating event network-vif-deleted:2b970d05-dcc5-434e-b084-7d1b4f1f4903 for instance da16de87-fb6f-4d4a-8243-54261f560ec6 on nch2-master-1 Mar 12 21:31:55.399590 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-1a17a44e-be75-4bbe-9943-b557949bfe10 req-b353f072-3926-4209-ac43-24eb1ba89cd1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042907 Mar 12 21:31:55.400535 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5003/5771] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:31:55.605518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb43c390-8fa2-4b4a-904a-6cd81c45863e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:55.606235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb43c390-8fa2-4b4a-904a-6cd81c45863e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:55.606470 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:31:55.606863 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:31:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:31:55.617002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb43c390-8fa2-4b4a-904a-6cd81c45863e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:55.617633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb43c390-8fa2-4b4a-904a-6cd81c45863e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:55.618469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb43c390-8fa2-4b4a-904a-6cd81c45863e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:55.619011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb43c390-8fa2-4b4a-904a-6cd81c45863e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:55.633605 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bb43c390-8fa2-4b4a-904a-6cd81c45863e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance da16de87-fb6f-4d4a-8243-54261f560ec6 could not be found. Mar 12 21:31:55.634255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb43c390-8fa2-4b4a-904a-6cd81c45863e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance da16de87-fb6f-4d4a-8243-54261f560ec6 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:31:55.635121 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb43c390-8fa2-4b4a-904a-6cd81c45863e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 404 len: 111 microversion: 2.1 time: 0.034148 Mar 12 21:31:55.636024 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5004/5772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:55 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:31:55.656123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-013e5599-a0be-4ab5-8e50-02c9b332a537 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:55.656766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-013e5599-a0be-4ab5-8e50-02c9b332a537 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:55.663261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-013e5599-a0be-4ab5-8e50-02c9b332a537 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:55.663724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-013e5599-a0be-4ab5-8e50-02c9b332a537 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:55.664530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-013e5599-a0be-4ab5-8e50-02c9b332a537 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:55.664991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-013e5599-a0be-4ab5-8e50-02c9b332a537 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:55.679580 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-013e5599-a0be-4ab5-8e50-02c9b332a537 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance da16de87-fb6f-4d4a-8243-54261f560ec6 could not be found. Mar 12 21:31:55.680230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-013e5599-a0be-4ab5-8e50-02c9b332a537 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance da16de87-fb6f-4d4a-8243-54261f560ec6 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:31:55.681091 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-013e5599-a0be-4ab5-8e50-02c9b332a537 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 404 len: 111 microversion: 2.1 time: 0.030242 Mar 12 21:31:55.681663 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5005/5773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:55 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 12 21:31:55.729082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2014156177", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "12f207f9-0639-4c0e-8e71-ff9d17b74d28"}], "security_groups": [{"name": "tempest-securitygroup--132650578"}], "key_name": "tempest-keypair-366629006", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:55.828358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] validate_networks() for [('12f207f9-0639-4c0e-8e71-ff9d17b74d28', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:31:56.200857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:31:56.201402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:31:56.202020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:31:56.202541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:31:56.202980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:31:56.212453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:56.212933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:56.213790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:56.214265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:56.233141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:31:56.239286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for user 2dc99cab406e42d6b6cd00fddedaf960 and project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:31:56.253539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:31:56.255973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:31:56.302959 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2218a622-d268-4ccb-9ab1-50adc9e3f5f0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.577935 Mar 12 21:31:56.303973 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5006/5774] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:31:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:31:56.314279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7cc040ec-fe46-45bc-9b8b-9be72589fcf0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:56.314925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7cc040ec-fe46-45bc-9b8b-9be72589fcf0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:56.370328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7cc040ec-fe46-45bc-9b8b-9be72589fcf0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:56.378269 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7cc040ec-fe46-45bc-9b8b-9be72589fcf0 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1238 microversion: 2.1 time: 0.067780 Mar 12 21:31:56.379227 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5007/5775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:56 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:31:57.395890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e0b20cce-6f5e-4f6b-a8ff-6e0d9c0835f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:57.396621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e0b20cce-6f5e-4f6b-a8ff-6e0d9c0835f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:57.405059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0b20cce-6f5e-4f6b-a8ff-6e0d9c0835f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:57.405607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0b20cce-6f5e-4f6b-a8ff-6e0d9c0835f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:57.406499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0b20cce-6f5e-4f6b-a8ff-6e0d9c0835f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:57.406961 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0b20cce-6f5e-4f6b-a8ff-6e0d9c0835f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:57.467829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e0b20cce-6f5e-4f6b-a8ff-6e0d9c0835f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:57.475448 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e0b20cce-6f5e-4f6b-a8ff-6e0d9c0835f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1296 microversion: 2.1 time: 0.083451 Mar 12 21:31:57.476060 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5008/5776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:57 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:58.494656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a00b4c6-ce4d-4cf9-89e8-00b5cdbc7ab4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:58.495345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0a00b4c6-ce4d-4cf9-89e8-00b5cdbc7ab4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:58.502483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a00b4c6-ce4d-4cf9-89e8-00b5cdbc7ab4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:58.502948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a00b4c6-ce4d-4cf9-89e8-00b5cdbc7ab4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:58.503759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a00b4c6-ce4d-4cf9-89e8-00b5cdbc7ab4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:58.504211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a00b4c6-ce4d-4cf9-89e8-00b5cdbc7ab4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:58.649603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0a00b4c6-ce4d-4cf9-89e8-00b5cdbc7ab4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:58.657431 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0a00b4c6-ce4d-4cf9-89e8-00b5cdbc7ab4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1363 microversion: 2.1 time: 0.166918 Mar 12 21:31:58.658492 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5009/5777] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:58 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:31:58.811299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-063040f6-d713-409e-ae8e-38fd682cc20b req-3d9da23c-384f-48e6-9e68-79b45acc6195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded972f1-262c-4c1a-b251-b07330eb837d", "tag": "6e20a880-4f4c-412b-aedb-854242fc65b5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:31:58.823005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-063040f6-d713-409e-ae8e-38fd682cc20b req-3d9da23c-384f-48e6-9e68-79b45acc6195 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:58.823478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-063040f6-d713-409e-ae8e-38fd682cc20b req-3d9da23c-384f-48e6-9e68-79b45acc6195 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:58.842929 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-063040f6-d713-409e-ae8e-38fd682cc20b req-3d9da23c-384f-48e6-9e68-79b45acc6195 service nova] Creating event network-changed:6e20a880-4f4c-412b-aedb-854242fc65b5 for instance ded972f1-262c-4c1a-b251-b07330eb837d on nch1-master-1 Mar 12 21:31:58.847820 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-063040f6-d713-409e-ae8e-38fd682cc20b req-3d9da23c-384f-48e6-9e68-79b45acc6195 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041276 Mar 12 21:31:58.848833 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5010/5778] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:31:59.676995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e1255c1f-490e-4930-8d2f-92089b58d64c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:31:59.677746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e1255c1f-490e-4930-8d2f-92089b58d64c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:31:59.684036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1255c1f-490e-4930-8d2f-92089b58d64c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:59.685036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1255c1f-490e-4930-8d2f-92089b58d64c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:59.685850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1255c1f-490e-4930-8d2f-92089b58d64c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:31:59.686306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e1255c1f-490e-4930-8d2f-92089b58d64c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:31:59.820231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e1255c1f-490e-4930-8d2f-92089b58d64c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:31:59.828760 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e1255c1f-490e-4930-8d2f-92089b58d64c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1363 microversion: 2.1 time: 0.157104 Mar 12 21:31:59.829340 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5011/5779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:31:59 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:00.846613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20b8f046-03ba-497a-959b-898037a9b902 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:00.847298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20b8f046-03ba-497a-959b-898037a9b902 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:00.854808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20b8f046-03ba-497a-959b-898037a9b902 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:00.855286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20b8f046-03ba-497a-959b-898037a9b902 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:00.856102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20b8f046-03ba-497a-959b-898037a9b902 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:00.856563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20b8f046-03ba-497a-959b-898037a9b902 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:00.990139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-20b8f046-03ba-497a-959b-898037a9b902 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:00.997543 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20b8f046-03ba-497a-959b-898037a9b902 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1363 microversion: 2.1 time: 0.154990 Mar 12 21:32:00.998152 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5012/5780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:00 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:02.015110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8fd51a60-f931-4fdf-86ec-0b3208aee198 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:02.015775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8fd51a60-f931-4fdf-86ec-0b3208aee198 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:02.022582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fd51a60-f931-4fdf-86ec-0b3208aee198 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:02.023060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fd51a60-f931-4fdf-86ec-0b3208aee198 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:02.023887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fd51a60-f931-4fdf-86ec-0b3208aee198 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:02.024348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fd51a60-f931-4fdf-86ec-0b3208aee198 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:02.159013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8fd51a60-f931-4fdf-86ec-0b3208aee198 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:02.166699 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8fd51a60-f931-4fdf-86ec-0b3208aee198 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1363 microversion: 2.1 time: 0.155330 Mar 12 21:32:02.167275 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5013/5781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:02 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:03.184606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-272dc3cf-427e-49d6-809a-2076f56e5be7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:03.185292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-272dc3cf-427e-49d6-809a-2076f56e5be7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:03.192280 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-272dc3cf-427e-49d6-809a-2076f56e5be7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:03.192754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-272dc3cf-427e-49d6-809a-2076f56e5be7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:03.193578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-272dc3cf-427e-49d6-809a-2076f56e5be7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:03.194078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-272dc3cf-427e-49d6-809a-2076f56e5be7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:03.325457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-272dc3cf-427e-49d6-809a-2076f56e5be7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:03.333078 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-272dc3cf-427e-49d6-809a-2076f56e5be7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1363 microversion: 2.1 time: 0.152483 Mar 12 21:32:03.333661 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5014/5782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:03 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:32:04.350641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a455864-d932-4326-a533-494ead0248ba tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:04.351328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a455864-d932-4326-a533-494ead0248ba tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:04.358649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a455864-d932-4326-a533-494ead0248ba tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:04.359116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a455864-d932-4326-a533-494ead0248ba tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:04.359924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a455864-d932-4326-a533-494ead0248ba tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:04.360382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a455864-d932-4326-a533-494ead0248ba tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:04.495210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5a455864-d932-4326-a533-494ead0248ba tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:04.502890 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a455864-d932-4326-a533-494ead0248ba tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1363 microversion: 2.1 time: 0.156213 Mar 12 21:32:04.503482 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5015/5783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:04 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:05.043396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-85bc1902-9c28-4534-9f79-3a67214e46c4 req-2e797d14-dafd-44da-b53c-3df96cd6b1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded972f1-262c-4c1a-b251-b07330eb837d", "name": "network-vif-plugged", "status": "completed", "tag": "6e20a880-4f4c-412b-aedb-854242fc65b5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:05.052526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-85bc1902-9c28-4534-9f79-3a67214e46c4 req-2e797d14-dafd-44da-b53c-3df96cd6b1aa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:05.053156 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-85bc1902-9c28-4534-9f79-3a67214e46c4 req-2e797d14-dafd-44da-b53c-3df96cd6b1aa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:05.064554 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-85bc1902-9c28-4534-9f79-3a67214e46c4 req-2e797d14-dafd-44da-b53c-3df96cd6b1aa service nova] Creating event network-vif-plugged:6e20a880-4f4c-412b-aedb-854242fc65b5 for instance ded972f1-262c-4c1a-b251-b07330eb837d on nch1-master-1 Mar 12 21:32:05.069805 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-85bc1902-9c28-4534-9f79-3a67214e46c4 req-2e797d14-dafd-44da-b53c-3df96cd6b1aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030469 Mar 12 21:32:05.070407 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5016/5784] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:32:05.520813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85abe844-f5de-43b7-8b1f-72ef1d016d43 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:05.521532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85abe844-f5de-43b7-8b1f-72ef1d016d43 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:05.528554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85abe844-f5de-43b7-8b1f-72ef1d016d43 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:05.529022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85abe844-f5de-43b7-8b1f-72ef1d016d43 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:05.529823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85abe844-f5de-43b7-8b1f-72ef1d016d43 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:05.530276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85abe844-f5de-43b7-8b1f-72ef1d016d43 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:05.669906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-85abe844-f5de-43b7-8b1f-72ef1d016d43 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:05.677480 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85abe844-f5de-43b7-8b1f-72ef1d016d43 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1363 microversion: 2.1 time: 0.160963 Mar 12 21:32:05.678096 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5017/5785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:05 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:06.694742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e36de612-a3a4-4280-bbc2-097563736052 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:06.695421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e36de612-a3a4-4280-bbc2-097563736052 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:06.702876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e36de612-a3a4-4280-bbc2-097563736052 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:06.703349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e36de612-a3a4-4280-bbc2-097563736052 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:06.704141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e36de612-a3a4-4280-bbc2-097563736052 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:06.704603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e36de612-a3a4-4280-bbc2-097563736052 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:06.839153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e36de612-a3a4-4280-bbc2-097563736052 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:06.846624 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e36de612-a3a4-4280-bbc2-097563736052 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1551 microversion: 2.1 time: 0.155915 Mar 12 21:32:06.847217 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5018/5786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:06 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:06.864592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a81c8be0-213d-4e98-a716-a9a86e08ba9c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:06.865114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a81c8be0-213d-4e98-a716-a9a86e08ba9c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:06.872611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a81c8be0-213d-4e98-a716-a9a86e08ba9c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:06.873086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a81c8be0-213d-4e98-a716-a9a86e08ba9c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:06.873916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a81c8be0-213d-4e98-a716-a9a86e08ba9c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:06.874380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a81c8be0-213d-4e98-a716-a9a86e08ba9c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:06.959286 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a81c8be0-213d-4e98-a716-a9a86e08ba9c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098656 Mar 12 21:32:06.959924 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5019/5787] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 21:32:06 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:32:07.897866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:07.899233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:07.906284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:07.906756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:07.907582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:07.908040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:07.936494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:07.942425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Old instance type m1.heat2, new instance type m1.heat {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 21:32:07.948720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:32:07.949159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:32:07.949657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:32:07.951043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:32:07.951733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:32:08.015386 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-81594053-94fe-43a3-98be-3f22986623f5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d/action" status: 202 len: 0 microversion: 2.1 time: 0.122133 Mar 12 21:32:08.019373 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5020/5788] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:32:07 2022] POST /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:32:08.088563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a61136d2-8f9a-4f10-856b-688fe993751b req-c713055f-f876-48fd-9db1-0fb0348d43a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded972f1-262c-4c1a-b251-b07330eb837d", "tag": "6e20a880-4f4c-412b-aedb-854242fc65b5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:08.097791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a61136d2-8f9a-4f10-856b-688fe993751b req-c713055f-f876-48fd-9db1-0fb0348d43a4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:08.098258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a61136d2-8f9a-4f10-856b-688fe993751b req-c713055f-f876-48fd-9db1-0fb0348d43a4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:08.111103 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a61136d2-8f9a-4f10-856b-688fe993751b req-c713055f-f876-48fd-9db1-0fb0348d43a4 service nova] Creating event network-changed:6e20a880-4f4c-412b-aedb-854242fc65b5 for instance ded972f1-262c-4c1a-b251-b07330eb837d on nch1-master-1 Mar 12 21:32:08.116727 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a61136d2-8f9a-4f10-856b-688fe993751b req-c713055f-f876-48fd-9db1-0fb0348d43a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099462 Mar 12 21:32:08.117755 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5021/5789] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:32:08.125026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5fe2c17-5991-4082-8f35-82a8082729c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:08.126744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e5fe2c17-5991-4082-8f35-82a8082729c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:08.135816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5fe2c17-5991-4082-8f35-82a8082729c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:08.136890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5fe2c17-5991-4082-8f35-82a8082729c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:08.138851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5fe2c17-5991-4082-8f35-82a8082729c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:08.139448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5fe2c17-5991-4082-8f35-82a8082729c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:08.314897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e5fe2c17-5991-4082-8f35-82a8082729c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:08.322755 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e5fe2c17-5991-4082-8f35-82a8082729c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1560 microversion: 2.1 time: 0.203612 Mar 12 21:32:08.333106 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5022/5790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:08 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:32:09.339969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0c640bb2-6bd1-4c6a-8287-a06f094cb26e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:09.341521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0c640bb2-6bd1-4c6a-8287-a06f094cb26e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:09.348764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c640bb2-6bd1-4c6a-8287-a06f094cb26e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:09.349584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c640bb2-6bd1-4c6a-8287-a06f094cb26e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:09.350444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c640bb2-6bd1-4c6a-8287-a06f094cb26e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:09.350906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0c640bb2-6bd1-4c6a-8287-a06f094cb26e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:09.489692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0c640bb2-6bd1-4c6a-8287-a06f094cb26e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:09.497169 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0c640bb2-6bd1-4c6a-8287-a06f094cb26e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1679 microversion: 2.1 time: 0.161506 Mar 12 21:32:09.497966 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5023/5791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:09 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:10.515986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4209635b-7801-4b2a-a9c0-1f253cc5dc73 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:10.516966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4209635b-7801-4b2a-a9c0-1f253cc5dc73 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:10.526447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4209635b-7801-4b2a-a9c0-1f253cc5dc73 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:10.526923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4209635b-7801-4b2a-a9c0-1f253cc5dc73 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:10.527722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4209635b-7801-4b2a-a9c0-1f253cc5dc73 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:10.528881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4209635b-7801-4b2a-a9c0-1f253cc5dc73 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:10.661836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4209635b-7801-4b2a-a9c0-1f253cc5dc73 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:10.669457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4209635b-7801-4b2a-a9c0-1f253cc5dc73 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.158959 Mar 12 21:32:10.670055 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5024/5792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:10 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:11.686479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-42ee346f-6b44-42db-b577-a24a54858e2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:11.687111 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-42ee346f-6b44-42db-b577-a24a54858e2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:11.693816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42ee346f-6b44-42db-b577-a24a54858e2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:11.694287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42ee346f-6b44-42db-b577-a24a54858e2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:11.695067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42ee346f-6b44-42db-b577-a24a54858e2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:11.695521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-42ee346f-6b44-42db-b577-a24a54858e2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:11.827999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-42ee346f-6b44-42db-b577-a24a54858e2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:11.835442 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-42ee346f-6b44-42db-b577-a24a54858e2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.153021 Mar 12 21:32:11.836021 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5025/5793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:11 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:12.852245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7923222a-0821-41fb-8fae-12c038fdf387 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:12.852882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7923222a-0821-41fb-8fae-12c038fdf387 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:12.860042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7923222a-0821-41fb-8fae-12c038fdf387 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:12.860520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7923222a-0821-41fb-8fae-12c038fdf387 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:12.861322 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7923222a-0821-41fb-8fae-12c038fdf387 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:12.862064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7923222a-0821-41fb-8fae-12c038fdf387 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:13.001528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7923222a-0821-41fb-8fae-12c038fdf387 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:13.009495 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7923222a-0821-41fb-8fae-12c038fdf387 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.161115 Mar 12 21:32:13.010393 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5026/5794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:12 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:14.027203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8354c1f2-6d48-4227-80ae-d5b39eea756c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:14.027843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8354c1f2-6d48-4227-80ae-d5b39eea756c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:14.034635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8354c1f2-6d48-4227-80ae-d5b39eea756c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:14.035105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8354c1f2-6d48-4227-80ae-d5b39eea756c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:14.035898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8354c1f2-6d48-4227-80ae-d5b39eea756c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:14.036357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8354c1f2-6d48-4227-80ae-d5b39eea756c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:14.168137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8354c1f2-6d48-4227-80ae-d5b39eea756c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:14.175556 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8354c1f2-6d48-4227-80ae-d5b39eea756c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.152322 Mar 12 21:32:14.176135 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5027/5795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:14 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:15.193408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b64b5691-9ebd-44a9-a8e8-9aec760a0a5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:15.194077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b64b5691-9ebd-44a9-a8e8-9aec760a0a5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:15.202444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b64b5691-9ebd-44a9-a8e8-9aec760a0a5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:15.203114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b64b5691-9ebd-44a9-a8e8-9aec760a0a5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:15.203957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b64b5691-9ebd-44a9-a8e8-9aec760a0a5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:15.204671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b64b5691-9ebd-44a9-a8e8-9aec760a0a5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:15.339471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b64b5691-9ebd-44a9-a8e8-9aec760a0a5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:15.347483 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b64b5691-9ebd-44a9-a8e8-9aec760a0a5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.158092 Mar 12 21:32:15.348131 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5028/5796] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:15 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:16.364501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90e37782-0435-478b-85ac-f60d740812d6 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:16.365187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90e37782-0435-478b-85ac-f60d740812d6 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:16.372609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90e37782-0435-478b-85ac-f60d740812d6 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:16.373083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90e37782-0435-478b-85ac-f60d740812d6 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:16.373912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90e37782-0435-478b-85ac-f60d740812d6 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:16.374377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90e37782-0435-478b-85ac-f60d740812d6 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:16.505698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90e37782-0435-478b-85ac-f60d740812d6 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:16.513328 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90e37782-0435-478b-85ac-f60d740812d6 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.152753 Mar 12 21:32:16.513968 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5029/5797] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:16 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:17.530556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8590fd72-9d9e-437f-ba7f-3e45eda4f60a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:17.531200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8590fd72-9d9e-437f-ba7f-3e45eda4f60a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:17.538045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8590fd72-9d9e-437f-ba7f-3e45eda4f60a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:17.538513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8590fd72-9d9e-437f-ba7f-3e45eda4f60a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:17.539295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8590fd72-9d9e-437f-ba7f-3e45eda4f60a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:17.539749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8590fd72-9d9e-437f-ba7f-3e45eda4f60a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:17.673696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8590fd72-9d9e-437f-ba7f-3e45eda4f60a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:17.681219 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8590fd72-9d9e-437f-ba7f-3e45eda4f60a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.154644 Mar 12 21:32:17.681810 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5030/5798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:17 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:18.698307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8366736a-2515-4087-a37d-38cde964fd25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:18.698982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8366736a-2515-4087-a37d-38cde964fd25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:18.706181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8366736a-2515-4087-a37d-38cde964fd25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:18.706647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8366736a-2515-4087-a37d-38cde964fd25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:18.707432 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8366736a-2515-4087-a37d-38cde964fd25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:18.707884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8366736a-2515-4087-a37d-38cde964fd25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:19.129237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8366736a-2515-4087-a37d-38cde964fd25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:19.136620 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8366736a-2515-4087-a37d-38cde964fd25 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.442276 Mar 12 21:32:19.137829 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5031/5799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:18 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:20.154149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e084fad4-ec8e-484b-9855-6f606a78a6a7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:20.154723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e084fad4-ec8e-484b-9855-6f606a78a6a7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:20.161475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e084fad4-ec8e-484b-9855-6f606a78a6a7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:20.161981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e084fad4-ec8e-484b-9855-6f606a78a6a7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:20.162757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e084fad4-ec8e-484b-9855-6f606a78a6a7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:20.163212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e084fad4-ec8e-484b-9855-6f606a78a6a7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:20.293521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e084fad4-ec8e-484b-9855-6f606a78a6a7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:20.303156 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e084fad4-ec8e-484b-9855-6f606a78a6a7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.153541 Mar 12 21:32:20.303751 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5032/5800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:20 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:21.323278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-691322d3-6606-4b1e-a8d1-6ed9c074614b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:21.323981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-691322d3-6606-4b1e-a8d1-6ed9c074614b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:21.330440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-691322d3-6606-4b1e-a8d1-6ed9c074614b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:21.330908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-691322d3-6606-4b1e-a8d1-6ed9c074614b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:21.331692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-691322d3-6606-4b1e-a8d1-6ed9c074614b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:21.332143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-691322d3-6606-4b1e-a8d1-6ed9c074614b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:21.463907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-691322d3-6606-4b1e-a8d1-6ed9c074614b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:21.472098 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-691322d3-6606-4b1e-a8d1-6ed9c074614b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.152935 Mar 12 21:32:21.472693 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5033/5801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:21 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:22.489997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-197e279c-5c58-416f-bfc4-c92095a40124 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:22.490734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-197e279c-5c58-416f-bfc4-c92095a40124 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:22.498127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197e279c-5c58-416f-bfc4-c92095a40124 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:22.498546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197e279c-5c58-416f-bfc4-c92095a40124 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:22.499332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197e279c-5c58-416f-bfc4-c92095a40124 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:22.499790 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197e279c-5c58-416f-bfc4-c92095a40124 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:22.628736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-197e279c-5c58-416f-bfc4-c92095a40124 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:22.636140 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-197e279c-5c58-416f-bfc4-c92095a40124 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.150151 Mar 12 21:32:22.636727 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5034/5802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:22 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:23.653569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8d37a25-b748-4903-a9b2-edfba7d7c9de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:23.654235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8d37a25-b748-4903-a9b2-edfba7d7c9de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:23.660877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8d37a25-b748-4903-a9b2-edfba7d7c9de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:23.661342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8d37a25-b748-4903-a9b2-edfba7d7c9de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:23.662189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8d37a25-b748-4903-a9b2-edfba7d7c9de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:23.662688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8d37a25-b748-4903-a9b2-edfba7d7c9de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:23.795332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a8d37a25-b748-4903-a9b2-edfba7d7c9de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:23.802751 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8d37a25-b748-4903-a9b2-edfba7d7c9de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.153342 Mar 12 21:32:23.803327 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5035/5803] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:23 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:24.820217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e865f209-cf3d-441a-b563-e354c267bd48 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:24.821006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e865f209-cf3d-441a-b563-e354c267bd48 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:24.827681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e865f209-cf3d-441a-b563-e354c267bd48 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:24.828143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e865f209-cf3d-441a-b563-e354c267bd48 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:24.828926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e865f209-cf3d-441a-b563-e354c267bd48 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:24.829377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e865f209-cf3d-441a-b563-e354c267bd48 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:24.959978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e865f209-cf3d-441a-b563-e354c267bd48 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:24.967391 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e865f209-cf3d-441a-b563-e354c267bd48 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.151252 Mar 12 21:32:24.967967 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5036/5804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:24 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:25.984649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2cb4e1b2-0de7-401f-9b65-6f1eb9392e7c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:25.985294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2cb4e1b2-0de7-401f-9b65-6f1eb9392e7c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:25.992276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cb4e1b2-0de7-401f-9b65-6f1eb9392e7c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:25.992778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cb4e1b2-0de7-401f-9b65-6f1eb9392e7c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:25.993572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cb4e1b2-0de7-401f-9b65-6f1eb9392e7c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:25.994066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2cb4e1b2-0de7-401f-9b65-6f1eb9392e7c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:26.127269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2cb4e1b2-0de7-401f-9b65-6f1eb9392e7c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:26.134804 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2cb4e1b2-0de7-401f-9b65-6f1eb9392e7c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.154542 Mar 12 21:32:26.135392 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5037/5805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:25 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:27.155035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f90f60b-1a9a-4fb5-9a65-014f1f8431f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:27.155675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6f90f60b-1a9a-4fb5-9a65-014f1f8431f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:27.162315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f90f60b-1a9a-4fb5-9a65-014f1f8431f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:27.162781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f90f60b-1a9a-4fb5-9a65-014f1f8431f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:27.163559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f90f60b-1a9a-4fb5-9a65-014f1f8431f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:27.164015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f90f60b-1a9a-4fb5-9a65-014f1f8431f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:27.297564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6f90f60b-1a9a-4fb5-9a65-014f1f8431f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:27.304837 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f90f60b-1a9a-4fb5-9a65-014f1f8431f7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.154542 Mar 12 21:32:27.305426 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5038/5806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:27 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:28.322054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72cabc39-95b4-4504-bd3d-6e91d7f39beb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:28.322702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-72cabc39-95b4-4504-bd3d-6e91d7f39beb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:28.328835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72cabc39-95b4-4504-bd3d-6e91d7f39beb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:28.329302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72cabc39-95b4-4504-bd3d-6e91d7f39beb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:28.330115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72cabc39-95b4-4504-bd3d-6e91d7f39beb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:28.330572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72cabc39-95b4-4504-bd3d-6e91d7f39beb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:28.459501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-72cabc39-95b4-4504-bd3d-6e91d7f39beb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:28.467510 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72cabc39-95b4-4504-bd3d-6e91d7f39beb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.149665 Mar 12 21:32:28.468096 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5039/5807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:28 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:29.486466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-60f2935c-c6b6-4995-a636-aec2a0d5ac41 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:29.487252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-60f2935c-c6b6-4995-a636-aec2a0d5ac41 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:29.495044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60f2935c-c6b6-4995-a636-aec2a0d5ac41 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:29.495603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60f2935c-c6b6-4995-a636-aec2a0d5ac41 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:29.496504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60f2935c-c6b6-4995-a636-aec2a0d5ac41 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:29.497706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60f2935c-c6b6-4995-a636-aec2a0d5ac41 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:29.636615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-60f2935c-c6b6-4995-a636-aec2a0d5ac41 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:29.644123 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-60f2935c-c6b6-4995-a636-aec2a0d5ac41 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.161779 Mar 12 21:32:29.644706 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5040/5808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:29 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:30.661822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9e42e6e0-7cf7-4c56-bb1f-2e61702706e7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:30.662498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9e42e6e0-7cf7-4c56-bb1f-2e61702706e7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:30.670094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e42e6e0-7cf7-4c56-bb1f-2e61702706e7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:30.670559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e42e6e0-7cf7-4c56-bb1f-2e61702706e7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:30.671332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e42e6e0-7cf7-4c56-bb1f-2e61702706e7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:30.671781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e42e6e0-7cf7-4c56-bb1f-2e61702706e7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:30.801263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9e42e6e0-7cf7-4c56-bb1f-2e61702706e7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:30.808662 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9e42e6e0-7cf7-4c56-bb1f-2e61702706e7 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.150845 Mar 12 21:32:30.809244 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5041/5809] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:30 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:31.825895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7d2cad51-0c98-40a9-8c26-6ce6891bcc9a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:31.826588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7d2cad51-0c98-40a9-8c26-6ce6891bcc9a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:31.833405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d2cad51-0c98-40a9-8c26-6ce6891bcc9a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:31.833917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d2cad51-0c98-40a9-8c26-6ce6891bcc9a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:31.834710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d2cad51-0c98-40a9-8c26-6ce6891bcc9a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:31.835171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7d2cad51-0c98-40a9-8c26-6ce6891bcc9a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:31.971257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7d2cad51-0c98-40a9-8c26-6ce6891bcc9a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:31.978761 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7d2cad51-0c98-40a9-8c26-6ce6891bcc9a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.156953 Mar 12 21:32:31.979351 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5042/5810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:31 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:32.996665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8f2c7643-daaf-4fc7-890c-eeb80bc86d69 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:32.997340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8f2c7643-daaf-4fc7-890c-eeb80bc86d69 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:33.004182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f2c7643-daaf-4fc7-890c-eeb80bc86d69 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:33.004827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f2c7643-daaf-4fc7-890c-eeb80bc86d69 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:33.005928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f2c7643-daaf-4fc7-890c-eeb80bc86d69 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:33.006398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8f2c7643-daaf-4fc7-890c-eeb80bc86d69 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:33.140683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8f2c7643-daaf-4fc7-890c-eeb80bc86d69 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:33.148161 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8f2c7643-daaf-4fc7-890c-eeb80bc86d69 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.155500 Mar 12 21:32:33.148742 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5043/5811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:32 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:34.166353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4aaa7099-6508-45fb-9bff-0f1d2153011a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:34.166984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4aaa7099-6508-45fb-9bff-0f1d2153011a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:34.174343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4aaa7099-6508-45fb-9bff-0f1d2153011a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:34.174822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4aaa7099-6508-45fb-9bff-0f1d2153011a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:34.175613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4aaa7099-6508-45fb-9bff-0f1d2153011a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:34.176115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4aaa7099-6508-45fb-9bff-0f1d2153011a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:34.306351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4aaa7099-6508-45fb-9bff-0f1d2153011a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:34.313746 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4aaa7099-6508-45fb-9bff-0f1d2153011a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.151745 Mar 12 21:32:34.314348 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5044/5812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:34 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:35.331895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf74cd11-d990-40b6-929d-64e3f1737bd5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:35.332561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bf74cd11-d990-40b6-929d-64e3f1737bd5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:35.339600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf74cd11-d990-40b6-929d-64e3f1737bd5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:35.340075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf74cd11-d990-40b6-929d-64e3f1737bd5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:35.340863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf74cd11-d990-40b6-929d-64e3f1737bd5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:35.341317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf74cd11-d990-40b6-929d-64e3f1737bd5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:35.475627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bf74cd11-d990-40b6-929d-64e3f1737bd5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:35.483653 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bf74cd11-d990-40b6-929d-64e3f1737bd5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.156735 Mar 12 21:32:35.484229 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5045/5813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:35 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:36.500643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7616492b-1f94-4bea-b4a7-1be467316368 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:36.501312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7616492b-1f94-4bea-b4a7-1be467316368 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:36.508924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7616492b-1f94-4bea-b4a7-1be467316368 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:36.509471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7616492b-1f94-4bea-b4a7-1be467316368 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:36.510973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7616492b-1f94-4bea-b4a7-1be467316368 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:36.511448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7616492b-1f94-4bea-b4a7-1be467316368 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:36.647728 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7616492b-1f94-4bea-b4a7-1be467316368 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:36.656640 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7616492b-1f94-4bea-b4a7-1be467316368 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1684 microversion: 2.1 time: 0.159914 Mar 12 21:32:36.657224 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5046/5814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:36 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:37.254621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-defa5d13-6a85-43d4-89fb-6ec17fa28317 req-40dc11e2-e843-44c9-ab4d-1f2a5756bfaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded972f1-262c-4c1a-b251-b07330eb837d", "name": "network-vif-unplugged", "status": "completed", "tag": "6e20a880-4f4c-412b-aedb-854242fc65b5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:37.263505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-defa5d13-6a85-43d4-89fb-6ec17fa28317 req-40dc11e2-e843-44c9-ab4d-1f2a5756bfaa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:37.264116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-defa5d13-6a85-43d4-89fb-6ec17fa28317 req-40dc11e2-e843-44c9-ab4d-1f2a5756bfaa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:37.279490 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-defa5d13-6a85-43d4-89fb-6ec17fa28317 req-40dc11e2-e843-44c9-ab4d-1f2a5756bfaa service nova] Creating event network-vif-unplugged:6e20a880-4f4c-412b-aedb-854242fc65b5 for instance ded972f1-262c-4c1a-b251-b07330eb837d on nch2-master-1 Mar 12 21:32:37.285690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-defa5d13-6a85-43d4-89fb-6ec17fa28317 req-40dc11e2-e843-44c9-ab4d-1f2a5756bfaa service nova] Instance ded972f1-262c-4c1a-b251-b07330eb837d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:32:37.299461 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-defa5d13-6a85-43d4-89fb-6ec17fa28317 req-40dc11e2-e843-44c9-ab4d-1f2a5756bfaa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115177 Mar 12 21:32:37.300241 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5047/5815] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:32:37.676008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-60e8e8a3-422c-4b9c-bfe1-cbced3cfd5f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:37.676736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-60e8e8a3-422c-4b9c-bfe1-cbced3cfd5f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:37.683753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60e8e8a3-422c-4b9c-bfe1-cbced3cfd5f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:37.684231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60e8e8a3-422c-4b9c-bfe1-cbced3cfd5f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:37.685052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60e8e8a3-422c-4b9c-bfe1-cbced3cfd5f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:37.685508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60e8e8a3-422c-4b9c-bfe1-cbced3cfd5f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:37.834495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-60e8e8a3-422c-4b9c-bfe1-cbced3cfd5f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:37.843059 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-60e8e8a3-422c-4b9c-bfe1-cbced3cfd5f2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1683 microversion: 2.1 time: 0.172169 Mar 12 21:32:37.844041 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5048/5816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:37 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:38.863400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e2f44148-0419-4a0f-afe5-bdc220e11b75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:38.864408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e2f44148-0419-4a0f-afe5-bdc220e11b75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:38.874539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2f44148-0419-4a0f-afe5-bdc220e11b75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:38.875249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2f44148-0419-4a0f-afe5-bdc220e11b75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:38.876402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2f44148-0419-4a0f-afe5-bdc220e11b75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:38.876861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e2f44148-0419-4a0f-afe5-bdc220e11b75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:39.014475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e2f44148-0419-4a0f-afe5-bdc220e11b75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:39.021850 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e2f44148-0419-4a0f-afe5-bdc220e11b75 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1681 microversion: 2.1 time: 0.164365 Mar 12 21:32:39.022429 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5049/5817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:38 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:39.315802 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6de39604-8666-45db-adf0-bbca2258ed22 req-aae97e3c-0f68-4e30-a5a0-869250b5f64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded972f1-262c-4c1a-b251-b07330eb837d", "tag": "6e20a880-4f4c-412b-aedb-854242fc65b5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:39.324408 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6de39604-8666-45db-adf0-bbca2258ed22 req-aae97e3c-0f68-4e30-a5a0-869250b5f64e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:39.325393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6de39604-8666-45db-adf0-bbca2258ed22 req-aae97e3c-0f68-4e30-a5a0-869250b5f64e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:39.339350 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6de39604-8666-45db-adf0-bbca2258ed22 req-aae97e3c-0f68-4e30-a5a0-869250b5f64e service nova] Creating event network-changed:6e20a880-4f4c-412b-aedb-854242fc65b5 for instance ded972f1-262c-4c1a-b251-b07330eb837d on nch2-master-1 Mar 12 21:32:39.345288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-6de39604-8666-45db-adf0-bbca2258ed22 req-aae97e3c-0f68-4e30-a5a0-869250b5f64e service nova] Instance ded972f1-262c-4c1a-b251-b07330eb837d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:32:39.356971 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6de39604-8666-45db-adf0-bbca2258ed22 req-aae97e3c-0f68-4e30-a5a0-869250b5f64e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044904 Mar 12 21:32:39.357612 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5050/5818] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:32:40.039916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-65540a1c-b449-406e-a0af-56afb86e3716 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:40.041719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-65540a1c-b449-406e-a0af-56afb86e3716 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:40.049336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65540a1c-b449-406e-a0af-56afb86e3716 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:40.049827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65540a1c-b449-406e-a0af-56afb86e3716 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:40.050615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65540a1c-b449-406e-a0af-56afb86e3716 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:40.051193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-65540a1c-b449-406e-a0af-56afb86e3716 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:40.189930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-65540a1c-b449-406e-a0af-56afb86e3716 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:40.197971 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-65540a1c-b449-406e-a0af-56afb86e3716 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1678 microversion: 2.1 time: 0.162248 Mar 12 21:32:40.198683 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5051/5819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:40 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:40.217177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:40.217737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:40.224203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:40.224670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:40.225479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:40.225969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:40.266025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:40.266496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:40.267327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:40.267778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:40.288753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'ram', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:32:40.294612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for user 2dc99cab406e42d6b6cd00fddedaf960 and project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'ram', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:32:40.402958 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d66e568a-950f-42b6-b36b-d2024a35df9e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d/action" status: 202 len: 0 microversion: 2.1 time: 0.190303 Mar 12 21:32:40.403644 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5052/5820] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:32:40 2022] POST /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:32:40.413555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6a658e82-f6fb-4479-b6ac-b5b9748f4f8e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:40.414307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6a658e82-f6fb-4479-b6ac-b5b9748f4f8e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:40.421104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a658e82-f6fb-4479-b6ac-b5b9748f4f8e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:40.421618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a658e82-f6fb-4479-b6ac-b5b9748f4f8e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:40.422477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a658e82-f6fb-4479-b6ac-b5b9748f4f8e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:40.423013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a658e82-f6fb-4479-b6ac-b5b9748f4f8e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:40.568625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6a658e82-f6fb-4479-b6ac-b5b9748f4f8e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:40.576134 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6a658e82-f6fb-4479-b6ac-b5b9748f4f8e tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1677 microversion: 2.1 time: 0.168109 Mar 12 21:32:40.576723 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5053/5821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:40 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:41.594046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f20f2caa-7134-4d25-ab12-267f7a29a9c2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:41.594720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f20f2caa-7134-4d25-ab12-267f7a29a9c2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:41.601437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f20f2caa-7134-4d25-ab12-267f7a29a9c2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:41.601950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f20f2caa-7134-4d25-ab12-267f7a29a9c2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:41.602736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f20f2caa-7134-4d25-ab12-267f7a29a9c2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:41.603184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f20f2caa-7134-4d25-ab12-267f7a29a9c2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:41.734206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f20f2caa-7134-4d25-ab12-267f7a29a9c2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:41.742326 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f20f2caa-7134-4d25-ab12-267f7a29a9c2 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1677 microversion: 2.1 time: 0.153663 Mar 12 21:32:41.742919 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5054/5822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:41 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:42.760017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51db8c58-ac58-484b-8ea4-b0123b06fdc1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:42.760710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51db8c58-ac58-484b-8ea4-b0123b06fdc1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:42.769387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51db8c58-ac58-484b-8ea4-b0123b06fdc1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:42.769883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51db8c58-ac58-484b-8ea4-b0123b06fdc1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:42.770667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51db8c58-ac58-484b-8ea4-b0123b06fdc1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:42.771125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51db8c58-ac58-484b-8ea4-b0123b06fdc1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:42.918353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51db8c58-ac58-484b-8ea4-b0123b06fdc1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:42.925892 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51db8c58-ac58-484b-8ea4-b0123b06fdc1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1677 microversion: 2.1 time: 0.169902 Mar 12 21:32:42.926476 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5055/5823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:42 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:43.848972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2d51e2ba-333a-418a-9c01-8758bb161f1a req-f8d80bce-5705-47a4-94dc-5aafc4d9237a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded972f1-262c-4c1a-b251-b07330eb837d", "tag": "6e20a880-4f4c-412b-aedb-854242fc65b5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:43.868271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2d51e2ba-333a-418a-9c01-8758bb161f1a req-f8d80bce-5705-47a4-94dc-5aafc4d9237a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:43.869048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2d51e2ba-333a-418a-9c01-8758bb161f1a req-f8d80bce-5705-47a4-94dc-5aafc4d9237a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:43.891900 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2d51e2ba-333a-418a-9c01-8758bb161f1a req-f8d80bce-5705-47a4-94dc-5aafc4d9237a service nova] Creating event network-changed:6e20a880-4f4c-412b-aedb-854242fc65b5 for instance ded972f1-262c-4c1a-b251-b07330eb837d on nch1-master-1 Mar 12 21:32:43.898637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-2d51e2ba-333a-418a-9c01-8758bb161f1a req-f8d80bce-5705-47a4-94dc-5aafc4d9237a service nova] Instance ded972f1-262c-4c1a-b251-b07330eb837d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:32:43.911064 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2d51e2ba-333a-418a-9c01-8758bb161f1a req-f8d80bce-5705-47a4-94dc-5aafc4d9237a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067257 Mar 12 21:32:43.911700 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5056/5824] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:32:43.943949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-197ddd5c-3882-4478-9fcf-c167ee354485 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:43.944791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-197ddd5c-3882-4478-9fcf-c167ee354485 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:43.953013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197ddd5c-3882-4478-9fcf-c167ee354485 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:43.953578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197ddd5c-3882-4478-9fcf-c167ee354485 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:43.954487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197ddd5c-3882-4478-9fcf-c167ee354485 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:43.955165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-197ddd5c-3882-4478-9fcf-c167ee354485 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:44.123372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-197ddd5c-3882-4478-9fcf-c167ee354485 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:44.133000 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-197ddd5c-3882-4478-9fcf-c167ee354485 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1677 microversion: 2.1 time: 0.193485 Mar 12 21:32:44.156240 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5057/5825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:43 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:44.236582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6dbb0174-4cad-43a5-b64c-2ac901aea397 req-5c90aeac-14f0-43e3-becb-66c3dc41312b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded972f1-262c-4c1a-b251-b07330eb837d", "name": "network-vif-plugged", "status": "completed", "tag": "6e20a880-4f4c-412b-aedb-854242fc65b5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:44.244557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6dbb0174-4cad-43a5-b64c-2ac901aea397 req-5c90aeac-14f0-43e3-becb-66c3dc41312b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:44.245020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6dbb0174-4cad-43a5-b64c-2ac901aea397 req-5c90aeac-14f0-43e3-becb-66c3dc41312b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:44.257823 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6dbb0174-4cad-43a5-b64c-2ac901aea397 req-5c90aeac-14f0-43e3-becb-66c3dc41312b service nova] Creating event network-vif-plugged:6e20a880-4f4c-412b-aedb-854242fc65b5 for instance ded972f1-262c-4c1a-b251-b07330eb837d on nch1-master-1 Mar 12 21:32:44.263357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-6dbb0174-4cad-43a5-b64c-2ac901aea397 req-5c90aeac-14f0-43e3-becb-66c3dc41312b service nova] Instance ded972f1-262c-4c1a-b251-b07330eb837d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:32:44.273995 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6dbb0174-4cad-43a5-b64c-2ac901aea397 req-5c90aeac-14f0-43e3-becb-66c3dc41312b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116158 Mar 12 21:32:44.274619 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5058/5826] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:32:45.152634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-967a7816-5c7c-4871-96fd-6ee1daf19e9b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:45.153458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-967a7816-5c7c-4871-96fd-6ee1daf19e9b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:45.160225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-967a7816-5c7c-4871-96fd-6ee1daf19e9b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:45.160695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-967a7816-5c7c-4871-96fd-6ee1daf19e9b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:45.161473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-967a7816-5c7c-4871-96fd-6ee1daf19e9b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:45.161958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-967a7816-5c7c-4871-96fd-6ee1daf19e9b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:45.304565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-967a7816-5c7c-4871-96fd-6ee1daf19e9b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:45.312596 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-967a7816-5c7c-4871-96fd-6ee1daf19e9b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1677 microversion: 2.1 time: 0.165183 Mar 12 21:32:45.313178 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5059/5827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:45 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:32:46.330601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4bac3d99-6d30-4a4a-a651-d467774bd039 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:46.331254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4bac3d99-6d30-4a4a-a651-d467774bd039 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:46.338197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bac3d99-6d30-4a4a-a651-d467774bd039 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:46.338671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bac3d99-6d30-4a4a-a651-d467774bd039 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:46.339465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bac3d99-6d30-4a4a-a651-d467774bd039 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:46.339928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4bac3d99-6d30-4a4a-a651-d467774bd039 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:46.472129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4bac3d99-6d30-4a4a-a651-d467774bd039 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:46.479545 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4bac3d99-6d30-4a4a-a651-d467774bd039 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1677 microversion: 2.1 time: 0.153369 Mar 12 21:32:46.480123 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5060/5828] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:46 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:47.496327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f91d957-6a85-4836-89be-c2b8a735c8e5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:47.496977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f91d957-6a85-4836-89be-c2b8a735c8e5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:47.503911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f91d957-6a85-4836-89be-c2b8a735c8e5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:47.504378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f91d957-6a85-4836-89be-c2b8a735c8e5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:47.505159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f91d957-6a85-4836-89be-c2b8a735c8e5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:47.505612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f91d957-6a85-4836-89be-c2b8a735c8e5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:47.643312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f91d957-6a85-4836-89be-c2b8a735c8e5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:47.651016 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f91d957-6a85-4836-89be-c2b8a735c8e5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1670 microversion: 2.1 time: 0.158590 Mar 12 21:32:47.651591 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5061/5829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:47 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:47.666939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce868625-763c-48bc-9082-95dcfa782d5f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:47.667926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce868625-763c-48bc-9082-95dcfa782d5f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:47.673842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce868625-763c-48bc-9082-95dcfa782d5f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:47.674254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce868625-763c-48bc-9082-95dcfa782d5f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:47.675055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce868625-763c-48bc-9082-95dcfa782d5f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:47.675491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce868625-763c-48bc-9082-95dcfa782d5f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:47.811551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce868625-763c-48bc-9082-95dcfa782d5f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:47.819102 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce868625-763c-48bc-9082-95dcfa782d5f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1670 microversion: 2.1 time: 0.156060 Mar 12 21:32:47.819692 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5062/5830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:47 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:47.835490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fbe2c20d-c6fd-4a00-bbd6-f190a0828cc9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:47.836126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fbe2c20d-c6fd-4a00-bbd6-f190a0828cc9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:47.842105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbe2c20d-c6fd-4a00-bbd6-f190a0828cc9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:47.842582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbe2c20d-c6fd-4a00-bbd6-f190a0828cc9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:47.843372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbe2c20d-c6fd-4a00-bbd6-f190a0828cc9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:47.843833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fbe2c20d-c6fd-4a00-bbd6-f190a0828cc9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:47.978151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fbe2c20d-c6fd-4a00-bbd6-f190a0828cc9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:47.986077 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fbe2c20d-c6fd-4a00-bbd6-f190a0828cc9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1670 microversion: 2.1 time: 0.154348 Mar 12 21:32:47.986666 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5063/5831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:47 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:48.002207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d7c35cbc-6584-4758-8f14-cf21a00d0898 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:48.002733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d7c35cbc-6584-4758-8f14-cf21a00d0898 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:48.008431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7c35cbc-6584-4758-8f14-cf21a00d0898 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:48.008901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7c35cbc-6584-4758-8f14-cf21a00d0898 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:48.009704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7c35cbc-6584-4758-8f14-cf21a00d0898 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:48.010176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d7c35cbc-6584-4758-8f14-cf21a00d0898 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:48.033735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d7c35cbc-6584-4758-8f14-cf21a00d0898 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:32:48.108245 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d7c35cbc-6584-4758-8f14-cf21a00d0898 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 204 len: 0 microversion: 2.1 time: 0.109792 Mar 12 21:32:48.108937 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5064/5832] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:32:47 2022] DELETE /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:32:48.117796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-77135fdd-c2c5-4360-b8a4-d92d7dab0fd3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:48.118512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-77135fdd-c2c5-4360-b8a4-d92d7dab0fd3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:48.125143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77135fdd-c2c5-4360-b8a4-d92d7dab0fd3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:48.125606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77135fdd-c2c5-4360-b8a4-d92d7dab0fd3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:48.126440 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77135fdd-c2c5-4360-b8a4-d92d7dab0fd3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:48.126891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-77135fdd-c2c5-4360-b8a4-d92d7dab0fd3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:48.263987 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-77135fdd-c2c5-4360-b8a4-d92d7dab0fd3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:48.271396 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-77135fdd-c2c5-4360-b8a4-d92d7dab0fd3 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1676 microversion: 2.1 time: 0.157731 Mar 12 21:32:48.271982 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5065/5833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:48 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:32:49.288168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8616ebee-aba7-49ac-8097-058eb5cd2fbe tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:49.288792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8616ebee-aba7-49ac-8097-058eb5cd2fbe tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:49.296383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8616ebee-aba7-49ac-8097-058eb5cd2fbe tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:49.296851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8616ebee-aba7-49ac-8097-058eb5cd2fbe tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:49.297642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8616ebee-aba7-49ac-8097-058eb5cd2fbe tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:49.298129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8616ebee-aba7-49ac-8097-058eb5cd2fbe tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:49.438054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8616ebee-aba7-49ac-8097-058eb5cd2fbe tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:49.445423 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8616ebee-aba7-49ac-8097-058eb5cd2fbe tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1676 microversion: 2.1 time: 0.161464 Mar 12 21:32:49.446030 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5066/5834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:49 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:49.450473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-020012b6-3f3c-4cf2-9cf7-d44255a1932c req-2a988319-fe68-452c-8257-c5eeabec9c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded972f1-262c-4c1a-b251-b07330eb837d", "name": "network-vif-plugged", "status": "completed", "tag": "6e20a880-4f4c-412b-aedb-854242fc65b5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:49.458670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-020012b6-3f3c-4cf2-9cf7-d44255a1932c req-2a988319-fe68-452c-8257-c5eeabec9c8e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:49.459133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-020012b6-3f3c-4cf2-9cf7-d44255a1932c req-2a988319-fe68-452c-8257-c5eeabec9c8e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:49.470308 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-020012b6-3f3c-4cf2-9cf7-d44255a1932c req-2a988319-fe68-452c-8257-c5eeabec9c8e service nova] Creating event network-vif-plugged:6e20a880-4f4c-412b-aedb-854242fc65b5 for instance ded972f1-262c-4c1a-b251-b07330eb837d on nch1-master-1 Mar 12 21:32:49.475413 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-020012b6-3f3c-4cf2-9cf7-d44255a1932c req-2a988319-fe68-452c-8257-c5eeabec9c8e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028124 Mar 12 21:32:49.476006 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5067/5835] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:32:50.413174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-05f554c4-1534-40d3-87aa-679bf0d24346 req-65175ed6-6e47-4139-bb59-17f582b96f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded972f1-262c-4c1a-b251-b07330eb837d", "name": "network-vif-deleted", "tag": "6e20a880-4f4c-412b-aedb-854242fc65b5"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:50.424290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-05f554c4-1534-40d3-87aa-679bf0d24346 req-65175ed6-6e47-4139-bb59-17f582b96f98 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:50.424762 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-05f554c4-1534-40d3-87aa-679bf0d24346 req-65175ed6-6e47-4139-bb59-17f582b96f98 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:50.437513 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-05f554c4-1534-40d3-87aa-679bf0d24346 req-65175ed6-6e47-4139-bb59-17f582b96f98 service nova] Creating event network-vif-deleted:6e20a880-4f4c-412b-aedb-854242fc65b5 for instance ded972f1-262c-4c1a-b251-b07330eb837d on nch1-master-1 Mar 12 21:32:50.442370 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-05f554c4-1534-40d3-87aa-679bf0d24346 req-65175ed6-6e47-4139-bb59-17f582b96f98 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034182 Mar 12 21:32:50.443011 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5068/5836] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:32:50.463947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6a035af3-1e66-4f63-98cd-f57ec995c0cb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:50.464674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6a035af3-1e66-4f63-98cd-f57ec995c0cb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:50.477474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a035af3-1e66-4f63-98cd-f57ec995c0cb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:50.477711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a035af3-1e66-4f63-98cd-f57ec995c0cb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:50.478542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a035af3-1e66-4f63-98cd-f57ec995c0cb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:50.479210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a035af3-1e66-4f63-98cd-f57ec995c0cb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:50.511732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a035af3-1e66-4f63-98cd-f57ec995c0cb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:50.512119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a035af3-1e66-4f63-98cd-f57ec995c0cb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:50.512605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-6a035af3-1e66-4f63-98cd-f57ec995c0cb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lazy-loading 'fault' on Instance uuid ded972f1-262c-4c1a-b251-b07330eb837d {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:32:50.556352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6a035af3-1e66-4f63-98cd-f57ec995c0cb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:50.564551 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6a035af3-1e66-4f63-98cd-f57ec995c0cb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 200 len: 1328 microversion: 2.1 time: 0.105507 Mar 12 21:32:50.565137 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5069/5837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:50 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:51.582308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1416cc6a-268d-4f8b-8657-0c25209a000a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:51.583051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1416cc6a-268d-4f8b-8657-0c25209a000a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:51.590117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1416cc6a-268d-4f8b-8657-0c25209a000a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:51.590583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1416cc6a-268d-4f8b-8657-0c25209a000a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:51.591405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1416cc6a-268d-4f8b-8657-0c25209a000a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:51.591861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1416cc6a-268d-4f8b-8657-0c25209a000a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:51.605049 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-1416cc6a-268d-4f8b-8657-0c25209a000a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance ded972f1-262c-4c1a-b251-b07330eb837d could not be found. Mar 12 21:32:51.605654 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1416cc6a-268d-4f8b-8657-0c25209a000a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance ded972f1-262c-4c1a-b251-b07330eb837d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:32:51.606523 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1416cc6a-268d-4f8b-8657-0c25209a000a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 404 len: 111 microversion: 2.1 time: 0.028189 Mar 12 21:32:51.607068 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5070/5838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:51 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:32:51.626502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dcd96e73-c6f6-45c8-a5bc-f27454095ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:51.627061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dcd96e73-c6f6-45c8-a5bc-f27454095ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:51.633291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcd96e73-c6f6-45c8-a5bc-f27454095ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:51.633759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcd96e73-c6f6-45c8-a5bc-f27454095ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:51.634569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcd96e73-c6f6-45c8-a5bc-f27454095ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:51.635016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dcd96e73-c6f6-45c8-a5bc-f27454095ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:51.650253 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-dcd96e73-c6f6-45c8-a5bc-f27454095ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance ded972f1-262c-4c1a-b251-b07330eb837d could not be found. Mar 12 21:32:51.650861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dcd96e73-c6f6-45c8-a5bc-f27454095ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance ded972f1-262c-4c1a-b251-b07330eb837d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:32:51.651699 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dcd96e73-c6f6-45c8-a5bc-f27454095ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 404 len: 111 microversion: 2.1 time: 0.029932 Mar 12 21:32:51.652252 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5071/5839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:51 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:32:51.702664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-894244767", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "12f207f9-0639-4c0e-8e71-ff9d17b74d28"}], "security_groups": [{"name": "tempest-securitygroup--132650578"}], "key_name": "tempest-keypair-366629006", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:51.799895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] validate_networks() for [('12f207f9-0639-4c0e-8e71-ff9d17b74d28', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:32:52.275585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:32:52.276026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:32:52.276517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:32:52.276943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:32:52.277373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:32:52.290105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:52.290868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:52.291957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:52.292411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:52.313070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:32:52.318268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for user 2dc99cab406e42d6b6cd00fddedaf960 and project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:32:52.333926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:32:52.336223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:32:52.391914 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1e49bfe7-306f-4a65-a7a3-9467df728ed8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.693154 Mar 12 21:32:52.392780 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5072/5840] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:32:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:32:52.402380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e0553e5e-590d-45ba-ba58-a8bcb5a91766 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:52.403004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e0553e5e-590d-45ba-ba58-a8bcb5a91766 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:52.460017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e0553e5e-590d-45ba-ba58-a8bcb5a91766 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:52.467441 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e0553e5e-590d-45ba-ba58-a8bcb5a91766 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1237 microversion: 2.1 time: 0.068783 Mar 12 21:32:52.468018 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5073/5841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:52 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:53.484978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2419f721-a70e-4b1b-bda6-06399aaeac15 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:53.485650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2419f721-a70e-4b1b-bda6-06399aaeac15 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:53.493099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2419f721-a70e-4b1b-bda6-06399aaeac15 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:53.493567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2419f721-a70e-4b1b-bda6-06399aaeac15 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:53.494411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2419f721-a70e-4b1b-bda6-06399aaeac15 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:53.494867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2419f721-a70e-4b1b-bda6-06399aaeac15 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:53.564751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2419f721-a70e-4b1b-bda6-06399aaeac15 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:53.572551 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2419f721-a70e-4b1b-bda6-06399aaeac15 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1295 microversion: 2.1 time: 0.092045 Mar 12 21:32:53.573132 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5074/5842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:53 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:54.592441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72e0b058-6f42-4b1b-9191-265f7e1b9d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:54.593139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-72e0b058-6f42-4b1b-9191-265f7e1b9d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:54.600724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72e0b058-6f42-4b1b-9191-265f7e1b9d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:54.601442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72e0b058-6f42-4b1b-9191-265f7e1b9d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:54.602324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72e0b058-6f42-4b1b-9191-265f7e1b9d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:54.603082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72e0b058-6f42-4b1b-9191-265f7e1b9d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:54.775054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-72e0b058-6f42-4b1b-9191-265f7e1b9d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:54.782887 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72e0b058-6f42-4b1b-9191-265f7e1b9d2c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1362 microversion: 2.1 time: 0.196378 Mar 12 21:32:54.786170 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5075/5843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:54 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:54.793263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6e9ef88e-18bf-4370-a1d4-59dbe2f12bbd req-91dc3631-1325-48a9-b60b-0abeee8b895d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96997437-204b-4da2-bbcd-b781ab1edcec", "tag": "e36287d3-77af-41f4-87e6-2ef807ae46ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:54.803818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6e9ef88e-18bf-4370-a1d4-59dbe2f12bbd req-91dc3631-1325-48a9-b60b-0abeee8b895d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:54.804541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6e9ef88e-18bf-4370-a1d4-59dbe2f12bbd req-91dc3631-1325-48a9-b60b-0abeee8b895d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:54.817236 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6e9ef88e-18bf-4370-a1d4-59dbe2f12bbd req-91dc3631-1325-48a9-b60b-0abeee8b895d service nova] Creating event network-changed:e36287d3-77af-41f4-87e6-2ef807ae46ab for instance 96997437-204b-4da2-bbcd-b781ab1edcec on nch2-master-1 Mar 12 21:32:54.822804 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6e9ef88e-18bf-4370-a1d4-59dbe2f12bbd req-91dc3631-1325-48a9-b60b-0abeee8b895d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035109 Mar 12 21:32:54.823667 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5076/5844] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:32:55.801980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9bad727-83da-43b5-b5e1-e658e0f24b37 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:55.802809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9bad727-83da-43b5-b5e1-e658e0f24b37 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:55.809045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9bad727-83da-43b5-b5e1-e658e0f24b37 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:55.809596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9bad727-83da-43b5-b5e1-e658e0f24b37 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:55.810923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9bad727-83da-43b5-b5e1-e658e0f24b37 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:55.811376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9bad727-83da-43b5-b5e1-e658e0f24b37 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:55.946793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9bad727-83da-43b5-b5e1-e658e0f24b37 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:55.954952 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9bad727-83da-43b5-b5e1-e658e0f24b37 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1362 microversion: 2.1 time: 0.158171 Mar 12 21:32:55.955530 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5077/5845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:55 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:56.973056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7a5d52d-95da-435d-9482-55197d2781b4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:56.973712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e7a5d52d-95da-435d-9482-55197d2781b4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:56.980513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7a5d52d-95da-435d-9482-55197d2781b4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:56.980985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7a5d52d-95da-435d-9482-55197d2781b4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:56.981817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7a5d52d-95da-435d-9482-55197d2781b4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:56.982281 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7a5d52d-95da-435d-9482-55197d2781b4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:57.116085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e7a5d52d-95da-435d-9482-55197d2781b4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:57.123434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e7a5d52d-95da-435d-9482-55197d2781b4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1362 microversion: 2.1 time: 0.154440 Mar 12 21:32:57.124010 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5078/5846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:56 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:58.141429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f87eacd8-87d8-4cd5-a19c-78f2e5a9ba87 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:58.142098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f87eacd8-87d8-4cd5-a19c-78f2e5a9ba87 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:58.148162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f87eacd8-87d8-4cd5-a19c-78f2e5a9ba87 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:58.148703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f87eacd8-87d8-4cd5-a19c-78f2e5a9ba87 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:58.149493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f87eacd8-87d8-4cd5-a19c-78f2e5a9ba87 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:58.149980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f87eacd8-87d8-4cd5-a19c-78f2e5a9ba87 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:58.279256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f87eacd8-87d8-4cd5-a19c-78f2e5a9ba87 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:58.286544 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f87eacd8-87d8-4cd5-a19c-78f2e5a9ba87 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1362 microversion: 2.1 time: 0.150009 Mar 12 21:32:58.287129 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5079/5847] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:58 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:32:59.303672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7dfb8bd-39b8-46c0-917f-b9d8593e598d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:32:59.304310 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7dfb8bd-39b8-46c0-917f-b9d8593e598d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:32:59.311693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7dfb8bd-39b8-46c0-917f-b9d8593e598d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:59.312173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7dfb8bd-39b8-46c0-917f-b9d8593e598d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:59.312973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7dfb8bd-39b8-46c0-917f-b9d8593e598d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:59.313435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7dfb8bd-39b8-46c0-917f-b9d8593e598d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:59.456985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c7dfb8bd-39b8-46c0-917f-b9d8593e598d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:32:59.464935 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7dfb8bd-39b8-46c0-917f-b9d8593e598d tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1362 microversion: 2.1 time: 0.165072 Mar 12 21:32:59.470437 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5080/5848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:32:59 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:32:59.475129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-eb8c9d1d-9865-4e6e-b2ea-2b44d6c23455 req-e68dfcea-934e-431d-aa78-5fc49f2a28dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96997437-204b-4da2-bbcd-b781ab1edcec", "name": "network-vif-plugged", "status": "completed", "tag": "e36287d3-77af-41f4-87e6-2ef807ae46ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:32:59.483458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-eb8c9d1d-9865-4e6e-b2ea-2b44d6c23455 req-e68dfcea-934e-431d-aa78-5fc49f2a28dc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:32:59.484059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-eb8c9d1d-9865-4e6e-b2ea-2b44d6c23455 req-e68dfcea-934e-431d-aa78-5fc49f2a28dc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:32:59.495266 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-eb8c9d1d-9865-4e6e-b2ea-2b44d6c23455 req-e68dfcea-934e-431d-aa78-5fc49f2a28dc service nova] Creating event network-vif-plugged:e36287d3-77af-41f4-87e6-2ef807ae46ab for instance 96997437-204b-4da2-bbcd-b781ab1edcec on nch2-master-1 Mar 12 21:32:59.500846 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-eb8c9d1d-9865-4e6e-b2ea-2b44d6c23455 req-e68dfcea-934e-431d-aa78-5fc49f2a28dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029218 Mar 12 21:32:59.501443 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5081/5849] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:33:00.483767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d926ab40-e5e5-40de-97ef-9cda21c52727 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:00.484492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d926ab40-e5e5-40de-97ef-9cda21c52727 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:00.490824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d926ab40-e5e5-40de-97ef-9cda21c52727 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:00.491309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d926ab40-e5e5-40de-97ef-9cda21c52727 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:00.492108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d926ab40-e5e5-40de-97ef-9cda21c52727 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:00.492567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d926ab40-e5e5-40de-97ef-9cda21c52727 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:00.639829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d926ab40-e5e5-40de-97ef-9cda21c52727 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:00.647507 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d926ab40-e5e5-40de-97ef-9cda21c52727 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1362 microversion: 2.1 time: 0.169523 Mar 12 21:33:00.648103 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5082/5850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:00 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:01.665522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c0ae493-a903-447a-ac65-6a23e04cd6fb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:01.666417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c0ae493-a903-447a-ac65-6a23e04cd6fb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:01.673640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c0ae493-a903-447a-ac65-6a23e04cd6fb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:01.674142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c0ae493-a903-447a-ac65-6a23e04cd6fb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:01.674934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c0ae493-a903-447a-ac65-6a23e04cd6fb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:01.675397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c0ae493-a903-447a-ac65-6a23e04cd6fb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:01.805471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c0ae493-a903-447a-ac65-6a23e04cd6fb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:01.812860 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c0ae493-a903-447a-ac65-6a23e04cd6fb tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1550 microversion: 2.1 time: 0.151460 Mar 12 21:33:01.813435 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5083/5851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:01 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:01.829186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e6d6e4da-ab43-41e6-92a7-c4222786b073 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:01.829679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e6d6e4da-ab43-41e6-92a7-c4222786b073 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:01.835784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6d6e4da-ab43-41e6-92a7-c4222786b073 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:01.836253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6d6e4da-ab43-41e6-92a7-c4222786b073 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:01.837042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6d6e4da-ab43-41e6-92a7-c4222786b073 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:01.837501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6d6e4da-ab43-41e6-92a7-c4222786b073 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:01.923393 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e6d6e4da-ab43-41e6-92a7-c4222786b073 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097926 Mar 12 21:33:01.924004 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5084/5852] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Mar 12 21:33:01 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:33:02.860937 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d5ccc438-e225-4a8d-8fc3-7b9117edebd9 req-83ad975a-80d1-4702-b9dc-c172e07a55bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96997437-204b-4da2-bbcd-b781ab1edcec", "tag": "e36287d3-77af-41f4-87e6-2ef807ae46ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:02.870750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d5ccc438-e225-4a8d-8fc3-7b9117edebd9 req-83ad975a-80d1-4702-b9dc-c172e07a55bc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:02.871221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d5ccc438-e225-4a8d-8fc3-7b9117edebd9 req-83ad975a-80d1-4702-b9dc-c172e07a55bc service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:02.883429 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d5ccc438-e225-4a8d-8fc3-7b9117edebd9 req-83ad975a-80d1-4702-b9dc-c172e07a55bc service nova] Creating event network-changed:e36287d3-77af-41f4-87e6-2ef807ae46ab for instance 96997437-204b-4da2-bbcd-b781ab1edcec on nch2-master-1 Mar 12 21:33:02.888650 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d5ccc438-e225-4a8d-8fc3-7b9117edebd9 req-83ad975a-80d1-4702-b9dc-c172e07a55bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032452 Mar 12 21:33:02.890266 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5085/5853] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:33:04.246301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3716bf3-b1f0-4f06-88b9-2f17258b9c64 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:04.247002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c3716bf3-b1f0-4f06-88b9-2f17258b9c64 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:04.253712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3716bf3-b1f0-4f06-88b9-2f17258b9c64 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:04.254308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3716bf3-b1f0-4f06-88b9-2f17258b9c64 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:04.255158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3716bf3-b1f0-4f06-88b9-2f17258b9c64 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:04.255621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3716bf3-b1f0-4f06-88b9-2f17258b9c64 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:04.395477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c3716bf3-b1f0-4f06-88b9-2f17258b9c64 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:04.403975 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3716bf3-b1f0-4f06-88b9-2f17258b9c64 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1669 microversion: 2.1 time: 0.162843 Mar 12 21:33:04.404658 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5086/5854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:04 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:04.426052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c403419f-39c5-459c-a79f-d2afa44e8978 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f38d0574-4c66-480c-a8f6-8b21ad0a473a"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:04.427560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c403419f-39c5-459c-a79f-d2afa44e8978 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:04.439389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c403419f-39c5-459c-a79f-d2afa44e8978 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:04.439896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c403419f-39c5-459c-a79f-d2afa44e8978 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:04.440745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c403419f-39c5-459c-a79f-d2afa44e8978 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:04.441212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c403419f-39c5-459c-a79f-d2afa44e8978 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:04.670243 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c403419f-39c5-459c-a79f-d2afa44e8978 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248769 Mar 12 21:33:04.670863 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5087/5855] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:33:04 2022] POST /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:33:05.099058 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:33:05.099275 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 21:33:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 21:33:06.884262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:06.885405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:06.893685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:06.894189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:06.894981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:06.895441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:06.922931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:06.928606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Old instance type m1.heat2, new instance type m1.heat {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 21:33:06.935315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:33:06.935757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:33:06.936810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:33:06.937249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:33:06.937667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:33:07.007187 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6c22e5d5-a017-48d2-89e4-6cad9a1f8043 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec/action" status: 202 len: 0 microversion: 2.1 time: 0.128173 Mar 12 21:33:07.008002 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5088/5856] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:33:06 2022] POST /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:33:07.016185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4360024d-4b87-4ab1-bb43-11756198644b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:07.016814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4360024d-4b87-4ab1-bb43-11756198644b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:07.022739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4360024d-4b87-4ab1-bb43-11756198644b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:07.023213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4360024d-4b87-4ab1-bb43-11756198644b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:07.023996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4360024d-4b87-4ab1-bb43-11756198644b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:07.024455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4360024d-4b87-4ab1-bb43-11756198644b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:07.166904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4360024d-4b87-4ab1-bb43-11756198644b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:07.176667 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4360024d-4b87-4ab1-bb43-11756198644b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1724 microversion: 2.1 time: 0.164427 Mar 12 21:33:07.177315 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5089/5857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:07 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:33:08.193906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75663d3b-8cb9-4619-ad25-715dc64a73fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:08.194604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75663d3b-8cb9-4619-ad25-715dc64a73fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:08.201365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75663d3b-8cb9-4619-ad25-715dc64a73fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:08.201878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75663d3b-8cb9-4619-ad25-715dc64a73fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:08.202661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75663d3b-8cb9-4619-ad25-715dc64a73fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:08.203116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75663d3b-8cb9-4619-ad25-715dc64a73fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:08.345265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-75663d3b-8cb9-4619-ad25-715dc64a73fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:08.353581 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75663d3b-8cb9-4619-ad25-715dc64a73fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1724 microversion: 2.1 time: 0.163599 Mar 12 21:33:08.354371 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5090/5858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:08 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:09.371751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2708aa6c-0aaf-4e15-951d-f4af58a43406 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:09.372383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2708aa6c-0aaf-4e15-951d-f4af58a43406 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:09.379807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2708aa6c-0aaf-4e15-951d-f4af58a43406 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:09.380273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2708aa6c-0aaf-4e15-951d-f4af58a43406 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:09.381049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2708aa6c-0aaf-4e15-951d-f4af58a43406 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:09.381500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2708aa6c-0aaf-4e15-951d-f4af58a43406 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:09.511676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2708aa6c-0aaf-4e15-951d-f4af58a43406 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:09.520315 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2708aa6c-0aaf-4e15-951d-f4af58a43406 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.152650 Mar 12 21:33:09.520927 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5091/5859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:09 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:10.537803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5220939b-c94f-40b3-bf35-06d905f51d96 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:10.538545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5220939b-c94f-40b3-bf35-06d905f51d96 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:10.546311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5220939b-c94f-40b3-bf35-06d905f51d96 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:10.546782 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5220939b-c94f-40b3-bf35-06d905f51d96 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:10.547558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5220939b-c94f-40b3-bf35-06d905f51d96 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:10.548007 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5220939b-c94f-40b3-bf35-06d905f51d96 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:10.682171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5220939b-c94f-40b3-bf35-06d905f51d96 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:10.690587 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5220939b-c94f-40b3-bf35-06d905f51d96 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.156800 Mar 12 21:33:10.691170 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5092/5860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:10 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:11.707861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e06b8336-568e-4efd-9d81-4b16bde19f84 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:11.708514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e06b8336-568e-4efd-9d81-4b16bde19f84 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:11.715246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e06b8336-568e-4efd-9d81-4b16bde19f84 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:11.715719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e06b8336-568e-4efd-9d81-4b16bde19f84 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:11.716504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e06b8336-568e-4efd-9d81-4b16bde19f84 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:11.716968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e06b8336-568e-4efd-9d81-4b16bde19f84 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:11.847743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e06b8336-568e-4efd-9d81-4b16bde19f84 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:11.856384 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e06b8336-568e-4efd-9d81-4b16bde19f84 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.152581 Mar 12 21:33:11.856984 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5093/5861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:11 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:12.875260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a9f673aa-4d90-476a-96ec-9b76b246f2bf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:12.875957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a9f673aa-4d90-476a-96ec-9b76b246f2bf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:12.882890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9f673aa-4d90-476a-96ec-9b76b246f2bf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:12.883364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9f673aa-4d90-476a-96ec-9b76b246f2bf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:12.884147 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9f673aa-4d90-476a-96ec-9b76b246f2bf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:12.884606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a9f673aa-4d90-476a-96ec-9b76b246f2bf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:13.021088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a9f673aa-4d90-476a-96ec-9b76b246f2bf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:13.030434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a9f673aa-4d90-476a-96ec-9b76b246f2bf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.158492 Mar 12 21:33:13.031017 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5094/5862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:12 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:14.048336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cc1e403e-be6c-4914-b1f8-475f4c9a201f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:14.048999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cc1e403e-be6c-4914-b1f8-475f4c9a201f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:14.057206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc1e403e-be6c-4914-b1f8-475f4c9a201f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:14.057676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc1e403e-be6c-4914-b1f8-475f4c9a201f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:14.058538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc1e403e-be6c-4914-b1f8-475f4c9a201f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:14.058986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cc1e403e-be6c-4914-b1f8-475f4c9a201f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:14.192414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cc1e403e-be6c-4914-b1f8-475f4c9a201f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:14.200365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cc1e403e-be6c-4914-b1f8-475f4c9a201f tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.156607 Mar 12 21:33:14.200955 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5095/5863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:14 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:15.218074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-156855c3-ae24-49f6-89f1-0f23ec0f2681 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:15.218692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-156855c3-ae24-49f6-89f1-0f23ec0f2681 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:15.225478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-156855c3-ae24-49f6-89f1-0f23ec0f2681 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:15.225997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-156855c3-ae24-49f6-89f1-0f23ec0f2681 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:15.226791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-156855c3-ae24-49f6-89f1-0f23ec0f2681 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:15.227251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-156855c3-ae24-49f6-89f1-0f23ec0f2681 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:15.362389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-156855c3-ae24-49f6-89f1-0f23ec0f2681 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:15.370389 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-156855c3-ae24-49f6-89f1-0f23ec0f2681 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.156477 Mar 12 21:33:15.370966 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5096/5864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:15 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:16.388445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f038fdc-ec47-4541-97f3-a8a272d77ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:16.389754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4f038fdc-ec47-4541-97f3-a8a272d77ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:16.396491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f038fdc-ec47-4541-97f3-a8a272d77ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:16.396960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f038fdc-ec47-4541-97f3-a8a272d77ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:16.397746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f038fdc-ec47-4541-97f3-a8a272d77ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:16.398229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4f038fdc-ec47-4541-97f3-a8a272d77ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:16.528617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4f038fdc-ec47-4541-97f3-a8a272d77ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:16.537097 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4f038fdc-ec47-4541-97f3-a8a272d77ce8 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.152634 Mar 12 21:33:16.537664 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5097/5865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:16 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:17.553969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12c94425-3eef-4be2-a661-f34591330caf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:17.554623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-12c94425-3eef-4be2-a661-f34591330caf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:17.561560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12c94425-3eef-4be2-a661-f34591330caf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:17.562064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12c94425-3eef-4be2-a661-f34591330caf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:17.562860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12c94425-3eef-4be2-a661-f34591330caf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:17.563319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12c94425-3eef-4be2-a661-f34591330caf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:17.693425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-12c94425-3eef-4be2-a661-f34591330caf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:17.701440 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-12c94425-3eef-4be2-a661-f34591330caf tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.151513 Mar 12 21:33:17.702056 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5098/5866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:17 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:18.718545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96919d3a-8dd8-4580-acdb-b9813bf496a1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:18.719220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96919d3a-8dd8-4580-acdb-b9813bf496a1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:18.725992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96919d3a-8dd8-4580-acdb-b9813bf496a1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:18.726465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96919d3a-8dd8-4580-acdb-b9813bf496a1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:18.727240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96919d3a-8dd8-4580-acdb-b9813bf496a1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:18.727693 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96919d3a-8dd8-4580-acdb-b9813bf496a1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:18.871415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96919d3a-8dd8-4580-acdb-b9813bf496a1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:18.880128 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96919d3a-8dd8-4580-acdb-b9813bf496a1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.165496 Mar 12 21:33:18.880717 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5099/5867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:18 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:19.896799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16e96e0f-9a95-4264-bc8b-42c04cb27ee4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:19.897438 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16e96e0f-9a95-4264-bc8b-42c04cb27ee4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:19.904289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16e96e0f-9a95-4264-bc8b-42c04cb27ee4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:19.904761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16e96e0f-9a95-4264-bc8b-42c04cb27ee4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:19.906257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16e96e0f-9a95-4264-bc8b-42c04cb27ee4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:19.906717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16e96e0f-9a95-4264-bc8b-42c04cb27ee4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:20.035621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16e96e0f-9a95-4264-bc8b-42c04cb27ee4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:20.043809 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16e96e0f-9a95-4264-bc8b-42c04cb27ee4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.151018 Mar 12 21:33:20.044421 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5100/5868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:19 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:21.062212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-483e4030-ce53-468a-be37-5ce1e94dc311 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:21.062870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-483e4030-ce53-468a-be37-5ce1e94dc311 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:21.069607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-483e4030-ce53-468a-be37-5ce1e94dc311 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:21.070100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-483e4030-ce53-468a-be37-5ce1e94dc311 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:21.070882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-483e4030-ce53-468a-be37-5ce1e94dc311 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:21.071337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-483e4030-ce53-468a-be37-5ce1e94dc311 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:21.207652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-483e4030-ce53-468a-be37-5ce1e94dc311 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:21.215490 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-483e4030-ce53-468a-be37-5ce1e94dc311 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.157295 Mar 12 21:33:21.216074 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5101/5869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:21 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:22.233139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51da763e-168d-4d92-bbbe-d666a366166c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:22.233867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51da763e-168d-4d92-bbbe-d666a366166c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:22.241110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51da763e-168d-4d92-bbbe-d666a366166c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:22.241814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51da763e-168d-4d92-bbbe-d666a366166c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:22.242623 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51da763e-168d-4d92-bbbe-d666a366166c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:22.243075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51da763e-168d-4d92-bbbe-d666a366166c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:22.373395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51da763e-168d-4d92-bbbe-d666a366166c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:22.381692 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51da763e-168d-4d92-bbbe-d666a366166c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.152604 Mar 12 21:33:22.382294 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5102/5870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:22 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:23.401511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f05feb9-4125-41ea-9659-51733cd31312 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:23.402249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f05feb9-4125-41ea-9659-51733cd31312 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:23.409131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f05feb9-4125-41ea-9659-51733cd31312 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:23.409614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f05feb9-4125-41ea-9659-51733cd31312 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:23.410455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f05feb9-4125-41ea-9659-51733cd31312 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:23.410920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f05feb9-4125-41ea-9659-51733cd31312 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:23.543376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f05feb9-4125-41ea-9659-51733cd31312 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:23.552018 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f05feb9-4125-41ea-9659-51733cd31312 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.154539 Mar 12 21:33:23.552622 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5103/5871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:23 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:33:24.568541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1e25cd51-cdcb-4e28-ad90-7f845dc2c149 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:24.569176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1e25cd51-cdcb-4e28-ad90-7f845dc2c149 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:24.576116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e25cd51-cdcb-4e28-ad90-7f845dc2c149 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:24.576588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e25cd51-cdcb-4e28-ad90-7f845dc2c149 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:24.578033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e25cd51-cdcb-4e28-ad90-7f845dc2c149 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:24.578496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1e25cd51-cdcb-4e28-ad90-7f845dc2c149 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:24.711709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1e25cd51-cdcb-4e28-ad90-7f845dc2c149 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:24.719515 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1e25cd51-cdcb-4e28-ad90-7f845dc2c149 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.154965 Mar 12 21:33:24.720096 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5104/5872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:24 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:25.736085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3cc9b890-3545-47cf-a360-e9127b9da928 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:25.736736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3cc9b890-3545-47cf-a360-e9127b9da928 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:25.743670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cc9b890-3545-47cf-a360-e9127b9da928 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:25.744143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cc9b890-3545-47cf-a360-e9127b9da928 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:25.744935 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cc9b890-3545-47cf-a360-e9127b9da928 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:25.745398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3cc9b890-3545-47cf-a360-e9127b9da928 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:25.942155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3cc9b890-3545-47cf-a360-e9127b9da928 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:25.950046 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3cc9b890-3545-47cf-a360-e9127b9da928 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1729 microversion: 2.1 time: 0.217881 Mar 12 21:33:25.950628 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5105/5873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:25 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:26.828934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-16ef67f8-95b8-44dd-8cb3-fe9b1bb15b06 req-739ca99d-2971-4784-b4d5-d2acae3fad9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96997437-204b-4da2-bbcd-b781ab1edcec", "name": "network-vif-unplugged", "status": "completed", "tag": "e36287d3-77af-41f4-87e6-2ef807ae46ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:26.838136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-16ef67f8-95b8-44dd-8cb3-fe9b1bb15b06 req-739ca99d-2971-4784-b4d5-d2acae3fad9e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:26.838603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-16ef67f8-95b8-44dd-8cb3-fe9b1bb15b06 req-739ca99d-2971-4784-b4d5-d2acae3fad9e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:26.851215 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-16ef67f8-95b8-44dd-8cb3-fe9b1bb15b06 req-739ca99d-2971-4784-b4d5-d2acae3fad9e service nova] Creating event network-vif-unplugged:e36287d3-77af-41f4-87e6-2ef807ae46ab for instance 96997437-204b-4da2-bbcd-b781ab1edcec on nch1-master-1 Mar 12 21:33:26.860133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-16ef67f8-95b8-44dd-8cb3-fe9b1bb15b06 req-739ca99d-2971-4784-b4d5-d2acae3fad9e service nova] Instance 96997437-204b-4da2-bbcd-b781ab1edcec is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:33:26.871640 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-16ef67f8-95b8-44dd-8cb3-fe9b1bb15b06 req-739ca99d-2971-4784-b4d5-d2acae3fad9e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047447 Mar 12 21:33:26.875149 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5106/5874] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:33:26.968446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d7a5c15-1a0e-4591-a18a-b7db2264de0b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:26.969514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5d7a5c15-1a0e-4591-a18a-b7db2264de0b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:26.976508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d7a5c15-1a0e-4591-a18a-b7db2264de0b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:26.976979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d7a5c15-1a0e-4591-a18a-b7db2264de0b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:26.977997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d7a5c15-1a0e-4591-a18a-b7db2264de0b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:26.978766 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d7a5c15-1a0e-4591-a18a-b7db2264de0b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:27.124583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5d7a5c15-1a0e-4591-a18a-b7db2264de0b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:27.134924 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5d7a5c15-1a0e-4591-a18a-b7db2264de0b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1728 microversion: 2.1 time: 0.170331 Mar 12 21:33:27.135893 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5107/5875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:26 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:27.466464 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:33:27.466978 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:33:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:33:28.152908 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0dc54fb1-dbdb-4850-b6f1-b3030006e817 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:28.153460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0dc54fb1-dbdb-4850-b6f1-b3030006e817 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:28.160176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0dc54fb1-dbdb-4850-b6f1-b3030006e817 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:28.160655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0dc54fb1-dbdb-4850-b6f1-b3030006e817 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:28.161447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0dc54fb1-dbdb-4850-b6f1-b3030006e817 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:28.161932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0dc54fb1-dbdb-4850-b6f1-b3030006e817 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:28.296775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0dc54fb1-dbdb-4850-b6f1-b3030006e817 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:28.304815 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0dc54fb1-dbdb-4850-b6f1-b3030006e817 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1726 microversion: 2.1 time: 0.156287 Mar 12 21:33:28.305388 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5108/5876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:28 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:28.892716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a76ad4f8-1c70-427f-aa74-d296714e5caa req-2b1296d5-717c-459d-98e2-219845f44a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96997437-204b-4da2-bbcd-b781ab1edcec", "tag": "e36287d3-77af-41f4-87e6-2ef807ae46ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:28.900764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a76ad4f8-1c70-427f-aa74-d296714e5caa req-2b1296d5-717c-459d-98e2-219845f44a9e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:28.901229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a76ad4f8-1c70-427f-aa74-d296714e5caa req-2b1296d5-717c-459d-98e2-219845f44a9e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:28.913449 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a76ad4f8-1c70-427f-aa74-d296714e5caa req-2b1296d5-717c-459d-98e2-219845f44a9e service nova] Creating event network-changed:e36287d3-77af-41f4-87e6-2ef807ae46ab for instance 96997437-204b-4da2-bbcd-b781ab1edcec on nch1-master-1 Mar 12 21:33:28.919024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-a76ad4f8-1c70-427f-aa74-d296714e5caa req-2b1296d5-717c-459d-98e2-219845f44a9e service nova] Instance 96997437-204b-4da2-bbcd-b781ab1edcec is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:33:28.930394 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a76ad4f8-1c70-427f-aa74-d296714e5caa req-2b1296d5-717c-459d-98e2-219845f44a9e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041438 Mar 12 21:33:28.931008 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5109/5877] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:33:29.324365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f0eed40d-9363-4740-8e1e-e8e73fd51f5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:29.325093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f0eed40d-9363-4740-8e1e-e8e73fd51f5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:29.331264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0eed40d-9363-4740-8e1e-e8e73fd51f5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:29.331736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0eed40d-9363-4740-8e1e-e8e73fd51f5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:29.332528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0eed40d-9363-4740-8e1e-e8e73fd51f5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:29.332985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0eed40d-9363-4740-8e1e-e8e73fd51f5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:29.474059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f0eed40d-9363-4740-8e1e-e8e73fd51f5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:29.482156 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f0eed40d-9363-4740-8e1e-e8e73fd51f5c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1726 microversion: 2.1 time: 0.162946 Mar 12 21:33:29.482746 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5110/5878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:29 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:30.500388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-261a310f-0fd9-4af2-9892-74be0edcd3f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:30.501159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-261a310f-0fd9-4af2-9892-74be0edcd3f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:30.508723 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-261a310f-0fd9-4af2-9892-74be0edcd3f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:30.509189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-261a310f-0fd9-4af2-9892-74be0edcd3f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:30.509996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-261a310f-0fd9-4af2-9892-74be0edcd3f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:30.510448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-261a310f-0fd9-4af2-9892-74be0edcd3f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:30.646426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-261a310f-0fd9-4af2-9892-74be0edcd3f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:30.655326 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-261a310f-0fd9-4af2-9892-74be0edcd3f9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1726 microversion: 2.1 time: 0.159176 Mar 12 21:33:30.656121 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5111/5879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:30 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:31.674357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3784f5a1-f524-4b67-b34b-9f5dcb03356b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:31.675011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3784f5a1-f524-4b67-b34b-9f5dcb03356b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:31.681721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3784f5a1-f524-4b67-b34b-9f5dcb03356b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:31.682218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3784f5a1-f524-4b67-b34b-9f5dcb03356b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:31.682994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3784f5a1-f524-4b67-b34b-9f5dcb03356b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:31.683446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3784f5a1-f524-4b67-b34b-9f5dcb03356b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:31.813535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3784f5a1-f524-4b67-b34b-9f5dcb03356b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:31.821359 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3784f5a1-f524-4b67-b34b-9f5dcb03356b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1726 microversion: 2.1 time: 0.151677 Mar 12 21:33:31.822074 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5112/5880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:31 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:32.837676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04a32bd7-74da-4d69-9e6d-cc7c4d3faeaa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:32.838405 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04a32bd7-74da-4d69-9e6d-cc7c4d3faeaa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:32.845267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04a32bd7-74da-4d69-9e6d-cc7c4d3faeaa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:32.845756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04a32bd7-74da-4d69-9e6d-cc7c4d3faeaa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:32.846567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04a32bd7-74da-4d69-9e6d-cc7c4d3faeaa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:32.847019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04a32bd7-74da-4d69-9e6d-cc7c4d3faeaa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:32.984155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04a32bd7-74da-4d69-9e6d-cc7c4d3faeaa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:32.992619 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04a32bd7-74da-4d69-9e6d-cc7c4d3faeaa tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1723 microversion: 2.1 time: 0.158949 Mar 12 21:33:32.993212 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5113/5881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:32 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:33.009094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:33.009658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:33.015420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:33.015893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:33.016687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:33.017178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:33.053446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:33.053947 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:33.054773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:33.055235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:33.075524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'ram', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:33:33.080714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Getting quotas for user 2dc99cab406e42d6b6cd00fddedaf960 and project 3b7d22f573c34c77b0bc58bc6b248070. Resources: {'ram', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:33:33.183987 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-acdaeda3-1e84-44c2-bfbd-0dedf5fb6e8b tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "POST /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec/action" status: 202 len: 0 microversion: 2.1 time: 0.178268 Mar 12 21:33:33.184635 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5114/5882] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:33:33 2022] POST /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:33:33.193637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a65d99eb-f35e-456d-9ea0-c6222056847c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:33.194366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a65d99eb-f35e-456d-9ea0-c6222056847c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:33.200660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a65d99eb-f35e-456d-9ea0-c6222056847c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:33.201131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a65d99eb-f35e-456d-9ea0-c6222056847c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:33.202097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a65d99eb-f35e-456d-9ea0-c6222056847c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:33.202682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a65d99eb-f35e-456d-9ea0-c6222056847c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:33.338335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a65d99eb-f35e-456d-9ea0-c6222056847c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:33.348030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a65d99eb-f35e-456d-9ea0-c6222056847c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1722 microversion: 2.1 time: 0.159134 Mar 12 21:33:33.348629 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5115/5883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:33 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:34.364848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cacb8704-8780-467e-a644-f1ac7acf53dd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:34.365544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cacb8704-8780-467e-a644-f1ac7acf53dd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:34.372469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cacb8704-8780-467e-a644-f1ac7acf53dd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:34.372896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cacb8704-8780-467e-a644-f1ac7acf53dd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:34.373682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cacb8704-8780-467e-a644-f1ac7acf53dd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:34.374165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cacb8704-8780-467e-a644-f1ac7acf53dd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:34.515704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cacb8704-8780-467e-a644-f1ac7acf53dd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:34.524388 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cacb8704-8780-467e-a644-f1ac7acf53dd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1722 microversion: 2.1 time: 0.163551 Mar 12 21:33:34.524974 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5116/5884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:34 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:35.542664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-073cb033-5e47-49eb-a3a1-26ba7d8f092c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:35.543420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-073cb033-5e47-49eb-a3a1-26ba7d8f092c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:35.551002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-073cb033-5e47-49eb-a3a1-26ba7d8f092c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:35.551479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-073cb033-5e47-49eb-a3a1-26ba7d8f092c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:35.552287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-073cb033-5e47-49eb-a3a1-26ba7d8f092c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:35.552780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-073cb033-5e47-49eb-a3a1-26ba7d8f092c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:35.698486 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-073cb033-5e47-49eb-a3a1-26ba7d8f092c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:35.706595 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-073cb033-5e47-49eb-a3a1-26ba7d8f092c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1722 microversion: 2.1 time: 0.168210 Mar 12 21:33:35.707182 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5117/5885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:35 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:35.721720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a9fe15eb-b231-4819-a5ae-5089514a2305 req-5d5d2c62-9c77-4006-847b-51d409dfd354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96997437-204b-4da2-bbcd-b781ab1edcec", "name": "network-vif-plugged", "status": "completed", "tag": "e36287d3-77af-41f4-87e6-2ef807ae46ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:35.729651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a9fe15eb-b231-4819-a5ae-5089514a2305 req-5d5d2c62-9c77-4006-847b-51d409dfd354 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:35.730151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a9fe15eb-b231-4819-a5ae-5089514a2305 req-5d5d2c62-9c77-4006-847b-51d409dfd354 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:35.742559 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a9fe15eb-b231-4819-a5ae-5089514a2305 req-5d5d2c62-9c77-4006-847b-51d409dfd354 service nova] Creating event network-vif-plugged:e36287d3-77af-41f4-87e6-2ef807ae46ab for instance 96997437-204b-4da2-bbcd-b781ab1edcec on nch1-master-1 Mar 12 21:33:35.748907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-a9fe15eb-b231-4819-a5ae-5089514a2305 req-5d5d2c62-9c77-4006-847b-51d409dfd354 service nova] Instance 96997437-204b-4da2-bbcd-b781ab1edcec is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:33:35.761635 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a9fe15eb-b231-4819-a5ae-5089514a2305 req-5d5d2c62-9c77-4006-847b-51d409dfd354 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043912 Mar 12 21:33:35.762361 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5118/5886] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:33:36.726346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9eb0dbb7-3f63-46e9-aa86-f7052be6a300 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:36.727172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9eb0dbb7-3f63-46e9-aa86-f7052be6a300 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:36.733242 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9eb0dbb7-3f63-46e9-aa86-f7052be6a300 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:36.733711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9eb0dbb7-3f63-46e9-aa86-f7052be6a300 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:36.734532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9eb0dbb7-3f63-46e9-aa86-f7052be6a300 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:36.734995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9eb0dbb7-3f63-46e9-aa86-f7052be6a300 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:36.885521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9eb0dbb7-3f63-46e9-aa86-f7052be6a300 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:36.897191 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9eb0dbb7-3f63-46e9-aa86-f7052be6a300 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1722 microversion: 2.1 time: 0.176564 Mar 12 21:33:36.898439 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5119/5887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:36 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:36.902971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d1007e13-042a-475b-9fb3-74f1d6efef95 req-3ec40a33-ff73-4fb9-add7-737c2c9c035a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96997437-204b-4da2-bbcd-b781ab1edcec", "name": "network-vif-unplugged", "status": "completed", "tag": "e36287d3-77af-41f4-87e6-2ef807ae46ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:36.917891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d1007e13-042a-475b-9fb3-74f1d6efef95 req-3ec40a33-ff73-4fb9-add7-737c2c9c035a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:36.918365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d1007e13-042a-475b-9fb3-74f1d6efef95 req-3ec40a33-ff73-4fb9-add7-737c2c9c035a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:36.930730 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d1007e13-042a-475b-9fb3-74f1d6efef95 req-3ec40a33-ff73-4fb9-add7-737c2c9c035a service nova] Creating event network-vif-unplugged:e36287d3-77af-41f4-87e6-2ef807ae46ab for instance 96997437-204b-4da2-bbcd-b781ab1edcec on nch2-master-1 Mar 12 21:33:36.936492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-d1007e13-042a-475b-9fb3-74f1d6efef95 req-3ec40a33-ff73-4fb9-add7-737c2c9c035a service nova] Instance 96997437-204b-4da2-bbcd-b781ab1edcec is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:33:36.948493 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d1007e13-042a-475b-9fb3-74f1d6efef95 req-3ec40a33-ff73-4fb9-add7-737c2c9c035a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049403 Mar 12 21:33:36.949613 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5120/5888] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:33:37.918003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99111b9f-ff61-4768-bf4d-c7159958005a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:37.918721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-99111b9f-ff61-4768-bf4d-c7159958005a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:37.925288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99111b9f-ff61-4768-bf4d-c7159958005a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:37.925780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99111b9f-ff61-4768-bf4d-c7159958005a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:37.926557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99111b9f-ff61-4768-bf4d-c7159958005a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:37.927008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99111b9f-ff61-4768-bf4d-c7159958005a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:38.359974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-99111b9f-ff61-4768-bf4d-c7159958005a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:38.368432 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99111b9f-ff61-4768-bf4d-c7159958005a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1722 microversion: 2.1 time: 0.455853 Mar 12 21:33:38.369106 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5121/5889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:37 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1722 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:39.315062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-bf7bc572-683f-46e9-8d9e-b93fcbdf4cbf req-9041700d-4ee1-470d-b054-2fe5ccca3cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96997437-204b-4da2-bbcd-b781ab1edcec", "tag": "e36287d3-77af-41f4-87e6-2ef807ae46ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:39.323777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bf7bc572-683f-46e9-8d9e-b93fcbdf4cbf req-9041700d-4ee1-470d-b054-2fe5ccca3cd4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:39.324238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-bf7bc572-683f-46e9-8d9e-b93fcbdf4cbf req-9041700d-4ee1-470d-b054-2fe5ccca3cd4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:39.337606 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-bf7bc572-683f-46e9-8d9e-b93fcbdf4cbf req-9041700d-4ee1-470d-b054-2fe5ccca3cd4 service nova] Creating event network-changed:e36287d3-77af-41f4-87e6-2ef807ae46ab for instance 96997437-204b-4da2-bbcd-b781ab1edcec on nch2-master-1 Mar 12 21:33:39.342891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-bf7bc572-683f-46e9-8d9e-b93fcbdf4cbf req-9041700d-4ee1-470d-b054-2fe5ccca3cd4 service nova] Instance 96997437-204b-4da2-bbcd-b781ab1edcec is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:33:39.354124 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-bf7bc572-683f-46e9-8d9e-b93fcbdf4cbf req-9041700d-4ee1-470d-b054-2fe5ccca3cd4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042691 Mar 12 21:33:39.354732 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5122/5890] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:33:39.385807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4be10a9-1daa-4950-b231-2508f8fc70ed tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:39.386628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b4be10a9-1daa-4950-b231-2508f8fc70ed tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:39.393392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4be10a9-1daa-4950-b231-2508f8fc70ed tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:39.393897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4be10a9-1daa-4950-b231-2508f8fc70ed tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:39.394709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4be10a9-1daa-4950-b231-2508f8fc70ed tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:39.395157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4be10a9-1daa-4950-b231-2508f8fc70ed tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:39.538067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b4be10a9-1daa-4950-b231-2508f8fc70ed tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:39.546297 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b4be10a9-1daa-4950-b231-2508f8fc70ed tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1722 microversion: 2.1 time: 0.165027 Mar 12 21:33:39.546881 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5123/5891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:39 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:33:40.564985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-50f4c40b-07c0-4333-b4bb-ee32e6406af4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:40.565686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-50f4c40b-07c0-4333-b4bb-ee32e6406af4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:40.572872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50f4c40b-07c0-4333-b4bb-ee32e6406af4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:40.573323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50f4c40b-07c0-4333-b4bb-ee32e6406af4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:40.574188 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50f4c40b-07c0-4333-b4bb-ee32e6406af4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:40.574659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50f4c40b-07c0-4333-b4bb-ee32e6406af4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:40.710045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-50f4c40b-07c0-4333-b4bb-ee32e6406af4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:40.717985 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-50f4c40b-07c0-4333-b4bb-ee32e6406af4 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1722 microversion: 2.1 time: 0.157801 Mar 12 21:33:40.718563 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5124/5892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:40 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:41.736428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8d6c2c8-b6dc-4a98-a865-9fbdb49c33de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:41.737076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8d6c2c8-b6dc-4a98-a865-9fbdb49c33de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:41.743915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8d6c2c8-b6dc-4a98-a865-9fbdb49c33de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:41.744387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8d6c2c8-b6dc-4a98-a865-9fbdb49c33de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:41.745200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8d6c2c8-b6dc-4a98-a865-9fbdb49c33de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:41.745643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8d6c2c8-b6dc-4a98-a865-9fbdb49c33de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:41.876181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a8d6c2c8-b6dc-4a98-a865-9fbdb49c33de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:41.884201 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8d6c2c8-b6dc-4a98-a865-9fbdb49c33de tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1715 microversion: 2.1 time: 0.152336 Mar 12 21:33:41.884816 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5125/5893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:41 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:41.901304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80736812-b2f4-47b3-8336-60e4e6a51117 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:41.901970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80736812-b2f4-47b3-8336-60e4e6a51117 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:41.908954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80736812-b2f4-47b3-8336-60e4e6a51117 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:41.909425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80736812-b2f4-47b3-8336-60e4e6a51117 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:41.910267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80736812-b2f4-47b3-8336-60e4e6a51117 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:41.910721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80736812-b2f4-47b3-8336-60e4e6a51117 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:42.045625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80736812-b2f4-47b3-8336-60e4e6a51117 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:42.053550 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80736812-b2f4-47b3-8336-60e4e6a51117 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1715 microversion: 2.1 time: 0.156232 Mar 12 21:33:42.054357 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5126/5894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:41 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:42.069366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ddd3c975-3c45-4728-b676-0abec1ad48c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:42.070041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ddd3c975-3c45-4728-b676-0abec1ad48c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:42.075711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ddd3c975-3c45-4728-b676-0abec1ad48c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:42.076128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ddd3c975-3c45-4728-b676-0abec1ad48c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:42.076930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ddd3c975-3c45-4728-b676-0abec1ad48c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:42.077390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ddd3c975-3c45-4728-b676-0abec1ad48c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:42.212702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ddd3c975-3c45-4728-b676-0abec1ad48c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:42.220704 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ddd3c975-3c45-4728-b676-0abec1ad48c9 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1715 microversion: 2.1 time: 0.154905 Mar 12 21:33:42.221282 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5127/5895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:42 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:42.236083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7126a51f-54a2-42a8-944e-aecbf9f4c2e1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:42.236595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7126a51f-54a2-42a8-944e-aecbf9f4c2e1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:42.242380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7126a51f-54a2-42a8-944e-aecbf9f4c2e1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:42.242848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7126a51f-54a2-42a8-944e-aecbf9f4c2e1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:42.243619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7126a51f-54a2-42a8-944e-aecbf9f4c2e1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:42.244068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7126a51f-54a2-42a8-944e-aecbf9f4c2e1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:42.268597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7126a51f-54a2-42a8-944e-aecbf9f4c2e1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:33:42.342013 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7126a51f-54a2-42a8-944e-aecbf9f4c2e1 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "DELETE /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 204 len: 0 microversion: 2.1 time: 0.109036 Mar 12 21:33:42.342677 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5128/5896] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:33:42 2022] DELETE /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:33:42.351340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3dafff1-d56f-4103-a64d-870e03b0b028 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:42.352045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c3dafff1-d56f-4103-a64d-870e03b0b028 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:42.357900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3dafff1-d56f-4103-a64d-870e03b0b028 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:42.358369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3dafff1-d56f-4103-a64d-870e03b0b028 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:42.359141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3dafff1-d56f-4103-a64d-870e03b0b028 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:42.359596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3dafff1-d56f-4103-a64d-870e03b0b028 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:42.495106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c3dafff1-d56f-4103-a64d-870e03b0b028 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:42.503513 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3dafff1-d56f-4103-a64d-870e03b0b028 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1721 microversion: 2.1 time: 0.156155 Mar 12 21:33:42.504095 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5129/5897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:42 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:33:43.524869 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a45501d-fa89-4436-bdff-bcce31538276 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:43.525575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a45501d-fa89-4436-bdff-bcce31538276 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:43.532345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a45501d-fa89-4436-bdff-bcce31538276 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:43.533410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a45501d-fa89-4436-bdff-bcce31538276 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:43.534570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a45501d-fa89-4436-bdff-bcce31538276 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:43.535196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a45501d-fa89-4436-bdff-bcce31538276 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:43.681479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5a45501d-fa89-4436-bdff-bcce31538276 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:43.689938 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a45501d-fa89-4436-bdff-bcce31538276 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1721 microversion: 2.1 time: 0.169728 Mar 12 21:33:43.690610 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5130/5898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:43 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:43.705612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-34650557-21a3-4f00-b450-a92341db57f8 req-3e4d8e85-8c0a-4272-bc3a-a9f34a05a68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96997437-204b-4da2-bbcd-b781ab1edcec", "name": "network-vif-plugged", "status": "completed", "tag": "e36287d3-77af-41f4-87e6-2ef807ae46ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:43.714478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-34650557-21a3-4f00-b450-a92341db57f8 req-3e4d8e85-8c0a-4272-bc3a-a9f34a05a68e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:43.714936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-34650557-21a3-4f00-b450-a92341db57f8 req-3e4d8e85-8c0a-4272-bc3a-a9f34a05a68e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:43.726841 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-34650557-21a3-4f00-b450-a92341db57f8 req-3e4d8e85-8c0a-4272-bc3a-a9f34a05a68e service nova] Creating event network-vif-plugged:e36287d3-77af-41f4-87e6-2ef807ae46ab for instance 96997437-204b-4da2-bbcd-b781ab1edcec on nch2-master-1 Mar 12 21:33:43.731844 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-34650557-21a3-4f00-b450-a92341db57f8 req-3e4d8e85-8c0a-4272-bc3a-a9f34a05a68e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031218 Mar 12 21:33:43.732503 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5131/5899] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:33:44.709163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d8c246a6-c93d-4600-af6b-6fa4a7f459ae tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:44.710056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d8c246a6-c93d-4600-af6b-6fa4a7f459ae tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:44.717129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8c246a6-c93d-4600-af6b-6fa4a7f459ae tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:44.717594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8c246a6-c93d-4600-af6b-6fa4a7f459ae tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:44.718418 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8c246a6-c93d-4600-af6b-6fa4a7f459ae tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:44.718872 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8c246a6-c93d-4600-af6b-6fa4a7f459ae tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:44.788637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d8c246a6-c93d-4600-af6b-6fa4a7f459ae tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc99cab406e42d6b6cd00fddedaf960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b7d22f573c34c77b0bc58bc6b248070', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:44.799596 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d8c246a6-c93d-4600-af6b-6fa4a7f459ae tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 200 len: 1654 microversion: 2.1 time: 0.096142 Mar 12 21:33:44.800519 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5132/5900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:44 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 1654 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:44.822210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f812d0d1-fc3a-49b4-8b93-59c686bc8f4a req-1a07b535-94fb-4e68-9fd0-3bb4c688de9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96997437-204b-4da2-bbcd-b781ab1edcec", "name": "network-vif-deleted", "tag": "e36287d3-77af-41f4-87e6-2ef807ae46ab"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:44.831929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f812d0d1-fc3a-49b4-8b93-59c686bc8f4a req-1a07b535-94fb-4e68-9fd0-3bb4c688de9f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:44.832485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f812d0d1-fc3a-49b4-8b93-59c686bc8f4a req-1a07b535-94fb-4e68-9fd0-3bb4c688de9f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:44.846639 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f812d0d1-fc3a-49b4-8b93-59c686bc8f4a req-1a07b535-94fb-4e68-9fd0-3bb4c688de9f service nova] Creating event network-vif-deleted:e36287d3-77af-41f4-87e6-2ef807ae46ab for instance 96997437-204b-4da2-bbcd-b781ab1edcec on nch2-master-1 Mar 12 21:33:44.852002 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f812d0d1-fc3a-49b4-8b93-59c686bc8f4a req-1a07b535-94fb-4e68-9fd0-3bb4c688de9f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Mar 12 21:33:44.853011 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5133/5901] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:33:45.818457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-11a38877-d739-45ff-b1da-f7300bc3f290 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:45.819203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-11a38877-d739-45ff-b1da-f7300bc3f290 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:45.830549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11a38877-d739-45ff-b1da-f7300bc3f290 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:45.830549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11a38877-d739-45ff-b1da-f7300bc3f290 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:45.830549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11a38877-d739-45ff-b1da-f7300bc3f290 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:45.830549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-11a38877-d739-45ff-b1da-f7300bc3f290 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:45.842794 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-11a38877-d739-45ff-b1da-f7300bc3f290 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance 96997437-204b-4da2-bbcd-b781ab1edcec could not be found. Mar 12 21:33:45.843439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-11a38877-d739-45ff-b1da-f7300bc3f290 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance 96997437-204b-4da2-bbcd-b781ab1edcec could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:33:45.844301 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-11a38877-d739-45ff-b1da-f7300bc3f290 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 404 len: 111 microversion: 2.1 time: 0.030804 Mar 12 21:33:45.844887 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5134/5902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:45 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:33:45.906032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25d7249c-02a7-4ea0-8892-21cc23e146fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:45.907036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-25d7249c-02a7-4ea0-8892-21cc23e146fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:45.914092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25d7249c-02a7-4ea0-8892-21cc23e146fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:45.914572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25d7249c-02a7-4ea0-8892-21cc23e146fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:45.915384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25d7249c-02a7-4ea0-8892-21cc23e146fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:45.915842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25d7249c-02a7-4ea0-8892-21cc23e146fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:45.931193 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-25d7249c-02a7-4ea0-8892-21cc23e146fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance 96997437-204b-4da2-bbcd-b781ab1edcec could not be found. Mar 12 21:33:45.931739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25d7249c-02a7-4ea0-8892-21cc23e146fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance 96997437-204b-4da2-bbcd-b781ab1edcec could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:33:45.932761 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-25d7249c-02a7-4ea0-8892-21cc23e146fd tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030904 Mar 12 21:33:45.933613 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5135/5903] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:33:45 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:33:47.129951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e21d8f4c-d704-4754-97c9-e05bae9f0e7a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:47.130554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e21d8f4c-d704-4754-97c9-e05bae9f0e7a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:47.137199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e21d8f4c-d704-4754-97c9-e05bae9f0e7a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.137678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e21d8f4c-d704-4754-97c9-e05bae9f0e7a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.138513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e21d8f4c-d704-4754-97c9-e05bae9f0e7a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.138979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e21d8f4c-d704-4754-97c9-e05bae9f0e7a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.154783 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e21d8f4c-d704-4754-97c9-e05bae9f0e7a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance 96997437-204b-4da2-bbcd-b781ab1edcec could not be found. Mar 12 21:33:47.155393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e21d8f4c-d704-4754-97c9-e05bae9f0e7a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance 96997437-204b-4da2-bbcd-b781ab1edcec could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:33:47.156240 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e21d8f4c-d704-4754-97c9-e05bae9f0e7a tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "DELETE /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 404 len: 111 microversion: 2.1 time: 0.031564 Mar 12 21:33:47.156786 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5136/5904] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:33:47 2022] DELETE /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:33:47.165067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f909fee-fff1-426e-9753-b48a78357c39 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:47.165689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9f909fee-fff1-426e-9753-b48a78357c39 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: 96997437-204b-4da2-bbcd-b781ab1edcec] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:47.171734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f909fee-fff1-426e-9753-b48a78357c39 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.172302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f909fee-fff1-426e-9753-b48a78357c39 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.173082 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f909fee-fff1-426e-9753-b48a78357c39 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.173537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9f909fee-fff1-426e-9753-b48a78357c39 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.186316 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-9f909fee-fff1-426e-9753-b48a78357c39 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance 96997437-204b-4da2-bbcd-b781ab1edcec could not be found. Mar 12 21:33:47.186907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9f909fee-fff1-426e-9753-b48a78357c39 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance 96997437-204b-4da2-bbcd-b781ab1edcec could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:33:47.187721 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9f909fee-fff1-426e-9753-b48a78357c39 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec" status: 404 len: 111 microversion: 2.1 time: 0.026221 Mar 12 21:33:47.188245 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5137/5905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:47 2022] GET /compute/v2.1/servers/96997437-204b-4da2-bbcd-b781ab1edcec => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:33:47.195351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab041c54-a182-48c7-bf8f-37856630b60c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:47.195855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ab041c54-a182-48c7-bf8f-37856630b60c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:47.201420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab041c54-a182-48c7-bf8f-37856630b60c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.201923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab041c54-a182-48c7-bf8f-37856630b60c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.202695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab041c54-a182-48c7-bf8f-37856630b60c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.203145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab041c54-a182-48c7-bf8f-37856630b60c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.217381 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ab041c54-a182-48c7-bf8f-37856630b60c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance ded972f1-262c-4c1a-b251-b07330eb837d could not be found. Mar 12 21:33:47.218008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab041c54-a182-48c7-bf8f-37856630b60c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance ded972f1-262c-4c1a-b251-b07330eb837d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:33:47.218832 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ab041c54-a182-48c7-bf8f-37856630b60c tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 404 len: 111 microversion: 2.1 time: 0.026882 Mar 12 21:33:47.219377 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5138/5906] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:33:47 2022] DELETE /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:33:47.227447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16b4b683-fd50-45d5-80b4-f2ef9cdd2702 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:47.228100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16b4b683-fd50-45d5-80b4-f2ef9cdd2702 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ded972f1-262c-4c1a-b251-b07330eb837d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:47.233724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16b4b683-fd50-45d5-80b4-f2ef9cdd2702 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.234231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16b4b683-fd50-45d5-80b4-f2ef9cdd2702 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.235008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16b4b683-fd50-45d5-80b4-f2ef9cdd2702 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.235465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16b4b683-fd50-45d5-80b4-f2ef9cdd2702 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.249950 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-16b4b683-fd50-45d5-80b4-f2ef9cdd2702 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance ded972f1-262c-4c1a-b251-b07330eb837d could not be found. Mar 12 21:33:47.250544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16b4b683-fd50-45d5-80b4-f2ef9cdd2702 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance ded972f1-262c-4c1a-b251-b07330eb837d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:33:47.251367 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16b4b683-fd50-45d5-80b4-f2ef9cdd2702 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d" status: 404 len: 111 microversion: 2.1 time: 0.027596 Mar 12 21:33:47.251898 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5139/5907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:47 2022] GET /compute/v2.1/servers/ded972f1-262c-4c1a-b251-b07330eb837d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:33:47.259302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-351959e7-a073-4285-a5a3-5d40daef2ed5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:47.259801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-351959e7-a073-4285-a5a3-5d40daef2ed5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:47.265406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-351959e7-a073-4285-a5a3-5d40daef2ed5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.265905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-351959e7-a073-4285-a5a3-5d40daef2ed5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.266674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-351959e7-a073-4285-a5a3-5d40daef2ed5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.267638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-351959e7-a073-4285-a5a3-5d40daef2ed5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.280385 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-351959e7-a073-4285-a5a3-5d40daef2ed5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance da16de87-fb6f-4d4a-8243-54261f560ec6 could not be found. Mar 12 21:33:47.280959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-351959e7-a073-4285-a5a3-5d40daef2ed5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance da16de87-fb6f-4d4a-8243-54261f560ec6 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:33:47.281794 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-351959e7-a073-4285-a5a3-5d40daef2ed5 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "DELETE /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 404 len: 111 microversion: 2.1 time: 0.026061 Mar 12 21:33:47.282314 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5140/5908] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:33:47 2022] DELETE /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:33:47.289948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c552441e-c37b-4c3e-bce3-56a356dcf878 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:47.290565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c552441e-c37b-4c3e-bce3-56a356dcf878 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: da16de87-fb6f-4d4a-8243-54261f560ec6] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:47.296243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c552441e-c37b-4c3e-bce3-56a356dcf878 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.296709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c552441e-c37b-4c3e-bce3-56a356dcf878 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.297476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c552441e-c37b-4c3e-bce3-56a356dcf878 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.297976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c552441e-c37b-4c3e-bce3-56a356dcf878 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.310675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c552441e-c37b-4c3e-bce3-56a356dcf878 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance da16de87-fb6f-4d4a-8243-54261f560ec6 could not be found. Mar 12 21:33:47.311258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c552441e-c37b-4c3e-bce3-56a356dcf878 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance da16de87-fb6f-4d4a-8243-54261f560ec6 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:33:47.312065 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c552441e-c37b-4c3e-bce3-56a356dcf878 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6" status: 404 len: 111 microversion: 2.1 time: 0.025534 Mar 12 21:33:47.312571 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5141/5909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:47 2022] GET /compute/v2.1/servers/da16de87-fb6f-4d4a-8243-54261f560ec6 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:33:47.319607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69b7f043-89ad-44d6-953d-c73493d7a945 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:47.320117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-69b7f043-89ad-44d6-953d-c73493d7a945 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:47.325463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69b7f043-89ad-44d6-953d-c73493d7a945 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.325969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69b7f043-89ad-44d6-953d-c73493d7a945 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.326736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69b7f043-89ad-44d6-953d-c73493d7a945 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.327187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69b7f043-89ad-44d6-953d-c73493d7a945 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.340302 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-69b7f043-89ad-44d6-953d-c73493d7a945 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 could not be found. Mar 12 21:33:47.341252 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69b7f043-89ad-44d6-953d-c73493d7a945 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:33:47.341679 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-69b7f043-89ad-44d6-953d-c73493d7a945 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 404 len: 111 microversion: 2.1 time: 0.025524 Mar 12 21:33:47.342278 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5142/5910] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:33:47 2022] DELETE /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:33:47.349938 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37a26faf-c612-4548-be25-2f99c3646946 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:47.350552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-37a26faf-c612-4548-be25-2f99c3646946 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] [instance: ed26d2b9-3e26-4339-83ab-d3879d00b2c3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:47.356069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37a26faf-c612-4548-be25-2f99c3646946 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.356476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37a26faf-c612-4548-be25-2f99c3646946 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.357240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37a26faf-c612-4548-be25-2f99c3646946 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:47.357696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-37a26faf-c612-4548-be25-2f99c3646946 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:47.370342 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-37a26faf-c612-4548-be25-2f99c3646946 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] HTTP exception thrown: Instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 could not be found. Mar 12 21:33:47.370923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-37a26faf-c612-4548-be25-2f99c3646946 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Returning 404 to user: Instance ed26d2b9-3e26-4339-83ab-d3879d00b2c3 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:33:47.371998 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-37a26faf-c612-4548-be25-2f99c3646946 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3" status: 404 len: 111 microversion: 2.1 time: 0.025232 Mar 12 21:33:47.372405 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5143/5911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:47 2022] GET /compute/v2.1/servers/ed26d2b9-3e26-4339-83ab-d3879d00b2c3 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:33:47.379772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad21ef0f-db81-4b2b-82d3-d00b7e0ebd00 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] Calling method '.version_select at 0x7f6e3728d670>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:47.402043 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad21ef0f-db81-4b2b-82d3-d00b7e0ebd00 tempest-ServerActionsTestJSON-1173026094 tempest-ServerActionsTestJSON-1173026094-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-366629006" status: 202 len: 0 microversion: 2.1 time: 0.025733 Mar 12 21:33:47.402819 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5144/5912] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Mar 12 21:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-366629006 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:33:53.104340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-41263221", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "56171d31-85cb-4d9d-9c9c-d52ac4434144"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:53.156063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] validate_networks() for [('56171d31-85cb-4d9d-9c9c-d52ac4434144', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:33:53.491051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:33:53.491495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:33:53.491990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:33:53.492419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:33:53.492849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:33:53.501813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:53.502831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:53.503668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:53.504123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:53.525932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Getting quotas for project dc7cc1bdbe0f498f845ff7e4bd99a895. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:33:53.532023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Getting quotas for user 0a026a6d628e4b96b5c2cbef16910e25 and project dc7cc1bdbe0f498f845ff7e4bd99a895. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:33:53.544702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:33:53.547045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:33:53.591651 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-108ea3f8-75a4-4370-be68-5a03633fefc9 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605372 Mar 12 21:33:53.592330 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5145/5913] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:33:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:33:53.602192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6be4adba-79d9-476f-9002-5bc9fcc80ffc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:53.602910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6be4adba-79d9-476f-9002-5bc9fcc80ffc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:53.666670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6be4adba-79d9-476f-9002-5bc9fcc80ffc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:53.674190 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6be4adba-79d9-476f-9002-5bc9fcc80ffc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1215 microversion: 2.1 time: 0.075717 Mar 12 21:33:53.674783 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5146/5914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:53 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:54.691369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-98e7e3a3-53e4-49b1-99b8-2cef7df58774 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:54.692051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-98e7e3a3-53e4-49b1-99b8-2cef7df58774 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:54.698970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98e7e3a3-53e4-49b1-99b8-2cef7df58774 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:54.699448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98e7e3a3-53e4-49b1-99b8-2cef7df58774 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:54.700253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98e7e3a3-53e4-49b1-99b8-2cef7df58774 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:54.700711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98e7e3a3-53e4-49b1-99b8-2cef7df58774 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:54.761591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-98e7e3a3-53e4-49b1-99b8-2cef7df58774 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:54.769658 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-98e7e3a3-53e4-49b1-99b8-2cef7df58774 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1273 microversion: 2.1 time: 0.082330 Mar 12 21:33:54.770285 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5147/5915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:54 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:55.757577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9a609bdc-ef53-46ed-b1e4-d78d001151f7 req-ace789c3-5781-411c-9076-0fa09bb32695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6acebb-43eb-4221-b422-5a245cee8570", "tag": "0d2bf9d2-2b90-4d90-862f-3beb6c2e2996"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:55.767881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9a609bdc-ef53-46ed-b1e4-d78d001151f7 req-ace789c3-5781-411c-9076-0fa09bb32695 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:55.768352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9a609bdc-ef53-46ed-b1e4-d78d001151f7 req-ace789c3-5781-411c-9076-0fa09bb32695 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:55.780339 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9a609bdc-ef53-46ed-b1e4-d78d001151f7 req-ace789c3-5781-411c-9076-0fa09bb32695 service nova] Creating event network-changed:0d2bf9d2-2b90-4d90-862f-3beb6c2e2996 for instance 4e6acebb-43eb-4221-b422-5a245cee8570 on nch2-master-1 Mar 12 21:33:55.785740 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9a609bdc-ef53-46ed-b1e4-d78d001151f7 req-ace789c3-5781-411c-9076-0fa09bb32695 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031836 Mar 12 21:33:55.786416 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5148/5916] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:33:55.791559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80658c44-107e-4a46-a3db-2a6fb3259357 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:55.792274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80658c44-107e-4a46-a3db-2a6fb3259357 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:55.798690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80658c44-107e-4a46-a3db-2a6fb3259357 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:55.799197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80658c44-107e-4a46-a3db-2a6fb3259357 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:55.800536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80658c44-107e-4a46-a3db-2a6fb3259357 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:55.800995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80658c44-107e-4a46-a3db-2a6fb3259357 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:55.943841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80658c44-107e-4a46-a3db-2a6fb3259357 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:55.956294 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80658c44-107e-4a46-a3db-2a6fb3259357 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1315 microversion: 2.1 time: 0.167880 Mar 12 21:33:55.957197 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5149/5917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:55 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:33:56.978323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09ead90b-df1d-4d79-8357-c9a0e32602fc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:56.978976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-09ead90b-df1d-4d79-8357-c9a0e32602fc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:56.985686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09ead90b-df1d-4d79-8357-c9a0e32602fc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:56.986186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09ead90b-df1d-4d79-8357-c9a0e32602fc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:56.987030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09ead90b-df1d-4d79-8357-c9a0e32602fc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:56.987484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09ead90b-df1d-4d79-8357-c9a0e32602fc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:57.121807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09ead90b-df1d-4d79-8357-c9a0e32602fc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:57.129151 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09ead90b-df1d-4d79-8357-c9a0e32602fc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1315 microversion: 2.1 time: 0.154791 Mar 12 21:33:57.129733 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5150/5918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:56 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:58.145886 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0e74008a-d99a-493a-a17f-768ac7671636 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:58.146554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0e74008a-d99a-493a-a17f-768ac7671636 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:58.152484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e74008a-d99a-493a-a17f-768ac7671636 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:58.152955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e74008a-d99a-493a-a17f-768ac7671636 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:58.153737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e74008a-d99a-493a-a17f-768ac7671636 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:58.154222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e74008a-d99a-493a-a17f-768ac7671636 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:58.287755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0e74008a-d99a-493a-a17f-768ac7671636 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:58.295340 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0e74008a-d99a-493a-a17f-768ac7671636 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1315 microversion: 2.1 time: 0.153765 Mar 12 21:33:58.295957 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5151/5919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:58 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:59.312715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c6aac26-f5ed-4626-a6da-22e5beab89b4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:33:59.313363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2c6aac26-f5ed-4626-a6da-22e5beab89b4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:33:59.320730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c6aac26-f5ed-4626-a6da-22e5beab89b4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:59.321201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c6aac26-f5ed-4626-a6da-22e5beab89b4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:59.322019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c6aac26-f5ed-4626-a6da-22e5beab89b4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:59.322482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2c6aac26-f5ed-4626-a6da-22e5beab89b4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:59.451788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c6aac26-f5ed-4626-a6da-22e5beab89b4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:33:59.459211 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c6aac26-f5ed-4626-a6da-22e5beab89b4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1315 microversion: 2.1 time: 0.150516 Mar 12 21:33:59.459798 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5152/5920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:33:59 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:33:59.708123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5a53541f-e1b2-4276-b46e-d88d27d77062 req-8f75a601-7215-47f2-95a5-3750fe2d702b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6acebb-43eb-4221-b422-5a245cee8570", "name": "network-vif-plugged", "status": "completed", "tag": "0d2bf9d2-2b90-4d90-862f-3beb6c2e2996"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:33:59.717981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5a53541f-e1b2-4276-b46e-d88d27d77062 req-8f75a601-7215-47f2-95a5-3750fe2d702b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:33:59.718453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5a53541f-e1b2-4276-b46e-d88d27d77062 req-8f75a601-7215-47f2-95a5-3750fe2d702b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:33:59.730298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5a53541f-e1b2-4276-b46e-d88d27d77062 req-8f75a601-7215-47f2-95a5-3750fe2d702b service nova] Creating event network-vif-plugged:0d2bf9d2-2b90-4d90-862f-3beb6c2e2996 for instance 4e6acebb-43eb-4221-b422-5a245cee8570 on nch2-master-1 Mar 12 21:33:59.735422 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5a53541f-e1b2-4276-b46e-d88d27d77062 req-8f75a601-7215-47f2-95a5-3750fe2d702b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031138 Mar 12 21:33:59.736198 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5153/5921] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:34:00.476470 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a7ae1ead-515f-4522-b0ee-ebb64d20dc32 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:00.477190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a7ae1ead-515f-4522-b0ee-ebb64d20dc32 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:00.484267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7ae1ead-515f-4522-b0ee-ebb64d20dc32 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:00.484738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7ae1ead-515f-4522-b0ee-ebb64d20dc32 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:00.485524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7ae1ead-515f-4522-b0ee-ebb64d20dc32 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:00.486014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a7ae1ead-515f-4522-b0ee-ebb64d20dc32 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:00.620297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a7ae1ead-515f-4522-b0ee-ebb64d20dc32 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:00.628334 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a7ae1ead-515f-4522-b0ee-ebb64d20dc32 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1315 microversion: 2.1 time: 0.155480 Mar 12 21:34:00.628924 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5154/5922] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:00 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:01.645109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-392efe62-e06e-41f1-8914-caacbee13b51 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:01.645752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-392efe62-e06e-41f1-8914-caacbee13b51 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:01.652403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-392efe62-e06e-41f1-8914-caacbee13b51 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:01.652867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-392efe62-e06e-41f1-8914-caacbee13b51 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:01.653656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-392efe62-e06e-41f1-8914-caacbee13b51 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:01.654139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-392efe62-e06e-41f1-8914-caacbee13b51 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:01.783811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-392efe62-e06e-41f1-8914-caacbee13b51 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:01.791094 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-392efe62-e06e-41f1-8914-caacbee13b51 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1504 microversion: 2.1 time: 0.150581 Mar 12 21:34:01.791934 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5155/5923] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:01 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:01.846008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-370687809", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "56171d31-85cb-4d9d-9c9c-d52ac4434144"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:34:01.896168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] validate_networks() for [('56171d31-85cb-4d9d-9c9c-d52ac4434144', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:34:02.251791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:34:02.252285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:34:02.253371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:34:02.253835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:34:02.254274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:34:02.263791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:02.264264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:02.265090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:02.265555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:02.282238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Getting quotas for project dc7cc1bdbe0f498f845ff7e4bd99a895. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:34:02.287559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Getting quotas for user 0a026a6d628e4b96b5c2cbef16910e25 and project dc7cc1bdbe0f498f845ff7e4bd99a895. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:34:02.300612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:34:02.302928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:34:02.349547 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-58a375aa-bc24-436b-9420-726f5960459f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507161 Mar 12 21:34:02.350734 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5156/5924] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:34:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:34:02.360371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-361f3865-d492-4728-9083-48e6f3255c20 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:02.361033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-361f3865-d492-4728-9083-48e6f3255c20 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:02.413225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-361f3865-d492-4728-9083-48e6f3255c20 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:02.420588 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-361f3865-d492-4728-9083-48e6f3255c20 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 200 len: 1216 microversion: 2.1 time: 0.064062 Mar 12 21:34:02.421158 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5157/5925] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:02 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 1216 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:03.437643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-27ff717a-56c9-46e2-a999-48d2992c434d tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:03.438366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-27ff717a-56c9-46e2-a999-48d2992c434d tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:03.445883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27ff717a-56c9-46e2-a999-48d2992c434d tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:03.446350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27ff717a-56c9-46e2-a999-48d2992c434d tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:03.447145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27ff717a-56c9-46e2-a999-48d2992c434d tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:03.447600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-27ff717a-56c9-46e2-a999-48d2992c434d tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:03.511210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-27ff717a-56c9-46e2-a999-48d2992c434d tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:03.521146 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-27ff717a-56c9-46e2-a999-48d2992c434d tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 200 len: 1274 microversion: 2.1 time: 0.086897 Mar 12 21:34:03.522317 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5158/5926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:03 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:04.513582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0087171e-42be-4d42-8a63-cda94c54ea0f req-ff2f40c5-94bb-4a08-b5e2-09ec03eb9edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a51b5c0-2bb7-4bb0-8009-c8a0051030b1", "tag": "ef0f271c-e6a4-47fc-a7df-c42b49eeea03"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:34:04.525530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0087171e-42be-4d42-8a63-cda94c54ea0f req-ff2f40c5-94bb-4a08-b5e2-09ec03eb9edb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:04.526022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0087171e-42be-4d42-8a63-cda94c54ea0f req-ff2f40c5-94bb-4a08-b5e2-09ec03eb9edb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:04.539203 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0087171e-42be-4d42-8a63-cda94c54ea0f req-ff2f40c5-94bb-4a08-b5e2-09ec03eb9edb service nova] Creating event network-changed:ef0f271c-e6a4-47fc-a7df-c42b49eeea03 for instance 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 on nch1-master-1 Mar 12 21:34:04.544783 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0087171e-42be-4d42-8a63-cda94c54ea0f req-ff2f40c5-94bb-4a08-b5e2-09ec03eb9edb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035544 Mar 12 21:34:04.545501 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5159/5927] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:34:04.553749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ca44814-5e24-4bac-a93b-a19c5081ccf7 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:04.554523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ca44814-5e24-4bac-a93b-a19c5081ccf7 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:04.560857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ca44814-5e24-4bac-a93b-a19c5081ccf7 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:04.561326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ca44814-5e24-4bac-a93b-a19c5081ccf7 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:04.562197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ca44814-5e24-4bac-a93b-a19c5081ccf7 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:04.562598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ca44814-5e24-4bac-a93b-a19c5081ccf7 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:04.709285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ca44814-5e24-4bac-a93b-a19c5081ccf7 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:04.716856 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ca44814-5e24-4bac-a93b-a19c5081ccf7 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 200 len: 1316 microversion: 2.1 time: 0.167086 Mar 12 21:34:04.717441 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5160/5928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:04 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:34:05.733980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b977d2f2-015b-44f4-ba0a-1540559eaade tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:05.734628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b977d2f2-015b-44f4-ba0a-1540559eaade tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:05.742185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b977d2f2-015b-44f4-ba0a-1540559eaade tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:05.742650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b977d2f2-015b-44f4-ba0a-1540559eaade tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:05.743431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b977d2f2-015b-44f4-ba0a-1540559eaade tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:05.743878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b977d2f2-015b-44f4-ba0a-1540559eaade tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:05.876794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b977d2f2-015b-44f4-ba0a-1540559eaade tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:05.884107 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b977d2f2-015b-44f4-ba0a-1540559eaade tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 200 len: 1316 microversion: 2.1 time: 0.154250 Mar 12 21:34:05.884682 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5161/5929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:05 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:06.901069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-89062df5-c8af-4697-ae8e-33ad7e480e40 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:06.901737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89062df5-c8af-4697-ae8e-33ad7e480e40 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:06.909107 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89062df5-c8af-4697-ae8e-33ad7e480e40 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:06.909608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89062df5-c8af-4697-ae8e-33ad7e480e40 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:06.910420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89062df5-c8af-4697-ae8e-33ad7e480e40 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:06.910879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89062df5-c8af-4697-ae8e-33ad7e480e40 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:07.045450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-89062df5-c8af-4697-ae8e-33ad7e480e40 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:07.053422 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-89062df5-c8af-4697-ae8e-33ad7e480e40 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 200 len: 1316 microversion: 2.1 time: 0.156313 Mar 12 21:34:07.054045 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5162/5930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:06 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:08.069917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-649a3d79-ff4b-4666-a1bf-c21a554b5f60 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:08.070587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-649a3d79-ff4b-4666-a1bf-c21a554b5f60 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:08.077687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-649a3d79-ff4b-4666-a1bf-c21a554b5f60 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:08.078215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-649a3d79-ff4b-4666-a1bf-c21a554b5f60 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:08.079039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-649a3d79-ff4b-4666-a1bf-c21a554b5f60 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:08.079503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-649a3d79-ff4b-4666-a1bf-c21a554b5f60 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:08.215633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-649a3d79-ff4b-4666-a1bf-c21a554b5f60 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:08.224045 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-649a3d79-ff4b-4666-a1bf-c21a554b5f60 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 200 len: 1316 microversion: 2.1 time: 0.158067 Mar 12 21:34:08.224908 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5163/5931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:08 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:09.246049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-98e1fdf4-b1a2-46b3-851e-f4cfc66a5b4c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:09.246688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-98e1fdf4-b1a2-46b3-851e-f4cfc66a5b4c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:09.253551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98e1fdf4-b1a2-46b3-851e-f4cfc66a5b4c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:09.254064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98e1fdf4-b1a2-46b3-851e-f4cfc66a5b4c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:09.254855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98e1fdf4-b1a2-46b3-851e-f4cfc66a5b4c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:09.255314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-98e1fdf4-b1a2-46b3-851e-f4cfc66a5b4c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:09.389720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-98e1fdf4-b1a2-46b3-851e-f4cfc66a5b4c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:09.397050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-98e1fdf4-b1a2-46b3-851e-f4cfc66a5b4c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 200 len: 1316 microversion: 2.1 time: 0.155021 Mar 12 21:34:09.397629 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5164/5932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:09 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:09.736816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8b6b763a-0eec-4843-a7fb-306d56701fe3 req-f552ed9d-1f80-4ec7-9415-a535366a30ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a51b5c0-2bb7-4bb0-8009-c8a0051030b1", "name": "network-vif-plugged", "status": "completed", "tag": "ef0f271c-e6a4-47fc-a7df-c42b49eeea03"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:34:09.745186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8b6b763a-0eec-4843-a7fb-306d56701fe3 req-f552ed9d-1f80-4ec7-9415-a535366a30ba service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:09.745931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8b6b763a-0eec-4843-a7fb-306d56701fe3 req-f552ed9d-1f80-4ec7-9415-a535366a30ba service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:09.757862 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8b6b763a-0eec-4843-a7fb-306d56701fe3 req-f552ed9d-1f80-4ec7-9415-a535366a30ba service nova] Creating event network-vif-plugged:ef0f271c-e6a4-47fc-a7df-c42b49eeea03 for instance 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 on nch1-master-1 Mar 12 21:34:09.762961 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8b6b763a-0eec-4843-a7fb-306d56701fe3 req-f552ed9d-1f80-4ec7-9415-a535366a30ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030176 Mar 12 21:34:09.763580 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5165/5933] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:34:10.414445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d27b3d4-d85b-40f5-baf4-dff57b831036 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:10.415078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2d27b3d4-d85b-40f5-baf4-dff57b831036 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:10.421716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d27b3d4-d85b-40f5-baf4-dff57b831036 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:10.422210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d27b3d4-d85b-40f5-baf4-dff57b831036 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:10.422988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d27b3d4-d85b-40f5-baf4-dff57b831036 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:10.423436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d27b3d4-d85b-40f5-baf4-dff57b831036 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:10.558162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2d27b3d4-d85b-40f5-baf4-dff57b831036 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:10.566170 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d27b3d4-d85b-40f5-baf4-dff57b831036 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 200 len: 1316 microversion: 2.1 time: 0.156741 Mar 12 21:34:10.566765 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5166/5934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:10 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:11.585865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-63f89341-8693-44ad-9778-1735da618193 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:11.586607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-63f89341-8693-44ad-9778-1735da618193 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:11.593384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63f89341-8693-44ad-9778-1735da618193 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:11.593882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63f89341-8693-44ad-9778-1735da618193 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:11.594661 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63f89341-8693-44ad-9778-1735da618193 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:11.595112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63f89341-8693-44ad-9778-1735da618193 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:11.729105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-63f89341-8693-44ad-9778-1735da618193 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:11.736540 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-63f89341-8693-44ad-9778-1735da618193 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 200 len: 1506 microversion: 2.1 time: 0.154619 Mar 12 21:34:11.737814 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5167/5935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:11 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:11.752413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e70b880f-02fe-4537-80f9-6353ac55589f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:11.752946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e70b880f-02fe-4537-80f9-6353ac55589f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:11.758528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e70b880f-02fe-4537-80f9-6353ac55589f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:11.759004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e70b880f-02fe-4537-80f9-6353ac55589f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:11.759792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e70b880f-02fe-4537-80f9-6353ac55589f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:11.760251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e70b880f-02fe-4537-80f9-6353ac55589f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:11.784134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e70b880f-02fe-4537-80f9-6353ac55589f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:34:11.861967 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e70b880f-02fe-4537-80f9-6353ac55589f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 204 len: 0 microversion: 2.1 time: 0.112069 Mar 12 21:34:11.862569 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5168/5936] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:34:11 2022] DELETE /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:34:11.870518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ef7483a6-0490-4c36-9e6c-373093b9784c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:11.871231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ef7483a6-0490-4c36-9e6c-373093b9784c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:11.877026 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef7483a6-0490-4c36-9e6c-373093b9784c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:11.877488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef7483a6-0490-4c36-9e6c-373093b9784c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:11.878296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef7483a6-0490-4c36-9e6c-373093b9784c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:11.878746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ef7483a6-0490-4c36-9e6c-373093b9784c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:12.013805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ef7483a6-0490-4c36-9e6c-373093b9784c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:12.021743 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ef7483a6-0490-4c36-9e6c-373093b9784c tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 200 len: 1512 microversion: 2.1 time: 0.155199 Mar 12 21:34:12.022344 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5169/5937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:11 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:34:13.038349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-26157002-1c24-4581-941b-452a8c7bcab4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:13.039010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-26157002-1c24-4581-941b-452a8c7bcab4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:13.047003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26157002-1c24-4581-941b-452a8c7bcab4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:13.047471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26157002-1c24-4581-941b-452a8c7bcab4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:13.048260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26157002-1c24-4581-941b-452a8c7bcab4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:13.048711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-26157002-1c24-4581-941b-452a8c7bcab4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:13.184734 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-26157002-1c24-4581-941b-452a8c7bcab4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:13.193248 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-26157002-1c24-4581-941b-452a8c7bcab4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 200 len: 1512 microversion: 2.1 time: 0.158880 Mar 12 21:34:13.193924 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5170/5938] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:13 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:13.715151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e4628b6b-7d2e-4c0c-8100-0eccdd99e7e0 req-b8855957-b8d7-40df-a659-ca36cf7e0b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a51b5c0-2bb7-4bb0-8009-c8a0051030b1", "name": "network-vif-deleted", "tag": "ef0f271c-e6a4-47fc-a7df-c42b49eeea03"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:34:13.726703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e4628b6b-7d2e-4c0c-8100-0eccdd99e7e0 req-b8855957-b8d7-40df-a659-ca36cf7e0b1e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:13.727163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e4628b6b-7d2e-4c0c-8100-0eccdd99e7e0 req-b8855957-b8d7-40df-a659-ca36cf7e0b1e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:13.741923 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e4628b6b-7d2e-4c0c-8100-0eccdd99e7e0 req-b8855957-b8d7-40df-a659-ca36cf7e0b1e service nova] Creating event network-vif-deleted:ef0f271c-e6a4-47fc-a7df-c42b49eeea03 for instance 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 on nch1-master-1 Mar 12 21:34:13.747747 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e4628b6b-7d2e-4c0c-8100-0eccdd99e7e0 req-b8855957-b8d7-40df-a659-ca36cf7e0b1e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036384 Mar 12 21:34:13.748680 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5171/5939] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:34:14.211308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4addcd5d-0a57-4e7e-8800-a7f0b72d243a tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:14.212034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4addcd5d-0a57-4e7e-8800-a7f0b72d243a tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:14.219141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4addcd5d-0a57-4e7e-8800-a7f0b72d243a tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.219619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4addcd5d-0a57-4e7e-8800-a7f0b72d243a tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.220413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4addcd5d-0a57-4e7e-8800-a7f0b72d243a tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.220876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4addcd5d-0a57-4e7e-8800-a7f0b72d243a tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.235388 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-4addcd5d-0a57-4e7e-8800-a7f0b72d243a tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] HTTP exception thrown: Instance 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 could not be found. Mar 12 21:34:14.235999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4addcd5d-0a57-4e7e-8800-a7f0b72d243a tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Returning 404 to user: Instance 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:34:14.236862 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4addcd5d-0a57-4e7e-8800-a7f0b72d243a tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 404 len: 111 microversion: 2.1 time: 0.029946 Mar 12 21:34:14.237413 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5172/5940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:14 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:34:14.245490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1ddc30d3-577a-490f-aafe-52af80c50112 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:14.246149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1ddc30d3-577a-490f-aafe-52af80c50112 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:14.251780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ddc30d3-577a-490f-aafe-52af80c50112 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.252273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ddc30d3-577a-490f-aafe-52af80c50112 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.253059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ddc30d3-577a-490f-aafe-52af80c50112 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.253518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ddc30d3-577a-490f-aafe-52af80c50112 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.387146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1ddc30d3-577a-490f-aafe-52af80c50112 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:14.395252 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1ddc30d3-577a-490f-aafe-52af80c50112 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1504 microversion: 2.1 time: 0.153308 Mar 12 21:34:14.395822 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5173/5941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:14 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:14.411401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb68baf0-028f-4e98-9ed8-f4dd3fec0ec4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:34:14.412372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb68baf0-028f-4e98-9ed8-f4dd3fec0ec4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 295fe91f-0f1a-4fbb-a226-687f9c905287] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:14.417748 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bb68baf0-028f-4e98-9ed8-f4dd3fec0ec4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] HTTP exception thrown: Instance 295fe91f-0f1a-4fbb-a226-687f9c905287 could not be found. Mar 12 21:34:14.418363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb68baf0-028f-4e98-9ed8-f4dd3fec0ec4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Returning 404 to user: Instance 295fe91f-0f1a-4fbb-a226-687f9c905287 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:34:14.419176 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb68baf0-028f-4e98-9ed8-f4dd3fec0ec4 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "POST /compute/v2.1/servers/295fe91f-0f1a-4fbb-a226-687f9c905287/action" status: 404 len: 111 microversion: 2.1 time: 0.012087 Mar 12 21:34:14.419697 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5174/5942] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:34:14 2022] POST /compute/v2.1/servers/295fe91f-0f1a-4fbb-a226-687f9c905287/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:34:14.426809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0f7c328c-83c9-4e57-99ca-fe0164ff11fe tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:14.427417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0f7c328c-83c9-4e57-99ca-fe0164ff11fe tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:14.433822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f7c328c-83c9-4e57-99ca-fe0164ff11fe tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.434273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f7c328c-83c9-4e57-99ca-fe0164ff11fe tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.435053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f7c328c-83c9-4e57-99ca-fe0164ff11fe tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.435665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0f7c328c-83c9-4e57-99ca-fe0164ff11fe tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.570027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0f7c328c-83c9-4e57-99ca-fe0164ff11fe tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:14.577818 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0f7c328c-83c9-4e57-99ca-fe0164ff11fe tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1504 microversion: 2.1 time: 0.154219 Mar 12 21:34:14.578400 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5175/5943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:14 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:14.595614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52dd69be-7ec5-47bc-9fc1-b18bc0ef8b19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:14.596172 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-52dd69be-7ec5-47bc-9fc1-b18bc0ef8b19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:14.602164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52dd69be-7ec5-47bc-9fc1-b18bc0ef8b19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.602634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52dd69be-7ec5-47bc-9fc1-b18bc0ef8b19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.603446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52dd69be-7ec5-47bc-9fc1-b18bc0ef8b19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.603903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52dd69be-7ec5-47bc-9fc1-b18bc0ef8b19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.733907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-52dd69be-7ec5-47bc-9fc1-b18bc0ef8b19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:14.741299 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-52dd69be-7ec5-47bc-9fc1-b18bc0ef8b19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1504 microversion: 2.1 time: 0.149491 Mar 12 21:34:14.741919 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5176/5944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:14 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:14.757402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7809018-d0f3-4756-875b-b8859ed47a19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "9396f39e-62e4-48f1-96f8-479968b9f96a"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:34:14.758396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c7809018-d0f3-4756-875b-b8859ed47a19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:14.766587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7809018-d0f3-4756-875b-b8859ed47a19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.767059 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7809018-d0f3-4756-875b-b8859ed47a19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.768410 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7809018-d0f3-4756-875b-b8859ed47a19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.768871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c7809018-d0f3-4756-875b-b8859ed47a19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.800647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c7809018-d0f3-4756-875b-b8859ed47a19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:14.805828 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-c7809018-d0f3-4756-875b-b8859ed47a19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] HTTP exception thrown: Flavor 9396f39e-62e4-48f1-96f8-479968b9f96a could not be found. Mar 12 21:34:14.806456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c7809018-d0f3-4756-875b-b8859ed47a19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Returning 400 to user: Flavor 9396f39e-62e4-48f1-96f8-479968b9f96a could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:34:14.807324 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c7809018-d0f3-4756-875b-b8859ed47a19 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "POST /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570/action" status: 400 len: 107 microversion: 2.1 time: 0.053563 Mar 12 21:34:14.807880 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5177/5945] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:34:14 2022] POST /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570/action => generated 107 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 12 21:34:14.816185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ecac6c24-c22a-4f73-8e3a-44c413f275e2 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:14.816803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ecac6c24-c22a-4f73-8e3a-44c413f275e2 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:14.822364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecac6c24-c22a-4f73-8e3a-44c413f275e2 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.822828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecac6c24-c22a-4f73-8e3a-44c413f275e2 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.823604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecac6c24-c22a-4f73-8e3a-44c413f275e2 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.824056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ecac6c24-c22a-4f73-8e3a-44c413f275e2 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.958831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ecac6c24-c22a-4f73-8e3a-44c413f275e2 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:14.967093 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ecac6c24-c22a-4f73-8e3a-44c413f275e2 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1504 microversion: 2.1 time: 0.155061 Mar 12 21:34:14.967673 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5178/5946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:14 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:34:14.983291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39a76661-2de8-4d46-83ff-d11505ec3ff0 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:14.983929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39a76661-2de8-4d46-83ff-d11505ec3ff0 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:14.990670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39a76661-2de8-4d46-83ff-d11505ec3ff0 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.991134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39a76661-2de8-4d46-83ff-d11505ec3ff0 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:14.991906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39a76661-2de8-4d46-83ff-d11505ec3ff0 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:14.992353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39a76661-2de8-4d46-83ff-d11505ec3ff0 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:15.121900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-39a76661-2de8-4d46-83ff-d11505ec3ff0 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:15.130010 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39a76661-2de8-4d46-83ff-d11505ec3ff0 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1504 microversion: 2.1 time: 0.150285 Mar 12 21:34:15.130581 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5179/5947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:14 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:15.145706 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5ac139c-e1fe-4323-8cc1-1dc1e5ad883b tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:34:15.146862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5ac139c-e1fe-4323-8cc1-1dc1e5ad883b tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:34:15.147657 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e5ac139c-e1fe-4323-8cc1-1dc1e5ad883b tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "POST /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570/action" status: 400 len: 113 microversion: 2.1 time: 0.005875 Mar 12 21:34:15.148163 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5180/5948] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:34:15 2022] POST /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 12 21:34:15.154800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d0aaeb09-97c0-4131-8769-d7c5a4a61934 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:15.155414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d0aaeb09-97c0-4131-8769-d7c5a4a61934 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:15.162502 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0aaeb09-97c0-4131-8769-d7c5a4a61934 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:15.162969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0aaeb09-97c0-4131-8769-d7c5a4a61934 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:15.163745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0aaeb09-97c0-4131-8769-d7c5a4a61934 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:15.164198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d0aaeb09-97c0-4131-8769-d7c5a4a61934 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:15.298187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d0aaeb09-97c0-4131-8769-d7c5a4a61934 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:15.306114 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d0aaeb09-97c0-4131-8769-d7c5a4a61934 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1504 microversion: 2.1 time: 0.154454 Mar 12 21:34:15.306688 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5181/5949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:15 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:15.325161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f66ae7c-ca16-4de3-baf7-f469ab41e501 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:15.325669 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6f66ae7c-ca16-4de3-baf7-f469ab41e501 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:15.331312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f66ae7c-ca16-4de3-baf7-f469ab41e501 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:15.331776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f66ae7c-ca16-4de3-baf7-f469ab41e501 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:15.332552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f66ae7c-ca16-4de3-baf7-f469ab41e501 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:15.333003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6f66ae7c-ca16-4de3-baf7-f469ab41e501 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:15.347070 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-6f66ae7c-ca16-4de3-baf7-f469ab41e501 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] HTTP exception thrown: Instance 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 could not be found. Mar 12 21:34:15.347678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6f66ae7c-ca16-4de3-baf7-f469ab41e501 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Returning 404 to user: Instance 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:34:15.349634 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6f66ae7c-ca16-4de3-baf7-f469ab41e501 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 404 len: 111 microversion: 2.1 time: 0.028100 Mar 12 21:34:15.350227 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5182/5950] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:34:15 2022] DELETE /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:34:15.357476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-76d52490-7aff-4025-bb98-f755cdb14b15 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:15.358129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-76d52490-7aff-4025-bb98-f755cdb14b15 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:15.364294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76d52490-7aff-4025-bb98-f755cdb14b15 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:15.364761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76d52490-7aff-4025-bb98-f755cdb14b15 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:15.365550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76d52490-7aff-4025-bb98-f755cdb14b15 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:15.366031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76d52490-7aff-4025-bb98-f755cdb14b15 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:15.378824 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-76d52490-7aff-4025-bb98-f755cdb14b15 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] HTTP exception thrown: Instance 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 could not be found. Mar 12 21:34:15.379364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-76d52490-7aff-4025-bb98-f755cdb14b15 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Returning 404 to user: Instance 5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:34:15.380203 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-76d52490-7aff-4025-bb98-f755cdb14b15 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1" status: 404 len: 111 microversion: 2.1 time: 0.026176 Mar 12 21:34:15.380717 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5183/5951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:15 2022] GET /compute/v2.1/servers/5a51b5c0-2bb7-4bb0-8009-c8a0051030b1 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:34:15.387721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a015015e-2676-49e3-b323-9a10dd431056 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:15.388227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a015015e-2676-49e3-b323-9a10dd431056 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:15.394490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a015015e-2676-49e3-b323-9a10dd431056 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:15.394972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a015015e-2676-49e3-b323-9a10dd431056 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:15.395757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a015015e-2676-49e3-b323-9a10dd431056 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:15.396213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a015015e-2676-49e3-b323-9a10dd431056 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:15.420186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a015015e-2676-49e3-b323-9a10dd431056 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:34:15.495501 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a015015e-2676-49e3-b323-9a10dd431056 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 204 len: 0 microversion: 2.1 time: 0.110594 Mar 12 21:34:15.496214 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5184/5952] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:34:15 2022] DELETE /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:34:15.504598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-52a03f6c-0520-4b8e-8ad3-a66e4a8fd735 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:15.505376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-52a03f6c-0520-4b8e-8ad3-a66e4a8fd735 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:15.511146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52a03f6c-0520-4b8e-8ad3-a66e4a8fd735 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:15.511617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52a03f6c-0520-4b8e-8ad3-a66e4a8fd735 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:15.512401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52a03f6c-0520-4b8e-8ad3-a66e4a8fd735 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:15.512851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-52a03f6c-0520-4b8e-8ad3-a66e4a8fd735 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:15.648291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-52a03f6c-0520-4b8e-8ad3-a66e4a8fd735 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:15.655735 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-52a03f6c-0520-4b8e-8ad3-a66e4a8fd735 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1510 microversion: 2.1 time: 0.155227 Mar 12 21:34:15.656303 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5185/5953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:15 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:16.673258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b40ab3c-170c-4b36-abf2-f75016842ffc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:16.673979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b40ab3c-170c-4b36-abf2-f75016842ffc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:16.681354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b40ab3c-170c-4b36-abf2-f75016842ffc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:16.681960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b40ab3c-170c-4b36-abf2-f75016842ffc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:16.682671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b40ab3c-170c-4b36-abf2-f75016842ffc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:16.683127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b40ab3c-170c-4b36-abf2-f75016842ffc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:16.812037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b40ab3c-170c-4b36-abf2-f75016842ffc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:16.819888 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b40ab3c-170c-4b36-abf2-f75016842ffc tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1510 microversion: 2.1 time: 0.150560 Mar 12 21:34:16.820455 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5186/5954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:16 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:17.650095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f4e711f5-b84a-45c9-af95-25d9e24384ba req-0edd0e95-8e87-4b7f-82f1-efb61f92a286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6acebb-43eb-4221-b422-5a245cee8570", "name": "network-vif-deleted", "tag": "0d2bf9d2-2b90-4d90-862f-3beb6c2e2996"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:34:17.659946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f4e711f5-b84a-45c9-af95-25d9e24384ba req-0edd0e95-8e87-4b7f-82f1-efb61f92a286 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:17.660412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f4e711f5-b84a-45c9-af95-25d9e24384ba req-0edd0e95-8e87-4b7f-82f1-efb61f92a286 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:17.672124 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f4e711f5-b84a-45c9-af95-25d9e24384ba req-0edd0e95-8e87-4b7f-82f1-efb61f92a286 service nova] Creating event network-vif-deleted:0d2bf9d2-2b90-4d90-862f-3beb6c2e2996 for instance 4e6acebb-43eb-4221-b422-5a245cee8570 on nch2-master-1 Mar 12 21:34:17.678367 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f4e711f5-b84a-45c9-af95-25d9e24384ba req-0edd0e95-8e87-4b7f-82f1-efb61f92a286 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031891 Mar 12 21:34:17.679019 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5187/5955] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:34:17.838165 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b1b2540-4ac0-40f7-9466-baeff34fd55f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:17.838887 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b1b2540-4ac0-40f7-9466-baeff34fd55f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:17.845129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b1b2540-4ac0-40f7-9466-baeff34fd55f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:17.845604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b1b2540-4ac0-40f7-9466-baeff34fd55f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:17.846445 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b1b2540-4ac0-40f7-9466-baeff34fd55f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:17.846903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b1b2540-4ac0-40f7-9466-baeff34fd55f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:17.877804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b1b2540-4ac0-40f7-9466-baeff34fd55f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:17.878297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b1b2540-4ac0-40f7-9466-baeff34fd55f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:17.878773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-9b1b2540-4ac0-40f7-9466-baeff34fd55f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lazy-loading 'fault' on Instance uuid 4e6acebb-43eb-4221-b422-5a245cee8570 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:34:17.922388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b1b2540-4ac0-40f7-9466-baeff34fd55f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a026a6d628e4b96b5c2cbef16910e25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7cc1bdbe0f498f845ff7e4bd99a895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:17.930315 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b1b2540-4ac0-40f7-9466-baeff34fd55f tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 200 len: 1305 microversion: 2.1 time: 0.097363 Mar 12 21:34:17.930903 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5188/5956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:17 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:18.948157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ade66429-c43f-4f9e-b5ad-2f9480be6f04 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:18.948829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ade66429-c43f-4f9e-b5ad-2f9480be6f04 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] [instance: 4e6acebb-43eb-4221-b422-5a245cee8570] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:18.955794 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ade66429-c43f-4f9e-b5ad-2f9480be6f04 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:18.956275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ade66429-c43f-4f9e-b5ad-2f9480be6f04 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:18.957069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ade66429-c43f-4f9e-b5ad-2f9480be6f04 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:18.957532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ade66429-c43f-4f9e-b5ad-2f9480be6f04 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:18.972643 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ade66429-c43f-4f9e-b5ad-2f9480be6f04 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] HTTP exception thrown: Instance 4e6acebb-43eb-4221-b422-5a245cee8570 could not be found. Mar 12 21:34:18.973251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ade66429-c43f-4f9e-b5ad-2f9480be6f04 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] Returning 404 to user: Instance 4e6acebb-43eb-4221-b422-5a245cee8570 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:34:18.974119 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ade66429-c43f-4f9e-b5ad-2f9480be6f04 tempest-ServersNegativeTestJSON-1870595804 tempest-ServersNegativeTestJSON-1870595804-project] 10.222.0.30 "GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570" status: 404 len: 111 microversion: 2.1 time: 0.029969 Mar 12 21:34:18.974675 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5189/5957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:18 2022] GET /compute/v2.1/servers/4e6acebb-43eb-4221-b422-5a245cee8570 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:34:57.713287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4f2ae655-c192-4988-9426-5c2fa1947e9d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Action: 'create', calling method: .version_select at 0x7f6e3731a700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-232026373"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:34:57.727992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4f2ae655-c192-4988-9426-5c2fa1947e9d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Getting quotas for project bf5558ecf7a94032ba36db2e467d97ab. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:34:57.733088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4f2ae655-c192-4988-9426-5c2fa1947e9d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Getting quotas for user 4111688f50434e13b938b6c99c71912b and project bf5558ecf7a94032ba36db2e467d97ab. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:34:57.815711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4f2ae655-c192-4988-9426-5c2fa1947e9d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Getting quotas for project bf5558ecf7a94032ba36db2e467d97ab. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:34:57.820643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4f2ae655-c192-4988-9426-5c2fa1947e9d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Getting quotas for user 4111688f50434e13b938b6c99c71912b and project bf5558ecf7a94032ba36db2e467d97ab. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:34:57.834788 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4f2ae655-c192-4988-9426-5c2fa1947e9d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.126768 Mar 12 21:34:57.835398 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5190/5958] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:34:57 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:57.895309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-580760670", "imageRef": "3fed0419-9f55-4475-82be-5b127ca5ea53", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-232026373", "networks": [{"uuid": "67c7af8e-9917-458d-8818-4f96208bf226"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:34:57.953065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] validate_networks() for [('67c7af8e-9917-458d-8818-4f96208bf226', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:34:58.335046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:34:58.335492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:34:58.335994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:34:58.336424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:34:58.336852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:34:58.346238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:58.346701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:58.347521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:58.347976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:58.364361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Getting quotas for project bf5558ecf7a94032ba36db2e467d97ab. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:34:58.369653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Getting quotas for user 4111688f50434e13b938b6c99c71912b and project bf5558ecf7a94032ba36db2e467d97ab. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:34:58.382466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:34:58.384700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3fed0419-9f55-4475-82be-5b127ca5ea53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:34:58.430092 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4554f0df-8e42-460f-b692-7da07bfb793e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538628 Mar 12 21:34:58.430908 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5191/5959] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:34:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:34:58.440317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad65d6fc-5966-4b18-be23-6bc663c61045 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:58.440946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad65d6fc-5966-4b18-be23-6bc663c61045 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:58.493045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad65d6fc-5966-4b18-be23-6bc663c61045 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:58.499796 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad65d6fc-5966-4b18-be23-6bc663c61045 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1257 microversion: 2.1 time: 0.063174 Mar 12 21:34:58.500382 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5192/5960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:58 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1257 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:34:59.516859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9e4bd91-bcfd-47f4-bc8c-522ea7ca12ba tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:34:59.518193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9e4bd91-bcfd-47f4-bc8c-522ea7ca12ba tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:34:59.526505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9e4bd91-bcfd-47f4-bc8c-522ea7ca12ba tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:59.527027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9e4bd91-bcfd-47f4-bc8c-522ea7ca12ba tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:59.528510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9e4bd91-bcfd-47f4-bc8c-522ea7ca12ba tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:34:59.528510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9e4bd91-bcfd-47f4-bc8c-522ea7ca12ba tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:34:59.619589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9e4bd91-bcfd-47f4-bc8c-522ea7ca12ba tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:34:59.632419 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9e4bd91-bcfd-47f4-bc8c-522ea7ca12ba tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1315 microversion: 2.1 time: 0.119419 Mar 12 21:34:59.633871 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5193/5961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:34:59 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1315 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:00.653624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0ee316d1-7bb1-418b-81c4-13466f1e861b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:00.654667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0ee316d1-7bb1-418b-81c4-13466f1e861b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:00.661760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ee316d1-7bb1-418b-81c4-13466f1e861b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:00.662361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ee316d1-7bb1-418b-81c4-13466f1e861b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:00.663245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ee316d1-7bb1-418b-81c4-13466f1e861b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:00.663792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0ee316d1-7bb1-418b-81c4-13466f1e861b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:00.809644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0ee316d1-7bb1-418b-81c4-13466f1e861b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:00.818739 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0ee316d1-7bb1-418b-81c4-13466f1e861b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1357 microversion: 2.1 time: 0.169284 Mar 12 21:35:00.823326 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5194/5962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:00 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:35:01.836957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-61ca68d5-25eb-42d9-ad30-604c2a429323 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:01.838731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-61ca68d5-25eb-42d9-ad30-604c2a429323 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:01.847393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61ca68d5-25eb-42d9-ad30-604c2a429323 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:01.848251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61ca68d5-25eb-42d9-ad30-604c2a429323 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:01.849345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61ca68d5-25eb-42d9-ad30-604c2a429323 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:01.850086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-61ca68d5-25eb-42d9-ad30-604c2a429323 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:02.003700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-61ca68d5-25eb-42d9-ad30-604c2a429323 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:02.012053 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-61ca68d5-25eb-42d9-ad30-604c2a429323 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1357 microversion: 2.1 time: 0.179520 Mar 12 21:35:02.022007 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5195/5963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:01 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:03.029655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d8420a90-eb8e-4d6e-bb7e-92f41fa6c047 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:03.030656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d8420a90-eb8e-4d6e-bb7e-92f41fa6c047 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:03.038619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8420a90-eb8e-4d6e-bb7e-92f41fa6c047 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:03.039094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8420a90-eb8e-4d6e-bb7e-92f41fa6c047 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:03.039901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8420a90-eb8e-4d6e-bb7e-92f41fa6c047 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:03.040525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8420a90-eb8e-4d6e-bb7e-92f41fa6c047 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:03.180244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d8420a90-eb8e-4d6e-bb7e-92f41fa6c047 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:03.188116 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d8420a90-eb8e-4d6e-bb7e-92f41fa6c047 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1357 microversion: 2.1 time: 0.162323 Mar 12 21:35:03.192425 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5196/5964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:03 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:04.206639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b1ef87b7-1bbf-4dd6-b494-d266c4aff130 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:04.207320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b1ef87b7-1bbf-4dd6-b494-d266c4aff130 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:04.215250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1ef87b7-1bbf-4dd6-b494-d266c4aff130 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:04.215719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1ef87b7-1bbf-4dd6-b494-d266c4aff130 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:04.216525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1ef87b7-1bbf-4dd6-b494-d266c4aff130 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:04.217006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b1ef87b7-1bbf-4dd6-b494-d266c4aff130 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:04.364786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b1ef87b7-1bbf-4dd6-b494-d266c4aff130 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:04.372738 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b1ef87b7-1bbf-4dd6-b494-d266c4aff130 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1357 microversion: 2.1 time: 0.171122 Mar 12 21:35:04.386044 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5197/5965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:04 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:05.398028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-19cb8c12-ad91-4e3a-a809-d30036c4c8e5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:05.398725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19cb8c12-ad91-4e3a-a809-d30036c4c8e5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:05.407061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19cb8c12-ad91-4e3a-a809-d30036c4c8e5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:05.408054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19cb8c12-ad91-4e3a-a809-d30036c4c8e5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:05.408873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19cb8c12-ad91-4e3a-a809-d30036c4c8e5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:05.409324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19cb8c12-ad91-4e3a-a809-d30036c4c8e5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:05.567636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-19cb8c12-ad91-4e3a-a809-d30036c4c8e5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:05.575970 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-19cb8c12-ad91-4e3a-a809-d30036c4c8e5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1357 microversion: 2.1 time: 0.182006 Mar 12 21:35:05.577979 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5198/5966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:05 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:06.592516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0e415b1b-6697-42c6-b754-d925440bfc6d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:06.593144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0e415b1b-6697-42c6-b754-d925440bfc6d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:06.600205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e415b1b-6697-42c6-b754-d925440bfc6d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:06.600724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e415b1b-6697-42c6-b754-d925440bfc6d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:06.601532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e415b1b-6697-42c6-b754-d925440bfc6d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:06.602122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e415b1b-6697-42c6-b754-d925440bfc6d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:06.734877 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0e415b1b-6697-42c6-b754-d925440bfc6d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:06.742403 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0e415b1b-6697-42c6-b754-d925440bfc6d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1357 microversion: 2.1 time: 0.153816 Mar 12 21:35:06.743003 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5199/5967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:06 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:35:07.761424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1bb1b215-0ddd-4125-b4fc-de79ee89ac53 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:07.762254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1bb1b215-0ddd-4125-b4fc-de79ee89ac53 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:07.773306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bb1b215-0ddd-4125-b4fc-de79ee89ac53 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:07.774103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bb1b215-0ddd-4125-b4fc-de79ee89ac53 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:07.775124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bb1b215-0ddd-4125-b4fc-de79ee89ac53 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:07.775934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1bb1b215-0ddd-4125-b4fc-de79ee89ac53 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:07.937372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1bb1b215-0ddd-4125-b4fc-de79ee89ac53 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:07.945734 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1bb1b215-0ddd-4125-b4fc-de79ee89ac53 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1357 microversion: 2.1 time: 0.190132 Mar 12 21:35:07.952268 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5200/5968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:07 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:35:07.952268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ff080695-89ca-44db-9bba-568d0bbbdd43 req-3aff97aa-6bb5-45b4-a601-0d88745ad92d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926d5c23-74d0-4a9d-bbd0-505e81328a30", "tag": "318785a1-aa1c-43a0-bf87-6ed1e32466f2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:35:07.959946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ff080695-89ca-44db-9bba-568d0bbbdd43 req-3aff97aa-6bb5-45b4-a601-0d88745ad92d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:07.960426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ff080695-89ca-44db-9bba-568d0bbbdd43 req-3aff97aa-6bb5-45b4-a601-0d88745ad92d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:07.972960 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ff080695-89ca-44db-9bba-568d0bbbdd43 req-3aff97aa-6bb5-45b4-a601-0d88745ad92d service nova] Creating event network-changed:318785a1-aa1c-43a0-bf87-6ed1e32466f2 for instance 926d5c23-74d0-4a9d-bbd0-505e81328a30 on nch2-master-1 Mar 12 21:35:07.979222 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ff080695-89ca-44db-9bba-568d0bbbdd43 req-3aff97aa-6bb5-45b4-a601-0d88745ad92d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031335 Mar 12 21:35:07.979853 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5201/5969] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:35:08.964095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-778e98fd-16c9-48c5-b2b2-b03823c8b0db tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:08.964809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-778e98fd-16c9-48c5-b2b2-b03823c8b0db tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:08.973058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-778e98fd-16c9-48c5-b2b2-b03823c8b0db tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:08.973530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-778e98fd-16c9-48c5-b2b2-b03823c8b0db tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:08.974356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-778e98fd-16c9-48c5-b2b2-b03823c8b0db tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:08.974812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-778e98fd-16c9-48c5-b2b2-b03823c8b0db tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:09.105867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-778e98fd-16c9-48c5-b2b2-b03823c8b0db tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:09.113281 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-778e98fd-16c9-48c5-b2b2-b03823c8b0db tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1357 microversion: 2.1 time: 0.153507 Mar 12 21:35:09.113955 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5202/5970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:08 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:10.132957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7a3e15a-4f49-403e-a3c3-7ae771579728 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:10.133603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f7a3e15a-4f49-403e-a3c3-7ae771579728 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:10.140355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7a3e15a-4f49-403e-a3c3-7ae771579728 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:10.140821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7a3e15a-4f49-403e-a3c3-7ae771579728 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:10.141605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7a3e15a-4f49-403e-a3c3-7ae771579728 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:10.142678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7a3e15a-4f49-403e-a3c3-7ae771579728 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:10.291868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f7a3e15a-4f49-403e-a3c3-7ae771579728 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:10.301835 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f7a3e15a-4f49-403e-a3c3-7ae771579728 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1357 microversion: 2.1 time: 0.175420 Mar 12 21:35:10.302418 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5203/5971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:10 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:11.319136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f71e00d2-4838-406d-b896-1369f5a9dcc3 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:11.319812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f71e00d2-4838-406d-b896-1369f5a9dcc3 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:11.326593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f71e00d2-4838-406d-b896-1369f5a9dcc3 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:11.327056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f71e00d2-4838-406d-b896-1369f5a9dcc3 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:11.327833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f71e00d2-4838-406d-b896-1369f5a9dcc3 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:11.328285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f71e00d2-4838-406d-b896-1369f5a9dcc3 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:11.460290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f71e00d2-4838-406d-b896-1369f5a9dcc3 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:11.467682 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f71e00d2-4838-406d-b896-1369f5a9dcc3 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1357 microversion: 2.1 time: 0.152557 Mar 12 21:35:11.468254 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5204/5972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:11 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:12.116513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-72b36421-6d93-49ff-b544-25ccca829205 req-fd230805-ed37-46be-b3c2-e9313ce5b435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "926d5c23-74d0-4a9d-bbd0-505e81328a30", "name": "network-vif-plugged", "status": "completed", "tag": "318785a1-aa1c-43a0-bf87-6ed1e32466f2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:35:12.124795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-72b36421-6d93-49ff-b544-25ccca829205 req-fd230805-ed37-46be-b3c2-e9313ce5b435 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:12.125284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-72b36421-6d93-49ff-b544-25ccca829205 req-fd230805-ed37-46be-b3c2-e9313ce5b435 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:12.139306 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-72b36421-6d93-49ff-b544-25ccca829205 req-fd230805-ed37-46be-b3c2-e9313ce5b435 service nova] Creating event network-vif-plugged:318785a1-aa1c-43a0-bf87-6ed1e32466f2 for instance 926d5c23-74d0-4a9d-bbd0-505e81328a30 on nch2-master-1 Mar 12 21:35:12.144708 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-72b36421-6d93-49ff-b544-25ccca829205 req-fd230805-ed37-46be-b3c2-e9313ce5b435 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032192 Mar 12 21:35:12.145618 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5205/5973] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:35:12.486451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cd63462f-047e-47ec-b13d-a00c7651a6ab tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:12.487171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cd63462f-047e-47ec-b13d-a00c7651a6ab tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:12.493480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd63462f-047e-47ec-b13d-a00c7651a6ab tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:12.493988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd63462f-047e-47ec-b13d-a00c7651a6ab tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:12.494776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd63462f-047e-47ec-b13d-a00c7651a6ab tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:12.495234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd63462f-047e-47ec-b13d-a00c7651a6ab tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:12.633118 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd63462f-047e-47ec-b13d-a00c7651a6ab tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:12.640935 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cd63462f-047e-47ec-b13d-a00c7651a6ab tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1357 microversion: 2.1 time: 0.160034 Mar 12 21:35:12.641536 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5206/5974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:12 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:13.162956 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:35:13.163575 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:35:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:35:13.658412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ad2711e-cd51-4fca-aa06-5ceef6568fdd tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:13.659051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ad2711e-cd51-4fca-aa06-5ceef6568fdd tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:13.665989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ad2711e-cd51-4fca-aa06-5ceef6568fdd tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:13.666668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ad2711e-cd51-4fca-aa06-5ceef6568fdd tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:13.667465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ad2711e-cd51-4fca-aa06-5ceef6568fdd tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:13.667927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ad2711e-cd51-4fca-aa06-5ceef6568fdd tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:13.801581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9ad2711e-cd51-4fca-aa06-5ceef6568fdd tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:13.809036 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ad2711e-cd51-4fca-aa06-5ceef6568fdd tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1548 microversion: 2.1 time: 0.155240 Mar 12 21:35:13.809618 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5207/5975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:13 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:13.824349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3305950f-3016-40c8-baac-2d60c1df82a4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:13.824971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3305950f-3016-40c8-baac-2d60c1df82a4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:13.831089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3305950f-3016-40c8-baac-2d60c1df82a4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:13.831559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3305950f-3016-40c8-baac-2d60c1df82a4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:13.832346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3305950f-3016-40c8-baac-2d60c1df82a4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:13.832806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3305950f-3016-40c8-baac-2d60c1df82a4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:13.964867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3305950f-3016-40c8-baac-2d60c1df82a4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:13.974702 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3305950f-3016-40c8-baac-2d60c1df82a4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1548 microversion: 2.1 time: 0.153804 Mar 12 21:35:13.975328 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5208/5976] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:13 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:13.990030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5919137f-db50-4f09-841f-521c21a7077d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:13.993287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5919137f-db50-4f09-841f-521c21a7077d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:13.994099 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5919137f-db50-4f09-841f-521c21a7077d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Searching by: {'deleted': False, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab'} {{(pid=136302) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 12 21:35:13.999677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5919137f-db50-4f09-841f-521c21a7077d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:14.000141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5919137f-db50-4f09-841f-521c21a7077d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:14.000965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5919137f-db50-4f09-841f-521c21a7077d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:14.001426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5919137f-db50-4f09-841f-521c21a7077d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:14.025149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.multi_cell_list [None req-5919137f-db50-4f09-841f-521c21a7077d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136302) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 12 21:35:14.052400 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5919137f-db50-4f09-841f-521c21a7077d tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.065987 Mar 12 21:35:14.053017 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5209/5977] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Mar 12 21:35:13 2022] GET /compute/v2.1/servers => generated 342 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:35:14.062974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ead8d34-3e20-48df-9f43-359c5da11fdc tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:14.063603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ead8d34-3e20-48df-9f43-359c5da11fdc tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:14.070057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ead8d34-3e20-48df-9f43-359c5da11fdc tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:14.070524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ead8d34-3e20-48df-9f43-359c5da11fdc tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:14.071309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ead8d34-3e20-48df-9f43-359c5da11fdc tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:14.071765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ead8d34-3e20-48df-9f43-359c5da11fdc tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:14.207851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ead8d34-3e20-48df-9f43-359c5da11fdc tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:14.215351 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ead8d34-3e20-48df-9f43-359c5da11fdc tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1548 microversion: 2.1 time: 0.156096 Mar 12 21:35:14.215865 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5210/5978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:14 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:35:15.614945 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:35:15.615490 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:35:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:35:15.715028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23bdbc38-f438-49ce-865b-252e60b573ef tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:35:15.716140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-23bdbc38-f438-49ce-865b-252e60b573ef tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:15.723126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23bdbc38-f438-49ce-865b-252e60b573ef tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:15.723594 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23bdbc38-f438-49ce-865b-252e60b573ef tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:15.724375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23bdbc38-f438-49ce-865b-252e60b573ef tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:15.724829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-23bdbc38-f438-49ce-865b-252e60b573ef tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:15.955744 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-23bdbc38-f438-49ce-865b-252e60b573ef tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "POST /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244529 Mar 12 21:35:15.956387 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5211/5979] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Mar 12 21:35:15 2022] POST /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:35:19.272967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1eaaaa7-2ad0-4505-bc5e-ad20dc81d03e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:19.273690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a1eaaaa7-2ad0-4505-bc5e-ad20dc81d03e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:19.279895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1eaaaa7-2ad0-4505-bc5e-ad20dc81d03e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:19.280368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1eaaaa7-2ad0-4505-bc5e-ad20dc81d03e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:19.281152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1eaaaa7-2ad0-4505-bc5e-ad20dc81d03e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:19.281610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1eaaaa7-2ad0-4505-bc5e-ad20dc81d03e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:19.418189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a1eaaaa7-2ad0-4505-bc5e-ad20dc81d03e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:19.426295 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1eaaaa7-2ad0-4505-bc5e-ad20dc81d03e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1594 microversion: 2.1 time: 0.158401 Mar 12 21:35:19.426869 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5212/5980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:19 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:21.087619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-59403f4c-76c1-4e23-a6bb-a7546241cb08 req-387d878e-1aad-437c-a73e-29268956b2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926d5c23-74d0-4a9d-bbd0-505e81328a30", "tag": "318785a1-aa1c-43a0-bf87-6ed1e32466f2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:35:21.102228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-59403f4c-76c1-4e23-a6bb-a7546241cb08 req-387d878e-1aad-437c-a73e-29268956b2b5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:21.102702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-59403f4c-76c1-4e23-a6bb-a7546241cb08 req-387d878e-1aad-437c-a73e-29268956b2b5 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:21.115675 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-59403f4c-76c1-4e23-a6bb-a7546241cb08 req-387d878e-1aad-437c-a73e-29268956b2b5 service nova] Creating event network-changed:318785a1-aa1c-43a0-bf87-6ed1e32466f2 for instance 926d5c23-74d0-4a9d-bbd0-505e81328a30 on nch2-master-1 Mar 12 21:35:21.120905 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-59403f4c-76c1-4e23-a6bb-a7546241cb08 req-387d878e-1aad-437c-a73e-29268956b2b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036848 Mar 12 21:35:21.121792 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5213/5981] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:35:22.123155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea5b584d-a4bb-44fa-835b-968005bc3bf1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1219378180"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:35:22.123890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea5b584d-a4bb-44fa-835b-968005bc3bf1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:22.132128 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea5b584d-a4bb-44fa-835b-968005bc3bf1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:22.132606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea5b584d-a4bb-44fa-835b-968005bc3bf1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:22.133430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea5b584d-a4bb-44fa-835b-968005bc3bf1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:22.133921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea5b584d-a4bb-44fa-835b-968005bc3bf1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:22.270820 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.network.security_group_api [None req-ea5b584d-a4bb-44fa-835b-968005bc3bf1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Adding security group 4af889ac-988f-4df3-afb4-8c3b9ea74af6 to port 318785a1-aa1c-43a0-bf87-6ed1e32466f2 Mar 12 21:35:22.910065 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea5b584d-a4bb-44fa-835b-968005bc3bf1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "POST /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/action" status: 202 len: 0 microversion: 2.1 time: 0.791331 Mar 12 21:35:22.914486 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5214/5982] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:35:22 2022] POST /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:35:22.919159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-471d8c8e-b53a-4f61-b759-7f697a378e04 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:22.919773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-471d8c8e-b53a-4f61-b759-7f697a378e04 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:22.934625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-471d8c8e-b53a-4f61-b759-7f697a378e04 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:22.935131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-471d8c8e-b53a-4f61-b759-7f697a378e04 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:22.935939 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-471d8c8e-b53a-4f61-b759-7f697a378e04 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:22.942345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-471d8c8e-b53a-4f61-b759-7f697a378e04 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:23.104703 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-471d8c8e-b53a-4f61-b759-7f697a378e04 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:23.113787 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-471d8c8e-b53a-4f61-b759-7f697a378e04 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1758 microversion: 2.1 time: 0.198690 Mar 12 21:35:23.114526 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5215/5983] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:22 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:35:23.137016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-885e8a0b-be90-415d-8147-e1bc13749a5a req-c9fe2b73-719f-4fe8-be99-76c7b4fe1df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926d5c23-74d0-4a9d-bbd0-505e81328a30", "tag": "318785a1-aa1c-43a0-bf87-6ed1e32466f2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:35:23.147004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-885e8a0b-be90-415d-8147-e1bc13749a5a req-c9fe2b73-719f-4fe8-be99-76c7b4fe1df4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:23.147578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-885e8a0b-be90-415d-8147-e1bc13749a5a req-c9fe2b73-719f-4fe8-be99-76c7b4fe1df4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:23.158958 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-885e8a0b-be90-415d-8147-e1bc13749a5a req-c9fe2b73-719f-4fe8-be99-76c7b4fe1df4 service nova] Creating event network-changed:318785a1-aa1c-43a0-bf87-6ed1e32466f2 for instance 926d5c23-74d0-4a9d-bbd0-505e81328a30 on nch2-master-1 Mar 12 21:35:23.164223 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-885e8a0b-be90-415d-8147-e1bc13749a5a req-c9fe2b73-719f-4fe8-be99-76c7b4fe1df4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030696 Mar 12 21:35:23.164783 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5216/5984] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:35:48.802713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2dfd8cac-69fc-422e-98a9-1002d83587a5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:35:48.803758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2dfd8cac-69fc-422e-98a9-1002d83587a5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:48.811469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2dfd8cac-69fc-422e-98a9-1002d83587a5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:48.811951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2dfd8cac-69fc-422e-98a9-1002d83587a5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:48.812779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2dfd8cac-69fc-422e-98a9-1002d83587a5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:48.813750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2dfd8cac-69fc-422e-98a9-1002d83587a5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:48.884813 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2dfd8cac-69fc-422e-98a9-1002d83587a5 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "POST /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/action" status: 202 len: 0 microversion: 2.1 time: 0.086135 Mar 12 21:35:48.885504 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5217/5985] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:35:48 2022] POST /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:35:48.895223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-82a527b1-3724-4b46-891c-a3563ef06da4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:48.895949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-82a527b1-3724-4b46-891c-a3563ef06da4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:48.902251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82a527b1-3724-4b46-891c-a3563ef06da4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:48.902785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82a527b1-3724-4b46-891c-a3563ef06da4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:48.903783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82a527b1-3724-4b46-891c-a3563ef06da4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:48.904251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82a527b1-3724-4b46-891c-a3563ef06da4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:49.052261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-82a527b1-3724-4b46-891c-a3563ef06da4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:49.060258 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-82a527b1-3724-4b46-891c-a3563ef06da4 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1750 microversion: 2.1 time: 0.169836 Mar 12 21:35:49.060774 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5218/5986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:48 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:50.079331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-47cca39b-f723-4b09-bec0-743cd4722e5e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:50.079996 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-47cca39b-f723-4b09-bec0-743cd4722e5e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:50.086811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47cca39b-f723-4b09-bec0-743cd4722e5e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:50.087282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47cca39b-f723-4b09-bec0-743cd4722e5e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:50.088068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47cca39b-f723-4b09-bec0-743cd4722e5e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:50.088526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47cca39b-f723-4b09-bec0-743cd4722e5e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:50.232732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-47cca39b-f723-4b09-bec0-743cd4722e5e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:50.240702 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-47cca39b-f723-4b09-bec0-743cd4722e5e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.165955 Mar 12 21:35:50.241284 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5219/5987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:50 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:51.257792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69bb86e9-7a66-474e-a549-9161391383c9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:51.258459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-69bb86e9-7a66-474e-a549-9161391383c9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:51.265133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69bb86e9-7a66-474e-a549-9161391383c9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:51.265600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69bb86e9-7a66-474e-a549-9161391383c9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:51.266505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69bb86e9-7a66-474e-a549-9161391383c9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:51.266962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69bb86e9-7a66-474e-a549-9161391383c9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:51.420637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-69bb86e9-7a66-474e-a549-9161391383c9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:51.429050 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-69bb86e9-7a66-474e-a549-9161391383c9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.175174 Mar 12 21:35:51.429625 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5220/5988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:51 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:52.446720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d329cd26-a406-4693-a6ca-dd5e6b841061 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:52.447393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d329cd26-a406-4693-a6ca-dd5e6b841061 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:52.454094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d329cd26-a406-4693-a6ca-dd5e6b841061 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:52.455197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d329cd26-a406-4693-a6ca-dd5e6b841061 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:52.455978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d329cd26-a406-4693-a6ca-dd5e6b841061 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:52.456429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d329cd26-a406-4693-a6ca-dd5e6b841061 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:52.599209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d329cd26-a406-4693-a6ca-dd5e6b841061 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:52.607066 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d329cd26-a406-4693-a6ca-dd5e6b841061 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.164270 Mar 12 21:35:52.607639 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5221/5989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:52 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:53.623616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-22c3c4ed-5887-45d4-820a-f1ac22cebb2b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:53.624261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-22c3c4ed-5887-45d4-820a-f1ac22cebb2b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:53.631613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22c3c4ed-5887-45d4-820a-f1ac22cebb2b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:53.632077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22c3c4ed-5887-45d4-820a-f1ac22cebb2b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:53.632858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22c3c4ed-5887-45d4-820a-f1ac22cebb2b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:53.633315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-22c3c4ed-5887-45d4-820a-f1ac22cebb2b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:53.780167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-22c3c4ed-5887-45d4-820a-f1ac22cebb2b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:53.788553 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-22c3c4ed-5887-45d4-820a-f1ac22cebb2b tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.168849 Mar 12 21:35:53.789131 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5222/5990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:53 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:54.806187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6340a1b5-bee1-433a-b300-7a0bd5891a88 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:54.806863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6340a1b5-bee1-433a-b300-7a0bd5891a88 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:54.814212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6340a1b5-bee1-433a-b300-7a0bd5891a88 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:54.814720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6340a1b5-bee1-433a-b300-7a0bd5891a88 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:54.815506 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6340a1b5-bee1-433a-b300-7a0bd5891a88 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:54.815970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6340a1b5-bee1-433a-b300-7a0bd5891a88 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:54.958831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6340a1b5-bee1-433a-b300-7a0bd5891a88 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:54.966767 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6340a1b5-bee1-433a-b300-7a0bd5891a88 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.164579 Mar 12 21:35:54.967351 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5223/5991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:54 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:55.986838 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-16bcd700-007e-4cec-8eb6-05d1221b14fe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:55.987503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-16bcd700-007e-4cec-8eb6-05d1221b14fe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:55.994441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16bcd700-007e-4cec-8eb6-05d1221b14fe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:55.994922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16bcd700-007e-4cec-8eb6-05d1221b14fe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:55.995716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16bcd700-007e-4cec-8eb6-05d1221b14fe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:55.996181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-16bcd700-007e-4cec-8eb6-05d1221b14fe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:56.143902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-16bcd700-007e-4cec-8eb6-05d1221b14fe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:56.151803 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-16bcd700-007e-4cec-8eb6-05d1221b14fe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.169440 Mar 12 21:35:56.152388 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5224/5992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:55 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:57.169905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7db00e5b-2a45-4c0c-a74d-4d838d84d02f tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:57.170573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7db00e5b-2a45-4c0c-a74d-4d838d84d02f tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:57.177783 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7db00e5b-2a45-4c0c-a74d-4d838d84d02f tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:57.178255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7db00e5b-2a45-4c0c-a74d-4d838d84d02f tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:57.179045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7db00e5b-2a45-4c0c-a74d-4d838d84d02f tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:57.179507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7db00e5b-2a45-4c0c-a74d-4d838d84d02f tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:57.325936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7db00e5b-2a45-4c0c-a74d-4d838d84d02f tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:57.334487 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7db00e5b-2a45-4c0c-a74d-4d838d84d02f tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.168867 Mar 12 21:35:57.335081 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5225/5993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:57 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:58.352010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f79d73bf-06d1-4c57-bf35-51872f19a56c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:58.352683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f79d73bf-06d1-4c57-bf35-51872f19a56c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:58.358754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f79d73bf-06d1-4c57-bf35-51872f19a56c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:58.359231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f79d73bf-06d1-4c57-bf35-51872f19a56c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:58.360027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f79d73bf-06d1-4c57-bf35-51872f19a56c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:58.360492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f79d73bf-06d1-4c57-bf35-51872f19a56c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:58.510416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f79d73bf-06d1-4c57-bf35-51872f19a56c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:58.518219 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f79d73bf-06d1-4c57-bf35-51872f19a56c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.170465 Mar 12 21:35:58.518805 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5226/5994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:58 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:35:59.535192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-029e471a-6c4c-4f62-b1e7-f4da726086d0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:35:59.535818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-029e471a-6c4c-4f62-b1e7-f4da726086d0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:35:59.542849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-029e471a-6c4c-4f62-b1e7-f4da726086d0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:59.543315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-029e471a-6c4c-4f62-b1e7-f4da726086d0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:59.544089 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-029e471a-6c4c-4f62-b1e7-f4da726086d0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:35:59.544544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-029e471a-6c4c-4f62-b1e7-f4da726086d0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:35:59.691619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-029e471a-6c4c-4f62-b1e7-f4da726086d0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:35:59.699409 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-029e471a-6c4c-4f62-b1e7-f4da726086d0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.168158 Mar 12 21:35:59.699981 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5227/5995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:35:59 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:36:00.716621 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-84cbe25f-966a-4c80-b9be-e6e63ce4b34c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:00.717341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-84cbe25f-966a-4c80-b9be-e6e63ce4b34c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:00.724589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84cbe25f-966a-4c80-b9be-e6e63ce4b34c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:00.725067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84cbe25f-966a-4c80-b9be-e6e63ce4b34c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:00.725889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84cbe25f-966a-4c80-b9be-e6e63ce4b34c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:00.726356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-84cbe25f-966a-4c80-b9be-e6e63ce4b34c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:00.870461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-84cbe25f-966a-4c80-b9be-e6e63ce4b34c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:36:00.878465 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-84cbe25f-966a-4c80-b9be-e6e63ce4b34c tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.165910 Mar 12 21:36:00.879044 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5228/5996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:36:00 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:36:01.896102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-efecd6dc-4da4-427a-a748-7802d33ce5c0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:01.896729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-efecd6dc-4da4-427a-a748-7802d33ce5c0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:01.903479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efecd6dc-4da4-427a-a748-7802d33ce5c0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:01.903942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efecd6dc-4da4-427a-a748-7802d33ce5c0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:01.904717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efecd6dc-4da4-427a-a748-7802d33ce5c0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:01.905166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-efecd6dc-4da4-427a-a748-7802d33ce5c0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:02.053696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-efecd6dc-4da4-427a-a748-7802d33ce5c0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:36:02.061753 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-efecd6dc-4da4-427a-a748-7802d33ce5c0 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.170153 Mar 12 21:36:02.062363 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5229/5997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:36:01 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:36:03.079554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab70de88-c536-42b4-95c7-83e1f2ba51d1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:03.080793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ab70de88-c536-42b4-95c7-83e1f2ba51d1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:03.087749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab70de88-c536-42b4-95c7-83e1f2ba51d1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:03.088222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab70de88-c536-42b4-95c7-83e1f2ba51d1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:03.089010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab70de88-c536-42b4-95c7-83e1f2ba51d1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:03.089467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab70de88-c536-42b4-95c7-83e1f2ba51d1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:03.231992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ab70de88-c536-42b4-95c7-83e1f2ba51d1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:36:03.240377 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ab70de88-c536-42b4-95c7-83e1f2ba51d1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.164887 Mar 12 21:36:03.240962 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5230/5998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:36:03 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:36:04.258146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2e873afb-61cc-4f2f-b8f6-9580b3251fbe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:04.258805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2e873afb-61cc-4f2f-b8f6-9580b3251fbe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:04.265652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e873afb-61cc-4f2f-b8f6-9580b3251fbe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:04.266157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e873afb-61cc-4f2f-b8f6-9580b3251fbe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:04.266948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e873afb-61cc-4f2f-b8f6-9580b3251fbe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:04.267451 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2e873afb-61cc-4f2f-b8f6-9580b3251fbe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:04.410672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2e873afb-61cc-4f2f-b8f6-9580b3251fbe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:36:04.418952 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2e873afb-61cc-4f2f-b8f6-9580b3251fbe tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1755 microversion: 2.1 time: 0.164791 Mar 12 21:36:04.419538 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5231/5999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:36:04 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:36:05.436501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc8e2ac8-0055-402e-9d59-c93e6b814ae9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:05.437179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dc8e2ac8-0055-402e-9d59-c93e6b814ae9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:05.444512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc8e2ac8-0055-402e-9d59-c93e6b814ae9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:05.444995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc8e2ac8-0055-402e-9d59-c93e6b814ae9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:05.445811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc8e2ac8-0055-402e-9d59-c93e6b814ae9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:05.446277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dc8e2ac8-0055-402e-9d59-c93e6b814ae9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:05.591687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dc8e2ac8-0055-402e-9d59-c93e6b814ae9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:36:05.600111 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc8e2ac8-0055-402e-9d59-c93e6b814ae9 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1758 microversion: 2.1 time: 0.167127 Mar 12 21:36:05.600690 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5232/6000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:36:05 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:36:37.909077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9840dcbc-a339-409d-987e-cf2ce629b029 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1219378180"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:36:37.909730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9840dcbc-a339-409d-987e-cf2ce629b029 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:37.917638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9840dcbc-a339-409d-987e-cf2ce629b029 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:37.918130 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9840dcbc-a339-409d-987e-cf2ce629b029 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:37.918925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9840dcbc-a339-409d-987e-cf2ce629b029 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:37.919376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9840dcbc-a339-409d-987e-cf2ce629b029 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:38.051274 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.network.security_group_api [None req-9840dcbc-a339-409d-987e-cf2ce629b029 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Removing security group 4af889ac-988f-4df3-afb4-8c3b9ea74af6 from port 318785a1-aa1c-43a0-bf87-6ed1e32466f2 Mar 12 21:36:38.382817 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9840dcbc-a339-409d-987e-cf2ce629b029 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "POST /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/action" status: 202 len: 0 microversion: 2.1 time: 0.477973 Mar 12 21:36:38.387217 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5233/6001] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:36:37 2022] POST /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:36:38.392225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-9c4f1b3e-2708-47ca-9c99-f575f610cdcc req-1ffd8cb5-082e-48ba-858e-5cb2800d0eda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926d5c23-74d0-4a9d-bbd0-505e81328a30", "tag": "318785a1-aa1c-43a0-bf87-6ed1e32466f2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:36:38.411167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9c4f1b3e-2708-47ca-9c99-f575f610cdcc req-1ffd8cb5-082e-48ba-858e-5cb2800d0eda service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:38.411722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-9c4f1b3e-2708-47ca-9c99-f575f610cdcc req-1ffd8cb5-082e-48ba-858e-5cb2800d0eda service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:38.433549 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-9c4f1b3e-2708-47ca-9c99-f575f610cdcc req-1ffd8cb5-082e-48ba-858e-5cb2800d0eda service nova] Creating event network-changed:318785a1-aa1c-43a0-bf87-6ed1e32466f2 for instance 926d5c23-74d0-4a9d-bbd0-505e81328a30 on nch2-master-1 Mar 12 21:36:38.448607 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-9c4f1b3e-2708-47ca-9c99-f575f610cdcc req-1ffd8cb5-082e-48ba-858e-5cb2800d0eda service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059630 Mar 12 21:36:38.449514 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5234/6002] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:36:39.526696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2dcb494a-9877-4685-bbae-ce3325529f62 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:39.527302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2dcb494a-9877-4685-bbae-ce3325529f62 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:39.534979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2dcb494a-9877-4685-bbae-ce3325529f62 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:39.535443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2dcb494a-9877-4685-bbae-ce3325529f62 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:39.536220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2dcb494a-9877-4685-bbae-ce3325529f62 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:39.536667 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2dcb494a-9877-4685-bbae-ce3325529f62 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:39.619712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-2dcb494a-9877-4685-bbae-ce3325529f62 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lazy-loading 'services' on Instance uuid 926d5c23-74d0-4a9d-bbd0-505e81328a30 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:36:39.688066 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2dcb494a-9877-4685-bbae-ce3325529f62 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "DELETE /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/os-volume_attachments/ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1" status: 202 len: 0 microversion: 2.1 time: 0.165616 Mar 12 21:36:39.689295 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5235/6003] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:36:39 2022] DELETE /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/os-volume_attachments/ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:36:39.707284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-12f7f7de-56cb-4800-b903-ef3e68b88bcb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:39.708377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-12f7f7de-56cb-4800-b903-ef3e68b88bcb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:39.716507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12f7f7de-56cb-4800-b903-ef3e68b88bcb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:39.716980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12f7f7de-56cb-4800-b903-ef3e68b88bcb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:39.717795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12f7f7de-56cb-4800-b903-ef3e68b88bcb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:39.718251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-12f7f7de-56cb-4800-b903-ef3e68b88bcb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:39.748185 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-12f7f7de-56cb-4800-b903-ef3e68b88bcb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047009 Mar 12 21:36:39.748757 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5236/6004] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:36:39 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:36:40.465673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b81ce408-23e0-4190-8e10-e6f3735c5dad req-2dd04c3b-32b7-4340-af27-baec540e257a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "926d5c23-74d0-4a9d-bbd0-505e81328a30", "tag": "318785a1-aa1c-43a0-bf87-6ed1e32466f2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:36:40.474289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b81ce408-23e0-4190-8e10-e6f3735c5dad req-2dd04c3b-32b7-4340-af27-baec540e257a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:40.474716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b81ce408-23e0-4190-8e10-e6f3735c5dad req-2dd04c3b-32b7-4340-af27-baec540e257a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:40.486581 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b81ce408-23e0-4190-8e10-e6f3735c5dad req-2dd04c3b-32b7-4340-af27-baec540e257a service nova] Creating event network-changed:318785a1-aa1c-43a0-bf87-6ed1e32466f2 for instance 926d5c23-74d0-4a9d-bbd0-505e81328a30 on nch2-master-1 Mar 12 21:36:40.491619 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b81ce408-23e0-4190-8e10-e6f3735c5dad req-2dd04c3b-32b7-4340-af27-baec540e257a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029649 Mar 12 21:36:40.492228 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5237/6005] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:36:40.762017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3bdf3298-dd52-4bf2-8e31-9fd137f74786 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:40.763051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3bdf3298-dd52-4bf2-8e31-9fd137f74786 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:40.769353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3bdf3298-dd52-4bf2-8e31-9fd137f74786 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:40.769858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3bdf3298-dd52-4bf2-8e31-9fd137f74786 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:40.770655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3bdf3298-dd52-4bf2-8e31-9fd137f74786 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:40.771108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3bdf3298-dd52-4bf2-8e31-9fd137f74786 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:40.800603 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3bdf3298-dd52-4bf2-8e31-9fd137f74786 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043799 Mar 12 21:36:40.801184 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5238/6006] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Mar 12 21:36:40 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 12 21:36:40.810740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e9e0f8a2-d90c-408b-be50-e41973437c00 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:40.811139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e9e0f8a2-d90c-408b-be50-e41973437c00 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:40.817398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9e0f8a2-d90c-408b-be50-e41973437c00 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:40.817893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9e0f8a2-d90c-408b-be50-e41973437c00 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:40.818698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9e0f8a2-d90c-408b-be50-e41973437c00 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:40.819160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e9e0f8a2-d90c-408b-be50-e41973437c00 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:40.893347 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-e9e0f8a2-d90c-408b-be50-e41973437c00 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] HTTP exception thrown: Instance 926d5c23-74d0-4a9d-bbd0-505e81328a30 is not attached to volume ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1 Mar 12 21:36:40.894003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e9e0f8a2-d90c-408b-be50-e41973437c00 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Returning 404 to user: Instance 926d5c23-74d0-4a9d-bbd0-505e81328a30 is not attached to volume ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1 {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:36:40.894871 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e9e0f8a2-d90c-408b-be50-e41973437c00 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "DELETE /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/os-volume_attachments/ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1" status: 404 len: 154 microversion: 2.1 time: 0.088035 Mar 12 21:36:40.895450 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5239/6007] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Mar 12 21:36:40 2022] DELETE /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30/os-volume_attachments/ec6c3fe2-8c71-43b5-b5e6-a13ef83c84f1 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:36:42.036178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6ef01325-70da-4575-8a15-cfa8b3c95f8e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:42.036769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ef01325-70da-4575-8a15-cfa8b3c95f8e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:42.044550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ef01325-70da-4575-8a15-cfa8b3c95f8e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:42.045017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ef01325-70da-4575-8a15-cfa8b3c95f8e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:42.045818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ef01325-70da-4575-8a15-cfa8b3c95f8e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:42.046274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6ef01325-70da-4575-8a15-cfa8b3c95f8e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:42.069371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6ef01325-70da-4575-8a15-cfa8b3c95f8e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:36:42.145583 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6ef01325-70da-4575-8a15-cfa8b3c95f8e tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "DELETE /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 204 len: 0 microversion: 2.1 time: 0.112674 Mar 12 21:36:42.146171 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5240/6008] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:36:42 2022] DELETE /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:36:42.155829 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8fa5b202-c1bd-465e-b656-5c455354e940 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:42.156542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8fa5b202-c1bd-465e-b656-5c455354e940 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:42.162773 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fa5b202-c1bd-465e-b656-5c455354e940 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:42.163238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fa5b202-c1bd-465e-b656-5c455354e940 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:42.164015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fa5b202-c1bd-465e-b656-5c455354e940 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:42.164467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8fa5b202-c1bd-465e-b656-5c455354e940 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:42.298435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8fa5b202-c1bd-465e-b656-5c455354e940 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:36:42.305832 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8fa5b202-c1bd-465e-b656-5c455354e940 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1554 microversion: 2.1 time: 0.154611 Mar 12 21:36:42.306409 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5241/6009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:36:42 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:36:43.323866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e8c4104f-c57d-4265-9993-cfdac7cfe7bb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:43.324518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e8c4104f-c57d-4265-9993-cfdac7cfe7bb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:43.331167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8c4104f-c57d-4265-9993-cfdac7cfe7bb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:43.331627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8c4104f-c57d-4265-9993-cfdac7cfe7bb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:43.332400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8c4104f-c57d-4265-9993-cfdac7cfe7bb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:43.332848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8c4104f-c57d-4265-9993-cfdac7cfe7bb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:43.467341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8c4104f-c57d-4265-9993-cfdac7cfe7bb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:36:43.475454 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e8c4104f-c57d-4265-9993-cfdac7cfe7bb tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1554 microversion: 2.1 time: 0.155620 Mar 12 21:36:43.476032 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5242/6010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:36:43 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:36:44.492716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ba77b6a4-4969-486f-901d-a51dd3da15b1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:44.494047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ba77b6a4-4969-486f-901d-a51dd3da15b1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:44.501743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba77b6a4-4969-486f-901d-a51dd3da15b1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:44.502283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba77b6a4-4969-486f-901d-a51dd3da15b1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:44.503260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba77b6a4-4969-486f-901d-a51dd3da15b1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:44.503545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba77b6a4-4969-486f-901d-a51dd3da15b1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:44.571971 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ba77b6a4-4969-486f-901d-a51dd3da15b1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4111688f50434e13b938b6c99c71912b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf5558ecf7a94032ba36db2e467d97ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:36:44.580292 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ba77b6a4-4969-486f-901d-a51dd3da15b1 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 200 len: 1512 microversion: 2.1 time: 0.091498 Mar 12 21:36:44.580892 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5243/6011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:36:44 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 1512 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:36:44.585501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7d84cefa-c067-48e7-8694-5ddde1ffdda6 req-e5c071ec-4b74-48df-af4f-9f9c3c648597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "926d5c23-74d0-4a9d-bbd0-505e81328a30", "name": "network-vif-deleted", "tag": "318785a1-aa1c-43a0-bf87-6ed1e32466f2"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:36:44.593992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7d84cefa-c067-48e7-8694-5ddde1ffdda6 req-e5c071ec-4b74-48df-af4f-9f9c3c648597 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:44.594442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7d84cefa-c067-48e7-8694-5ddde1ffdda6 req-e5c071ec-4b74-48df-af4f-9f9c3c648597 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:44.606139 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7d84cefa-c067-48e7-8694-5ddde1ffdda6 req-e5c071ec-4b74-48df-af4f-9f9c3c648597 service nova] Creating event network-vif-deleted:318785a1-aa1c-43a0-bf87-6ed1e32466f2 for instance 926d5c23-74d0-4a9d-bbd0-505e81328a30 on nch2-master-1 Mar 12 21:36:44.611434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7d84cefa-c067-48e7-8694-5ddde1ffdda6 req-e5c071ec-4b74-48df-af4f-9f9c3c648597 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029434 Mar 12 21:36:44.612062 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5244/6012] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:36:45.598043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-50d59aa3-af29-4b60-b937-9565dd54cea7 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:45.598770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-50d59aa3-af29-4b60-b937-9565dd54cea7 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] [instance: 926d5c23-74d0-4a9d-bbd0-505e81328a30] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:36:45.605094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50d59aa3-af29-4b60-b937-9565dd54cea7 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:45.605569 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50d59aa3-af29-4b60-b937-9565dd54cea7 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:45.606394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50d59aa3-af29-4b60-b937-9565dd54cea7 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:36:45.606858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50d59aa3-af29-4b60-b937-9565dd54cea7 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:36:45.620126 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-50d59aa3-af29-4b60-b937-9565dd54cea7 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] HTTP exception thrown: Instance 926d5c23-74d0-4a9d-bbd0-505e81328a30 could not be found. Mar 12 21:36:45.620738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-50d59aa3-af29-4b60-b937-9565dd54cea7 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Returning 404 to user: Instance 926d5c23-74d0-4a9d-bbd0-505e81328a30 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:36:45.621587 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-50d59aa3-af29-4b60-b937-9565dd54cea7 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30" status: 404 len: 111 microversion: 2.1 time: 0.028826 Mar 12 21:36:45.622168 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5245/6013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:36:45 2022] GET /compute/v2.1/servers/926d5c23-74d0-4a9d-bbd0-505e81328a30 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:36:45.630658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-23947033-d537-4e25-9c2d-fd654d61c8b2 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] Calling method '.version_select at 0x7f6e36d46ca0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:36:45.658489 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-23947033-d537-4e25-9c2d-fd654d61c8b2 tempest-TestMinimumBasicScenario-1749035881 tempest-TestMinimumBasicScenario-1749035881-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-232026373" status: 202 len: 0 microversion: 2.1 time: 0.031950 Mar 12 21:36:45.659084 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5246/6014] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Mar 12 21:36:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-232026373 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:36:47.475175 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:36:47.476476 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:36:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:36:54.782970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-965c76e1-2f8c-4172-941f-8233a67aa9a2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'create', calling method: .version_select at 0x7f6e3731aee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-464765115"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:36:54.801039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-965c76e1-2f8c-4172-941f-8233a67aa9a2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:36:54.806538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-965c76e1-2f8c-4172-941f-8233a67aa9a2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:36:54.932603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-965c76e1-2f8c-4172-941f-8233a67aa9a2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:36:54.937863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-965c76e1-2f8c-4172-941f-8233a67aa9a2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:36:54.955282 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-965c76e1-2f8c-4172-941f-8233a67aa9a2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.336164 Mar 12 21:36:54.955900 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5247/6015] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:36:54 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:37:00.272942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-603070423", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "0dc03860-3537-4673-ba0c-c04b1619ff06"}], "key_name": "tempest-TestNetworkAdvancedServerOps-464765115", "security_groups": [{"name": "tempest-secgroup-smoke-1507080714"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:37:00.380692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] validate_networks() for [('0dc03860-3537-4673-ba0c-c04b1619ff06', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:37:00.775117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:37:00.776152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:37:00.777246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:37:00.777922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:37:00.778735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:37:00.789622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:00.790256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:00.794338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:00.794991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:00.816786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:37:00.823921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:37:00.838955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:37:00.841379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:37:00.893697 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b148e0fa-8b2d-4e32-b0d3-a275fa328837 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.625989 Mar 12 21:37:00.894786 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5248/6016] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:37:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:37:00.904742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4908c40b-1a4a-45b2-ac84-2282f7e57453 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:00.905376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4908c40b-1a4a-45b2-ac84-2282f7e57453 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:00.963792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4908c40b-1a4a-45b2-ac84-2282f7e57453 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:00.976527 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4908c40b-1a4a-45b2-ac84-2282f7e57453 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1265 microversion: 2.1 time: 0.075767 Mar 12 21:37:00.977391 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5249/6017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:00 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1265 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:37:01.993820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56dc0616-c380-4a60-adb4-0b422b59db9a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:01.996542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-56dc0616-c380-4a60-adb4-0b422b59db9a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:02.004568 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56dc0616-c380-4a60-adb4-0b422b59db9a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:02.005412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56dc0616-c380-4a60-adb4-0b422b59db9a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:02.007369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56dc0616-c380-4a60-adb4-0b422b59db9a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:02.007912 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56dc0616-c380-4a60-adb4-0b422b59db9a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:02.086331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-56dc0616-c380-4a60-adb4-0b422b59db9a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:02.095300 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56dc0616-c380-4a60-adb4-0b422b59db9a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1317 microversion: 2.1 time: 0.105394 Mar 12 21:37:02.096281 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5250/6018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:01 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1317 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:37:03.114949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0649836d-aa47-4ac2-b626-0650e0aaeba1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:03.116951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0649836d-aa47-4ac2-b626-0650e0aaeba1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:03.124904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0649836d-aa47-4ac2-b626-0650e0aaeba1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:03.125374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0649836d-aa47-4ac2-b626-0650e0aaeba1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:03.126209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0649836d-aa47-4ac2-b626-0650e0aaeba1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:03.126663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0649836d-aa47-4ac2-b626-0650e0aaeba1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:03.291757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0649836d-aa47-4ac2-b626-0650e0aaeba1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:03.301852 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0649836d-aa47-4ac2-b626-0650e0aaeba1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1391 microversion: 2.1 time: 0.193047 Mar 12 21:37:03.302454 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5251/6019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:03 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:37:03.735473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0f788ca9-ebe9-4ea2-9c8a-8d7389df213b req-44fa476b-7c30-43e3-9811-80317c35fc99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc62d00-4a37-46ef-89fe-aac8294156f3", "tag": "8b0a099e-126f-4557-a7ac-d669dce7b103"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:37:03.770379 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0f788ca9-ebe9-4ea2-9c8a-8d7389df213b req-44fa476b-7c30-43e3-9811-80317c35fc99 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:03.770888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0f788ca9-ebe9-4ea2-9c8a-8d7389df213b req-44fa476b-7c30-43e3-9811-80317c35fc99 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:03.787558 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0f788ca9-ebe9-4ea2-9c8a-8d7389df213b req-44fa476b-7c30-43e3-9811-80317c35fc99 service nova] Creating event network-changed:8b0a099e-126f-4557-a7ac-d669dce7b103 for instance fcc62d00-4a37-46ef-89fe-aac8294156f3 on nch1-master-1 Mar 12 21:37:03.793534 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0f788ca9-ebe9-4ea2-9c8a-8d7389df213b req-44fa476b-7c30-43e3-9811-80317c35fc99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061708 Mar 12 21:37:03.794181 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5252/6020] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:37:04.320398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f2112950-d94a-4a24-bdac-3865f6bfc1e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:04.321112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f2112950-d94a-4a24-bdac-3865f6bfc1e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:04.327645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2112950-d94a-4a24-bdac-3865f6bfc1e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:04.328179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2112950-d94a-4a24-bdac-3865f6bfc1e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:04.328981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2112950-d94a-4a24-bdac-3865f6bfc1e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:04.329443 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f2112950-d94a-4a24-bdac-3865f6bfc1e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:04.464613 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f2112950-d94a-4a24-bdac-3865f6bfc1e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:04.472698 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f2112950-d94a-4a24-bdac-3865f6bfc1e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1391 microversion: 2.1 time: 0.157820 Mar 12 21:37:04.473268 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5253/6021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:04 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:37:05.489345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-174e9bbf-9ccf-4909-9cb8-45e9db7df050 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:05.490032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-174e9bbf-9ccf-4909-9cb8-45e9db7df050 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:05.496752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-174e9bbf-9ccf-4909-9cb8-45e9db7df050 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:05.497219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-174e9bbf-9ccf-4909-9cb8-45e9db7df050 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:05.498020 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-174e9bbf-9ccf-4909-9cb8-45e9db7df050 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:05.498474 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-174e9bbf-9ccf-4909-9cb8-45e9db7df050 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:05.632489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-174e9bbf-9ccf-4909-9cb8-45e9db7df050 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:05.640734 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-174e9bbf-9ccf-4909-9cb8-45e9db7df050 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1391 microversion: 2.1 time: 0.155797 Mar 12 21:37:05.641375 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5254/6022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:05 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:37:06.657904 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5cfdf76f-c6ee-4158-8ed7-a5302012e74e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:06.658523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5cfdf76f-c6ee-4158-8ed7-a5302012e74e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:06.665263 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5cfdf76f-c6ee-4158-8ed7-a5302012e74e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:06.666013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5cfdf76f-c6ee-4158-8ed7-a5302012e74e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:06.666818 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5cfdf76f-c6ee-4158-8ed7-a5302012e74e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:06.667283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5cfdf76f-c6ee-4158-8ed7-a5302012e74e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:06.799575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5cfdf76f-c6ee-4158-8ed7-a5302012e74e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:06.806908 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5cfdf76f-c6ee-4158-8ed7-a5302012e74e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1391 microversion: 2.1 time: 0.153128 Mar 12 21:37:06.807503 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5255/6023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:06 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:37:07.824520 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-349ac197-8555-4655-bc79-96d52ae7d233 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:07.825151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-349ac197-8555-4655-bc79-96d52ae7d233 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:07.832607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-349ac197-8555-4655-bc79-96d52ae7d233 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:07.833078 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-349ac197-8555-4655-bc79-96d52ae7d233 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:07.833915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-349ac197-8555-4655-bc79-96d52ae7d233 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:07.834375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-349ac197-8555-4655-bc79-96d52ae7d233 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:07.967558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-349ac197-8555-4655-bc79-96d52ae7d233 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:07.975457 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-349ac197-8555-4655-bc79-96d52ae7d233 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1391 microversion: 2.1 time: 0.154927 Mar 12 21:37:07.976031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5256/6024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:07 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:37:08.992610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5f1cf0b-b7a2-4ac3-8ac2-254a38d665f5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:08.993377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f5f1cf0b-b7a2-4ac3-8ac2-254a38d665f5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:08.999991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5f1cf0b-b7a2-4ac3-8ac2-254a38d665f5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:09.000467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5f1cf0b-b7a2-4ac3-8ac2-254a38d665f5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:09.001266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5f1cf0b-b7a2-4ac3-8ac2-254a38d665f5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:09.002273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5f1cf0b-b7a2-4ac3-8ac2-254a38d665f5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:09.138480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f5f1cf0b-b7a2-4ac3-8ac2-254a38d665f5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:09.145893 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5f1cf0b-b7a2-4ac3-8ac2-254a38d665f5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1391 microversion: 2.1 time: 0.157189 Mar 12 21:37:09.146489 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5257/6025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:08 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:37:10.164821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a3a53dce-be4c-4177-83fb-5b25cad579af tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:10.166680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a3a53dce-be4c-4177-83fb-5b25cad579af tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:10.173572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3a53dce-be4c-4177-83fb-5b25cad579af tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:10.174088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3a53dce-be4c-4177-83fb-5b25cad579af tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:10.174890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3a53dce-be4c-4177-83fb-5b25cad579af tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:10.175990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3a53dce-be4c-4177-83fb-5b25cad579af tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:10.308744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a3a53dce-be4c-4177-83fb-5b25cad579af tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:10.316531 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a3a53dce-be4c-4177-83fb-5b25cad579af tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1391 microversion: 2.1 time: 0.157608 Mar 12 21:37:10.317110 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5258/6026] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:10 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:37:10.498529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d2ee1184-c8df-43aa-813e-6287fea97c01 req-15b66527-fda6-4c68-9afa-5fb538c9b366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc62d00-4a37-46ef-89fe-aac8294156f3", "name": "network-vif-plugged", "status": "completed", "tag": "8b0a099e-126f-4557-a7ac-d669dce7b103"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:37:10.507093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d2ee1184-c8df-43aa-813e-6287fea97c01 req-15b66527-fda6-4c68-9afa-5fb538c9b366 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:10.507562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d2ee1184-c8df-43aa-813e-6287fea97c01 req-15b66527-fda6-4c68-9afa-5fb538c9b366 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:10.519316 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d2ee1184-c8df-43aa-813e-6287fea97c01 req-15b66527-fda6-4c68-9afa-5fb538c9b366 service nova] Creating event network-vif-plugged:8b0a099e-126f-4557-a7ac-d669dce7b103 for instance fcc62d00-4a37-46ef-89fe-aac8294156f3 on nch1-master-1 Mar 12 21:37:10.524374 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d2ee1184-c8df-43aa-813e-6287fea97c01 req-15b66527-fda6-4c68-9afa-5fb538c9b366 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029582 Mar 12 21:37:10.524981 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5259/6027] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:37:11.333758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49a9fa14-f1d5-460c-b31b-a1a40f558ca0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:11.334750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-49a9fa14-f1d5-460c-b31b-a1a40f558ca0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:11.342696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49a9fa14-f1d5-460c-b31b-a1a40f558ca0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:11.343160 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49a9fa14-f1d5-460c-b31b-a1a40f558ca0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:11.343940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49a9fa14-f1d5-460c-b31b-a1a40f558ca0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:11.344390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49a9fa14-f1d5-460c-b31b-a1a40f558ca0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:11.480169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-49a9fa14-f1d5-460c-b31b-a1a40f558ca0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:11.488442 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-49a9fa14-f1d5-460c-b31b-a1a40f558ca0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1391 microversion: 2.1 time: 0.159704 Mar 12 21:37:11.489028 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5260/6028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:11 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:37:12.505732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9e90f66e-780d-47e9-ba8d-20572609c880 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:12.506426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9e90f66e-780d-47e9-ba8d-20572609c880 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:12.513309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e90f66e-780d-47e9-ba8d-20572609c880 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:12.513729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e90f66e-780d-47e9-ba8d-20572609c880 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:12.514583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e90f66e-780d-47e9-ba8d-20572609c880 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:12.515046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e90f66e-780d-47e9-ba8d-20572609c880 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:12.647859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9e90f66e-780d-47e9-ba8d-20572609c880 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:12.655409 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9e90f66e-780d-47e9-ba8d-20572609c880 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1564 microversion: 2.1 time: 0.154170 Mar 12 21:37:12.655994 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5261/6029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:12 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:37:12.671430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99cd9614-10db-4583-a479-b2cfb69a7b64 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:12.672065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-99cd9614-10db-4583-a479-b2cfb69a7b64 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:12.678015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99cd9614-10db-4583-a479-b2cfb69a7b64 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:12.678508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99cd9614-10db-4583-a479-b2cfb69a7b64 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:12.679300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99cd9614-10db-4583-a479-b2cfb69a7b64 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:12.679763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99cd9614-10db-4583-a479-b2cfb69a7b64 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:12.812858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-99cd9614-10db-4583-a479-b2cfb69a7b64 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:12.820846 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99cd9614-10db-4583-a479-b2cfb69a7b64 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1564 microversion: 2.1 time: 0.153153 Mar 12 21:37:12.821427 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5262/6030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:12 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:37:14.763666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c517408-ffe6-4075-af92-6f73f673200f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:37:14.764296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c517408-ffe6-4075-af92-6f73f673200f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:14.771673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c517408-ffe6-4075-af92-6f73f673200f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:14.772149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c517408-ffe6-4075-af92-6f73f673200f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:14.772940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c517408-ffe6-4075-af92-6f73f673200f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:14.773393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c517408-ffe6-4075-af92-6f73f673200f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:14.918292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c517408-ffe6-4075-af92-6f73f673200f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:37:14.925959 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c517408-ffe6-4075-af92-6f73f673200f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1564 microversion: 2.1 time: 0.166130 Mar 12 21:37:14.926553 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5263/6031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:37:14 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:37:15.009338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f00261aa-484a-4d91-ac35-d423e45c8d13 req-f93a312b-846c-46c9-9255-17f9664409a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc62d00-4a37-46ef-89fe-aac8294156f3", "tag": "8b0a099e-126f-4557-a7ac-d669dce7b103"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:37:15.018201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f00261aa-484a-4d91-ac35-d423e45c8d13 req-f93a312b-846c-46c9-9255-17f9664409a6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:15.018676 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f00261aa-484a-4d91-ac35-d423e45c8d13 req-f93a312b-846c-46c9-9255-17f9664409a6 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:15.031796 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f00261aa-484a-4d91-ac35-d423e45c8d13 req-f93a312b-846c-46c9-9255-17f9664409a6 service nova] Creating event network-changed:8b0a099e-126f-4557-a7ac-d669dce7b103 for instance fcc62d00-4a37-46ef-89fe-aac8294156f3 on nch1-master-1 Mar 12 21:37:15.036737 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f00261aa-484a-4d91-ac35-d423e45c8d13 req-f93a312b-846c-46c9-9255-17f9664409a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109058 Mar 12 21:37:15.037345 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5264/6032] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:37:46.213187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9a0cf4e9-58f3-44be-bbc7-48d53d2ff6cd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:37:46.214152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9a0cf4e9-58f3-44be-bbc7-48d53d2ff6cd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:37:46.220865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a0cf4e9-58f3-44be-bbc7-48d53d2ff6cd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:46.221342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a0cf4e9-58f3-44be-bbc7-48d53d2ff6cd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:46.222185 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a0cf4e9-58f3-44be-bbc7-48d53d2ff6cd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:37:46.222650 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9a0cf4e9-58f3-44be-bbc7-48d53d2ff6cd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:37:46.271650 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9a0cf4e9-58f3-44be-bbc7-48d53d2ff6cd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3/action" status: 200 len: 24577 microversion: 2.1 time: 0.063982 Mar 12 21:37:46.272328 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5265/6033] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:37:46 2022] POST /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3/action => generated 24577 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:38:16.501177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f7ecbca7-aab3-49db-8b83-95fabab986aa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:38:16.502446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f7ecbca7-aab3-49db-8b83-95fabab986aa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:16.509609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7ecbca7-aab3-49db-8b83-95fabab986aa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:16.510112 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7ecbca7-aab3-49db-8b83-95fabab986aa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:16.510928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7ecbca7-aab3-49db-8b83-95fabab986aa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:16.511388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f7ecbca7-aab3-49db-8b83-95fabab986aa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:16.575879 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f7ecbca7-aab3-49db-8b83-95fabab986aa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3/action" status: 202 len: 0 microversion: 2.1 time: 0.078881 Mar 12 21:38:16.576517 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5266/6034] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:38:16 2022] POST /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:38:16.585898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-24aba27c-ad54-4227-9bfd-ba1df35c0ea0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:16.586624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-24aba27c-ad54-4227-9bfd-ba1df35c0ea0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:16.592918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24aba27c-ad54-4227-9bfd-ba1df35c0ea0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:16.593392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24aba27c-ad54-4227-9bfd-ba1df35c0ea0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:16.594251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24aba27c-ad54-4227-9bfd-ba1df35c0ea0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:16.594707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-24aba27c-ad54-4227-9bfd-ba1df35c0ea0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:16.741529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-24aba27c-ad54-4227-9bfd-ba1df35c0ea0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:16.748842 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-24aba27c-ad54-4227-9bfd-ba1df35c0ea0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1688 microversion: 2.1 time: 0.167365 Mar 12 21:38:16.749422 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5267/6035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:16 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:17.765960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d31791a4-c682-4d24-bcb6-c41df11b8348 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:17.766589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d31791a4-c682-4d24-bcb6-c41df11b8348 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:17.773331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d31791a4-c682-4d24-bcb6-c41df11b8348 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:17.773832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d31791a4-c682-4d24-bcb6-c41df11b8348 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:17.774629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d31791a4-c682-4d24-bcb6-c41df11b8348 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:17.775091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d31791a4-c682-4d24-bcb6-c41df11b8348 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:17.907459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d31791a4-c682-4d24-bcb6-c41df11b8348 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:17.915561 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d31791a4-c682-4d24-bcb6-c41df11b8348 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1668 microversion: 2.1 time: 0.153448 Mar 12 21:38:17.916144 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5268/6036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:17 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:19.022576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ddfd3fb-f82b-4085-a8b0-675bad2b9de9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:38:19.023515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ddfd3fb-f82b-4085-a8b0-675bad2b9de9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:19.030283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ddfd3fb-f82b-4085-a8b0-675bad2b9de9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:19.030754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ddfd3fb-f82b-4085-a8b0-675bad2b9de9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:19.031542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ddfd3fb-f82b-4085-a8b0-675bad2b9de9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:19.032003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ddfd3fb-f82b-4085-a8b0-675bad2b9de9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:19.078312 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ddfd3fb-f82b-4085-a8b0-675bad2b9de9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3/action" status: 200 len: 32642 microversion: 2.1 time: 0.059511 Mar 12 21:38:19.078962 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5269/6037] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:38:19 2022] POST /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3/action => generated 32642 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:38:19.090266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-91503420-325d-4a84-9b03-ea2f244dad72 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:38:19.090836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-91503420-325d-4a84-9b03-ea2f244dad72 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:19.098256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91503420-325d-4a84-9b03-ea2f244dad72 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:19.098726 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91503420-325d-4a84-9b03-ea2f244dad72 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:19.099511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91503420-325d-4a84-9b03-ea2f244dad72 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:19.099969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-91503420-325d-4a84-9b03-ea2f244dad72 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:19.165686 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-91503420-325d-4a84-9b03-ea2f244dad72 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3/action" status: 202 len: 0 microversion: 2.1 time: 0.078904 Mar 12 21:38:19.166397 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5270/6038] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:38:19 2022] POST /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:38:19.176521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-94a06e26-55cd-48ca-8d40-b9a5f46a882a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:19.177264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-94a06e26-55cd-48ca-8d40-b9a5f46a882a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:19.183509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94a06e26-55cd-48ca-8d40-b9a5f46a882a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:19.183981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94a06e26-55cd-48ca-8d40-b9a5f46a882a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:19.184763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94a06e26-55cd-48ca-8d40-b9a5f46a882a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:19.185485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-94a06e26-55cd-48ca-8d40-b9a5f46a882a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:19.323169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-94a06e26-55cd-48ca-8d40-b9a5f46a882a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:19.331556 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-94a06e26-55cd-48ca-8d40-b9a5f46a882a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1675 microversion: 2.1 time: 0.159874 Mar 12 21:38:19.332158 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5271/6039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:19 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:38:20.350414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51d8675a-a0f1-4122-a20e-f0e212997d97 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:20.351095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51d8675a-a0f1-4122-a20e-f0e212997d97 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:20.357922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51d8675a-a0f1-4122-a20e-f0e212997d97 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:20.358402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51d8675a-a0f1-4122-a20e-f0e212997d97 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:20.359189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51d8675a-a0f1-4122-a20e-f0e212997d97 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:20.359652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51d8675a-a0f1-4122-a20e-f0e212997d97 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:20.502399 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51d8675a-a0f1-4122-a20e-f0e212997d97 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:20.509949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51d8675a-a0f1-4122-a20e-f0e212997d97 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1683 microversion: 2.1 time: 0.163452 Mar 12 21:38:20.510548 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5272/6040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:20 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:20.602993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d8303dd-2d49-44d3-8193-b3908e192ab8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:38:20.603968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5d8303dd-2d49-44d3-8193-b3908e192ab8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:20.610641 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d8303dd-2d49-44d3-8193-b3908e192ab8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:20.611699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d8303dd-2d49-44d3-8193-b3908e192ab8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:20.612523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d8303dd-2d49-44d3-8193-b3908e192ab8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:20.612973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5d8303dd-2d49-44d3-8193-b3908e192ab8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:20.661935 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5d8303dd-2d49-44d3-8193-b3908e192ab8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3/action" status: 200 len: 38396 microversion: 2.1 time: 0.062926 Mar 12 21:38:20.662594 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5273/6041] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:38:20 2022] POST /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3/action => generated 38396 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:38:21.659446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-35f5c68f-e9df-450b-a4e4-422aa940d439 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:21.660049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-35f5c68f-e9df-450b-a4e4-422aa940d439 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:21.667767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35f5c68f-e9df-450b-a4e4-422aa940d439 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:21.668238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35f5c68f-e9df-450b-a4e4-422aa940d439 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:21.669029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35f5c68f-e9df-450b-a4e4-422aa940d439 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:21.669485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-35f5c68f-e9df-450b-a4e4-422aa940d439 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:21.694920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-35f5c68f-e9df-450b-a4e4-422aa940d439 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:38:21.777882 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-35f5c68f-e9df-450b-a4e4-422aa940d439 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 204 len: 0 microversion: 2.1 time: 0.122154 Mar 12 21:38:21.778574 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5274/6042] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:38:21 2022] DELETE /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:38:21.787719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-55653e35-40f1-4ccd-bc4a-de3a4229ff3d req-c753a314-cc55-40ce-83ca-b0bb17ec3a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc62d00-4a37-46ef-89fe-aac8294156f3", "tag": "8b0a099e-126f-4557-a7ac-d669dce7b103"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:38:21.796278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-55653e35-40f1-4ccd-bc4a-de3a4229ff3d req-c753a314-cc55-40ce-83ca-b0bb17ec3a4d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:21.796745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-55653e35-40f1-4ccd-bc4a-de3a4229ff3d req-c753a314-cc55-40ce-83ca-b0bb17ec3a4d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:21.810132 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-55653e35-40f1-4ccd-bc4a-de3a4229ff3d req-c753a314-cc55-40ce-83ca-b0bb17ec3a4d service nova] Creating event network-changed:8b0a099e-126f-4557-a7ac-d669dce7b103 for instance fcc62d00-4a37-46ef-89fe-aac8294156f3 on nch1-master-1 Mar 12 21:38:21.815932 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-55653e35-40f1-4ccd-bc4a-de3a4229ff3d req-c753a314-cc55-40ce-83ca-b0bb17ec3a4d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032713 Mar 12 21:38:21.816740 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5275/6043] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:38:21.821903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3c560d00-7e8d-4ae4-a84c-cb14b13d064b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:21.822821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3c560d00-7e8d-4ae4-a84c-cb14b13d064b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:21.833307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c560d00-7e8d-4ae4-a84c-cb14b13d064b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:21.833797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c560d00-7e8d-4ae4-a84c-cb14b13d064b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:21.834843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c560d00-7e8d-4ae4-a84c-cb14b13d064b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:21.835124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3c560d00-7e8d-4ae4-a84c-cb14b13d064b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:21.986642 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3c560d00-7e8d-4ae4-a84c-cb14b13d064b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:21.995110 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3c560d00-7e8d-4ae4-a84c-cb14b13d064b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1689 microversion: 2.1 time: 0.177294 Mar 12 21:38:21.995698 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5276/6044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:21 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:38:23.012587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-50323d28-79f6-4e84-b154-94fd9092751a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:23.013254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-50323d28-79f6-4e84-b154-94fd9092751a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:23.020807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50323d28-79f6-4e84-b154-94fd9092751a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:23.021293 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50323d28-79f6-4e84-b154-94fd9092751a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:23.022153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50323d28-79f6-4e84-b154-94fd9092751a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:23.022617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50323d28-79f6-4e84-b154-94fd9092751a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:23.154265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-50323d28-79f6-4e84-b154-94fd9092751a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:23.162197 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-50323d28-79f6-4e84-b154-94fd9092751a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1570 microversion: 2.1 time: 0.153507 Mar 12 21:38:23.162776 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5277/6045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:23 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:24.113994 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6e4baeb2-8f3b-4e12-a9a2-fccead6b32a6 req-5a95f410-c78e-4af7-bee8-11df46a69c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc62d00-4a37-46ef-89fe-aac8294156f3", "name": "network-vif-deleted", "tag": "8b0a099e-126f-4557-a7ac-d669dce7b103"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:38:24.122910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6e4baeb2-8f3b-4e12-a9a2-fccead6b32a6 req-5a95f410-c78e-4af7-bee8-11df46a69c6b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:24.123350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6e4baeb2-8f3b-4e12-a9a2-fccead6b32a6 req-5a95f410-c78e-4af7-bee8-11df46a69c6b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:24.134705 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6e4baeb2-8f3b-4e12-a9a2-fccead6b32a6 req-5a95f410-c78e-4af7-bee8-11df46a69c6b service nova] Creating event network-vif-deleted:8b0a099e-126f-4557-a7ac-d669dce7b103 for instance fcc62d00-4a37-46ef-89fe-aac8294156f3 on nch1-master-1 Mar 12 21:38:24.139360 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6e4baeb2-8f3b-4e12-a9a2-fccead6b32a6 req-5a95f410-c78e-4af7-bee8-11df46a69c6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094946 Mar 12 21:38:24.139966 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5278/6046] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:38:24.180273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-58289746-6003-4039-b2d5-17de87f19e60 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:24.180985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-58289746-6003-4039-b2d5-17de87f19e60 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:24.187135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58289746-6003-4039-b2d5-17de87f19e60 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:24.187602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58289746-6003-4039-b2d5-17de87f19e60 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:24.188381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58289746-6003-4039-b2d5-17de87f19e60 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:24.188831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58289746-6003-4039-b2d5-17de87f19e60 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:24.218539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58289746-6003-4039-b2d5-17de87f19e60 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:24.219000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58289746-6003-4039-b2d5-17de87f19e60 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:24.219461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-58289746-6003-4039-b2d5-17de87f19e60 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lazy-loading 'fault' on Instance uuid fcc62d00-4a37-46ef-89fe-aac8294156f3 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:38:24.259348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-58289746-6003-4039-b2d5-17de87f19e60 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:24.266679 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-58289746-6003-4039-b2d5-17de87f19e60 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 200 len: 1355 microversion: 2.1 time: 0.090645 Mar 12 21:38:24.267784 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5279/6047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:24 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 1355 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:25.285138 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99a27446-db1f-4626-b180-e3368477e468 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:25.285793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-99a27446-db1f-4626-b180-e3368477e468 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: fcc62d00-4a37-46ef-89fe-aac8294156f3] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:25.292791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99a27446-db1f-4626-b180-e3368477e468 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:25.293262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99a27446-db1f-4626-b180-e3368477e468 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:25.294068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99a27446-db1f-4626-b180-e3368477e468 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:25.294521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-99a27446-db1f-4626-b180-e3368477e468 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:25.307944 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-99a27446-db1f-4626-b180-e3368477e468 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] HTTP exception thrown: Instance fcc62d00-4a37-46ef-89fe-aac8294156f3 could not be found. Mar 12 21:38:25.308539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-99a27446-db1f-4626-b180-e3368477e468 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Returning 404 to user: Instance fcc62d00-4a37-46ef-89fe-aac8294156f3 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:38:25.309356 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-99a27446-db1f-4626-b180-e3368477e468 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3" status: 404 len: 111 microversion: 2.1 time: 0.028898 Mar 12 21:38:25.309903 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5280/6048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:25 2022] GET /compute/v2.1/servers/fcc62d00-4a37-46ef-89fe-aac8294156f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:38:28.616785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf6b238e-9c98-4c9b-96b9-72c6ce8c5303 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '.version_select at 0x7f6e36ebcc10>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:28.645639 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bf6b238e-9c98-4c9b-96b9-72c6ce8c5303 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-464765115" status: 202 len: 0 microversion: 2.1 time: 0.033379 Mar 12 21:38:28.647627 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5281/6049] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Mar 12 21:38:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-464765115 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:38:28.671313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd7b1568-f9f0-4cb9-81df-30ddc67f963f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'create', calling method: .version_select at 0x7f6e376faa60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1574872763"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:38:28.686826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-dd7b1568-f9f0-4cb9-81df-30ddc67f963f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:38:28.692514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-dd7b1568-f9f0-4cb9-81df-30ddc67f963f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:38:28.961358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-dd7b1568-f9f0-4cb9-81df-30ddc67f963f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:38:28.966367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-dd7b1568-f9f0-4cb9-81df-30ddc67f963f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:38:28.981109 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd7b1568-f9f0-4cb9-81df-30ddc67f963f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.313805 Mar 12 21:38:28.981708 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5282/6050] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:38:28 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:33.180472 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:38:33.181036 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:38:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:38:34.724764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-338518087", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "bf4bacee-dfc7-473c-a19a-886a5faa38bf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1574872763", "security_groups": [{"name": "tempest-secgroup-smoke-425058686"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:38:35.043931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] validate_networks() for [('bf4bacee-dfc7-473c-a19a-886a5faa38bf', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:38:35.500745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:38:35.501940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:38:35.502538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:38:35.503036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:38:35.503542 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:38:35.513076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:35.513640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:35.514587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:35.515113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:35.534275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:38:35.539846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:38:35.553425 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:38:35.555821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:38:35.610308 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86921d78-a4e2-4a61-a894-afa1b6417abb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.891035 Mar 12 21:38:35.611009 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5283/6051] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:38:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:38:35.621804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2c990e7c-f18c-4918-832b-bb7f93baeaae tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:35.622496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2c990e7c-f18c-4918-832b-bb7f93baeaae tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:35.624395 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:38:35.625179 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:38:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:38:35.695288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2c990e7c-f18c-4918-832b-bb7f93baeaae tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:35.702981 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2c990e7c-f18c-4918-832b-bb7f93baeaae tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1266 microversion: 2.1 time: 0.085750 Mar 12 21:38:35.703558 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5284/6052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:35 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:38:36.731302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-66805d65-93dc-40d2-bb78-12e2a6375565 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:36.732050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-66805d65-93dc-40d2-bb78-12e2a6375565 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:36.759098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66805d65-93dc-40d2-bb78-12e2a6375565 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:36.759868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66805d65-93dc-40d2-bb78-12e2a6375565 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:36.760846 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66805d65-93dc-40d2-bb78-12e2a6375565 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:36.762292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66805d65-93dc-40d2-bb78-12e2a6375565 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:36.877461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-66805d65-93dc-40d2-bb78-12e2a6375565 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:36.891355 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-66805d65-93dc-40d2-bb78-12e2a6375565 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1326 microversion: 2.1 time: 0.174713 Mar 12 21:38:36.892596 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5285/6053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:36 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1326 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:37.909950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ad0debc1-65fb-4262-aa16-47fe70b73938 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:37.910570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ad0debc1-65fb-4262-aa16-47fe70b73938 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:37.917671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad0debc1-65fb-4262-aa16-47fe70b73938 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:37.918223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad0debc1-65fb-4262-aa16-47fe70b73938 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:37.919052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad0debc1-65fb-4262-aa16-47fe70b73938 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:37.919501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ad0debc1-65fb-4262-aa16-47fe70b73938 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:38.079930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ad0debc1-65fb-4262-aa16-47fe70b73938 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:38.087748 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ad0debc1-65fb-4262-aa16-47fe70b73938 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1391 microversion: 2.1 time: 0.182992 Mar 12 21:38:38.088581 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5286/6054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:37 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:38.256965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0e6ed5eb-c08d-4ad9-8c5f-d124610518e2 req-148e8aaf-35a7-4a47-aaf0-90da3f79e65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c", "tag": "4bbe0e3c-5bf9-489f-9a6c-de4fdd544b34"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:38:38.274885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0e6ed5eb-c08d-4ad9-8c5f-d124610518e2 req-148e8aaf-35a7-4a47-aaf0-90da3f79e65c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:38.275582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0e6ed5eb-c08d-4ad9-8c5f-d124610518e2 req-148e8aaf-35a7-4a47-aaf0-90da3f79e65c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:38.291778 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0e6ed5eb-c08d-4ad9-8c5f-d124610518e2 req-148e8aaf-35a7-4a47-aaf0-90da3f79e65c service nova] Creating event network-changed:4bbe0e3c-5bf9-489f-9a6c-de4fdd544b34 for instance 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c on nch1-master-1 Mar 12 21:38:38.302809 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0e6ed5eb-c08d-4ad9-8c5f-d124610518e2 req-148e8aaf-35a7-4a47-aaf0-90da3f79e65c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049550 Mar 12 21:38:38.303431 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5287/6055] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:38:39.106104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-721c1c6a-b35a-4235-b54c-9e5a789eb379 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:39.106809 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-721c1c6a-b35a-4235-b54c-9e5a789eb379 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:39.113517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-721c1c6a-b35a-4235-b54c-9e5a789eb379 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:39.114008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-721c1c6a-b35a-4235-b54c-9e5a789eb379 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:39.114827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-721c1c6a-b35a-4235-b54c-9e5a789eb379 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:39.115283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-721c1c6a-b35a-4235-b54c-9e5a789eb379 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:39.251925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-721c1c6a-b35a-4235-b54c-9e5a789eb379 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:39.259283 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-721c1c6a-b35a-4235-b54c-9e5a789eb379 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1391 microversion: 2.1 time: 0.158337 Mar 12 21:38:39.259861 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5288/6056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:39 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:40.277255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6a80a595-b8c9-4b33-8c15-7ed59bc934dc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:40.277952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6a80a595-b8c9-4b33-8c15-7ed59bc934dc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:40.286049 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a80a595-b8c9-4b33-8c15-7ed59bc934dc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:40.286516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a80a595-b8c9-4b33-8c15-7ed59bc934dc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:40.287302 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a80a595-b8c9-4b33-8c15-7ed59bc934dc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:40.287753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6a80a595-b8c9-4b33-8c15-7ed59bc934dc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:40.419134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6a80a595-b8c9-4b33-8c15-7ed59bc934dc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:40.426539 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6a80a595-b8c9-4b33-8c15-7ed59bc934dc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1391 microversion: 2.1 time: 0.154370 Mar 12 21:38:40.427115 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5289/6057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:40 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:41.444236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f5a61723-73e3-4212-888a-9cb6c9cceb89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:41.444984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f5a61723-73e3-4212-888a-9cb6c9cceb89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:41.451684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5a61723-73e3-4212-888a-9cb6c9cceb89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:41.452162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5a61723-73e3-4212-888a-9cb6c9cceb89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:41.452967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5a61723-73e3-4212-888a-9cb6c9cceb89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:41.453428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f5a61723-73e3-4212-888a-9cb6c9cceb89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:41.584354 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f5a61723-73e3-4212-888a-9cb6c9cceb89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:41.591763 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f5a61723-73e3-4212-888a-9cb6c9cceb89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1391 microversion: 2.1 time: 0.151499 Mar 12 21:38:41.592351 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5290/6058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:41 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:42.608687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-55285c87-8abf-4eed-bd56-23a9058bfb57 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:42.609360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-55285c87-8abf-4eed-bd56-23a9058bfb57 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:42.616848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55285c87-8abf-4eed-bd56-23a9058bfb57 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:42.617323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55285c87-8abf-4eed-bd56-23a9058bfb57 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:42.618161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55285c87-8abf-4eed-bd56-23a9058bfb57 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:42.618616 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-55285c87-8abf-4eed-bd56-23a9058bfb57 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:42.755113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-55285c87-8abf-4eed-bd56-23a9058bfb57 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:42.762466 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-55285c87-8abf-4eed-bd56-23a9058bfb57 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1391 microversion: 2.1 time: 0.157725 Mar 12 21:38:42.763245 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5291/6059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:42 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:43.780040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c1fd9b2-1e06-4e6b-889a-718a32610be9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:43.780702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c1fd9b2-1e06-4e6b-889a-718a32610be9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:43.787476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c1fd9b2-1e06-4e6b-889a-718a32610be9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:43.787941 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c1fd9b2-1e06-4e6b-889a-718a32610be9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:43.788717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c1fd9b2-1e06-4e6b-889a-718a32610be9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:43.789168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c1fd9b2-1e06-4e6b-889a-718a32610be9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:43.923671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c1fd9b2-1e06-4e6b-889a-718a32610be9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:43.931292 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c1fd9b2-1e06-4e6b-889a-718a32610be9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1391 microversion: 2.1 time: 0.155312 Mar 12 21:38:43.931869 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5292/6060] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:43 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:45.010984 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7e32a7ed-e3f5-4227-961e-827db7d4da58 req-a7cb0f54-0351-42c0-80bd-7b050e8f82fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c", "name": "network-vif-plugged", "status": "completed", "tag": "4bbe0e3c-5bf9-489f-9a6c-de4fdd544b34"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:38:45.019648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7e32a7ed-e3f5-4227-961e-827db7d4da58 req-a7cb0f54-0351-42c0-80bd-7b050e8f82fd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:45.020117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7e32a7ed-e3f5-4227-961e-827db7d4da58 req-a7cb0f54-0351-42c0-80bd-7b050e8f82fd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:45.030701 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7e32a7ed-e3f5-4227-961e-827db7d4da58 req-a7cb0f54-0351-42c0-80bd-7b050e8f82fd service nova] Creating event network-vif-plugged:4bbe0e3c-5bf9-489f-9a6c-de4fdd544b34 for instance 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c on nch1-master-1 Mar 12 21:38:45.036336 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7e32a7ed-e3f5-4227-961e-827db7d4da58 req-a7cb0f54-0351-42c0-80bd-7b050e8f82fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111173 Mar 12 21:38:45.036932 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5293/6061] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:38:45.042389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-254eea6e-ba8c-4fcf-91c6-9f7ecfd9325d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:45.043186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-254eea6e-ba8c-4fcf-91c6-9f7ecfd9325d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:45.049863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-254eea6e-ba8c-4fcf-91c6-9f7ecfd9325d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:45.050349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-254eea6e-ba8c-4fcf-91c6-9f7ecfd9325d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:45.051142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-254eea6e-ba8c-4fcf-91c6-9f7ecfd9325d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:45.051601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-254eea6e-ba8c-4fcf-91c6-9f7ecfd9325d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:45.193402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-254eea6e-ba8c-4fcf-91c6-9f7ecfd9325d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:45.200785 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-254eea6e-ba8c-4fcf-91c6-9f7ecfd9325d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1391 microversion: 2.1 time: 0.162641 Mar 12 21:38:45.201364 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5294/6062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:45 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:38:46.218463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96df842a-c071-4740-88d0-0dd6cf4bdcf9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:46.219114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96df842a-c071-4740-88d0-0dd6cf4bdcf9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:46.225786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96df842a-c071-4740-88d0-0dd6cf4bdcf9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:46.226257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96df842a-c071-4740-88d0-0dd6cf4bdcf9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:46.227028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96df842a-c071-4740-88d0-0dd6cf4bdcf9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:46.227478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96df842a-c071-4740-88d0-0dd6cf4bdcf9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:46.364683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96df842a-c071-4740-88d0-0dd6cf4bdcf9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:46.372106 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96df842a-c071-4740-88d0-0dd6cf4bdcf9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1391 microversion: 2.1 time: 0.157709 Mar 12 21:38:46.372690 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5295/6063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:46 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:47.389097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f54f1f1a-cc4f-42f1-a3c7-11291fb0f3ee tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:47.389807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f54f1f1a-cc4f-42f1-a3c7-11291fb0f3ee tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:47.397232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f54f1f1a-cc4f-42f1-a3c7-11291fb0f3ee tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:47.397699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f54f1f1a-cc4f-42f1-a3c7-11291fb0f3ee tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:47.398510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f54f1f1a-cc4f-42f1-a3c7-11291fb0f3ee tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:47.398964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f54f1f1a-cc4f-42f1-a3c7-11291fb0f3ee tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:47.533910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f54f1f1a-cc4f-42f1-a3c7-11291fb0f3ee tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:47.541506 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f54f1f1a-cc4f-42f1-a3c7-11291fb0f3ee tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1563 microversion: 2.1 time: 0.156373 Mar 12 21:38:47.542117 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5296/6064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:47 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:47.557422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f6fa86df-8ad8-4df4-8509-f93feca8ba4b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:47.558073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f6fa86df-8ad8-4df4-8509-f93feca8ba4b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:47.564090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6fa86df-8ad8-4df4-8509-f93feca8ba4b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:47.564562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6fa86df-8ad8-4df4-8509-f93feca8ba4b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:47.565342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6fa86df-8ad8-4df4-8509-f93feca8ba4b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:47.565834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f6fa86df-8ad8-4df4-8509-f93feca8ba4b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:47.697265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f6fa86df-8ad8-4df4-8509-f93feca8ba4b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:47.704825 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f6fa86df-8ad8-4df4-8509-f93feca8ba4b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1563 microversion: 2.1 time: 0.150906 Mar 12 21:38:47.705407 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5297/6065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:47 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:49.310556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3e94848f-a154-4d1d-b3e0-4f974ee7605f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:38:49.311193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3e94848f-a154-4d1d-b3e0-4f974ee7605f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:38:49.326375 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e94848f-a154-4d1d-b3e0-4f974ee7605f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:49.326848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e94848f-a154-4d1d-b3e0-4f974ee7605f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:49.327645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e94848f-a154-4d1d-b3e0-4f974ee7605f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:49.328102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3e94848f-a154-4d1d-b3e0-4f974ee7605f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:49.464201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3e94848f-a154-4d1d-b3e0-4f974ee7605f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:38:49.472706 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3e94848f-a154-4d1d-b3e0-4f974ee7605f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1563 microversion: 2.1 time: 0.166024 Mar 12 21:38:49.473722 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5298/6066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:38:49 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:38:49.478461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-f36099e9-c7ab-415a-8ee2-30abfeaa21bb req-dda4c5b1-7fd6-4186-b9dc-74773b69ecf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c", "tag": "4bbe0e3c-5bf9-489f-9a6c-de4fdd544b34"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:38:49.488611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f36099e9-c7ab-415a-8ee2-30abfeaa21bb req-dda4c5b1-7fd6-4186-b9dc-74773b69ecf8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:38:49.489319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-f36099e9-c7ab-415a-8ee2-30abfeaa21bb req-dda4c5b1-7fd6-4186-b9dc-74773b69ecf8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:38:49.501425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-f36099e9-c7ab-415a-8ee2-30abfeaa21bb req-dda4c5b1-7fd6-4186-b9dc-74773b69ecf8 service nova] Creating event network-changed:4bbe0e3c-5bf9-489f-9a6c-de4fdd544b34 for instance 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c on nch1-master-1 Mar 12 21:38:49.506963 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-f36099e9-c7ab-415a-8ee2-30abfeaa21bb req-dda4c5b1-7fd6-4186-b9dc-74773b69ecf8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031924 Mar 12 21:38:49.507819 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5299/6067] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:39:20.778025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c1373c09-d65f-4ca0-8511-fcfb24c2cbdb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:39:20.779066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c1373c09-d65f-4ca0-8511-fcfb24c2cbdb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:39:20.785355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1373c09-d65f-4ca0-8511-fcfb24c2cbdb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:20.785866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1373c09-d65f-4ca0-8511-fcfb24c2cbdb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:20.786649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1373c09-d65f-4ca0-8511-fcfb24c2cbdb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:20.787116 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c1373c09-d65f-4ca0-8511-fcfb24c2cbdb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:20.841179 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c1373c09-d65f-4ca0-8511-fcfb24c2cbdb tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c/action" status: 200 len: 24563 microversion: 2.1 time: 0.068524 Mar 12 21:39:20.841874 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5300/6068] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:39:20 2022] POST /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c/action => generated 24563 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:39:51.043195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5991ccda-d3dd-4c09-b803-aa7ea08e5af6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:39:51.044276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5991ccda-d3dd-4c09-b803-aa7ea08e5af6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:39:51.052029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5991ccda-d3dd-4c09-b803-aa7ea08e5af6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:51.052498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5991ccda-d3dd-4c09-b803-aa7ea08e5af6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:51.053274 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5991ccda-d3dd-4c09-b803-aa7ea08e5af6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:51.053729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5991ccda-d3dd-4c09-b803-aa7ea08e5af6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:51.124922 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5991ccda-d3dd-4c09-b803-aa7ea08e5af6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c/action" status: 202 len: 0 microversion: 2.1 time: 0.086079 Mar 12 21:39:51.125693 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5301/6069] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:39:51 2022] POST /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:39:51.133948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b03e2468-2deb-41e5-aeef-d2a785d70969 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:39:51.134662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b03e2468-2deb-41e5-aeef-d2a785d70969 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:39:51.141383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b03e2468-2deb-41e5-aeef-d2a785d70969 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:51.141888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b03e2468-2deb-41e5-aeef-d2a785d70969 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:51.142795 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b03e2468-2deb-41e5-aeef-d2a785d70969 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:51.143253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b03e2468-2deb-41e5-aeef-d2a785d70969 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:51.304968 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b03e2468-2deb-41e5-aeef-d2a785d70969 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:39:51.312330 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b03e2468-2deb-41e5-aeef-d2a785d70969 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1674 microversion: 2.1 time: 0.182352 Mar 12 21:39:51.312911 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5302/6070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:39:51 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:39:52.330093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a78b4cc9-1b75-427b-b0a3-ec0ea445c019 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:39:52.330814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a78b4cc9-1b75-427b-b0a3-ec0ea445c019 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:39:52.337394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a78b4cc9-1b75-427b-b0a3-ec0ea445c019 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:52.337896 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a78b4cc9-1b75-427b-b0a3-ec0ea445c019 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:52.338673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a78b4cc9-1b75-427b-b0a3-ec0ea445c019 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:52.339126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a78b4cc9-1b75-427b-b0a3-ec0ea445c019 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:52.473892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a78b4cc9-1b75-427b-b0a3-ec0ea445c019 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:39:52.481302 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a78b4cc9-1b75-427b-b0a3-ec0ea445c019 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1679 microversion: 2.1 time: 0.155078 Mar 12 21:39:52.481899 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5303/6071] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:39:52 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:39:53.499552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c5764ebd-64ac-457d-9648-4a5639df1fd5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:39:53.500225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c5764ebd-64ac-457d-9648-4a5639df1fd5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:39:53.507047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5764ebd-64ac-457d-9648-4a5639df1fd5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:53.507524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5764ebd-64ac-457d-9648-4a5639df1fd5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:53.508309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5764ebd-64ac-457d-9648-4a5639df1fd5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:53.508765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c5764ebd-64ac-457d-9648-4a5639df1fd5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:53.644042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c5764ebd-64ac-457d-9648-4a5639df1fd5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:39:53.651438 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c5764ebd-64ac-457d-9648-4a5639df1fd5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1679 microversion: 2.1 time: 0.155864 Mar 12 21:39:53.652017 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5304/6072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:39:53 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:39:54.669352 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86e3a69a-722a-49ac-b586-0a63c4790aff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:39:54.670076 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86e3a69a-722a-49ac-b586-0a63c4790aff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:39:54.676724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86e3a69a-722a-49ac-b586-0a63c4790aff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:54.677189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86e3a69a-722a-49ac-b586-0a63c4790aff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:54.677998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86e3a69a-722a-49ac-b586-0a63c4790aff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:54.678529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86e3a69a-722a-49ac-b586-0a63c4790aff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:54.814952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86e3a69a-722a-49ac-b586-0a63c4790aff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:39:54.822319 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86e3a69a-722a-49ac-b586-0a63c4790aff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1679 microversion: 2.1 time: 0.156976 Mar 12 21:39:54.822900 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5305/6073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:39:54 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:39:55.840581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9e0521f6-67ae-4273-8ba0-f0b6d0b1d9f4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:39:55.841204 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9e0521f6-67ae-4273-8ba0-f0b6d0b1d9f4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:39:55.848635 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e0521f6-67ae-4273-8ba0-f0b6d0b1d9f4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:55.849103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e0521f6-67ae-4273-8ba0-f0b6d0b1d9f4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:55.849918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e0521f6-67ae-4273-8ba0-f0b6d0b1d9f4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:55.850400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9e0521f6-67ae-4273-8ba0-f0b6d0b1d9f4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:55.983603 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9e0521f6-67ae-4273-8ba0-f0b6d0b1d9f4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:39:55.990985 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9e0521f6-67ae-4273-8ba0-f0b6d0b1d9f4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1679 microversion: 2.1 time: 0.154392 Mar 12 21:39:55.991569 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5306/6074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:39:55 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:39:57.008494 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34aefb2f-37c8-493c-88b8-45d43441ebb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:39:57.009126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34aefb2f-37c8-493c-88b8-45d43441ebb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:39:57.015892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34aefb2f-37c8-493c-88b8-45d43441ebb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:57.016361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34aefb2f-37c8-493c-88b8-45d43441ebb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:57.017151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34aefb2f-37c8-493c-88b8-45d43441ebb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:57.017611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34aefb2f-37c8-493c-88b8-45d43441ebb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:57.152309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34aefb2f-37c8-493c-88b8-45d43441ebb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:39:57.160427 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34aefb2f-37c8-493c-88b8-45d43441ebb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1679 microversion: 2.1 time: 0.155855 Mar 12 21:39:57.161010 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5307/6075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:39:57 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:39:58.178724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-043b13f1-6c80-4db4-9e5f-064013ca287d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:39:58.179381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-043b13f1-6c80-4db4-9e5f-064013ca287d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:39:58.185290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-043b13f1-6c80-4db4-9e5f-064013ca287d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:58.185759 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-043b13f1-6c80-4db4-9e5f-064013ca287d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:58.186571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-043b13f1-6c80-4db4-9e5f-064013ca287d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:58.187678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-043b13f1-6c80-4db4-9e5f-064013ca287d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:58.317097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-043b13f1-6c80-4db4-9e5f-064013ca287d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:39:58.324478 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-043b13f1-6c80-4db4-9e5f-064013ca287d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1679 microversion: 2.1 time: 0.150031 Mar 12 21:39:58.325057 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5308/6076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:39:58 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:39:59.341674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2a8645be-d7f8-48ca-893e-f221ba66b097 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:39:59.342360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2a8645be-d7f8-48ca-893e-f221ba66b097 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:39:59.349840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a8645be-d7f8-48ca-893e-f221ba66b097 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:59.350317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a8645be-d7f8-48ca-893e-f221ba66b097 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:59.351109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a8645be-d7f8-48ca-893e-f221ba66b097 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:39:59.351564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2a8645be-d7f8-48ca-893e-f221ba66b097 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:39:59.487428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2a8645be-d7f8-48ca-893e-f221ba66b097 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:39:59.495131 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2a8645be-d7f8-48ca-893e-f221ba66b097 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1679 microversion: 2.1 time: 0.157395 Mar 12 21:39:59.495755 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5309/6077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:39:59 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:40:00.512448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7104de1a-9e87-4177-9f03-00423d67fc90 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:40:00.513131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7104de1a-9e87-4177-9f03-00423d67fc90 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:40:00.520914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7104de1a-9e87-4177-9f03-00423d67fc90 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:00.521406 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7104de1a-9e87-4177-9f03-00423d67fc90 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:00.522225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7104de1a-9e87-4177-9f03-00423d67fc90 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:00.522712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7104de1a-9e87-4177-9f03-00423d67fc90 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:00.656153 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7104de1a-9e87-4177-9f03-00423d67fc90 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:40:00.663515 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7104de1a-9e87-4177-9f03-00423d67fc90 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1679 microversion: 2.1 time: 0.154970 Mar 12 21:40:00.664096 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5310/6078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:40:00 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:40:01.680853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e8213c07-0309-4be9-b66e-099ffce27ef0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:40:01.681523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e8213c07-0309-4be9-b66e-099ffce27ef0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:40:01.688920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8213c07-0309-4be9-b66e-099ffce27ef0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:01.689394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8213c07-0309-4be9-b66e-099ffce27ef0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:01.690222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8213c07-0309-4be9-b66e-099ffce27ef0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:01.690686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e8213c07-0309-4be9-b66e-099ffce27ef0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:01.824814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e8213c07-0309-4be9-b66e-099ffce27ef0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:40:01.832305 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e8213c07-0309-4be9-b66e-099ffce27ef0 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1679 microversion: 2.1 time: 0.155378 Mar 12 21:40:01.832898 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5311/6079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:40:01 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:40:02.848540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c9b159ff-d1a5-4614-8087-b50244b9551b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:40:02.849221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c9b159ff-d1a5-4614-8087-b50244b9551b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:40:02.857565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9b159ff-d1a5-4614-8087-b50244b9551b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:02.858070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9b159ff-d1a5-4614-8087-b50244b9551b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:02.858932 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9b159ff-d1a5-4614-8087-b50244b9551b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:02.859397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c9b159ff-d1a5-4614-8087-b50244b9551b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:02.995986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c9b159ff-d1a5-4614-8087-b50244b9551b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:40:03.003985 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c9b159ff-d1a5-4614-8087-b50244b9551b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1682 microversion: 2.1 time: 0.159472 Mar 12 21:40:03.004569 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5312/6080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:40:02 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:40:07.499706 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:40:07.500339 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:40:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:40:35.212730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d6c6742-a9b0-4fb7-b5e2-a53c35392d04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:40:35.213587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2d6c6742-a9b0-4fb7-b5e2-a53c35392d04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:40:35.219753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d6c6742-a9b0-4fb7-b5e2-a53c35392d04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:35.220224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d6c6742-a9b0-4fb7-b5e2-a53c35392d04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:35.221010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d6c6742-a9b0-4fb7-b5e2-a53c35392d04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:35.221467 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d6c6742-a9b0-4fb7-b5e2-a53c35392d04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:35.271988 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d6c6742-a9b0-4fb7-b5e2-a53c35392d04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c/action" status: 200 len: 69092 microversion: 2.1 time: 0.063404 Mar 12 21:40:35.272680 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5313/6081] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:40:35 2022] POST /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c/action => generated 69092 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:40:52.420786 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e0e4e0df-73fd-4174-b9f6-f0c5ffe4e114 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:40:52.421548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e0e4e0df-73fd-4174-b9f6-f0c5ffe4e114 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:40:52.429222 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0e4e0df-73fd-4174-b9f6-f0c5ffe4e114 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:52.429707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0e4e0df-73fd-4174-b9f6-f0c5ffe4e114 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:52.430527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0e4e0df-73fd-4174-b9f6-f0c5ffe4e114 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:52.431042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e0e4e0df-73fd-4174-b9f6-f0c5ffe4e114 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:52.455209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e0e4e0df-73fd-4174-b9f6-f0c5ffe4e114 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:40:52.537109 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e0e4e0df-73fd-4174-b9f6-f0c5ffe4e114 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 204 len: 0 microversion: 2.1 time: 0.120414 Mar 12 21:40:52.537960 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5314/6082] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:40:52 2022] DELETE /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:40:52.543350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ea70371b-cb32-4f4c-a755-c30b89be2fa6 req-6a56d163-0da4-422d-8128-2394a8b033b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c", "tag": "4bbe0e3c-5bf9-489f-9a6c-de4fdd544b34"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:40:52.552068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ea70371b-cb32-4f4c-a755-c30b89be2fa6 req-6a56d163-0da4-422d-8128-2394a8b033b3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:52.552541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ea70371b-cb32-4f4c-a755-c30b89be2fa6 req-6a56d163-0da4-422d-8128-2394a8b033b3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:52.563424 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ea70371b-cb32-4f4c-a755-c30b89be2fa6 req-6a56d163-0da4-422d-8128-2394a8b033b3 service nova] Creating event network-changed:4bbe0e3c-5bf9-489f-9a6c-de4fdd544b34 for instance 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c on nch1-master-1 Mar 12 21:40:52.568848 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ea70371b-cb32-4f4c-a755-c30b89be2fa6 req-6a56d163-0da4-422d-8128-2394a8b033b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029855 Mar 12 21:40:52.569789 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5315/6083] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:40:52.574811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ab4fdfc6-9cb2-4269-864f-5ccac5302800 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:40:52.575505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ab4fdfc6-9cb2-4269-864f-5ccac5302800 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:40:52.582275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab4fdfc6-9cb2-4269-864f-5ccac5302800 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:52.582739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab4fdfc6-9cb2-4269-864f-5ccac5302800 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:52.583529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab4fdfc6-9cb2-4269-864f-5ccac5302800 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:52.583978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ab4fdfc6-9cb2-4269-864f-5ccac5302800 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:52.734287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ab4fdfc6-9cb2-4269-864f-5ccac5302800 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:40:52.742900 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ab4fdfc6-9cb2-4269-864f-5ccac5302800 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1688 microversion: 2.1 time: 0.171942 Mar 12 21:40:52.743734 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5316/6084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:40:52 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:40:53.761217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-81189a01-a9a3-49b7-a5c1-6f14b3831b39 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:40:53.761916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-81189a01-a9a3-49b7-a5c1-6f14b3831b39 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:40:53.768548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81189a01-a9a3-49b7-a5c1-6f14b3831b39 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:53.769013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81189a01-a9a3-49b7-a5c1-6f14b3831b39 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:53.769865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81189a01-a9a3-49b7-a5c1-6f14b3831b39 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:53.770320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-81189a01-a9a3-49b7-a5c1-6f14b3831b39 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:53.901485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-81189a01-a9a3-49b7-a5c1-6f14b3831b39 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:40:53.909403 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-81189a01-a9a3-49b7-a5c1-6f14b3831b39 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1569 microversion: 2.1 time: 0.152129 Mar 12 21:40:53.910026 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5317/6085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:40:53 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:40:54.673036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-274fece4-2064-4194-9d71-6b63052e6529 req-9755e99e-aff1-4049-b14a-aba1412780d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c", "name": "network-vif-deleted", "tag": "4bbe0e3c-5bf9-489f-9a6c-de4fdd544b34"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:40:54.683421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-274fece4-2064-4194-9d71-6b63052e6529 req-9755e99e-aff1-4049-b14a-aba1412780d8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:54.683882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-274fece4-2064-4194-9d71-6b63052e6529 req-9755e99e-aff1-4049-b14a-aba1412780d8 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:54.696761 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-274fece4-2064-4194-9d71-6b63052e6529 req-9755e99e-aff1-4049-b14a-aba1412780d8 service nova] Creating event network-vif-deleted:4bbe0e3c-5bf9-489f-9a6c-de4fdd544b34 for instance 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c on nch1-master-1 Mar 12 21:40:54.702178 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-274fece4-2064-4194-9d71-6b63052e6529 req-9755e99e-aff1-4049-b14a-aba1412780d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033051 Mar 12 21:40:54.703107 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5318/6086] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:40:54.927031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ea97163c-d96c-4b18-8443-165affbb2b9e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:40:54.927758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ea97163c-d96c-4b18-8443-165affbb2b9e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:40:54.934607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea97163c-d96c-4b18-8443-165affbb2b9e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:54.935097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea97163c-d96c-4b18-8443-165affbb2b9e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:54.935873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea97163c-d96c-4b18-8443-165affbb2b9e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:54.936336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea97163c-d96c-4b18-8443-165affbb2b9e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:54.970668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea97163c-d96c-4b18-8443-165affbb2b9e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:54.971141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ea97163c-d96c-4b18-8443-165affbb2b9e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:54.971611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-ea97163c-d96c-4b18-8443-165affbb2b9e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lazy-loading 'fault' on Instance uuid 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:40:55.013853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ea97163c-d96c-4b18-8443-165affbb2b9e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:40:55.022063 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ea97163c-d96c-4b18-8443-165affbb2b9e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 200 len: 1356 microversion: 2.1 time: 0.099688 Mar 12 21:40:55.022746 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5319/6087] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:40:54 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:40:56.040101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b27c0cc-8dec-44c0-9f4f-452dd8d51e7d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:40:56.040715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3b27c0cc-8dec-44c0-9f4f-452dd8d51e7d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:40:56.047442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b27c0cc-8dec-44c0-9f4f-452dd8d51e7d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:56.047903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b27c0cc-8dec-44c0-9f4f-452dd8d51e7d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:56.049286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b27c0cc-8dec-44c0-9f4f-452dd8d51e7d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:40:56.049738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3b27c0cc-8dec-44c0-9f4f-452dd8d51e7d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:40:56.062608 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-3b27c0cc-8dec-44c0-9f4f-452dd8d51e7d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] HTTP exception thrown: Instance 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c could not be found. Mar 12 21:40:56.063203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3b27c0cc-8dec-44c0-9f4f-452dd8d51e7d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Returning 404 to user: Instance 2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:40:56.064054 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3b27c0cc-8dec-44c0-9f4f-452dd8d51e7d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c" status: 404 len: 111 microversion: 2.1 time: 0.028164 Mar 12 21:40:56.064567 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5320/6088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:40:56 2022] GET /compute/v2.1/servers/2fe8e32b-c25f-42c3-b2f5-4d0d0de33d0c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:40:59.363088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f00795f4-edbc-4700-bfa0-faeccc4e1aa6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '.version_select at 0x7f6e48e4f820>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:40:59.387867 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f00795f4-edbc-4700-bfa0-faeccc4e1aa6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1574872763" status: 202 len: 0 microversion: 2.1 time: 0.028766 Mar 12 21:40:59.388450 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5321/6089] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Mar 12 21:40:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1574872763 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:40:59.412298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5d0793cc-1f6f-47e6-a9a7-de54bedf4fc7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'create', calling method: .version_select at 0x7f6e36ea8550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-962672770"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:40:59.427629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-5d0793cc-1f6f-47e6-a9a7-de54bedf4fc7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:40:59.432986 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-5d0793cc-1f6f-47e6-a9a7-de54bedf4fc7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:40:59.579238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-5d0793cc-1f6f-47e6-a9a7-de54bedf4fc7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:40:59.584851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-5d0793cc-1f6f-47e6-a9a7-de54bedf4fc7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:40:59.600435 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5d0793cc-1f6f-47e6-a9a7-de54bedf4fc7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.192680 Mar 12 21:40:59.601229 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5322/6090] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:40:59 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:41:05.145104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1151827677", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "fd040194-cf79-44f3-9742-5f9da3c971e1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-962672770", "security_groups": [{"name": "tempest-secgroup-smoke-984060300"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:41:05.255507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] validate_networks() for [('fd040194-cf79-44f3-9742-5f9da3c971e1', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:41:05.710378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:41:05.710879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:41:05.711383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:41:05.712193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:41:05.712874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:41:05.723716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:05.724060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:05.724882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:05.725335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:05.750048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:41:05.756774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:41:05.774901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:41:05.779492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:41:05.844978 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9935bb53-7023-46d4-bcff-2d4a645a17e3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.702698 Mar 12 21:41:05.845200 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5323/6091] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:41:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:41:05.874992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c80433b5-1372-4752-b78c-a3ef5b342394 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:05.875690 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c80433b5-1372-4752-b78c-a3ef5b342394 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:05.946524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c80433b5-1372-4752-b78c-a3ef5b342394 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:05.960379 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c80433b5-1372-4752-b78c-a3ef5b342394 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1266 microversion: 2.1 time: 0.104889 Mar 12 21:41:05.961049 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5324/6092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:05 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:41:06.978435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f22efc33-7f6e-450f-925c-f9ad40622f02 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:06.980083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f22efc33-7f6e-450f-925c-f9ad40622f02 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:06.996103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f22efc33-7f6e-450f-925c-f9ad40622f02 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:06.996940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f22efc33-7f6e-450f-925c-f9ad40622f02 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:06.998058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f22efc33-7f6e-450f-925c-f9ad40622f02 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:06.998779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f22efc33-7f6e-450f-925c-f9ad40622f02 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:07.103224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f22efc33-7f6e-450f-925c-f9ad40622f02 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:07.112605 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f22efc33-7f6e-450f-925c-f9ad40622f02 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1326 microversion: 2.1 time: 0.139128 Mar 12 21:41:07.114389 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5325/6093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:06 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1326 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:41:08.133639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3483ef68-2588-44c6-96fd-6feb8da48494 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:08.135570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3483ef68-2588-44c6-96fd-6feb8da48494 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:08.149524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3483ef68-2588-44c6-96fd-6feb8da48494 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:08.150303 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3483ef68-2588-44c6-96fd-6feb8da48494 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:08.151386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3483ef68-2588-44c6-96fd-6feb8da48494 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:08.152056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3483ef68-2588-44c6-96fd-6feb8da48494 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:08.331092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3483ef68-2588-44c6-96fd-6feb8da48494 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:08.340166 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3483ef68-2588-44c6-96fd-6feb8da48494 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1391 microversion: 2.1 time: 0.212359 Mar 12 21:41:08.340878 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5326/6094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:08 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:08.714468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-72d22529-7be0-4d46-84e1-6b4041e122cd req-16c87a7f-070a-4059-8248-5033edd4b5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96", "tag": "a4dc4bc9-370e-4286-a4b3-e3771ad70d85"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:41:08.755866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-72d22529-7be0-4d46-84e1-6b4041e122cd req-16c87a7f-070a-4059-8248-5033edd4b5f7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:08.756343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-72d22529-7be0-4d46-84e1-6b4041e122cd req-16c87a7f-070a-4059-8248-5033edd4b5f7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:08.773520 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-72d22529-7be0-4d46-84e1-6b4041e122cd req-16c87a7f-070a-4059-8248-5033edd4b5f7 service nova] Creating event network-changed:a4dc4bc9-370e-4286-a4b3-e3771ad70d85 for instance b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 on nch2-master-1 Mar 12 21:41:08.778009 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-72d22529-7be0-4d46-84e1-6b4041e122cd req-16c87a7f-070a-4059-8248-5033edd4b5f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068264 Mar 12 21:41:08.779221 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5327/6095] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:41:09.360015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-af086041-a068-413d-a01a-4d8cce42605d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:09.361355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-af086041-a068-413d-a01a-4d8cce42605d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:09.367788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af086041-a068-413d-a01a-4d8cce42605d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:09.368253 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af086041-a068-413d-a01a-4d8cce42605d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:09.369066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af086041-a068-413d-a01a-4d8cce42605d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:09.369521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-af086041-a068-413d-a01a-4d8cce42605d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:09.502610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-af086041-a068-413d-a01a-4d8cce42605d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:09.509990 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-af086041-a068-413d-a01a-4d8cce42605d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1391 microversion: 2.1 time: 0.155184 Mar 12 21:41:09.510571 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5328/6096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:09 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:10.526046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ffab2b35-4192-4804-a2d3-0ca64e9263de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:10.526757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ffab2b35-4192-4804-a2d3-0ca64e9263de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:10.534041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffab2b35-4192-4804-a2d3-0ca64e9263de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:10.534503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffab2b35-4192-4804-a2d3-0ca64e9263de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:10.535283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffab2b35-4192-4804-a2d3-0ca64e9263de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:10.535735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffab2b35-4192-4804-a2d3-0ca64e9263de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:10.674079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ffab2b35-4192-4804-a2d3-0ca64e9263de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:10.681480 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ffab2b35-4192-4804-a2d3-0ca64e9263de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1391 microversion: 2.1 time: 0.159342 Mar 12 21:41:10.682098 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5329/6097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:10 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:11.697605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d8e4edfb-5acb-4075-935d-ac163657769b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:11.698371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d8e4edfb-5acb-4075-935d-ac163657769b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:11.705276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8e4edfb-5acb-4075-935d-ac163657769b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:11.705747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8e4edfb-5acb-4075-935d-ac163657769b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:11.706564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8e4edfb-5acb-4075-935d-ac163657769b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:11.707021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d8e4edfb-5acb-4075-935d-ac163657769b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:11.843208 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d8e4edfb-5acb-4075-935d-ac163657769b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:11.851042 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d8e4edfb-5acb-4075-935d-ac163657769b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1391 microversion: 2.1 time: 0.157342 Mar 12 21:41:11.851552 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5330/6098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:11 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:12.868038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cd4f18c9-02bb-49f7-a608-a3203abe9840 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:12.868674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cd4f18c9-02bb-49f7-a608-a3203abe9840 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:12.875487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd4f18c9-02bb-49f7-a608-a3203abe9840 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:12.875959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd4f18c9-02bb-49f7-a608-a3203abe9840 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:12.877334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd4f18c9-02bb-49f7-a608-a3203abe9840 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:12.877823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd4f18c9-02bb-49f7-a608-a3203abe9840 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:13.012560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd4f18c9-02bb-49f7-a608-a3203abe9840 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:13.020045 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cd4f18c9-02bb-49f7-a608-a3203abe9840 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1391 microversion: 2.1 time: 0.155994 Mar 12 21:41:13.020621 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5331/6099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:12 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:13.799808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-76f67dc6-1399-4142-9087-092054bd12d6 req-e4652ffe-ff17-4b31-a849-9edb180af4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96", "name": "network-vif-plugged", "status": "completed", "tag": "a4dc4bc9-370e-4286-a4b3-e3771ad70d85"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:41:13.808748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-76f67dc6-1399-4142-9087-092054bd12d6 req-e4652ffe-ff17-4b31-a849-9edb180af4b7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:13.809875 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-76f67dc6-1399-4142-9087-092054bd12d6 req-e4652ffe-ff17-4b31-a849-9edb180af4b7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:13.820805 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-76f67dc6-1399-4142-9087-092054bd12d6 req-e4652ffe-ff17-4b31-a849-9edb180af4b7 service nova] Creating event network-vif-plugged:a4dc4bc9-370e-4286-a4b3-e3771ad70d85 for instance b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 on nch2-master-1 Mar 12 21:41:13.826117 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-76f67dc6-1399-4142-9087-092054bd12d6 req-e4652ffe-ff17-4b31-a849-9edb180af4b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030067 Mar 12 21:41:13.827241 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5332/6100] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:41:14.037874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1ef9f677-deac-4b36-8daf-cb67cba49346 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:14.038602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1ef9f677-deac-4b36-8daf-cb67cba49346 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:14.045740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ef9f677-deac-4b36-8daf-cb67cba49346 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:14.046249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ef9f677-deac-4b36-8daf-cb67cba49346 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:14.047034 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ef9f677-deac-4b36-8daf-cb67cba49346 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:14.047491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1ef9f677-deac-4b36-8daf-cb67cba49346 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:14.181624 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1ef9f677-deac-4b36-8daf-cb67cba49346 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:14.189622 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1ef9f677-deac-4b36-8daf-cb67cba49346 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1391 microversion: 2.1 time: 0.156205 Mar 12 21:41:14.190237 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5333/6101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:14 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:15.207198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-df632866-cf7c-419d-8922-2b50356946d8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:15.207906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-df632866-cf7c-419d-8922-2b50356946d8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:15.214550 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df632866-cf7c-419d-8922-2b50356946d8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:15.215015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df632866-cf7c-419d-8922-2b50356946d8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:15.215792 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df632866-cf7c-419d-8922-2b50356946d8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:15.216243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-df632866-cf7c-419d-8922-2b50356946d8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:15.347383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-df632866-cf7c-419d-8922-2b50356946d8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:15.354801 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-df632866-cf7c-419d-8922-2b50356946d8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1564 microversion: 2.1 time: 0.152163 Mar 12 21:41:15.355390 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5334/6102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:15 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:15.370364 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ce78e5c-cce0-4a16-8382-20cf124afeb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:15.370988 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3ce78e5c-cce0-4a16-8382-20cf124afeb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:15.377005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ce78e5c-cce0-4a16-8382-20cf124afeb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:15.377480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ce78e5c-cce0-4a16-8382-20cf124afeb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:15.378317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ce78e5c-cce0-4a16-8382-20cf124afeb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:15.378777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3ce78e5c-cce0-4a16-8382-20cf124afeb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:15.511931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3ce78e5c-cce0-4a16-8382-20cf124afeb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:15.519872 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ce78e5c-cce0-4a16-8382-20cf124afeb3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1564 microversion: 2.1 time: 0.153063 Mar 12 21:41:15.520492 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5335/6103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:15 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:17.439030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34442966-3707-4b56-b670-c085e19a0738 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:17.439743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34442966-3707-4b56-b670-c085e19a0738 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:17.446578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34442966-3707-4b56-b670-c085e19a0738 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:17.447044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34442966-3707-4b56-b670-c085e19a0738 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:17.447824 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34442966-3707-4b56-b670-c085e19a0738 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:17.448275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34442966-3707-4b56-b670-c085e19a0738 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:17.582821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34442966-3707-4b56-b670-c085e19a0738 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:17.590442 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34442966-3707-4b56-b670-c085e19a0738 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1564 microversion: 2.1 time: 0.156054 Mar 12 21:41:17.591062 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5336/6104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:17 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:41:17.596355 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-de8eff34-bb13-401f-bbf5-dc3eb88f6a8a req-eec1779f-c4b3-43be-87ab-7e51c5f8e817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96", "tag": "a4dc4bc9-370e-4286-a4b3-e3771ad70d85"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:41:17.608184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-de8eff34-bb13-401f-bbf5-dc3eb88f6a8a req-eec1779f-c4b3-43be-87ab-7e51c5f8e817 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:17.608660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-de8eff34-bb13-401f-bbf5-dc3eb88f6a8a req-eec1779f-c4b3-43be-87ab-7e51c5f8e817 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:17.620519 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-de8eff34-bb13-401f-bbf5-dc3eb88f6a8a req-eec1779f-c4b3-43be-87ab-7e51c5f8e817 service nova] Creating event network-changed:a4dc4bc9-370e-4286-a4b3-e3771ad70d85 for instance b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 on nch2-master-1 Mar 12 21:41:17.626016 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-de8eff34-bb13-401f-bbf5-dc3eb88f6a8a req-eec1779f-c4b3-43be-87ab-7e51c5f8e817 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033753 Mar 12 21:41:17.626791 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5337/6105] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:41:40.864243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ee2f20be-905d-4b55-b899-9c704a3dfccf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:41:40.865269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ee2f20be-905d-4b55-b899-9c704a3dfccf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:40.871539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee2f20be-905d-4b55-b899-9c704a3dfccf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:40.872019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee2f20be-905d-4b55-b899-9c704a3dfccf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:40.872812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee2f20be-905d-4b55-b899-9c704a3dfccf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:40.873276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ee2f20be-905d-4b55-b899-9c704a3dfccf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:40.921109 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ee2f20be-905d-4b55-b899-9c704a3dfccf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96/action" status: 200 len: 24572 microversion: 2.1 time: 0.063488 Mar 12 21:41:40.921749 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5338/6106] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:41:40 2022] POST /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96/action => generated 24572 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:41:47.379976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:41:47.381051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:47.388539 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:47.389033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:47.389851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:47.390311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:47.429528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:47.435892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Old instance type m1.heat2, new instance type m1.heat {{(pid=136302) resize /opt/stack/nova/nova/compute/api.py:4164}} Mar 12 21:41:47.442226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:41:47.442670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:41:47.443200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:41:47.443632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:41:47.444072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:41:47.505304 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e5070f7e-7cfa-43a8-8f4f-8be660be7c04 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96/action" status: 202 len: 0 microversion: 2.1 time: 0.129655 Mar 12 21:41:47.509026 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5339/6107] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:41:47 2022] POST /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:41:47.513920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6884aede-39da-4fc5-82ef-cc044e33bb77 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:47.514549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6884aede-39da-4fc5-82ef-cc044e33bb77 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:47.520891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6884aede-39da-4fc5-82ef-cc044e33bb77 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:47.521411 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6884aede-39da-4fc5-82ef-cc044e33bb77 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:47.522223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6884aede-39da-4fc5-82ef-cc044e33bb77 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:47.522859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6884aede-39da-4fc5-82ef-cc044e33bb77 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:47.703062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6884aede-39da-4fc5-82ef-cc044e33bb77 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:47.711654 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6884aede-39da-4fc5-82ef-cc044e33bb77 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1692 microversion: 2.1 time: 0.201336 Mar 12 21:41:47.712439 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5340/6108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:47 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1692 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:41:48.729562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0027645d-510a-4f6d-88e5-1714e2e71478 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:48.730270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0027645d-510a-4f6d-88e5-1714e2e71478 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:48.737025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0027645d-510a-4f6d-88e5-1714e2e71478 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:48.737500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0027645d-510a-4f6d-88e5-1714e2e71478 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:48.738317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0027645d-510a-4f6d-88e5-1714e2e71478 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:48.738777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0027645d-510a-4f6d-88e5-1714e2e71478 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:48.884533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0027645d-510a-4f6d-88e5-1714e2e71478 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:48.891938 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0027645d-510a-4f6d-88e5-1714e2e71478 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1692 microversion: 2.1 time: 0.166291 Mar 12 21:41:48.892514 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5341/6109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:48 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:49.909929 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4dd33b37-2005-42fc-94e7-b05896cbfbf2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:49.910571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4dd33b37-2005-42fc-94e7-b05896cbfbf2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:49.918151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4dd33b37-2005-42fc-94e7-b05896cbfbf2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:49.918627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4dd33b37-2005-42fc-94e7-b05896cbfbf2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:49.919414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4dd33b37-2005-42fc-94e7-b05896cbfbf2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:49.919880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4dd33b37-2005-42fc-94e7-b05896cbfbf2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:50.056113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4dd33b37-2005-42fc-94e7-b05896cbfbf2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:50.063531 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4dd33b37-2005-42fc-94e7-b05896cbfbf2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1697 microversion: 2.1 time: 0.158228 Mar 12 21:41:50.064102 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5342/6110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:49 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:51.080465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e7941238-0511-49d9-bc0d-406948a59342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:51.081126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e7941238-0511-49d9-bc0d-406948a59342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:51.087853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7941238-0511-49d9-bc0d-406948a59342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:51.088315 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7941238-0511-49d9-bc0d-406948a59342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:51.089087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7941238-0511-49d9-bc0d-406948a59342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:51.089536 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e7941238-0511-49d9-bc0d-406948a59342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:51.223341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e7941238-0511-49d9-bc0d-406948a59342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:51.230819 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e7941238-0511-49d9-bc0d-406948a59342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1697 microversion: 2.1 time: 0.154328 Mar 12 21:41:51.231402 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5343/6111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:51 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:41:52.248286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67a68975-0899-4b1d-8d7e-e3355f9c8df9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:52.248946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-67a68975-0899-4b1d-8d7e-e3355f9c8df9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:52.256183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67a68975-0899-4b1d-8d7e-e3355f9c8df9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:52.256649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67a68975-0899-4b1d-8d7e-e3355f9c8df9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:52.257424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67a68975-0899-4b1d-8d7e-e3355f9c8df9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:52.257898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67a68975-0899-4b1d-8d7e-e3355f9c8df9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:52.397538 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-67a68975-0899-4b1d-8d7e-e3355f9c8df9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:52.405410 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67a68975-0899-4b1d-8d7e-e3355f9c8df9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1697 microversion: 2.1 time: 0.160957 Mar 12 21:41:52.406023 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5344/6112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:52 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:53.190881 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:41:53.191447 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:41:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:41:53.423320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-40621245-2f47-44ff-b3a7-3d37dad92976 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:53.423949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-40621245-2f47-44ff-b3a7-3d37dad92976 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:53.430784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40621245-2f47-44ff-b3a7-3d37dad92976 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:53.431259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40621245-2f47-44ff-b3a7-3d37dad92976 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:53.432044 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40621245-2f47-44ff-b3a7-3d37dad92976 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:53.432510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-40621245-2f47-44ff-b3a7-3d37dad92976 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:53.562958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-40621245-2f47-44ff-b3a7-3d37dad92976 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:53.570913 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-40621245-2f47-44ff-b3a7-3d37dad92976 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1697 microversion: 2.1 time: 0.151596 Mar 12 21:41:53.571494 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5345/6113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:53 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:54.637436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4005076b-4ff7-4051-9eb9-f2d5ac09a436 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:54.638193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4005076b-4ff7-4051-9eb9-f2d5ac09a436 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:54.644698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4005076b-4ff7-4051-9eb9-f2d5ac09a436 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:54.644999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4005076b-4ff7-4051-9eb9-f2d5ac09a436 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:54.646033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4005076b-4ff7-4051-9eb9-f2d5ac09a436 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:54.646662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4005076b-4ff7-4051-9eb9-f2d5ac09a436 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:54.786454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4005076b-4ff7-4051-9eb9-f2d5ac09a436 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:54.794686 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4005076b-4ff7-4051-9eb9-f2d5ac09a436 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1697 microversion: 2.1 time: 0.210175 Mar 12 21:41:54.795275 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5346/6114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:54 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1697 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:55.642349 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:41:55.642349 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:41:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:41:55.812174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-67e93304-efca-4346-8310-cbb36b85bea7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:55.812827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-67e93304-efca-4346-8310-cbb36b85bea7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:55.820114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67e93304-efca-4346-8310-cbb36b85bea7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:55.820582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67e93304-efca-4346-8310-cbb36b85bea7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:55.821361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67e93304-efca-4346-8310-cbb36b85bea7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:55.821836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-67e93304-efca-4346-8310-cbb36b85bea7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:55.957395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-67e93304-efca-4346-8310-cbb36b85bea7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:55.965030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-67e93304-efca-4346-8310-cbb36b85bea7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1697 microversion: 2.1 time: 0.156789 Mar 12 21:41:55.965606 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5347/6115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:55 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:56.982196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-50a4c355-00d3-47e6-888b-8544dc26a979 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:56.982828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-50a4c355-00d3-47e6-888b-8544dc26a979 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:56.989705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50a4c355-00d3-47e6-888b-8544dc26a979 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:56.990194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50a4c355-00d3-47e6-888b-8544dc26a979 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:56.990975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50a4c355-00d3-47e6-888b-8544dc26a979 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:56.991424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-50a4c355-00d3-47e6-888b-8544dc26a979 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:57.131065 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-50a4c355-00d3-47e6-888b-8544dc26a979 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:57.138612 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-50a4c355-00d3-47e6-888b-8544dc26a979 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1697 microversion: 2.1 time: 0.160352 Mar 12 21:41:57.139206 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5348/6116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:56 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:58.156223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d9ed2bd1-a714-40c6-ab91-983f3ac33807 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:58.156909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d9ed2bd1-a714-40c6-ab91-983f3ac33807 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:58.163998 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9ed2bd1-a714-40c6-ab91-983f3ac33807 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:58.164462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9ed2bd1-a714-40c6-ab91-983f3ac33807 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:58.165237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9ed2bd1-a714-40c6-ab91-983f3ac33807 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:58.165689 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d9ed2bd1-a714-40c6-ab91-983f3ac33807 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:58.297677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d9ed2bd1-a714-40c6-ab91-983f3ac33807 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:58.305583 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d9ed2bd1-a714-40c6-ab91-983f3ac33807 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1697 microversion: 2.1 time: 0.153458 Mar 12 21:41:58.306196 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5349/6117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:58 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:41:59.323015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5c0e8346-0c6a-49d8-a0c2-48f339eaefbc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:41:59.323697 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5c0e8346-0c6a-49d8-a0c2-48f339eaefbc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:41:59.330934 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c0e8346-0c6a-49d8-a0c2-48f339eaefbc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:59.331402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c0e8346-0c6a-49d8-a0c2-48f339eaefbc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:59.332177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c0e8346-0c6a-49d8-a0c2-48f339eaefbc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:41:59.332628 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5c0e8346-0c6a-49d8-a0c2-48f339eaefbc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:41:59.463073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5c0e8346-0c6a-49d8-a0c2-48f339eaefbc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:41:59.470338 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5c0e8346-0c6a-49d8-a0c2-48f339eaefbc tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1697 microversion: 2.1 time: 0.151354 Mar 12 21:41:59.471521 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5350/6118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:41:59 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:42:00.488003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4898f768-d5c9-4884-b940-35b7c583c525 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:42:00.488785 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4898f768-d5c9-4884-b940-35b7c583c525 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:42:00.495331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4898f768-d5c9-4884-b940-35b7c583c525 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:00.495776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4898f768-d5c9-4884-b940-35b7c583c525 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:00.496552 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4898f768-d5c9-4884-b940-35b7c583c525 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:00.497008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4898f768-d5c9-4884-b940-35b7c583c525 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:00.632513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4898f768-d5c9-4884-b940-35b7c583c525 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:42:00.639808 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4898f768-d5c9-4884-b940-35b7c583c525 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1697 microversion: 2.1 time: 0.155754 Mar 12 21:42:00.640388 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5351/6119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:42:00 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:42:01.656699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ce971be0-7abb-4026-9e65-a2cc9e30d587 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:42:01.657338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ce971be0-7abb-4026-9e65-a2cc9e30d587 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:42:01.664402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce971be0-7abb-4026-9e65-a2cc9e30d587 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:01.664867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce971be0-7abb-4026-9e65-a2cc9e30d587 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:01.665652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce971be0-7abb-4026-9e65-a2cc9e30d587 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:01.666135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ce971be0-7abb-4026-9e65-a2cc9e30d587 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:01.805348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ce971be0-7abb-4026-9e65-a2cc9e30d587 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:42:01.815981 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ce971be0-7abb-4026-9e65-a2cc9e30d587 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1696 microversion: 2.1 time: 0.162015 Mar 12 21:42:01.816852 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5352/6120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:42:01 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:42:01.827385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a580e869-a584-435d-b50b-ae4a478c00a5 req-71934085-85c6-47af-873c-dcb6a8030ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96", "name": "network-vif-unplugged", "status": "completed", "tag": "a4dc4bc9-370e-4286-a4b3-e3771ad70d85"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:42:01.839574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a580e869-a584-435d-b50b-ae4a478c00a5 req-71934085-85c6-47af-873c-dcb6a8030ac4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:01.840070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a580e869-a584-435d-b50b-ae4a478c00a5 req-71934085-85c6-47af-873c-dcb6a8030ac4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:01.855593 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a580e869-a584-435d-b50b-ae4a478c00a5 req-71934085-85c6-47af-873c-dcb6a8030ac4 service nova] Creating event network-vif-unplugged:a4dc4bc9-370e-4286-a4b3-e3771ad70d85 for instance b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 on nch1-master-1 Mar 12 21:42:01.865807 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-a580e869-a584-435d-b50b-ae4a478c00a5 req-71934085-85c6-47af-873c-dcb6a8030ac4 service nova] Instance b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:42:01.878037 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a580e869-a584-435d-b50b-ae4a478c00a5 req-71934085-85c6-47af-873c-dcb6a8030ac4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058690 Mar 12 21:42:01.879124 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5353/6121] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:42:02.835461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9651ed83-867e-4028-bae4-065d03a1489b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:42:02.836226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9651ed83-867e-4028-bae4-065d03a1489b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:42:02.842404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9651ed83-867e-4028-bae4-065d03a1489b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:02.842871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9651ed83-867e-4028-bae4-065d03a1489b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:02.843677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9651ed83-867e-4028-bae4-065d03a1489b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:02.844125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9651ed83-867e-4028-bae4-065d03a1489b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:02.985630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9651ed83-867e-4028-bae4-065d03a1489b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:42:02.993131 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9651ed83-867e-4028-bae4-065d03a1489b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1694 microversion: 2.1 time: 0.162947 Mar 12 21:42:02.993649 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5354/6122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:42:02 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:42:03.920168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e70c2de9-e74f-4404-a415-6a9e8f519442 req-e927d5c2-7211-4d3c-8b9d-1f9708e89915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96", "tag": "a4dc4bc9-370e-4286-a4b3-e3771ad70d85"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:42:03.929739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e70c2de9-e74f-4404-a415-6a9e8f519442 req-e927d5c2-7211-4d3c-8b9d-1f9708e89915 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:03.930266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e70c2de9-e74f-4404-a415-6a9e8f519442 req-e927d5c2-7211-4d3c-8b9d-1f9708e89915 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:03.941922 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e70c2de9-e74f-4404-a415-6a9e8f519442 req-e927d5c2-7211-4d3c-8b9d-1f9708e89915 service nova] Creating event network-changed:a4dc4bc9-370e-4286-a4b3-e3771ad70d85 for instance b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 on nch1-master-1 Mar 12 21:42:03.947047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [req-e70c2de9-e74f-4404-a415-6a9e8f519442 req-e927d5c2-7211-4d3c-8b9d-1f9708e89915 service nova] Instance b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136302) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Mar 12 21:42:03.958200 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e70c2de9-e74f-4404-a415-6a9e8f519442 req-e927d5c2-7211-4d3c-8b9d-1f9708e89915 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041931 Mar 12 21:42:03.958829 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5355/6123] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:42:04.012503 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a5fee245-1db6-4530-bb96-489d5c5095ac tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:42:04.013392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a5fee245-1db6-4530-bb96-489d5c5095ac tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:42:04.020174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5fee245-1db6-4530-bb96-489d5c5095ac tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:04.020653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5fee245-1db6-4530-bb96-489d5c5095ac tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:04.021459 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5fee245-1db6-4530-bb96-489d5c5095ac tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:04.021957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a5fee245-1db6-4530-bb96-489d5c5095ac tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:04.162570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a5fee245-1db6-4530-bb96-489d5c5095ac tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:42:04.171249 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a5fee245-1db6-4530-bb96-489d5c5095ac tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1694 microversion: 2.1 time: 0.163747 Mar 12 21:42:04.171872 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5356/6124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:42:04 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:42:05.188511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1a5eb866-a371-4b8f-8d81-0c54a9db2b6d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:42:05.189135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1a5eb866-a371-4b8f-8d81-0c54a9db2b6d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:42:05.196005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a5eb866-a371-4b8f-8d81-0c54a9db2b6d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:05.196487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a5eb866-a371-4b8f-8d81-0c54a9db2b6d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:05.197301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a5eb866-a371-4b8f-8d81-0c54a9db2b6d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:05.197754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1a5eb866-a371-4b8f-8d81-0c54a9db2b6d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:05.332381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1a5eb866-a371-4b8f-8d81-0c54a9db2b6d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:42:05.339775 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1a5eb866-a371-4b8f-8d81-0c54a9db2b6d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1694 microversion: 2.1 time: 0.155274 Mar 12 21:42:05.340412 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5357/6125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:42:05 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:42:06.357449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2d88353c-d6fd-4a5d-8f1c-b7e5849ce7f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:42:06.358149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2d88353c-d6fd-4a5d-8f1c-b7e5849ce7f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:42:06.365672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d88353c-d6fd-4a5d-8f1c-b7e5849ce7f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:06.366186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d88353c-d6fd-4a5d-8f1c-b7e5849ce7f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:06.366980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d88353c-d6fd-4a5d-8f1c-b7e5849ce7f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:06.367450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2d88353c-d6fd-4a5d-8f1c-b7e5849ce7f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:06.504132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2d88353c-d6fd-4a5d-8f1c-b7e5849ce7f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:42:06.511633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2d88353c-d6fd-4a5d-8f1c-b7e5849ce7f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1691 microversion: 2.1 time: 0.158131 Mar 12 21:42:06.512214 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5358/6126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:42:06 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:42:06.527266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a8001107-41da-4bc4-9bd9-df5c0968b784 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:42:06.527808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a8001107-41da-4bc4-9bd9-df5c0968b784 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:42:06.533859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8001107-41da-4bc4-9bd9-df5c0968b784 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:06.534325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8001107-41da-4bc4-9bd9-df5c0968b784 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:06.535109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8001107-41da-4bc4-9bd9-df5c0968b784 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:06.535558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a8001107-41da-4bc4-9bd9-df5c0968b784 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:06.590464 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a8001107-41da-4bc4-9bd9-df5c0968b784 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96/action" status: 204 len: 0 microversion: 2.1 time: 0.066502 Mar 12 21:42:06.591115 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5359/6127] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:42:06 2022] POST /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96/action => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:42:06.600639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2959ddd8-1f5d-4e6a-b3b9-af5ada4ba17e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:42:06.601378 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2959ddd8-1f5d-4e6a-b3b9-af5ada4ba17e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:42:06.607435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2959ddd8-1f5d-4e6a-b3b9-af5ada4ba17e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:06.607895 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2959ddd8-1f5d-4e6a-b3b9-af5ada4ba17e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:06.609105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2959ddd8-1f5d-4e6a-b3b9-af5ada4ba17e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:06.609857 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2959ddd8-1f5d-4e6a-b3b9-af5ada4ba17e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:06.752492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2959ddd8-1f5d-4e6a-b3b9-af5ada4ba17e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:42:06.760012 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2959ddd8-1f5d-4e6a-b3b9-af5ada4ba17e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1691 microversion: 2.1 time: 0.164648 Mar 12 21:42:06.760600 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5360/6128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:42:06 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:42:06.776602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e5921424-d831-43da-b42d-a4079eb119b8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:42:06.777347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e5921424-d831-43da-b42d-a4079eb119b8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:42:06.783953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5921424-d831-43da-b42d-a4079eb119b8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:06.784427 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5921424-d831-43da-b42d-a4079eb119b8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:06.785216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5921424-d831-43da-b42d-a4079eb119b8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:06.785673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e5921424-d831-43da-b42d-a4079eb119b8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:06.928183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e5921424-d831-43da-b42d-a4079eb119b8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:42:06.935699 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e5921424-d831-43da-b42d-a4079eb119b8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1691 microversion: 2.1 time: 0.162842 Mar 12 21:42:06.936291 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5361/6129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:42:06 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:42:07.846566 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-c9479275-2f32-46cc-a642-270629243ad1 req-2595791d-1b8d-4950-882f-0b3201e35551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96", "name": "network-vif-plugged", "status": "completed", "tag": "a4dc4bc9-370e-4286-a4b3-e3771ad70d85"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:42:07.856105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c9479275-2f32-46cc-a642-270629243ad1 req-2595791d-1b8d-4950-882f-0b3201e35551 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:07.856925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-c9479275-2f32-46cc-a642-270629243ad1 req-2595791d-1b8d-4950-882f-0b3201e35551 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:07.871179 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-c9479275-2f32-46cc-a642-270629243ad1 req-2595791d-1b8d-4950-882f-0b3201e35551 service nova] Creating event network-vif-plugged:a4dc4bc9-370e-4286-a4b3-e3771ad70d85 for instance b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 on nch1-master-1 Mar 12 21:42:07.876712 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-c9479275-2f32-46cc-a642-270629243ad1 req-2595791d-1b8d-4950-882f-0b3201e35551 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034494 Mar 12 21:42:07.877523 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5362/6130] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:42:07.953251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd8834b2-0b54-48c3-b4e8-538e25eb66b4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:42:07.954002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dd8834b2-0b54-48c3-b4e8-538e25eb66b4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:42:07.960240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd8834b2-0b54-48c3-b4e8-538e25eb66b4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:07.960718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd8834b2-0b54-48c3-b4e8-538e25eb66b4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:07.961500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd8834b2-0b54-48c3-b4e8-538e25eb66b4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:07.961989 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd8834b2-0b54-48c3-b4e8-538e25eb66b4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:08.100407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dd8834b2-0b54-48c3-b4e8-538e25eb66b4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:42:08.107950 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd8834b2-0b54-48c3-b4e8-538e25eb66b4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1683 microversion: 2.1 time: 0.159030 Mar 12 21:42:08.108536 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5363/6131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:42:07 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:42:38.329803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cbd1d3e0-974f-49eb-836c-70bec6811bef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:42:38.330771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cbd1d3e0-974f-49eb-836c-70bec6811bef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:42:38.336813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbd1d3e0-974f-49eb-836c-70bec6811bef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:38.337292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbd1d3e0-974f-49eb-836c-70bec6811bef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:38.338140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbd1d3e0-974f-49eb-836c-70bec6811bef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:42:38.338605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cbd1d3e0-974f-49eb-836c-70bec6811bef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:42:38.386595 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cbd1d3e0-974f-49eb-836c-70bec6811bef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96/action" status: 200 len: 24575 microversion: 2.1 time: 0.060933 Mar 12 21:42:38.387228 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5364/6132] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:42:38 2022] POST /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96/action => generated 24575 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:43:01.883182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-69c34b22-71b6-4692-973a-697d243e532c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:01.883842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-69c34b22-71b6-4692-973a-697d243e532c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:01.891190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69c34b22-71b6-4692-973a-697d243e532c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:01.891732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69c34b22-71b6-4692-973a-697d243e532c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:01.892588 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69c34b22-71b6-4692-973a-697d243e532c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:01.893133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-69c34b22-71b6-4692-973a-697d243e532c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:01.918312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-69c34b22-71b6-4692-973a-697d243e532c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:43:01.994885 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-69c34b22-71b6-4692-973a-697d243e532c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 204 len: 0 microversion: 2.1 time: 0.115946 Mar 12 21:43:01.995452 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5365/6133] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:43:01 2022] DELETE /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:43:02.001119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-411b0d3c-132d-4404-994a-5e6c88f0f9a0 req-51202a19-d695-4923-a2b1-e701e662543e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96", "tag": "a4dc4bc9-370e-4286-a4b3-e3771ad70d85"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:43:02.010032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-411b0d3c-132d-4404-994a-5e6c88f0f9a0 req-51202a19-d695-4923-a2b1-e701e662543e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:02.010501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-411b0d3c-132d-4404-994a-5e6c88f0f9a0 req-51202a19-d695-4923-a2b1-e701e662543e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:02.022221 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-411b0d3c-132d-4404-994a-5e6c88f0f9a0 req-51202a19-d695-4923-a2b1-e701e662543e service nova] Creating event network-changed:a4dc4bc9-370e-4286-a4b3-e3771ad70d85 for instance b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 on nch1-master-1 Mar 12 21:43:02.027253 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-411b0d3c-132d-4404-994a-5e6c88f0f9a0 req-51202a19-d695-4923-a2b1-e701e662543e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030019 Mar 12 21:43:02.027872 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5366/6134] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:43:02.033148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8feda61e-8a3d-400f-ba10-5669de5e6f92 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:02.033840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8feda61e-8a3d-400f-ba10-5669de5e6f92 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:02.041684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8feda61e-8a3d-400f-ba10-5669de5e6f92 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:02.042201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8feda61e-8a3d-400f-ba10-5669de5e6f92 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:02.043006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8feda61e-8a3d-400f-ba10-5669de5e6f92 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:02.043479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8feda61e-8a3d-400f-ba10-5669de5e6f92 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:02.186512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8feda61e-8a3d-400f-ba10-5669de5e6f92 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:02.194511 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8feda61e-8a3d-400f-ba10-5669de5e6f92 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1689 microversion: 2.1 time: 0.165487 Mar 12 21:43:02.195312 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5367/6135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:02 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:43:03.212835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3591971b-b005-44cc-8da5-ae303e80e1ba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:03.213483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3591971b-b005-44cc-8da5-ae303e80e1ba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:03.220347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3591971b-b005-44cc-8da5-ae303e80e1ba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:03.220817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3591971b-b005-44cc-8da5-ae303e80e1ba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:03.221606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3591971b-b005-44cc-8da5-ae303e80e1ba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:03.222102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3591971b-b005-44cc-8da5-ae303e80e1ba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:03.369668 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3591971b-b005-44cc-8da5-ae303e80e1ba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:03.378835 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3591971b-b005-44cc-8da5-ae303e80e1ba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1570 microversion: 2.1 time: 0.169479 Mar 12 21:43:03.379438 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5368/6136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:03 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:43:04.043072 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8b2d0366-bd4e-41da-8958-892475462f82 req-123482e0-c1fc-43ff-bcc2-acd72d9f35d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96", "name": "network-vif-deleted", "tag": "a4dc4bc9-370e-4286-a4b3-e3771ad70d85"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:43:04.057047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8b2d0366-bd4e-41da-8958-892475462f82 req-123482e0-c1fc-43ff-bcc2-acd72d9f35d4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:04.057513 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8b2d0366-bd4e-41da-8958-892475462f82 req-123482e0-c1fc-43ff-bcc2-acd72d9f35d4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:04.069030 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8b2d0366-bd4e-41da-8958-892475462f82 req-123482e0-c1fc-43ff-bcc2-acd72d9f35d4 service nova] Creating event network-vif-deleted:a4dc4bc9-370e-4286-a4b3-e3771ad70d85 for instance b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 on nch1-master-1 Mar 12 21:43:04.074043 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8b2d0366-bd4e-41da-8958-892475462f82 req-123482e0-c1fc-43ff-bcc2-acd72d9f35d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035265 Mar 12 21:43:04.074646 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5369/6137] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:43:04.397789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5102bada-b513-4bdb-a0d4-a57d881ee0de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:04.398517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5102bada-b513-4bdb-a0d4-a57d881ee0de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:04.405608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5102bada-b513-4bdb-a0d4-a57d881ee0de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:04.406389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5102bada-b513-4bdb-a0d4-a57d881ee0de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:04.407200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5102bada-b513-4bdb-a0d4-a57d881ee0de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:04.407659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5102bada-b513-4bdb-a0d4-a57d881ee0de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:04.447363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5102bada-b513-4bdb-a0d4-a57d881ee0de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:04.447546 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5102bada-b513-4bdb-a0d4-a57d881ee0de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:04.448292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-5102bada-b513-4bdb-a0d4-a57d881ee0de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lazy-loading 'fault' on Instance uuid b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:43:04.496137 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5102bada-b513-4bdb-a0d4-a57d881ee0de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:04.502920 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5102bada-b513-4bdb-a0d4-a57d881ee0de tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 200 len: 1356 microversion: 2.1 time: 0.110138 Mar 12 21:43:04.503544 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5370/6138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:04 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 1356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:43:05.114344 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:43:05.114553 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 21:43:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 21:43:05.520688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bdf31cd9-cf85-43b8-86e4-27897c3d6b50 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:05.521350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bdf31cd9-cf85-43b8-86e4-27897c3d6b50 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:05.528189 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bdf31cd9-cf85-43b8-86e4-27897c3d6b50 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:05.528663 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bdf31cd9-cf85-43b8-86e4-27897c3d6b50 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:05.529458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bdf31cd9-cf85-43b8-86e4-27897c3d6b50 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:05.529953 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bdf31cd9-cf85-43b8-86e4-27897c3d6b50 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:05.545423 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-bdf31cd9-cf85-43b8-86e4-27897c3d6b50 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] HTTP exception thrown: Instance b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 could not be found. Mar 12 21:43:05.546106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bdf31cd9-cf85-43b8-86e4-27897c3d6b50 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Returning 404 to user: Instance b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:43:05.547137 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bdf31cd9-cf85-43b8-86e4-27897c3d6b50 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96" status: 404 len: 111 microversion: 2.1 time: 0.031043 Mar 12 21:43:05.547677 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5371/6139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:05 2022] GET /compute/v2.1/servers/b2f3b3d7-725d-4bb2-bb5f-a95396d8bd96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:43:08.885805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-13dc5f10-657e-4ac3-a61f-f2d473a9d7d7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '.version_select at 0x7f6e353eaa60>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:08.913090 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-13dc5f10-657e-4ac3-a61f-f2d473a9d7d7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-962672770" status: 202 len: 0 microversion: 2.1 time: 0.031595 Mar 12 21:43:08.913677 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5372/6140] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Mar 12 21:43:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-962672770 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:43:08.938157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a0846e67-4ab0-4d90-afd6-e2290c97fe94 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'create', calling method: .version_select at 0x7f6e36253e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1899113407"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:43:08.953814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a0846e67-4ab0-4d90-afd6-e2290c97fe94 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:43:08.959081 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a0846e67-4ab0-4d90-afd6-e2290c97fe94 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:43:09.094005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a0846e67-4ab0-4d90-afd6-e2290c97fe94 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:43:09.099215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-a0846e67-4ab0-4d90-afd6-e2290c97fe94 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:43:09.114167 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a0846e67-4ab0-4d90-afd6-e2290c97fe94 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.179966 Mar 12 21:43:09.114769 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5373/6141] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:43:08 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:43:14.688384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-358258855", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "2c9f9da1-a401-4e91-ad83-042500ebeffd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1899113407", "security_groups": [{"name": "tempest-secgroup-smoke-24363804"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:43:14.825712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] validate_networks() for [('2c9f9da1-a401-4e91-ad83-042500ebeffd', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:43:15.532198 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:43:15.532643 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:43:15.533143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:43:15.533609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:43:15.534075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:43:15.543567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:15.544037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:15.544876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:15.545336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:15.562993 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:43:15.568819 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:43:15.584894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:43:15.587264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:43:15.632229 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20a4beca-1354-4b50-8fcf-bbfb3936fda8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.948580 Mar 12 21:43:15.633130 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5374/6142] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:43:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:43:15.642960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-172e1cc5-bacc-40c8-ae73-07ee1f69d6d2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:15.643595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-172e1cc5-bacc-40c8-ae73-07ee1f69d6d2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:15.700371 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-172e1cc5-bacc-40c8-ae73-07ee1f69d6d2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:15.708058 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-172e1cc5-bacc-40c8-ae73-07ee1f69d6d2 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1266 microversion: 2.1 time: 0.068281 Mar 12 21:43:15.717539 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5375/6143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:15 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:43:16.733152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d41bc36f-e09c-4505-b059-430895113d92 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:16.734203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d41bc36f-e09c-4505-b059-430895113d92 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:16.795778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d41bc36f-e09c-4505-b059-430895113d92 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:16.804020 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d41bc36f-e09c-4505-b059-430895113d92 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1266 microversion: 2.1 time: 0.078485 Mar 12 21:43:16.804622 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5376/6144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:16 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:43:17.821487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-837fd2de-c511-4e2b-8e3f-8dc6704f5687 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:17.822149 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-837fd2de-c511-4e2b-8e3f-8dc6704f5687 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:17.878537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-837fd2de-c511-4e2b-8e3f-8dc6704f5687 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:17.887425 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-837fd2de-c511-4e2b-8e3f-8dc6704f5687 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1266 microversion: 2.1 time: 0.070016 Mar 12 21:43:17.887890 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5377/6145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:17 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:43:18.904497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-70f00bc9-5200-44f3-8040-74cd3f3f019f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:18.905349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-70f00bc9-5200-44f3-8040-74cd3f3f019f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:18.956576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-70f00bc9-5200-44f3-8040-74cd3f3f019f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:18.963750 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-70f00bc9-5200-44f3-8040-74cd3f3f019f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1266 microversion: 2.1 time: 0.063495 Mar 12 21:43:18.964318 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5378/6146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:18 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1266 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:43:19.980960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-86ccf820-c539-4e8a-9897-4332b8b38dbf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:19.981590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-86ccf820-c539-4e8a-9897-4332b8b38dbf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:19.988531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86ccf820-c539-4e8a-9897-4332b8b38dbf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:19.989005 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86ccf820-c539-4e8a-9897-4332b8b38dbf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:19.989806 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86ccf820-c539-4e8a-9897-4332b8b38dbf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:19.990269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-86ccf820-c539-4e8a-9897-4332b8b38dbf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:20.052403 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-86ccf820-c539-4e8a-9897-4332b8b38dbf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:20.060842 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-86ccf820-c539-4e8a-9897-4332b8b38dbf tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1270 microversion: 2.1 time: 0.083833 Mar 12 21:43:20.061410 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5379/6147] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:19 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:43:21.078300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bf418fcf-7548-41e8-bd2e-5916e8199149 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:21.079070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bf418fcf-7548-41e8-bd2e-5916e8199149 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:21.085843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf418fcf-7548-41e8-bd2e-5916e8199149 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:21.086325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf418fcf-7548-41e8-bd2e-5916e8199149 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:21.087124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf418fcf-7548-41e8-bd2e-5916e8199149 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:21.087586 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bf418fcf-7548-41e8-bd2e-5916e8199149 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:21.148878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bf418fcf-7548-41e8-bd2e-5916e8199149 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:21.156568 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bf418fcf-7548-41e8-bd2e-5916e8199149 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1324 microversion: 2.1 time: 0.082051 Mar 12 21:43:21.157495 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5380/6148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:21 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1324 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:43:21.983590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-5d44453c-44c2-4d42-b861-f54910409275 req-d80de449-e40f-4840-9092-4fff17b37468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e91e12-9bc0-4ba8-9000-ffeeec888a26", "tag": "41b7b380-3918-43e3-af44-7df20c541d2a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:43:21.992817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5d44453c-44c2-4d42-b861-f54910409275 req-d80de449-e40f-4840-9092-4fff17b37468 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:21.993129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-5d44453c-44c2-4d42-b861-f54910409275 req-d80de449-e40f-4840-9092-4fff17b37468 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:22.013340 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-5d44453c-44c2-4d42-b861-f54910409275 req-d80de449-e40f-4840-9092-4fff17b37468 service nova] Creating event network-changed:41b7b380-3918-43e3-af44-7df20c541d2a for instance b4e91e12-9bc0-4ba8-9000-ffeeec888a26 on nch2-master-1 Mar 12 21:43:22.018820 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-5d44453c-44c2-4d42-b861-f54910409275 req-d80de449-e40f-4840-9092-4fff17b37468 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039445 Mar 12 21:43:22.019646 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5381/6149] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:43:22.176255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e69455ae-8ee1-41f8-b7ab-65d76768b760 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:22.177331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e69455ae-8ee1-41f8-b7ab-65d76768b760 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:22.183583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e69455ae-8ee1-41f8-b7ab-65d76768b760 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:22.184050 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e69455ae-8ee1-41f8-b7ab-65d76768b760 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:22.184834 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e69455ae-8ee1-41f8-b7ab-65d76768b760 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:22.185291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e69455ae-8ee1-41f8-b7ab-65d76768b760 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:22.330714 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e69455ae-8ee1-41f8-b7ab-65d76768b760 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:22.338621 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e69455ae-8ee1-41f8-b7ab-65d76768b760 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1390 microversion: 2.1 time: 0.167515 Mar 12 21:43:22.339224 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5382/6150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:22 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:43:23.356241 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fea7a846-a278-4bd0-b242-f48cb4faaaf3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:23.356865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fea7a846-a278-4bd0-b242-f48cb4faaaf3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:23.363700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fea7a846-a278-4bd0-b242-f48cb4faaaf3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:23.364170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fea7a846-a278-4bd0-b242-f48cb4faaaf3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:23.364956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fea7a846-a278-4bd0-b242-f48cb4faaaf3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:23.365963 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fea7a846-a278-4bd0-b242-f48cb4faaaf3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:23.499627 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fea7a846-a278-4bd0-b242-f48cb4faaaf3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:23.507037 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fea7a846-a278-4bd0-b242-f48cb4faaaf3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1390 microversion: 2.1 time: 0.154733 Mar 12 21:43:23.507614 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5383/6151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:23 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:43:24.532527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e33697f3-dba5-4e49-9d14-371778eecf15 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:24.533168 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e33697f3-dba5-4e49-9d14-371778eecf15 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:24.540212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e33697f3-dba5-4e49-9d14-371778eecf15 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:24.540688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e33697f3-dba5-4e49-9d14-371778eecf15 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:24.541489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e33697f3-dba5-4e49-9d14-371778eecf15 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:24.541974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e33697f3-dba5-4e49-9d14-371778eecf15 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:24.684407 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e33697f3-dba5-4e49-9d14-371778eecf15 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:24.691700 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e33697f3-dba5-4e49-9d14-371778eecf15 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1390 microversion: 2.1 time: 0.163176 Mar 12 21:43:24.692278 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5384/6152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:24 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:43:25.709393 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9c12f25e-aa3b-47eb-8153-66a2628c84ce tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:25.710087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9c12f25e-aa3b-47eb-8153-66a2628c84ce tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:25.716765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c12f25e-aa3b-47eb-8153-66a2628c84ce tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:25.717229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c12f25e-aa3b-47eb-8153-66a2628c84ce tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:25.718039 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c12f25e-aa3b-47eb-8153-66a2628c84ce tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:25.718492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9c12f25e-aa3b-47eb-8153-66a2628c84ce tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:25.852990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9c12f25e-aa3b-47eb-8153-66a2628c84ce tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:25.862391 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9c12f25e-aa3b-47eb-8153-66a2628c84ce tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1390 microversion: 2.1 time: 0.156919 Mar 12 21:43:25.862990 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5385/6153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:25 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:43:26.513731 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-6ebb2536-b8c8-42ea-9998-5bd7c00105ce req-9bda99c3-a4de-4be5-a103-d9df4be70511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e91e12-9bc0-4ba8-9000-ffeeec888a26", "name": "network-vif-plugged", "status": "completed", "tag": "41b7b380-3918-43e3-af44-7df20c541d2a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:43:26.522237 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6ebb2536-b8c8-42ea-9998-5bd7c00105ce req-9bda99c3-a4de-4be5-a103-d9df4be70511 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:26.522902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-6ebb2536-b8c8-42ea-9998-5bd7c00105ce req-9bda99c3-a4de-4be5-a103-d9df4be70511 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:26.534242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-6ebb2536-b8c8-42ea-9998-5bd7c00105ce req-9bda99c3-a4de-4be5-a103-d9df4be70511 service nova] Creating event network-vif-plugged:41b7b380-3918-43e3-af44-7df20c541d2a for instance b4e91e12-9bc0-4ba8-9000-ffeeec888a26 on nch2-master-1 Mar 12 21:43:26.539424 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-6ebb2536-b8c8-42ea-9998-5bd7c00105ce req-9bda99c3-a4de-4be5-a103-d9df4be70511 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029416 Mar 12 21:43:26.540031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5386/6154] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:43:26.882500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-82f2d37c-6517-45fe-a29d-e2a580105663 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:26.885308 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-82f2d37c-6517-45fe-a29d-e2a580105663 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:26.889647 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82f2d37c-6517-45fe-a29d-e2a580105663 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:26.890152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82f2d37c-6517-45fe-a29d-e2a580105663 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:26.890960 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82f2d37c-6517-45fe-a29d-e2a580105663 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:26.891394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-82f2d37c-6517-45fe-a29d-e2a580105663 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:27.028446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-82f2d37c-6517-45fe-a29d-e2a580105663 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:27.035660 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-82f2d37c-6517-45fe-a29d-e2a580105663 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1390 microversion: 2.1 time: 0.159322 Mar 12 21:43:27.036237 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5387/6155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:26 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:43:27.508048 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:43:27.508673 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:43:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:43:28.053439 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-abeb5fce-e0b6-4f49-98ce-0ff9a5f9dc63 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:28.054028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-abeb5fce-e0b6-4f49-98ce-0ff9a5f9dc63 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:28.060300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abeb5fce-e0b6-4f49-98ce-0ff9a5f9dc63 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:28.060767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abeb5fce-e0b6-4f49-98ce-0ff9a5f9dc63 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:28.061556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abeb5fce-e0b6-4f49-98ce-0ff9a5f9dc63 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:28.062036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-abeb5fce-e0b6-4f49-98ce-0ff9a5f9dc63 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:28.197166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-abeb5fce-e0b6-4f49-98ce-0ff9a5f9dc63 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:28.204557 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-abeb5fce-e0b6-4f49-98ce-0ff9a5f9dc63 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1562 microversion: 2.1 time: 0.155152 Mar 12 21:43:28.205125 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5388/6156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:28 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:43:28.221058 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3f11fd90-a320-4472-bb2c-63f73156ec2d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:28.221681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3f11fd90-a320-4472-bb2c-63f73156ec2d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:28.228182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f11fd90-a320-4472-bb2c-63f73156ec2d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:28.228651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f11fd90-a320-4472-bb2c-63f73156ec2d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:28.229435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f11fd90-a320-4472-bb2c-63f73156ec2d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:28.229919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3f11fd90-a320-4472-bb2c-63f73156ec2d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:28.366870 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3f11fd90-a320-4472-bb2c-63f73156ec2d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:28.374205 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3f11fd90-a320-4472-bb2c-63f73156ec2d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1562 microversion: 2.1 time: 0.156826 Mar 12 21:43:28.374787 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5389/6157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:28 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:43:29.962294 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7b1893d5-de79-42e4-8604-296ebb6669fd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:29.963012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7b1893d5-de79-42e4-8604-296ebb6669fd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:29.969959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b1893d5-de79-42e4-8604-296ebb6669fd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:29.970508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b1893d5-de79-42e4-8604-296ebb6669fd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:29.971373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b1893d5-de79-42e4-8604-296ebb6669fd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:29.971925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7b1893d5-de79-42e4-8604-296ebb6669fd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:30.105367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7b1893d5-de79-42e4-8604-296ebb6669fd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:43:30.113105 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7b1893d5-de79-42e4-8604-296ebb6669fd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1562 microversion: 2.1 time: 0.155902 Mar 12 21:43:30.113693 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5390/6158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:29 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:43:30.193735 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7fd0b69a-3361-441a-ad7c-c1c267d6f78d req-512d0c11-4c1a-4567-b552-b05b4ac5619e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e91e12-9bc0-4ba8-9000-ffeeec888a26", "tag": "41b7b380-3918-43e3-af44-7df20c541d2a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:43:30.201878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7fd0b69a-3361-441a-ad7c-c1c267d6f78d req-512d0c11-4c1a-4567-b552-b05b4ac5619e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:30.202450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7fd0b69a-3361-441a-ad7c-c1c267d6f78d req-512d0c11-4c1a-4567-b552-b05b4ac5619e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:30.213900 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7fd0b69a-3361-441a-ad7c-c1c267d6f78d req-512d0c11-4c1a-4567-b552-b05b4ac5619e service nova] Creating event network-changed:41b7b380-3918-43e3-af44-7df20c541d2a for instance b4e91e12-9bc0-4ba8-9000-ffeeec888a26 on nch2-master-1 Mar 12 21:43:30.219478 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7fd0b69a-3361-441a-ad7c-c1c267d6f78d req-512d0c11-4c1a-4567-b552-b05b4ac5619e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104445 Mar 12 21:43:30.220585 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5391/6159] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:43:53.359143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6743c2e3-d7ab-4962-b0ee-fbc09667e950 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:43:53.360146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6743c2e3-d7ab-4962-b0ee-fbc09667e950 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:53.367559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6743c2e3-d7ab-4962-b0ee-fbc09667e950 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:53.368028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6743c2e3-d7ab-4962-b0ee-fbc09667e950 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:53.368811 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6743c2e3-d7ab-4962-b0ee-fbc09667e950 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:53.369269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6743c2e3-d7ab-4962-b0ee-fbc09667e950 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:53.419002 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6743c2e3-d7ab-4962-b0ee-fbc09667e950 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26/action" status: 200 len: 24560 microversion: 2.1 time: 0.063267 Mar 12 21:43:53.419655 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5392/6160] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:43:53 2022] POST /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26/action => generated 24560 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:43:59.829444 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5ce45b44-0a0e-432a-9f35-729831d46534 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:43:59.836775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ce45b44-0a0e-432a-9f35-729831d46534 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:59.837239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5ce45b44-0a0e-432a-9f35-729831d46534 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:59.859535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5ce45b44-0a0e-432a-9f35-729831d46534 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Going to try to stop instance {{(pid=136302) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 12 21:43:59.901369 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5ce45b44-0a0e-432a-9f35-729831d46534 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26/action" status: 202 len: 0 microversion: 2.1 time: 0.076086 Mar 12 21:43:59.902155 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5393/6161] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:43:59 2022] POST /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:43:59.911219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-87032984-fbb2-42cd-bb43-524f9ac983ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:43:59.911975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-87032984-fbb2-42cd-bb43-524f9ac983ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:43:59.918737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87032984-fbb2-42cd-bb43-524f9ac983ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:59.919203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87032984-fbb2-42cd-bb43-524f9ac983ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:43:59.920067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87032984-fbb2-42cd-bb43-524f9ac983ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:43:59.920557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-87032984-fbb2-42cd-bb43-524f9ac983ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:00.110297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-87032984-fbb2-42cd-bb43-524f9ac983ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:00.118317 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-87032984-fbb2-42cd-bb43-524f9ac983ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1691 microversion: 2.1 time: 0.211471 Mar 12 21:44:00.118899 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5394/6162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:43:59 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1691 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:01.136098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-70cd2996-640b-4869-ac20-f5c2f48465fa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:01.136718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-70cd2996-640b-4869-ac20-f5c2f48465fa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:01.143420 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70cd2996-640b-4869-ac20-f5c2f48465fa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:01.143884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70cd2996-640b-4869-ac20-f5c2f48465fa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:01.144662 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70cd2996-640b-4869-ac20-f5c2f48465fa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:01.145113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70cd2996-640b-4869-ac20-f5c2f48465fa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:01.278798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-70cd2996-640b-4869-ac20-f5c2f48465fa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:01.286082 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-70cd2996-640b-4869-ac20-f5c2f48465fa tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1691 microversion: 2.1 time: 0.154467 Mar 12 21:44:01.286656 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5395/6163] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:01 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:02.303457 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ed208d6f-ce01-4506-a200-2d5d9380e01a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:02.304142 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ed208d6f-ce01-4506-a200-2d5d9380e01a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:02.310883 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed208d6f-ce01-4506-a200-2d5d9380e01a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:02.311350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed208d6f-ce01-4506-a200-2d5d9380e01a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:02.312133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed208d6f-ce01-4506-a200-2d5d9380e01a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:02.312583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ed208d6f-ce01-4506-a200-2d5d9380e01a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:02.451618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ed208d6f-ce01-4506-a200-2d5d9380e01a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:02.459113 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ed208d6f-ce01-4506-a200-2d5d9380e01a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1691 microversion: 2.1 time: 0.159579 Mar 12 21:44:02.459698 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5396/6164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:02 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:03.476686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c3c663e2-53b8-4d14-bb09-5354cf1db9a8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:03.477384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c3c663e2-53b8-4d14-bb09-5354cf1db9a8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:03.484202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3c663e2-53b8-4d14-bb09-5354cf1db9a8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:03.484673 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3c663e2-53b8-4d14-bb09-5354cf1db9a8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:03.485454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3c663e2-53b8-4d14-bb09-5354cf1db9a8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:03.485948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c3c663e2-53b8-4d14-bb09-5354cf1db9a8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:03.628614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c3c663e2-53b8-4d14-bb09-5354cf1db9a8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:03.638709 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c3c663e2-53b8-4d14-bb09-5354cf1db9a8 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1691 microversion: 2.1 time: 0.166136 Mar 12 21:44:03.639302 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5397/6165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:03 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:04.656479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e435467e-4d24-4f90-8667-4abede2716df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:04.657183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e435467e-4d24-4f90-8667-4abede2716df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:04.664927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e435467e-4d24-4f90-8667-4abede2716df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:04.665396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e435467e-4d24-4f90-8667-4abede2716df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:04.666218 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e435467e-4d24-4f90-8667-4abede2716df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:04.666675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e435467e-4d24-4f90-8667-4abede2716df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:04.801685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e435467e-4d24-4f90-8667-4abede2716df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:04.809726 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e435467e-4d24-4f90-8667-4abede2716df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1691 microversion: 2.1 time: 0.157215 Mar 12 21:44:04.810398 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5398/6166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:04 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:05.828465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-33039e2b-f087-4757-933f-19e650c753c3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:05.829126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-33039e2b-f087-4757-933f-19e650c753c3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:05.835620 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33039e2b-f087-4757-933f-19e650c753c3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:05.836086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33039e2b-f087-4757-933f-19e650c753c3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:05.836874 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33039e2b-f087-4757-933f-19e650c753c3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:05.837329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-33039e2b-f087-4757-933f-19e650c753c3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:05.972901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-33039e2b-f087-4757-933f-19e650c753c3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:05.980227 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-33039e2b-f087-4757-933f-19e650c753c3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1691 microversion: 2.1 time: 0.156747 Mar 12 21:44:05.980799 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5399/6167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:05 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:06.996415 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-199dd575-f8a1-45dd-ab78-ac64ae13c5e1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:06.997077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-199dd575-f8a1-45dd-ab78-ac64ae13c5e1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:07.003858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-199dd575-f8a1-45dd-ab78-ac64ae13c5e1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:07.004324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-199dd575-f8a1-45dd-ab78-ac64ae13c5e1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:07.005097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-199dd575-f8a1-45dd-ab78-ac64ae13c5e1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:07.005551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-199dd575-f8a1-45dd-ab78-ac64ae13c5e1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:07.152915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-199dd575-f8a1-45dd-ab78-ac64ae13c5e1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:07.160223 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-199dd575-f8a1-45dd-ab78-ac64ae13c5e1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1691 microversion: 2.1 time: 0.167746 Mar 12 21:44:07.160798 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5400/6168] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:06 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:08.177549 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4da58c28-bbd9-4672-8d80-aeed7c6d80d4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:08.178234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4da58c28-bbd9-4672-8d80-aeed7c6d80d4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:08.184873 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da58c28-bbd9-4672-8d80-aeed7c6d80d4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:08.185347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da58c28-bbd9-4672-8d80-aeed7c6d80d4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:08.186194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da58c28-bbd9-4672-8d80-aeed7c6d80d4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:08.186645 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4da58c28-bbd9-4672-8d80-aeed7c6d80d4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:08.318193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4da58c28-bbd9-4672-8d80-aeed7c6d80d4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:08.326421 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4da58c28-bbd9-4672-8d80-aeed7c6d80d4 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1691 microversion: 2.1 time: 0.152913 Mar 12 21:44:08.327011 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5401/6169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:08 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:09.343512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1d1828c5-eab5-41ab-87d4-61edb10f4af1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:09.344157 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1d1828c5-eab5-41ab-87d4-61edb10f4af1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:09.351464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d1828c5-eab5-41ab-87d4-61edb10f4af1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:09.351936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d1828c5-eab5-41ab-87d4-61edb10f4af1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:09.352725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d1828c5-eab5-41ab-87d4-61edb10f4af1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:09.353184 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d1828c5-eab5-41ab-87d4-61edb10f4af1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:09.488944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1d1828c5-eab5-41ab-87d4-61edb10f4af1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:09.496339 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1d1828c5-eab5-41ab-87d4-61edb10f4af1 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1691 microversion: 2.1 time: 0.156754 Mar 12 21:44:09.496917 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5402/6170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:09 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:10.514093 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90070868-5e59-4189-9c76-2c66bd2ab0b5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:10.514797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90070868-5e59-4189-9c76-2c66bd2ab0b5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:10.521509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90070868-5e59-4189-9c76-2c66bd2ab0b5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:10.522036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90070868-5e59-4189-9c76-2c66bd2ab0b5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:10.522828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90070868-5e59-4189-9c76-2c66bd2ab0b5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:10.523284 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90070868-5e59-4189-9c76-2c66bd2ab0b5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:10.654015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90070868-5e59-4189-9c76-2c66bd2ab0b5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:10.661335 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90070868-5e59-4189-9c76-2c66bd2ab0b5 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1668 microversion: 2.1 time: 0.151220 Mar 12 21:44:10.661949 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5403/6171] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:10 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:11.749577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f8ed4c96-841d-4b95-ad88-5e086cd8e335 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:44:11.750534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f8ed4c96-841d-4b95-ad88-5e086cd8e335 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:11.757967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8ed4c96-841d-4b95-ad88-5e086cd8e335 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:11.758433 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8ed4c96-841d-4b95-ad88-5e086cd8e335 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:11.759206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8ed4c96-841d-4b95-ad88-5e086cd8e335 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:11.759656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f8ed4c96-841d-4b95-ad88-5e086cd8e335 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:11.808409 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f8ed4c96-841d-4b95-ad88-5e086cd8e335 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26/action" status: 200 len: 36172 microversion: 2.1 time: 0.062512 Mar 12 21:44:11.809240 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5404/6172] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:44:11 2022] POST /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26/action => generated 36172 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:44:11.820863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-841653d6-863f-41de-be5b-1d60edc16025 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:44:11.827712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-841653d6-863f-41de-be5b-1d60edc16025 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:11.828171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-841653d6-863f-41de-be5b-1d60edc16025 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:11.852104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-841653d6-863f-41de-be5b-1d60edc16025 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Going to try to start instance {{(pid=136302) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 12 21:44:11.892659 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-841653d6-863f-41de-be5b-1d60edc16025 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26/action" status: 202 len: 0 microversion: 2.1 time: 0.076121 Mar 12 21:44:11.893305 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5405/6173] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:44:11 2022] POST /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:44:11.902139 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7de33057-c1d7-46ff-a3bf-51dbba9dbb4f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:11.902861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7de33057-c1d7-46ff-a3bf-51dbba9dbb4f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:11.909336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7de33057-c1d7-46ff-a3bf-51dbba9dbb4f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:11.909836 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7de33057-c1d7-46ff-a3bf-51dbba9dbb4f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:11.910633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7de33057-c1d7-46ff-a3bf-51dbba9dbb4f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:11.911095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7de33057-c1d7-46ff-a3bf-51dbba9dbb4f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:12.057210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7de33057-c1d7-46ff-a3bf-51dbba9dbb4f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:12.064754 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7de33057-c1d7-46ff-a3bf-51dbba9dbb4f tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1677 microversion: 2.1 time: 0.167140 Mar 12 21:44:12.065349 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5406/6174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:11 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:13.082495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da785aef-2503-491b-a7ad-4ccc815776f6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:13.083174 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-da785aef-2503-491b-a7ad-4ccc815776f6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:13.090108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da785aef-2503-491b-a7ad-4ccc815776f6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:13.090582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da785aef-2503-491b-a7ad-4ccc815776f6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:13.091368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da785aef-2503-491b-a7ad-4ccc815776f6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:13.091827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-da785aef-2503-491b-a7ad-4ccc815776f6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:13.222768 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-da785aef-2503-491b-a7ad-4ccc815776f6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:13.230724 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da785aef-2503-491b-a7ad-4ccc815776f6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1681 microversion: 2.1 time: 0.152153 Mar 12 21:44:13.231301 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5407/6175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:13 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:37.423558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-08386eb4-c35c-4175-909c-cab62509d563 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:44:37.424500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-08386eb4-c35c-4175-909c-cab62509d563 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:37.431496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08386eb4-c35c-4175-909c-cab62509d563 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:37.431962 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08386eb4-c35c-4175-909c-cab62509d563 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:37.432740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08386eb4-c35c-4175-909c-cab62509d563 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:37.433190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-08386eb4-c35c-4175-909c-cab62509d563 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:37.486603 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-08386eb4-c35c-4175-909c-cab62509d563 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26/action" status: 200 len: 60739 microversion: 2.1 time: 0.066998 Mar 12 21:44:37.487251 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5408/6176] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:44:37 2022] POST /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26/action => generated 60739 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:44:44.824861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-734a43c1-c4fc-4d65-b754-3f5e68b2b574 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:44.825561 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-734a43c1-c4fc-4d65-b754-3f5e68b2b574 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:44.840797 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-734a43c1-c4fc-4d65-b754-3f5e68b2b574 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:44.841270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-734a43c1-c4fc-4d65-b754-3f5e68b2b574 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:44.842094 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-734a43c1-c4fc-4d65-b754-3f5e68b2b574 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:44.842554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-734a43c1-c4fc-4d65-b754-3f5e68b2b574 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:44.869260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-734a43c1-c4fc-4d65-b754-3f5e68b2b574 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:44:44.950957 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-734a43c1-c4fc-4d65-b754-3f5e68b2b574 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 204 len: 0 microversion: 2.1 time: 0.130561 Mar 12 21:44:44.954825 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5409/6177] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:44:44 2022] DELETE /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 21:44:45.019409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-aeaaea0b-5643-47a5-a274-2b8c43db6a11 req-7068efc0-11c6-49c9-b6c4-603665c4bdd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e91e12-9bc0-4ba8-9000-ffeeec888a26", "tag": "41b7b380-3918-43e3-af44-7df20c541d2a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:44:45.028919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aeaaea0b-5643-47a5-a274-2b8c43db6a11 req-7068efc0-11c6-49c9-b6c4-603665c4bdd2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:45.029386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-aeaaea0b-5643-47a5-a274-2b8c43db6a11 req-7068efc0-11c6-49c9-b6c4-603665c4bdd2 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:45.039742 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-aeaaea0b-5643-47a5-a274-2b8c43db6a11 req-7068efc0-11c6-49c9-b6c4-603665c4bdd2 service nova] Creating event network-changed:41b7b380-3918-43e3-af44-7df20c541d2a for instance b4e91e12-9bc0-4ba8-9000-ffeeec888a26 on nch2-master-1 Mar 12 21:44:45.044516 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-aeaaea0b-5643-47a5-a274-2b8c43db6a11 req-7068efc0-11c6-49c9-b6c4-603665c4bdd2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091011 Mar 12 21:44:45.045114 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5410/6178] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:44:45.050095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0afc109b-b0f1-49cc-8625-9b01100f3141 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:45.050810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0afc109b-b0f1-49cc-8625-9b01100f3141 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:45.065236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0afc109b-b0f1-49cc-8625-9b01100f3141 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:45.065737 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0afc109b-b0f1-49cc-8625-9b01100f3141 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:45.066567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0afc109b-b0f1-49cc-8625-9b01100f3141 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:45.067033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0afc109b-b0f1-49cc-8625-9b01100f3141 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:45.220301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0afc109b-b0f1-49cc-8625-9b01100f3141 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:45.228041 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0afc109b-b0f1-49cc-8625-9b01100f3141 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1687 microversion: 2.1 time: 0.181755 Mar 12 21:44:45.228682 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5411/6179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:45 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:44:46.245521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2b74f074-e971-4d5b-a4b6-7e6ec6cf602d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:46.246400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2b74f074-e971-4d5b-a4b6-7e6ec6cf602d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:46.253454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b74f074-e971-4d5b-a4b6-7e6ec6cf602d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:46.253967 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b74f074-e971-4d5b-a4b6-7e6ec6cf602d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:46.254760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b74f074-e971-4d5b-a4b6-7e6ec6cf602d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:46.255215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b74f074-e971-4d5b-a4b6-7e6ec6cf602d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:46.391017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2b74f074-e971-4d5b-a4b6-7e6ec6cf602d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:46.398377 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2b74f074-e971-4d5b-a4b6-7e6ec6cf602d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 200 len: 1568 microversion: 2.1 time: 0.157404 Mar 12 21:44:46.398956 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5412/6180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:46 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:46.898803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-d71c1367-4569-4772-a0b8-e636de10b3d3 req-d2639487-7746-4b9a-a509-0ed84a233928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e91e12-9bc0-4ba8-9000-ffeeec888a26", "name": "network-vif-deleted", "tag": "41b7b380-3918-43e3-af44-7df20c541d2a"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:44:46.908814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d71c1367-4569-4772-a0b8-e636de10b3d3 req-d2639487-7746-4b9a-a509-0ed84a233928 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:46.909487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-d71c1367-4569-4772-a0b8-e636de10b3d3 req-d2639487-7746-4b9a-a509-0ed84a233928 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:46.925260 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-d71c1367-4569-4772-a0b8-e636de10b3d3 req-d2639487-7746-4b9a-a509-0ed84a233928 service nova] Creating event network-vif-deleted:41b7b380-3918-43e3-af44-7df20c541d2a for instance b4e91e12-9bc0-4ba8-9000-ffeeec888a26 on nch2-master-1 Mar 12 21:44:46.930376 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-d71c1367-4569-4772-a0b8-e636de10b3d3 req-d2639487-7746-4b9a-a509-0ed84a233928 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035383 Mar 12 21:44:46.930980 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5413/6181] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:44:47.416477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8db41510-8b11-488d-8335-ef6952e3509e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:47.417124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8db41510-8b11-488d-8335-ef6952e3509e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: b4e91e12-9bc0-4ba8-9000-ffeeec888a26] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:47.423665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8db41510-8b11-488d-8335-ef6952e3509e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:47.424131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8db41510-8b11-488d-8335-ef6952e3509e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:47.424905 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8db41510-8b11-488d-8335-ef6952e3509e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:47.425356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8db41510-8b11-488d-8335-ef6952e3509e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:47.438152 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8db41510-8b11-488d-8335-ef6952e3509e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] HTTP exception thrown: Instance b4e91e12-9bc0-4ba8-9000-ffeeec888a26 could not be found. Mar 12 21:44:47.438746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8db41510-8b11-488d-8335-ef6952e3509e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Returning 404 to user: Instance b4e91e12-9bc0-4ba8-9000-ffeeec888a26 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:44:47.439566 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8db41510-8b11-488d-8335-ef6952e3509e tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26" status: 404 len: 111 microversion: 2.1 time: 0.027807 Mar 12 21:44:47.440114 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5414/6182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:47 2022] GET /compute/v2.1/servers/b4e91e12-9bc0-4ba8-9000-ffeeec888a26 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:44:50.750387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dc214130-1864-449a-979d-61f40cee892b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '.version_select at 0x7f6e36ea8550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:50.774937 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dc214130-1864-449a-979d-61f40cee892b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1899113407" status: 202 len: 0 microversion: 2.1 time: 0.028365 Mar 12 21:44:50.775686 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5415/6183] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Mar 12 21:44:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1899113407 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:44:50.803256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3ff83abe-4436-407c-8a5d-67333066f2dd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'create', calling method: .version_select at 0x7f6e34366790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-258936380"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:44:50.818553 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3ff83abe-4436-407c-8a5d-67333066f2dd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:44:50.824152 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3ff83abe-4436-407c-8a5d-67333066f2dd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:44:50.947495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3ff83abe-4436-407c-8a5d-67333066f2dd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:44:50.952597 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-3ff83abe-4436-407c-8a5d-67333066f2dd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:44:50.966631 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3ff83abe-4436-407c-8a5d-67333066f2dd tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.168085 Mar 12 21:44:50.967227 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5416/6184] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:44:50 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:56.843674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-773208654", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "networks": [{"uuid": "7867dbdb-7b7c-4cf2-9d3e-94644077b278"}], "key_name": "tempest-TestNetworkAdvancedServerOps-258936380", "security_groups": [{"name": "tempest-secgroup-smoke-379909433"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:44:56.950856 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] validate_networks() for [('7867dbdb-7b7c-4cf2-9d3e-94644077b278', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:44:57.430604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:44:57.432888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:44:57.433577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:44:57.434359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:44:57.434975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:44:57.448136 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:57.448602 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:57.449419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:57.449891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:57.468155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for project 00f655a3cb704a8d920c6d53068d448d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:44:57.474262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Getting quotas for user 233cb5515e73402581bfe580a54a4dd7 and project 00f655a3cb704a8d920c6d53068d448d. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:44:57.487892 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:44:57.490239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:44:57.539567 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-18793579-dd5e-4edf-a23b-6429c735cfff tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.700393 Mar 12 21:44:57.540220 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5417/6185] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:44:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:44:57.551563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-560b9666-9941-4107-815a-8e7dadacfd22 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:57.552183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-560b9666-9941-4107-815a-8e7dadacfd22 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:57.616166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-560b9666-9941-4107-815a-8e7dadacfd22 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:57.624809 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-560b9666-9941-4107-815a-8e7dadacfd22 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1265 microversion: 2.1 time: 0.078371 Mar 12 21:44:57.626559 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5418/6186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:57 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:44:58.645562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c873912-d8ab-401a-af0c-ad073a2943ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:58.646370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c873912-d8ab-401a-af0c-ad073a2943ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:58.656911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c873912-d8ab-401a-af0c-ad073a2943ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:58.657560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c873912-d8ab-401a-af0c-ad073a2943ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:58.658499 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c873912-d8ab-401a-af0c-ad073a2943ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:58.662948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c873912-d8ab-401a-af0c-ad073a2943ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:58.781666 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4c873912-d8ab-401a-af0c-ad073a2943ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:44:58.792062 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4c873912-d8ab-401a-af0c-ad073a2943ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1325 microversion: 2.1 time: 0.154632 Mar 12 21:44:58.793139 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5419/6187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:58 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1325 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:44:59.817471 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-853f9450-9b1e-4c4a-a0a2-692ce09eef76 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:44:59.818162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-853f9450-9b1e-4c4a-a0a2-692ce09eef76 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:44:59.825096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-853f9450-9b1e-4c4a-a0a2-692ce09eef76 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:59.826054 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-853f9450-9b1e-4c4a-a0a2-692ce09eef76 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:44:59.827342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-853f9450-9b1e-4c4a-a0a2-692ce09eef76 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:44:59.827965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-853f9450-9b1e-4c4a-a0a2-692ce09eef76 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:00.047813 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-853f9450-9b1e-4c4a-a0a2-692ce09eef76 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:45:00.057420 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-853f9450-9b1e-4c4a-a0a2-692ce09eef76 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1390 microversion: 2.1 time: 0.250666 Mar 12 21:45:00.058297 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5420/6188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:44:59 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1390 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:45:00.197245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-16f13367-bf61-46cf-a009-128c788cde19 req-5c3c0255-0aac-42fc-aa3f-421781a1dcf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4064142-b87d-48f9-92b0-df121f44692b", "tag": "0297c7b8-5f3a-4a30-a7c1-63fda28f472c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:45:00.206359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-16f13367-bf61-46cf-a009-128c788cde19 req-5c3c0255-0aac-42fc-aa3f-421781a1dcf7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:00.206576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-16f13367-bf61-46cf-a009-128c788cde19 req-5c3c0255-0aac-42fc-aa3f-421781a1dcf7 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:00.225256 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-16f13367-bf61-46cf-a009-128c788cde19 req-5c3c0255-0aac-42fc-aa3f-421781a1dcf7 service nova] Creating event network-changed:0297c7b8-5f3a-4a30-a7c1-63fda28f472c for instance a4064142-b87d-48f9-92b0-df121f44692b on nch1-master-1 Mar 12 21:45:00.230852 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-16f13367-bf61-46cf-a009-128c788cde19 req-5c3c0255-0aac-42fc-aa3f-421781a1dcf7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037920 Mar 12 21:45:00.231592 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5421/6189] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:45:01.076640 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1d9cb3e9-ba28-48c5-a15b-f45d470761ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:45:01.078135 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1d9cb3e9-ba28-48c5-a15b-f45d470761ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:45:01.084583 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d9cb3e9-ba28-48c5-a15b-f45d470761ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:01.085045 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d9cb3e9-ba28-48c5-a15b-f45d470761ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:01.085849 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d9cb3e9-ba28-48c5-a15b-f45d470761ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:01.086304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1d9cb3e9-ba28-48c5-a15b-f45d470761ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:01.220210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1d9cb3e9-ba28-48c5-a15b-f45d470761ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:45:01.227513 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1d9cb3e9-ba28-48c5-a15b-f45d470761ec tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1390 microversion: 2.1 time: 0.156551 Mar 12 21:45:01.228093 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5422/6190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:45:01 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:45:02.244220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9907a29a-b490-41a7-85f9-68317a91fc89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:45:02.245015 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9907a29a-b490-41a7-85f9-68317a91fc89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:45:02.251698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9907a29a-b490-41a7-85f9-68317a91fc89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:02.252166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9907a29a-b490-41a7-85f9-68317a91fc89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:02.252944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9907a29a-b490-41a7-85f9-68317a91fc89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:02.253397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9907a29a-b490-41a7-85f9-68317a91fc89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:02.392614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9907a29a-b490-41a7-85f9-68317a91fc89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:45:02.400560 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9907a29a-b490-41a7-85f9-68317a91fc89 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1390 microversion: 2.1 time: 0.159672 Mar 12 21:45:02.401155 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5423/6191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:45:02 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:45:03.418349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-370004bb-cd31-4337-8e96-e6e079eae7ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:45:03.418992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-370004bb-cd31-4337-8e96-e6e079eae7ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:45:03.425720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-370004bb-cd31-4337-8e96-e6e079eae7ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:03.426227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-370004bb-cd31-4337-8e96-e6e079eae7ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:03.427008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-370004bb-cd31-4337-8e96-e6e079eae7ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:03.427464 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-370004bb-cd31-4337-8e96-e6e079eae7ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:03.559086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-370004bb-cd31-4337-8e96-e6e079eae7ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:45:03.566432 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-370004bb-cd31-4337-8e96-e6e079eae7ef tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1390 microversion: 2.1 time: 0.152741 Mar 12 21:45:03.567013 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5424/6192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:45:03 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:45:04.583347 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-116d0e4e-d244-4f61-b346-27ff9a89a240 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:45:04.583983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-116d0e4e-d244-4f61-b346-27ff9a89a240 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:45:04.591911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-116d0e4e-d244-4f61-b346-27ff9a89a240 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:04.592391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-116d0e4e-d244-4f61-b346-27ff9a89a240 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:04.593193 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-116d0e4e-d244-4f61-b346-27ff9a89a240 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:04.593670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-116d0e4e-d244-4f61-b346-27ff9a89a240 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:04.739098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-116d0e4e-d244-4f61-b346-27ff9a89a240 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:45:04.747424 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-116d0e4e-d244-4f61-b346-27ff9a89a240 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1390 microversion: 2.1 time: 0.167988 Mar 12 21:45:04.748042 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5425/6193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:45:04 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:45:05.765316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d5f38386-b5d6-4bdb-9223-c654dd9daf54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:45:05.766016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d5f38386-b5d6-4bdb-9223-c654dd9daf54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:45:05.772805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5f38386-b5d6-4bdb-9223-c654dd9daf54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:05.773282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5f38386-b5d6-4bdb-9223-c654dd9daf54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:05.774100 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5f38386-b5d6-4bdb-9223-c654dd9daf54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:05.774564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d5f38386-b5d6-4bdb-9223-c654dd9daf54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:05.907190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d5f38386-b5d6-4bdb-9223-c654dd9daf54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:45:05.914882 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d5f38386-b5d6-4bdb-9223-c654dd9daf54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1390 microversion: 2.1 time: 0.153563 Mar 12 21:45:05.915458 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5426/6194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:45:05 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:45:06.713761 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-82819b25-20b4-4ecd-87d7-78d582dc6897 req-fe4a3216-3e23-41cf-891e-2fe4bfbba0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4064142-b87d-48f9-92b0-df121f44692b", "name": "network-vif-plugged", "status": "completed", "tag": "0297c7b8-5f3a-4a30-a7c1-63fda28f472c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:45:06.721923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-82819b25-20b4-4ecd-87d7-78d582dc6897 req-fe4a3216-3e23-41cf-891e-2fe4bfbba0a9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:06.722388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-82819b25-20b4-4ecd-87d7-78d582dc6897 req-fe4a3216-3e23-41cf-891e-2fe4bfbba0a9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:06.733434 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-82819b25-20b4-4ecd-87d7-78d582dc6897 req-fe4a3216-3e23-41cf-891e-2fe4bfbba0a9 service nova] Creating event network-vif-plugged:0297c7b8-5f3a-4a30-a7c1-63fda28f472c for instance a4064142-b87d-48f9-92b0-df121f44692b on nch1-master-1 Mar 12 21:45:06.738592 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-82819b25-20b4-4ecd-87d7-78d582dc6897 req-fe4a3216-3e23-41cf-891e-2fe4bfbba0a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089197 Mar 12 21:45:06.739178 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5427/6195] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:45:06.932460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-97199906-8b51-4117-937a-e3037718c578 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:45:06.933176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-97199906-8b51-4117-937a-e3037718c578 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:45:06.940240 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97199906-8b51-4117-937a-e3037718c578 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:06.940708 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97199906-8b51-4117-937a-e3037718c578 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:06.941487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97199906-8b51-4117-937a-e3037718c578 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:06.941966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-97199906-8b51-4117-937a-e3037718c578 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:07.075266 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-97199906-8b51-4117-937a-e3037718c578 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:45:07.082910 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-97199906-8b51-4117-937a-e3037718c578 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1390 microversion: 2.1 time: 0.154708 Mar 12 21:45:07.083480 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5428/6196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:45:06 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:45:08.100671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bbfa3c1b-0c7b-4bed-8cec-484fbb28e342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:45:08.101307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bbfa3c1b-0c7b-4bed-8cec-484fbb28e342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:45:08.108123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbfa3c1b-0c7b-4bed-8cec-484fbb28e342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:08.108596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbfa3c1b-0c7b-4bed-8cec-484fbb28e342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:08.109391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbfa3c1b-0c7b-4bed-8cec-484fbb28e342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:08.109868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bbfa3c1b-0c7b-4bed-8cec-484fbb28e342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:08.253431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bbfa3c1b-0c7b-4bed-8cec-484fbb28e342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:45:08.261211 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bbfa3c1b-0c7b-4bed-8cec-484fbb28e342 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1390 microversion: 2.1 time: 0.164589 Mar 12 21:45:08.261801 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5429/6197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:45:08 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:45:09.277685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-652a3aa3-5883-4bf1-bac6-15e4454f0282 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:45:09.278358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-652a3aa3-5883-4bf1-bac6-15e4454f0282 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:45:09.285201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-652a3aa3-5883-4bf1-bac6-15e4454f0282 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:09.285671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-652a3aa3-5883-4bf1-bac6-15e4454f0282 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:09.286746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-652a3aa3-5883-4bf1-bac6-15e4454f0282 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:09.287209 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-652a3aa3-5883-4bf1-bac6-15e4454f0282 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:09.419791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-652a3aa3-5883-4bf1-bac6-15e4454f0282 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:45:09.427053 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-652a3aa3-5883-4bf1-bac6-15e4454f0282 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1562 microversion: 2.1 time: 0.153300 Mar 12 21:45:09.427923 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5430/6198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:45:09 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:45:09.442859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8aa54f4b-9061-4b27-9dad-50db2ad41f54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:45:09.443478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8aa54f4b-9061-4b27-9dad-50db2ad41f54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:45:09.448965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8aa54f4b-9061-4b27-9dad-50db2ad41f54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:09.449430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8aa54f4b-9061-4b27-9dad-50db2ad41f54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:09.450245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8aa54f4b-9061-4b27-9dad-50db2ad41f54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:09.450701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8aa54f4b-9061-4b27-9dad-50db2ad41f54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:09.588680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8aa54f4b-9061-4b27-9dad-50db2ad41f54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:45:09.596242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8aa54f4b-9061-4b27-9dad-50db2ad41f54 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1562 microversion: 2.1 time: 0.157021 Mar 12 21:45:09.596818 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5431/6199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:45:09 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:45:11.182372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-75a99f76-5453-45a7-bfb1-497c26eec95d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:45:11.182992 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-75a99f76-5453-45a7-bfb1-497c26eec95d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:45:11.189554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75a99f76-5453-45a7-bfb1-497c26eec95d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:11.190051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75a99f76-5453-45a7-bfb1-497c26eec95d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:11.190842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75a99f76-5453-45a7-bfb1-497c26eec95d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:11.191295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-75a99f76-5453-45a7-bfb1-497c26eec95d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:11.338234 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-75a99f76-5453-45a7-bfb1-497c26eec95d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:45:11.345843 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-75a99f76-5453-45a7-bfb1-497c26eec95d tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1562 microversion: 2.1 time: 0.168123 Mar 12 21:45:11.355129 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5432/6200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:45:11 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:45:11.355129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-fd9d646a-e2cc-46d2-bfcc-7738ffd29562 req-98c01f74-046c-42ae-b92b-d9cf980b5c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4064142-b87d-48f9-92b0-df121f44692b", "tag": "0297c7b8-5f3a-4a30-a7c1-63fda28f472c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:45:11.359450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fd9d646a-e2cc-46d2-bfcc-7738ffd29562 req-98c01f74-046c-42ae-b92b-d9cf980b5c33 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:11.359921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-fd9d646a-e2cc-46d2-bfcc-7738ffd29562 req-98c01f74-046c-42ae-b92b-d9cf980b5c33 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:11.371486 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-fd9d646a-e2cc-46d2-bfcc-7738ffd29562 req-98c01f74-046c-42ae-b92b-d9cf980b5c33 service nova] Creating event network-changed:0297c7b8-5f3a-4a30-a7c1-63fda28f472c for instance a4064142-b87d-48f9-92b0-df121f44692b on nch1-master-1 Mar 12 21:45:11.376738 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-fd9d646a-e2cc-46d2-bfcc-7738ffd29562 req-98c01f74-046c-42ae-b92b-d9cf980b5c33 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029097 Mar 12 21:45:11.377851 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5433/6201] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:45:13.198963 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:45:13.199520 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:45:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:45:15.648891 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:45:15.649611 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:45:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:45:42.623632 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4e72f995-17f9-4dcc-a003-c6170c85d2a6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:45:42.624651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4e72f995-17f9-4dcc-a003-c6170c85d2a6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:45:42.630948 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e72f995-17f9-4dcc-a003-c6170c85d2a6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:42.631417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e72f995-17f9-4dcc-a003-c6170c85d2a6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:42.632203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e72f995-17f9-4dcc-a003-c6170c85d2a6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:45:42.632655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e72f995-17f9-4dcc-a003-c6170c85d2a6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:45:42.684844 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4e72f995-17f9-4dcc-a003-c6170c85d2a6 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b/action" status: 200 len: 24575 microversion: 2.1 time: 0.066464 Mar 12 21:45:42.685504 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5434/6202] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:45:42 2022] POST /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b/action => generated 24575 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:46:21.733727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85e372b0-2434-448d-a71c-9749a7b3aaba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:46:21.734421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85e372b0-2434-448d-a71c-9749a7b3aaba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:21.741409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85e372b0-2434-448d-a71c-9749a7b3aaba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:21.741894 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85e372b0-2434-448d-a71c-9749a7b3aaba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:21.742672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85e372b0-2434-448d-a71c-9749a7b3aaba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:21.743120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85e372b0-2434-448d-a71c-9749a7b3aaba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:21.766009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-85e372b0-2434-448d-a71c-9749a7b3aaba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lazy-loading 'flavor' on Instance uuid a4064142-b87d-48f9-92b0-df121f44692b {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:46:21.835204 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85e372b0-2434-448d-a71c-9749a7b3aaba tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b/action" status: 202 len: 0 microversion: 2.1 time: 0.105971 Mar 12 21:46:21.836221 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5435/6203] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:46:21 2022] POST /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:46:21.844995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-60fea900-9349-4c71-92ee-66c37d45dfc9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:21.845741 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-60fea900-9349-4c71-92ee-66c37d45dfc9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:21.852183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60fea900-9349-4c71-92ee-66c37d45dfc9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:21.852649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60fea900-9349-4c71-92ee-66c37d45dfc9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:21.853587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60fea900-9349-4c71-92ee-66c37d45dfc9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:21.854619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-60fea900-9349-4c71-92ee-66c37d45dfc9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:22.125533 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-60fea900-9349-4c71-92ee-66c37d45dfc9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:22.132975 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-60fea900-9349-4c71-92ee-66c37d45dfc9 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1689 microversion: 2.1 time: 0.292225 Mar 12 21:46:22.133561 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5436/6204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:21 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1689 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:23.151144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-47c3e46d-1233-463e-bbc8-c0c12557b1df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:23.151804 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-47c3e46d-1233-463e-bbc8-c0c12557b1df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:23.159042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47c3e46d-1233-463e-bbc8-c0c12557b1df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:23.159517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47c3e46d-1233-463e-bbc8-c0c12557b1df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:23.160309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47c3e46d-1233-463e-bbc8-c0c12557b1df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:23.161036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-47c3e46d-1233-463e-bbc8-c0c12557b1df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:23.295192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-47c3e46d-1233-463e-bbc8-c0c12557b1df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:23.302607 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-47c3e46d-1233-463e-bbc8-c0c12557b1df tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1689 microversion: 2.1 time: 0.156043 Mar 12 21:46:23.303192 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5437/6205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:23 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:24.320269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-63f4eed8-ffc8-4984-ba8d-177df726d78c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:24.320959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-63f4eed8-ffc8-4984-ba8d-177df726d78c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:24.328448 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63f4eed8-ffc8-4984-ba8d-177df726d78c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:24.328914 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63f4eed8-ffc8-4984-ba8d-177df726d78c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:24.329692 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63f4eed8-ffc8-4984-ba8d-177df726d78c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:24.330166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63f4eed8-ffc8-4984-ba8d-177df726d78c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:24.460933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-63f4eed8-ffc8-4984-ba8d-177df726d78c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:24.468318 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-63f4eed8-ffc8-4984-ba8d-177df726d78c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1672 microversion: 2.1 time: 0.152299 Mar 12 21:46:24.468894 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5438/6206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:24 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:25.557903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-297f671a-9fdb-43e2-ad47-cbb7c02a0087 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:46:25.558942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-297f671a-9fdb-43e2-ad47-cbb7c02a0087 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:25.565812 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-297f671a-9fdb-43e2-ad47-cbb7c02a0087 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:25.566295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-297f671a-9fdb-43e2-ad47-cbb7c02a0087 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:25.567088 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-297f671a-9fdb-43e2-ad47-cbb7c02a0087 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:25.567554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-297f671a-9fdb-43e2-ad47-cbb7c02a0087 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:25.617607 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-297f671a-9fdb-43e2-ad47-cbb7c02a0087 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b/action" status: 200 len: 38396 microversion: 2.1 time: 0.064186 Mar 12 21:46:25.618309 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5439/6207] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:46:25 2022] POST /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b/action => generated 38396 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 12 21:46:25.629516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-49ac9a49-e267-4509-9aef-680413191c96 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:46:25.630195 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-49ac9a49-e267-4509-9aef-680413191c96 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:25.637652 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49ac9a49-e267-4509-9aef-680413191c96 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:25.638162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49ac9a49-e267-4509-9aef-680413191c96 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:25.638951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49ac9a49-e267-4509-9aef-680413191c96 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:25.639417 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-49ac9a49-e267-4509-9aef-680413191c96 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:25.704211 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-49ac9a49-e267-4509-9aef-680413191c96 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b/action" status: 202 len: 0 microversion: 2.1 time: 0.078450 Mar 12 21:46:25.704910 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5440/6208] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:46:25 2022] POST /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:46:25.713712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4548891e-ac54-48e4-b8cc-442502b6e314 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:25.714462 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4548891e-ac54-48e4-b8cc-442502b6e314 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:25.721134 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4548891e-ac54-48e4-b8cc-442502b6e314 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:25.721600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4548891e-ac54-48e4-b8cc-442502b6e314 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:25.722428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4548891e-ac54-48e4-b8cc-442502b6e314 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:25.722964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4548891e-ac54-48e4-b8cc-442502b6e314 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:25.864307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4548891e-ac54-48e4-b8cc-442502b6e314 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:25.873161 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4548891e-ac54-48e4-b8cc-442502b6e314 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1678 microversion: 2.1 time: 0.163805 Mar 12 21:46:25.874158 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5441/6209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:25 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:46:26.890933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4d39c89a-34de-41a3-9749-c3225a7c9659 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:26.891573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4d39c89a-34de-41a3-9749-c3225a7c9659 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:26.898370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d39c89a-34de-41a3-9749-c3225a7c9659 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:26.898843 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d39c89a-34de-41a3-9749-c3225a7c9659 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:26.899617 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d39c89a-34de-41a3-9749-c3225a7c9659 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:26.900070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4d39c89a-34de-41a3-9749-c3225a7c9659 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:27.035158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4d39c89a-34de-41a3-9749-c3225a7c9659 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:27.043334 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4d39c89a-34de-41a3-9749-c3225a7c9659 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1678 microversion: 2.1 time: 0.156322 Mar 12 21:46:27.043910 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5442/6210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:26 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:28.061064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-506aca47-48bd-4132-8414-f56b1dd5bb1c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:28.061752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-506aca47-48bd-4132-8414-f56b1dd5bb1c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:28.068221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-506aca47-48bd-4132-8414-f56b1dd5bb1c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:28.068687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-506aca47-48bd-4132-8414-f56b1dd5bb1c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:28.069466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-506aca47-48bd-4132-8414-f56b1dd5bb1c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:28.069965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-506aca47-48bd-4132-8414-f56b1dd5bb1c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:28.206075 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-506aca47-48bd-4132-8414-f56b1dd5bb1c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:28.213484 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-506aca47-48bd-4132-8414-f56b1dd5bb1c tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1681 microversion: 2.1 time: 0.156909 Mar 12 21:46:28.214154 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5443/6211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:28 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:28.301035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c31b16d-610d-42b1-9bf8-8d8ce7cdd003 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:46:28.302017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c31b16d-610d-42b1-9bf8-8d8ce7cdd003 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:28.309389 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c31b16d-610d-42b1-9bf8-8d8ce7cdd003 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:28.310171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c31b16d-610d-42b1-9bf8-8d8ce7cdd003 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:28.310977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c31b16d-610d-42b1-9bf8-8d8ce7cdd003 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:28.311736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c31b16d-610d-42b1-9bf8-8d8ce7cdd003 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:28.350971 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c31b16d-610d-42b1-9bf8-8d8ce7cdd003 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "POST /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b/action" status: 200 len: 38396 microversion: 2.1 time: 0.053742 Mar 12 21:46:28.351912 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5444/6212] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:46:28 2022] POST /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b/action => generated 38396 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 12 21:46:29.634975 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e6993196-8827-4eb4-9684-c5cb578265f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:29.635736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e6993196-8827-4eb4-9684-c5cb578265f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:29.643479 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6993196-8827-4eb4-9684-c5cb578265f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:29.644011 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6993196-8827-4eb4-9684-c5cb578265f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:29.645177 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6993196-8827-4eb4-9684-c5cb578265f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:29.645325 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e6993196-8827-4eb4-9684-c5cb578265f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:29.672171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e6993196-8827-4eb4-9684-c5cb578265f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:46:29.747817 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e6993196-8827-4eb4-9684-c5cb578265f3 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 204 len: 0 microversion: 2.1 time: 0.117744 Mar 12 21:46:29.748343 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5445/6213] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:46:29 2022] DELETE /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:46:29.805414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-80307866-e0cc-4ecd-842e-5d25b9bd82e9 req-1ce5d631-cfe2-448e-85fb-da291ce98147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4064142-b87d-48f9-92b0-df121f44692b", "tag": "0297c7b8-5f3a-4a30-a7c1-63fda28f472c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:46:29.814114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-80307866-e0cc-4ecd-842e-5d25b9bd82e9 req-1ce5d631-cfe2-448e-85fb-da291ce98147 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:29.814572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-80307866-e0cc-4ecd-842e-5d25b9bd82e9 req-1ce5d631-cfe2-448e-85fb-da291ce98147 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:29.824627 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-80307866-e0cc-4ecd-842e-5d25b9bd82e9 req-1ce5d631-cfe2-448e-85fb-da291ce98147 service nova] Creating event network-changed:0297c7b8-5f3a-4a30-a7c1-63fda28f472c for instance a4064142-b87d-48f9-92b0-df121f44692b on nch1-master-1 Mar 12 21:46:29.829560 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-80307866-e0cc-4ecd-842e-5d25b9bd82e9 req-1ce5d631-cfe2-448e-85fb-da291ce98147 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079618 Mar 12 21:46:29.830352 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5446/6214] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:46:29.835523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c24c0360-e159-4849-9fd1-d804d0dec22b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:29.836224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c24c0360-e159-4849-9fd1-d804d0dec22b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:29.843995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c24c0360-e159-4849-9fd1-d804d0dec22b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:29.844612 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c24c0360-e159-4849-9fd1-d804d0dec22b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:29.845251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c24c0360-e159-4849-9fd1-d804d0dec22b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:29.845700 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c24c0360-e159-4849-9fd1-d804d0dec22b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:29.993159 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c24c0360-e159-4849-9fd1-d804d0dec22b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:30.001632 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c24c0360-e159-4849-9fd1-d804d0dec22b tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1687 microversion: 2.1 time: 0.170232 Mar 12 21:46:30.002414 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5447/6215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:29 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:46:31.019164 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5e1cc470-2a20-4a1b-b94f-9228673c5166 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:31.019841 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5e1cc470-2a20-4a1b-b94f-9228673c5166 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:31.026957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e1cc470-2a20-4a1b-b94f-9228673c5166 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:31.027430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e1cc470-2a20-4a1b-b94f-9228673c5166 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:31.028248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e1cc470-2a20-4a1b-b94f-9228673c5166 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:31.028702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5e1cc470-2a20-4a1b-b94f-9228673c5166 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:31.184377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5e1cc470-2a20-4a1b-b94f-9228673c5166 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:31.191788 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5e1cc470-2a20-4a1b-b94f-9228673c5166 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1568 microversion: 2.1 time: 0.176699 Mar 12 21:46:31.192362 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5448/6216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:31 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:32.009316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-637d9d1a-a156-4554-84dc-3ddf3fb5c185 req-b54ae236-1f92-4a22-9056-4a717ec90d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4064142-b87d-48f9-92b0-df121f44692b", "name": "network-vif-deleted", "tag": "0297c7b8-5f3a-4a30-a7c1-63fda28f472c"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:46:32.018368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-637d9d1a-a156-4554-84dc-3ddf3fb5c185 req-b54ae236-1f92-4a22-9056-4a717ec90d7f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:32.018832 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-637d9d1a-a156-4554-84dc-3ddf3fb5c185 req-b54ae236-1f92-4a22-9056-4a717ec90d7f service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:32.039037 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-637d9d1a-a156-4554-84dc-3ddf3fb5c185 req-b54ae236-1f92-4a22-9056-4a717ec90d7f service nova] Creating event network-vif-deleted:0297c7b8-5f3a-4a30-a7c1-63fda28f472c for instance a4064142-b87d-48f9-92b0-df121f44692b on nch1-master-1 Mar 12 21:46:32.044665 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-637d9d1a-a156-4554-84dc-3ddf3fb5c185 req-b54ae236-1f92-4a22-9056-4a717ec90d7f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039013 Mar 12 21:46:32.045288 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5449/6217] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:46:32.209103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-32626969-2e7d-4df9-8660-af66819daba7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:32.209719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-32626969-2e7d-4df9-8660-af66819daba7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:32.216530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32626969-2e7d-4df9-8660-af66819daba7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:32.216997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32626969-2e7d-4df9-8660-af66819daba7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:32.217827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32626969-2e7d-4df9-8660-af66819daba7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:32.218288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32626969-2e7d-4df9-8660-af66819daba7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:32.246560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32626969-2e7d-4df9-8660-af66819daba7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:32.247025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32626969-2e7d-4df9-8660-af66819daba7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:32.247489 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-32626969-2e7d-4df9-8660-af66819daba7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lazy-loading 'fault' on Instance uuid a4064142-b87d-48f9-92b0-df121f44692b {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:46:32.289217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-32626969-2e7d-4df9-8660-af66819daba7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233cb5515e73402581bfe580a54a4dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f655a3cb704a8d920c6d53068d448d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:32.297085 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-32626969-2e7d-4df9-8660-af66819daba7 tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 200 len: 1355 microversion: 2.1 time: 0.092351 Mar 12 21:46:32.297671 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5450/6218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:32 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 1355 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:33.313860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ba6a82b6-6f8b-4b44-a732-9594086d049a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:33.314526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ba6a82b6-6f8b-4b44-a732-9594086d049a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] [instance: a4064142-b87d-48f9-92b0-df121f44692b] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:33.321187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba6a82b6-6f8b-4b44-a732-9594086d049a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:33.321651 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba6a82b6-6f8b-4b44-a732-9594086d049a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:33.322455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba6a82b6-6f8b-4b44-a732-9594086d049a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:33.322910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ba6a82b6-6f8b-4b44-a732-9594086d049a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:33.335901 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-ba6a82b6-6f8b-4b44-a732-9594086d049a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] HTTP exception thrown: Instance a4064142-b87d-48f9-92b0-df121f44692b could not be found. Mar 12 21:46:33.336495 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ba6a82b6-6f8b-4b44-a732-9594086d049a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Returning 404 to user: Instance a4064142-b87d-48f9-92b0-df121f44692b could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:46:33.337317 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ba6a82b6-6f8b-4b44-a732-9594086d049a tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b" status: 404 len: 111 microversion: 2.1 time: 0.027420 Mar 12 21:46:33.338371 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5451/6219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:33 2022] GET /compute/v2.1/servers/a4064142-b87d-48f9-92b0-df121f44692b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:46:36.627080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-93c7299e-f91a-4487-8d22-b340e77e16ce tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] Calling method '.version_select at 0x7f6e3424a550>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:36.652921 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-93c7299e-f91a-4487-8d22-b340e77e16ce tempest-TestNetworkAdvancedServerOps-1546196446 tempest-TestNetworkAdvancedServerOps-1546196446-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-258936380" status: 202 len: 0 microversion: 2.1 time: 0.029600 Mar 12 21:46:36.653407 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5452/6220] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Mar 12 21:46:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-258936380 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:46:47.521376 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:46:47.522732 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:46:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:46:48.261954 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0e882558-954d-42c4-b40f-825f4089dcf3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Action: 'create', calling method: .version_select at 0x7f6e342eef70>, body: {"keypair": {"name": "tempest-TestShelveInstance-722642708"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:46:48.279436 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0e882558-954d-42c4-b40f-825f4089dcf3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Getting quotas for project fe4938aa90944ae7b17fbccaa7f8afe1. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:46:48.284630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0e882558-954d-42c4-b40f-825f4089dcf3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Getting quotas for user b5a0b91da24b4522b5556fb5797cffa1 and project fe4938aa90944ae7b17fbccaa7f8afe1. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:46:48.557359 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0e882558-954d-42c4-b40f-825f4089dcf3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Getting quotas for project fe4938aa90944ae7b17fbccaa7f8afe1. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:46:48.562429 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0e882558-954d-42c4-b40f-825f4089dcf3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Getting quotas for user b5a0b91da24b4522b5556fb5797cffa1 and project fe4938aa90944ae7b17fbccaa7f8afe1. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:46:48.576981 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0e882558-954d-42c4-b40f-825f4089dcf3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.523291 Mar 12 21:46:48.577600 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5453/6221] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:46:48 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:49.474769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1322375432", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-722642708", "security_groups": [{"name": "tempest-secgroup-smoke-382381914"}], "networks": [{"uuid": "200175a3-01d3-47dc-bd67-4843849240c3"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:46:49.580330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] validate_networks() for [('200175a3-01d3-47dc-bd67-4843849240c3', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:46:50.092141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:46:50.092578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:46:50.093120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:46:50.093490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:46:50.094014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:46:50.104300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:50.104764 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:50.105572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:50.106074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:50.122956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Getting quotas for project fe4938aa90944ae7b17fbccaa7f8afe1. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:46:50.128577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Getting quotas for user b5a0b91da24b4522b5556fb5797cffa1 and project fe4938aa90944ae7b17fbccaa7f8afe1. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:46:50.141670 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:46:50.144077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:46:50.194144 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b850a74f-b072-493b-a5a6-28b0f1d20303 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.723325 Mar 12 21:46:50.194809 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5454/6222] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:46:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:46:50.205199 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-167b384b-35ca-416b-9b6d-d70772bcc001 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:50.205958 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-167b384b-35ca-416b-9b6d-d70772bcc001 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:50.268579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-167b384b-35ca-416b-9b6d-d70772bcc001 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:50.275213 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-167b384b-35ca-416b-9b6d-d70772bcc001 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1246 microversion: 2.1 time: 0.074102 Mar 12 21:46:50.275975 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5455/6223] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:50 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1246 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:46:51.293458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ffdb1764-4ac9-45bf-9147-992279b859e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:51.295031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ffdb1764-4ac9-45bf-9147-992279b859e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:51.303530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffdb1764-4ac9-45bf-9147-992279b859e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:51.304268 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffdb1764-4ac9-45bf-9147-992279b859e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:51.305609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffdb1764-4ac9-45bf-9147-992279b859e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:51.306644 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ffdb1764-4ac9-45bf-9147-992279b859e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:51.385564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ffdb1764-4ac9-45bf-9147-992279b859e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:51.393521 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ffdb1764-4ac9-45bf-9147-992279b859e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1304 microversion: 2.1 time: 0.104731 Mar 12 21:46:51.394946 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5456/6224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:51 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:46:52.411148 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f852766-5bb9-45f0-a578-b1676a8c786c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:52.411890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f852766-5bb9-45f0-a578-b1676a8c786c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:52.419305 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f852766-5bb9-45f0-a578-b1676a8c786c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:52.419770 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f852766-5bb9-45f0-a578-b1676a8c786c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:52.420554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f852766-5bb9-45f0-a578-b1676a8c786c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:52.421008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f852766-5bb9-45f0-a578-b1676a8c786c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:52.571656 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f852766-5bb9-45f0-a578-b1676a8c786c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:52.579569 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f852766-5bb9-45f0-a578-b1676a8c786c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1371 microversion: 2.1 time: 0.172802 Mar 12 21:46:52.580721 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5457/6225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:52 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:52.805691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ed308892-ed1b-465d-9d4e-2191b9954f57 req-8c55c5f9-7e45-43eb-8b77-0e0e4ae7c99b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781f355e-1617-4871-9154-cea0652ef40d", "tag": "865df1be-c360-459d-8ca3-0334aa97bcb4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:46:52.816426 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ed308892-ed1b-465d-9d4e-2191b9954f57 req-8c55c5f9-7e45-43eb-8b77-0e0e4ae7c99b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:52.816810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ed308892-ed1b-465d-9d4e-2191b9954f57 req-8c55c5f9-7e45-43eb-8b77-0e0e4ae7c99b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:52.833115 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ed308892-ed1b-465d-9d4e-2191b9954f57 req-8c55c5f9-7e45-43eb-8b77-0e0e4ae7c99b service nova] Creating event network-changed:865df1be-c360-459d-8ca3-0334aa97bcb4 for instance 781f355e-1617-4871-9154-cea0652ef40d on nch1-master-1 Mar 12 21:46:52.839248 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ed308892-ed1b-465d-9d4e-2191b9954f57 req-8c55c5f9-7e45-43eb-8b77-0e0e4ae7c99b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098126 Mar 12 21:46:52.839873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5458/6226] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:46:53.598372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0a50ac29-3990-4faf-86b5-fed5c0d0b1cc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:53.599105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0a50ac29-3990-4faf-86b5-fed5c0d0b1cc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:53.606042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a50ac29-3990-4faf-86b5-fed5c0d0b1cc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:53.606514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a50ac29-3990-4faf-86b5-fed5c0d0b1cc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:53.607631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a50ac29-3990-4faf-86b5-fed5c0d0b1cc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:53.608336 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0a50ac29-3990-4faf-86b5-fed5c0d0b1cc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:53.746525 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0a50ac29-3990-4faf-86b5-fed5c0d0b1cc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:53.753978 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0a50ac29-3990-4faf-86b5-fed5c0d0b1cc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1371 microversion: 2.1 time: 0.161011 Mar 12 21:46:53.754573 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5459/6227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:53 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:54.770879 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a972f879-0f07-4131-93f2-b964a6a27b83 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:54.771573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a972f879-0f07-4131-93f2-b964a6a27b83 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:54.779259 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a972f879-0f07-4131-93f2-b964a6a27b83 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:54.779789 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a972f879-0f07-4131-93f2-b964a6a27b83 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:54.780584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a972f879-0f07-4131-93f2-b964a6a27b83 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:54.781035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a972f879-0f07-4131-93f2-b964a6a27b83 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:54.918114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a972f879-0f07-4131-93f2-b964a6a27b83 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:54.925590 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a972f879-0f07-4131-93f2-b964a6a27b83 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1371 microversion: 2.1 time: 0.158676 Mar 12 21:46:54.926210 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5460/6228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:54 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:55.942545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-20fc3c01-d83b-47c1-a985-c3bfadf3796c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:55.943197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-20fc3c01-d83b-47c1-a985-c3bfadf3796c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:55.950035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20fc3c01-d83b-47c1-a985-c3bfadf3796c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:55.950511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20fc3c01-d83b-47c1-a985-c3bfadf3796c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:55.951298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20fc3c01-d83b-47c1-a985-c3bfadf3796c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:55.951755 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-20fc3c01-d83b-47c1-a985-c3bfadf3796c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:56.084496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-20fc3c01-d83b-47c1-a985-c3bfadf3796c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:56.092332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-20fc3c01-d83b-47c1-a985-c3bfadf3796c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1371 microversion: 2.1 time: 0.153802 Mar 12 21:46:56.092913 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5461/6229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:55 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:57.108576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fead8276-8c3c-4dcb-9678-b271ae77fada tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:57.109239 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fead8276-8c3c-4dcb-9678-b271ae77fada tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:57.116175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fead8276-8c3c-4dcb-9678-b271ae77fada tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:57.116721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fead8276-8c3c-4dcb-9678-b271ae77fada tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:57.117381 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fead8276-8c3c-4dcb-9678-b271ae77fada tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:57.117868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fead8276-8c3c-4dcb-9678-b271ae77fada tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:57.263264 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fead8276-8c3c-4dcb-9678-b271ae77fada tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:57.270700 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fead8276-8c3c-4dcb-9678-b271ae77fada tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1371 microversion: 2.1 time: 0.166147 Mar 12 21:46:57.271268 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5462/6230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:57 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:58.288380 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ae732fef-63d0-4a32-abd3-503ef6fdc1da tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:58.289069 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ae732fef-63d0-4a32-abd3-503ef6fdc1da tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:58.296286 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae732fef-63d0-4a32-abd3-503ef6fdc1da tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:58.296758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae732fef-63d0-4a32-abd3-503ef6fdc1da tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:58.297544 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae732fef-63d0-4a32-abd3-503ef6fdc1da tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:58.298031 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ae732fef-63d0-4a32-abd3-503ef6fdc1da tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:58.434863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ae732fef-63d0-4a32-abd3-503ef6fdc1da tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:58.442131 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ae732fef-63d0-4a32-abd3-503ef6fdc1da tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1371 microversion: 2.1 time: 0.157871 Mar 12 21:46:58.442708 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5463/6231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:58 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:46:59.231779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0251135e-ba0a-45a3-8081-a3cd2cd608c9 req-d54c1987-b208-4a27-a495-e9c92fe61038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781f355e-1617-4871-9154-cea0652ef40d", "name": "network-vif-plugged", "status": "completed", "tag": "865df1be-c360-459d-8ca3-0334aa97bcb4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:46:59.239575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0251135e-ba0a-45a3-8081-a3cd2cd608c9 req-d54c1987-b208-4a27-a495-e9c92fe61038 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:59.240032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0251135e-ba0a-45a3-8081-a3cd2cd608c9 req-d54c1987-b208-4a27-a495-e9c92fe61038 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:59.251056 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0251135e-ba0a-45a3-8081-a3cd2cd608c9 req-d54c1987-b208-4a27-a495-e9c92fe61038 service nova] Creating event network-vif-plugged:865df1be-c360-459d-8ca3-0334aa97bcb4 for instance 781f355e-1617-4871-9154-cea0652ef40d on nch1-master-1 Mar 12 21:46:59.256023 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0251135e-ba0a-45a3-8081-a3cd2cd608c9 req-d54c1987-b208-4a27-a495-e9c92fe61038 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077065 Mar 12 21:46:59.256626 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5464/6232] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:46:59.460775 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4107f827-2011-4c28-aee9-dca240db854a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:46:59.461526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4107f827-2011-4c28-aee9-dca240db854a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:46:59.467725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4107f827-2011-4c28-aee9-dca240db854a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:59.468190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4107f827-2011-4c28-aee9-dca240db854a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:59.468977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4107f827-2011-4c28-aee9-dca240db854a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:46:59.469431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4107f827-2011-4c28-aee9-dca240db854a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:46:59.602278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4107f827-2011-4c28-aee9-dca240db854a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:46:59.610320 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4107f827-2011-4c28-aee9-dca240db854a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1371 microversion: 2.1 time: 0.154493 Mar 12 21:46:59.610842 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5465/6233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:46:59 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:47:00.626891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ff6de407-01cd-45ee-a110-901219744d6c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:47:00.627600 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ff6de407-01cd-45ee-a110-901219744d6c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:47:00.634864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff6de407-01cd-45ee-a110-901219744d6c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:47:00.635334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff6de407-01cd-45ee-a110-901219744d6c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:47:00.636124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff6de407-01cd-45ee-a110-901219744d6c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:47:00.636581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ff6de407-01cd-45ee-a110-901219744d6c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:47:00.777926 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ff6de407-01cd-45ee-a110-901219744d6c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:47:00.785545 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ff6de407-01cd-45ee-a110-901219744d6c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1371 microversion: 2.1 time: 0.162360 Mar 12 21:47:00.786147 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5466/6234] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:47:00 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:47:01.802098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-3189c9cb-9cc5-4c53-a5f3-68233fa9bcc8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:47:01.802750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-3189c9cb-9cc5-4c53-a5f3-68233fa9bcc8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:47:01.810085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3189c9cb-9cc5-4c53-a5f3-68233fa9bcc8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:47:01.810557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3189c9cb-9cc5-4c53-a5f3-68233fa9bcc8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:47:01.811343 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3189c9cb-9cc5-4c53-a5f3-68233fa9bcc8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:47:01.811808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-3189c9cb-9cc5-4c53-a5f3-68233fa9bcc8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:47:01.947290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-3189c9cb-9cc5-4c53-a5f3-68233fa9bcc8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:47:01.955091 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-3189c9cb-9cc5-4c53-a5f3-68233fa9bcc8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1555 microversion: 2.1 time: 0.156510 Mar 12 21:47:01.955666 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5467/6235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:47:01 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:47:01.971029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-53885717-3461-42c6-9786-52f2696c602b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:47:01.971648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-53885717-3461-42c6-9786-52f2696c602b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:47:01.977201 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53885717-3461-42c6-9786-52f2696c602b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:47:01.977672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53885717-3461-42c6-9786-52f2696c602b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:47:01.979103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53885717-3461-42c6-9786-52f2696c602b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:47:01.979557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53885717-3461-42c6-9786-52f2696c602b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:47:02.111515 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-53885717-3461-42c6-9786-52f2696c602b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:47:02.118869 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-53885717-3461-42c6-9786-52f2696c602b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1555 microversion: 2.1 time: 0.151382 Mar 12 21:47:02.119449 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5468/6236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:47:01 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:47:04.075087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-52377e78-3449-424c-aa10-81919e0dbbdc req-1d8d7aff-8b8a-4f5c-a9a2-4ed4c01ddcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781f355e-1617-4871-9154-cea0652ef40d", "tag": "865df1be-c360-459d-8ca3-0334aa97bcb4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:47:04.083793 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-52377e78-3449-424c-aa10-81919e0dbbdc req-1d8d7aff-8b8a-4f5c-a9a2-4ed4c01ddcb1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:47:04.084262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-52377e78-3449-424c-aa10-81919e0dbbdc req-1d8d7aff-8b8a-4f5c-a9a2-4ed4c01ddcb1 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:47:04.096003 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-52377e78-3449-424c-aa10-81919e0dbbdc req-1d8d7aff-8b8a-4f5c-a9a2-4ed4c01ddcb1 service nova] Creating event network-changed:865df1be-c360-459d-8ca3-0334aa97bcb4 for instance 781f355e-1617-4871-9154-cea0652ef40d on nch1-master-1 Mar 12 21:47:04.101203 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-52377e78-3449-424c-aa10-81919e0dbbdc req-1d8d7aff-8b8a-4f5c-a9a2-4ed4c01ddcb1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029958 Mar 12 21:47:04.101836 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5469/6237] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:48:33.206984 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:48:33.207558 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:48:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:48:35.656772 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:48:35.657416 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:48:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:49:30.198142 ncdv-master-1 devstack@n-api.service[136302]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b3a5e23-4d61-4ee0-b93f-1df1716bb266] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 12 21:49:30.198899 ncdv-master-1 devstack@n-api.service[136302]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6333ff2d-0072-4370-9794-f5297b7a2156] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 12 21:49:30.203270 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-89410b86-7ffe-4c4e-9c15-8582eb393d5b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:49:30.203919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-89410b86-7ffe-4c4e-9c15-8582eb393d5b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:30.212307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89410b86-7ffe-4c4e-9c15-8582eb393d5b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:30.212780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89410b86-7ffe-4c4e-9c15-8582eb393d5b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:30.213595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89410b86-7ffe-4c4e-9c15-8582eb393d5b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:30.214077 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-89410b86-7ffe-4c4e-9c15-8582eb393d5b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:30.239276 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-89410b86-7ffe-4c4e-9c15-8582eb393d5b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lazy-loading 'flavor' on Instance uuid 781f355e-1617-4871-9154-cea0652ef40d {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:49:30.492716 ncdv-master-1 devstack@n-api.service[136302]: ERROR oslo.messaging._drivers.impl_rabbit [None req-89410b86-7ffe-4c4e-9c15-8582eb393d5b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [d7081c79-78d0-46b0-b8c9-c7c47267849f] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 12 21:49:31.210026 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] [6333ff2d-0072-4370-9794-f5297b7a2156] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59602. Mar 12 21:49:31.214187 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b3a5e23-4d61-4ee0-b93f-1df1716bb266] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59600. Mar 12 21:49:31.499322 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [None req-89410b86-7ffe-4c4e-9c15-8582eb393d5b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [d7081c79-78d0-46b0-b8c9-c7c47267849f] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59604. Mar 12 21:49:31.502642 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-89410b86-7ffe-4c4e-9c15-8582eb393d5b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "POST /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d/action" status: 202 len: 0 microversion: 2.1 time: 1.307112 Mar 12 21:49:31.503430 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5470/6238] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:49:30 2022] POST /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d/action => generated 0 bytes in 1309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:49:31.513131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7ff6c434-65ab-474c-b106-7a5ee429a0b4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:31.513911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7ff6c434-65ab-474c-b106-7a5ee429a0b4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:31.523657 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ff6c434-65ab-474c-b106-7a5ee429a0b4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:31.524115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ff6c434-65ab-474c-b106-7a5ee429a0b4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:31.524928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ff6c434-65ab-474c-b106-7a5ee429a0b4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:31.525368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7ff6c434-65ab-474c-b106-7a5ee429a0b4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:31.677922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7ff6c434-65ab-474c-b106-7a5ee429a0b4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:31.685859 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7ff6c434-65ab-474c-b106-7a5ee429a0b4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.176781 Mar 12 21:49:31.686439 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5471/6239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:31 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:49:32.703751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-914c1a4b-b217-4681-9bab-e341fab03a59 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:32.704456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-914c1a4b-b217-4681-9bab-e341fab03a59 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:32.711038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-914c1a4b-b217-4681-9bab-e341fab03a59 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:32.711501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-914c1a4b-b217-4681-9bab-e341fab03a59 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:32.712306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-914c1a4b-b217-4681-9bab-e341fab03a59 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:32.712756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-914c1a4b-b217-4681-9bab-e341fab03a59 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:32.848167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-914c1a4b-b217-4681-9bab-e341fab03a59 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:32.856009 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-914c1a4b-b217-4681-9bab-e341fab03a59 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.156184 Mar 12 21:49:32.856585 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5472/6240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:32 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:33.872839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14f3d6b4-7d8c-4f8a-a815-6980830e3999 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:33.873483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14f3d6b4-7d8c-4f8a-a815-6980830e3999 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:33.880233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14f3d6b4-7d8c-4f8a-a815-6980830e3999 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:33.880702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14f3d6b4-7d8c-4f8a-a815-6980830e3999 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:33.881480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14f3d6b4-7d8c-4f8a-a815-6980830e3999 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:33.881965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14f3d6b4-7d8c-4f8a-a815-6980830e3999 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:34.014113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14f3d6b4-7d8c-4f8a-a815-6980830e3999 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:34.021493 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14f3d6b4-7d8c-4f8a-a815-6980830e3999 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.152577 Mar 12 21:49:34.022095 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5473/6241] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:33 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:35.040727 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d641345e-a72a-4a76-b6a5-2b9bf781c7e4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:35.041889 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d641345e-a72a-4a76-b6a5-2b9bf781c7e4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:35.050273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d641345e-a72a-4a76-b6a5-2b9bf781c7e4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:35.050749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d641345e-a72a-4a76-b6a5-2b9bf781c7e4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:35.051592 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d641345e-a72a-4a76-b6a5-2b9bf781c7e4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:35.052060 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d641345e-a72a-4a76-b6a5-2b9bf781c7e4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:35.187717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d641345e-a72a-4a76-b6a5-2b9bf781c7e4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:35.195124 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d641345e-a72a-4a76-b6a5-2b9bf781c7e4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.159247 Mar 12 21:49:35.195714 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5474/6242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:35 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:36.212867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-25af03cc-220e-41e2-a4e0-f235105137fc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:36.213551 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-25af03cc-220e-41e2-a4e0-f235105137fc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:36.220469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25af03cc-220e-41e2-a4e0-f235105137fc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:36.220952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25af03cc-220e-41e2-a4e0-f235105137fc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:36.221750 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25af03cc-220e-41e2-a4e0-f235105137fc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:36.222233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-25af03cc-220e-41e2-a4e0-f235105137fc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:36.353248 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-25af03cc-220e-41e2-a4e0-f235105137fc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:36.360621 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-25af03cc-220e-41e2-a4e0-f235105137fc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.152087 Mar 12 21:49:36.361205 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5475/6243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:36 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:37.378369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-76133f1a-504b-482a-bfa5-695088731179 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:37.379046 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-76133f1a-504b-482a-bfa5-695088731179 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:37.387582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76133f1a-504b-482a-bfa5-695088731179 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:37.388028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76133f1a-504b-482a-bfa5-695088731179 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:37.388816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76133f1a-504b-482a-bfa5-695088731179 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:37.389267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-76133f1a-504b-482a-bfa5-695088731179 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:37.525333 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-76133f1a-504b-482a-bfa5-695088731179 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:37.532626 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-76133f1a-504b-482a-bfa5-695088731179 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.158344 Mar 12 21:49:37.533473 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5476/6244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:37 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:38.550023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f0ed0492-035f-4bd4-84ad-e2a6d406248d tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:38.550720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f0ed0492-035f-4bd4-84ad-e2a6d406248d tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:38.557978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0ed0492-035f-4bd4-84ad-e2a6d406248d tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:38.558449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0ed0492-035f-4bd4-84ad-e2a6d406248d tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:38.559231 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0ed0492-035f-4bd4-84ad-e2a6d406248d tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:38.559691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f0ed0492-035f-4bd4-84ad-e2a6d406248d tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:38.690798 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f0ed0492-035f-4bd4-84ad-e2a6d406248d tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:38.698227 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f0ed0492-035f-4bd4-84ad-e2a6d406248d tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.152146 Mar 12 21:49:38.698813 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5477/6245] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:38 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:39.715845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-337d09ff-c19c-4a55-b6b1-82efc09605cb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:39.716589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-337d09ff-c19c-4a55-b6b1-82efc09605cb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:39.723215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-337d09ff-c19c-4a55-b6b1-82efc09605cb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:39.723674 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-337d09ff-c19c-4a55-b6b1-82efc09605cb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:39.724449 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-337d09ff-c19c-4a55-b6b1-82efc09605cb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:39.724902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-337d09ff-c19c-4a55-b6b1-82efc09605cb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:39.864461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-337d09ff-c19c-4a55-b6b1-82efc09605cb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:39.872148 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-337d09ff-c19c-4a55-b6b1-82efc09605cb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.160186 Mar 12 21:49:39.872741 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5478/6246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:39 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:40.889370 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f89109de-2ea3-4236-98a8-3e05e4084684 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:40.890030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f89109de-2ea3-4236-98a8-3e05e4084684 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:40.896922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f89109de-2ea3-4236-98a8-3e05e4084684 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:40.897414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f89109de-2ea3-4236-98a8-3e05e4084684 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:40.898232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f89109de-2ea3-4236-98a8-3e05e4084684 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:40.898725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f89109de-2ea3-4236-98a8-3e05e4084684 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:41.030080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f89109de-2ea3-4236-98a8-3e05e4084684 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:41.037695 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f89109de-2ea3-4236-98a8-3e05e4084684 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.152282 Mar 12 21:49:41.038298 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5479/6247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:40 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:42.055327 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f3c146c5-9ef2-4713-8313-459bd8a26b20 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:42.056211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f3c146c5-9ef2-4713-8313-459bd8a26b20 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:42.063127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3c146c5-9ef2-4713-8313-459bd8a26b20 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:42.063598 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3c146c5-9ef2-4713-8313-459bd8a26b20 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:42.064392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3c146c5-9ef2-4713-8313-459bd8a26b20 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:42.064847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f3c146c5-9ef2-4713-8313-459bd8a26b20 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:42.196683 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f3c146c5-9ef2-4713-8313-459bd8a26b20 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:42.204005 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f3c146c5-9ef2-4713-8313-459bd8a26b20 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.152784 Mar 12 21:49:42.204585 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5480/6248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:42 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:43.221299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-056f530a-fb19-4ec8-bf11-abf7729e9ce2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:43.221979 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-056f530a-fb19-4ec8-bf11-abf7729e9ce2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:43.229171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-056f530a-fb19-4ec8-bf11-abf7729e9ce2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:43.229638 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-056f530a-fb19-4ec8-bf11-abf7729e9ce2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:43.230450 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-056f530a-fb19-4ec8-bf11-abf7729e9ce2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:43.230907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-056f530a-fb19-4ec8-bf11-abf7729e9ce2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:43.367915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-056f530a-fb19-4ec8-bf11-abf7729e9ce2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:43.375375 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-056f530a-fb19-4ec8-bf11-abf7729e9ce2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.158154 Mar 12 21:49:43.375960 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5481/6249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:43 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:44.392496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4cc8f94e-1f94-4925-9dae-17927a0ab390 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:44.393182 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4cc8f94e-1f94-4925-9dae-17927a0ab390 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:44.399897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cc8f94e-1f94-4925-9dae-17927a0ab390 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:44.400367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cc8f94e-1f94-4925-9dae-17927a0ab390 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:44.401151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cc8f94e-1f94-4925-9dae-17927a0ab390 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:44.401604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4cc8f94e-1f94-4925-9dae-17927a0ab390 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:44.534639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4cc8f94e-1f94-4925-9dae-17927a0ab390 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:44.542761 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4cc8f94e-1f94-4925-9dae-17927a0ab390 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.154188 Mar 12 21:49:44.543346 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5482/6250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:44 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:45.125404 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:49:45.125663 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 21:49:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 21:49:45.217797 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:49:45.218000 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 21:49:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 21:49:45.560400 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-63338a02-c0f4-4ae8-bad2-bf070618253b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:45.561105 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-63338a02-c0f4-4ae8-bad2-bf070618253b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:45.568291 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63338a02-c0f4-4ae8-bad2-bf070618253b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:45.568756 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63338a02-c0f4-4ae8-bad2-bf070618253b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:45.569541 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63338a02-c0f4-4ae8-bad2-bf070618253b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:45.570024 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-63338a02-c0f4-4ae8-bad2-bf070618253b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:45.705183 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-63338a02-c0f4-4ae8-bad2-bf070618253b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:45.713088 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-63338a02-c0f4-4ae8-bad2-bf070618253b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.156663 Mar 12 21:49:45.713666 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5483/6251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:45 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:46.730799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85a83ed0-fb2d-4125-89da-bc6eb756f455 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:46.731514 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85a83ed0-fb2d-4125-89da-bc6eb756f455 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:46.738361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85a83ed0-fb2d-4125-89da-bc6eb756f455 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:46.738839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85a83ed0-fb2d-4125-89da-bc6eb756f455 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:46.739633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85a83ed0-fb2d-4125-89da-bc6eb756f455 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:46.740190 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85a83ed0-fb2d-4125-89da-bc6eb756f455 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:46.874461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-85a83ed0-fb2d-4125-89da-bc6eb756f455 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:46.881989 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85a83ed0-fb2d-4125-89da-bc6eb756f455 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.155692 Mar 12 21:49:46.882596 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5484/6252] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:46 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:47.898981 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0e81fdcd-fb03-4058-8223-d43b0f6e678f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:47.899606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0e81fdcd-fb03-4058-8223-d43b0f6e678f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:47.906257 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e81fdcd-fb03-4058-8223-d43b0f6e678f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:47.906721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e81fdcd-fb03-4058-8223-d43b0f6e678f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:47.907516 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e81fdcd-fb03-4058-8223-d43b0f6e678f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:47.908227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0e81fdcd-fb03-4058-8223-d43b0f6e678f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:48.039158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0e81fdcd-fb03-4058-8223-d43b0f6e678f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:48.046567 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0e81fdcd-fb03-4058-8223-d43b0f6e678f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1700 microversion: 2.1 time: 0.151487 Mar 12 21:49:48.047164 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5485/6253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:47 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1700 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:49.064512 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bd23d463-06b3-44be-aafc-8f25c6d43295 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:49.065166 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bd23d463-06b3-44be-aafc-8f25c6d43295 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:49.071916 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd23d463-06b3-44be-aafc-8f25c6d43295 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:49.072385 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd23d463-06b3-44be-aafc-8f25c6d43295 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:49.073175 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd23d463-06b3-44be-aafc-8f25c6d43295 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:49.073626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bd23d463-06b3-44be-aafc-8f25c6d43295 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:49.208570 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bd23d463-06b3-44be-aafc-8f25c6d43295 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:49.216009 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bd23d463-06b3-44be-aafc-8f25c6d43295 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1700 microversion: 2.1 time: 0.155448 Mar 12 21:49:49.216578 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5486/6254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:49 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:50.233882 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90c71d45-daa2-415f-8e33-cd757617bb5c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:50.234548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90c71d45-daa2-415f-8e33-cd757617bb5c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:50.241101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90c71d45-daa2-415f-8e33-cd757617bb5c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:50.241571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90c71d45-daa2-415f-8e33-cd757617bb5c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:50.242383 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90c71d45-daa2-415f-8e33-cd757617bb5c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:50.242840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90c71d45-daa2-415f-8e33-cd757617bb5c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:50.373090 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-90c71d45-daa2-415f-8e33-cd757617bb5c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:50.380525 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90c71d45-daa2-415f-8e33-cd757617bb5c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1700 microversion: 2.1 time: 0.150980 Mar 12 21:49:50.381101 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5487/6255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:50 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1700 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:51.397338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c17629ff-5ee6-49cc-9f2e-115d0d44de28 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:51.397997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c17629ff-5ee6-49cc-9f2e-115d0d44de28 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:51.405287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c17629ff-5ee6-49cc-9f2e-115d0d44de28 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:51.405754 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c17629ff-5ee6-49cc-9f2e-115d0d44de28 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:51.406589 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c17629ff-5ee6-49cc-9f2e-115d0d44de28 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:51.407047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c17629ff-5ee6-49cc-9f2e-115d0d44de28 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:51.543145 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c17629ff-5ee6-49cc-9f2e-115d0d44de28 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:51.550448 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c17629ff-5ee6-49cc-9f2e-115d0d44de28 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1700 microversion: 2.1 time: 0.157048 Mar 12 21:49:51.551022 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5488/6256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:51 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1700 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:52.077372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-de5d2cbb-5071-4aff-b655-3a9b018d3eaa req-02853db0-9f10-4aa6-b4a9-137642aca24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781f355e-1617-4871-9154-cea0652ef40d", "name": "network-vif-plugged", "status": "completed", "tag": "865df1be-c360-459d-8ca3-0334aa97bcb4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:49:52.087051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-de5d2cbb-5071-4aff-b655-3a9b018d3eaa req-02853db0-9f10-4aa6-b4a9-137642aca24b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:52.087523 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-de5d2cbb-5071-4aff-b655-3a9b018d3eaa req-02853db0-9f10-4aa6-b4a9-137642aca24b service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:52.099468 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-de5d2cbb-5071-4aff-b655-3a9b018d3eaa req-02853db0-9f10-4aa6-b4a9-137642aca24b service nova] Creating event network-vif-plugged:865df1be-c360-459d-8ca3-0334aa97bcb4 for instance 781f355e-1617-4871-9154-cea0652ef40d on nch1-master-1 Mar 12 21:49:52.105291 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-de5d2cbb-5071-4aff-b655-3a9b018d3eaa req-02853db0-9f10-4aa6-b4a9-137642aca24b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031471 Mar 12 21:49:52.106255 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5489/6257] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:49:52.569575 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-85072f50-e62f-47f1-8e7d-cadf28d7d8cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:52.570907 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-85072f50-e62f-47f1-8e7d-cadf28d7d8cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:52.577114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85072f50-e62f-47f1-8e7d-cadf28d7d8cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:52.577591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85072f50-e62f-47f1-8e7d-cadf28d7d8cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:52.578409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85072f50-e62f-47f1-8e7d-cadf28d7d8cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:52.578867 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-85072f50-e62f-47f1-8e7d-cadf28d7d8cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:52.716888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-85072f50-e62f-47f1-8e7d-cadf28d7d8cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:52.724365 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-85072f50-e62f-47f1-8e7d-cadf28d7d8cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1700 microversion: 2.1 time: 0.159925 Mar 12 21:49:52.725066 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5490/6258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:52 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:53.742027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-faf148f3-9b97-40f9-b253-c3038d9eedf4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:53.742660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-faf148f3-9b97-40f9-b253-c3038d9eedf4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:53.749258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-faf148f3-9b97-40f9-b253-c3038d9eedf4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:53.749724 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-faf148f3-9b97-40f9-b253-c3038d9eedf4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:53.750529 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-faf148f3-9b97-40f9-b253-c3038d9eedf4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:53.750980 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-faf148f3-9b97-40f9-b253-c3038d9eedf4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:53.901016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-faf148f3-9b97-40f9-b253-c3038d9eedf4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:53.909234 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-faf148f3-9b97-40f9-b253-c3038d9eedf4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1695 microversion: 2.1 time: 0.171124 Mar 12 21:49:53.909838 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5491/6259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:53 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:54.926625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eb640fdc-5770-4eb3-8b02-675d7497ea7b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:54.927983 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eb640fdc-5770-4eb3-8b02-675d7497ea7b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:54.935129 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb640fdc-5770-4eb3-8b02-675d7497ea7b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:54.935599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb640fdc-5770-4eb3-8b02-675d7497ea7b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:54.936521 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb640fdc-5770-4eb3-8b02-675d7497ea7b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:54.936982 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eb640fdc-5770-4eb3-8b02-675d7497ea7b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:55.104778 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eb640fdc-5770-4eb3-8b02-675d7497ea7b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:55.115454 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eb640fdc-5770-4eb3-8b02-675d7497ea7b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1695 microversion: 2.1 time: 0.193000 Mar 12 21:49:55.116192 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5492/6260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:54 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:56.133631 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-72981336-6611-476f-ab3f-6d75ee78005e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:56.135316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-72981336-6611-476f-ab3f-6d75ee78005e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:56.142511 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72981336-6611-476f-ab3f-6d75ee78005e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:56.143283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72981336-6611-476f-ab3f-6d75ee78005e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:56.144080 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72981336-6611-476f-ab3f-6d75ee78005e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:56.144532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-72981336-6611-476f-ab3f-6d75ee78005e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:56.292125 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-72981336-6611-476f-ab3f-6d75ee78005e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:56.300119 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-72981336-6611-476f-ab3f-6d75ee78005e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1695 microversion: 2.1 time: 0.171063 Mar 12 21:49:56.300729 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5493/6261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:56 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:57.317073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-691b8962-07e8-4c69-8c46-fa10a81f1994 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:57.317922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-691b8962-07e8-4c69-8c46-fa10a81f1994 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:57.329828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-691b8962-07e8-4c69-8c46-fa10a81f1994 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:57.329828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-691b8962-07e8-4c69-8c46-fa10a81f1994 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:57.329828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-691b8962-07e8-4c69-8c46-fa10a81f1994 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:57.329828 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-691b8962-07e8-4c69-8c46-fa10a81f1994 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:57.487351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-691b8962-07e8-4c69-8c46-fa10a81f1994 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:57.495488 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-691b8962-07e8-4c69-8c46-fa10a81f1994 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1695 microversion: 2.1 time: 0.182461 Mar 12 21:49:57.496116 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5494/6262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:57 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:49:58.516314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2b0860af-8757-4fbc-85d3-c1c600eb0dd1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:58.516314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2b0860af-8757-4fbc-85d3-c1c600eb0dd1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:58.521351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b0860af-8757-4fbc-85d3-c1c600eb0dd1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:58.521866 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b0860af-8757-4fbc-85d3-c1c600eb0dd1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:58.522665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b0860af-8757-4fbc-85d3-c1c600eb0dd1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:58.523733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2b0860af-8757-4fbc-85d3-c1c600eb0dd1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:58.676842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2b0860af-8757-4fbc-85d3-c1c600eb0dd1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:58.686337 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2b0860af-8757-4fbc-85d3-c1c600eb0dd1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1695 microversion: 2.1 time: 0.176391 Mar 12 21:49:58.687091 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5495/6263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:58 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:49:59.705101 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d05be78-3654-419a-b1ec-fb8b954ae8ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:49:59.706671 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0d05be78-3654-419a-b1ec-fb8b954ae8ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:49:59.714707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d05be78-3654-419a-b1ec-fb8b954ae8ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:59.715476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d05be78-3654-419a-b1ec-fb8b954ae8ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:59.716283 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d05be78-3654-419a-b1ec-fb8b954ae8ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:49:59.716844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d05be78-3654-419a-b1ec-fb8b954ae8ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:49:59.899133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0d05be78-3654-419a-b1ec-fb8b954ae8ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:49:59.908187 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d05be78-3654-419a-b1ec-fb8b954ae8ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1695 microversion: 2.1 time: 0.208105 Mar 12 21:49:59.908798 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5496/6264] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:49:59 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1695 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:00.926973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-637c0ae4-cc0a-4240-b351-a45b9a4b661a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:00.927854 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-637c0ae4-cc0a-4240-b351-a45b9a4b661a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:00.934848 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-637c0ae4-cc0a-4240-b351-a45b9a4b661a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:00.935397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-637c0ae4-cc0a-4240-b351-a45b9a4b661a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:00.936475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-637c0ae4-cc0a-4240-b351-a45b9a4b661a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:00.937033 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-637c0ae4-cc0a-4240-b351-a45b9a4b661a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:01.087349 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-637c0ae4-cc0a-4240-b351-a45b9a4b661a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:01.095273 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-637c0ae4-cc0a-4240-b351-a45b9a4b661a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1695 microversion: 2.1 time: 0.172710 Mar 12 21:50:01.096448 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5497/6265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:00 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:02.113353 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-32c45f2c-bb87-4630-bea8-d89658491fef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:02.115000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-32c45f2c-bb87-4630-bea8-d89658491fef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:02.122250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32c45f2c-bb87-4630-bea8-d89658491fef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:02.122721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32c45f2c-bb87-4630-bea8-d89658491fef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:02.123519 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32c45f2c-bb87-4630-bea8-d89658491fef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:02.123976 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-32c45f2c-bb87-4630-bea8-d89658491fef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:02.264374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-32c45f2c-bb87-4630-bea8-d89658491fef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:02.272435 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-32c45f2c-bb87-4630-bea8-d89658491fef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1695 microversion: 2.1 time: 0.163507 Mar 12 21:50:02.273963 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5498/6266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:02 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:50:03.290815 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0eb41b1e-17d5-4aa8-b353-b141e88e95a9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:03.291475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0eb41b1e-17d5-4aa8-b353-b141e88e95a9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:03.298238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0eb41b1e-17d5-4aa8-b353-b141e88e95a9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:03.298880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0eb41b1e-17d5-4aa8-b353-b141e88e95a9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:03.299822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0eb41b1e-17d5-4aa8-b353-b141e88e95a9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:03.300334 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0eb41b1e-17d5-4aa8-b353-b141e88e95a9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:03.438739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0eb41b1e-17d5-4aa8-b353-b141e88e95a9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:03.446760 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0eb41b1e-17d5-4aa8-b353-b141e88e95a9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1677 microversion: 2.1 time: 0.159874 Mar 12 21:50:03.447352 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5499/6267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:03 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:04.464296 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-19488a6c-d03d-4489-b51a-b5894895bf4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:04.464946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19488a6c-d03d-4489-b51a-b5894895bf4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:04.471781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19488a6c-d03d-4489-b51a-b5894895bf4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:04.472251 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19488a6c-d03d-4489-b51a-b5894895bf4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:04.473048 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19488a6c-d03d-4489-b51a-b5894895bf4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:04.473504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19488a6c-d03d-4489-b51a-b5894895bf4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:04.614655 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-19488a6c-d03d-4489-b51a-b5894895bf4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:04.622117 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-19488a6c-d03d-4489-b51a-b5894895bf4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1677 microversion: 2.1 time: 0.162353 Mar 12 21:50:04.622697 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5500/6268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:04 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:05.639278 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a3350257-ba5d-4ccb-ac0a-84b6ed264f23 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:05.640110 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a3350257-ba5d-4ccb-ac0a-84b6ed264f23 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:05.646974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3350257-ba5d-4ccb-ac0a-84b6ed264f23 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:05.647441 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3350257-ba5d-4ccb-ac0a-84b6ed264f23 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:05.648808 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3350257-ba5d-4ccb-ac0a-84b6ed264f23 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:05.649265 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a3350257-ba5d-4ccb-ac0a-84b6ed264f23 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:05.786140 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a3350257-ba5d-4ccb-ac0a-84b6ed264f23 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:05.793546 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a3350257-ba5d-4ccb-ac0a-84b6ed264f23 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1680 microversion: 2.1 time: 0.158267 Mar 12 21:50:05.794155 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5501/6269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:05 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:50:05.809461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-56fa84ac-b703-4abd-9fca-cee8209ea864 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:50:05.810066 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-56fa84ac-b703-4abd-9fca-cee8209ea864 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:05.815769 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56fa84ac-b703-4abd-9fca-cee8209ea864 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:05.816235 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56fa84ac-b703-4abd-9fca-cee8209ea864 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:05.817023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56fa84ac-b703-4abd-9fca-cee8209ea864 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:05.817476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-56fa84ac-b703-4abd-9fca-cee8209ea864 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:05.909486 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-56fa84ac-b703-4abd-9fca-cee8209ea864 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "POST /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d/action" status: 202 len: 0 microversion: 2.1 time: 0.103497 Mar 12 21:50:05.910184 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5502/6270] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:50:05 2022] POST /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:50:05.918634 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a2841929-e491-417d-aebb-660665ac0334 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:05.919373 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a2841929-e491-417d-aebb-660665ac0334 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:05.925475 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2841929-e491-417d-aebb-660665ac0334 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:05.925903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2841929-e491-417d-aebb-660665ac0334 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:05.926710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2841929-e491-417d-aebb-660665ac0334 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:05.927309 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a2841929-e491-417d-aebb-660665ac0334 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:06.073736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a2841929-e491-417d-aebb-660665ac0334 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:06.081144 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a2841929-e491-417d-aebb-660665ac0334 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1628 microversion: 2.1 time: 0.166702 Mar 12 21:50:06.081724 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5503/6271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:05 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1628 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:07.098619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a27b6d0b-7420-421c-b677-0d8fae633531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:07.099324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a27b6d0b-7420-421c-b677-0d8fae633531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:07.105906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a27b6d0b-7420-421c-b677-0d8fae633531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:07.106372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a27b6d0b-7420-421c-b677-0d8fae633531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:07.107155 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a27b6d0b-7420-421c-b677-0d8fae633531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:07.107610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a27b6d0b-7420-421c-b677-0d8fae633531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:07.247492 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a27b6d0b-7420-421c-b677-0d8fae633531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:07.255123 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a27b6d0b-7420-421c-b677-0d8fae633531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.160422 Mar 12 21:50:07.255716 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5504/6272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:07 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:07.531118 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:50:07.531728 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:50:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:50:07.963205 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2765391c-abd4-40ba-8753-e89b495feebd req-0ea85ec2-4585-46cb-b448-a96a0290bf9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781f355e-1617-4871-9154-cea0652ef40d", "name": "network-vif-unplugged", "status": "completed", "tag": "865df1be-c360-459d-8ca3-0334aa97bcb4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:50:07.971412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2765391c-abd4-40ba-8753-e89b495feebd req-0ea85ec2-4585-46cb-b448-a96a0290bf9a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:07.972010 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2765391c-abd4-40ba-8753-e89b495feebd req-0ea85ec2-4585-46cb-b448-a96a0290bf9a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:07.986274 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2765391c-abd4-40ba-8753-e89b495feebd req-0ea85ec2-4585-46cb-b448-a96a0290bf9a service nova] Creating event network-vif-unplugged:865df1be-c360-459d-8ca3-0334aa97bcb4 for instance 781f355e-1617-4871-9154-cea0652ef40d on nch1-master-1 Mar 12 21:50:07.992315 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2765391c-abd4-40ba-8753-e89b495feebd req-0ea85ec2-4585-46cb-b448-a96a0290bf9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032205 Mar 12 21:50:07.993732 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5505/6273] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:50:08.276063 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-59231cc2-fa2e-4d68-85a9-c6acaf26b860 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:08.276917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-59231cc2-fa2e-4d68-85a9-c6acaf26b860 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:08.286898 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59231cc2-fa2e-4d68-85a9-c6acaf26b860 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:08.289398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59231cc2-fa2e-4d68-85a9-c6acaf26b860 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:08.290791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59231cc2-fa2e-4d68-85a9-c6acaf26b860 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:08.291681 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-59231cc2-fa2e-4d68-85a9-c6acaf26b860 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:08.476473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-59231cc2-fa2e-4d68-85a9-c6acaf26b860 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:08.485639 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-59231cc2-fa2e-4d68-85a9-c6acaf26b860 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.214322 Mar 12 21:50:08.486548 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5506/6274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:08 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:09.503840 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8319ad54-97cd-441d-8076-379e159a0a21 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:09.504680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8319ad54-97cd-441d-8076-379e159a0a21 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:09.511884 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8319ad54-97cd-441d-8076-379e159a0a21 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:09.512437 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8319ad54-97cd-441d-8076-379e159a0a21 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:09.513319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8319ad54-97cd-441d-8076-379e159a0a21 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:09.513946 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8319ad54-97cd-441d-8076-379e159a0a21 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:09.673109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8319ad54-97cd-441d-8076-379e159a0a21 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:09.679781 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8319ad54-97cd-441d-8076-379e159a0a21 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.179937 Mar 12 21:50:09.680454 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5507/6275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:09 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:10.697396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-caed4de2-164d-4a3b-9570-3870618101ef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:10.699124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-caed4de2-164d-4a3b-9570-3870618101ef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:10.705940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caed4de2-164d-4a3b-9570-3870618101ef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:10.706416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caed4de2-164d-4a3b-9570-3870618101ef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:10.707215 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caed4de2-164d-4a3b-9570-3870618101ef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:10.707675 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-caed4de2-164d-4a3b-9570-3870618101ef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:10.859023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-caed4de2-164d-4a3b-9570-3870618101ef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:10.867108 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-caed4de2-164d-4a3b-9570-3870618101ef tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.173946 Mar 12 21:50:10.867710 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5508/6276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:10 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:11.888771 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d1670a03-7d81-4bc7-9e43-35ad8b660a86 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:11.889556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d1670a03-7d81-4bc7-9e43-35ad8b660a86 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:11.896369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1670a03-7d81-4bc7-9e43-35ad8b660a86 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:11.896839 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1670a03-7d81-4bc7-9e43-35ad8b660a86 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:11.901169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1670a03-7d81-4bc7-9e43-35ad8b660a86 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:11.901169 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d1670a03-7d81-4bc7-9e43-35ad8b660a86 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:12.048902 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d1670a03-7d81-4bc7-9e43-35ad8b660a86 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:12.057401 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d1670a03-7d81-4bc7-9e43-35ad8b660a86 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.173016 Mar 12 21:50:12.058251 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5509/6277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:11 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:13.075346 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-579e488d-5da9-4480-9d42-95a602c91c12 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:13.076956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-579e488d-5da9-4480-9d42-95a602c91c12 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:13.084233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-579e488d-5da9-4480-9d42-95a602c91c12 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:13.084707 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-579e488d-5da9-4480-9d42-95a602c91c12 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:13.086104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-579e488d-5da9-4480-9d42-95a602c91c12 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:13.086562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-579e488d-5da9-4480-9d42-95a602c91c12 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:13.235610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-579e488d-5da9-4480-9d42-95a602c91c12 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:13.243414 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-579e488d-5da9-4480-9d42-95a602c91c12 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.172037 Mar 12 21:50:13.244369 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5510/6278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:13 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:14.261022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1c044d06-acfe-414e-8458-00fe0d90537f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:14.261745 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1c044d06-acfe-414e-8458-00fe0d90537f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:14.268749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c044d06-acfe-414e-8458-00fe0d90537f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:14.269217 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c044d06-acfe-414e-8458-00fe0d90537f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:14.270073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c044d06-acfe-414e-8458-00fe0d90537f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:14.270537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1c044d06-acfe-414e-8458-00fe0d90537f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:14.423765 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1c044d06-acfe-414e-8458-00fe0d90537f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:14.431792 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1c044d06-acfe-414e-8458-00fe0d90537f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.175072 Mar 12 21:50:14.432575 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5511/6279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:14 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:15.448517 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8033ad30-c4f2-438c-a243-87b66c46cc45 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:15.449682 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8033ad30-c4f2-438c-a243-87b66c46cc45 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:15.456016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8033ad30-c4f2-438c-a243-87b66c46cc45 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:15.456485 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8033ad30-c4f2-438c-a243-87b66c46cc45 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:15.457275 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8033ad30-c4f2-438c-a243-87b66c46cc45 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:15.457730 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8033ad30-c4f2-438c-a243-87b66c46cc45 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:15.603298 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8033ad30-c4f2-438c-a243-87b66c46cc45 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:15.611332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8033ad30-c4f2-438c-a243-87b66c46cc45 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.166703 Mar 12 21:50:15.612321 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5512/6280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:15 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:16.629615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4e4e20f5-4ce8-4465-932d-d3cdf75c7af8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:16.630369 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4e4e20f5-4ce8-4465-932d-d3cdf75c7af8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:16.637679 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e4e20f5-4ce8-4465-932d-d3cdf75c7af8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:16.638181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e4e20f5-4ce8-4465-932d-d3cdf75c7af8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:16.638978 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e4e20f5-4ce8-4465-932d-d3cdf75c7af8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:16.639435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4e4e20f5-4ce8-4465-932d-d3cdf75c7af8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:16.770579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4e4e20f5-4ce8-4465-932d-d3cdf75c7af8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:16.778293 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4e4e20f5-4ce8-4465-932d-d3cdf75c7af8 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.152674 Mar 12 21:50:16.779281 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5513/6281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:16 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:17.796071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cd9e3c94-b203-4b62-9b5e-1651eed141c6 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:17.796748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cd9e3c94-b203-4b62-9b5e-1651eed141c6 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:17.803493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd9e3c94-b203-4b62-9b5e-1651eed141c6 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:17.803964 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd9e3c94-b203-4b62-9b5e-1651eed141c6 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:17.804748 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd9e3c94-b203-4b62-9b5e-1651eed141c6 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:17.805197 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd9e3c94-b203-4b62-9b5e-1651eed141c6 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:17.948288 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd9e3c94-b203-4b62-9b5e-1651eed141c6 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:17.955618 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cd9e3c94-b203-4b62-9b5e-1651eed141c6 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.163552 Mar 12 21:50:17.956202 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5514/6282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:17 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:18.971970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0860845e-99d4-4943-a629-ed758e5547fd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:18.972607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0860845e-99d4-4943-a629-ed758e5547fd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:18.979329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0860845e-99d4-4943-a629-ed758e5547fd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:18.979801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0860845e-99d4-4943-a629-ed758e5547fd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:18.980585 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0860845e-99d4-4943-a629-ed758e5547fd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:18.981042 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0860845e-99d4-4943-a629-ed758e5547fd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:19.113572 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0860845e-99d4-4943-a629-ed758e5547fd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:19.120992 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0860845e-99d4-4943-a629-ed758e5547fd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.153014 Mar 12 21:50:19.121574 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5515/6283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:18 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:20.138243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5a7f6d5d-b4db-4d3f-9a87-05db7b379dcf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:20.138876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5a7f6d5d-b4db-4d3f-9a87-05db7b379dcf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:20.145577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a7f6d5d-b4db-4d3f-9a87-05db7b379dcf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:20.146073 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a7f6d5d-b4db-4d3f-9a87-05db7b379dcf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:20.146863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a7f6d5d-b4db-4d3f-9a87-05db7b379dcf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:20.147313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5a7f6d5d-b4db-4d3f-9a87-05db7b379dcf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:20.285860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5a7f6d5d-b4db-4d3f-9a87-05db7b379dcf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:20.293975 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5a7f6d5d-b4db-4d3f-9a87-05db7b379dcf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.159748 Mar 12 21:50:20.294566 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5516/6284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:20 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:21.311695 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a1236f1b-f04c-4459-9218-2621b1c160c3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:21.312388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a1236f1b-f04c-4459-9218-2621b1c160c3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:21.319051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1236f1b-f04c-4459-9218-2621b1c160c3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:21.319522 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1236f1b-f04c-4459-9218-2621b1c160c3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:21.320307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1236f1b-f04c-4459-9218-2621b1c160c3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:21.320763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a1236f1b-f04c-4459-9218-2621b1c160c3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:21.452927 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a1236f1b-f04c-4459-9218-2621b1c160c3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:21.460266 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a1236f1b-f04c-4459-9218-2621b1c160c3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.152515 Mar 12 21:50:21.460845 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5517/6285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:21 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:22.478537 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a26abde7-077c-4bc3-98ab-6d70a2087ddc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:22.479224 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a26abde7-077c-4bc3-98ab-6d70a2087ddc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:22.485965 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a26abde7-077c-4bc3-98ab-6d70a2087ddc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:22.486431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a26abde7-077c-4bc3-98ab-6d70a2087ddc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:22.487213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a26abde7-077c-4bc3-98ab-6d70a2087ddc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:22.487664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a26abde7-077c-4bc3-98ab-6d70a2087ddc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:22.627170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a26abde7-077c-4bc3-98ab-6d70a2087ddc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:22.637294 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a26abde7-077c-4bc3-98ab-6d70a2087ddc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.163149 Mar 12 21:50:22.637939 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5518/6286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:22 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:23.654593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-814619cb-eedc-40d9-ad99-249fbe8726f5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:23.655290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-814619cb-eedc-40d9-ad99-249fbe8726f5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:23.662390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-814619cb-eedc-40d9-ad99-249fbe8726f5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:23.662860 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-814619cb-eedc-40d9-ad99-249fbe8726f5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:23.663677 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-814619cb-eedc-40d9-ad99-249fbe8726f5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:23.664132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-814619cb-eedc-40d9-ad99-249fbe8726f5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:23.800323 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-814619cb-eedc-40d9-ad99-249fbe8726f5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:23.808332 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-814619cb-eedc-40d9-ad99-249fbe8726f5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1686 microversion: 2.1 time: 0.157681 Mar 12 21:50:23.808915 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5519/6287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:23 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:24.825501 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-80861ca1-b0c8-4270-8e78-051c560356ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:50:24.826213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-80861ca1-b0c8-4270-8e78-051c560356ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:50:24.832985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80861ca1-b0c8-4270-8e78-051c560356ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:24.833460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80861ca1-b0c8-4270-8e78-051c560356ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:24.834290 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80861ca1-b0c8-4270-8e78-051c560356ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:24.834752 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-80861ca1-b0c8-4270-8e78-051c560356ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:24.970453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-80861ca1-b0c8-4270-8e78-051c560356ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:50:24.978270 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-80861ca1-b0c8-4270-8e78-051c560356ec tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1673 microversion: 2.1 time: 0.156804 Mar 12 21:50:24.978847 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5520/6288] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:50:24 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:50:26.093414 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-a06f3053-910e-43bc-8e54-9d2ed716137b req-4fc98ff7-659b-47db-95b9-efc5d70aecdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781f355e-1617-4871-9154-cea0652ef40d", "name": "network-vif-plugged", "status": "completed", "tag": "865df1be-c360-459d-8ca3-0334aa97bcb4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:50:26.102853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a06f3053-910e-43bc-8e54-9d2ed716137b req-4fc98ff7-659b-47db-95b9-efc5d70aecdd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:50:26.103341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-a06f3053-910e-43bc-8e54-9d2ed716137b req-4fc98ff7-659b-47db-95b9-efc5d70aecdd service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:50:26.114594 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-a06f3053-910e-43bc-8e54-9d2ed716137b req-4fc98ff7-659b-47db-95b9-efc5d70aecdd service nova] Creating event network-vif-plugged:865df1be-c360-459d-8ca3-0334aa97bcb4 for instance 781f355e-1617-4871-9154-cea0652ef40d on nch1-master-1 Mar 12 21:50:26.120991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-a06f3053-910e-43bc-8e54-9d2ed716137b req-4fc98ff7-659b-47db-95b9-efc5d70aecdd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030836 Mar 12 21:50:26.121603 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5521/6289] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:51:53.214969 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:51:53.215591 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:51:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:51:55.665640 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:51:55.666365 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:51:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:52:10.326173 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71123955-a9e1-42db-8514-da628e7bdb0e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:10.326888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71123955-a9e1-42db-8514-da628e7bdb0e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:10.334018 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71123955-a9e1-42db-8514-da628e7bdb0e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:10.334581 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71123955-a9e1-42db-8514-da628e7bdb0e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:10.335421 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71123955-a9e1-42db-8514-da628e7bdb0e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:10.335942 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71123955-a9e1-42db-8514-da628e7bdb0e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:10.363608 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71123955-a9e1-42db-8514-da628e7bdb0e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:52:10.447248 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71123955-a9e1-42db-8514-da628e7bdb0e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "DELETE /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 204 len: 0 microversion: 2.1 time: 0.126006 Mar 12 21:52:10.448090 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5522/6290] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:52:10 2022] DELETE /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:52:10.531435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ff50004c-7668-455e-b266-5b01ba695fbc req-81cb550a-9948-407f-8d6d-1c517ba3b7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781f355e-1617-4871-9154-cea0652ef40d", "tag": "865df1be-c360-459d-8ca3-0334aa97bcb4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:52:10.539384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ff50004c-7668-455e-b266-5b01ba695fbc req-81cb550a-9948-407f-8d6d-1c517ba3b7d9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:10.539853 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ff50004c-7668-455e-b266-5b01ba695fbc req-81cb550a-9948-407f-8d6d-1c517ba3b7d9 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:10.550844 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ff50004c-7668-455e-b266-5b01ba695fbc req-81cb550a-9948-407f-8d6d-1c517ba3b7d9 service nova] Creating event network-changed:865df1be-c360-459d-8ca3-0334aa97bcb4 for instance 781f355e-1617-4871-9154-cea0652ef40d on nch1-master-1 Mar 12 21:52:10.556427 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ff50004c-7668-455e-b266-5b01ba695fbc req-81cb550a-9948-407f-8d6d-1c517ba3b7d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106559 Mar 12 21:52:10.557031 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5523/6291] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:52:10.568014 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6e43780b-622b-48ab-94bd-276b55b12814 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:10.569019 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6e43780b-622b-48ab-94bd-276b55b12814 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:10.576068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e43780b-622b-48ab-94bd-276b55b12814 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:10.576604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e43780b-622b-48ab-94bd-276b55b12814 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:10.577422 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e43780b-622b-48ab-94bd-276b55b12814 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:10.577919 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6e43780b-622b-48ab-94bd-276b55b12814 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:10.792096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-6e43780b-622b-48ab-94bd-276b55b12814 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:10.800336 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6e43780b-622b-48ab-94bd-276b55b12814 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1679 microversion: 2.1 time: 0.239365 Mar 12 21:52:10.801300 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5524/6292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:10 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1679 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:52:11.819527 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04657a94-5db5-4bbc-8f68-38d67a181112 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:11.820228 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04657a94-5db5-4bbc-8f68-38d67a181112 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:11.828332 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04657a94-5db5-4bbc-8f68-38d67a181112 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:11.828791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04657a94-5db5-4bbc-8f68-38d67a181112 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:11.829607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04657a94-5db5-4bbc-8f68-38d67a181112 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:11.830083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04657a94-5db5-4bbc-8f68-38d67a181112 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:11.967732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04657a94-5db5-4bbc-8f68-38d67a181112 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:11.975219 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04657a94-5db5-4bbc-8f68-38d67a181112 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 200 len: 1561 microversion: 2.1 time: 0.159642 Mar 12 21:52:11.975802 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5525/6293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:11 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:12.613893 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-e9fe7f18-1ada-43aa-b1ab-9d5e08855887 req-079a5568-1ba9-44f8-b134-5199a8c69164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781f355e-1617-4871-9154-cea0652ef40d", "name": "network-vif-deleted", "tag": "865df1be-c360-459d-8ca3-0334aa97bcb4"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:52:12.621831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e9fe7f18-1ada-43aa-b1ab-9d5e08855887 req-079a5568-1ba9-44f8-b134-5199a8c69164 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:12.622299 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-e9fe7f18-1ada-43aa-b1ab-9d5e08855887 req-079a5568-1ba9-44f8-b134-5199a8c69164 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:12.633751 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-e9fe7f18-1ada-43aa-b1ab-9d5e08855887 req-079a5568-1ba9-44f8-b134-5199a8c69164 service nova] Creating event network-vif-deleted:865df1be-c360-459d-8ca3-0334aa97bcb4 for instance 781f355e-1617-4871-9154-cea0652ef40d on nch1-master-1 Mar 12 21:52:12.638793 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-e9fe7f18-1ada-43aa-b1ab-9d5e08855887 req-079a5568-1ba9-44f8-b134-5199a8c69164 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081632 Mar 12 21:52:12.639395 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5526/6294] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:52:13.000391 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6797e4b7-919e-480a-9da4-634d19d6a525 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:13.001477 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6797e4b7-919e-480a-9da4-634d19d6a525 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 781f355e-1617-4871-9154-cea0652ef40d] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:13.008206 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6797e4b7-919e-480a-9da4-634d19d6a525 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:13.009179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6797e4b7-919e-480a-9da4-634d19d6a525 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:13.010004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6797e4b7-919e-480a-9da4-634d19d6a525 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:13.010454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6797e4b7-919e-480a-9da4-634d19d6a525 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:13.025196 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-6797e4b7-919e-480a-9da4-634d19d6a525 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] HTTP exception thrown: Instance 781f355e-1617-4871-9154-cea0652ef40d could not be found. Mar 12 21:52:13.025851 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6797e4b7-919e-480a-9da4-634d19d6a525 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Returning 404 to user: Instance 781f355e-1617-4871-9154-cea0652ef40d could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:52:13.026820 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6797e4b7-919e-480a-9da4-634d19d6a525 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d" status: 404 len: 111 microversion: 2.1 time: 0.033448 Mar 12 21:52:13.027388 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5527/6295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:12 2022] GET /compute/v2.1/servers/781f355e-1617-4871-9154-cea0652ef40d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:52:13.182482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1269129e-b726-40a3-8882-83c2433e7ff3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '.version_select at 0x7f6e342080d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:13.205715 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1269129e-b726-40a3-8882-83c2433e7ff3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-722642708" status: 202 len: 0 microversion: 2.1 time: 0.026828 Mar 12 21:52:13.206391 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5528/6296] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Mar 12 21:52:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-722642708 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:52:13.228348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f727c170-2596-4347-a09d-b8a4b3d877eb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Action: 'create', calling method: .version_select at 0x7f6e3424ddc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-513445975"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:52:13.244742 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f727c170-2596-4347-a09d-b8a4b3d877eb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Getting quotas for project fe4938aa90944ae7b17fbccaa7f8afe1. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:52:13.250740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f727c170-2596-4347-a09d-b8a4b3d877eb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Getting quotas for user b5a0b91da24b4522b5556fb5797cffa1 and project fe4938aa90944ae7b17fbccaa7f8afe1. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:52:13.464928 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f727c170-2596-4347-a09d-b8a4b3d877eb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Getting quotas for project fe4938aa90944ae7b17fbccaa7f8afe1. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:52:13.469801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-f727c170-2596-4347-a09d-b8a4b3d877eb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Getting quotas for user b5a0b91da24b4522b5556fb5797cffa1 and project fe4938aa90944ae7b17fbccaa7f8afe1. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:52:13.483665 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f727c170-2596-4347-a09d-b8a4b3d877eb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.259207 Mar 12 21:52:13.484439 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5529/6297] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:52:13 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:16.854776 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1018214989", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-513445975", "security_groups": [{"name": "tempest-secgroup-smoke-304250683"}], "networks": [{"uuid": "200175a3-01d3-47dc-bd67-4843849240c3"}], "block_device_mapping_v2": [{"uuid": "06bbc9c3-1465-48de-9575-e1c40e6428b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:52:16.965966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] validate_networks() for [('200175a3-01d3-47dc-bd67-4843849240c3', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:52:17.369365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:52:17.369833 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:52:17.370357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:52:17.370831 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:52:17.371256 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:52:17.380030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:17.380491 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:17.381297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:17.381810 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:17.400086 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Getting quotas for project fe4938aa90944ae7b17fbccaa7f8afe1. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:52:17.405260 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Getting quotas for user b5a0b91da24b4522b5556fb5797cffa1 and project fe4938aa90944ae7b17fbccaa7f8afe1. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:52:17.462554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:52:17.464718 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06bbc9c3-1465-48de-9575-e1c40e6428b5',volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:52:17.586488 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0bce5036-aeb6-4623-a2d6-0c6ef286eefc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.736524 Mar 12 21:52:17.587257 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5530/6298] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:52:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:52:17.596852 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a0673b59-b13b-48fc-85a5-52163f13fe7f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:17.597481 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a0673b59-b13b-48fc-85a5-52163f13fe7f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:17.658528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a0673b59-b13b-48fc-85a5-52163f13fe7f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:17.667689 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a0673b59-b13b-48fc-85a5-52163f13fe7f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1088 microversion: 2.1 time: 0.074529 Mar 12 21:52:17.668310 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5531/6299] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:17 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:18.687271 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c37f3c95-f82c-40b3-9dcb-e390fa372e9c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:18.688055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c37f3c95-f82c-40b3-9dcb-e390fa372e9c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:18.694888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c37f3c95-f82c-40b3-9dcb-e390fa372e9c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:18.695357 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c37f3c95-f82c-40b3-9dcb-e390fa372e9c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:18.697220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c37f3c95-f82c-40b3-9dcb-e390fa372e9c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:18.697338 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c37f3c95-f82c-40b3-9dcb-e390fa372e9c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:18.764096 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c37f3c95-f82c-40b3-9dcb-e390fa372e9c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:18.771564 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c37f3c95-f82c-40b3-9dcb-e390fa372e9c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1204 microversion: 2.1 time: 0.088495 Mar 12 21:52:18.772136 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5532/6300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:18 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1204 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:19.788710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-71b0f6f7-16d5-41b5-a8da-79a5bd7b2531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:19.789428 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-71b0f6f7-16d5-41b5-a8da-79a5bd7b2531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:19.796255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71b0f6f7-16d5-41b5-a8da-79a5bd7b2531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:19.796973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71b0f6f7-16d5-41b5-a8da-79a5bd7b2531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:19.797990 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71b0f6f7-16d5-41b5-a8da-79a5bd7b2531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:19.799055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-71b0f6f7-16d5-41b5-a8da-79a5bd7b2531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:19.971615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-71b0f6f7-16d5-41b5-a8da-79a5bd7b2531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:19.979916 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-71b0f6f7-16d5-41b5-a8da-79a5bd7b2531 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1259 microversion: 2.1 time: 0.195232 Mar 12 21:52:19.990503 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5533/6301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:19 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:20.048974 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0e066828-5001-4d77-b1bb-c56df96dc77e req-22312177-fe74-4dba-bd83-5246e4dd8715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0", "tag": "dfdc859c-0d82-4538-b428-6b5a0dd9a0dd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:52:20.059163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0e066828-5001-4d77-b1bb-c56df96dc77e req-22312177-fe74-4dba-bd83-5246e4dd8715 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:20.059909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0e066828-5001-4d77-b1bb-c56df96dc77e req-22312177-fe74-4dba-bd83-5246e4dd8715 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:20.086924 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0e066828-5001-4d77-b1bb-c56df96dc77e req-22312177-fe74-4dba-bd83-5246e4dd8715 service nova] Creating event network-changed:dfdc859c-0d82-4538-b428-6b5a0dd9a0dd for instance 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 on nch2-master-1 Mar 12 21:52:20.092409 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0e066828-5001-4d77-b1bb-c56df96dc77e req-22312177-fe74-4dba-bd83-5246e4dd8715 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047066 Mar 12 21:52:20.093111 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5534/6302] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:52:20.998945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1dd90512-5a88-433d-8498-8407c69a37ca tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:20.999684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1dd90512-5a88-433d-8498-8407c69a37ca tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:21.005715 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1dd90512-5a88-433d-8498-8407c69a37ca tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:21.006216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1dd90512-5a88-433d-8498-8407c69a37ca tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:21.006999 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1dd90512-5a88-433d-8498-8407c69a37ca tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:21.007454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1dd90512-5a88-433d-8498-8407c69a37ca tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:21.142753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1dd90512-5a88-433d-8498-8407c69a37ca tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:21.150807 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1dd90512-5a88-433d-8498-8407c69a37ca tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1259 microversion: 2.1 time: 0.156950 Mar 12 21:52:21.151392 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5535/6303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:20 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:22.167920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-70d675fd-c4be-4223-afce-87b065707c89 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:22.168563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-70d675fd-c4be-4223-afce-87b065707c89 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:22.175453 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70d675fd-c4be-4223-afce-87b065707c89 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:22.175920 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70d675fd-c4be-4223-afce-87b065707c89 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:22.176732 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70d675fd-c4be-4223-afce-87b065707c89 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:22.177211 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-70d675fd-c4be-4223-afce-87b065707c89 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:22.308595 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-70d675fd-c4be-4223-afce-87b065707c89 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:22.316028 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-70d675fd-c4be-4223-afce-87b065707c89 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1259 microversion: 2.1 time: 0.151981 Mar 12 21:52:22.316541 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5536/6304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:22 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:23.333648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-14c895da-62a0-43ed-b560-3db541fcdc08 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:23.334339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-14c895da-62a0-43ed-b560-3db541fcdc08 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:23.341591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14c895da-62a0-43ed-b560-3db541fcdc08 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:23.342098 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14c895da-62a0-43ed-b560-3db541fcdc08 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:23.342891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14c895da-62a0-43ed-b560-3db541fcdc08 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:23.343350 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-14c895da-62a0-43ed-b560-3db541fcdc08 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:23.474365 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-14c895da-62a0-43ed-b560-3db541fcdc08 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:23.481667 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-14c895da-62a0-43ed-b560-3db541fcdc08 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1259 microversion: 2.1 time: 0.151969 Mar 12 21:52:23.482268 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5537/6305] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:23 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:24.499115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-cd6dbce6-6299-4c05-9ecb-82005da4e0bd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:24.499774 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-cd6dbce6-6299-4c05-9ecb-82005da4e0bd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:24.506404 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd6dbce6-6299-4c05-9ecb-82005da4e0bd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:24.506850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd6dbce6-6299-4c05-9ecb-82005da4e0bd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:24.507629 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd6dbce6-6299-4c05-9ecb-82005da4e0bd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:24.508079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-cd6dbce6-6299-4c05-9ecb-82005da4e0bd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:24.644751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-cd6dbce6-6299-4c05-9ecb-82005da4e0bd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:24.652733 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-cd6dbce6-6299-4c05-9ecb-82005da4e0bd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1259 microversion: 2.1 time: 0.157552 Mar 12 21:52:24.653315 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5538/6306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:24 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:25.674543 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-835e81f6-becb-412f-b0a9-97904fa8269a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:25.675952 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-835e81f6-becb-412f-b0a9-97904fa8269a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:25.685052 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-835e81f6-becb-412f-b0a9-97904fa8269a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:25.685531 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-835e81f6-becb-412f-b0a9-97904fa8269a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:25.686358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-835e81f6-becb-412f-b0a9-97904fa8269a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:25.686955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-835e81f6-becb-412f-b0a9-97904fa8269a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:25.836003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-835e81f6-becb-412f-b0a9-97904fa8269a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:25.843826 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-835e81f6-becb-412f-b0a9-97904fa8269a tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1259 microversion: 2.1 time: 0.176139 Mar 12 21:52:25.844500 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5539/6307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:25 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:26.861556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-de63dafd-6645-48f6-b2e4-e826e92c748f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:26.862091 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-de63dafd-6645-48f6-b2e4-e826e92c748f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:26.869095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de63dafd-6645-48f6-b2e4-e826e92c748f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:26.869557 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de63dafd-6645-48f6-b2e4-e826e92c748f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:26.870362 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de63dafd-6645-48f6-b2e4-e826e92c748f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:26.870816 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-de63dafd-6645-48f6-b2e4-e826e92c748f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:27.004719 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-de63dafd-6645-48f6-b2e4-e826e92c748f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:27.012633 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-de63dafd-6645-48f6-b2e4-e826e92c748f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1259 microversion: 2.1 time: 0.155392 Mar 12 21:52:27.013202 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5540/6308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:26 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:27.326648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-0fae65b9-a1b8-4b81-8f44-afb76434a8de req-1302f025-d181-4e4e-849f-fe3307d668fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0", "name": "network-vif-plugged", "status": "completed", "tag": "dfdc859c-0d82-4538-b428-6b5a0dd9a0dd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:52:27.336143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0fae65b9-a1b8-4b81-8f44-afb76434a8de req-1302f025-d181-4e4e-849f-fe3307d668fb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:27.336609 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-0fae65b9-a1b8-4b81-8f44-afb76434a8de req-1302f025-d181-4e4e-849f-fe3307d668fb service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:27.347701 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-0fae65b9-a1b8-4b81-8f44-afb76434a8de req-1302f025-d181-4e4e-849f-fe3307d668fb service nova] Creating event network-vif-plugged:dfdc859c-0d82-4538-b428-6b5a0dd9a0dd for instance 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 on nch2-master-1 Mar 12 21:52:27.353587 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-0fae65b9-a1b8-4b81-8f44-afb76434a8de req-1302f025-d181-4e4e-849f-fe3307d668fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086811 Mar 12 21:52:27.354203 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5541/6309] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:52:28.030850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-73073d0d-4920-4326-b016-bbe0b15512bc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:28.031576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-73073d0d-4920-4326-b016-bbe0b15512bc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:28.038630 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73073d0d-4920-4326-b016-bbe0b15512bc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:28.039114 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73073d0d-4920-4326-b016-bbe0b15512bc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:28.040460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73073d0d-4920-4326-b016-bbe0b15512bc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:28.040922 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-73073d0d-4920-4326-b016-bbe0b15512bc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:28.177910 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-73073d0d-4920-4326-b016-bbe0b15512bc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:28.185339 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-73073d0d-4920-4326-b016-bbe0b15512bc tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1259 microversion: 2.1 time: 0.159050 Mar 12 21:52:28.185951 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5542/6310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:28 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:29.204070 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f4a97a9a-07e9-4779-9b9d-7ca55e1431bb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:29.204721 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f4a97a9a-07e9-4779-9b9d-7ca55e1431bb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:29.211863 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4a97a9a-07e9-4779-9b9d-7ca55e1431bb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:29.212329 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4a97a9a-07e9-4779-9b9d-7ca55e1431bb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:29.213102 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4a97a9a-07e9-4779-9b9d-7ca55e1431bb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:29.213556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f4a97a9a-07e9-4779-9b9d-7ca55e1431bb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:29.347562 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f4a97a9a-07e9-4779-9b9d-7ca55e1431bb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:29.354949 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f4a97a9a-07e9-4779-9b9d-7ca55e1431bb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1443 microversion: 2.1 time: 0.154901 Mar 12 21:52:29.355520 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5543/6311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:29 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:29.371038 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a4abc99a-ee75-4841-b91d-1d6284f47ed2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:52:29.372146 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a4abc99a-ee75-4841-b91d-1d6284f47ed2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:52:29.377871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4abc99a-ee75-4841-b91d-1d6284f47ed2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:29.378341 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4abc99a-ee75-4841-b91d-1d6284f47ed2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:29.379126 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4abc99a-ee75-4841-b91d-1d6284f47ed2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:29.379582 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a4abc99a-ee75-4841-b91d-1d6284f47ed2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:29.510447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a4abc99a-ee75-4841-b91d-1d6284f47ed2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:52:29.518004 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a4abc99a-ee75-4841-b91d-1d6284f47ed2 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1443 microversion: 2.1 time: 0.150529 Mar 12 21:52:29.518587 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5544/6312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:52:29 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:52:31.437788 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-b62d8ebf-d09c-439c-a652-b1a500dd3736 req-b978179f-d178-44da-ad0f-a41d73bd555a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0", "tag": "dfdc859c-0d82-4538-b428-6b5a0dd9a0dd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:52:31.446596 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b62d8ebf-d09c-439c-a652-b1a500dd3736 req-b978179f-d178-44da-ad0f-a41d73bd555a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:52:31.447068 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-b62d8ebf-d09c-439c-a652-b1a500dd3736 req-b978179f-d178-44da-ad0f-a41d73bd555a service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:52:31.458158 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-b62d8ebf-d09c-439c-a652-b1a500dd3736 req-b978179f-d178-44da-ad0f-a41d73bd555a service nova] Creating event network-changed:dfdc859c-0d82-4538-b428-6b5a0dd9a0dd for instance 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 on nch2-master-1 Mar 12 21:52:31.463411 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-b62d8ebf-d09c-439c-a652-b1a500dd3736 req-b978179f-d178-44da-ad0f-a41d73bd555a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029731 Mar 12 21:52:31.464502 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5545/6313] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:53:27.540612 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:53:27.541233 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:53:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:54:36.386871 ncdv-master-1 devstack@n-api.service[136302]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b3a5e23-4d61-4ee0-b93f-1df1716bb266] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 12 21:54:36.387742 ncdv-master-1 devstack@n-api.service[136302]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6333ff2d-0072-4370-9794-f5297b7a2156] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 12 21:54:36.391747 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-01560de5-42f6-4b69-a7df-829f37bef5b3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:54:36.392395 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-01560de5-42f6-4b69-a7df-829f37bef5b3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:36.398685 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01560de5-42f6-4b69-a7df-829f37bef5b3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:36.399158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01560de5-42f6-4b69-a7df-829f37bef5b3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:36.399951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01560de5-42f6-4b69-a7df-829f37bef5b3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:36.400435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-01560de5-42f6-4b69-a7df-829f37bef5b3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:36.424749 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-01560de5-42f6-4b69-a7df-829f37bef5b3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lazy-loading 'flavor' on Instance uuid 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:54:36.803002 ncdv-master-1 devstack@n-api.service[136302]: ERROR oslo.messaging._drivers.impl_rabbit [None req-01560de5-42f6-4b69-a7df-829f37bef5b3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [d7081c79-78d0-46b0-b8c9-c7c47267849f] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 12 21:54:37.395552 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b3a5e23-4d61-4ee0-b93f-1df1716bb266] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60274. Mar 12 21:54:37.396302 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] [6333ff2d-0072-4370-9794-f5297b7a2156] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60276. Mar 12 21:54:37.810261 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [None req-01560de5-42f6-4b69-a7df-829f37bef5b3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [d7081c79-78d0-46b0-b8c9-c7c47267849f] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60278. Mar 12 21:54:37.813416 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-01560de5-42f6-4b69-a7df-829f37bef5b3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "POST /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0/action" status: 202 len: 0 microversion: 2.1 time: 1.429565 Mar 12 21:54:37.814065 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5546/6314] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:54:36 2022] POST /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0/action => generated 0 bytes in 1431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:54:37.822402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1477cfc9-709a-4ac3-a592-ae9bc93f9c4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:37.823127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1477cfc9-709a-4ac3-a592-ae9bc93f9c4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:37.830289 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1477cfc9-709a-4ac3-a592-ae9bc93f9c4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:37.830858 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1477cfc9-709a-4ac3-a592-ae9bc93f9c4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:37.831622 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1477cfc9-709a-4ac3-a592-ae9bc93f9c4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:37.832036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1477cfc9-709a-4ac3-a592-ae9bc93f9c4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:37.968680 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1477cfc9-709a-4ac3-a592-ae9bc93f9c4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:37.976197 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1477cfc9-709a-4ac3-a592-ae9bc93f9c4f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1567 microversion: 2.1 time: 0.157827 Mar 12 21:54:37.976775 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5547/6315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:37 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:38.996176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bb86b47d-de5f-4018-8cff-1f0c2a390273 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:38.996850 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bb86b47d-de5f-4018-8cff-1f0c2a390273 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:39.003554 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb86b47d-de5f-4018-8cff-1f0c2a390273 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:39.004023 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb86b47d-de5f-4018-8cff-1f0c2a390273 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:39.004803 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb86b47d-de5f-4018-8cff-1f0c2a390273 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:39.005258 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bb86b47d-de5f-4018-8cff-1f0c2a390273 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:39.139571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bb86b47d-de5f-4018-8cff-1f0c2a390273 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:39.147924 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bb86b47d-de5f-4018-8cff-1f0c2a390273 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1567 microversion: 2.1 time: 0.155448 Mar 12 21:54:39.148501 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5548/6316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:38 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:40.165351 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8ca035ac-9cb5-4a53-a2ee-dc11e0dd6ceb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:40.166035 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8ca035ac-9cb5-4a53-a2ee-dc11e0dd6ceb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:40.172814 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ca035ac-9cb5-4a53-a2ee-dc11e0dd6ceb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:40.173287 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ca035ac-9cb5-4a53-a2ee-dc11e0dd6ceb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:40.174106 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ca035ac-9cb5-4a53-a2ee-dc11e0dd6ceb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:40.174563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8ca035ac-9cb5-4a53-a2ee-dc11e0dd6ceb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:40.308476 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8ca035ac-9cb5-4a53-a2ee-dc11e0dd6ceb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:40.315972 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8ca035ac-9cb5-4a53-a2ee-dc11e0dd6ceb tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1567 microversion: 2.1 time: 0.154587 Mar 12 21:54:40.316540 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5549/6317] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:40 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:41.333493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-68b0cfd7-4014-41e7-814d-64887b02d1cf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:41.334216 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-68b0cfd7-4014-41e7-814d-64887b02d1cf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:41.341416 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68b0cfd7-4014-41e7-814d-64887b02d1cf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:41.341918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68b0cfd7-4014-41e7-814d-64887b02d1cf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:41.342696 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68b0cfd7-4014-41e7-814d-64887b02d1cf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:41.343143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-68b0cfd7-4014-41e7-814d-64887b02d1cf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:41.478171 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-68b0cfd7-4014-41e7-814d-64887b02d1cf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:41.485518 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-68b0cfd7-4014-41e7-814d-64887b02d1cf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1567 microversion: 2.1 time: 0.155903 Mar 12 21:54:41.486133 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5550/6318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:41 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:42.502442 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-96273d5d-5d7e-43e1-a49c-96bc3adfb563 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:42.503083 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-96273d5d-5d7e-43e1-a49c-96bc3adfb563 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:42.510435 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96273d5d-5d7e-43e1-a49c-96bc3adfb563 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:42.510903 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96273d5d-5d7e-43e1-a49c-96bc3adfb563 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:42.511687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96273d5d-5d7e-43e1-a49c-96bc3adfb563 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:42.512141 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-96273d5d-5d7e-43e1-a49c-96bc3adfb563 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:42.642321 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-96273d5d-5d7e-43e1-a49c-96bc3adfb563 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:42.650317 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-96273d5d-5d7e-43e1-a49c-96bc3adfb563 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1567 microversion: 2.1 time: 0.151228 Mar 12 21:54:42.650849 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5551/6319] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:42 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:43.667604 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7c97718f-54c5-4d7c-8151-7d24ee5198a5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:43.668307 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7c97718f-54c5-4d7c-8151-7d24ee5198a5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:43.675016 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c97718f-54c5-4d7c-8151-7d24ee5198a5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:43.675496 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c97718f-54c5-4d7c-8151-7d24ee5198a5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:43.676301 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c97718f-54c5-4d7c-8151-7d24ee5198a5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:43.676767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c97718f-54c5-4d7c-8151-7d24ee5198a5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:43.810196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7c97718f-54c5-4d7c-8151-7d24ee5198a5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:43.818047 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7c97718f-54c5-4d7c-8151-7d24ee5198a5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1567 microversion: 2.1 time: 0.154367 Mar 12 21:54:43.818679 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5552/6320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:43 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:44.835827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-04be57ba-6897-4d3a-9eb2-210c731e7926 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:44.836458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-04be57ba-6897-4d3a-9eb2-210c731e7926 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:44.843781 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04be57ba-6897-4d3a-9eb2-210c731e7926 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:44.844249 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04be57ba-6897-4d3a-9eb2-210c731e7926 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:44.845036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04be57ba-6897-4d3a-9eb2-210c731e7926 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:44.845487 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-04be57ba-6897-4d3a-9eb2-210c731e7926 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:44.984430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-04be57ba-6897-4d3a-9eb2-210c731e7926 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:44.991846 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-04be57ba-6897-4d3a-9eb2-210c731e7926 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1567 microversion: 2.1 time: 0.160368 Mar 12 21:54:44.992415 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5553/6321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:44 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:45.135919 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:54:45.136280 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 21:54:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 21:54:45.226795 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:54:45.226795 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 21:54:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 21:54:46.010119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d22b835f-d99e-4198-9445-6ed7ad5460c9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:46.010822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d22b835f-d99e-4198-9445-6ed7ad5460c9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:46.017985 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d22b835f-d99e-4198-9445-6ed7ad5460c9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:46.018458 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d22b835f-d99e-4198-9445-6ed7ad5460c9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:46.019245 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d22b835f-d99e-4198-9445-6ed7ad5460c9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:46.019702 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d22b835f-d99e-4198-9445-6ed7ad5460c9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:46.156431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d22b835f-d99e-4198-9445-6ed7ad5460c9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:46.165388 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d22b835f-d99e-4198-9445-6ed7ad5460c9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1567 microversion: 2.1 time: 0.159667 Mar 12 21:54:46.166047 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5554/6322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:46 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:47.183176 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dd365f30-f513-45d6-b301-003bab3b0cf1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:47.183821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dd365f30-f513-45d6-b301-003bab3b0cf1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:47.190658 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd365f30-f513-45d6-b301-003bab3b0cf1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:47.191123 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd365f30-f513-45d6-b301-003bab3b0cf1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:47.191925 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd365f30-f513-45d6-b301-003bab3b0cf1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:47.192387 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dd365f30-f513-45d6-b301-003bab3b0cf1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:47.332625 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dd365f30-f513-45d6-b301-003bab3b0cf1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:47.340730 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dd365f30-f513-45d6-b301-003bab3b0cf1 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1567 microversion: 2.1 time: 0.161669 Mar 12 21:54:47.341309 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5555/6323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:47 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:48.357805 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-dac52e62-d52a-4508-9c35-8b782be657cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:48.359220 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-dac52e62-d52a-4508-9c35-8b782be657cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:48.366057 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dac52e62-d52a-4508-9c35-8b782be657cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:48.366564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dac52e62-d52a-4508-9c35-8b782be657cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:48.367360 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dac52e62-d52a-4508-9c35-8b782be657cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:48.367827 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-dac52e62-d52a-4508-9c35-8b782be657cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:48.503868 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-dac52e62-d52a-4508-9c35-8b782be657cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:48.511328 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-dac52e62-d52a-4508-9c35-8b782be657cd tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1567 microversion: 2.1 time: 0.157596 Mar 12 21:54:48.511899 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5556/6324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:48 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:49.528363 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-51ae7c01-426c-4cbc-a9df-f4f955a380e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:49.529316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-51ae7c01-426c-4cbc-a9df-f4f955a380e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:49.536055 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51ae7c01-426c-4cbc-a9df-f4f955a380e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:49.536532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51ae7c01-426c-4cbc-a9df-f4f955a380e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:49.537317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51ae7c01-426c-4cbc-a9df-f4f955a380e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:49.537800 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-51ae7c01-426c-4cbc-a9df-f4f955a380e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:49.667507 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-51ae7c01-426c-4cbc-a9df-f4f955a380e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:49.674903 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-51ae7c01-426c-4cbc-a9df-f4f955a380e7 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1567 microversion: 2.1 time: 0.150553 Mar 12 21:54:49.675476 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5557/6325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:49 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:50.692571 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-58fc9be3-1f67-4bf3-88e4-76a6eca5d0b9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:50.693273 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-58fc9be3-1f67-4bf3-88e4-76a6eca5d0b9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:50.700691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58fc9be3-1f67-4bf3-88e4-76a6eca5d0b9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:50.701170 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58fc9be3-1f67-4bf3-88e4-76a6eca5d0b9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:50.702017 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58fc9be3-1f67-4bf3-88e4-76a6eca5d0b9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:50.702483 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-58fc9be3-1f67-4bf3-88e4-76a6eca5d0b9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:50.844560 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-58fc9be3-1f67-4bf3-88e4-76a6eca5d0b9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:50.852039 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-58fc9be3-1f67-4bf3-88e4-76a6eca5d0b9 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1508 microversion: 2.1 time: 0.163443 Mar 12 21:54:50.852751 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5558/6326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:50 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:50.868881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-6b044f5a-19de-4c01-946e-4eb2153cc37e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:54:50.869465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-6b044f5a-19de-4c01-946e-4eb2153cc37e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:50.875446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b044f5a-19de-4c01-946e-4eb2153cc37e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:50.875915 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b044f5a-19de-4c01-946e-4eb2153cc37e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:50.876699 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b044f5a-19de-4c01-946e-4eb2153cc37e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:50.877151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-6b044f5a-19de-4c01-946e-4eb2153cc37e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:50.950867 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-6b044f5a-19de-4c01-946e-4eb2153cc37e tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "POST /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0/action" status: 202 len: 0 microversion: 2.1 time: 0.085688 Mar 12 21:54:50.951466 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5559/6327] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:54:50 2022] POST /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 21:54:50.959434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8b877b2c-252f-4eac-bcc4-85bfbff15486 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:50.960071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8b877b2c-252f-4eac-bcc4-85bfbff15486 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:50.966717 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b877b2c-252f-4eac-bcc4-85bfbff15486 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:50.967202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b877b2c-252f-4eac-bcc4-85bfbff15486 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:50.968003 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b877b2c-252f-4eac-bcc4-85bfbff15486 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:50.968468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8b877b2c-252f-4eac-bcc4-85bfbff15486 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:51.170740 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8b877b2c-252f-4eac-bcc4-85bfbff15486 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:51.178488 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8b877b2c-252f-4eac-bcc4-85bfbff15486 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1516 microversion: 2.1 time: 0.222722 Mar 12 21:54:51.179069 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5560/6328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:50 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1516 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:52.196607 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-09ac4b35-7087-43a3-9857-259aa71844aa tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:52.197688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-09ac4b35-7087-43a3-9857-259aa71844aa tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:52.205504 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09ac4b35-7087-43a3-9857-259aa71844aa tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:52.206012 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09ac4b35-7087-43a3-9857-259aa71844aa tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:52.206859 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09ac4b35-7087-43a3-9857-259aa71844aa tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:52.207324 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-09ac4b35-7087-43a3-9857-259aa71844aa tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:52.346944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-09ac4b35-7087-43a3-9857-259aa71844aa tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:52.355535 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-09ac4b35-7087-43a3-9857-259aa71844aa tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1518 microversion: 2.1 time: 0.162904 Mar 12 21:54:52.356118 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5561/6329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:52 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:53.373573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d6ef0dde-2f15-4ed4-bf9d-dd381ab65ac5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:53.374244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d6ef0dde-2f15-4ed4-bf9d-dd381ab65ac5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:53.381074 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6ef0dde-2f15-4ed4-bf9d-dd381ab65ac5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:53.381548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6ef0dde-2f15-4ed4-bf9d-dd381ab65ac5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:53.382390 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6ef0dde-2f15-4ed4-bf9d-dd381ab65ac5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:53.382847 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d6ef0dde-2f15-4ed4-bf9d-dd381ab65ac5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:53.523037 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d6ef0dde-2f15-4ed4-bf9d-dd381ab65ac5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:53.530835 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d6ef0dde-2f15-4ed4-bf9d-dd381ab65ac5 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1574 microversion: 2.1 time: 0.161298 Mar 12 21:54:53.531405 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5562/6330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:53 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:53.784262 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ab91d715-490c-49a0-a016-fa09b7569f73 req-d95a093c-34a0-4bc8-9654-f95829fc2285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0", "name": "network-vif-unplugged", "status": "completed", "tag": "dfdc859c-0d82-4538-b428-6b5a0dd9a0dd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:54:53.793092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ab91d715-490c-49a0-a016-fa09b7569f73 req-d95a093c-34a0-4bc8-9654-f95829fc2285 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:53.793601 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ab91d715-490c-49a0-a016-fa09b7569f73 req-d95a093c-34a0-4bc8-9654-f95829fc2285 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:53.806755 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ab91d715-490c-49a0-a016-fa09b7569f73 req-d95a093c-34a0-4bc8-9654-f95829fc2285 service nova] Creating event network-vif-unplugged:dfdc859c-0d82-4538-b428-6b5a0dd9a0dd for instance 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 on nch2-master-1 Mar 12 21:54:53.811895 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ab91d715-490c-49a0-a016-fa09b7569f73 req-d95a093c-34a0-4bc8-9654-f95829fc2285 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031510 Mar 12 21:54:53.812484 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5563/6331] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:54:54.550210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b4ba426a-075c-4de1-a129-c630bd4f105c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:54.550940 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b4ba426a-075c-4de1-a129-c630bd4f105c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:54.557144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4ba426a-075c-4de1-a129-c630bd4f105c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:54.557626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4ba426a-075c-4de1-a129-c630bd4f105c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:54.558461 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4ba426a-075c-4de1-a129-c630bd4f105c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:54.558923 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b4ba426a-075c-4de1-a129-c630bd4f105c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:54.693434 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b4ba426a-075c-4de1-a129-c630bd4f105c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:54.700892 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b4ba426a-075c-4de1-a129-c630bd4f105c tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1574 microversion: 2.1 time: 0.155954 Mar 12 21:54:54.701496 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5564/6332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:54 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:55.717167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c8a6e8b5-b1d0-48f6-a324-5455cef1d5a4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:55.717844 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c8a6e8b5-b1d0-48f6-a324-5455cef1d5a4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:55.724478 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a6e8b5-b1d0-48f6-a324-5455cef1d5a4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:55.724949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a6e8b5-b1d0-48f6-a324-5455cef1d5a4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:55.725784 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a6e8b5-b1d0-48f6-a324-5455cef1d5a4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:55.726246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c8a6e8b5-b1d0-48f6-a324-5455cef1d5a4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:55.862396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c8a6e8b5-b1d0-48f6-a324-5455cef1d5a4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:55.871046 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c8a6e8b5-b1d0-48f6-a324-5455cef1d5a4 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1574 microversion: 2.1 time: 0.157839 Mar 12 21:54:55.871665 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5565/6333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:55 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:56.888861 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-57e10947-d7c5-49db-a80f-e4d3e8abfbaf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:54:56.889528 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-57e10947-d7c5-49db-a80f-e4d3e8abfbaf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:54:56.896326 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57e10947-d7c5-49db-a80f-e4d3e8abfbaf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:56.896801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57e10947-d7c5-49db-a80f-e4d3e8abfbaf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:56.897599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57e10947-d7c5-49db-a80f-e4d3e8abfbaf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:56.898092 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-57e10947-d7c5-49db-a80f-e4d3e8abfbaf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:57.030823 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-57e10947-d7c5-49db-a80f-e4d3e8abfbaf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:54:57.038303 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-57e10947-d7c5-49db-a80f-e4d3e8abfbaf tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1561 microversion: 2.1 time: 0.153916 Mar 12 21:54:57.038877 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5566/6334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:54:56 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:54:59.881143 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-63b7881f-0258-4292-b3f8-a95b456f6f1f req-0d7535da-b1a7-4313-ae7e-fd746d0aaf56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0", "name": "network-vif-plugged", "status": "completed", "tag": "dfdc859c-0d82-4538-b428-6b5a0dd9a0dd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:54:59.890720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-63b7881f-0258-4292-b3f8-a95b456f6f1f req-0d7535da-b1a7-4313-ae7e-fd746d0aaf56 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:54:59.891200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-63b7881f-0258-4292-b3f8-a95b456f6f1f req-0d7535da-b1a7-4313-ae7e-fd746d0aaf56 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:54:59.902318 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-63b7881f-0258-4292-b3f8-a95b456f6f1f req-0d7535da-b1a7-4313-ae7e-fd746d0aaf56 service nova] Creating event network-vif-plugged:dfdc859c-0d82-4538-b428-6b5a0dd9a0dd for instance 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 on nch2-master-1 Mar 12 21:54:59.907524 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-63b7881f-0258-4292-b3f8-a95b456f6f1f req-0d7535da-b1a7-4313-ae7e-fd746d0aaf56 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030106 Mar 12 21:54:59.908118 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5567/6335] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:55:13.222978 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:55:13.223538 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:55:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:55:15.674186 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:55:15.674931 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:55:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:56:16.635067 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e619e66c-7088-4f4a-973f-e2f41324837b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:16.635779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e619e66c-7088-4f4a-973f-e2f41324837b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:16.642181 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e619e66c-7088-4f4a-973f-e2f41324837b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:16.642729 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e619e66c-7088-4f4a-973f-e2f41324837b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:16.643611 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e619e66c-7088-4f4a-973f-e2f41324837b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:16.644071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e619e66c-7088-4f4a-973f-e2f41324837b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:16.669277 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e619e66c-7088-4f4a-973f-e2f41324837b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 21:56:16.746242 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e619e66c-7088-4f4a-973f-e2f41324837b tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "DELETE /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 204 len: 0 microversion: 2.1 time: 0.117884 Mar 12 21:56:16.747381 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5568/6336] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 21:56:16 2022] DELETE /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 21:56:16.754716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3e622a62-2894-4303-a589-2e386c20a384 req-75166bbf-c83c-4698-98a1-4f99f730afb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0", "tag": "dfdc859c-0d82-4538-b428-6b5a0dd9a0dd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:56:16.762835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3e622a62-2894-4303-a589-2e386c20a384 req-75166bbf-c83c-4698-98a1-4f99f730afb3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:16.763300 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3e622a62-2894-4303-a589-2e386c20a384 req-75166bbf-c83c-4698-98a1-4f99f730afb3 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:16.774464 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3e622a62-2894-4303-a589-2e386c20a384 req-75166bbf-c83c-4698-98a1-4f99f730afb3 service nova] Creating event network-changed:dfdc859c-0d82-4538-b428-6b5a0dd9a0dd for instance 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 on nch2-master-1 Mar 12 21:56:16.779973 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3e622a62-2894-4303-a589-2e386c20a384 req-75166bbf-c83c-4698-98a1-4f99f730afb3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031107 Mar 12 21:56:16.780655 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5569/6337] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:56:16.785966 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-ca5548d1-426f-4c44-ac5a-90e65d9ca6ad tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:16.786955 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-ca5548d1-426f-4c44-ac5a-90e65d9ca6ad tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:16.792970 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca5548d1-426f-4c44-ac5a-90e65d9ca6ad tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:16.793446 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca5548d1-426f-4c44-ac5a-90e65d9ca6ad tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:16.794269 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca5548d1-426f-4c44-ac5a-90e65d9ca6ad tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:16.794787 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-ca5548d1-426f-4c44-ac5a-90e65d9ca6ad tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:16.934950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-ca5548d1-426f-4c44-ac5a-90e65d9ca6ad tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:16.944962 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-ca5548d1-426f-4c44-ac5a-90e65d9ca6ad tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1567 microversion: 2.1 time: 0.163064 Mar 12 21:56:16.954545 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5570/6338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:16 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:56:17.963120 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9b026419-cbd4-4789-b7df-d09391a3193f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:17.963791 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9b026419-cbd4-4789-b7df-d09391a3193f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:17.970565 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b026419-cbd4-4789-b7df-d09391a3193f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:17.971036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b026419-cbd4-4789-b7df-d09391a3193f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:17.971891 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b026419-cbd4-4789-b7df-d09391a3193f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:17.972402 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9b026419-cbd4-4789-b7df-d09391a3193f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:18.113618 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9b026419-cbd4-4789-b7df-d09391a3193f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:18.121073 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9b026419-cbd4-4789-b7df-d09391a3193f tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1449 microversion: 2.1 time: 0.161878 Mar 12 21:56:18.121645 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5571/6339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:17 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:18.762913 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-72d34d84-045f-4160-be9a-0c71fcf62c28 req-2891fdcc-62cd-4d20-b971-1065226c5a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0", "name": "network-vif-deleted", "tag": "dfdc859c-0d82-4538-b428-6b5a0dd9a0dd"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:56:18.773062 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-72d34d84-045f-4160-be9a-0c71fcf62c28 req-2891fdcc-62cd-4d20-b971-1065226c5a03 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:18.773532 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-72d34d84-045f-4160-be9a-0c71fcf62c28 req-2891fdcc-62cd-4d20-b971-1065226c5a03 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:18.785208 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-72d34d84-045f-4160-be9a-0c71fcf62c28 req-2891fdcc-62cd-4d20-b971-1065226c5a03 service nova] Creating event network-vif-deleted:dfdc859c-0d82-4538-b428-6b5a0dd9a0dd for instance 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 on nch2-master-1 Mar 12 21:56:18.789991 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-72d34d84-045f-4160-be9a-0c71fcf62c28 req-2891fdcc-62cd-4d20-b971-1065226c5a03 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031015 Mar 12 21:56:18.790690 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5572/6340] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:56:19.140368 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-aa109961-dfea-47fa-8f21-a3c894fcea18 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:19.141104 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-aa109961-dfea-47fa-8f21-a3c894fcea18 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:19.148777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa109961-dfea-47fa-8f21-a3c894fcea18 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:19.149396 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa109961-dfea-47fa-8f21-a3c894fcea18 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:19.150243 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa109961-dfea-47fa-8f21-a3c894fcea18 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:19.151348 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa109961-dfea-47fa-8f21-a3c894fcea18 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:19.188196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa109961-dfea-47fa-8f21-a3c894fcea18 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:19.188716 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-aa109961-dfea-47fa-8f21-a3c894fcea18 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:19.189398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-aa109961-dfea-47fa-8f21-a3c894fcea18 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lazy-loading 'fault' on Instance uuid 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 21:56:19.238472 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-aa109961-dfea-47fa-8f21-a3c894fcea18 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a0b91da24b4522b5556fb5797cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe4938aa90944ae7b17fbccaa7f8afe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:19.247346 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-aa109961-dfea-47fa-8f21-a3c894fcea18 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 200 len: 1224 microversion: 2.1 time: 0.112918 Mar 12 21:56:19.247960 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5573/6341] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:19 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:56:20.264705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8301013c-d0d4-486e-a44d-af7d54d4b5d3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:20.265356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8301013c-d0d4-486e-a44d-af7d54d4b5d3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] [instance: 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:20.272736 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8301013c-d0d4-486e-a44d-af7d54d4b5d3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:20.273200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8301013c-d0d4-486e-a44d-af7d54d4b5d3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:20.274250 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8301013c-d0d4-486e-a44d-af7d54d4b5d3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:20.274704 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8301013c-d0d4-486e-a44d-af7d54d4b5d3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:20.287806 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-8301013c-d0d4-486e-a44d-af7d54d4b5d3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] HTTP exception thrown: Instance 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 could not be found. Mar 12 21:56:20.288409 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8301013c-d0d4-486e-a44d-af7d54d4b5d3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Returning 404 to user: Instance 47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 21:56:20.289236 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8301013c-d0d4-486e-a44d-af7d54d4b5d3 tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0" status: 404 len: 111 microversion: 2.1 time: 0.028540 Mar 12 21:56:20.289786 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5574/6342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:20 2022] GET /compute/v2.1/servers/47df4d8e-91fd-4c9e-a7b1-dd7292a3c4f0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 21:56:20.449672 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c5c9f35-91fe-48ae-b275-b0c1a59c096d tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] Calling method '.version_select at 0x7f6e34237310>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:20.473967 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c5c9f35-91fe-48ae-b275-b0c1a59c096d tempest-TestShelveInstance-371818113 tempest-TestShelveInstance-371818113-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-513445975" status: 202 len: 0 microversion: 2.1 time: 0.028185 Mar 12 21:56:20.479027 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5575/6343] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Mar 12 21:56:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-513445975 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 12 21:56:38.285950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-da5c0a71-97d1-48c9-8b3b-a7e0988daedc tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Action: 'create', calling method: .version_select at 0x7f6e341f5670>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-306382837"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:56:38.309374 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-da5c0a71-97d1-48c9-8b3b-a7e0988daedc tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Getting quotas for project 8417f1bcfb484822a911f003d0a9898f. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:56:38.315880 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-da5c0a71-97d1-48c9-8b3b-a7e0988daedc tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Getting quotas for user 279dd1ec634148c8acd450c086b41b4d and project 8417f1bcfb484822a911f003d0a9898f. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:56:38.443973 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-da5c0a71-97d1-48c9-8b3b-a7e0988daedc tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Getting quotas for project 8417f1bcfb484822a911f003d0a9898f. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:56:38.449639 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-da5c0a71-97d1-48c9-8b3b-a7e0988daedc tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Getting quotas for user 279dd1ec634148c8acd450c086b41b4d and project 8417f1bcfb484822a911f003d0a9898f. Resources: {'key_pairs'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:56:38.465711 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-da5c0a71-97d1-48c9-8b3b-a7e0988daedc tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.410701 Mar 12 21:56:38.466540 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5576/6344] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Mar 12 21:56:38 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:39.442043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-870853649", "imageRef": "539171db-0bd3-4f16-95fd-a7cd5530137d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-306382837", "security_groups": [{"name": "tempest-secgroup-smoke-347310666"}], "networks": [{"uuid": "3b7272bd-83de-4579-abd3-8314a89ae3ea"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:56:39.550997 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] validate_networks() for [('3b7272bd-83de-4579-abd3-8314a89ae3ea', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:56:39.927002 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:56:39.927558 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:56:39.928097 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:56:39.928534 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:56:39.928972 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:56:39.937897 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:39.938377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:39.939210 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:39.940021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:39.957637 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Getting quotas for project 8417f1bcfb484822a911f003d0a9898f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:56:39.964238 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Getting quotas for user 279dd1ec634148c8acd450c086b41b4d and project 8417f1bcfb484822a911f003d0a9898f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:56:39.977725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:56:39.980151 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='539171db-0bd3-4f16-95fd-a7cd5530137d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:56:40.025889 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-90f1ff26-25be-4c1a-9908-91bb0fd68e7f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.588427 Mar 12 21:56:40.027151 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5577/6345] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:56:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 12 21:56:40.039744 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fa0a41bc-e0d8-42d4-8f00-d7c8daaa1a08 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:40.041796 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fa0a41bc-e0d8-42d4-8f00-d7c8daaa1a08 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:40.100777 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fa0a41bc-e0d8-42d4-8f00-d7c8daaa1a08 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:40.108395 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fa0a41bc-e0d8-42d4-8f00-d7c8daaa1a08 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1247 microversion: 2.1 time: 0.074851 Mar 12 21:56:40.109229 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5578/6346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:40 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:41.131131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7e84e0dc-7eb1-4b6d-b0c1-f97d4d5437d6 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:41.133482 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7e84e0dc-7eb1-4b6d-b0c1-f97d4d5437d6 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:41.147021 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e84e0dc-7eb1-4b6d-b0c1-f97d4d5437d6 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:41.147945 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e84e0dc-7eb1-4b6d-b0c1-f97d4d5437d6 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:41.149013 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e84e0dc-7eb1-4b6d-b0c1-f97d4d5437d6 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:41.149701 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7e84e0dc-7eb1-4b6d-b0c1-f97d4d5437d6 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:41.218087 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7e84e0dc-7eb1-4b6d-b0c1-f97d4d5437d6 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:41.226207 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7e84e0dc-7eb1-4b6d-b0c1-f97d4d5437d6 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1305 microversion: 2.1 time: 0.103616 Mar 12 21:56:41.226778 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5579/6347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:41 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:42.243855 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-e03dde68-041a-43af-bb50-7acea136bf46 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:42.244505 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-e03dde68-041a-43af-bb50-7acea136bf46 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:42.255230 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e03dde68-041a-43af-bb50-7acea136bf46 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:42.255712 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e03dde68-041a-43af-bb50-7acea136bf46 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:42.256530 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e03dde68-041a-43af-bb50-7acea136bf46 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:42.257202 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-e03dde68-041a-43af-bb50-7acea136bf46 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:42.437524 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-e03dde68-041a-43af-bb50-7acea136bf46 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:42.448055 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-e03dde68-041a-43af-bb50-7acea136bf46 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1372 microversion: 2.1 time: 0.207953 Mar 12 21:56:42.449498 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5580/6348] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:42 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1372 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:42.519030 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-48e04751-5d9c-46fa-bd11-14a6c310cb80 req-9c88ba5e-abc0-429a-8a1f-21088069441d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73669ed-0924-498f-b913-f4120381e01f", "tag": "ddfc7ade-f99c-4665-b85a-9d3ced4efa43"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:56:42.529909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-48e04751-5d9c-46fa-bd11-14a6c310cb80 req-9c88ba5e-abc0-429a-8a1f-21088069441d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:42.530386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-48e04751-5d9c-46fa-bd11-14a6c310cb80 req-9c88ba5e-abc0-429a-8a1f-21088069441d service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:42.548169 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-48e04751-5d9c-46fa-bd11-14a6c310cb80 req-9c88ba5e-abc0-429a-8a1f-21088069441d service nova] Creating event network-changed:ddfc7ade-f99c-4665-b85a-9d3ced4efa43 for instance d73669ed-0924-498f-b913-f4120381e01f on nch1-master-1 Mar 12 21:56:42.555074 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-48e04751-5d9c-46fa-bd11-14a6c310cb80 req-9c88ba5e-abc0-429a-8a1f-21088069441d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040830 Mar 12 21:56:42.555837 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5581/6349] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:56:43.467295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c62315a2-048c-4adb-a4e3-a7d3e73d536e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:43.468162 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c62315a2-048c-4adb-a4e3-a7d3e73d536e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:43.474563 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c62315a2-048c-4adb-a4e3-a7d3e73d536e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:43.475043 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c62315a2-048c-4adb-a4e3-a7d3e73d536e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:43.475878 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c62315a2-048c-4adb-a4e3-a7d3e73d536e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:43.476342 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c62315a2-048c-4adb-a4e3-a7d3e73d536e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:43.616556 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c62315a2-048c-4adb-a4e3-a7d3e73d536e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:43.624061 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c62315a2-048c-4adb-a4e3-a7d3e73d536e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1372 microversion: 2.1 time: 0.162111 Mar 12 21:56:43.624626 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5582/6350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:43 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:44.641431 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9719c4c6-2548-4a38-97e9-72ed7e0bc345 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:44.642178 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9719c4c6-2548-4a38-97e9-72ed7e0bc345 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:44.649615 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9719c4c6-2548-4a38-97e9-72ed7e0bc345 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:44.650124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9719c4c6-2548-4a38-97e9-72ed7e0bc345 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:44.650918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9719c4c6-2548-4a38-97e9-72ed7e0bc345 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:44.651376 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9719c4c6-2548-4a38-97e9-72ed7e0bc345 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:44.789711 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9719c4c6-2548-4a38-97e9-72ed7e0bc345 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:44.797075 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9719c4c6-2548-4a38-97e9-72ed7e0bc345 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1372 microversion: 2.1 time: 0.159573 Mar 12 21:56:44.797651 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5583/6351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:44 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:45.813820 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-effb3f85-9598-404a-9dab-a9c126e3775f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:45.814447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-effb3f85-9598-404a-9dab-a9c126e3775f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:45.821115 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-effb3f85-9598-404a-9dab-a9c126e3775f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:45.821590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-effb3f85-9598-404a-9dab-a9c126e3775f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:45.822419 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-effb3f85-9598-404a-9dab-a9c126e3775f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:45.822871 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-effb3f85-9598-404a-9dab-a9c126e3775f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:45.957918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-effb3f85-9598-404a-9dab-a9c126e3775f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:45.967956 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-effb3f85-9598-404a-9dab-a9c126e3775f tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1372 microversion: 2.1 time: 0.157551 Mar 12 21:56:45.969004 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5584/6352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:45 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:46.986025 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d738fd9d-da10-4992-b017-bdd1632ba058 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:46.986686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d738fd9d-da10-4992-b017-bdd1632ba058 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:46.993366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d738fd9d-da10-4992-b017-bdd1632ba058 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:46.993921 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d738fd9d-da10-4992-b017-bdd1632ba058 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:46.994664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d738fd9d-da10-4992-b017-bdd1632ba058 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:46.995124 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d738fd9d-da10-4992-b017-bdd1632ba058 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:47.130108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-d738fd9d-da10-4992-b017-bdd1632ba058 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:47.137444 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d738fd9d-da10-4992-b017-bdd1632ba058 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1372 microversion: 2.1 time: 0.155462 Mar 12 21:56:47.138049 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5585/6353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:46 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:47.548784 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:56:47.549346 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:56:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:56:47.991578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-61871095-faf3-40ed-a9fe-d4097f10a037 req-a2f6055d-ab99-45bb-b8fb-f9504be3158e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73669ed-0924-498f-b913-f4120381e01f", "name": "network-vif-plugged", "status": "completed", "tag": "ddfc7ade-f99c-4665-b85a-9d3ced4efa43"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:56:48.000649 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-61871095-faf3-40ed-a9fe-d4097f10a037 req-a2f6055d-ab99-45bb-b8fb-f9504be3158e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:48.001001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-61871095-faf3-40ed-a9fe-d4097f10a037 req-a2f6055d-ab99-45bb-b8fb-f9504be3158e service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:48.012541 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-61871095-faf3-40ed-a9fe-d4097f10a037 req-a2f6055d-ab99-45bb-b8fb-f9504be3158e service nova] Creating event network-vif-plugged:ddfc7ade-f99c-4665-b85a-9d3ced4efa43 for instance d73669ed-0924-498f-b913-f4120381e01f on nch1-master-1 Mar 12 21:56:48.018043 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-61871095-faf3-40ed-a9fe-d4097f10a037 req-a2f6055d-ab99-45bb-b8fb-f9504be3158e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029648 Mar 12 21:56:48.018650 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5586/6354] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:56:48.155725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-1f16d91f-651e-4e74-96fa-91e4586e5e10 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:48.156686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-1f16d91f-651e-4e74-96fa-91e4586e5e10 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:48.162943 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f16d91f-651e-4e74-96fa-91e4586e5e10 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:48.163497 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f16d91f-651e-4e74-96fa-91e4586e5e10 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:48.164312 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f16d91f-651e-4e74-96fa-91e4586e5e10 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:48.164760 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-1f16d91f-651e-4e74-96fa-91e4586e5e10 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:48.305545 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-1f16d91f-651e-4e74-96fa-91e4586e5e10 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:48.312970 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-1f16d91f-651e-4e74-96fa-91e4586e5e10 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1372 microversion: 2.1 time: 0.161834 Mar 12 21:56:48.313551 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5587/6355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:48 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:49.330614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-eeda1c5d-6105-4d55-8c23-61da04ef6590 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:49.331304 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-eeda1c5d-6105-4d55-8c23-61da04ef6590 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:49.337931 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeda1c5d-6105-4d55-8c23-61da04ef6590 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:49.338398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeda1c5d-6105-4d55-8c23-61da04ef6590 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:49.339212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeda1c5d-6105-4d55-8c23-61da04ef6590 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:49.339660 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-eeda1c5d-6105-4d55-8c23-61da04ef6590 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:49.473535 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-eeda1c5d-6105-4d55-8c23-61da04ef6590 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:49.481996 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-eeda1c5d-6105-4d55-8c23-61da04ef6590 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1372 microversion: 2.1 time: 0.155837 Mar 12 21:56:49.482583 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5588/6356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:49 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:50.499233 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4c11dbf2-4536-4c22-bdba-6ac44acb8e05 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:50.499881 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4c11dbf2-4536-4c22-bdba-6ac44acb8e05 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:50.507227 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c11dbf2-4536-4c22-bdba-6ac44acb8e05 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:50.507691 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c11dbf2-4536-4c22-bdba-6ac44acb8e05 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:50.508924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c11dbf2-4536-4c22-bdba-6ac44acb8e05 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:50.509388 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4c11dbf2-4536-4c22-bdba-6ac44acb8e05 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:50.646821 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4c11dbf2-4536-4c22-bdba-6ac44acb8e05 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:50.654310 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4c11dbf2-4536-4c22-bdba-6ac44acb8e05 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1557 microversion: 2.1 time: 0.158962 Mar 12 21:56:50.654887 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5589/6357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:50 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:50.669991 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-552d4c2e-083c-4921-9588-4d1b0fb1d1a5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:56:50.670610 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-552d4c2e-083c-4921-9588-4d1b0fb1d1a5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:56:50.676710 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-552d4c2e-083c-4921-9588-4d1b0fb1d1a5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:50.677179 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-552d4c2e-083c-4921-9588-4d1b0fb1d1a5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:50.678001 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-552d4c2e-083c-4921-9588-4d1b0fb1d1a5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:50.678452 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-552d4c2e-083c-4921-9588-4d1b0fb1d1a5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:50.811279 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-552d4c2e-083c-4921-9588-4d1b0fb1d1a5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:56:50.818628 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-552d4c2e-083c-4921-9588-4d1b0fb1d1a5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1557 microversion: 2.1 time: 0.152147 Mar 12 21:56:50.819204 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5590/6358] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:56:50 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:56:52.845133 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-cdc4c013-f876-4012-9707-98721faca19c req-88ccd251-891d-4fb3-baaf-ec68337bb96c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73669ed-0924-498f-b913-f4120381e01f", "tag": "ddfc7ade-f99c-4665-b85a-9d3ced4efa43"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:56:52.857454 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cdc4c013-f876-4012-9707-98721faca19c req-88ccd251-891d-4fb3-baaf-ec68337bb96c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:56:52.858285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-cdc4c013-f876-4012-9707-98721faca19c req-88ccd251-891d-4fb3-baaf-ec68337bb96c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:56:52.870377 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-cdc4c013-f876-4012-9707-98721faca19c req-88ccd251-891d-4fb3-baaf-ec68337bb96c service nova] Creating event network-changed:ddfc7ade-f99c-4665-b85a-9d3ced4efa43 for instance d73669ed-0924-498f-b913-f4120381e01f on nch1-master-1 Mar 12 21:56:52.875653 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-cdc4c013-f876-4012-9707-98721faca19c req-88ccd251-891d-4fb3-baaf-ec68337bb96c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034564 Mar 12 21:56:52.876303 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5591/6359] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:58:33.231067 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:58:33.231695 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:58:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:58:35.682373 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:58:35.683002 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 21:58:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 21:59:16.978817 ncdv-master-1 devstack@n-api.service[136302]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3b3a5e23-4d61-4ee0-b93f-1df1716bb266] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 12 21:59:16.979655 ncdv-master-1 devstack@n-api.service[136302]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6333ff2d-0072-4370-9794-f5297b7a2156] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 12 21:59:16.984226 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2ace4fff-bc6a-4e56-b266-32495fa51129 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1984678482"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:59:16.985339 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2ace4fff-bc6a-4e56-b266-32495fa51129 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:16.991574 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ace4fff-bc6a-4e56-b266-32495fa51129 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:16.992036 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ace4fff-bc6a-4e56-b266-32495fa51129 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:16.992909 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ace4fff-bc6a-4e56-b266-32495fa51129 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:16.993361 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2ace4fff-bc6a-4e56-b266-32495fa51129 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:17.392744 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2ace4fff-bc6a-4e56-b266-32495fa51129 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "POST /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f/action" status: 202 len: 0 microversion: 2.1 time: 0.416248 Mar 12 21:59:17.393815 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5592/6360] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 21:59:16 2022] POST /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Mar 12 21:59:24.757458 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] [6333ff2d-0072-4370-9794-f5297b7a2156] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60776. Mar 12 21:59:24.758426 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] [3b3a5e23-4d61-4ee0-b93f-1df1716bb266] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60774. Mar 12 21:59:24.810356 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-60d4ef12-1194-4b85-9022-3ca2739e34f4 req-246b0a49-1a34-4916-b579-ed860f5daaaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73669ed-0924-498f-b913-f4120381e01f", "name": "network-vif-plugged", "status": "completed", "tag": "ddfc7ade-f99c-4665-b85a-9d3ced4efa43"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:59:24.819648 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-60d4ef12-1194-4b85-9022-3ca2739e34f4 req-246b0a49-1a34-4916-b579-ed860f5daaaa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:24.820119 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-60d4ef12-1194-4b85-9022-3ca2739e34f4 req-246b0a49-1a34-4916-b579-ed860f5daaaa service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:24.830464 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-60d4ef12-1194-4b85-9022-3ca2739e34f4 req-246b0a49-1a34-4916-b579-ed860f5daaaa service nova] Creating event network-vif-plugged:ddfc7ade-f99c-4665-b85a-9d3ced4efa43 for instance d73669ed-0924-498f-b913-f4120381e01f on nch1-master-1 Mar 12 21:59:24.836107 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-60d4ef12-1194-4b85-9022-3ca2739e34f4 req-246b0a49-1a34-4916-b579-ed860f5daaaa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091584 Mar 12 21:59:24.836698 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5593/6361] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:59:34.993004 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1961641745", "imageRef": "3c8362e1-9db5-4a70-98b5-d8c971ccb1db", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-306382837", "security_groups": [{"name": "tempest-secgroup-smoke-347310666"}], "networks": [{"uuid": "3b7272bd-83de-4579-abd3-8314a89ae3ea"}]}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:59:35.099367 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.network.neutron [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] validate_networks() for [('3b7272bd-83de-4579-abd3-8314a89ae3ea', None, None, None, None, None)] {{(pid=136302) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 12 21:59:35.507950 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Flavor limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 12 21:59:35.508401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Image limits 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 12 21:59:35.508900 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Flavor pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 12 21:59:35.509331 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Image pref 0:0:0 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 12 21:59:35.509780 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.virt.hardware [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136302) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 12 21:59:35.518463 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:35.518933 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:35.519753 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:35.520212 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:35.537822 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Getting quotas for project 8417f1bcfb484822a911f003d0a9898f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 12 21:59:35.544186 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.quota [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Getting quotas for user 279dd1ec634148c8acd450c086b41b4d and project 8417f1bcfb484822a911f003d0a9898f. Resources: {'ram', 'instances', 'cores'} {{(pid=136302) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 12 21:59:35.557051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Going to run 1 instances... {{(pid=136302) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 12 21:59:35.559587 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3c8362e1-9db5-4a70-98b5-d8c971ccb1db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136302) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 12 21:59:35.602766 ncdv-master-1 devstack@n-api.service[136302]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [3b63f1da-9c43-4aa5-a55a-fe942d6a92f1] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 12 21:59:36.610480 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [3b63f1da-9c43-4aa5-a55a-fe942d6a92f1] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60894. Mar 12 21:59:36.615444 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-d72a66e5-7cf6-487e-9ec5-85be0ca8b80b tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.628266 Mar 12 21:59:36.616096 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5594/6362] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Mar 12 21:59:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 12 21:59:36.625626 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a810f5fc-dbdf-4408-83a3-d81521910035 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:36.626314 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a810f5fc-dbdf-4408-83a3-d81521910035 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:36.678606 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a810f5fc-dbdf-4408-83a3-d81521910035 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:36.685174 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a810f5fc-dbdf-4408-83a3-d81521910035 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1248 microversion: 2.1 time: 0.063271 Mar 12 21:59:36.685752 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5595/6363] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:36 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1248 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:37.701306 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8019c630-38b1-4b76-b4dd-6ea8166f6b53 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:37.702047 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8019c630-38b1-4b76-b4dd-6ea8166f6b53 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:37.710103 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8019c630-38b1-4b76-b4dd-6ea8166f6b53 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:37.710577 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8019c630-38b1-4b76-b4dd-6ea8166f6b53 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:37.711366 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8019c630-38b1-4b76-b4dd-6ea8166f6b53 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:37.711826 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8019c630-38b1-4b76-b4dd-6ea8166f6b53 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:37.775320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8019c630-38b1-4b76-b4dd-6ea8166f6b53 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:37.782729 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8019c630-38b1-4b76-b4dd-6ea8166f6b53 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1252 microversion: 2.1 time: 0.085462 Mar 12 21:59:37.783300 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5596/6364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:37 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1252 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:38.803599 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9866942d-7441-4fec-b2f4-e05f29d28899 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:38.805079 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9866942d-7441-4fec-b2f4-e05f29d28899 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:38.812498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9866942d-7441-4fec-b2f4-e05f29d28899 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:38.813232 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9866942d-7441-4fec-b2f4-e05f29d28899 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:38.814392 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9866942d-7441-4fec-b2f4-e05f29d28899 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:38.814924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9866942d-7441-4fec-b2f4-e05f29d28899 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:38.925064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9866942d-7441-4fec-b2f4-e05f29d28899 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:38.933815 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9866942d-7441-4fec-b2f4-e05f29d28899 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1306 microversion: 2.1 time: 0.134377 Mar 12 21:59:38.945110 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5597/6365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:38 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1306 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:59:38.950319 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-7f28955c-b859-4765-9f3d-a74a71cf0093 req-bd6276b3-bd21-419b-893a-0d89ad054c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73669ed-0924-498f-b913-f4120381e01f", "name": "network-vif-unplugged", "status": "completed", "tag": "ddfc7ade-f99c-4665-b85a-9d3ced4efa43"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:59:38.959225 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7f28955c-b859-4765-9f3d-a74a71cf0093 req-bd6276b3-bd21-419b-893a-0d89ad054c01 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:38.959720 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-7f28955c-b859-4765-9f3d-a74a71cf0093 req-bd6276b3-bd21-419b-893a-0d89ad054c01 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:38.972078 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-7f28955c-b859-4765-9f3d-a74a71cf0093 req-bd6276b3-bd21-419b-893a-0d89ad054c01 service nova] Creating event network-vif-unplugged:ddfc7ade-f99c-4665-b85a-9d3ced4efa43 for instance d73669ed-0924-498f-b913-f4120381e01f on nch1-master-1 Mar 12 21:59:38.981101 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-7f28955c-b859-4765-9f3d-a74a71cf0093 req-bd6276b3-bd21-419b-893a-0d89ad054c01 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034080 Mar 12 21:59:38.982664 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5598/6366] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:59:39.954041 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8c22e08b-7723-44a3-8b3e-26ba6d7952af tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:39.955518 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8c22e08b-7723-44a3-8b3e-26ba6d7952af tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:39.963008 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c22e08b-7723-44a3-8b3e-26ba6d7952af tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:39.963488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c22e08b-7723-44a3-8b3e-26ba6d7952af tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:39.964328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c22e08b-7723-44a3-8b3e-26ba6d7952af tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:39.964995 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8c22e08b-7723-44a3-8b3e-26ba6d7952af tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:40.108029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8c22e08b-7723-44a3-8b3e-26ba6d7952af tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:40.116157 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8c22e08b-7723-44a3-8b3e-26ba6d7952af tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.167438 Mar 12 21:59:40.126185 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5599/6367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:39 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:41.137424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-19b39043-9f16-4006-b589-412b5625e1d5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:41.139022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-19b39043-9f16-4006-b589-412b5625e1d5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:41.147330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19b39043-9f16-4006-b589-412b5625e1d5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:41.147799 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19b39043-9f16-4006-b589-412b5625e1d5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:41.148605 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19b39043-9f16-4006-b589-412b5625e1d5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:41.149320 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-19b39043-9f16-4006-b589-412b5625e1d5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:41.295295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-19b39043-9f16-4006-b589-412b5625e1d5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:41.303205 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-19b39043-9f16-4006-b589-412b5625e1d5 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.171799 Mar 12 21:59:41.303797 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5600/6368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:41 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:59:42.320709 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-53647536-5e7c-48fc-9255-e3654400f497 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:42.321466 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-53647536-5e7c-48fc-9255-e3654400f497 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:42.328163 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53647536-5e7c-48fc-9255-e3654400f497 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:42.328636 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53647536-5e7c-48fc-9255-e3654400f497 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:42.329424 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53647536-5e7c-48fc-9255-e3654400f497 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:42.329911 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-53647536-5e7c-48fc-9255-e3654400f497 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:42.475593 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-53647536-5e7c-48fc-9255-e3654400f497 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:42.483302 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-53647536-5e7c-48fc-9255-e3654400f497 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.167017 Mar 12 21:59:42.484106 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5601/6369] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:42 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:43.500337 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9499465f-feac-41c5-bb87-540a3ba4de21 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:43.501061 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9499465f-feac-41c5-bb87-540a3ba4de21 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:43.508412 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9499465f-feac-41c5-bb87-540a3ba4de21 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:43.508888 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9499465f-feac-41c5-bb87-540a3ba4de21 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:43.509924 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9499465f-feac-41c5-bb87-540a3ba4de21 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:43.510559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9499465f-feac-41c5-bb87-540a3ba4de21 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:43.662493 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9499465f-feac-41c5-bb87-540a3ba4de21 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:43.671349 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9499465f-feac-41c5-bb87-540a3ba4de21 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.174919 Mar 12 21:59:43.672142 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5602/6370] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:43 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:44.703335 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-4fc21de4-8d5b-4f92-8347-32732c488ae7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:44.704029 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-4fc21de4-8d5b-4f92-8347-32732c488ae7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:44.712236 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fc21de4-8d5b-4f92-8347-32732c488ae7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:44.712722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fc21de4-8d5b-4f92-8347-32732c488ae7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:44.713567 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fc21de4-8d5b-4f92-8347-32732c488ae7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:44.714071 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-4fc21de4-8d5b-4f92-8347-32732c488ae7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:44.867191 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-4fc21de4-8d5b-4f92-8347-32732c488ae7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:44.880646 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-4fc21de4-8d5b-4f92-8347-32732c488ae7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.182138 Mar 12 21:59:44.881286 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5603/6371] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:44 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 21:59:45.146486 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 21:59:45.146839 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 21:59:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 21:59:45.898659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-34e66506-f7bf-4572-98a2-7d3639d163c3 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:45.899890 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-34e66506-f7bf-4572-98a2-7d3639d163c3 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:45.906480 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34e66506-f7bf-4572-98a2-7d3639d163c3 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:45.906951 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34e66506-f7bf-4572-98a2-7d3639d163c3 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:45.907739 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34e66506-f7bf-4572-98a2-7d3639d163c3 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:45.908194 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-34e66506-f7bf-4572-98a2-7d3639d163c3 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:46.069255 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-34e66506-f7bf-4572-98a2-7d3639d163c3 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:46.077133 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-34e66506-f7bf-4572-98a2-7d3639d163c3 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.182461 Mar 12 21:59:46.077722 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5604/6372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:45 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:47.093835 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-8e03e03b-ee09-41c3-994d-aadd0401b6fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:47.094540 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-8e03e03b-ee09-41c3-994d-aadd0401b6fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:47.101085 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e03e03b-ee09-41c3-994d-aadd0401b6fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:47.101559 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e03e03b-ee09-41c3-994d-aadd0401b6fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:47.102384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e03e03b-ee09-41c3-994d-aadd0401b6fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:47.102845 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-8e03e03b-ee09-41c3-994d-aadd0401b6fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:47.245508 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-8e03e03b-ee09-41c3-994d-aadd0401b6fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:47.253210 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-8e03e03b-ee09-41c3-994d-aadd0401b6fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.163398 Mar 12 21:59:47.253907 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5605/6373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:47 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:47.581510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-2ae0aeb2-76a0-409a-a2d3-a8434fd22c60 req-49ae8455-7e68-458b-895f-862bf32857a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4cd8ed2-f993-49d5-a015-f834295370c7", "tag": "26b81367-e8ea-4aba-937d-c64353752fdf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:59:47.590885 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2ae0aeb2-76a0-409a-a2d3-a8434fd22c60 req-49ae8455-7e68-458b-895f-862bf32857a4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:47.591619 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-2ae0aeb2-76a0-409a-a2d3-a8434fd22c60 req-49ae8455-7e68-458b-895f-862bf32857a4 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:47.606743 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-2ae0aeb2-76a0-409a-a2d3-a8434fd22c60 req-49ae8455-7e68-458b-895f-862bf32857a4 service nova] Creating event network-changed:26b81367-e8ea-4aba-937d-c64353752fdf for instance e4cd8ed2-f993-49d5-a015-f834295370c7 on nch2-master-1 Mar 12 21:59:47.611834 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-2ae0aeb2-76a0-409a-a2d3-a8434fd22c60 req-49ae8455-7e68-458b-895f-862bf32857a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116755 Mar 12 21:59:47.612574 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5606/6374] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 21:59:48.272292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-7c48833d-bd5b-4b2d-80bc-a0df6b8db1f7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:48.273051 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-7c48833d-bd5b-4b2d-80bc-a0df6b8db1f7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:48.279488 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c48833d-bd5b-4b2d-80bc-a0df6b8db1f7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:48.279959 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c48833d-bd5b-4b2d-80bc-a0df6b8db1f7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:48.280751 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c48833d-bd5b-4b2d-80bc-a0df6b8db1f7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:48.281213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-7c48833d-bd5b-4b2d-80bc-a0df6b8db1f7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:48.417382 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-7c48833d-bd5b-4b2d-80bc-a0df6b8db1f7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:48.424810 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-7c48833d-bd5b-4b2d-80bc-a0df6b8db1f7 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.158391 Mar 12 21:59:48.425390 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5607/6375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:48 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:49.441221 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-0d0cc0dc-7988-416d-8e15-9187b6d4bb35 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:49.441901 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-0d0cc0dc-7988-416d-8e15-9187b6d4bb35 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:49.448738 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d0cc0dc-7988-416d-8e15-9187b6d4bb35 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:49.449213 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d0cc0dc-7988-416d-8e15-9187b6d4bb35 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:49.450040 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d0cc0dc-7988-416d-8e15-9187b6d4bb35 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:49.450510 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-0d0cc0dc-7988-416d-8e15-9187b6d4bb35 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:49.588254 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-0d0cc0dc-7988-416d-8e15-9187b6d4bb35 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:49.595576 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-0d0cc0dc-7988-416d-8e15-9187b6d4bb35 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.158364 Mar 12 21:59:49.596179 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5608/6376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:49 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:50.613027 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-bff236bc-44b4-43c3-b149-44ed93adc04e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:50.613698 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-bff236bc-44b4-43c3-b149-44ed93adc04e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:50.621095 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bff236bc-44b4-43c3-b149-44ed93adc04e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:50.621579 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bff236bc-44b4-43c3-b149-44ed93adc04e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:50.622413 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bff236bc-44b4-43c3-b149-44ed93adc04e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:50.622876 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-bff236bc-44b4-43c3-b149-44ed93adc04e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:50.758187 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-bff236bc-44b4-43c3-b149-44ed93adc04e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:50.765663 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-bff236bc-44b4-43c3-b149-44ed93adc04e tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.156603 Mar 12 21:59:50.766284 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5609/6377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:50 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:51.782763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-fa4906af-db44-4c03-969d-01d6e9886b97 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:51.783397 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-fa4906af-db44-4c03-969d-01d6e9886b97 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:51.790219 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4906af-db44-4c03-969d-01d6e9886b97 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:51.790687 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4906af-db44-4c03-969d-01d6e9886b97 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:51.791468 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4906af-db44-4c03-969d-01d6e9886b97 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:51.791918 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-fa4906af-db44-4c03-969d-01d6e9886b97 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:51.936285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-fa4906af-db44-4c03-969d-01d6e9886b97 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:51.944691 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-fa4906af-db44-4c03-969d-01d6e9886b97 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.165876 Mar 12 21:59:51.945292 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5610/6378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:51 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:52.962684 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f62d674a-358d-4d94-8200-c8d25b6ac829 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:52.963316 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f62d674a-358d-4d94-8200-c8d25b6ac829 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:52.970292 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f62d674a-358d-4d94-8200-c8d25b6ac829 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:52.970772 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f62d674a-358d-4d94-8200-c8d25b6ac829 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:52.971564 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f62d674a-358d-4d94-8200-c8d25b6ac829 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:52.972022 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f62d674a-358d-4d94-8200-c8d25b6ac829 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:53.112864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-f62d674a-358d-4d94-8200-c8d25b6ac829 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:53.121100 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f62d674a-358d-4d94-8200-c8d25b6ac829 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.162377 Mar 12 21:59:53.121686 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5611/6379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:52 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:53.167576 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-8c0fecce-2055-4f25-a259-61dbbd0c4c6a req-8de35449-227e-41bf-8086-1f6193c2c549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cd8ed2-f993-49d5-a015-f834295370c7", "name": "network-vif-plugged", "status": "completed", "tag": "26b81367-e8ea-4aba-937d-c64353752fdf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:59:53.177899 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8c0fecce-2055-4f25-a259-61dbbd0c4c6a req-8de35449-227e-41bf-8086-1f6193c2c549 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:53.178509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-8c0fecce-2055-4f25-a259-61dbbd0c4c6a req-8de35449-227e-41bf-8086-1f6193c2c549 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:53.189614 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-8c0fecce-2055-4f25-a259-61dbbd0c4c6a req-8de35449-227e-41bf-8086-1f6193c2c549 service nova] Creating event network-vif-plugged:26b81367-e8ea-4aba-937d-c64353752fdf for instance e4cd8ed2-f993-49d5-a015-f834295370c7 on nch2-master-1 Mar 12 21:59:53.195511 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-8c0fecce-2055-4f25-a259-61dbbd0c4c6a req-8de35449-227e-41bf-8086-1f6193c2c549 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031569 Mar 12 21:59:53.196457 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5612/6380] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 21:59:54.140053 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c2a977cf-8fc3-4b69-a145-40dea0cd3ff2 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:54.140779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c2a977cf-8fc3-4b69-a145-40dea0cd3ff2 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:54.147509 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2a977cf-8fc3-4b69-a145-40dea0cd3ff2 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:54.147977 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2a977cf-8fc3-4b69-a145-40dea0cd3ff2 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:54.148763 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2a977cf-8fc3-4b69-a145-40dea0cd3ff2 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:54.149473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c2a977cf-8fc3-4b69-a145-40dea0cd3ff2 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:54.283313 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c2a977cf-8fc3-4b69-a145-40dea0cd3ff2 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:54.290747 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c2a977cf-8fc3-4b69-a145-40dea0cd3ff2 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1373 microversion: 2.1 time: 0.155849 Mar 12 21:59:54.291327 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5613/6381] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:54 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:55.307526 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-b884aaa6-54fc-4e3c-a68a-ec3dfa3667ad tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:55.308200 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-b884aaa6-54fc-4e3c-a68a-ec3dfa3667ad tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:55.314484 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b884aaa6-54fc-4e3c-a68a-ec3dfa3667ad tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:55.314957 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b884aaa6-54fc-4e3c-a68a-ec3dfa3667ad tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:55.315746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b884aaa6-54fc-4e3c-a68a-ec3dfa3667ad tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:55.316207 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-b884aaa6-54fc-4e3c-a68a-ec3dfa3667ad tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:55.454447 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-b884aaa6-54fc-4e3c-a68a-ec3dfa3667ad tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:55.462507 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-b884aaa6-54fc-4e3c-a68a-ec3dfa3667ad tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1559 microversion: 2.1 time: 0.158941 Mar 12 21:59:55.463082 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5614/6382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:55 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:55.478377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5f2538de-e391-431d-81f7-3be58c7a2c24 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 21:59:55.479000 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5f2538de-e391-431d-81f7-3be58c7a2c24 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 21:59:55.484864 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f2538de-e391-431d-81f7-3be58c7a2c24 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:55.485330 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f2538de-e391-431d-81f7-3be58c7a2c24 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:55.486132 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f2538de-e391-431d-81f7-3be58c7a2c24 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:55.486584 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5f2538de-e391-431d-81f7-3be58c7a2c24 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:55.619917 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5f2538de-e391-431d-81f7-3be58c7a2c24 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 21:59:55.627290 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5f2538de-e391-431d-81f7-3be58c7a2c24 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1559 microversion: 2.1 time: 0.152624 Mar 12 21:59:55.627863 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5615/6383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 21:59:55 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 21:59:57.542944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-4bb5505c-c881-450e-9e25-fa8b065a9fca req-40c21458-8fc5-466a-9228-4c83f2cac715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4cd8ed2-f993-49d5-a015-f834295370c7", "tag": "26b81367-e8ea-4aba-937d-c64353752fdf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 21:59:57.552127 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4bb5505c-c881-450e-9e25-fa8b065a9fca req-40c21458-8fc5-466a-9228-4c83f2cac715 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 21:59:57.552590 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-4bb5505c-c881-450e-9e25-fa8b065a9fca req-40c21458-8fc5-466a-9228-4c83f2cac715 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 21:59:57.564292 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-4bb5505c-c881-450e-9e25-fa8b065a9fca req-40c21458-8fc5-466a-9228-4c83f2cac715 service nova] Creating event network-changed:26b81367-e8ea-4aba-937d-c64353752fdf for instance e4cd8ed2-f993-49d5-a015-f834295370c7 on nch2-master-1 Mar 12 21:59:57.569386 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-4bb5505c-c881-450e-9e25-fa8b065a9fca req-40c21458-8fc5-466a-9228-4c83f2cac715 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030664 Mar 12 21:59:57.570106 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5616/6384] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 21:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 22:00:07.556576 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:00:07.557216 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 22:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 22:01:18.187490 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-66ed4e3c-476f-44eb-aed0-f004d950b3fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1422528446"}} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 22:01:18.188555 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-66ed4e3c-476f-44eb-aed0-f004d950b3fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 22:01:18.195377 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66ed4e3c-476f-44eb-aed0-f004d950b3fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:18.195842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66ed4e3c-476f-44eb-aed0-f004d950b3fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:18.196664 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66ed4e3c-476f-44eb-aed0-f004d950b3fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:18.197117 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-66ed4e3c-476f-44eb-aed0-f004d950b3fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:18.462269 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-66ed4e3c-476f-44eb-aed0-f004d950b3fe tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "POST /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7/action" status: 202 len: 0 microversion: 2.1 time: 0.281977 Mar 12 22:01:18.462851 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5617/6385] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Mar 12 22:01:18 2022] POST /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Mar 12 22:01:23.724084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-3b729db3-f5b4-49f2-8c1d-ab647003f779 req-cb312c53-69d9-4413-a63b-7d83d92bdc79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cd8ed2-f993-49d5-a015-f834295370c7", "name": "network-vif-plugged", "status": "completed", "tag": "26b81367-e8ea-4aba-937d-c64353752fdf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 22:01:23.734295 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3b729db3-f5b4-49f2-8c1d-ab647003f779 req-cb312c53-69d9-4413-a63b-7d83d92bdc79 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:23.735203 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-3b729db3-f5b4-49f2-8c1d-ab647003f779 req-cb312c53-69d9-4413-a63b-7d83d92bdc79 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:23.748011 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-3b729db3-f5b4-49f2-8c1d-ab647003f779 req-cb312c53-69d9-4413-a63b-7d83d92bdc79 service nova] Creating event network-vif-plugged:26b81367-e8ea-4aba-937d-c64353752fdf for instance e4cd8ed2-f993-49d5-a015-f834295370c7 on nch2-master-1 Mar 12 22:01:23.754211 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-3b729db3-f5b4-49f2-8c1d-ab647003f779 req-cb312c53-69d9-4413-a63b-7d83d92bdc79 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034208 Mar 12 22:01:23.754822 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5618/6386] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 22:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 22:01:32.056591 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-f49cbf74-6c74-4ea7-bedc-a20d78796d13 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 22:01:32.057398 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f49cbf74-6c74-4ea7-bedc-a20d78796d13 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 22:01:32.063817 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f49cbf74-6c74-4ea7-bedc-a20d78796d13 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:32.064282 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f49cbf74-6c74-4ea7-bedc-a20d78796d13 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:32.065578 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f49cbf74-6c74-4ea7-bedc-a20d78796d13 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:32.066056 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-f49cbf74-6c74-4ea7-bedc-a20d78796d13 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:32.091969 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-f49cbf74-6c74-4ea7-bedc-a20d78796d13 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 22:01:32.170277 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-f49cbf74-6c74-4ea7-bedc-a20d78796d13 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 204 len: 0 microversion: 2.1 time: 0.118867 Mar 12 22:01:32.171241 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5619/6387] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 22:01:32 2022] DELETE /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 12 22:01:32.179678 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-29644356-00aa-4f96-9a15-f372f51e1366 req-361668a6-7180-445e-a2d9-6e42ceb0714c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4cd8ed2-f993-49d5-a015-f834295370c7", "tag": "26b81367-e8ea-4aba-937d-c64353752fdf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 22:01:32.187779 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-29644356-00aa-4f96-9a15-f372f51e1366 req-361668a6-7180-445e-a2d9-6e42ceb0714c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:32.188244 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-29644356-00aa-4f96-9a15-f372f51e1366 req-361668a6-7180-445e-a2d9-6e42ceb0714c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:32.199856 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-29644356-00aa-4f96-9a15-f372f51e1366 req-361668a6-7180-445e-a2d9-6e42ceb0714c service nova] Creating event network-changed:26b81367-e8ea-4aba-937d-c64353752fdf for instance e4cd8ed2-f993-49d5-a015-f834295370c7 on nch2-master-1 Mar 12 22:01:32.204683 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-29644356-00aa-4f96-9a15-f372f51e1366 req-361668a6-7180-445e-a2d9-6e42ceb0714c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032108 Mar 12 22:01:32.205526 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5620/6388] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 22:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 22:01:32.210311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-2730ff1a-575d-418f-a8ea-1fa49caa40e8 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 22:01:32.211028 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-2730ff1a-575d-418f-a8ea-1fa49caa40e8 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 22:01:32.217456 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2730ff1a-575d-418f-a8ea-1fa49caa40e8 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:32.217936 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2730ff1a-575d-418f-a8ea-1fa49caa40e8 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:32.218743 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2730ff1a-575d-418f-a8ea-1fa49caa40e8 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:32.219196 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-2730ff1a-575d-418f-a8ea-1fa49caa40e8 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:32.375767 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-2730ff1a-575d-418f-a8ea-1fa49caa40e8 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 22:01:32.385393 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-2730ff1a-575d-418f-a8ea-1fa49caa40e8 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1684 microversion: 2.1 time: 0.178840 Mar 12 22:01:32.386191 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5621/6389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 22:01:32 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 22:01:33.404345 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-9ccd85e1-a807-4dda-8ea7-dce36e1bf0e9 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 22:01:33.405032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-9ccd85e1-a807-4dda-8ea7-dce36e1bf0e9 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 22:01:33.411688 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ccd85e1-a807-4dda-8ea7-dce36e1bf0e9 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:33.412158 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ccd85e1-a807-4dda-8ea7-dce36e1bf0e9 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:33.412930 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ccd85e1-a807-4dda-8ea7-dce36e1bf0e9 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:33.413384 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-9ccd85e1-a807-4dda-8ea7-dce36e1bf0e9 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:33.549665 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-9ccd85e1-a807-4dda-8ea7-dce36e1bf0e9 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 22:01:33.557106 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-9ccd85e1-a807-4dda-8ea7-dce36e1bf0e9 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1565 microversion: 2.1 time: 0.156773 Mar 12 22:01:33.557842 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5622/6390] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 22:01:33 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 22:01:34.497473 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-22ac306a-50cc-4af1-9235-a6c7cb0ee4fb req-28c8b84e-da83-47b1-9ef1-b0479adba551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4cd8ed2-f993-49d5-a015-f834295370c7", "name": "network-vif-deleted", "tag": "26b81367-e8ea-4aba-937d-c64353752fdf"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 22:01:34.509500 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-22ac306a-50cc-4af1-9235-a6c7cb0ee4fb req-28c8b84e-da83-47b1-9ef1-b0479adba551 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:34.510006 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-22ac306a-50cc-4af1-9235-a6c7cb0ee4fb req-28c8b84e-da83-47b1-9ef1-b0479adba551 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:34.522146 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-22ac306a-50cc-4af1-9235-a6c7cb0ee4fb req-28c8b84e-da83-47b1-9ef1-b0479adba551 service nova] Creating event network-vif-deleted:26b81367-e8ea-4aba-937d-c64353752fdf for instance e4cd8ed2-f993-49d5-a015-f834295370c7 on nch2-master-1 Mar 12 22:01:34.527317 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-22ac306a-50cc-4af1-9235-a6c7cb0ee4fb req-28c8b84e-da83-47b1-9ef1-b0479adba551 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033577 Mar 12 22:01:34.527955 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5623/6391] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 22:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 22:01:34.576285 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-5037c94e-e225-4405-854f-af5ee00a7595 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 22:01:34.577267 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-5037c94e-e225-4405-854f-af5ee00a7595 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 22:01:34.584394 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5037c94e-e225-4405-854f-af5ee00a7595 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:34.584862 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5037c94e-e225-4405-854f-af5ee00a7595 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:34.586261 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5037c94e-e225-4405-854f-af5ee00a7595 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:34.586757 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5037c94e-e225-4405-854f-af5ee00a7595 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:34.620192 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5037c94e-e225-4405-854f-af5ee00a7595 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:34.620659 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-5037c94e-e225-4405-854f-af5ee00a7595 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:34.621131 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-5037c94e-e225-4405-854f-af5ee00a7595 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lazy-loading 'fault' on Instance uuid e4cd8ed2-f993-49d5-a015-f834295370c7 {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 22:01:34.661949 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-5037c94e-e225-4405-854f-af5ee00a7595 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 22:01:34.669367 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-5037c94e-e225-4405-854f-af5ee00a7595 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 200 len: 1338 microversion: 2.1 time: 0.098091 Mar 12 22:01:34.670174 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5624/6392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 22:01:34 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 1338 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 22:01:35.686713 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-797f3f5b-13bb-4181-9497-cd4739fe5d14 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 22:01:35.687372 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-797f3f5b-13bb-4181-9497-cd4739fe5d14 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: e4cd8ed2-f993-49d5-a015-f834295370c7] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 22:01:35.696223 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-797f3f5b-13bb-4181-9497-cd4739fe5d14 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:35.696725 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-797f3f5b-13bb-4181-9497-cd4739fe5d14 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:35.697573 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-797f3f5b-13bb-4181-9497-cd4739fe5d14 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:35.698064 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-797f3f5b-13bb-4181-9497-cd4739fe5d14 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:35.711847 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-797f3f5b-13bb-4181-9497-cd4739fe5d14 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] HTTP exception thrown: Instance e4cd8ed2-f993-49d5-a015-f834295370c7 could not be found. Mar 12 22:01:35.712465 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-797f3f5b-13bb-4181-9497-cd4739fe5d14 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Returning 404 to user: Instance e4cd8ed2-f993-49d5-a015-f834295370c7 could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 22:01:35.713310 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-797f3f5b-13bb-4181-9497-cd4739fe5d14 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7" status: 404 len: 111 microversion: 2.1 time: 0.030560 Mar 12 22:01:35.713873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5625/6393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 22:01:35 2022] GET /compute/v2.1/servers/e4cd8ed2-f993-49d5-a015-f834295370c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 22:01:37.058340 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-29fcf8e5-861e-45cc-bd99-94c7d72656cf tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 22:01:37.058944 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-29fcf8e5-861e-45cc-bd99-94c7d72656cf tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 22:01:37.066358 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29fcf8e5-861e-45cc-bd99-94c7d72656cf tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:37.066842 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29fcf8e5-861e-45cc-bd99-94c7d72656cf tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:37.067653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29fcf8e5-861e-45cc-bd99-94c7d72656cf tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:37.068122 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-29fcf8e5-861e-45cc-bd99-94c7d72656cf tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:37.094758 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-29fcf8e5-861e-45cc-bd99-94c7d72656cf tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Going to try to terminate instance {{(pid=136302) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 12 22:01:37.178515 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-29fcf8e5-861e-45cc-bd99-94c7d72656cf tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 204 len: 0 microversion: 2.1 time: 0.123942 Mar 12 22:01:37.179545 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5626/6394] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Mar 12 22:01:37 2022] DELETE /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 12 22:01:37.241297 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-ed03bf8e-5eb9-4dd5-b88c-96a0abb9bfb4 req-39aa28cf-cf28-47c5-9666-71f3f6ef427c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73669ed-0924-498f-b913-f4120381e01f", "tag": "ddfc7ade-f99c-4665-b85a-9d3ced4efa43"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 22:01:37.249317 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ed03bf8e-5eb9-4dd5-b88c-96a0abb9bfb4 req-39aa28cf-cf28-47c5-9666-71f3f6ef427c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:37.249801 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-ed03bf8e-5eb9-4dd5-b88c-96a0abb9bfb4 req-39aa28cf-cf28-47c5-9666-71f3f6ef427c service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:37.261484 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-ed03bf8e-5eb9-4dd5-b88c-96a0abb9bfb4 req-39aa28cf-cf28-47c5-9666-71f3f6ef427c service nova] Creating event network-changed:ddfc7ade-f99c-4665-b85a-9d3ced4efa43 for instance d73669ed-0924-498f-b913-f4120381e01f on nch1-master-1 Mar 12 22:01:37.266514 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-ed03bf8e-5eb9-4dd5-b88c-96a0abb9bfb4 req-39aa28cf-cf28-47c5-9666-71f3f6ef427c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085459 Mar 12 22:01:37.267181 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5627/6395] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 22:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 12 22:01:37.273311 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c92c1205-3a33-4f27-ae38-4eeb4951d9dd tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 22:01:37.274109 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c92c1205-3a33-4f27-ae38-4eeb4951d9dd tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 22:01:37.280272 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c92c1205-3a33-4f27-ae38-4eeb4951d9dd tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:37.280746 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c92c1205-3a33-4f27-ae38-4eeb4951d9dd tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:37.281548 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c92c1205-3a33-4f27-ae38-4eeb4951d9dd tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:37.282032 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c92c1205-3a33-4f27-ae38-4eeb4951d9dd tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:37.432246 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c92c1205-3a33-4f27-ae38-4eeb4951d9dd tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 22:01:37.443298 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c92c1205-3a33-4f27-ae38-4eeb4951d9dd tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1682 microversion: 2.1 time: 0.174094 Mar 12 22:01:37.444303 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5628/6396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 22:01:37 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 12 22:01:38.505733 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-a054bf66-24b2-4b45-afe4-ad5438a73851 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 22:01:38.506455 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-a054bf66-24b2-4b45-afe4-ad5438a73851 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 22:01:38.512686 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a054bf66-24b2-4b45-afe4-ad5438a73851 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:38.513161 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a054bf66-24b2-4b45-afe4-ad5438a73851 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:38.514009 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a054bf66-24b2-4b45-afe4-ad5438a73851 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:38.514469 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-a054bf66-24b2-4b45-afe4-ad5438a73851 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:38.645865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-a054bf66-24b2-4b45-afe4-ad5438a73851 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 22:01:38.653504 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-a054bf66-24b2-4b45-afe4-ad5438a73851 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1563 microversion: 2.1 time: 0.196438 Mar 12 22:01:38.654118 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5629/6397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 22:01:38 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1563 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 22:01:39.463614 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [req-827351c8-3fe2-43db-affd-454d0221e337 req-5786083d-a147-4456-acb2-6ae5a6bc1574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73669ed-0924-498f-b913-f4120381e01f", "name": "network-vif-deleted", "tag": "ddfc7ade-f99c-4665-b85a-9d3ced4efa43"}]} {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 12 22:01:39.473108 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-827351c8-3fe2-43db-affd-454d0221e337 req-5786083d-a147-4456-acb2-6ae5a6bc1574 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:39.473580 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [req-827351c8-3fe2-43db-affd-454d0221e337 req-5786083d-a147-4456-acb2-6ae5a6bc1574 service nova] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:39.484912 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.compute.server_external_events [req-827351c8-3fe2-43db-affd-454d0221e337 req-5786083d-a147-4456-acb2-6ae5a6bc1574 service nova] Creating event network-vif-deleted:ddfc7ade-f99c-4665-b85a-9d3ced4efa43 for instance d73669ed-0924-498f-b913-f4120381e01f on nch1-master-1 Mar 12 22:01:39.490326 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [req-827351c8-3fe2-43db-affd-454d0221e337 req-5786083d-a147-4456-acb2-6ae5a6bc1574 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031684 Mar 12 22:01:39.490926 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5630/6398] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Mar 12 22:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 12 22:01:39.670328 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-c65e4ff3-d615-4266-afbf-1271709405d4 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 22:01:39.670956 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-c65e4ff3-d615-4266-afbf-1271709405d4 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 22:01:39.677401 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65e4ff3-d615-4266-afbf-1271709405d4 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:39.677865 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65e4ff3-d615-4266-afbf-1271709405d4 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:39.678653 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65e4ff3-d615-4266-afbf-1271709405d4 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:39.679113 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65e4ff3-d615-4266-afbf-1271709405d4 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:39.709633 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65e4ff3-d615-4266-afbf-1271709405d4 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:39.710386 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-c65e4ff3-d615-4266-afbf-1271709405d4 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:39.711084 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.objects.instance [None req-c65e4ff3-d615-4266-afbf-1271709405d4 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lazy-loading 'fault' on Instance uuid d73669ed-0924-498f-b913-f4120381e01f {{(pid=136302) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 12 22:01:39.756229 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.policy [None req-c65e4ff3-d615-4266-afbf-1271709405d4 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279dd1ec634148c8acd450c086b41b4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8417f1bcfb484822a911f003d0a9898f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136302) authorize /opt/stack/nova/nova/policy.py:199}} Mar 12 22:01:39.764230 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-c65e4ff3-d615-4266-afbf-1271709405d4 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 200 len: 1337 microversion: 2.1 time: 0.098198 Mar 12 22:01:39.764822 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5631/6399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 22:01:39 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 1337 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 12 22:01:40.782460 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39bf61c5-e566-41fb-9932-b4cab8271300 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 22:01:40.783144 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.compute.api [None req-39bf61c5-e566-41fb-9932-b4cab8271300 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] [instance: d73669ed-0924-498f-b913-f4120381e01f] Fetching instance by UUID {{(pid=136302) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 12 22:01:40.790430 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39bf61c5-e566-41fb-9932-b4cab8271300 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:40.790906 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39bf61c5-e566-41fb-9932-b4cab8271300 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:40.791705 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39bf61c5-e566-41fb-9932-b4cab8271300 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 12 22:01:40.792167 ncdv-master-1 devstack@n-api.service[136302]: DEBUG oslo_concurrency.lockutils [None req-39bf61c5-e566-41fb-9932-b4cab8271300 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Lock "4c4d5282-7cc3-4af0-ad9b-94df8d06175d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 12 22:01:40.805878 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.wsgi [None req-39bf61c5-e566-41fb-9932-b4cab8271300 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] HTTP exception thrown: Instance d73669ed-0924-498f-b913-f4120381e01f could not be found. Mar 12 22:01:40.806498 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-39bf61c5-e566-41fb-9932-b4cab8271300 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Returning 404 to user: Instance d73669ed-0924-498f-b913-f4120381e01f could not be found. {{(pid=136302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 12 22:01:40.807335 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-39bf61c5-e566-41fb-9932-b4cab8271300 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f" status: 404 len: 111 microversion: 2.1 time: 0.028960 Mar 12 22:01:40.807873 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5632/6400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Mar 12 22:01:40 2022] GET /compute/v2.1/servers/d73669ed-0924-498f-b913-f4120381e01f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 12 22:01:40.963722 ncdv-master-1 devstack@n-api.service[136302]: DEBUG nova.api.openstack.wsgi [None req-997a6338-6c41-4315-a12e-d49f1d121538 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] Calling method '.version_select at 0x7f6e353950d0>' {{(pid=136302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 12 22:01:40.990154 ncdv-master-1 devstack@n-api.service[136302]: INFO nova.api.openstack.requestlog [None req-997a6338-6c41-4315-a12e-d49f1d121538 tempest-TestSnapshotPattern-12580164 tempest-TestSnapshotPattern-12580164-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-306382837" status: 202 len: 0 microversion: 2.1 time: 0.030283 Mar 12 22:01:40.990747 ncdv-master-1 devstack@n-api.service[136302]: [pid: 136302|app: 0|req: 5633/6401] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Mar 12 22:01:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-306382837 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 12 22:01:53.239531 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:01:53.240185 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 22:01:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 22:01:55.690157 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:01:55.691356 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 22:01:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 22:03:27.566827 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:03:27.567587 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 22:03:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 22:04:45.157908 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:04:45.158486 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 22:04:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 22:04:45.242538 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:04:45.242716 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 22:04:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 22:04:47.037131 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:04:47.037730 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 22:04:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 22:05:13.247960 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:05:13.248587 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 22:05:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 22:05:15.699675 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:05:15.700312 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 22:05:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 22:06:47.575427 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:06:47.576102 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 22:06:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 22:08:05.166884 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:08:05.167472 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 22:08:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 22:08:05.249741 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:08:05.249984 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 22:08:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 22:08:07.044961 ncdv-master-1 devstack@n-api.service[136302]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:08:07.045677 ncdv-master-1 devstack@n-api.service[136302]: Sat Mar 12 22:08:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 12 22:08:33.256877 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:08:33.257466 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 22:08:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 22:08:35.708985 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:08:35.709544 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 22:08:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!! Mar 12 22:10:07.583982 ncdv-master-1 devstack@n-api.service[136303]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 12 22:10:07.584716 ncdv-master-1 devstack@n-api.service[136303]: Sat Mar 12 22:10:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ae82842-58a0-4d5e-a522-a1c83c53e101 (ip 10.222.0.30) !!!